View all newsletters
Receive our newsletter - data, insights and analysis delivered to you
  1. Technology
  2. Data
June 26, 2014

Google ditches MapReduce for its own Cloud Dataflow

The analytics service is based on Google’s own technologies Flume and MillWheel.


Google has replaced its MapReduce analytics service in favour of a cloud analytics system it has built called Cloud Dataflow.

MapReduce is based on the popular Apache Hadoop-based analytics platform and analyses data in batch mode, which allows companies to build their own big data application using low-cost hardware.

Cloud Dataflow, announced at Google’s I/O keynote in San Francisco, is based on Google’s own technologies, Flume and MillWheel, and does not have the same scaling restrictions of MapReduce.

The service, which is not yet available to developers, claims to allow companies to more easily build complex ‘data pipelines’, view trends and be alerted to insights in real-time.

Cloud Dataflow is expected to take on Amazon Web Services’ Redshift, a datawarehouse service, and Elastic MapReduce, which uses Hadoop to crunch large datasets.

Other services announced on Google’s cloud platform include Cloud Save, Cloud Debugging, Cloud Tracing, which provides latency statistics across different groups, and Cloud Monitoring.

Content from our partners
Why enterprises of all sizes must  embrace smart manufacturing solutions
European Technology Leadership: Deutsche Bank CTO Gordon Mackechnie
Print’s role in driving the environmental agenda

Websites in our network
NEWSLETTER Sign up Tick the boxes of the newsletters you would like to receive. Tech Monitor's research, insight and analysis examines the frontiers of digital transformation to help tech leaders navigate the future. Our Changelog newsletter delivers our best work to your inbox every week.
I consent to New Statesman Media Group collecting my details provided via this form in accordance with the Privacy Policy