Scott Yara, President of Pivotal said he hopes Hadoop developer Cloudera will opt to join the recently formed Open Data Platform group.

Speaking to CBR Yara said Cloudera and Hortonworks have very different philosophies in their approach to the market.

"Cloudera decided not to participate [at the formation of the Open Data Platform] and I respect their decision and our hope is they absolutely will join because we think it is the right thing to do," Yara told CBR.

He said Pivotal believes that what was true for Linux is just as true for Hadoop so the Open Data Platform initiative was announced with IBM, Hortonworks, Teradata, SAS, Verizon, Splunk, Centurylink and others.

The idea for ODP is to standardise on a common core of components in the Hadoop ecosystem that are version tested and certified to work together and are common across commercial distributions, Yara said.

"We think the industry rallying around a common core will allow a much broader adoption of Hadoop in the enterprise, a much better development environment and a much better for service providers," said Yara.

Cloudrea and Hortonworks emerged as the dominant open source contributors over the last five years providing commercial distributions of Hadoop. But they have very different philosophies in their approach to the market.

"Cloudera took a conventional approach to commercial open source – they provide their own distribution and have a bunch of proprietary enhancements to it. And they have been successful. Hortonworks says we’re a 100% open source distribution. Everything is based on Open Apache projects. That’s where we felt a sense of alignment with Hortonworks because the Cloud Foundry experience gave us a relevant contact."

Yesterday at the Hadoop summit in Brussels Pivotal announced the release of open source core of Gemfire, a distrbuted in-memory database.