Hortonworks has been using the Hadoop Summit in Dublin to push forward its big data alliances and technology.
The first move the Hadoop vendor revealed is an expanded partnership with Pivotal that is centred on the Hortonworks Data Platform and Pivotal HDB.
The partnership will bring together Hortonworks support for data management and processing with Pivotal’s analytics engine for Hadoop and will include Pivotal standardising its HDP support subscription software that is 100% identical to the Hortonworks Data Platform(HDP).
This means that customers will get access to security, governance and operations functionality by from HDP.
In addition to this, Hortonworks will offer customer support and implementation services for HDB that will be powered by Apache HAWQ.
This isn’t the only partnership that Hortonworks has been working on as it has also partnered with Syncsort to provide optimised ETL on-boarding for Hadoop.
Collaborations between Hadoop vendors were expected before the event and Hortonworks certainly seems to be active in this department.
The work being done together with Syncsort will see the two deliver an integrated solution to help customers to easily migrate data onto HDP. As part of the deal, Hortonworks will resell Syncsort’s DMX-h solution for on-boarding ETL processing in Hadoop.
The idea behind this is to create a key solution for integrating legacy ETL flows in Connected Data Platforms, which are at the centre of data and analytics architectures and require on-boarding of data from other systems as a key component.
In what is more of a solo effort compared to the partnership work being done, Hortonworks has updated its data platform with an extended services release.
Included in the release is the integration of Apache Ranger for security and Apache Atlas for data governance. Businesses will be able to use Atlas to classify and assign metadata tags, which can then be enforced through Ranger to enable various access policies.
The company has also added Cloudbreak, a service which allows for the automated provisioning of Hadoop in any cloud. The update expands support for OpenStack for private cloud and Windows Azure Storage Blob for Microsoft Azure.
Further simplification work has also been done to simplify cluster operations with the upcoming release of Apache Ambari. Ambari features pre-built HDFS, YARN, Hive, and HBase.
Additional capabilities for users have also been added through Apache Zeppelin, a browser-based user interface that aims to provide a notebook-style capability for analysts and data scientists to interactively look at their data and perform data analytics.
As is standard when it comes to dealing with data, security is an important issue. With this in mind, Hortonworks is improving its security with Apache Metron.
Metron is an incubating open source project that is dedicated to providing an extensible and scalable security analytics platform which is capable of detecting and mitigating security risks in real-time.
Metron achieved incubator status in the Apache Software Foundation in December last year and is the next evolution of Security Incident event Management.
The technology is basically designed to tap into the increasing need for tools that operate in real-time and dealing with large volumes of data.
