Big Data companies Syncsort and Impetus Technologies have announced a new partnership.

The purpose of the partnership will be to provide an integrated solution for building real-time, streaming analytics integrated with Apache Kafka, RabbitMQ and other message brokers on Hadoop.

While Apache Storm is a powerful open source computational engine for real-time Big Data applications on Hadoop, it can often be difficult to use when integrated with Kafka.

To solve this problem, Syncsort will integrate its DMX-h data integration software with Impetus’ StreamAnalytix platform. This should lead to a simplification of real-time analytics application creation.

Jeff Kelly, principal research contributor, the Wikibon Project, said: "Partnerships make it easier for Big Data practitioners to adopt and integrate the latest Hadoop-based technologies."

"The integrated solution from Syncsort and Impetus will be a significant contribution to the Apache Hadoop ecosystem, facilitating real-time analytics."

The joint offering is aiming to remove the obstacles to building streaming analytics application on Hadoop, which should result in less of a difference between batch and real-time workloads.

Tendu Yogurtcu, general manager of Syncsort’s Big Data business unit, said: "Many of our customers are looking to get Big Data analytics in real-time, which is why we see strong and growing interest in streaming ETL use cases."

"We are delighted that Impetus has joined our technology partner program and is working with us to integrate their StreamAnalytix platform with our flagship Hadoop-based data integration software, Syncsort DMX-h. Now users will be able to use our simple drag-and-drop interface to create real-time data pipelines."

Streaming analytics applications address key use cases in areas such as the Internet of Things, e-commerce, security, fraud and other analytics functions.

Anand Venugopal, senior director of business development for StreamAnalytix at Impetus, said: "There is strong demand in large enterprises for a way to create real-time streaming analytics applications without straining IT resources and skill sets."

"With Syncsort’s industry-leading Hadoop technology, our new StreamAnalytix platform and our experienced Big Data analytics services consulting team, we will be able to address this market demand."