View all newsletters
Receive our newsletter - data, insights and analysis delivered to you
  1. Technology
  2. Software
September 25, 2018updated 26 Jul 2022 10:30am

Apache Pulsar Emerges from Incubation  

Highly scalable, low latency messaging platform running on commodity hardware leaves the Apache incubator

By CBR Staff Writer

Apache Pulsar, a major project by the open source Apache Foundation, today emerged from a two-year incubation period as one of the foundation’s “top level” projects.

Apache Pulsar is a so-called “pub-sub” or publish/subscribe messaging system developed then open-sourced by Yahoo! in Sept. 2016.

It comes with a REST Admin API for provisioning, administration, tools and monitoring and can be deployed on bare metal or Kubernetes.

Pub/sub is a form of asynchronous service-to-service communication used in serverless and microservices architectures. It can be used to enable event-driven architectures (a framework to orchestrate behaviour around events and their responses) or to decouple applications in order to increase performance, reliability and scalability.

See also: Apache Software Foundation: myNewt Flourishing, Check; Cloud Migration, Check; Audit Passed; Check; Five-Year Plan? Check…

Apache Pulsar was described by the Foundation as: “Highly scalable, low latency messaging platform running on commodity hardware. It provides simple pub-sub and queue semantics over topics, lightweight compute framework, automatic cursor management for subscribers, and cross-datacenter replication.”

Apache Pulsar

Pulsar has run in production at Yahoo scale for over three years, with millions of messages per second across millions of topics and its original lead developer, Matteo Merli, the co-founder of Streamlio and recently named VP of Apache Pulsar said.

He added: “The fact that Apache Pulsar has gone from incubator project to top-level in two short years is a testament to the community growth around the project… it has become instrumental in a broad range of modern data-driven applications.”

Content from our partners
How designers are leveraging tech to apply the brakes to fast fashion
Why the tech sector must embrace faster, smarter talent recruitment
Sherif Tawfik: The Middle East and Africa are ready to lead on the climate

One Click Retail (owned by the UK’s Ascential) is one of the early adopters of the tool. The company’s Jowanza Joseph said: “Because of Pulsar’s unique combination of messaging and stream processing, we’ve been able to replace multiple systems with one solution that works seamlessly in our Kubernetes environment.”

He added: “Pulsar functions has allowed us to dramatically simplify our stream processing pipeline and to reduce the cost associated with production grade stream processing systems. Seeing Pulsar become a top-level Apache project is a great milestone that validates our confidence in the current and future innovations of Pulsar and the Pulsar community.”

Websites in our network
Select and enter your corporate email address Tech Monitor's research, insight and analysis examines the frontiers of digital transformation to help tech leaders navigate the future. Our Changelog newsletter delivers our best work to your inbox every week.
  • CIO
  • CTO
  • CISO
  • CSO
  • CFO
  • CDO
  • CEO
  • Architect Founder
  • MD
  • Director
  • Manager
  • Other
Visit our privacy policy for more information about our services, how New Statesman Media Group may use, process and share your personal data, including information on your rights in respect of your personal data and how you can unsubscribe from future marketing communications. Our services are intended for corporate subscribers and you warrant that the email address submitted is your corporate email address.
THANK YOU