View all newsletters
Receive our newsletter - data, insights and analysis delivered to you
  1. Technology
  2. Cloud
November 15, 2017updated 16 Nov 2017 11:33am

Microsoft adds a Spark to Azure

Microsoft re-ignites the 2016 love for Apache Spark by optimising it for Azure.

By James Nunns

Microsoft is helping its customers to get to grips with their data on its cloud platform with the addition of Databricks.

The Apache Spark based data analytics platform, will appear as Azure Databricks in the Azure Portal, as part of the partnership between the two companies.

The link-up is said to address the customer demand for Apache Spark on Azure.

“Our alliance with Microsoft is a major milestone for the growth of Databricks’ Unified Analytics Platform,” said Ali Ghodsi, cofounder and CEO at Databricks. “There’s a large base of Microsoft Azure customers looking for a high-performance analytics platform based on Spark – and Databricks is already the leading Cloud platform for Spark. These organizations will be able to simplify Big Data and AI with Azure Databricks.”

The Azure Databricks tool will use the core functionality of Databricks’ Unified Analytics Platform, which includes things like a collaborative work space for Data Science and Data Engineering teams.

Image result for databricks

there is also a single, unified engine for all types of analytics – the usual suspects of batch, ad hoc, machine learning, and deep learning, streaming, graph, and a serverless cloud infrastructure that is fully managed.

Content from our partners
Scan and deliver
GenAI cybersecurity: "A super-human analyst, with a brain the size of a planet."
Cloud, AI, and cyber security – highlights from DTX Manchester

The preview, which was announced at Microsoft Connect 2017, came alongside a number of other announcements from the company.

Microsoft also announced a Cassandra API preview for Azure Cosmos DB that is said to expand on the multi-model capabilities of Azure Cosmos DB so that Cassandra can be offered as-a-Service over turnkey global distribution.

Cisco Sparkles in the board room with new AI assistant
Microsoft adds a Spark to Machine Learning Library for data scientists
Intel open sources deep learning with BigDL for Apache Spark

There’s also a new cloud service for developers in the form of Visual Studio App Centre GA. The idea of the service is to ship higher quality applications more frequently.

Azure DevOps Projects will give developers the ability to configure a full DevOps pipeline and connect to Azure in 5 minutes – according to the company.

Azure IoT Edge is now available in preview, this is the company’s play to enable AI, advanced analytics, and machine learning at the edge, or IoT devices.

The final announcement is the preview of Azure SQL Database Machine Learning services. There’s now support for R models inside SQL Database, meaning that data scientists will be able to train models in Azure Machine Learning and then deploy them directly to the SQL Database on the cloud platform.

Topics in this article : , ,
Websites in our network
Select and enter your corporate email address Tech Monitor's research, insight and analysis examines the frontiers of digital transformation to help tech leaders navigate the future. Our Changelog newsletter delivers our best work to your inbox every week.
  • CIO
  • CTO
  • CISO
  • CSO
  • CFO
  • CDO
  • CEO
  • Architect Founder
  • MD
  • Director
  • Manager
  • Other
Visit our privacy policy for more information about our services, how Progressive Media Investments may use, process and share your personal data, including information on your rights in respect of your personal data and how you can unsubscribe from future marketing communications. Our services are intended for corporate subscribers and you warrant that the email address submitted is your corporate email address.