View all newsletters
Receive our newsletter - data, insights and analysis delivered to you
  1. Technology
  2. Data
August 15, 2014

How MIT’s latest data-visualisation tool can improve cost savings and efficiency

The tool could help businesses to better understand their data.

By Amy-Jo Crowley

Researchers at the Massachusetts Institute of Technology (MIT) have released a data visualisation tool, which they claim allows users to highlight patterns and determine which data sources are responsible for which.

The new tool, dubbed DBWipes, could be used to identify abberations, for example, faulty sensors that are corrupting a regular pattern of readings or variables that are affecting a company’s sales figures, according to MIT’s Computer Science and Artificial Intelligence Laboratory.

Samuel Madden, a professor of computer science and engineering and one of the Database Group’s leaders, said: "If you look at the way people traditionally produce visualisations of any sort, they would have some big, rich data set — that has maybe hundreds of millions of data points, or records – and they would do some reduction of the set to a few hundred or thousands of records at most.

"The problem with doing that sort of reduction is that you lose information about where those output data points came from relative to the input data set. If one of these data points is crazy – is an outlier, for example – you don’t have any real ability to go back to the data set and ask, ‘Where did this come from and what were its properties?’"

Developed in collaboration with engineering graduate Eugene Wu and Professor Michael Stonebraker, DBWipes includes a "provenance tracking" system for large data sets in efforts to solve this problem.

The researchers claim the provenance-tracking system provides a compact representation of the source of the summarised data, allowing users to trace visualised data back to the source.

Content from our partners
How businesses can safeguard themselves on the cyber frontline
How hackers’ tactics are evolving in an increasingly complex landscape
Green for go: Transforming trade in the UK

The researchers also worked on an algorithm called Scorpion, which is designed to track down the records responsible for aspects of a DBWipes visualisation and efficiently recalculates the visualisation to either exclude or emphasise the data they contain.

The idea was driven by a study at a Boston hospital, which revealed that a number of patients were incurring much higher treatment costs than the rest.

The researchers found that the difference in costs was explained by a single variable: their doctors, who prescribed more treatment than their colleagues.

Websites in our network
Select and enter your corporate email address Tech Monitor's research, insight and analysis examines the frontiers of digital transformation to help tech leaders navigate the future. Our Changelog newsletter delivers our best work to your inbox every week.
  • CIO
  • CTO
  • CISO
  • CSO
  • CFO
  • CDO
  • CEO
  • Architect Founder
  • MD
  • Director
  • Manager
  • Other
Visit our privacy policy for more information about our services, how New Statesman Media Group may use, process and share your personal data, including information on your rights in respect of your personal data and how you can unsubscribe from future marketing communications. Our services are intended for corporate subscribers and you warrant that the email address submitted is your corporate email address.
THANK YOU