View all newsletters
Receive our newsletter - data, insights and analysis delivered to you
  1. What Is
March 20, 2017updated 27 Oct 2022 3:45pm

What is big data?

Big data has inspired a great deal of hype over the past decade, but what is it?

By James Nunns

Big Data is a term used for large data sets which are so huge that traditional software cannot deal with them. In a business sense, the term also refers to extremely large data sets that can be analysed to reveal patterns, trends and various insights. The rise of big data in business is being pushed by the exponential growth and availability of data, both structured and unstructured.

There are a number of challenges surrounding the industry, including capture, storage, analysis, curation, search, sharing, transfer, visualisation, querying, updating and information privacy.

While there are many misconceptions, such as believing that it is necessary to collect and store large amounts of your own data, it cannot be denied that this buzzword has great significance to businesses and the world.

Industry analyst Doug Laney said in 2001 that the mainstream definition of big data consists of three V’s: volume, velocity and variety.

big data
(Image: Shutterstock)

What are the three Vs in big data?

Volume simply means that there is more data. This could be from transactional data that has been stored over the years, unstructured data which can be from social media or sensor and machine data that is being collected.

Velocity refers to the speed at which data is streaming from sensors, smart metering and RFID tags. This has helped to drive an increase in the need to analyse data in real-time.

The third V is variety, which looks at the various different formats that data comes in. These different formats include structured data, numeric data, data created from a line of business applications, unstructured data and financial transaction data, in addition to others.

Some companies such as SAS consider there to be two additional ‘V’s: variability and veracity.

Content from our partners
Why food manufacturers must pursue greater visibility and agility
How to define an empowered chief data officer
Financial management can be onerous for CFOs, but new tech is helping lighten the load

Variability looks at the inconsistency of data flows, such as social media activity that reacts to an event to create an increase in usage.

Veracity refers to the fact that data is coming from multiple different sources which can be difficult to keep consistent.

Topics in this article:
Websites in our network
Select and enter your corporate email address Tech Monitor's research, insight and analysis examines the frontiers of digital transformation to help tech leaders navigate the future. Our Changelog newsletter delivers our best work to your inbox every week.
  • CIO
  • CTO
  • CISO
  • CSO
  • CFO
  • CDO
  • CEO
  • Architect Founder
  • MD
  • Director
  • Manager
  • Other
Visit our privacy policy for more information about our services, how New Statesman Media Group may use, process and share your personal data, including information on your rights in respect of your personal data and how you can unsubscribe from future marketing communications. Our services are intended for corporate subscribers and you warrant that the email address submitted is your corporate email address.
THANK YOU