Debunking 5 of the Biggest Data Myths
With so much hype about big data, it's difficult for data managers and IT leaders to understand how to exploit datas potential. Gartner, Inc. dispels five myths to help IT leaders evolve their information infrastructure strategies.
Debunking 5 of the Biggest Data Myths
With so much hype about big data, it's difficult for data managers and IT leaders to understand how to exploit datas potential. Gartner, Inc. dispels five myths to help IT leaders evolve their information infrastructure strategies. This presentation originated at Information Management magazine.
Myth 1: Everyone Is Ahead of Us in Adopting Big Data

Interest in big data technologies and services is at a record high, with 73 percent of the organizations Gartner surveyed in 2014 investing or planning to invest in them.
Reality: Gartner finds that most organizations are still in the very early stages of adoption only 13 percent of those surveyed had deployed these solutions. Gartner reports that the biggest challenges organizations face are to determine how to obtain value from big data, and how to decide where to start. Further, many organizations get stuck at the pilot stage because they don't tie the technology to business processes or concrete use cases.
Myth 2: We Have So Much Data, We Don't Need to Worry About Every Little Data Flaw

IT leaders believe that the huge volume of data that organizations now manage makes individual data quality flaws insignificant.
Reality: "In reality, although each individual flaw has a much smaller impact on the whole data set than it did when there was less data, there are more flaws than before because there is more data," said Ted Friedman, vice president and distinguished analyst at Gartner. "Therefore, the overall impact of poor-quality data on the whole data set remains the same. In addition, much of the data that organizations use in a big data context comes from outside, or is of unknown structure and origin. This means that the likelihood of data quality issues is even higher than before. So data quality is actually more important in the world of big data."
Myth 3: Big Data Technology Will Eliminate the Need for Data Integration

The general view is that big data technology will enable organizations to read the same sources using multiple data models.
Reality: Gartner states that most information users rely significantly on "schema on write" scenarios in which data is described, content is prescribed, and there is agreement about the integrity of data and how it relates to the scenarios.
Myth 4: It's Pointless Using a Data Warehouse for Advanced Analytics

Many information management leaders consider building a data warehouse to be a time-consuming and pointless exercise when advanced analytics use new types of data beyond the data warehouse.
Reality: Many advanced analytics projects use a data warehouse during the analysis. In other cases, IM leaders must refine new data types that are part of big data to make them suitable for analysis. Gartner identifies the need for IM leaders to decide which data is relevant, how to aggregate it and the level of data quality necessary, and notes that this data refinement can happen in places other than the data warehouse.
Myth 5: Data Lakes Will Replace the Data Warehouse

Vendors market data lakes as enterprise-wide data management platforms for analyzing disparate sources of data in their native formats.
Reality: Gartner says it's misleading for vendors to position data lakes as replacements for data warehouses or as critical elements of an analytical infrastructure. Further, Gartner states that a data lake's foundational technologies lack the maturity and breadth of the features found in established data warehouse technologies. "Data warehouses already have the capabilities to support a broad variety of users throughout an organization. IM leaders don't have to wait for data lakes to catch up," said Nick Heudecker, research director at Gartner.

Additional information is available in these Gartner reports (registration required):
Major Myths About Big Datas Impact on Information Infrastructure available here.
Major Myths About Big Datas Impact on Analytics available here.