Fact #5: Big Data theory is moving faster than the reality of what an enterprise is capable of from both a technology and manpower standpoint.
Since much of Big Data is derived from user-centric behavior and usage, it moves a lot faster than what an enterprise typically generates from its application systems. About 70 percent of the digital universe has been created by individuals, not corporations.
The primary reason why the Big Data theory is moving faster than its practice is to address the solution for managing such humongous amounts of data. Oceans of data will be created between now and the year 2020, resulting in a 4,300 percent increase in annual data generation as the macro drivers of user-generated data, along with the shift from analog to digital media, propel us to the next frontier.
The Big Data tsunami is also causing technologies to be modernized. What used to be stored in conventional RDBMS and later in NoSQL databases are insufficient and cannot be accessed by direct record access methods. The current technology of choice is not conventional RDBMS but a map-reduced database like Hadoop that operates off distributed hardware substrate.
As with cloud computing, Big Data is a hot topic around the business right now. Expectations for what it can achieve often reach into the stratosphere. At the same time, the overwhelming amount of data involved is daunting and can seem like an insurmountable obstacle. So what is Big Data, where does it come from, and what can you actually do with it? ThreatTrack Security has identified eight facts and eight fictions regarding Big Data.