Big Data: Four New Governance Challenges

Loraine Lawson
Slide Show

Looking Ahead at the 2015 Business Intelligence Landscape

Before you move forward with Big Data, you’ll need to evolve your approach to data governance, experts say.

By now, most organizations are familiar with the basics of data governance: Identify the data owner, appoint a data steward, and so on. While those concepts are still essential to data governance, Big Data introduces new challenges that will require new adaptations.

“The arrival of Big Data should compel enterprises to re-think their approach to conventional data governance,” writes Dan O’Brien for Inside Analysis. “Everything about Big Data – its context, provenance, speed, scale and ‘cleanliness’ – extends data governance far beyond traditional, rigid databases, where it’s already an issue.”

Here’s a look at the new challenges Big Data introduces:

Data Roles: It may be easy to identify who owns all the data in an enterprise app, but data ownership and stewardship become trickier with big datasets. For instance, who are the stewards for your click stream data? The data may also be generated by multiple individuals, according to Avi Kalderon,  NewVantage Partners’ practice leader for Big Data and Analytics. Roles can even change during the data’s lifecycle, he notes.

Broader Business Involvement: Business should always be involved with data governance, but now it will be involved on a much broader scale. In part, that’s because Big Data is an enterprise-wide endeavor, as opposed to data initiatives that target individual business units. But it’s also because the rules aren’t always so clear, as O’Brien explains. For instance, how long do you need to store web logs? Do you need to retain all social media data or only a subset of it? “Data governance is more than a small group of people tasked with making sure that the quality of data coming into the organization is good,” writes Kalderon. “It’s an enterprise effort where many can contribute.”

Business Buy-in: Because more of the business is involved, you’ll also need broader business buy-in. During the early stages, Big Data governance really only required executive buy-in, but now, you’ll need to convince middle management — and they tend to be skeptics, Kalderon warns. Business users will also need to buy into the education and training efforts required for Big Data governance.

Technical Challenges: Big Data will make you appreciate all the little things your relational database management system does for you. For instance, metadata management is built into these systems, but for Big Data technologies, it’s a bit more manual. Other technical issues that come with Big Data are tagging, maintaining data lineage and additional data quality challenges created by using external data sets or merging internal data, according to QuinStreet’s Turning Big Data into Useful Information.

Loraine Lawson is a veteran technology reporter and blogger. She currently writes the Integration blog for IT Business Edge, which covers all aspects of integration technology, including data governance and best practices. She has also covered IT/Business Alignment and IT Security for IT Business Edge. Before becoming a freelance writer, Lawson worked at TechRepublic as a site editor and writer, covering mobile, IT management, IT security and other technology trends. Previously, she was a webmaster at the Kentucky Transportation Cabinet and a newspaper journalist. Follow Lawson at Google+ and on Twitter.

Add Comment      Leave a comment on this blog post
Feb 2, 2015 12:09 PM RSeiner RSeiner  says:
You stated that ... By now, most organizations are familiar with the basics of data governance: Identify the data owner, appoint a data steward, and so on. ... I have a problem with this statement. :) While I agree that theses things are considered by many to be the basics of data governance, they are also what is standing in our way to success. The truth is that there really should not be an owner of the data as the enterprise owns the data and the term ownership implies exactly the wrong thing -- "my data and I can do what I want". The second issue is with the words "appoint data stewards". Data stewards must be identified and recognized rather then be assigned or appointed. People should be held formally accountable depending on their relationship to the data they define, produce and use. In this case almost everybody is a data steward and we must have a program to help them become more efficient and effective in how they govern the data. I would love to discuss this further. Please reach out if you are interested. Reply
Nov 9, 2015 1:23 AM kyvos kyvos  says:
Agree with good Insights! Big Data is everywhere, and seen as one of the world’s biggest IT related economic and societal challenges. The rapid expansion of the web and the explosive evolution of software and hardware technology have resulted in immense amounts of digital data. Identify actual legal, ethical, economic and political challenges in big data by exploring both positive and negative impacts of big data using tools and technology its really challenge for new governance too. Nice to read post. Thank you! Reply

Post a comment





(Maximum characters: 1200). You have 1200 characters left.



Subscribe to our Newsletters

Sign up now and get the best business technology insights direct to your inbox.