Making Data Integration Easier

Loraine Lawson

Last week, I shared a great post, written by Robin Bloor, president of the Bloor Group and a partner with Hurwitz and Associates, that described precisely why data integration is so gosh-darn hard. Lack of standards, applications built without considering data sharing, and a lack of a metadata warehouse all made Bloor's list, along with seven other causes.

The point of the list wasn't to solve those problems, many of which are unsolvable at this point anyway. It was just to explain something that some of us, myself included, have long wondered, which is why data integration continues to be such a pain in the patootie.


It does beg the question, though: If that's the stuff that makes data integration hard, what makes it easy, or, at least, easier?


It turns out, the answer appeared earlier this month in a article. The article is about Composite Software's recent Data Virtualization Day and what speakers there had to say about data integration. About halfway into the article, I found the answer to easier data integration, according to Ted Friedman, a vice president at Gartner and a member of the research firm's information architecture team.


Friedman says the five keys to making data integration both successful and easier are:

  • Standardization
  • Diversification
  • Unification
  • Leveraging data-integration technology to its fullest
  • Governance

He's based his opinion on surveys and conversations with Gartner clients. The second half of the article is dedicated to explaining what he means by each of these, and it's not exactly what you'd expect. For instance, by "standardization" he doesn't mean necessarily adopting standards, but that "organizations should focus on repeatable processes and approaches for dealing with data-integration problems," the piece explains.


That governance piece is interesting. It seems many organizations are getting it right when it comes to data quality, security, privacy and so on-but still missing the whole governance piece of the data-integration puzzle. Friedman specifically warned governance is "certainly an insurance policy, in a way, to get the optimal value out of all these investments."


Of course, as has been noted here before, getting the right people to care about data governance is easier said than done. But if you can do it, it's nice to know it'd at least make integration easier.

Add Comment      Leave a comment on this blog post
Oct 20, 2010 11:11 AM Oliver Claude Oliver Claude  says:

Yes it is interesting to watch the evolution of data governance.

I agree that it started out with a focus on compliance, and actually developed a bit of a negative perception as a result.

What is interesting, is that more and more customers are looking at data governance beyond a protective point-of-view to a pro-active point-of view where data governance is seen as a way to improve profitability.

Still, many data governance projects begin with a focus on data retention compliance or data quality, and rightfully so. In fact, a number of companies are morphing their data quality programs into an enterprise data quality program that acts as a catalyst to align business and IT, and foster data governance.

When it comes to data integration, it is indeed a complex world. I think about it in terms of three layers. The data layer across all the silos of data, the technology layer across all the tools an organization has, and the people / process layer across the functions and needs that stakeholders have throughout an organization.

I think the fundamental challenge is about managing the complexity within each layer, but more importantly managing the complexity across the layers from the data to the ultimate business outcome.

From a data governance point-of-view, I like to start at the organizational layer and focus on what the business is trying to accomplish and drive better collaboration with IT in order to put in place the policies but also how the policies get "codified" into the technology and data layers.

That's where things get interesting of course given the complex landscape of tools and data management challenges. That is also where there is a great opportunity to unify data management technologies and best practices to break down the existing complexity.


Post a comment





(Maximum characters: 1200). You have 1200 characters left.



Subscribe to our Newsletters

Sign up now and get the best business technology insights direct to your inbox.