Newsletters Welcome, Guest Log In | Register

Integration

Begin with business processes and then progress into leading-edge technologies

About this Blogger RSS

Subscribe

Sign up now and get the best business technology insights direct to your inbox.

  • Daily Edge
  • CTO Edge Update
  • Business Tools & Templates
  • Aligning IT & Business Goals
  • Maximizing IT Investments

1

Will Master Data Management and ETL Overlap?

Posted by Loraine Lawson May 22, 2008 4:09:26 PM

I was chatting today with Andy Hayler. Hayler co-founded the data warehousing/master data management company Kalido, but recently launched the consultancy, The Information Difference, with Dr. David Waddington, a former chief IT Systems Architect. Hayler described the company as a "boutique version of Gartner or Forrester" devoted solely to researching master data management.

 

He contends integration vendors need to sit up and pay attention to what's going on with MDM, because MDM technology could eliminate the need for some of the point-to-point, hard-coded integration ETL solutions currently provide:

"...the integration vendors need to understand what's happening in the MDM world, because a piece of their world is changing and I think they need to ideally become part of that solution. If MDM does continue to grow and be widely implemented, and you're an integration vendor and you don't participate in that world, you're going to lose at least some of your potential application. This is why SAP, Oracle Microsoft and IBM have all bought MDM vendors. All four have realized if they don't have MDM at the heart at their own offerings, then some of their proprietary applications start to be hollowed out. I don't' think it's fully dawned on all the integration vendors."

I thought of his comments when I saw this IT-Director article on expressor software, a new ETL-based data integration solution profiled by Philip Howard, a data management research director with Bloor Research.

 

Howard points out that many functionalities for existing ETL products have been tacked on, but expressor was designed to incorporate these functionalities from the get-go. That's its first advantage. The second is that it uses semantics, which means the tool can figure out "customer no" "customer ID" and "customer_no" are all the same thing -- without you having to manually connect the dots. It ships with a slew of similar semantic equivalents, saving you a lot of time and trouble, he writes.

 

Howard seems to anticipate expressor to be disruptive to existing players, such as Informatica, Business Objects and IBM.

 

To me, that functionality sounds very similar to what MDM offers. Perhaps this could be another sign of cross-pollination between MDM and ETL?

 

MDM is still young, and Hayler said no one has a mature, complete solution. MDM will undergo further consolidation and mergers, both as a technology and a market. A recent article on SearchOracle.com took a look at some current big-name MDM offerings, and I think it reflects Hayler's assessment. It's a good read, particularly if you're involved in or about to start an MDM initiative.

 

But if you're only thinking about MDM, does this mean you should wait? Well, it depends on your needs, obviously. But even if you don't want to invest in the technology, a recent report from the Aberdeen Group suggests it's probably worth your company's time to look at the practice of master data management.

 

MDM the practice is already showing positive results in manufacturing firms, according to an Manufacturing Computer Solutions' article on the Aberdeen study. Aberdeen found manufacturers who pursued "one version of the truth" -- which is MDM's goal -- improved customer satisfaction scores, operated more efficiently and decreased the time it took to get data to the business.

Add a comment Leave a comment on this blog post.
May 23, 2008 8:22 PM Guest John Russell  says:

I agree with you that there is an emerging cross-pollination between MDM and ETL.  And you are right that there are similarities between our semantic data integration system and off-the-shelf MDM solutions, albeit we classify our product as general purpose data integration infrastructure software rather than domain-specific MDM software. 

 

We look at MDM as a specific data integration scenario. Prior to the debut of off the shelf MDM solutions this processing was maintained in ETL applications and at one time MDM was considered to be a subset of data integration. The birth of MDM as a paradigm is the result of one simple fact: that todays mainstream ETL vendor solutions arent able to address the MDM customer needs effectively and efficiently. 

 

All current ETL tools lack the ability to semantically rationalize physical metadata towards common business terms  an important capability that is built into todays MDM solutions and is now becoming available via our patent-pending expressor semantic data integration system. 

 

We expect customers to continue to use CDI and PIM solutions for domain-specific MDM initiatives and consider us as a viable alternative for general purpose MDM integration projects that cannot be solved with these specialized solutions.

Software Forum: Information On Demand Virtual Experience

This interactive virtual forum presents leading IT experts providing the insights you need to turn your information into a strategic driver for innovation, business optimization and competitive differentiation.

Performance Under Pressure: The State of Enterprise Web Application Quality and Availability

This research study finds that Web application issues are an all-too-common problem and examines these Web-based enterprise application issues from two perspectives: that of an online customer and that of a site manager.

Mobile Computing Optimization

Mobile computing solutions, tips, and expert commentary that increases the usability and bottom-line benefits of your mobile computing assets.

Optimized Infrastructure

Hardware and software tools to create an enterprise infrastructure for data and business optimization.

Data Management

Data management tips and techniques that insure ease of access, comprehensive security and absolute privacy for your invaluable company information.

Data Deduplication

Data manipulation strategies that make data stores more manageable and reduce the need for storage capacity and its associated costs.

ITIL V3 Foundation - Complete Certification Kit

Enhance your IT career by getting your ITIL Foundation Certificate. It's fast and easy with this complete resource. The 186-page eBook and companion online training course is guaranteed to help you pass the ITIL exam.

Learn more >

Budget & Finance Toolkit for IT - 2010 Edition

What kind of year are you planning in 2010?  Growth or continued "survival mode"?  Download a comprehensive collection of templates, forms, instruction and advice that will help you to plan and submit your 2010 IT Budget.

Learn more >