Coping with the Coming Analytics Shortage

Michael Vizard

When it comes to analytics the limiting factor is not the software, but rather the shortage of skilled people required to make sense of the data.


As is often the case when demand for a particular resource outstrips supply, it's only a matter of time before a much wider variety of services based on applying data analytics within various vertical industries starts to emerge.


In the case of IBM, which has anchored much of its Smarter Planet strategy around the broad availability of quality analytics, the general shortage of analysts skilled in using analytics software means that the company will package a number of analytic services to its portfolio in select niche areas in the years ahead.


According to Frank Balboni, global business lead for business analytics and optimization, IBM will proceed cautiously into the services sector given the sensitivities customers have about making proprietary information available outside of their own organization. But he expects to see a fairly large number of third-party service providers emerge in any number of vertical industries to provide analytic-based services.


As the cost of computing continues to drop, the ability to provide these services becomes more feasible. But the limiting factor is a current general lack of professionals skilled in analytics. IBM has been partnering with a variety of universities to help train students on how to master analytics software, but it will be at least a decade before any of those efforts would have a meaningful impact on the current shortage.


According to Balboni, IBM in the last five years has spent $11 billion acquiring companies in the area of analytics in addition to another $2 billion on internal research and development. In addition, he said that the analytics category is growing three times faster than traditional transaction proccessing applications.


But while interest in analytics is growing rapidly, customers are trying to limit the expense associated with these applications by embracing emerging technologies such as the R programming model and the Hadoop data management systems that, while not as fast as proprietary systems, allow IT organizations to embrace analytics in a more affordable manner.


The challenge, however, is not aggregating the data, but making sure that the data itself is reliable and that meaningful correlations can be made in real time. Only then is the data actually going to considered trustworthy enough by the business to be actionable information, versus just data in another long series of reports that nobody ever uses.

Add Comment      Leave a comment on this blog post
Feb 25, 2011 7:05 AM Tim Negris Tim Negris  says:

Very insightful analysis.  I have not seen anyone else make that point, but now that you mention it, it seems so obvious.  "Tools bloat" is only getting worse as the good old (very old) RDMBS is getting surrounded and supplanted by a surfeit of start-up solutions.  My money is on the quietly successful company, 1010data.  Their analytics database is notable for disintermediating ETL, DDL (data definition language) and SQL and connecting the quants directly to the data, without the need for a ton of extraneous tools, techniques and technology. 

Nov 7, 2011 12:29 PM Robert van der Hooning Robert van der Hooning  says:

I spoke to IBM 2 months ago.  They hired 8,000 analytics professionals during the past 3 years and said they can't find enough qualified people.

IMHO, there's confusion about what skills and training (and basic aptitude) is required for all the various branches of analytics - data, systems integration, algorithms, etc.  If the analytics job involves algorithms, then I'd expect a background in calculus, linear algebra, matrix theory, statistics, probability and discrete math (proofs) in addition to a couple years of computer programming.  However, other roles require intermediate knowledge in math and stat at the BS degree level -- just enough to be fluent in modeling packages.  Yet others in data management, for example, require a few courses in programming, database and architecture with 6 months of professional development and a sharp, analytical mind.  I think the human capital shortage problem needs to be disaggregated into its parts. 

One size does not fit all.


Post a comment





(Maximum characters: 1200). You have 1200 characters left.



Subscribe to our Newsletters

Sign up now and get the best business technology insights direct to your inbox.