While there is a lot of interest these days in the open source Hadoop data management platform, finding people who can manage it has become a challenge since the number of people capable of deploying and managing Hadoop systems is fairly limited right now.
To help address that specific issue, Cloudera today launched a management service for Hadoop customers as part of a version 3.7 upgrade to Cloudera Enterprise that provides, among other capabilities, log management, operational reports and health checks on the status of the customer's Hadoop installation.
According to Charles Zedlewski, vice president of product, the basic idea for the service is to provide an easy-to-use management platform that will facilitate the adoption of Hadoop. As an alternative to traditional databases, Hadoop is gaining momentum because of its flexibility, which Zedlewski says is derived from the fact that customers don't have to set up a schema for the data that needs to be managed.
But for all that flexibility, people with Hadoop skills are still needed to manage the overall environment. Right now, however, those people are an expensive resource given the limited supply of people with Hadoop skills and the current demand for those skills. Cloudera Manager, says Zedlewski, is designed to make it simple enough for the average SQL database administrator to start managing a Hadoop environment in a matter of minutes.
Right now it looks like Hadoop is set to become a permanent part of a data management landscape that is getting more diverse with each passing day. The challenge facing IT organizations is not going to be finding ways to limit that diversity, but rather embracing it in a way that makes it easier to manage.