5 Steps to Wrangle Uncontrolled Data Flow The ability to inexpensively collect massive amounts of Big Data using Hadoop is one thing. Being able to manage all that data is another matter altogether. With that issue in mind, Hortonworks today announced the upgrade of a Hortonworks DataFlow (HDF) streaming analytics platform with an eye toward […]
5 Steps to Wrangle Uncontrolled Data Flow
The ability to inexpensively collect massive amounts of Big Data using Hadoop is one thing. Being able to manage all that data is another matter altogether. With that issue in mind, Hortonworks today announced the upgrade of a Hortonworks DataFlow (HDF) streaming analytics platform with an eye toward addressing a broad range of enterprise management issues.
HDF 2.0 now sports a revamped user interface that tightens the integration between the streaming analytics platform that is based on the Apache NiFi data routing engine and Apache Kafka messaging software and Apache Ambari tools for managing Hadoop deployments. Apache NiFi itself is based on streaming analytics software created by Onyara, which Hortonworks acquired last year.
In addition, Hortonworks has announced that it has integrated HDF 2.0 with Apache Ranger software for securing access to data in Hadoop.
Finally, Hortonworks revealed that it has developed Apache MiNiFi, an implementation of Apache NiFi that has been optimized to process streaming analytics on an Internet of Things (IoT) gateway, while at the same time formally certifying over 150 third-party HDF 2.0 connectors.
Jamie Engesser, vice president and general manager for emerging products at Hortonworks, says a truly comprehensive approach to Big Data requires an ability to process and manage data both in motion and at rest. HDF now extends the ability of Hortonworks to process data all the way out to the edge. That approach, adds Engesser, also serves to limit the amount of network bandwidth that needs to be allocated to an IoT project.
“Now organizations can actually prioritize what data needs to be sent back across the network,” says Engesser.
HDF 2.0 is an example of how streaming analytics is now being applied to Big Data both inside and out of Hadoop itself. The next challenge IT organizations face is going to be determining to what degree any of this open source streaming analytics software might either complement or obviate previous investments in analytics applications throughout the rest of the enterprise.
Save
Save
Michael Vizard is a seasoned IT journalist, with nearly 30 years of experience writing and editing about enterprise IT issues. He is a contributor to publications including Programmableweb, IT Business Edge, CIOinsight and UBM Tech. He formerly was editorial director for Ziff-Davis Enterprise, where he launched the company’s custom content division, and has also served as editor in chief for CRN and InfoWorld. He also has held editorial positions at PC Week, Computerworld and Digital Review.
The go-to resource for IT professionals from all corners of the tech world looking for cutting edge technology solutions that solve their unique business challenges. We aim to help these professionals grow their knowledge base and authority in their field with the top news and trends in the technology space.
Property of TechnologyAdvice. © 2025 TechnologyAdvice. All Rights Reserved
Advertiser Disclosure: Some of the products that appear on this site are from companies from which TechnologyAdvice receives compensation. This compensation may impact how and where products appear on this site including, for example, the order in which they appear. TechnologyAdvice does not include all companies or all types of products available in the marketplace.
