Big Data Processing and Management Meets the Scalability of NoSQL

Kim Mays

Though many enterprises have scaled the mountains of Big Data and are leading the way with management of data on an extreme scale, many others have yet to begin the ascent. The towering amounts of information that must be processed and managed seem overwhelming, so IT and the data analysis staff have yet to figure out where to begin.

When Big Data also involves cloud computing, it can seem especially daunting. Various programming models and cloud deployment options are available, but how does an organization choose which one is best?

A recent book on the subject of Big Data provides background to help IT organizations make the right choices for their large-scale data management needs. Titled “Large Scale and Big Data: Processing and Management,” the book includes chapters developed by leaders in the data management community. The book provides insight on management and processing techniques and tools used with Big Data within a wide range of computing models.

Chapters in the book cover important topics such as:

  • Distributed programming for the cloud
  • Incremental MapReduce computations
  • Overview of large-scale stream processing engines
  • Virtualizing resources for the cloud
  • Security in Big Data and cloud computing

In the preface, the authors explain the need for such a book within the realm of Big Data management:

This book approaches the challenges associated with Big Data-processing techniques and tools on cloud computing environments from different but integrated perspectives; it connects the dots. The book is designed for studying various fundamental challenges of storing and processing Big Data. In addition, it discusses the applications of Big Data processing in various domains… In a nutshell, the book provides a comprehensive summary from both of the research and the applied perspectives. It will provide the reader with a better understanding of how Big Data-processing techniques and tools can be effectively utilized in different application domains.

In our downloads area, ITBE readers can download an excerpt from this book, “Chapter 9: An Overview of the NoSQL World” by Liang Zhao, Sherif Sakr, and Anna Liu. This excerpt explores current advancements in the area of Web-scale Big Data management.

It explains how MySQL, PostgreSQL and SQL Server are all “one-size-fits-all solutions” for relational database management systems (RDBMS), but Big Data has of course created a need for even more scalability. The emergence of NoSQL (Not Only SQL) has helped relieve some of the issues that were experienced with the other RDBMS solutions.

The chapter goes on to explain NoSQL systems and how they have been used among “three of the key players in the Web-scale data management domain: Google, Yahoo and Amazon.” It includes sections on each of these enterprises and explains how each has used its own database system to support larger-scale data.

The chapter also explains open source systems that are available for public use. Other segments in the chapter deal with database as a service and multitenancy within the data management scheme.

Subscribe to our Newsletters

Sign up now and get the best business technology insights direct to your inbox.


Add Comment      Leave a comment on this blog post
Jul 29, 2014 4:49 AM SDBExplorer SDBExplorer  says:
Amazon web service provides non-relational database services. AWS customers now have cloud based database solutions available called Amazon SimpleDB. Amazon SimpleDB can be useful for those who need a non-relational database for storage of smaller, non-structural data. Amazon SimpleDB has restricted storage size to 10GB per domain and it can achieve up to 25 writes/second. Amazon SimpleDB offers simplicity and flexibility. SimpleDB automatically indexes all data. Amazon SimpleDB pricing is based on your actual box usage. You can store any UTF-8 string data in Amazon SimpleDB. On the different note - SDB Explorer provides an industry-leading and intuitive Graphical User Interface (GUI) to explore Amazon SimpleDB service in a thorough manner, and in a very efficient and user friendly way. http://www.sdbexplorer.com/ Reply

Post a comment





(Maximum characters: 1200). You have 1200 characters left.




Subscribe Daily Edge Newsletters

Sign up now and get the best business technology insights direct to your inbox.

Subscribe Daily Edge Newsletters

Sign up now and get the best business technology insights direct to your inbox.