Dedupe in the Virtual/Cloud Era

Arthur Cole

Despite the momentous changes taking place in the enterprise, one thing remains constant: the need for efficient, effective backup and recovery.

Slide Show

Five Reasons to Conduct a Storage Assessment Today

In that vein, then, technologies like deduplication are in continual demand. Not only do they help preserve valuable storage capacity but they take pressure off network infrastructure as well, enabling greater performance across the entire data environment.

Dedupe’s value in advanced virtual and cloud architectures is evident in the fact that even massively scalable storage platforms like Stonefly’s Unified Scale Out Storage system employ it as a means to optimize storage processes. The company has integrated Permabit Technology’s Albireo system into the StoneFusion operating system to enable seamless dedupe without interfering with advanced SAN/NAS features like active/active clustering, mirroring, replication and thin provisioning. The combo will be available across StoneFly’s lines of physical appliances and virtual machine platforms where it can be utilized for either primary or backup storage applications.

And even though dedupe has been around for a while, it is still seeing a steady flow of new techniques designed to keep pace with the dynamic data environments currently under development. ExaGrid, for example, recently received its latest patent for a new zone-level approach that, unlike existing byte- or block-level methods, provides both seamless scalability and faster backup and restoration in complex architectures. The technology also supports leading backup applications, such as Acronis, CommVault, Simpana and ARCserve, as well as integrated systems from HP, IBM, Oracle, Symantec and VMware.

While dedupe is very effective at lessening data loads, it does suffer from one flaw: the need to “rehydrate” data and even virtual machines in order to bring them back into service. To that end, ExaGrid has turned to Veeam Software to provide virtual server data protection to provide full-data backups that can be up and running within minutes. A traditional dedupe recovery can take hours, which would put it past the recovery point objective (RPO) of most restoration programs. Under the ExaGrid/Veeam package, the enterprise maintains resource efficiency without sacrificing full restoration performance.

HP is also looking to ease the rehydration process, although its intent is to improve replication performance throughout disparate architectures. The company’s StoreOnce virtual storage appliance (VSA) provides multitenant backup-as-a-service and deduplication functions that allow data sets to be replicated anywhere in the data environment without having to rehydrate. In this way, the company is able to provide increasingly modularized storage solutions for software-defined storage architectures, as well as potential plug-in solutions for the company’s Project Moonshot server portfolio.

Dedupe has emerged as a vital tool as the enterprise seeks to fulfill increasing demands for better performance and smaller, more efficient footprints. But it is by no means a plug-and-play technology. Implementation must be conducted very carefully, followed by extensive performance testing to ensure data operations are not inhibited by the dedupe process, particularly when it comes to recovery systems.

Clearly, no one wants to provision more storage or greater network bandwidth than is needed, but neither do you want to be caught unawares should stakeholders start to wonder why their data environment is not running the way it is supposed to.

Subscribe to our Newsletters

Sign up now and get the best business technology insights direct to your inbox.


Add Comment      Leave a comment on this blog post
Jan 31, 2014 9:37 PM Jim Sanders Jim Sanders  says:
The technology for backup and recovery is always evolving, recently a tool was developed to do a full back-up (sector by sector I do believe) that is compressed and that updates itself in increments, so you have your original full back up, smaller files that keep all of the changes, and when you encounter a problem you can load from any checkpoint along the way, loading all previous drivers, files, setting etc. all is restored and in incredible time. Very cool stuff! Reply
Mar 31, 2014 11:17 PM Elisa Jed Elisa Jed  says:
The more advanced technology gets and the more memory available, the more important back ups becomes. I know I have become dependent on my tablet. I wouldn't know what to do without the files I have saved on it. Those machine platforms seem like a good back up idea. Are they more efficient as primary or secondary? Elisa Jed | http://www.seaportsteel.com Reply
May 7, 2014 4:59 PM thiago daluz thiago daluz  says:
Thanks for sharing this. I'm really excited to see how Dedupe evolves in the Cloud. The technology will just keep getting better from here, so they've a lot to look forward to. Here's hoping they capitalize on the opportunity. Thiago | http://www.dieandgasket.com/ Reply

Post a comment





(Maximum characters: 1200). You have 1200 characters left.




Subscribe Daily Edge Newsletters

Sign up now and get the best business technology insights direct to your inbox.

Subscribe Daily Edge Newsletters

Sign up now and get the best business technology insights direct to your inbox.