• Skip to main content
  • Skip to primary sidebar
  • Skip to footer
  • Home
  • About
    • Stephen Foskett
      • My Publications
        • Urban Forms in Suburbia: The Rise of the Edge City
      • Storage Magazine Columns
      • Whitepapers
      • Multimedia
      • Speaking Engagements
    • Services
    • Disclosures
  • Categories
    • Apple
    • Ask a Pack Rat
    • Computer History
    • Deals
    • Enterprise storage
    • Events
    • Personal
    • Photography
    • Terabyte home
    • Virtual Storage
  • Guides
    • The iPhone Exchange ActiveSync Guide
      • The iPhone Exchange ActiveSync Troubleshooting Guide
    • The iPad Exchange ActiveSync Guide
      • iPad Exchange ActiveSync Troubleshooting Guide
    • Toolbox
      • Power Over Ethernet Calculator
      • EMC Symmetrix WWN Calculator
      • EMC Symmetrix TimeFinder DOS Batch File
    • Linux Logical Volume Manager Walkthrough
  • Calendar

Stephen Foskett, Pack Rat

Understanding the accumulation of data

You are here: Home / Everything / Enterprise storage / Is Deduplication Ready for Prime Time?

Is Deduplication Ready for Prime Time?

September 25, 2008 By Stephen Leave a Comment

In an article for Enterprise Storage Forum, Paul Shread comments on the positive reviews that various deduplication technologies got at Storage Decisions from analysts and end users. He suggests that less than 10% of attendees were using deduplication already, but that others were inspired by their experience and would be using it soon.

Paul goes on to quote me, saying I “didn’t think primary data de-duplication technology was ready for prime time just yet.” I absolutely did say these words, but I am not sure if my point came across.

I’ve recently expounded about the benefits of deduplication technology, but have warned that it might not be all it’s cracked up to be in primary storage environments. By “primary” I mean those storage environments serving mission-critical applications. Although dedupe works great for backup and archiving, the random I/O, low latency, and high throughput of primary storage (and especially virtualized servers) might be too much for current systems. And as of now, only NetApp, Riverbed (soon), and startups greenBytes (see my story) and Ocarina (more on them another time) were willing to go on record with me as supporting deduplication of primary storage.

So what I meant was that deduplication is not yet ready for prime time in primary storage applications. No one should hesitate to use the technology for backup or archiving at this point, but make sure you do a thorough evaluation of the specific product you are selecting to make sure it delivers the performance you require!

You might also want to read these other posts...

  • Electric Car Over the Internet: My Experience Buying From…
  • Scam Alert: Fake DMCA Takedown for Link Insertion
  • Tortoise or Hare? Nvidia Jetson TK1
  • How To Connect Everything From Everywhere with ZeroTier
  • How To Install ZeroTier on TrueNAS 12

Filed Under: Enterprise storage, Virtual Storage Tagged With: data deduplication, deduplication, Enterprise Storage Forum, greenBytes, NetApp, Ocarina, Riverbed, Storage Decisions

Primary Sidebar

James T. Kirk: Mr. Scott. Have you always multiplied your repair estimates by a factor of four?
Montgomery Scott: Certainly, sir. How else can I keep my reputation as a miracle worker?

Subscribe via Email

Subscribe via email and you will receive my latest blog posts in your inbox. No ads or spam, just the same great content you find on my site!
 New posts (daily)
 Where's Stephen? (weekly)

Download My Book


Download my free e-book:
Essential Enterprise Storage Concepts!

Recent Posts

How To Install ZeroTier on TrueNAS 12

February 3, 2022

Scam Alert: Fake DMCA Takedown for Link Insertion

January 24, 2022

How To Connect Everything From Everywhere with ZeroTier

January 14, 2022

Electric Car Over the Internet: My Experience Buying From Vroom

November 28, 2020

Powering Rabbits: The Mean Well LRS-350-12 Power Supply

October 18, 2020

Tortoise or Hare? Nvidia Jetson TK1

September 22, 2020

Running Rabbits: More About My Cloud NUCs

September 21, 2020

Introducing Rabbit: I Bought a Cloud!

September 10, 2020

Remove ROM To Use LSI SAS Cards in HPE Servers

August 23, 2020

Test Your Wi-Fi with iPerf for iOS

July 9, 2020

Symbolic Links

    Featured Posts

    Review: 2013 Ford Flex

    September 23, 2012

    Datacenter History: Through the Ages in Lego

    October 22, 2013

    What You See and What You Get When You Follow Me

    May 28, 2019

    Why Big Disk Drives Require Data Integrity Checking

    December 19, 2014

    Co-Processors, GPGPU, and Heterogeneous Computing

    June 26, 2017

    Debit or Credit? Always Choose Credit!

    December 19, 2013

    The Prime Directive of Storage: Do Not Lose Data

    December 12, 2014

    Free as in Coffee – Thoughts on the State of OpenStack

    May 2, 2016

    Generation 3 drobo: Fall In Love All Over Again

    April 9, 2015

    Why Are PCIe SSDs So Fast?

    June 12, 2013

    Footer

    Legalese

    Copyright © 2022 · Log in