• Skip to main content
  • Skip to primary sidebar
  • Skip to footer
  • Home
  • About
    • Stephen Foskett
      • My Publications
        • Urban Forms in Suburbia: The Rise of the Edge City
      • Storage Magazine Columns
      • Whitepapers
      • Multimedia
      • Speaking Engagements
    • Services
    • Disclosures
  • Categories
    • Apple
    • Ask a Pack Rat
    • Computer History
    • Deals
    • Enterprise storage
    • Events
    • Personal
    • Photography
    • Terabyte home
    • Virtual Storage
  • Guides
    • The iPhone Exchange ActiveSync Guide
      • The iPhone Exchange ActiveSync Troubleshooting Guide
    • The iPad Exchange ActiveSync Guide
      • iPad Exchange ActiveSync Troubleshooting Guide
    • Toolbox
      • Power Over Ethernet Calculator
      • EMC Symmetrix WWN Calculator
      • EMC Symmetrix TimeFinder DOS Batch File
    • Linux Logical Volume Manager Walkthrough
  • Calendar

Stephen Foskett, Pack Rat

Understanding the accumulation of data

You are here: Home / Everything / Computer History / Flush Time

Flush Time

October 19, 2009 By Stephen 5 Comments

Single-parity RAID is under attack. Caching is the hottest trend in storage. The end of the high-performance disk drive is imminent. What happened? Increasing areal bit density has caused disk capacity to grow much faster than disk performance. A presentation at Storage Networking World by Ronald Bianchini of Avere exposed the mathematics of this phenomenon. Of course, hard disk platters are not getting larger – quite the opposite. But the bits are getting smaller, so the effect is the same:

  • Capacity increases exponentially based on the formula for the area of a disc: Pi times radius squared
  • Sequential performance increases algebraically based on the formula for the circumference of a disc: Pi times diameter

Therefore, sequential performance grows smoothly with disk density, but capacity increases much faster. Double the density of disk media and you can read twice as many bits in the same amount of time, but the disk now contains four times as much data. Iterate this a dozen times, a miracle performed regularly by hard disk drive manufacturers, and you have a serious bottleneck to both performance and reliability.

Disk capacity has outpaced performance over the last decade
Disk capacity has outpaced performance over the last decade

Back in 2004, I gave this metric a name: Flush time. It is a simple calculation to answer the question, how long would it take to read the entire content of a hard disk drive? Let’s look at some real-world examples:

  • In 2000, a 45 GB Western Digital 450AA disk could stream data at 25.4 MB/s, requiring 30 minutes to flush every byte out its UDMA/66 interface. This was a massive and slow drive at the time – enterprise disks were much faster. A 2000 Quantum Atlas 10K II SCSI drive (36 GB and 31 MB/s) could flush in 19 minutes!
  • A 2004-era Seagate Barracuda 7200.7 boasted 160 GB ad averaged 44.5 MB/s, requiring about an hour for a full flush.
  • By 2007, high-performance drives like the Hitachi 15K450 had hit 450 GB and about 100 MB/s in sustained throughput, but flush times were well over an hour.
  • Today’s enterprise drives can push 200 MB/s and average 160 MB/s across the entire 600 GB of capacity. But this is still about an hour for a flush. But large-capacity SATA drives are much more popular for bulk storage. The Samsung Spinpoint F2 EcoGreen drive I use in my Drobo only delivers about 110 MB/s, requiring almost four hours to flush at 1.5 TB of capacity! Think this is unusual? Check out Hitachi’s popular E7K1000, which needs 2.5 hours at 1 TB and 118 MB/s.
What will happen to flush time over the next decade if density continues to increase?
What will happen to flush time over the next half decade if density continues to increase? How about 16 TB drives, 400 MB/s, and RAID rebuilds that last more than half a day?

Since (traditional) RAID rebuilds are directly impacted by flush time, today’s massive disk drives are killing RAID. And flush time is only the minimum required time – most RAID rebuilds take much longer! Then there is the issue of media reliability!

Note: Yes, I know there are alternative RAID schemes that get around this problem. Far from ignoring that point, I’ll be promoting these in future posts! Stay tuned for more on these topics…

You might also want to read these other posts...

  • Electric Car Over the Internet: My Experience Buying From…
  • Powering Rabbits: The Mean Well LRS-350-12 Power Supply
  • Introducing Rabbit: I Bought a Cloud!
  • Tortoise or Hare? Nvidia Jetson TK1
  • How To Connect Everything From Everywhere with ZeroTier

Filed Under: Computer History, Enterprise storage Tagged With: Avere, capacity, density, Drobo, flush time, Hitachi, performance, Quantum, RAID, Ronald Bianchini, Samsung, Seagate, Western Digital

Primary Sidebar

We can only see a short distance ahead, but we can see plenty there that needs to be done

Alan Turing

Subscribe via Email

Subscribe via email and you will receive my latest blog posts in your inbox. No ads or spam, just the same great content you find on my site!
 New posts (daily)
 Where's Stephen? (weekly)

Download My Book


Download my free e-book:
Essential Enterprise Storage Concepts!

Recent Posts

How To Install ZeroTier on TrueNAS 12

February 3, 2022

Scam Alert: Fake DMCA Takedown for Link Insertion

January 24, 2022

How To Connect Everything From Everywhere with ZeroTier

January 14, 2022

Electric Car Over the Internet: My Experience Buying From Vroom

November 28, 2020

Powering Rabbits: The Mean Well LRS-350-12 Power Supply

October 18, 2020

Tortoise or Hare? Nvidia Jetson TK1

September 22, 2020

Running Rabbits: More About My Cloud NUCs

September 21, 2020

Introducing Rabbit: I Bought a Cloud!

September 10, 2020

Remove ROM To Use LSI SAS Cards in HPE Servers

August 23, 2020

Test Your Wi-Fi with iPerf for iOS

July 9, 2020

Symbolic Links

    Featured Posts

    Why Big Disk Drives Require Data Integrity Checking

    December 19, 2014

    What is VMware VASA? Not Much (Yet)

    November 11, 2011

    Why Buy a NEX-7? Why Sony NEX At All?

    October 17, 2011

    What’s the Deal with Containers?

    October 21, 2016

    What’s (Still) Wrong With Dropbox For Business

    April 17, 2013

    Thoughts on the Modern Miracle of 3D Printing

    July 28, 2015

    The Rack Endgame: Converged Infrastructure and Disaggregation

    September 19, 2014

    How Fast Is It? A Storage Infographic

    October 29, 2010

    Debit or Credit? Always Choose Credit!

    December 19, 2013

    Cisco’s Trojan Horse

    September 15, 2014

    Footer

    Legalese

    Copyright © 2022 · Log in