• Home
  • About
    • Stephen Foskett
      • My Publications
        • Urban Forms in Suburbia: The Rise of the Edge City
      • Storage Magazine Columns
      • Whitepapers
      • Multimedia
      • Speaking Engagements
    • Services
    • Disclosures
  • Categories
    • Apple
    • Ask a Pack Rat
    • Computer History
    • Deals
    • Enterprise storage
    • Events
    • Personal
    • Photography
    • Terabyte home
    • Virtual Storage
  • Guides
    • The iPhone Exchange ActiveSync Guide
      • The iPhone Exchange ActiveSync Troubleshooting Guide
    • The iPad Exchange ActiveSync Guide
      • iPad Exchange ActiveSync Troubleshooting Guide
    • Toolbox
      • Power Over Ethernet Calculator
      • EMC Symmetrix WWN Calculator
      • EMC Symmetrix TimeFinder DOS Batch File
    • Linux Logical Volume Manager Walkthrough
  • Calendar

Stephen Foskett, Pack Rat

Understanding the accumulation of data

You are here: Home / Everything / Computer History / Flush Time

Flush Time

October 19, 2009 By Stephen 5 Comments

Single-parity RAID is under attack. Caching is the hottest trend in storage. The end of the high-performance disk drive is imminent. What happened? Increasing areal bit density has caused disk capacity to grow much faster than disk performance. A presentation at Storage Networking World by Ronald Bianchini of Avere exposed the mathematics of this phenomenon. Of course, hard disk platters are not getting larger – quite the opposite. But the bits are getting smaller, so the effect is the same:

  • Capacity increases exponentially based on the formula for the area of a disc: Pi times radius squared
  • Sequential performance increases algebraically based on the formula for the circumference of a disc: Pi times diameter

Therefore, sequential performance grows smoothly with disk density, but capacity increases much faster. Double the density of disk media and you can read twice as many bits in the same amount of time, but the disk now contains four times as much data. Iterate this a dozen times, a miracle performed regularly by hard disk drive manufacturers, and you have a serious bottleneck to both performance and reliability.

Disk capacity has outpaced performance over the last decade
Disk capacity has outpaced performance over the last decade

Back in 2004, I gave this metric a name: Flush time. It is a simple calculation to answer the question, how long would it take to read the entire content of a hard disk drive? Let’s look at some real-world examples:

  • In 2000, a 45 GB Western Digital 450AA disk could stream data at 25.4 MB/s, requiring 30 minutes to flush every byte out its UDMA/66 interface. This was a massive and slow drive at the time – enterprise disks were much faster. A 2000 Quantum Atlas 10K II SCSI drive (36 GB and 31 MB/s) could flush in 19 minutes!
  • A 2004-era Seagate Barracuda 7200.7 boasted 160 GB ad averaged 44.5 MB/s, requiring about an hour for a full flush.
  • By 2007, high-performance drives like the Hitachi 15K450 had hit 450 GB and about 100 MB/s in sustained throughput, but flush times were well over an hour.
  • Today’s enterprise drives can push 200 MB/s and average 160 MB/s across the entire 600 GB of capacity. But this is still about an hour for a flush. But large-capacity SATA drives are much more popular for bulk storage. The Samsung Spinpoint F2 EcoGreen drive I use in my Drobo only delivers about 110 MB/s, requiring almost four hours to flush at 1.5 TB of capacity! Think this is unusual? Check out Hitachi’s popular E7K1000, which needs 2.5 hours at 1 TB and 118 MB/s.
What will happen to flush time over the next decade if density continues to increase?
What will happen to flush time over the next half decade if density continues to increase? How about 16 TB drives, 400 MB/s, and RAID rebuilds that last more than half a day?

Since (traditional) RAID rebuilds are directly impacted by flush time, today’s massive disk drives are killing RAID. And flush time is only the minimum required time – most RAID rebuilds take much longer! Then there is the issue of media reliability!

Note: Yes, I know there are alternative RAID schemes that get around this problem. Far from ignoring that point, I’ll be promoting these in future posts! Stay tuned for more on these topics…

You might also want to read these other posts...

  • Turn Off Error Recovery in RAID Drives: TLER, ERC, and CCTL
  • It’s Fine To Mount Hard Drives On Their Side…
  • The Four Horsemen of Storage System Performance Are…
  • Waves of Storage Innovation
  • Today’s Storage: Same As It Ever Was

Filed Under: Computer History, Enterprise storage Tagged With: Avere, capacity, density, Drobo, flush time, Hitachi, performance, Quantum, RAID, Ronald Bianchini, Samsung, Seagate, Western Digital

The same thing can be identified by many different terms, and the same term may mean many different things.

Douglas John Foskett

Subscribe via Email

Subscribe via email and you will receive my latest blog posts in your inbox. No ads or spam, just the same great content you find on my site!
 New posts (daily)
 Where's Stephen? (weekly)

Download My Book


Download my free e-book:
Essential Enterprise Storage Concepts!

Recent Posts

Add a Mirror to an Existing ZFS Drive

December 11, 2017

How To Remove Raw Images From Apple Photos and iCloud

How To Remove Raw Images From Apple Photos and iCloud

July 24, 2017

Recalling An HP MediaSmart Server To Active Duty

Recalling An HP MediaSmart Server To Active Duty

July 21, 2017

Go Get a ProtonMail Account and Protect Your Online Life!

Go Get a ProtonMail Account and Protect Your Online Life!

July 19, 2017

ZFS Is the Best Filesystem (For Now…)

ZFS Is the Best Filesystem (For Now…)

July 10, 2017

Co-Processors, GPGPU, and Heterogeneous Computing

Co-Processors, GPGPU, and Heterogeneous Computing

June 26, 2017

What is OCuLink?

What is OCuLink?

June 22, 2017

Storage is Getting Cloudier!

Storage is Getting Cloudier!

June 21, 2017

Where Have All The GPU’s Gone? Cryptocurrency Mining!

Where Have All The GPU’s Gone? Cryptocurrency Mining!

June 11, 2017

Turn Off Error Recovery in RAID Drives: TLER, ERC, and CCTL

Turn Off Error Recovery in RAID Drives: TLER, ERC, and CCTL

May 30, 2017

Symbolic Links

  • IRL Analogies Explaining Digital Concepts are Terrible

  • Hass.io 2018

  • Describing Network Automation: Automate the Coffee

  • Cisco’s Latest AP is Mind-Blowing (and a quick history lesson)

  • E8 Storage Announces InfiniBand Support

Featured Posts

Scaling Storage In Conventional Arrays

November 19, 2013

Review: American Standard’s Champion 4 Toilet Flushes Almost Anything

July 31, 2012

Edward Snowden Is Right: We Must Protect The Internet

March 19, 2014

Why I Am Biased Against FCoE

October 21, 2011

10 Mysteries The Lost Finale Definitively Settled

May 25, 2010

Defining Failure: What Is MTTR, MTTF, and MTBF?

July 6, 2011

A Watch Guy’s Review of the Apple Watch

April 27, 2015

Donate Your Swag to School Kids In Need

July 28, 2010

It’s Time To Move Beyond Passwords (Especially On Web Sites)

January 8, 2016

What is VMware VASA? Not Much (Yet)

November 11, 2011

Copyright © 2018 · Log in