• Skip to main content
  • Skip to primary sidebar
  • Home
  • About
    • Stephen Foskett
      • My Publications
        • Urban Forms in Suburbia: The Rise of the Edge City
      • Storage Magazine Columns
      • Whitepapers
      • Multimedia
      • Speaking Engagements
    • Services
    • Disclosures
  • Categories
    • Apple
    • Ask a Pack Rat
    • Computer History
    • Deals
    • Enterprise storage
    • Events
    • Personal
    • Photography
    • Terabyte home
    • Virtual Storage
  • Guides
    • The iPhone Exchange ActiveSync Guide
      • The iPhone Exchange ActiveSync Troubleshooting Guide
    • The iPad Exchange ActiveSync Guide
      • iPad Exchange ActiveSync Troubleshooting Guide
    • Toolbox
      • Power Over Ethernet Calculator
      • EMC Symmetrix WWN Calculator
      • EMC Symmetrix TimeFinder DOS Batch File
    • Linux Logical Volume Manager Walkthrough
  • Calendar

Stephen Foskett, Pack Rat

Understanding the accumulation of data

You are here: Home / Everything / Enterprise storage / Predictable Performance Beats Maximum Speed Any Day

Predictable Performance Beats Maximum Speed Any Day

February 18, 2015 By Stephen 1 Comment

Everyone wants to be the best, so outrageous claims of supremacy are as old as time. In IT, these claims often revolve around synthetic benchmarks chosen to highlight a system’s performance. Buyers have grown wary of these claims, smartly asking to try before they buy. But predictability is even more important than real-world testing, and this is particularly difficult for storage systems to achieve.

Who cares if your storage system “goes to eleven” if it can’t stay there all day long?

Jingle Bells and Benchmarks

Have you ever listened to the lyrics of the classic holiday song, “Jingle Bells”? It’s a drag racing song from back in the horse-and-sled days. The subject, a young man, wipes out with his girl and gets laughed at by his rivals. But the narrator has some advice: “Just get a bobtailed bay/two forty as his speed/hitch him to an open sleigh/and crack! you’ll take the lead.” Get a faster horse and a lighter sled to impress the ladies!

Just like that young man, every storage company wants to take the performance lead against his rivals. And just like him, they will spare no expense to rig the contest. The easiest way to brag with benchmarks is to match it to the particular quirks of your system, pick the best result, and only report that. And make sure the system is empty and features like deduplication are turned off. Who cares if “your mileage may vary”?

I’ve been guilty of cheering for top-speed benchmark results in the past, happy to report “million IOPS” claims and raw throughput numbers. But I’ve always tried to emphasize that these top-speed numbers only show one aspect of performance. Run a real workload against a system and you’ll usually get a more realistic idea of system performance.

Predictable Performance

For the last few years, hybrid and all-flash arrays have been the bobtailed bays bedeviling the old nags of the storage industry. And some of them are pretty fast indeed, even with real-world applications running!

But these systems often have serious issues maintaining top performance over time. Many slow down as the capacity fills up, and processes like garbage collection, rebalancing, and deduplication can cause serious intermittent performance hiccups. Then there’s the crunch caused by resource contention in scale-up and clustered systems. It’s really tough to know how a system will perform over time!

The same issues affected disk-based systems, but those had less potential performance so developers added less conflicting demands. Most were designed to wring out maximum IOPS from the (slow) disks so activities like rebalancing and deduplication were relegated to occasional/post-process status. The difference is that systems flush with flash are increasingly putting all this in-line and leaving it on all the time.

That’s why I’m more impressed by systems that can guarantee a predictable quality of service than those that boast maximum IOPS. Companies like SolidFire offer performance guarantees even as the system scales out, and this more than offsets their somewhat modest claims. Reborn NexGen Storage is another company with serious quality of service credentials – it was core to their original design! And consistent performance is a big part of Pure Storage’s all-flash pitch as well.

Flash devices have issues with performance consistency, too. SSDs have their own inline data massaging techniques, and most have garbage collection or trim processes that can ruin performance intermittently. And once you get into the world of ultra-high performance, PCIe bus and chipset contention can come into play, according to Diablo Systems.

Stephen’s Stance

We can’t accept benchmarks at face value, but we must also be careful when constructing real-world performance tests. Fill up the array and let it run for a while and you might see performance-sapping processes interrupting your baseline performance plateau. Just another thing to look for in storage!

Disclaimer: Just about every storage company has done business with me as part of Tech Field Day, and Foskett Services has been involved in custom projects with NexGen, Fusion-io, and Diablo. Plus SolidFire gave me great beer. None of this had any influence in my writing this article, however.

You might also want to read these other posts...

  • Electric Car Over the Internet: My Experience Buying…
  • GPS Time Rollover Failures Keep Happening (But…
  • Ranting and Raving About the 2018 iPad Pro
  • Introducing Rabbit: I Bought a Cloud!
  • Liberate Wi-Fi Smart Bulbs and Switches with Tasmota!

Filed Under: Enterprise storage Tagged With: benchmarks, Diablo Technologies, garbage collection, IOPS, latency, NexGen, performance, Pure Storage, SolidFire, SSD

Primary Sidebar

This is our mission: To be the Daleks of God

Shriekback

Subscribe via Email

Subscribe via email and you will receive my latest blog posts in your inbox. No ads or spam, just the same great content you find on my site!
 New posts (daily)
 Where's Stephen? (weekly)

Download My Book


Download my free e-book:
Essential Enterprise Storage Concepts!

Recent Posts

Electric Car Over the Internet: My Experience Buying From Vroom

November 28, 2020

Powering Rabbits: The Mean Well LRS-350-12 Power Supply

October 18, 2020

Tortoise or Hare? Nvidia Jetson TK1

September 22, 2020

Running Rabbits: More About My Cloud NUCs

September 21, 2020

Introducing Rabbit: I Bought a Cloud!

September 10, 2020

Remove ROM To Use LSI SAS Cards in HPE Servers

August 23, 2020

Test Your Wi-Fi with iPerf for iOS

July 9, 2020

Liberate Wi-Fi Smart Bulbs and Switches with Tasmota!

May 29, 2020

What You See and What You Get When You Follow Me

May 28, 2019

GPS Time Rollover Failures Keep Happening (But They’re Almost Done)

April 6, 2019

Symbolic Links

    Featured Posts

    New England Takes On Seattle To Determine Who’s Number 2 … In Tech!

    January 19, 2015

    Frequent Flier Kung Fu for Novices

    March 12, 2012

    Not All 802.11n Networks Are Alike

    July 2, 2011

    Making a Case For (and Against) Software-Defined Storage

    January 9, 2014

    Are You a Hypervisor Hugger or a Storage Stalwart?

    November 14, 2011

    Sony NEX-5 Camera Review

    September 15, 2010

    It’s Fine To Mount Hard Drives On Their Side Or Even Upside-Down

    August 13, 2016

    How Will Cisco Recover From The Consumer Strategy Blunder?

    January 2, 2013

    Marketers: Fudging the Meaning of Buzzwords Matters (To You!)

    December 2, 2015

    What is VMware VASA? Not Much (Yet)

    November 11, 2011

    Copyright © 2021 · Log in