• Skip to main content
  • Skip to primary sidebar
  • Skip to footer
  • Home
  • About
    • Stephen Foskett
      • My Publications
        • Urban Forms in Suburbia: The Rise of the Edge City
      • Storage Magazine Columns
      • Whitepapers
      • Multimedia
      • Speaking Engagements
    • Services
    • Disclosures
  • Categories
    • Apple
    • Ask a Pack Rat
    • Computer History
    • Deals
    • Enterprise storage
    • Events
    • Personal
    • Photography
    • Terabyte home
    • Virtual Storage
  • Guides
    • The iPhone Exchange ActiveSync Guide
      • The iPhone Exchange ActiveSync Troubleshooting Guide
    • The iPad Exchange ActiveSync Guide
      • iPad Exchange ActiveSync Troubleshooting Guide
    • Toolbox
      • Power Over Ethernet Calculator
      • EMC Symmetrix WWN Calculator
      • EMC Symmetrix TimeFinder DOS Batch File
    • Linux Logical Volume Manager Walkthrough
  • Calendar

Stephen Foskett, Pack Rat

Understanding the accumulation of data

You are here: Home / Everything / Enterprise storage / Your Mileage May Vary: Lies, Damn Lies, and Benchmarks

Your Mileage May Vary: Lies, Damn Lies, and Benchmarks

September 22, 2015 By Stephen 3 Comments

The hot story in the news this week is Volkswagen’s reported brazen cheating in diesel engine emissions testing. This brought to mind a host of similar occurrences, from Samsung/HTC cheating at benchmarks to alleged cheating in SPC enterprise storage performance testing. Cynics say we should just assume we’re being cheated, but is this a world in which we want to live?

Big benchmark numbers get consumer attention, but can you trust them?
Big benchmark numbers get consumer attention, but can you trust them?

The Volkswagen situation is really remarkable in its brazenness. Pretty much every diesel passenger vehicle sold in the USA uses urea injection to tame nitrogen oxide and meet the US EPA’s very-strict emissions standards. But Volkswagen somehow managed to meet the standards without urea in their popular 2.0 liter TDI engine. Automotive geeks always wondered if there was some technical trick Volkswagen had developed to pull this off. Turns out, there was!

As the old saying goes, “your mileage may vary.” By now, most car buyers know they won’t match the “Monroney Sticker” fuel economy estimates, yet these still prove valuable when cross-shopping vehicles.1 The same holds true for Energy Star ratings, lightbulb lumen/wattage numbers, and nutritional information.

Your mileage will vary, but most consumers assume that those benchmarks were obtained on a level playing field. What kind of company would develop as sophisticated a cheat as Volkswagen is alleged to have created? What does this say about the company and the state of mind of those who created it? As Planet Money points out, sometimes people do bad things in business contexts.

But that doesn’t mean we should forgive them or resign ourselves to being cheated. As an industry and as a society, we should strive for fairness always. And we should punish those who abuse that trust, even though it’s likely to happen again. And because of that, we always have to be watchful!

  1. If you’re not a car geek like me, you would not believe the shenanigans that go on behind the scenes with these numbers! ↩

You might also want to read these other posts...

  • Electric Car Over the Internet: My Experience Buying From…
  • Scam Alert: Fake DMCA Takedown for Link Insertion
  • Tortoise or Hare? Nvidia Jetson TK1
  • Running Rabbits: More About My Cloud NUCs
  • Introducing Rabbit: I Bought a Cloud!

Filed Under: Enterprise storage, Personal Tagged With: automobiles, benchmark, benchmarks, cars, Energy Star, ethics, lightbulb, Samsung, SPC-1, Volkswagen

Primary Sidebar

I’m of the opinion that science fiction writers suck at predicting the future. We mostly go around describing the present in futuristic clothes

Cory Doctorow

Subscribe via Email

Subscribe via email and you will receive my latest blog posts in your inbox. No ads or spam, just the same great content you find on my site!
 New posts (daily)
 Where's Stephen? (weekly)

Download My Book


Download my free e-book:
Essential Enterprise Storage Concepts!

Recent Posts

How To Install ZeroTier on TrueNAS 12

February 3, 2022

Scam Alert: Fake DMCA Takedown for Link Insertion

January 24, 2022

How To Connect Everything From Everywhere with ZeroTier

January 14, 2022

Electric Car Over the Internet: My Experience Buying From Vroom

November 28, 2020

Powering Rabbits: The Mean Well LRS-350-12 Power Supply

October 18, 2020

Tortoise or Hare? Nvidia Jetson TK1

September 22, 2020

Running Rabbits: More About My Cloud NUCs

September 21, 2020

Introducing Rabbit: I Bought a Cloud!

September 10, 2020

Remove ROM To Use LSI SAS Cards in HPE Servers

August 23, 2020

Test Your Wi-Fi with iPerf for iOS

July 9, 2020

Symbolic Links

    Featured Posts

    A Complete List of VMware VAAI Primitives

    November 10, 2011

    What is VMware VASA? Not Much (Yet)

    November 11, 2011

    The Ideal pfSense Platform: Netgate RCC-VE 2440

    September 21, 2015

    What’s the Deal with Containers?

    October 21, 2016

    Are You a Hypervisor Hugger or a Storage Stalwart?

    November 14, 2011

    Thoughts on the Modern Miracle of 3D Printing

    July 28, 2015

    How To Connect Everything From Everywhere with ZeroTier

    January 14, 2022

    My Visit to Bletchley Park

    August 3, 2012

    From LAN Manager and SMB to CIFS: The Evolution of Prehistoric PC Network Protocols

    March 22, 2012

    Storage Changes in VMware vSphere 5.1

    September 4, 2012

    Footer

    Legalese

    Copyright © 2022 · Log in