The hot story in the news this week is Volkswagen’s reported brazen cheating in diesel engine emissions testing. This brought to mind a host of similar occurrences, from Samsung/HTC cheating at benchmarks to alleged cheating in SPC enterprise storage performance testing. Cynics say we should just assume we’re being cheated, but is this a world in which we want to live?
I’ve long been critical of poorly-executed performance comparisons and the “fastest is always best” mentality behind them. But, although it sounds inconsistent, I still love reading the performance “comparos” in Car & Driver, and I am committed to the belief that the enterprise IT world needs lab tests and performance comparisons.