February 12, 2012

In Praise of Performance Comparisons

IT needs application monitoring: Gauges alone won't get you to your destination!

I’ve long been critical of poorly-executed performance comparisons and the “fastest is always best” mentality behind them. But, although it sounds inconsistent, I still love reading the performance “comparos” in Car & Driver, and I am committed to the belief that the enterprise IT world needs lab tests and performance comparisons.

Innocence, Fairness, and Technology Benchmarks

Greta examines the marks on an 18th century cobbler's bench

HP recently commissioned Tolly Group to benchmark their BladeSystem c7000 against the Cisco UCS 5100. The short report focuses on two results, and reads like so many competitive benchmarks in the IT industry: Tolly focuses on metrics that highlight the strength of HP’s solution and the weaknesses of Cisco’s. What’s the real value of pinpoint maximum-performance benchmarks like this?