I’ve long been critical of poorly-executed performance comparisons and the “fastest is always best” mentality behind them. But, although it sounds inconsistent, I still love reading the performance “comparos” in Car & Driver, and I am committed to the belief that the enterprise IT world needs lab tests and performance comparisons.
Tolly
Innocence, Fairness, and Technology Benchmarks
HP recently commissioned Tolly Group to benchmark their BladeSystem c7000 against the Cisco UCS 5100. The short report focuses on two results, and reads like so many competitive benchmarks in the IT industry: Tolly focuses on metrics that highlight the strength of HP’s solution and the weaknesses of Cisco’s. What’s the real value of pinpoint maximum-performance benchmarks like this?
