GigaOM Pro

In cloud computing today, benchmarks are best used as guides rather than actual measurements.

Cloud providers sometimes tout performance metrics obtained from benchmarking tests as undeniable proof that their clouds are better than the competition. The actual value to be derived from cloud benchmarks, however, is less black and white. From the uniqueness of each user's application to network performance, there are many variables at play. This means that benchmarks can be excellent guidance in some cases but warrant little consideration in others. As with all things cloud, users should rely on them at their own risk.