SamsungIsn’tTheOnlyManufacturerCheatingOnAndroidBenchmarkingTests

It looks like Samsung isn’t the only Android hardware manufacturer gaming the benchmarking tests. A fascinating look by Anandtech shows that a large majority of handset manufacturers are playing the same type of dirty tricks.
The site built a comprehensive chart (hysterically named “I Can't Believe I Have to Make This Table") that shows how a number of devices are rigged to cheat certain benchmarking tests:

We started piecing this data together back in July, and even had conversations with both silicon vendors and OEMs about getting it to stop. With the exception of Apple and Motorola, literally every single OEM we’ve worked with ships (or has shipped) at least one device that runs this silly CPU optimization. It's possible that older Motorola devices might've done the same thing, but none of the newer devices we have on hand exhibited the behavior. It’s a systemic problem that seems to have surfaced over the last two years, and one that extends far beyond Samsung.

And the report rightfully questions what the manufacturers gain by playing the system:

The hilarious part of all of this is we’re still talking about small gains in performance. The impact on our CPU tests is 0 - 5%, and somewhere south of 10% on our GPU benchmarks as far as we can tell. I can't stress enough that it would be far less painful for the OEMs to just stop this nonsense and instead demand better performance/power efficiency from their silicon vendors. Whether the OEMs choose to change or not however, we’ve seen how this story ends. We’re very much in the mid-1990s PC era in terms of mobile benchmarks. What follows next are application based tests and suites. Then comes the fun part of course. Intel, Qualcomm and Samsung are all involved in their own benchmarking efforts, many of which will come to light over the coming years. The problem will then quickly shift from gaming simple micro benchmarks to which “real world” tests are unfairly optimized which architectures.