Smartphones are becoming more like PCs by the day. Now, they've taken another step toward complete PC-ification by learning to cheat in popular benchmarks. Ain't progress grand?
AnandTech exposed the subterfuge on Samsung's Galaxy S4. The site started by testing the international version of the phone, which is powered by Samsung's own Exynos 5 system-on-a-chip. AnandTech ran a shell command to repeatedly probe the clock speed of the SoC's PowerVR integrated graphics. It found that, while the clock speed never rose past 480MHz in games—even "the most demanding titles"—running benchmarks like GLBenchmark, AnTuTu, and Quadrant bumped the speed to 532MHz.
The same thing happened in CPU tests, only this time, both the Exynos-powered phone and its Qualcomm-powered North American counterpart skewed the numbers. As AnandTech explains, the Qualcomm-powered model "is set to the maximum CPU frequency available at app launch and stays there for the duration, all cores are plugged in as well, regardless of load, as soon as the application starts." AnTuTu, Linpack, Benchmark Pi, and Quadrant all exhibit the same behavior.
The culprit? A set of exceptions in the phone's DVFS (short for dynamic voltage and frequency scaling) management app. Opening the app with a text editor reveals incriminating text strings, including "BenchmarkBooster" as well as specific references to the aforementioned benchmark apps.
In a statement sent to AnandTech this morning, Samsung claims the Galaxy S4's graphics speed maxes out in "apps that are usually used in full-screen mode, such as the S Browser, Gallery, Camera, Video Player, and certain benchmarking apps, which also demand substantial performance." It goes on to indulge in a bit of doublethink, adding, "The maximum GPU frequencies . . . were not intended to improve certain benchmark results." AnandTech found that the graphics speed did indeed reach its peak in the Camera app, but only for short bursts. In benchmarks, the peak speed was sustained.
When I went hands-on with the Galaxy S4 last month, I noticed that the device felt slower than my iPhone 5, even though benchmarks around the web suggested the opposite. Perhaps this discovery helps explain that. In any case, Samsung needs to learn the same lesson its PC industry counterparts did some years ago: funny business in benchmarks always comes to light sooner or later, and it's never a good alternative to winning performance contests the right way.
|1. BIF - $340||2. chasp_0 - $251||3. mbutrovich - $250|
|4. Ryu Connor - $250||5. YetAnotherGeek2 - $200||6. aeassa - $175|
|7. dashbarron - $150||8. Lucky Jack Aubrey - $100||9. Captain Ned - $100|
|10. Anonymous Gerbil - $100|
|We take a seat on Turris' VR Chair||17|
|Deals of the week: Asus' MG278Q display for $400 and more||0|
|Phanteks wraps its Enthoo Evolv ATX case in sheets of glass||9|
|AOC Agon AG271QX is the first in a new line of gaming displays||15|
|HP's Chromebook 13 is dressed for success at $499||20|
|Apple and Samsung lead tablet shipments in a struggling market||25|
|MSI debuts entry-level and enthusiast C232 motherboards||12|
|Z410 SSDs bring a 480GB tier to SanDisk's entry-level drives||10|
|Galaxy S7 phones help Samsung deliver a strong first quarter||8|
|It's about time!||+39|