AlphaAtlas
[H]ard|Gawd
- Joined
- Mar 3, 2018
- Messages
- 1,713
Amid allegations that Huawei devices are "cheating" in 3D benchmarks like 3DMark and GFXBench, Shrout Research found that the Huawei P20 Pro artificially inflates Geekbench scores. Ryan Shrout ran the public version of Geekbench and a "private version" with a renamed executable back to back, and found some drastic performance differences. The Kirin 970 device's single core score dropped 6.5% when using the private Geekbench app, while the multi core score dropped 16.7%. This suggests the SOC runs at an artificially high power state when the OS detects certain benchmarks.
Some have asked me why this issue matters; if the hardware is clearly capable of performance like this, why should Huawei and HiSilicon not be able to present it that way? The higher performance results that 3DMark, GFXBench, and now Geekbench show are not indicative of the performance consumers get with their devices on real applications. The entire goal of benchmarks and reviews is to try to convey the experience a buyer would get for a smartphone, or anything else for that matter.
Some have asked me why this issue matters; if the hardware is clearly capable of performance like this, why should Huawei and HiSilicon not be able to present it that way? The higher performance results that 3DMark, GFXBench, and now Geekbench show are not indicative of the performance consumers get with their devices on real applications. The entire goal of benchmarks and reviews is to try to convey the experience a buyer would get for a smartphone, or anything else for that matter.