Oh yes, things are really starting to kick off in the arcane world of smartphone benchmarking. First, there came clear evidence of phone makers manipulating scores in apps like AnTuTu and GFXBench, and now a more mainstream benchmarking company, Futuremark, has publicly delisted specific Samsung and HTC phones that it suspects of cheating. Futuremark says that the devices in question -- including the Galaxy Note 3, HTC One and HTC One Mini -- fail to adhere to the fairness policy, which requires that a device treats its 3DMark app just as it would treat any other app, with no tailor-made bursts of performance designed to achieve artificially high scores. Clearly, this bad behavior is just as endemic as we originally feared, so benchmark apps either need to toughen up, as Futuremark appears to be doing, or they need to find entirely new ways of measuring performance.
Filed under: Cellphones, Mobile, Samsung, HTC
Comments
Via: HotHardware, The Register
Source: Futuremark
You can add another big name to the list of phone makers found cheating on benchmarks. UL Benchmarks has delisted Oppo's Find X and F7 phones from its 3DMark charts after testing from itself and Tech2 revealed that both devices were artificially ram...
You'd think smartphone manufacturers would have learned their lesson after being caught cheating multiple times, but that's apparently not the case. UL Benchmarks (aka the Futuremark team) has delisted Huawei's P20 Pro, P20, Nova 3 and Honor Play fro...
