[ad_1]
Huawei was surprised to optimize some of its best smartphones to outperform benchmark tests. Tuesday, AnandTech discovered that Huawei's P20 had been programmed to optimize performance, especially when it was running 3DMark, a popular benchmarking application. Today, the company behind 3DMark issued a statement in which it claimed to have confirmed the results and would remove the P20, as well as three other Huawei phones with similar behavior, from its benchmark rankings.
The phones that are written off include the P20, the P20 Pro, the Nova 3 and the Honor Play. Huawei admitted this behavior in a statement given to Android Authority, saying that his phones are designed to adjust their performance based on the application being run.
But the way Huawei applied this behavior is not allowed. Although phones can adjust their performance as part of their normal behavior under high workloads, they can not be hard-coded to optimize their behavior simply because a specific test application is running. . That's what Huawei seems to have done, according to UL, which is behind the 3DMark software.
When UL launched an internal version of 3DMark, which Huawei phones could not recognize the name, the phones were less performing during the test. This meant that the phones were not smart enough to identify the high performance requirements themselves, which meant that the baseline score did not accurately reflect how the phone would handle a typical application without special attention from the audience. from Huawei.
As a punishment, 3DMark removed the ranking of these phones from its rankings and posted on its website noting that the "phone manufacturer did not comply with the UL reference rules". Many of their results have also been removed.
Huawei is far from being the first company to get caught with the benchmark results. Samsung suffered the same behavior on its flagship phones in 2013, and last year, OnePlus also did the same thing. This is particularly unfortunate for Huawei because a few weeks ago he was caught trying to get a DSLR photo as a picture of one of his phones.
The funny thing about all this is that benchmarks do not really matter. Twisting a phone to optimize reference applications can produce numbers that make a small subset of nerds drool, but these numbers do not match the actual experience of using the phone. They can talk about the phone's performance under intense stress, like games, but a better test is to just play a game and find out what's going on.
Huawei admits it even. In his statement, the company stated that she "always favors the user experience rather than looking for high benchmark scores, especially since there are not any." direct link between smartphone testing and user experiences. " when performing a benchmark test.
But Huawei also claims that its phones include artificial intelligence intelligent enough to optimize performance based on the current application, and this is clearly not the case. If that were the case, then improving performance for performance testing would be a fair game – but, for now, it does not really reflect the phone's performance in demanding situations.
Source link
