Antutu bans the Realme GT after it finds evidence of benchmark cheating

Publish date: 2023-05-06

TL;DR

Smartphone companies striving for high if not truly honest benchmark scores is nothing new. The latest apparent addition to the infamous benchmark cheating group is Realme, specifically the Realme GT.

In a Weibo post, (h/t GizmoChina) Antutu has outed the Realme GT for allegedly cheating its benchmark. As a result, it has also removed the phone’s ~750,000 score from the database. That’s considerably higher than the Xiaomi Mi 11’s score of ~708,000, per Antutu’s testing. Antutu specifically noted (via machine translation) that this figure was “not a manifestation of true strength, but obtained through cheating and other means.”

The phone reportedly used thread delay tactics to run the multithreaded test on its fastest CPU cores as much as possible. This, Antutu notes, resulted in a higher score. The Realme GT also “modified” the reference JPG image used by Antutu. Instead of processing the image verbatim, it instead used mosaic color blocks to reduce the quality of the image. This, in turn, allowed for lower processing times.

Realme GT's mulithreaded testRealme GT's JPG decoding test

Antutu notes that both tactics are against the spirit of the benchmark. The benchmark firm has therefore removed Realme GT’s scores for three months. It has also issued an ultimatum to Realme stating that if the firm won’t modify how the phone completes the benchmark, it will permanently ban the phone from Antutu.

Benchmark cheating

Realme is not the first firm outed for cheating on benchmarks. Last year, several MediaTek-powered phones by Oppo and others were reportedly gaming the PCMark test. The likes of Samsung, Huawei, OnePlus, and Meizu have been accused in the past, too.

For companies, benchmark figures remain an easy marketing tool. Arguably, these numbers may help a buyer not completely focused on other features or specs. It also helps the Realme GT to stand out as it competes against a number of other competent Snapdragon 888 phones.

They are supposed to standardize the performance of phones across a variety of common tasks. But companies gaming the system ultimately bring doubt to the figures. That’s something the likes of Antutu obviously want to guard against.

Do you care that smartphone makers still cheat in benchmarks?

987 votes

Yes, I do care.

77%

No, I don't care.

23%

Realme responds

Realme told Android Authority in an email that it believes the benchmark scores are “all accurate.” The firm also told us that it’s communicating with Antutu at the time of writing.

The company’s CMO Xu Qi Chase issued a statement to Weibo, calling the scores the “real data run under the current version” of Antutu. See the Google-translated statement above.

Do you really care if smartphone makers cheat in benchmarks? Be sure to vote in the poll above, and let us know your thoughts in the comments below.

Comments

ncG1vNJzZmivp6x7orrDq6ainJGqwam70aKrsmaTpLpwvsSao6adXZzBbq7Ep5qhpZGnuG6vx56YraGenHpyfo9xcGlsXw%3D%3D