Following reports that Samsung throttled performance for several apps and games on its flagship phones (and even throttled recent tablets like the S8 series), other manufacturers have come under scrutiny for their own performance-adjusting behaviors. Testing Xiaomi's latest lineup with the popular Geekbench benchmarking application, we've measured a noticeable performance difference between various "spoofed" versions of the app that were recognized by the system as known apps or games. According to Geekbench, this behavior will result in affected phones being delisted from its benchmarking charts. Xiaomi has since responded, expplaining more about how its performance profiling system works.

We tested several modified versions of the Geekbench application that were meant to trigger any app-identifying performance profiles on the Xiaomi 12 Pro and Xiaomi 12X. We're still investigating the mechanism behind how Xiaomi's performance tuning works (and we'll update if and when we learn more about it), but our preliminary numbers indicate that Xiaomi is giving apps it recognizes as games or benchmarks a better performance profile and throttling performance for other apps. This bears out with differences in benchmark scores for modified versions of the Geekbench app:

Geekbench Corporate

Genshin Spoof

Netflix Spoof

Chrome Spoof

Play Store Geekbench

12 Pro

738/3148

1119/3468

733/3065

737/3071

1201/3394

12X

712/3049

807/3314

708/3020

710/2973

978/3289

Geekbench results for the 12 Pro and 12X comparing versions of the app modified to look like other apps to the system (i.e., which were "spoofed").

Specific results of our testing varied between models, but generally indicated that the phone was using multiple performance profiles across apps. Checking two phones from the recent 12 series, the Snapdragon 8 Gen 1-powered 12 Pro is more affected by the performance throttling than the Snapdragon 888-equipped 12X.

Versions of the Geekbench app the system recognizes as either Geekbench or Genshin Impact saw benchmark results with up to 50% better single-core performance on the 12 Pro compared to versions of the app that the system believed were Netflix or Chrome — a substantial performance penalty. Even the 12X was affected to a certain degree, with a similar but smaller difference in results that was nonetheless larger than any expected margin of error.

Interestingly, performance even simply varied when the app identified correctly as Geekbench. The Play Store-distributed version of the app observed higher results than a slightly different corporate version of the app, which was throttled. The Xiaomi 12X also saw a bigger difference between game and benchmark performance, which didn't appear to be present on the 12 Pro. This could indicate a more complex throttling system, or different performance profiles depending on base hardware or phone model, as chipsets vary between the two devices.

The Xiaomi 12 Pro (first) and 12X (second).

Again, we haven't been able to dive into the inner technical workings of how Xiaomi's performance profiling/throttling might work yet. Based on these results, it seems like Xiaomi is simply loading different profiles based on app-identifying details like package names, with games and benchmarking applications getting full performance, while other potentially less demanding apps get a throttled performance profile. However, when sought for comment, Xiaomi told us its system is a little more sophisticated:

"Xiaomi applies temperature control strategies to ensure optimal product experience, particularly with demanding applications commonly used for extended periods. In many of our devices, we offer 3 performance modes, enabling users to adjust the balance of performance and power efficiency. At a system level, all optimizations related to application performance weigh many essential factors, such as power consumption, performance, and thermal impact."

Further testing on our part indicated that even in an available high-performance mode, Xiaomi still throttles performance for certain apps on the 12 Pro.

Xiaomi has engaged in similar "optimizations" in the past, with the Xiaomi 11T Pro using different performance profiles for different apps, in that case, adopting a faster-throttling performance profile for apps it believed to be games. Although we did not test "sustained" performance on our devices (we don't have a set standard for "sustained" testing at Android Police, and we aren't sure what Anandtech's standard references might be), the 12-series could have similar behavior.

Geekbench founder and president John Poole provided us with the following statement:

It's disappointing to see another device manufacturer mislead consumers by reducing application performance but not benchmark performance. We are investigating which Xiaomi handsets are affected and expect to start delisting Xiaomi handsets from the Android Benchmark chart later this week.

A precise schedule wasn't set, and we don't know how many of Xiaomi's phones might have this sort of selective throttling behavior — which Geekbench has previously told us it considers a form of benchmark manipulation — but phones that have been demonstrated to be affected will be removed from the company's Android Benchmark charts. Previously, Geekbench delisted four generations of Samsung phones for similar behavior. Although a recent update may have adjusted that behavior, Geekbench's policy to date has been that once a device is delisted, it remains delisted (though that could change).

Right now, the Xiaomi Mi 11 is #3 on the Geekbench Single Core charts, and the Poco F2 Pro is #2 on the Multi-Core chart. If either phone is demonstrated to be affected, they could lose those crowns.

UPDATE: 2022/04/01 11:38 EST BY RYNE HAGER

Xiaomi statement

Four days after initial publication, Xiaomi responded to our request for a statement with additional information. Our coverage has been updated.