Hot topics

Why has falsifying benchmarks become so easy?

AndroidPIT faking a benchmark 2
© nextpit

Often, technical specifications and features are leaked online even before the smartphones have been officially unveiled. The main sources for such rumors are specification tests called benchmarks like AnTuTu, Geekbench and other similar applications. But how reliable are these tests?

Yes, benchmarks allow us to learn about the device. However, manipulating results is a function that doesn't take long to do and it allows you to publish different data. Today, we’re going to show you how one can falsify benchmark results.

Modify build.prop to have a Galaxy S8

Important system data is saved in the build.prop file including the name, model and Android version that the device is running. Through an app, this file can be modified, the only condition is that the smartphone must be rooted.

A text editor with a root access (or directly with BuildProp Editor) allows you to edit the important values. You then have to access a build.prop file to recover the actual values. I have used this method to turn my Moto G3 into a Samsung Galaxy S8. As you can see in the screenshot below, the smartphone now runs under Android 7.1!

AndroidPIT faking a benchmark 1
Here’s a Galaxy S8 running Android 7.1! © NextPit

Some important information before continuing with our guide: build.prop is a system file. Changing it can have consequences for the device - you may not even be able to start up your phone. It’s not advised to carry out this procedure with your everyday smartphone, but rather with another phone that you can eventually factory reset if you need to.

To modify these values, you will need to use the BuildProp Editor app:

  • ro.product.manufacturer: Samsung
  • ro.product.brand: Samsung
  • ro.product.model: Galaxy S8
  • ro.product.name: heroltexx

If you'd like to run the new version of Android, here’s how to modify it:

  • ro.build.version.release: 7.1

You could get satisfactory results by changing these values however, it’s preferable to dig deeper in the build.prop app to get higher authenticity. These options are sufficient for my tests. After modifying the following elements, you have to restart the phone.

Geekbench: perfect for producing false benchmarks

Geekbench is perfect for my experiment because the tests run quickly and the information is easily compiled. In the menu, select View Online and you will get a link to the results. Here you can see my test for the Moto G3 under the Samsung Galaxy S8 format:

AnTuTu and Geekbench: now it gets complicated

AnTuTu also provides a useful page that gathers all the results but it doesn’t provide the option to publish them. The screenhot below shows that our Galaxy S8 runs under Android 7.1. But even though AnTuTu has an integrated share feature, it wasn’t possible to get it working in our test.

AndroidPIT faking a benchmark 3
AnTuTu reveals some characteristics of the Galaxy S8... I mean, of the Moto G3. © NextPit

In the first GFXbench test, we received notification messages indicating that the results were saved in the database. This isn’t a problem for our Galaxy S8 ;) However, GFXbench verifies certain information in order to evaluate the tests’ reliability.

ANDROIDPIT antutu gfxbench fake
The AnTuTu and GFXbench results! © Screenshots: ANDROIDPIT

How can you perfectly falsify a benchmark?

To achieve the most credible results, it’s better to use a smartphone that is technically similar. For example, a Samsung Galaxy S7 could easily be used to falsify the benchmark for, hypothetically, a Note 7 or Galaxy S8. With an app like Geekbench, the technical difference will not be picked up.

If you’re lucky, you’ll get as far as attracting attention from technology websites that feature your falsified benchmark.

Conclusion: rumors prove that benchmarks are easily falsified

Through my test, I wanted to show how easy it is to falsify benchmark data for devices that are still on the market. Geekbench is particularly easy but, with a little more effort, you could also falsify benchmarks through AnTuTu and GFXBench.

However, sometimes brand employees test smartphones that have not yet been officially announced but this is rare.

Have you already tried to falsify a benchmark? Let us know about it in the comments.

  nextpit recommendation Price tip Luxury version with handle Price tip with handle For Garmin fans Mid-range tip
Product
Image Withings Body Smart Product Image Renpho Smart Body Fat Scale Product Image Withings Body Scan Product Image Lepulse Lescale P1 Product Image Garmin Index S2 Smart Scale Product Image eufy Smart Scale P3 Product Image
Deals*
Go to comment (1)
Hans-Georg Kluge

Hans-Georg Kluge
Editor

Hans-Georg writes about apps, hardware and other stuff that happens in the Android universe. He is a happy owner of the Galaxy S7 but enjoys time with an iPad as well.

Liked this article? Share now!
Recommended articles
Latest articles
Push notification Next article
1 Comment
Write new comment:
All changes will be saved. No drafts are saved when editing
Write new comment:
All changes will be saved. No drafts are saved when editing

  • Jerry's W. 20
    Jerry's W. Oct 14, 2016 Link to comment

    What is the point of falsifying benchmark? To trick who with what purpose?
    I advice people who hear about the file build.prop for the first time and did not know about its existence to keep far far far away from it like author writes.
    Unless you want to have to bring it to repairshop like it is your hobby....