The popular benchmarking app — Antutu — has come up with a quantifiable scale to judge AI performance of different smartphones.
The Antutu benchmark tool termed “AI Review” base its score on two categories: Image Classification and Object Classification. While the image classification test is based on the Inception v3 neural network, the Object Classification uses MobileNet SSD neural network.
Once a neural network is established, the test translates the original neural network into a neural network supported by the manufacturer, through the SDK provided by the manufacturer.
In the blog post, Antutu mentions that it is challenging to measure the AI performance of a smartphone. This is due to the lack of unified AI scale, and therefore, each phone manufacturer has a different kind of AI implementation on the device.
With that said, Antutu has still managed to come up some criteria. One of the grading criteria depends upon the balance of speed and accuracy. For instance, if the speed is good but the accuracy is poor, the test will immediately add penalties for it. Consequently, this will make it difficult for OEMs to cheat the AI review test.
While there is no word for the release of an official version, you can download the early benchmark version and know the score of your smartphone.
