Page 1 of 5

Android benchmark. Looking for testers

Posted: Thu Sep 20, 2012 3:42 pm
by codedivine
edit: I am pleased to announce that it is now live on Google Play. Thanks everyone who tested. Download at https://play.google.com/store/apps/details?id=org.codedivine.rgbench

The current tests for FP performance benchmarking on Android (such as Linpack for Android) are IMO not very accurate. Many such tests are written using Java, and are not properly tuned to use the hardware.

Thus, I have implemented my own small benchmark. I have tested it on a Snapdragon S3 based device already, and need testers for other systems. Currently, the test is in early stages and I am still experimenting. It is currently single-threaded but will be adding multi-threaded modes, as well as more comprehensive tests.

If you are interested, let me know and I will provide you with a self-signed APK. It will run on any device running ICS or higher. If you are worried about security of a non-market APK, note that the APK does not need internet access or SD card access. In fact, it does not ask for any special permissions at all. All you get is an application that has a "Run" button. You run it, and shows the result on screen.

Re: Android benchmark. Looking for testers

Posted: Thu Sep 20, 2012 3:48 pm
by willyjwebb
im running a galaxy s2 i9100m, id be interested to try it out

edit: im running a custom jelly bean rom, dont know if that matters to you or not

Re: Android benchmark. Looking for testers

Posted: Thu Sep 20, 2012 3:50 pm
by DancinJack
I'm on a Galaxy Nexus. I'll give it a shot even though the OMAP4460 is a little dated now.

e: I should mention that I'm not running a stock kernel nor stock speeds. I can jump back to stock if that's what you want for the tests.

Re: Android benchmark. Looking for testers

Posted: Thu Sep 20, 2012 3:57 pm
by codedivine
Thanks. PMed you both. It is not necessary to run stock kernel right now. More interested in compatibility and stability testing for now.

Re: Android benchmark. Looking for testers

Posted: Thu Sep 20, 2012 4:02 pm
by willyjwebb
rgbench freezes up, then shows at not responding :(

edit: ran the second time, 787.1224180946756 MFlops

Re: Android benchmark. Looking for testers

Posted: Thu Sep 20, 2012 4:06 pm
by DancinJack
FC's on me. Uninstall+reinstall and still FC's.

Like I said, I'm on a custom ROM and a custom kernel. May be the issue. I'll throw the stock 4.1.1 kernel on there and give it a shot.

Re: Android benchmark. Looking for testers

Posted: Thu Sep 20, 2012 4:07 pm
by killadark
Im willin to try using international s3 on jelly bean

Re: Android benchmark. Looking for testers

Posted: Thu Sep 20, 2012 4:08 pm
by codedivine
Thank you both. I will attempt a fix for the not-responding issue. I think I know what the problem is.
On my Snapdragon S3 (1.5GHz), I got about 610 MFlops.

Re: Android benchmark. Looking for testers

Posted: Thu Sep 20, 2012 4:13 pm
by codedivine
killadark wrote:
Im willin to try using international s3 on jelly bean


PMed.

Re: Android benchmark. Looking for testers

Posted: Thu Sep 20, 2012 4:16 pm
by DancinJack
I'm going to predict ~1100 MFlops for that international GS3.

Re: Android benchmark. Looking for testers

Posted: Thu Sep 20, 2012 4:16 pm
by willyjwebb
your s3 got a lower score than my s2?

Re: Android benchmark. Looking for testers

Posted: Thu Sep 20, 2012 4:18 pm
by DancinJack
willyjwebb wrote:
your s3 got a lower score than my s2?


He's talking about the processor. The processor in your S2 is a dual core Exynos if I'm not mistaken. A slightly faster SoC than the Quallcomm S3 that is in his device.

Re: Android benchmark. Looking for testers

Posted: Thu Sep 20, 2012 4:20 pm
by willyjwebb
yeah, im just surprised samsungs new galaxy would show lower scores, is that the quad core that we have here in canada, or a different version?

edit: reading fail, i see what you are saying now, he never said it was a galaxy s3, its the snapdragon s3, duhhhh

Re: Android benchmark. Looking for testers

Posted: Thu Sep 20, 2012 4:20 pm
by codedivine
DancinJack wrote:
willyjwebb wrote:
your s3 got a lower score than my s2?


He's talking about the processor. The processor in your S2 is a dual core Exynos if I'm not mistaken. A slightly faster SoC than the Quallcomm S3 that is in his device.


Correct. My device is a Galaxy T989, sold by T-Mobile and Telus/Koodo as Galaxy S2-X.

Re: Android benchmark. Looking for testers

Posted: Thu Sep 20, 2012 4:22 pm
by killadark
995.9432 MFlops
Sgs3 international
Jelly bean
No fc's
Sorry to dissapoint some people :p

Re: Android benchmark. Looking for testers

Posted: Thu Sep 20, 2012 4:23 pm
by Captain Ned
If you want some humor find a way to make that app work for Froyo so I can revel in the slowness of my Droid 2 Global. If you're feeling really frisky, compile it for Bugless Beast (Eclair) on the OG Droid (my daughter's phone; my first smartphone).

Re: Android benchmark. Looking for testers

Posted: Thu Sep 20, 2012 4:23 pm
by willyjwebb
i work in a pawn shop, and literally just got a galaxy s2 lte in, i wonder what, if any, difference i would see from mine to that

Re: Android benchmark. Looking for testers

Posted: Thu Sep 20, 2012 4:23 pm
by Captain Ned
willyjwebb wrote:
i work in a pawn shop, and literally just got a galaxy s2 lte in, i wonder what, if any, difference i would see from mine to that

Chumlee!!!!

Re: Android benchmark. Looking for testers

Posted: Thu Sep 20, 2012 4:24 pm
by DancinJack
Dang. That's codedivine's fault for not multi-threading it yet. ;)

Re: Android benchmark. Looking for testers

Posted: Thu Sep 20, 2012 4:26 pm
by willyjwebb
Captain Ned wrote:
willyjwebb wrote:
i work in a pawn shop, and literally just got a galaxy s2 lte in, i wonder what, if any, difference i would see from mine to that

Chumlee!!!!


nahhh, not that dumb, or fat, lol
the pawn business up here is quite boring compared to the stuff you see on tv

as im sitting at work on a work laptop now, it just shows how boring it really is

Re: Android benchmark. Looking for testers

Posted: Thu Sep 20, 2012 4:31 pm
by PGleo86
I'll give it a shot on both of my phones:
Verizon Galaxy S3 rooted on stock
Droid Incredible running some custom ICS build (haven't flashed anything new to that in about 3-4 months)

Re: Android benchmark. Looking for testers

Posted: Thu Sep 20, 2012 4:35 pm
by ChronoReverse
Does this bench use just VFP or does it also take advantage of NEON?

I have the LTE Galaxy Note which has the Snapdragon S3.

Re: Android benchmark. Looking for testers

Posted: Thu Sep 20, 2012 4:35 pm
by codedivine
PGleo86 wrote:
I'll give it a shot on both of my phones:
Verizon Galaxy S3 rooted on stock
Droid Incredible running some custom ICS build (haven't flashed anything new to that in about 3-4 months)


PMed.

Re: Android benchmark. Looking for testers

Posted: Thu Sep 20, 2012 4:36 pm
by codedivine
ChronoReverse wrote:
Does this bench use just VFP or does it also take advantage of NEON?

I have the LTE Galaxy Note which has the Snapdragon S3.


Just VFP. It is doing fp64 computations which NEON does not support AFAIK. PMing you.

Re: Android benchmark. Looking for testers

Posted: Thu Sep 20, 2012 4:41 pm
by codedivine
I think I have gotten enough testers for today. I will try and fix the FCs, and add multi-threading. Hope to do so in a week or two when I get time.
I am also thinking of exploring using Renderscript Compute instead of NDK.

Re: Android benchmark. Looking for testers

Posted: Thu Sep 20, 2012 4:47 pm
by ChronoReverse
codedivine wrote:
ChronoReverse wrote:
Does this bench use just VFP or does it also take advantage of NEON?

I have the LTE Galaxy Note which has the Snapdragon S3.


Just VFP. It is doing fp64 computations which NEON does not support AFAIK. PMing you.


Ah, I was hoping to eventually see a NEON benchmark too since it would put my S3 in a better light lol.

My Snapdragon S3 @ 1.5GHz on Android 4.1 (JB, CM10) scored around 735 for all three runs. I'm already liking this better than Linpack in that it has more more stable scores. I wonder how the workload spread compares.


Seems stable on my Galaxy Note. Ran it 6 times with scores ranging from 715 to 738

Re: Android benchmark. Looking for testers

Posted: Thu Sep 20, 2012 5:01 pm
by codedivine
ChronoReverse wrote:
codedivine wrote:
ChronoReverse wrote:
Does this bench use just VFP or does it also take advantage of NEON?

I have the LTE Galaxy Note which has the Snapdragon S3.


Just VFP. It is doing fp64 computations which NEON does not support AFAIK. PMing you.


Ah, I was hoping to eventually see a NEON benchmark too since it would put my S3 in a better light lol.

My Snapdragon S3 @ 1.5GHz on Android 4.1 (JB, CM10) scored around 735 for all three runs. I'm already liking this better than Linpack in that it has more more stable scores. I wonder how the workload spread compares.


Thanks. It is essentially doing a tiled matrix multiply, but it is testing multiple versions of the code and reporting the best performance found on the device.
A well-written LINPACK usually depends on matrix multiply performance anyway so the performance should not be too far off from a well-written LINPACK. It is a micro-benchmark, which is not 100% ideal, but is still better than what is available on Android today.

At some point, I also plan to add a few more tests. Numbers will be reported separately of course.

Re: Android benchmark. Looking for testers

Posted: Thu Sep 20, 2012 5:12 pm
by Philldoe
I have an Asus TF300 with a Tegra 3 in it if you need another tester.

Re: Android benchmark. Looking for testers

Posted: Thu Sep 20, 2012 5:17 pm
by codedivine
Philldoe wrote:
I have an Asus TF300 with a Tegra 3 in it if you need another tester.


PMed.

Re: Android benchmark. Looking for testers

Posted: Thu Sep 20, 2012 5:24 pm
by killadark
Philldoe wrote:
I have an Asus TF300 with a Tegra 3 in it if you need another tester.

Will test on tf101 also