Android benchmark. Looking for testers

Laptops, PDAs, Cell Phones, and all other tech that you carry with you.

Moderators: mac_h8r1, Nelliesboo, David

Android benchmark. Looking for testers

Postposted on Thu Sep 20, 2012 3:42 pm

edit: I am pleased to announce that it is now live on Google Play. Thanks everyone who tested. Download at https://play.google.com/store/apps/details?id=org.codedivine.rgbench

The current tests for FP performance benchmarking on Android (such as Linpack for Android) are IMO not very accurate. Many such tests are written using Java, and are not properly tuned to use the hardware.

Thus, I have implemented my own small benchmark. I have tested it on a Snapdragon S3 based device already, and need testers for other systems. Currently, the test is in early stages and I am still experimenting. It is currently single-threaded but will be adding multi-threaded modes, as well as more comprehensive tests.

If you are interested, let me know and I will provide you with a self-signed APK. It will run on any device running ICS or higher. If you are worried about security of a non-market APK, note that the APK does not need internet access or SD card access. In fact, it does not ask for any special permissions at all. All you get is an application that has a "Run" button. You run it, and shows the result on screen.
Last edited by codedivine on Mon Sep 24, 2012 1:14 pm, edited 1 time in total.
codedivine
Gerbil Elite
Silver subscriber
 
 
Posts: 705
Joined: Sat Jan 24, 2009 8:13 am

Re: Android benchmark. Looking for testers

Postposted on Thu Sep 20, 2012 3:48 pm

im running a galaxy s2 i9100m, id be interested to try it out

edit: im running a custom jelly bean rom, dont know if that matters to you or not
Last edited by willyjwebb on Thu Sep 20, 2012 3:55 pm, edited 1 time in total.
I7-860, 2x4 gig crucial ballistix ram,64 gb kingston ssdnow, 2tb wd fyps2002, ihas rev b burner, radeon 5850, rocketfish 900 watt, coolermaster elite
willyjwebb
Gerbil
 
Posts: 64
Joined: Sun Jul 22, 2012 9:38 pm

Re: Android benchmark. Looking for testers

Postposted on Thu Sep 20, 2012 3:50 pm

I'm on a Galaxy Nexus. I'll give it a shot even though the OMAP4460 is a little dated now.

e: I should mention that I'm not running a stock kernel nor stock speeds. I can jump back to stock if that's what you want for the tests.
i7 860 - GA-P55-USB3 - 8GiB - HD7850 - SSD - 3.64TB HDD - Xonar D1 - U2410 - Win7 Pro x64.
DancinJack
Minister of Gerbil Affairs
 
Posts: 2050
Joined: Sat Nov 25, 2006 3:21 pm
Location: Austin, TX

Re: Android benchmark. Looking for testers

Postposted on Thu Sep 20, 2012 3:57 pm

Thanks. PMed you both. It is not necessary to run stock kernel right now. More interested in compatibility and stability testing for now.
codedivine
Gerbil Elite
Silver subscriber
 
 
Posts: 705
Joined: Sat Jan 24, 2009 8:13 am

Re: Android benchmark. Looking for testers

Postposted on Thu Sep 20, 2012 4:02 pm

rgbench freezes up, then shows at not responding :(

edit: ran the second time, 787.1224180946756 MFlops
I7-860, 2x4 gig crucial ballistix ram,64 gb kingston ssdnow, 2tb wd fyps2002, ihas rev b burner, radeon 5850, rocketfish 900 watt, coolermaster elite
willyjwebb
Gerbil
 
Posts: 64
Joined: Sun Jul 22, 2012 9:38 pm

Re: Android benchmark. Looking for testers

Postposted on Thu Sep 20, 2012 4:06 pm

FC's on me. Uninstall+reinstall and still FC's.

Like I said, I'm on a custom ROM and a custom kernel. May be the issue. I'll throw the stock 4.1.1 kernel on there and give it a shot.
Last edited by DancinJack on Thu Sep 20, 2012 4:08 pm, edited 1 time in total.
i7 860 - GA-P55-USB3 - 8GiB - HD7850 - SSD - 3.64TB HDD - Xonar D1 - U2410 - Win7 Pro x64.
DancinJack
Minister of Gerbil Affairs
 
Posts: 2050
Joined: Sat Nov 25, 2006 3:21 pm
Location: Austin, TX

Re: Android benchmark. Looking for testers

Postposted on Thu Sep 20, 2012 4:07 pm

Im willin to try using international s3 on jelly bean
AMD FX-8350|Sabetooth 990FX|16gb Kingston Hyper X|Samsung SSD 120g 840|AMD R9 290 TRI-X
TT ToughPower 850w,Thermaltake Xaser vi ,Creative SoundBlaster X-Fi Titanium Sound Card
killadark
Gerbil Team Leader
 
Posts: 293
Joined: Fri Feb 22, 2008 2:55 am

Re: Android benchmark. Looking for testers

Postposted on Thu Sep 20, 2012 4:08 pm

Thank you both. I will attempt a fix for the not-responding issue. I think I know what the problem is.
On my Snapdragon S3 (1.5GHz), I got about 610 MFlops.
codedivine
Gerbil Elite
Silver subscriber
 
 
Posts: 705
Joined: Sat Jan 24, 2009 8:13 am

Re: Android benchmark. Looking for testers

Postposted on Thu Sep 20, 2012 4:13 pm

killadark wrote:Im willin to try using international s3 on jelly bean


PMed.
codedivine
Gerbil Elite
Silver subscriber
 
 
Posts: 705
Joined: Sat Jan 24, 2009 8:13 am

Re: Android benchmark. Looking for testers

Postposted on Thu Sep 20, 2012 4:16 pm

I'm going to predict ~1100 MFlops for that international GS3.
i7 860 - GA-P55-USB3 - 8GiB - HD7850 - SSD - 3.64TB HDD - Xonar D1 - U2410 - Win7 Pro x64.
DancinJack
Minister of Gerbil Affairs
 
Posts: 2050
Joined: Sat Nov 25, 2006 3:21 pm
Location: Austin, TX

Re: Android benchmark. Looking for testers

Postposted on Thu Sep 20, 2012 4:16 pm

your s3 got a lower score than my s2?
I7-860, 2x4 gig crucial ballistix ram,64 gb kingston ssdnow, 2tb wd fyps2002, ihas rev b burner, radeon 5850, rocketfish 900 watt, coolermaster elite
willyjwebb
Gerbil
 
Posts: 64
Joined: Sun Jul 22, 2012 9:38 pm

Re: Android benchmark. Looking for testers

Postposted on Thu Sep 20, 2012 4:18 pm

willyjwebb wrote:your s3 got a lower score than my s2?


He's talking about the processor. The processor in your S2 is a dual core Exynos if I'm not mistaken. A slightly faster SoC than the Quallcomm S3 that is in his device.
i7 860 - GA-P55-USB3 - 8GiB - HD7850 - SSD - 3.64TB HDD - Xonar D1 - U2410 - Win7 Pro x64.
DancinJack
Minister of Gerbil Affairs
 
Posts: 2050
Joined: Sat Nov 25, 2006 3:21 pm
Location: Austin, TX

Re: Android benchmark. Looking for testers

Postposted on Thu Sep 20, 2012 4:20 pm

yeah, im just surprised samsungs new galaxy would show lower scores, is that the quad core that we have here in canada, or a different version?

edit: reading fail, i see what you are saying now, he never said it was a galaxy s3, its the snapdragon s3, duhhhh
Last edited by willyjwebb on Thu Sep 20, 2012 4:21 pm, edited 1 time in total.
I7-860, 2x4 gig crucial ballistix ram,64 gb kingston ssdnow, 2tb wd fyps2002, ihas rev b burner, radeon 5850, rocketfish 900 watt, coolermaster elite
willyjwebb
Gerbil
 
Posts: 64
Joined: Sun Jul 22, 2012 9:38 pm

Re: Android benchmark. Looking for testers

Postposted on Thu Sep 20, 2012 4:20 pm

DancinJack wrote:
willyjwebb wrote:your s3 got a lower score than my s2?


He's talking about the processor. The processor in your S2 is a dual core Exynos if I'm not mistaken. A slightly faster SoC than the Quallcomm S3 that is in his device.


Correct. My device is a Galaxy T989, sold by T-Mobile and Telus/Koodo as Galaxy S2-X.
codedivine
Gerbil Elite
Silver subscriber
 
 
Posts: 705
Joined: Sat Jan 24, 2009 8:13 am

Re: Android benchmark. Looking for testers

Postposted on Thu Sep 20, 2012 4:22 pm

995.9432 MFlops
Sgs3 international
Jelly bean
No fc's
Sorry to dissapoint some people :p
AMD FX-8350|Sabetooth 990FX|16gb Kingston Hyper X|Samsung SSD 120g 840|AMD R9 290 TRI-X
TT ToughPower 850w,Thermaltake Xaser vi ,Creative SoundBlaster X-Fi Titanium Sound Card
killadark
Gerbil Team Leader
 
Posts: 293
Joined: Fri Feb 22, 2008 2:55 am

Re: Android benchmark. Looking for testers

Postposted on Thu Sep 20, 2012 4:23 pm

If you want some humor find a way to make that app work for Froyo so I can revel in the slowness of my Droid 2 Global. If you're feeling really frisky, compile it for Bugless Beast (Eclair) on the OG Droid (my daughter's phone; my first smartphone).
Life is hard; but it's harder if you're stupid. Big Al.
Captain Ned
Global Moderator
Gold subscriber
 
 
Posts: 20437
Joined: Wed Jan 16, 2002 7:00 pm
Location: Vermont, USA

Re: Android benchmark. Looking for testers

Postposted on Thu Sep 20, 2012 4:23 pm

i work in a pawn shop, and literally just got a galaxy s2 lte in, i wonder what, if any, difference i would see from mine to that
I7-860, 2x4 gig crucial ballistix ram,64 gb kingston ssdnow, 2tb wd fyps2002, ihas rev b burner, radeon 5850, rocketfish 900 watt, coolermaster elite
willyjwebb
Gerbil
 
Posts: 64
Joined: Sun Jul 22, 2012 9:38 pm

Re: Android benchmark. Looking for testers

Postposted on Thu Sep 20, 2012 4:23 pm

willyjwebb wrote:i work in a pawn shop, and literally just got a galaxy s2 lte in, i wonder what, if any, difference i would see from mine to that

Chumlee!!!!
Life is hard; but it's harder if you're stupid. Big Al.
Captain Ned
Global Moderator
Gold subscriber
 
 
Posts: 20437
Joined: Wed Jan 16, 2002 7:00 pm
Location: Vermont, USA

Re: Android benchmark. Looking for testers

Postposted on Thu Sep 20, 2012 4:24 pm

Dang. That's codedivine's fault for not multi-threading it yet. ;)
i7 860 - GA-P55-USB3 - 8GiB - HD7850 - SSD - 3.64TB HDD - Xonar D1 - U2410 - Win7 Pro x64.
DancinJack
Minister of Gerbil Affairs
 
Posts: 2050
Joined: Sat Nov 25, 2006 3:21 pm
Location: Austin, TX

Re: Android benchmark. Looking for testers

Postposted on Thu Sep 20, 2012 4:26 pm

Captain Ned wrote:
willyjwebb wrote:i work in a pawn shop, and literally just got a galaxy s2 lte in, i wonder what, if any, difference i would see from mine to that

Chumlee!!!!


nahhh, not that dumb, or fat, lol
the pawn business up here is quite boring compared to the stuff you see on tv

as im sitting at work on a work laptop now, it just shows how boring it really is
I7-860, 2x4 gig crucial ballistix ram,64 gb kingston ssdnow, 2tb wd fyps2002, ihas rev b burner, radeon 5850, rocketfish 900 watt, coolermaster elite
willyjwebb
Gerbil
 
Posts: 64
Joined: Sun Jul 22, 2012 9:38 pm

Re: Android benchmark. Looking for testers

Postposted on Thu Sep 20, 2012 4:31 pm

I'll give it a shot on both of my phones:
Verizon Galaxy S3 rooted on stock
Droid Incredible running some custom ICS build (haven't flashed anything new to that in about 3-4 months)
ASRock A55 Pro3, AMD A8 x4 3850 @ 4.7 + Xigmatek Gaia, Thermaltake V3 Black Edition, 8GB DDR3/1600, HIS 6870 1GB, 620W PSU, 500GB HDD, 250GB HDD, 3TB HDD, Logitech x530 5.1
PGleo86
Gerbil
 
Posts: 29
Joined: Sun May 20, 2012 7:03 pm

Re: Android benchmark. Looking for testers

Postposted on Thu Sep 20, 2012 4:35 pm

Does this bench use just VFP or does it also take advantage of NEON?

I have the LTE Galaxy Note which has the Snapdragon S3.
ChronoReverse
Gerbil Elite
 
Posts: 736
Joined: Wed Dec 12, 2007 4:20 pm

Re: Android benchmark. Looking for testers

Postposted on Thu Sep 20, 2012 4:35 pm

PGleo86 wrote:I'll give it a shot on both of my phones:
Verizon Galaxy S3 rooted on stock
Droid Incredible running some custom ICS build (haven't flashed anything new to that in about 3-4 months)


PMed.
codedivine
Gerbil Elite
Silver subscriber
 
 
Posts: 705
Joined: Sat Jan 24, 2009 8:13 am

Re: Android benchmark. Looking for testers

Postposted on Thu Sep 20, 2012 4:36 pm

ChronoReverse wrote:Does this bench use just VFP or does it also take advantage of NEON?

I have the LTE Galaxy Note which has the Snapdragon S3.


Just VFP. It is doing fp64 computations which NEON does not support AFAIK. PMing you.
codedivine
Gerbil Elite
Silver subscriber
 
 
Posts: 705
Joined: Sat Jan 24, 2009 8:13 am

Re: Android benchmark. Looking for testers

Postposted on Thu Sep 20, 2012 4:41 pm

I think I have gotten enough testers for today. I will try and fix the FCs, and add multi-threading. Hope to do so in a week or two when I get time.
I am also thinking of exploring using Renderscript Compute instead of NDK.
codedivine
Gerbil Elite
Silver subscriber
 
 
Posts: 705
Joined: Sat Jan 24, 2009 8:13 am

Re: Android benchmark. Looking for testers

Postposted on Thu Sep 20, 2012 4:47 pm

codedivine wrote:
ChronoReverse wrote:Does this bench use just VFP or does it also take advantage of NEON?

I have the LTE Galaxy Note which has the Snapdragon S3.


Just VFP. It is doing fp64 computations which NEON does not support AFAIK. PMing you.


Ah, I was hoping to eventually see a NEON benchmark too since it would put my S3 in a better light lol.

My Snapdragon S3 @ 1.5GHz on Android 4.1 (JB, CM10) scored around 735 for all three runs. I'm already liking this better than Linpack in that it has more more stable scores. I wonder how the workload spread compares.


Seems stable on my Galaxy Note. Ran it 6 times with scores ranging from 715 to 738
ChronoReverse
Gerbil Elite
 
Posts: 736
Joined: Wed Dec 12, 2007 4:20 pm

Re: Android benchmark. Looking for testers

Postposted on Thu Sep 20, 2012 5:01 pm

ChronoReverse wrote:
codedivine wrote:
ChronoReverse wrote:Does this bench use just VFP or does it also take advantage of NEON?

I have the LTE Galaxy Note which has the Snapdragon S3.


Just VFP. It is doing fp64 computations which NEON does not support AFAIK. PMing you.


Ah, I was hoping to eventually see a NEON benchmark too since it would put my S3 in a better light lol.

My Snapdragon S3 @ 1.5GHz on Android 4.1 (JB, CM10) scored around 735 for all three runs. I'm already liking this better than Linpack in that it has more more stable scores. I wonder how the workload spread compares.


Thanks. It is essentially doing a tiled matrix multiply, but it is testing multiple versions of the code and reporting the best performance found on the device.
A well-written LINPACK usually depends on matrix multiply performance anyway so the performance should not be too far off from a well-written LINPACK. It is a micro-benchmark, which is not 100% ideal, but is still better than what is available on Android today.

At some point, I also plan to add a few more tests. Numbers will be reported separately of course.
codedivine
Gerbil Elite
Silver subscriber
 
 
Posts: 705
Joined: Sat Jan 24, 2009 8:13 am

Re: Android benchmark. Looking for testers

Postposted on Thu Sep 20, 2012 5:12 pm

I have an Asus TF300 with a Tegra 3 in it if you need another tester.
Fastfreak39: I feel like they should change the phrase "jumping on the band wagon" to "sailing on the pirate ship"
Philldoe
Minister of Gerbil Affairs
 
Posts: 2795
Joined: Thu May 13, 2004 12:12 pm
Location: Turn around...

Re: Android benchmark. Looking for testers

Postposted on Thu Sep 20, 2012 5:17 pm

Philldoe wrote:I have an Asus TF300 with a Tegra 3 in it if you need another tester.


PMed.
codedivine
Gerbil Elite
Silver subscriber
 
 
Posts: 705
Joined: Sat Jan 24, 2009 8:13 am

Re: Android benchmark. Looking for testers

Postposted on Thu Sep 20, 2012 5:24 pm

Philldoe wrote:I have an Asus TF300 with a Tegra 3 in it if you need another tester.

Will test on tf101 also
AMD FX-8350|Sabetooth 990FX|16gb Kingston Hyper X|Samsung SSD 120g 840|AMD R9 290 TRI-X
TT ToughPower 850w,Thermaltake Xaser vi ,Creative SoundBlaster X-Fi Titanium Sound Card
killadark
Gerbil Team Leader
 
Posts: 293
Joined: Fri Feb 22, 2008 2:55 am

Next

Return to Mobile Tech

Who is online

Users browsing this forum: Google [Bot] and 5 guests