Personal computing discussed

Moderators: renee, David, mac_h8r1, Nelliesboo

 
codedivine
Gerbil Elite
Topic Author
Posts: 714
Joined: Sat Jan 24, 2009 8:13 am

Android benchmark. Looking for testers

Thu Sep 20, 2012 3:42 pm

edit: I am pleased to announce that it is now live on Google Play. Thanks everyone who tested. Download at https://play.google.com/store/apps/details?id=org.codedivine.rgbench

The current tests for FP performance benchmarking on Android (such as Linpack for Android) are IMO not very accurate. Many such tests are written using Java, and are not properly tuned to use the hardware.

Thus, I have implemented my own small benchmark. I have tested it on a Snapdragon S3 based device already, and need testers for other systems. Currently, the test is in early stages and I am still experimenting. It is currently single-threaded but will be adding multi-threaded modes, as well as more comprehensive tests.

If you are interested, let me know and I will provide you with a self-signed APK. It will run on any device running ICS or higher. If you are worried about security of a non-market APK, note that the APK does not need internet access or SD card access. In fact, it does not ask for any special permissions at all. All you get is an application that has a "Run" button. You run it, and shows the result on screen.
Last edited by codedivine on Mon Sep 24, 2012 1:14 pm, edited 1 time in total.
 
willyjwebb
Gerbil
Posts: 64
Joined: Sun Jul 22, 2012 9:38 pm

Re: Android benchmark. Looking for testers

Thu Sep 20, 2012 3:48 pm

im running a galaxy s2 i9100m, id be interested to try it out

edit: im running a custom jelly bean rom, dont know if that matters to you or not
Last edited by willyjwebb on Thu Sep 20, 2012 3:55 pm, edited 1 time in total.
I7-860, 2x4 gig crucial ballistix ram,64 gb kingston ssdnow, 2tb wd fyps2002, ihas rev b burner, radeon 5850, rocketfish 900 watt, coolermaster elite
 
DancinJack
Maximum Gerbil
Posts: 4494
Joined: Sat Nov 25, 2006 3:21 pm
Location: Kansas

Re: Android benchmark. Looking for testers

Thu Sep 20, 2012 3:50 pm

I'm on a Galaxy Nexus. I'll give it a shot even though the OMAP4460 is a little dated now.

e: I should mention that I'm not running a stock kernel nor stock speeds. I can jump back to stock if that's what you want for the tests.
i7 6700K - Z170 - 16GiB DDR4 - GTX 1080 - 512GB SSD - 256GB SSD - 500GB SSD - 3TB HDD- 27" IPS G-sync - Win10 Pro x64 - Ubuntu/Mint x64 :: 2015 13" rMBP Sierra :: Canon EOS 80D/Sony RX100
 
codedivine
Gerbil Elite
Topic Author
Posts: 714
Joined: Sat Jan 24, 2009 8:13 am

Re: Android benchmark. Looking for testers

Thu Sep 20, 2012 3:57 pm

Thanks. PMed you both. It is not necessary to run stock kernel right now. More interested in compatibility and stability testing for now.
 
willyjwebb
Gerbil
Posts: 64
Joined: Sun Jul 22, 2012 9:38 pm

Re: Android benchmark. Looking for testers

Thu Sep 20, 2012 4:02 pm

rgbench freezes up, then shows at not responding :(

edit: ran the second time, 787.1224180946756 MFlops
I7-860, 2x4 gig crucial ballistix ram,64 gb kingston ssdnow, 2tb wd fyps2002, ihas rev b burner, radeon 5850, rocketfish 900 watt, coolermaster elite
 
DancinJack
Maximum Gerbil
Posts: 4494
Joined: Sat Nov 25, 2006 3:21 pm
Location: Kansas

Re: Android benchmark. Looking for testers

Thu Sep 20, 2012 4:06 pm

FC's on me. Uninstall+reinstall and still FC's.

Like I said, I'm on a custom ROM and a custom kernel. May be the issue. I'll throw the stock 4.1.1 kernel on there and give it a shot.
Last edited by DancinJack on Thu Sep 20, 2012 4:08 pm, edited 1 time in total.
i7 6700K - Z170 - 16GiB DDR4 - GTX 1080 - 512GB SSD - 256GB SSD - 500GB SSD - 3TB HDD- 27" IPS G-sync - Win10 Pro x64 - Ubuntu/Mint x64 :: 2015 13" rMBP Sierra :: Canon EOS 80D/Sony RX100
 
killadark
Gerbil XP
Posts: 376
Joined: Fri Feb 22, 2008 2:55 am

Re: Android benchmark. Looking for testers

Thu Sep 20, 2012 4:07 pm

Im willin to try using international s3 on jelly bean
AMD FX-8350|Asus M5A97 LE R2.0|16gb GSKILL Sniper 2400mhz|Samsung SSD 120g 840|AMD R9 290 TRI-X (dead) GTX1070
Corsair RM650x,Thermaltake Xaser vi ,Creative SoundBlaster X-Fi Titanium Sound Card
 
codedivine
Gerbil Elite
Topic Author
Posts: 714
Joined: Sat Jan 24, 2009 8:13 am

Re: Android benchmark. Looking for testers

Thu Sep 20, 2012 4:08 pm

Thank you both. I will attempt a fix for the not-responding issue. I think I know what the problem is.
On my Snapdragon S3 (1.5GHz), I got about 610 MFlops.
 
codedivine
Gerbil Elite
Topic Author
Posts: 714
Joined: Sat Jan 24, 2009 8:13 am

Re: Android benchmark. Looking for testers

Thu Sep 20, 2012 4:13 pm

killadark wrote:
Im willin to try using international s3 on jelly bean


PMed.
 
DancinJack
Maximum Gerbil
Posts: 4494
Joined: Sat Nov 25, 2006 3:21 pm
Location: Kansas

Re: Android benchmark. Looking for testers

Thu Sep 20, 2012 4:16 pm

I'm going to predict ~1100 MFlops for that international GS3.
i7 6700K - Z170 - 16GiB DDR4 - GTX 1080 - 512GB SSD - 256GB SSD - 500GB SSD - 3TB HDD- 27" IPS G-sync - Win10 Pro x64 - Ubuntu/Mint x64 :: 2015 13" rMBP Sierra :: Canon EOS 80D/Sony RX100
 
willyjwebb
Gerbil
Posts: 64
Joined: Sun Jul 22, 2012 9:38 pm

Re: Android benchmark. Looking for testers

Thu Sep 20, 2012 4:16 pm

your s3 got a lower score than my s2?
I7-860, 2x4 gig crucial ballistix ram,64 gb kingston ssdnow, 2tb wd fyps2002, ihas rev b burner, radeon 5850, rocketfish 900 watt, coolermaster elite
 
DancinJack
Maximum Gerbil
Posts: 4494
Joined: Sat Nov 25, 2006 3:21 pm
Location: Kansas

Re: Android benchmark. Looking for testers

Thu Sep 20, 2012 4:18 pm

willyjwebb wrote:
your s3 got a lower score than my s2?


He's talking about the processor. The processor in your S2 is a dual core Exynos if I'm not mistaken. A slightly faster SoC than the Quallcomm S3 that is in his device.
i7 6700K - Z170 - 16GiB DDR4 - GTX 1080 - 512GB SSD - 256GB SSD - 500GB SSD - 3TB HDD- 27" IPS G-sync - Win10 Pro x64 - Ubuntu/Mint x64 :: 2015 13" rMBP Sierra :: Canon EOS 80D/Sony RX100
 
willyjwebb
Gerbil
Posts: 64
Joined: Sun Jul 22, 2012 9:38 pm

Re: Android benchmark. Looking for testers

Thu Sep 20, 2012 4:20 pm

yeah, im just surprised samsungs new galaxy would show lower scores, is that the quad core that we have here in canada, or a different version?

edit: reading fail, i see what you are saying now, he never said it was a galaxy s3, its the snapdragon s3, duhhhh
Last edited by willyjwebb on Thu Sep 20, 2012 4:21 pm, edited 1 time in total.
I7-860, 2x4 gig crucial ballistix ram,64 gb kingston ssdnow, 2tb wd fyps2002, ihas rev b burner, radeon 5850, rocketfish 900 watt, coolermaster elite
 
codedivine
Gerbil Elite
Topic Author
Posts: 714
Joined: Sat Jan 24, 2009 8:13 am

Re: Android benchmark. Looking for testers

Thu Sep 20, 2012 4:20 pm

DancinJack wrote:
willyjwebb wrote:
your s3 got a lower score than my s2?


He's talking about the processor. The processor in your S2 is a dual core Exynos if I'm not mistaken. A slightly faster SoC than the Quallcomm S3 that is in his device.


Correct. My device is a Galaxy T989, sold by T-Mobile and Telus/Koodo as Galaxy S2-X.
 
killadark
Gerbil XP
Posts: 376
Joined: Fri Feb 22, 2008 2:55 am

Re: Android benchmark. Looking for testers

Thu Sep 20, 2012 4:22 pm

995.9432 MFlops
Sgs3 international
Jelly bean
No fc's
Sorry to dissapoint some people :p
AMD FX-8350|Asus M5A97 LE R2.0|16gb GSKILL Sniper 2400mhz|Samsung SSD 120g 840|AMD R9 290 TRI-X (dead) GTX1070
Corsair RM650x,Thermaltake Xaser vi ,Creative SoundBlaster X-Fi Titanium Sound Card
 
Captain Ned
Global Moderator
Posts: 28704
Joined: Wed Jan 16, 2002 7:00 pm
Location: Vermont, USA

Re: Android benchmark. Looking for testers

Thu Sep 20, 2012 4:23 pm

If you want some humor find a way to make that app work for Froyo so I can revel in the slowness of my Droid 2 Global. If you're feeling really frisky, compile it for Bugless Beast (Eclair) on the OG Droid (my daughter's phone; my first smartphone).
What we have today is way too much pluribus and not enough unum.
 
willyjwebb
Gerbil
Posts: 64
Joined: Sun Jul 22, 2012 9:38 pm

Re: Android benchmark. Looking for testers

Thu Sep 20, 2012 4:23 pm

i work in a pawn shop, and literally just got a galaxy s2 lte in, i wonder what, if any, difference i would see from mine to that
I7-860, 2x4 gig crucial ballistix ram,64 gb kingston ssdnow, 2tb wd fyps2002, ihas rev b burner, radeon 5850, rocketfish 900 watt, coolermaster elite
 
Captain Ned
Global Moderator
Posts: 28704
Joined: Wed Jan 16, 2002 7:00 pm
Location: Vermont, USA

Re: Android benchmark. Looking for testers

Thu Sep 20, 2012 4:23 pm

willyjwebb wrote:
i work in a pawn shop, and literally just got a galaxy s2 lte in, i wonder what, if any, difference i would see from mine to that

Chumlee!!!!
What we have today is way too much pluribus and not enough unum.
 
DancinJack
Maximum Gerbil
Posts: 4494
Joined: Sat Nov 25, 2006 3:21 pm
Location: Kansas

Re: Android benchmark. Looking for testers

Thu Sep 20, 2012 4:24 pm

Dang. That's codedivine's fault for not multi-threading it yet. ;)
i7 6700K - Z170 - 16GiB DDR4 - GTX 1080 - 512GB SSD - 256GB SSD - 500GB SSD - 3TB HDD- 27" IPS G-sync - Win10 Pro x64 - Ubuntu/Mint x64 :: 2015 13" rMBP Sierra :: Canon EOS 80D/Sony RX100
 
willyjwebb
Gerbil
Posts: 64
Joined: Sun Jul 22, 2012 9:38 pm

Re: Android benchmark. Looking for testers

Thu Sep 20, 2012 4:26 pm

Captain Ned wrote:
willyjwebb wrote:
i work in a pawn shop, and literally just got a galaxy s2 lte in, i wonder what, if any, difference i would see from mine to that

Chumlee!!!!


nahhh, not that dumb, or fat, lol
the pawn business up here is quite boring compared to the stuff you see on tv

as im sitting at work on a work laptop now, it just shows how boring it really is
I7-860, 2x4 gig crucial ballistix ram,64 gb kingston ssdnow, 2tb wd fyps2002, ihas rev b burner, radeon 5850, rocketfish 900 watt, coolermaster elite
 
PGleo86
Gerbil
Posts: 47
Joined: Sun May 20, 2012 7:03 pm

Re: Android benchmark. Looking for testers

Thu Sep 20, 2012 4:31 pm

I'll give it a shot on both of my phones:
Verizon Galaxy S3 rooted on stock
Droid Incredible running some custom ICS build (haven't flashed anything new to that in about 3-4 months)
ASUS Z97-A, i7 4790K @ 4.8 + Corsair H100i GTX, Fractal Design Define R5 (window, Titanium), 20GB DDR3/1600, ZOTAC GTX 980 AMP!, 620W PSU, 5TB HDD, 512GB Samsung 840 Pro
 
ChronoReverse
Gerbil Elite
Posts: 757
Joined: Wed Dec 12, 2007 4:20 pm

Re: Android benchmark. Looking for testers

Thu Sep 20, 2012 4:35 pm

Does this bench use just VFP or does it also take advantage of NEON?

I have the LTE Galaxy Note which has the Snapdragon S3.
 
codedivine
Gerbil Elite
Topic Author
Posts: 714
Joined: Sat Jan 24, 2009 8:13 am

Re: Android benchmark. Looking for testers

Thu Sep 20, 2012 4:35 pm

PGleo86 wrote:
I'll give it a shot on both of my phones:
Verizon Galaxy S3 rooted on stock
Droid Incredible running some custom ICS build (haven't flashed anything new to that in about 3-4 months)


PMed.
 
codedivine
Gerbil Elite
Topic Author
Posts: 714
Joined: Sat Jan 24, 2009 8:13 am

Re: Android benchmark. Looking for testers

Thu Sep 20, 2012 4:36 pm

ChronoReverse wrote:
Does this bench use just VFP or does it also take advantage of NEON?

I have the LTE Galaxy Note which has the Snapdragon S3.


Just VFP. It is doing fp64 computations which NEON does not support AFAIK. PMing you.
 
codedivine
Gerbil Elite
Topic Author
Posts: 714
Joined: Sat Jan 24, 2009 8:13 am

Re: Android benchmark. Looking for testers

Thu Sep 20, 2012 4:41 pm

I think I have gotten enough testers for today. I will try and fix the FCs, and add multi-threading. Hope to do so in a week or two when I get time.
I am also thinking of exploring using Renderscript Compute instead of NDK.
 
ChronoReverse
Gerbil Elite
Posts: 757
Joined: Wed Dec 12, 2007 4:20 pm

Re: Android benchmark. Looking for testers

Thu Sep 20, 2012 4:47 pm

codedivine wrote:
ChronoReverse wrote:
Does this bench use just VFP or does it also take advantage of NEON?

I have the LTE Galaxy Note which has the Snapdragon S3.


Just VFP. It is doing fp64 computations which NEON does not support AFAIK. PMing you.


Ah, I was hoping to eventually see a NEON benchmark too since it would put my S3 in a better light lol.

My Snapdragon S3 @ 1.5GHz on Android 4.1 (JB, CM10) scored around 735 for all three runs. I'm already liking this better than Linpack in that it has more more stable scores. I wonder how the workload spread compares.


Seems stable on my Galaxy Note. Ran it 6 times with scores ranging from 715 to 738
 
codedivine
Gerbil Elite
Topic Author
Posts: 714
Joined: Sat Jan 24, 2009 8:13 am

Re: Android benchmark. Looking for testers

Thu Sep 20, 2012 5:01 pm

ChronoReverse wrote:
codedivine wrote:
ChronoReverse wrote:
Does this bench use just VFP or does it also take advantage of NEON?

I have the LTE Galaxy Note which has the Snapdragon S3.


Just VFP. It is doing fp64 computations which NEON does not support AFAIK. PMing you.


Ah, I was hoping to eventually see a NEON benchmark too since it would put my S3 in a better light lol.

My Snapdragon S3 @ 1.5GHz on Android 4.1 (JB, CM10) scored around 735 for all three runs. I'm already liking this better than Linpack in that it has more more stable scores. I wonder how the workload spread compares.


Thanks. It is essentially doing a tiled matrix multiply, but it is testing multiple versions of the code and reporting the best performance found on the device.
A well-written LINPACK usually depends on matrix multiply performance anyway so the performance should not be too far off from a well-written LINPACK. It is a micro-benchmark, which is not 100% ideal, but is still better than what is available on Android today.

At some point, I also plan to add a few more tests. Numbers will be reported separately of course.
 
Philldoe
Grand Gerbil Poohbah
Posts: 3045
Joined: Thu May 13, 2004 12:12 pm
Location: Turn around...

Re: Android benchmark. Looking for testers

Thu Sep 20, 2012 5:12 pm

I have an Asus TF300 with a Tegra 3 in it if you need another tester.
Fastfreak39: I feel like they should change the phrase "jumping on the band wagon" to "sailing on the pirate ship"
 
codedivine
Gerbil Elite
Topic Author
Posts: 714
Joined: Sat Jan 24, 2009 8:13 am

Re: Android benchmark. Looking for testers

Thu Sep 20, 2012 5:17 pm

Philldoe wrote:
I have an Asus TF300 with a Tegra 3 in it if you need another tester.


PMed.
 
killadark
Gerbil XP
Posts: 376
Joined: Fri Feb 22, 2008 2:55 am

Re: Android benchmark. Looking for testers

Thu Sep 20, 2012 5:24 pm

Philldoe wrote:
I have an Asus TF300 with a Tegra 3 in it if you need another tester.

Will test on tf101 also
AMD FX-8350|Asus M5A97 LE R2.0|16gb GSKILL Sniper 2400mhz|Samsung SSD 120g 840|AMD R9 290 TRI-X (dead) GTX1070
Corsair RM650x,Thermaltake Xaser vi ,Creative SoundBlaster X-Fi Titanium Sound Card

Who is online

Users browsing this forum: No registered users and 1 guest
GZIP: On