Firefox on Android benchmark

Laptops, PDAs, Cell Phones, and all other tech that you carry with you.

Moderators: mac_h8r1, Nelliesboo, David

Firefox on Android benchmark

Postposted on Fri Nov 08, 2013 6:59 pm

Android owners, I have a fun request for you all. Would you mind downloading Firefox 25 (Download from: https://ftp.mozilla.org/pub/mozilla.org ... oid/en-US/) and reporting data about Kraken benchmark and Octane 2.0 benchmarks? I am linking to Mozilla's site instead of the Play store to ensure we all get the same browser version. Idea is to get an idea of performance differences across SoCs by ensuring that we are all running the same APK.

I will keep updating this table from scores I get below or on twitter.
edit: People are seeing 10-15% variation between runs on some devices, so do be careful while drawing very precise conclusions but does give us a good qualitative idea.

Device Kraken 1.1 (ms)
Nvidia Shield (Tegra 4, Cortex A15 @ 1.9GHz) 5215
Samsung Galaxy S4 (Exynos 5410) 6895
Nexus 5 (Snapdragon 800, 4.4) 7474
Galaxy S4 (Snapdragon 600, CM 10.2) 9535
Moto X (Snapdragon S4 MSM8960Pro, 1.7GHz) 9573
Xperia SP (Snapdragon S4 dual-core 1.7GHz) 9689
HTC One (Snapdragon 600, 1.7GHz) 10569
Nexus 7 (Snapdragon S4 Pro) 10944
Lenovo K900 (Atom Z2580, x86, FF25b10) 12861*
LG Optimus G (Snapdragon S4 Pro) 13217
Nexus 4 (Snapdragon S4 Pro) 13372
Asus TF700T (Nvidia Tegra 3 at 1.7GHz) 14615
Galaxy S3 (Snapdragon S4 1.1GHz, PAC-MAN nightly 9/30 (4.3)) 15096
Hisense Sero 7 Lite (RK3066, Cortex A9 @ 1.6GHz) 16439
Nexus 7 (Tegra 3) 16547
ifive Mini 2 (RK3066, Android 4.1.1) 16589
HP Touchpad (Snapdragon S3, 1.728 GHz, Android 4.3) 16972
Cubot 6589a (MTK 6589, quad Cortex A7 @ 1GHz?) 17249
Sony Xperia acro S (Snapdragon S3 MSM 8260 1.5GHz, 4.1.2) 17741
Galaxy Nexus (OMAP 4460, 1.2GHz, 4.4) 17813
ASUS TF300T (Tegra 3 1.3GHz, CM10.1 nightly 4/07 (4.2.2)) 19322
Galaxy S2X (Snapdragon S3 1.5GHz) 21016
Motorola Droid Razr MAXX (OMAP 4430, 1.2GHz) 21138
Onda v812 Allwinner A31, Firmware v3.2.1/Android 4.2.2 21472
Galaxy S3 (Exynos 4412) 21754


Device Octane 2.0
Nvidia Shield (Tegra 4, Cortex A15 @ 1.9GHz) 4408
Nexus 5 (Snapdragon 800, 4.4) 3877
Samsung Galaxy S4 (Exynos 5410) 3656
Moto X (Snapdragon S4 MSM8960Pro, 1.7GHz) 2793
Galaxy S4 (Snapdragon 600, CM 10.2) 2736
Xperia SP (Snapdragon S4 dual-core 1.7GHz) 2625
Lenovo K900 (Atom Z2580, x86, FF25b10) 2612*
Asus TF700T (Nvidia Tegra 3 at 1.7GHz) 2494
Nexus 7 (Snapdragon S4 Pro) 2391
ifive Mini 2 (RK3066, Android 4.1.1) 2368
Galaxy S3 (Exynos 4412) 2303
Nexus 7 (Tegra 3) 2158
Nexus 4 (Snapdragon S4 Pro) 2099
Galaxy Nexus (OMAP 4460, 1.2GHz, 4.4) 2064
HTC One (Snapdragon 600, 1.7GHz, US edition) 2063
LG Optimus G (Snapdragon S4 Pro) 2042
Hisense Sero 7 Lite (RK3066, Cortex A9 @ 1.6GHz) 2040
ASUS TF300T (Tegra 3 1.3GHz, CM10.1 nightly 4/07 (4.2.2)) 1744
Galaxy S3 (Snapdragon S4 1.1GHz, PAC-MAN nightly 9/30 (4.3)) 1691
Motorola Droid Razr MAXX (OMAP 4430, 1.2GHz) 1687
HP Touchpad (Snapdragon S3, 1.728 GHz, Android 4.3) 1585**
Cubot 6589a (MTK 6589, quad Cortex A7 @ 1GHz?) 1573
Onda v812 Allwinner A31, Firmware v3.2.1/Android 4.2.2 1472
Sony Xperia acro S (Snapdragon S3 MSM 8260 1.5GHz, 4.1.2) 1478
Galaxy S2X (Snapdragon S3 1.5GHz) 1104
Last edited by codedivine on Wed Nov 13, 2013 10:50 pm, edited 29 times in total.
codedivine
Gerbil Elite
Silver subscriber
 
 
Posts: 705
Joined: Sat Jan 24, 2009 8:13 am

Re: Firefox on Android benchmark

Postposted on Fri Nov 08, 2013 7:06 pm

You want the results from that specific version (I'm on the beta)?
ChronoReverse
Gerbil Elite
 
Posts: 736
Joined: Wed Dec 12, 2007 4:20 pm

Re: Firefox on Android benchmark

Postposted on Fri Nov 08, 2013 7:08 pm

ChronoReverse wrote:You want the results from that specific version (I'm on the beta)?

Yeah, the idea is that we all run the same software release so that we can get a valid SoC performance comparison. With different browser versions, we will be running more of a software optimization test.
codedivine
Gerbil Elite
Silver subscriber
 
 
Posts: 705
Joined: Sat Jan 24, 2009 8:13 am

Re: Firefox on Android benchmark

Postposted on Fri Nov 08, 2013 7:09 pm

Anshel Sag told me on twitter about Kraken on Firefox 25 on nexus 5: 8057ms

https://twitter.com/anshelsag/status/398963690596098048
codedivine
Gerbil Elite
Silver subscriber
 
 
Posts: 705
Joined: Sat Jan 24, 2009 8:13 am

Re: Firefox on Android benchmark

Postposted on Fri Nov 08, 2013 7:18 pm

Nexus 4 using the .apk from your ftp link.

Kraken: 13371.6ms

Octane 2.0: 2099
slowriot
Gerbil First Class
Gold subscriber
 
 
Posts: 157
Joined: Wed Apr 03, 2013 10:57 am

Re: Firefox on Android benchmark

Postposted on Fri Nov 08, 2013 7:20 pm

Galaxy S4 - Snapdragon 600 version - CM10.2
Kraken: 9535.2ms +/- 1.5%
Octane: 2736
ChronoReverse
Gerbil Elite
 
Posts: 736
Joined: Wed Dec 12, 2007 4:20 pm

Re: Firefox on Android benchmark

Postposted on Fri Nov 08, 2013 7:34 pm

Thanks Chrono and slowriot! Updated top post with data. Interesting to see SoC progression so far :)
codedivine
Gerbil Elite
Silver subscriber
 
 
Posts: 705
Joined: Sat Jan 24, 2009 8:13 am

Re: Firefox on Android benchmark

Postposted on Fri Nov 08, 2013 8:28 pm

I like how we all have Snapdragons. Qualcomm has really taken over the market.

I'll see if I can get some A9 results from a Galaxy Nexus this weekend.

Also, can't wait for 4.4 so I could try this out with ART.
ChronoReverse
Gerbil Elite
 
Posts: 736
Joined: Wed Dec 12, 2007 4:20 pm

Re: Firefox on Android benchmark

Postposted on Fri Nov 08, 2013 10:10 pm

Yes Cortex A9 numbers should be interesting. Also, does anyone have a Tegra 4 or Exynos 5 based system so that we can check out Cortex A15? Would also be interesting to see Moto X.
codedivine
Gerbil Elite
Silver subscriber
 
 
Posts: 705
Joined: Sat Jan 24, 2009 8:13 am

Re: Firefox on Android benchmark

Postposted on Fri Nov 08, 2013 11:09 pm

Put it in a nicely formatted table :)
codedivine
Gerbil Elite
Silver subscriber
 
 
Posts: 705
Joined: Sat Jan 24, 2009 8:13 am

Re: Firefox on Android benchmark

Postposted on Fri Nov 08, 2013 11:12 pm

I'll help out:

Kraken
Galaxy S3 (Snapdragon S4 1.1GHz, PAC-MAN nightly 9/30 (4.3)): 15095.7ms (+/- 2.2%)
ASUS TF300T (nVidia Tegra 3 1.3GHz, CM10.1 nightly 4/07 (4.2.2)): 19322.5ms (+/- 6.9%)

Octane
Galaxy S3 (Snapdragon S4 1.1GHz, PAC-MAN nightly 9/30 (4.3)): 1691
ASUS TF300T (nVidia Tegra 3 1.3GHz, CM10.1 nightly 4/07 (4.2.2)): 1744

Interesting results, I think. The TF300T has notoriously bad memory performance, so I didn't expect either test to beat the Galaxy S3, even underclocked. That said, here you go!
ASRock A55 Pro3, AMD A8 x4 3850 @ 4.7 + Xigmatek Gaia, Thermaltake V3 Black Edition, 8GB DDR3/1600, HIS 6870 1GB, 620W PSU, 500GB HDD, 250GB HDD, 3TB HDD, Logitech x530 5.1
PGleo86
Gerbil
 
Posts: 29
Joined: Sun May 20, 2012 7:03 pm

Re: Firefox on Android benchmark

Postposted on Fri Nov 08, 2013 11:22 pm

Thanks PGleo86 :D
codedivine
Gerbil Elite
Silver subscriber
 
 
Posts: 705
Joined: Sat Jan 24, 2009 8:13 am

Re: Firefox on Android benchmark

Postposted on Fri Nov 08, 2013 11:35 pm

Btw it is amazing that we are getting a 2.5x speedup in only about 2.5 years :)
No wonder the mobile space is so exciting right now.
codedivine
Gerbil Elite
Silver subscriber
 
 
Posts: 705
Joined: Sat Jan 24, 2009 8:13 am

Re: Firefox on Android benchmark

Postposted on Fri Nov 08, 2013 11:39 pm

Not a problem! Got at least some Tegra love in there (or at least as close to love as I can give that tablet)!

Just for fun, I ran them in Firefox 25.0 on my desktop computer (specs in sig). Kraken got 2730.8ms (+/- 2.4%) and Octane got 11293. Seems like mobile performance has been catching desktop performance little by little, but it's still a ways away...
ASRock A55 Pro3, AMD A8 x4 3850 @ 4.7 + Xigmatek Gaia, Thermaltake V3 Black Edition, 8GB DDR3/1600, HIS 6870 1GB, 620W PSU, 500GB HDD, 250GB HDD, 3TB HDD, Logitech x530 5.1
PGleo86
Gerbil
 
Posts: 29
Joined: Sun May 20, 2012 7:03 pm

Re: Firefox on Android benchmark

Postposted on Fri Nov 08, 2013 11:55 pm

Yeah my i7-4770k@4.3GHz gets 21k in Octane and 1250ms in Kraken. And these tests only use a single core!

The mobile CPUs are starting to run out of easy speed boosts too as the current generation stuff is faster but get thermal throttled easily.

Whoa, Haswell literally doubles the speed of an AMD A8 huh?
ChronoReverse
Gerbil Elite
 
Posts: 736
Joined: Wed Dec 12, 2007 4:20 pm

Re: Firefox on Android benchmark

Postposted on Sat Nov 09, 2013 12:31 am

Asus TF700T (Nvidia Tegra 3 at 1.7GHz) kraken score 14615.3ms +/- 1.9%, Octane 2.0 score 2494

Stock Intel 3930K kraken score 1241.4ms +/- 2.9%, octane 2.0 score 20313


Edit: added octane 2.0 scores
Last edited by equivicus on Sat Nov 09, 2013 12:38 am, edited 1 time in total.
equivicus
Gerbil First Class
 
Posts: 117
Joined: Mon Jan 02, 2006 1:57 pm
Location: Houston, Texas

Re: Firefox on Android benchmark

Postposted on Sat Nov 09, 2013 12:34 am

equivicus wrote:Asus TF700T (Nvidia Tegra 3 at 1.7GHz) kraken score 14615.3ms +/- 1.9%

Stock Intel 3930K kraken score 1241.4ms +/- 2.9%


Thanks :) . Would you mind also running Octane 2.0? https://developers.google.com/octane/
edit: Thanks. Added both.
codedivine
Gerbil Elite
Silver subscriber
 
 
Posts: 705
Joined: Sat Jan 24, 2009 8:13 am

Re: Firefox on Android benchmark

Postposted on Sat Nov 09, 2013 1:21 am

LG Optimus G (Stock LG Android Image)
Octane 2.0: 2042
Kraken 1.1: 13217.0ms +/- 1.4%
Flatland_Spider
Gerbil Elite
 
Posts: 853
Joined: Mon Sep 13, 2004 8:33 pm
Location: The 918/539

Re: Firefox on Android benchmark

Postposted on Sat Nov 09, 2013 1:57 am

Flatland_Spider wrote:LG Optimus G (Stock LG Android Image)
Octane 2.0: 2042
Kraken 1.1: 13217.0ms +/- 1.4%


Thanks. Also added Xperia SP figures reported on B3D forums :)
codedivine
Gerbil Elite
Silver subscriber
 
 
Posts: 705
Joined: Sat Jan 24, 2009 8:13 am

Re: Firefox on Android benchmark

Postposted on Sat Nov 09, 2013 4:36 am

Added Nvidia Shield results as reported by a user on B3D forums. Frankly quite amazing performance, though the performance will likely be lower in a phone form-factor.
codedivine
Gerbil Elite
Silver subscriber
 
 
Posts: 705
Joined: Sat Jan 24, 2009 8:13 am

Re: Firefox on Android benchmark

Postposted on Sat Nov 09, 2013 3:09 pm

Does anyone have a Cortex A7 based device, such as the Mediatek MT8125 devices (like Memo Pad HD 7) or various Allwinner A31 based devices?
codedivine
Gerbil Elite
Silver subscriber
 
 
Posts: 705
Joined: Sat Jan 24, 2009 8:13 am

Re: Firefox on Android benchmark

Postposted on Sat Nov 09, 2013 4:15 pm

Verizon Galaxy Nexus running "Shiny" 4.4:
Dalvik:
Kraken: 17813.5ms +/- 2.2%
Octane 2.0: 2064

I also ran Kraken on ART (along side numerous BG process crashes): 17396ms +/- 0.9%
2600K @ 4.8GHz; XSPC Rasa/RX240/RX120 Phobya Xtreme 200; Asus P8Z68-V Pro; 16GB Corsair Vengeance 1333 C9; 2x7970 OC w/ Razor 7970; Force GT 120GB; 3x F3 1TB; Corsair HX750; X-Fi Titanium; Corsair Obsidian 650D; Dell 2408WFP Rev. A01; 2x Dell U2412m
mortifiedPenguin
Gerbil Elite
 
Posts: 812
Joined: Mon Oct 08, 2007 7:46 pm

Re: Firefox on Android benchmark

Postposted on Sat Nov 09, 2013 4:32 pm

mortifiedPenguin wrote:Verizon Galaxy Nexus running "Shiny" 4.4:
Dalvik:
Kraken: 17813.5ms +/- 2.2%
Octane 2.0: 2064

I also ran Kraken on ART (along side numerous BG process crashes): 17396ms +/- 0.9%


Thanks. As for ART vs Dalvik, I don't think the VM will matter very much. My understanding (may be wrong) is that Firefox UI is done in Java but the Javascript JIT compiler in Firefox (IonMonkey) is producing native code anyway and will not be affected by which Java VM you use.
codedivine
Gerbil Elite
Silver subscriber
 
 
Posts: 705
Joined: Sat Jan 24, 2009 8:13 am

Re: Firefox on Android benchmark

Postposted on Sat Nov 09, 2013 5:02 pm

Yay!

OK, I'm running a Droid Razr MAXX with Android 4.1.2. According to the stats I've seen it's a TI OMAP 4430 (Dual-core A9 SoC) at 1.2 GHz.

Here are my results:

Kraken 1.1: 21138.2 ms total. For a more detailed breakdown, here's the link to the test results

Octane 2.0: Final score is 1687. I'd post a breakdown of the scores but Google doesn't give you a link like Mozilla does with Kraken.

Hope this helps!
4770K @ 4.7 GHz; 32GB DDR3-2133; GTX-770; 512GB 840 Pro (2x); Fractal Define XL-R2; NZXT Kraken-X60
--Many thanks to the TR Forum for advice in getting it built.
chuckula
Gerbil Elite
Gold subscriber
 
 
Posts: 568
Joined: Wed Jan 23, 2008 9:18 pm
Location: Probably where I don't belong.

Re: Firefox on Android benchmark

Postposted on Sat Nov 09, 2013 5:13 pm

chuckula wrote:Yay!

OK, I'm running a Droid Razr MAXX with Android 4.1.2. According to the stats I've seen it's a TI OMAP 4430 (Dual-core A9 SoC) at 1.2 GHz.

Here are my results:

Kraken 1.1: 21138.2 ms total. For a more detailed breakdown, here's the link to the test results

Octane 2.0: Final score is 1687. I'd post a breakdown of the scores but Google doesn't give you a link like Mozilla does with Kraken.

Hope this helps!


Thanks. Done!
codedivine
Gerbil Elite
Silver subscriber
 
 
Posts: 705
Joined: Sat Jan 24, 2009 8:13 am

Re: Firefox on Android benchmark

Postposted on Sat Nov 09, 2013 11:28 pm

I reverted to 4.2.2 stock from 4.4. Partially because my Galaxy Nexus was starting to get really glitchy (no mobile data and graphical artifacts) and partially because I was really curious what the benchmark results would be.

Verizon Galaxy Nexus Stock 4.2.2
Kraken: 19956.5ms +/- 9.1%
Octane 2.0: 2102
2600K @ 4.8GHz; XSPC Rasa/RX240/RX120 Phobya Xtreme 200; Asus P8Z68-V Pro; 16GB Corsair Vengeance 1333 C9; 2x7970 OC w/ Razor 7970; Force GT 120GB; 3x F3 1TB; Corsair HX750; X-Fi Titanium; Corsair Obsidian 650D; Dell 2408WFP Rev. A01; 2x Dell U2412m
mortifiedPenguin
Gerbil Elite
 
Posts: 812
Joined: Mon Oct 08, 2007 7:46 pm

Re: Firefox on Android benchmark

Postposted on Sun Nov 10, 2013 7:52 am

Updated with data from Exynos 5 version of Galaxy S4. Cortex A15 is clearly ruling the roost here.
codedivine
Gerbil Elite
Silver subscriber
 
 
Posts: 705
Joined: Sat Jan 24, 2009 8:13 am

Re: Firefox on Android benchmark

Postposted on Sun Nov 10, 2013 7:53 am

I ran the benchmarks on a Nexus 5 with ART runtime instead of Dalvik. You can choose the runtime from the developer options.

Kraken: 7023 ms was the best result out of five runs (worst being 7340 ms).

Octane: 3884 was the best out of three runs (3880 and 3770 being the other two results).

Edit: fixed result typo :P
Last edited by nico1982 on Sun Nov 10, 2013 7:57 am, edited 1 time in total.
nico1982
Gerbil In Training
 
Posts: 6
Joined: Fri Jan 29, 2010 7:30 am

Re: Firefox on Android benchmark

Postposted on Sun Nov 10, 2013 7:54 am

nico1982 wrote:I ran the benchmarks on a Nexus 5 with ART runtime instead of Dalvik. You can choose the runtime from the developer options.

Kraken: 7023 ms was the best result out of five runs (worst being 7340 ms).

Octane: 8884 was the best out of three runs (3880 and 3770 being the other two results).

Octane: Did you mean 3884 instead of 8884?
codedivine
Gerbil Elite
Silver subscriber
 
 
Posts: 705
Joined: Sat Jan 24, 2009 8:13 am

Re: Firefox on Android benchmark

Postposted on Sun Nov 10, 2013 7:57 am

codedivine wrote:Octane: Did you mean 3884 instead of 8884?

Yes, of course! XD
nico1982
Gerbil In Training
 
Posts: 6
Joined: Fri Jan 29, 2010 7:30 am

Next

Return to Mobile Tech

Who is online

Users browsing this forum: No registered users and 0 guests