TR Forums

Android owners, I have a fun request for you all. Would you mind downloading Firefox 25 (Download from: https://ftp.mozilla.org/pub/mozilla.org ... oid/en-US/) and reporting data about Kraken benchmark and Octane 2.0 benchmarks? I am linking to Mozilla's site instead of the Play store to ensure we all get the same browser version. Idea is to get an idea of performance differences across SoCs by ensuring that we are all running the same APK.

I will keep updating this table from scores I get below or on twitter.
edit: People are seeing 10-15% variation between runs on some devices, so do be careful while drawing very precise conclusions but does give us a good qualitative idea.

Device	Kraken 1.1 (ms)
Nvidia Shield (Tegra 4, Cortex A15 @ 1.9GHz)	5215
Samsung Galaxy S4 (Exynos 5410)	6895
Nexus 5 (Snapdragon 800, 4.4)	7474
Galaxy S4 (Snapdragon 600, CM 10.2)	9535
Moto X (Snapdragon S4 MSM8960Pro, 1.7GHz)	9573
Xperia SP (Snapdragon S4 dual-core 1.7GHz)	9689
HTC One (Snapdragon 600, 1.7GHz)	10569
Nexus 7 (Snapdragon S4 Pro)	10944
Lenovo K900 (Atom Z2580, x86, FF25b10)	12861*
LG Optimus G (Snapdragon S4 Pro)	13217
Nexus 4 (Snapdragon S4 Pro)	13372
Asus TF700T (Nvidia Tegra 3 at 1.7GHz)	14615
Galaxy S3 (Snapdragon S4 1.1GHz, PAC-MAN nightly 9/30 (4.3))	15096
Hisense Sero 7 Lite (RK3066, Cortex A9 @ 1.6GHz)	16439
Nexus 7 (Tegra 3)	16547
ifive Mini 2 (RK3066, Android 4.1.1)	16589
HP Touchpad (Snapdragon S3, 1.728 GHz, Android 4.3)	16972
Cubot 6589a (MTK 6589, quad Cortex A7 @ 1GHz?)	17249
Sony Xperia acro S (Snapdragon S3 MSM 8260 1.5GHz, 4.1.2)	17741
Galaxy Nexus (OMAP 4460, 1.2GHz, 4.4)	17813
ASUS TF300T (Tegra 3 1.3GHz, CM10.1 nightly 4/07 (4.2.2))	19322
Galaxy S2X (Snapdragon S3 1.5GHz)	21016
Motorola Droid Razr MAXX (OMAP 4430, 1.2GHz)	21138
Onda v812 Allwinner A31, Firmware v3.2.1/Android 4.2.2	21472
Galaxy S3 (Exynos 4412)	21754

Device	Octane 2.0
Nvidia Shield (Tegra 4, Cortex A15 @ 1.9GHz)	4408
Nexus 5 (Snapdragon 800, 4.4)	3877
Samsung Galaxy S4 (Exynos 5410)	3656
Moto X (Snapdragon S4 MSM8960Pro, 1.7GHz)	2793
Galaxy S4 (Snapdragon 600, CM 10.2)	2736
Xperia SP (Snapdragon S4 dual-core 1.7GHz)	2625
Lenovo K900 (Atom Z2580, x86, FF25b10)	2612*
Asus TF700T (Nvidia Tegra 3 at 1.7GHz)	2494
Nexus 7 (Snapdragon S4 Pro)	2391
ifive Mini 2 (RK3066, Android 4.1.1)	2368
Galaxy S3 (Exynos 4412)	2303
Nexus 7 (Tegra 3)	2158
Nexus 4 (Snapdragon S4 Pro)	2099
Galaxy Nexus (OMAP 4460, 1.2GHz, 4.4)	2064
HTC One (Snapdragon 600, 1.7GHz, US edition)	2063
LG Optimus G (Snapdragon S4 Pro)	2042
Hisense Sero 7 Lite (RK3066, Cortex A9 @ 1.6GHz)	2040
ASUS TF300T (Tegra 3 1.3GHz, CM10.1 nightly 4/07 (4.2.2))	1744
Galaxy S3 (Snapdragon S4 1.1GHz, PAC-MAN nightly 9/30 (4.3))	1691
Motorola Droid Razr MAXX (OMAP 4430, 1.2GHz)	1687
HP Touchpad (Snapdragon S3, 1.728 GHz, Android 4.3)	1585**
Cubot 6589a (MTK 6589, quad Cortex A7 @ 1GHz?)	1573
Onda v812 Allwinner A31, Firmware v3.2.1/Android 4.2.2	1472
Sony Xperia acro S (Snapdragon S3 MSM 8260 1.5GHz, 4.1.2)	1478
Galaxy S2X (Snapdragon S3 1.5GHz)	1104

You want the results from that specific version (I'm on the beta)?

ChronoReverse wrote:

You want the results from that specific version (I'm on the beta)?

Yeah, the idea is that we all run the same software release so that we can get a valid SoC performance comparison. With different browser versions, we will be running more of a software optimization test.

Anshel Sag told me on twitter about Kraken on Firefox 25 on nexus 5: 8057ms

https://twitter.com/anshelsag/status/398963690596098048

Nexus 4 using the .apk from your ftp link.

Kraken: 13371.6ms

Octane 2.0: 2099

Galaxy S4 - Snapdragon 600 version - CM10.2
Kraken: 9535.2ms +/- 1.5%
Octane: 2736

Thanks Chrono and slowriot! Updated top post with data. Interesting to see SoC progression so far

I like how we all have Snapdragons. Qualcomm has really taken over the market.

I'll see if I can get some A9 results from a Galaxy Nexus this weekend.

Also, can't wait for 4.4 so I could try this out with ART.

Yes Cortex A9 numbers should be interesting. Also, does anyone have a Tegra 4 or Exynos 5 based system so that we can check out Cortex A15? Would also be interesting to see Moto X.

Put it in a nicely formatted table

I'll help out:

Kraken
Galaxy S3 (Snapdragon S4 1.1GHz, PAC-MAN nightly 9/30 (4.3)): 15095.7ms (+/- 2.2%)
ASUS TF300T (nVidia Tegra 3 1.3GHz, CM10.1 nightly 4/07 (4.2.2)): 19322.5ms (+/- 6.9%)

Octane
Galaxy S3 (Snapdragon S4 1.1GHz, PAC-MAN nightly 9/30 (4.3)): 1691
ASUS TF300T (nVidia Tegra 3 1.3GHz, CM10.1 nightly 4/07 (4.2.2)): 1744

Interesting results, I think. The TF300T has notoriously bad memory performance, so I didn't expect either test to beat the Galaxy S3, even underclocked. That said, here you go!

Thanks PGleo86

Btw it is amazing that we are getting a 2.5x speedup in only about 2.5 years
No wonder the mobile space is so exciting right now.

Not a problem! Got at least some Tegra love in there (or at least as close to love as I can give that tablet)!

Just for fun, I ran them in Firefox 25.0 on my desktop computer (specs in sig). Kraken got 2730.8ms (+/- 2.4%) and Octane got 11293. Seems like mobile performance has been catching desktop performance little by little, but it's still a ways away...

Yeah my [email protected] gets 21k in Octane and 1250ms in Kraken. And these tests only use a single core!

The mobile CPUs are starting to run out of easy speed boosts too as the current generation stuff is faster but get thermal throttled easily.

Whoa, Haswell literally doubles the speed of an AMD A8 huh?

Asus TF700T (Nvidia Tegra 3 at 1.7GHz) kraken score 14615.3ms +/- 1.9%, Octane 2.0 score 2494

Stock Intel 3930K kraken score 1241.4ms +/- 2.9%, octane 2.0 score 20313


Edit: added octane 2.0 scores

equivicus wrote:

Asus TF700T (Nvidia Tegra 3 at 1.7GHz) kraken score 14615.3ms +/- 1.9%

Stock Intel 3930K kraken score 1241.4ms +/- 2.9%

Thanks . Would you mind also running Octane 2.0? https://developers.google.com/octane/
edit: Thanks. Added both.

LG Optimus G (Stock LG Android Image)
Octane 2.0: 2042
Kraken 1.1: 13217.0ms +/- 1.4%

Flatland_Spider wrote:

LG Optimus G (Stock LG Android Image)
Octane 2.0: 2042
Kraken 1.1: 13217.0ms +/- 1.4%

Thanks. Also added Xperia SP figures reported on B3D forums

Added Nvidia Shield results as reported by a user on B3D forums. Frankly quite amazing performance, though the performance will likely be lower in a phone form-factor.

Does anyone have a Cortex A7 based device, such as the Mediatek MT8125 devices (like Memo Pad HD 7) or various Allwinner A31 based devices?

Verizon Galaxy Nexus running "Shiny" 4.4:
Dalvik:
Kraken: 17813.5ms +/- 2.2%
Octane 2.0: 2064

I also ran Kraken on ART (along side numerous BG process crashes): 17396ms +/- 0.9%

mortifiedPenguin wrote:

Verizon Galaxy Nexus running "Shiny" 4.4:
Dalvik:
Kraken: 17813.5ms +/- 2.2%
Octane 2.0: 2064

I also ran Kraken on ART (along side numerous BG process crashes): 17396ms +/- 0.9%

Thanks. As for ART vs Dalvik, I don't think the VM will matter very much. My understanding (may be wrong) is that Firefox UI is done in Java but the Javascript JIT compiler in Firefox (IonMonkey) is producing native code anyway and will not be affected by which Java VM you use.

Yay!

OK, I'm running a Droid Razr MAXX with Android 4.1.2. According to the stats I've seen it's a TI OMAP 4430 (Dual-core A9 SoC) at 1.2 GHz.

Here are my results:

Kraken 1.1: 21138.2 ms total. For a more detailed breakdown, here's the link to the test results

Octane 2.0: Final score is 1687. I'd post a breakdown of the scores but Google doesn't give you a link like Mozilla does with Kraken.

Hope this helps!

chuckula wrote:

Yay!

OK, I'm running a Droid Razr MAXX with Android 4.1.2. According to the stats I've seen it's a TI OMAP 4430 (Dual-core A9 SoC) at 1.2 GHz.

Here are my results:

Kraken 1.1: 21138.2 ms total. For a more detailed breakdown, here's the link to the test results

Octane 2.0: Final score is 1687. I'd post a breakdown of the scores but Google doesn't give you a link like Mozilla does with Kraken.

Hope this helps!

Thanks. Done!

I reverted to 4.2.2 stock from 4.4. Partially because my Galaxy Nexus was starting to get really glitchy (no mobile data and graphical artifacts) and partially because I was really curious what the benchmark results would be.

Verizon Galaxy Nexus Stock 4.2.2
Kraken: 19956.5ms +/- 9.1%
Octane 2.0: 2102

Updated with data from Exynos 5 version of Galaxy S4. Cortex A15 is clearly ruling the roost here.

I ran the benchmarks on a Nexus 5 with ART runtime instead of Dalvik. You can choose the runtime from the developer options.

Kraken: 7023 ms was the best result out of five runs (worst being 7340 ms).

Octane: 3884 was the best out of three runs (3880 and 3770 being the other two results).

Edit: fixed result typo

nico1982 wrote:

I ran the benchmarks on a Nexus 5 with ART runtime instead of Dalvik. You can choose the runtime from the developer options.

Kraken: 7023 ms was the best result out of five runs (worst being 7340 ms).

Octane: 8884 was the best out of three runs (3880 and 3770 being the other two results).

Octane: Did you mean 3884 instead of 8884?

codedivine wrote:

Octane: Did you mean 3884 instead of 8884?

Yes, of course! XD