Firefox on Android benchmark

Laptops, PDAs, Cell Phones, and all other tech that you carry with you.

Moderators: mac_h8r1, Nelliesboo, David

Re: Firefox on Android benchmark

Postposted on Sun Nov 10, 2013 7:00 am

nico1982 wrote:
codedivine wrote:Octane: Did you mean 3884 instead of 8884?

Yes, of course! XD


Thanks. Would you mind running with Dalvik too? Should be interesting to see, though theoretically I would not expect huge changes in this test because Firefox includes its own JIT compiler. Dalvik vs ART, theoretically, should be more important for purely Java apps.
codedivine
Gerbil Elite
Silver subscriber
 
 
Posts: 700
Joined: Sat Jan 24, 2009 7:13 am

Re: Firefox on Android benchmark

Postposted on Sun Nov 10, 2013 7:17 am

Samsung Galaxy S i9000 (2010) with a single-core 1 GHz S5PC110 (Cortex A8) and 512 MB RAM, running CM 10.2 M1 (Android 4.3.1): both Kraken and Octane crash Firefox 25 very early.

CM 10.2 M1 browser: Kraken 48009 ms, Octane crashes the browser (presumably runs out of RAM).

In comparison:

* Lenovo ThinkPad T61 (2008), with a Core 2 Duo T7100 Merom at 1.8 GHz and 2 GB RAM, running Firefox 25: Kraken: 3733 ms, Octane: 7037
* AMD Phenom II X6 1055T (2010), at 2.8 GHz, with 4 GB RAM (albeit DDR2 -- this is on an AM2+ board), running Firefox 25: Kraken: 2866 ms, Octane: 10155
* Lenovo ThinkPad X201 (2010), Core i5 520M Arrandale (Nehalem/Westmere generation), 2.4 GHz with 4 GB RAM, running Firefox 25: Kraken: 2261 ms, Octane: 11390

(That's right, the newest computing device I currently own -- probably the phone actually -- has technology over three years old.)
Last edited by Prototyped on Sun Nov 10, 2013 8:53 am, edited 7 times in total.
Prototyped
Gerbil
 
Posts: 58
Joined: Wed Dec 26, 2001 6:00 pm
Location: Purgatory

Re: Firefox on Android benchmark

Postposted on Sun Nov 10, 2013 7:39 am

Motorola DROID Bionic on Android 4.1.2
Kraken 1.1 - 20198.2ms +/- 2.6%
Octane 1874
Peldor
Gerbil In Training
 
Posts: 3
Joined: Thu Dec 15, 2005 12:27 pm
Location: WS, NC

Re: Firefox on Android benchmark

Postposted on Sun Nov 10, 2013 8:11 am

codedivine wrote:
nico1982 wrote:
codedivine wrote:Octane: Did you mean 3884 instead of 8884?

Yes, of course! XD


Thanks. Would you mind running with Dalvik too? Should be interesting to see, though theoretically I would not expect huge changes in this test because Firefox includes its own JIT compiler. Dalvik vs ART, theoretically, should be more important for purely Java apps.

I guess you're right. On Dalvik, I got 8639 ms on Kraken on the first run, then 7474 ms and an even lower 7247 ms on the third run. Octane score is 3877.

Nexus 7 on Android 4.3: 16547 ms Kraken and 2158 Octane.
nico1982
Gerbil In Training
 
Posts: 6
Joined: Fri Jan 29, 2010 6:30 am

Re: Firefox on Android benchmark

Postposted on Sun Nov 10, 2013 12:05 pm

Galaxy S3 international version (exynos quad-core), running samsung stock android 4.1.2 and firefox 25 from google playstore:
kraken 1.1 - 21754.3ms
Octane 2.0 - 2303

Hisense sero 7 lite (bleh...), rockwell chip 3066 (dual core @ 1.6GHz), running android 4.1.2 and firefox 25 from google playstore:
kraken 1.1 - 16439.0ms
Octane 2.0 - 2040
hakron
Gerbil
 
Posts: 25
Joined: Sun Oct 31, 2010 6:17 am

Re: Firefox on Android benchmark

Postposted on Sun Nov 10, 2013 12:23 pm

Prototyped wrote:In comparison:

* Lenovo ThinkPad T61 (2008), with a Core 2 Duo T7100 Merom at 1.8 GHz and 2 GB RAM, running Firefox 25: Kraken: 3733 ms, Octane: 7037
* AMD Phenom II X6 1055T (2010), at 2.8 GHz, with 4 GB RAM (albeit DDR2 -- this is on an AM2+ board), running Firefox 25: Kraken: 2866 ms, Octane: 10155
* Lenovo ThinkPad X201 (2010), Core i5 520M Arrandale (Nehalem/Westmere generation), 2.4 GHz with 4 GB RAM, running Firefox 25: Kraken: 2261 ms, Octane: 11390

(That's right, the newest computing device I currently own -- probably the phone actually -- has technology over three years old.)



Interesting idea for a frame of reference.

Using the desktop version of Firefox 25.0 on Arch Linux I get:

Kraken 1.1: 835.4 ms +/- 1.4% (link to detailed results)

Octane 2.0 Score: 27,372.

These results are on my 4770K that is clocked at 4.7GHz.

Additionally, Chromium v30 gives:

Kraken 1.1: 807.4 ms +/- 0.8% (link here)

Octane 2.0: 34,173
4770K @ 4.7 GHz; 32GB DDR3-2133; GTX-770; 512GB 840 Pro (2x); Fractal Define XL-R2; NZXT Kraken-X60
--Many thanks to the TR Forum for advice in getting it built.
chuckula
Gerbil Elite
Gold subscriber
 
 
Posts: 544
Joined: Wed Jan 23, 2008 8:18 pm
Location: Probably where I don't belong.

Re: Firefox on Android benchmark

Postposted on Sun Nov 10, 2013 1:50 pm

nico1982 wrote:I guess you're right. On Dalvik, I got 8639 ms on Kraken on the first run, then 7474 ms and an even lower 7247 ms on the third run. Octane score is 3877.
Nexus 7 on Android 4.3: 16547 ms Kraken and 2158 Octane.

Thats a lot of variation on Kraken :roll:
I have added an edit in the original post cautioning people about run-to-run variation to avoid drawing very precise conclusions.

About Nexus 7, is that 2012 or 2013 model?
codedivine
Gerbil Elite
Silver subscriber
 
 
Posts: 700
Joined: Sat Jan 24, 2009 7:13 am

Re: Firefox on Android benchmark

Postposted on Sun Nov 10, 2013 4:47 pm

codedivine wrote:About Nexus 7, is that 2012 or 2013 model?

2012, Tegra 3 :)
nico1982
Gerbil In Training
 
Posts: 6
Joined: Fri Jan 29, 2010 6:30 am

Re: Firefox on Android benchmark

Postposted on Sun Nov 10, 2013 7:25 pm

codedivine wrote:Does anyone have a Cortex A7 based device, such as the Mediatek MT8125 devices (like Memo Pad HD 7) or various Allwinner A31 based devices?


codedivine,

I'll run this on my Onda v812 (Allwinnner A31 SDK 3.2/Android 4.2 device) tonight and update the thread :D

On my Sony Xperia acro S (LT26w) running Android 4.1.2 (Snapdragon S3 MSM 8260 2x Scorpion @ 1.5GHz):

Kraken 1.1
17740.8 ms +/- 1.7%

Octane 2.0:
1478 2nd run
DAUNTLESS: AMD Phenom II 960T@3.6GHz || MSI 890GXM-G65 || Sapphire HD6950 2GB Ref || 2x4GB Kingston HyperX blu DDR1600 || Creative X-Fi Titanium || Samsung 1TB F3 || Seagate 1TB Barracuda
k00k
Gerbil
 
Posts: 23
Joined: Sun Sep 11, 2011 8:04 pm

Re: Firefox on Android benchmark

Postposted on Sun Nov 10, 2013 8:21 pm

My lenovo k900 got 32199 in kraken. My cubot 6589a (MTK 6589) got 17249 in kraken and 1573 in octane. Using firefox on my k900 is so slow its almost painful. Its still running octane, ill post when its done.

Edit: The k900 can't complete the test, it just crashes.

I tried it on my Asus TF101 and it got 19035 in kraken and 1757 in octane.
cwj717
Gerbil In Training
 
Posts: 9
Joined: Fri Nov 25, 2011 6:22 pm

Re: Firefox on Android benchmark

Postposted on Sun Nov 10, 2013 8:47 pm

cwj717 wrote:My lenovo k900 got 32199 in kraken. My cubot 6589a (MTK 6589) got 17249 in kraken and 1573 in octane. Using firefox on my k900 is so slow its almost painful. Its still running octane, ill post when its done.

Edit: The k900 can't complete the test, it just crashes.

I tried it on my Asus TF101 and it got 19035 in kraken and 1757 in octane.


Isn't the K900 an Intel-powered device? codedivine's Firefox link is for ARM devices, which is painful to run (or not at all compatible) on Atom-based Android devices
DAUNTLESS: AMD Phenom II 960T@3.6GHz || MSI 890GXM-G65 || Sapphire HD6950 2GB Ref || 2x4GB Kingston HyperX blu DDR1600 || Creative X-Fi Titanium || Samsung 1TB F3 || Seagate 1TB Barracuda
k00k
Gerbil
 
Posts: 23
Joined: Sun Sep 11, 2011 8:04 pm

Re: Firefox on Android benchmark

Postposted on Sun Nov 10, 2013 8:49 pm

k00k wrote:
cwj717 wrote:My lenovo k900 got 32199 in kraken. My cubot 6589a (MTK 6589) got 17249 in kraken and 1573 in octane. Using firefox on my k900 is so slow its almost painful. Its still running octane, ill post when its done.

Edit: The k900 can't complete the test, it just crashes.

I tried it on my Asus TF101 and it got 19035 in kraken and 1757 in octane.


Isn't the K900 an Intel-powered device? codedivine's Firefox link is for ARM devices, which is painful to run (or not at all compatible) on Atom-based Android devices


I didn't install it from codedivine's link, i installed it from the playstore.

Edit: Ok, my k900 was running the arm version. After looking around the mozilla ftp, I found the x86 version of fierfox but there were only beta versions. I installed the closest to version 25, 25b10. With this version my k900 got 12861 in kraken and 2612 in octane.
cwj717
Gerbil In Training
 
Posts: 9
Joined: Fri Nov 25, 2011 6:22 pm

Re: Firefox on Android benchmark

Postposted on Sun Nov 10, 2013 9:14 pm

Installed by side loading from the link in the OP.

Nexus 7 2013 (Snapdragon APQ8064, stock 4.3) - 13215
Nook Tablet (OMAP4 1.2Ghz, CM10.1 4.2.2) - 17956

When I get a chance (once it's got a decent charge again) I'll get a Galaxy S4 with the Snapdragon 600.
I do not understand what I do. For what I want to do, I do not do. But what I hate, I do.
derFunkenstein
Gerbil God
Gold subscriber
 
 
Posts: 21142
Joined: Fri Feb 21, 2003 8:13 pm
Location: WHAT?

Re: Firefox on Android benchmark

Postposted on Mon Nov 11, 2013 1:12 am

ChronoReverse wrote:Yeah my i7-4770k@4.3GHz gets 21k in Octane and 1250ms in Kraken. And these tests only use a single core!

That does not sound right. On my 3770K I get 30k in Octane and 961ms in Kraken. My i7-920 gets 22.5k in Octane and 1273ms in Kraken. Even my lowly 3720QM scores 22k in Octane.

Edit: Ah, you are probably using FF. I ran the benchmark runs under Chrome.

ChronoReverse wrote:The mobile CPUs are starting to run out of easy speed boosts

And yet we continue to see major performance increases every year.
i7-3770K@4.7 | H100 | P8Z77-V PREMIUM | 16GB | 2 GTX 770 4GB SLI | M500 960GB | EVO 840 250GB | AX850 | Obsidian 550D | R.A.T. 9 | U2713H | U2711
End User
Gerbil Elite
Gold subscriber
 
 
Posts: 947
Joined: Fri Apr 16, 2004 5:47 pm
Location: Toronto, Canada

Re: Firefox on Android benchmark

Postposted on Mon Nov 11, 2013 1:39 am

Thanks everyone. Keep them coming! We now have results from various SoCs based upon Cortex A7, A9, A15, Snapdragon S3, S4, 600 and 800 (and a beta clover-trail result) :D
codedivine
Gerbil Elite
Silver subscriber
 
 
Posts: 700
Joined: Sat Jan 24, 2009 7:13 am

Re: Firefox on Android benchmark

Postposted on Mon Nov 11, 2013 12:31 pm

For what it's worth, both Kraken and Octane make Firefox crash on an Xperia Active, Scorpion 1GHz and 512 MB of memory, running on Android 4.0 :P
nico1982
Gerbil In Training
 
Posts: 6
Joined: Fri Jan 29, 2010 6:30 am

Re: Firefox on Android benchmark

Postposted on Mon Nov 11, 2013 1:07 pm

k00k wrote:codedivine,

I'll run this on my Onda v812 (Allwinnner A31 SDK 3.2/Android 4.2 device) tonight and update the thread :D


Let us know when you finish the test. A31 results should be interesting :)
codedivine
Gerbil Elite
Silver subscriber
 
 
Posts: 700
Joined: Sat Jan 24, 2009 7:13 am

Re: Firefox on Android benchmark

Postposted on Tue Nov 12, 2013 5:04 pm

Added Moto X, Nexus 7 (2013) results and added HTC One Octane result all thanks to https://twitter.com/DanMatte :)
codedivine
Gerbil Elite
Silver subscriber
 
 
Posts: 700
Joined: Sat Jan 24, 2009 7:13 am

Re: Firefox on Android benchmark

Postposted on Tue Nov 12, 2013 5:39 pm

End User wrote:And yet we continue to see major performance increases every year.

With a significant boost in heat generation. The Snapdragon S4's all heat throttle very quickly.

If you compare the SHIELD with a Galaxy S4, both using an A15 class CPU, the Galaxy S4 runs far lower (per MHz) than the SHIELD because it's thermally limited.

Even so, the A15 is much slower than Haswell and isn't designed to run at 4GHz either. Hence my comment about "easy" speed boosts (an example of this would be the jump from Cortex A8 to Cortex A9 when they finally gave us OOE).


And yeah, I was using Firefox although the desktop version is probably at least somewhat unlike the Android version.
ChronoReverse
Gerbil Elite
 
Posts: 732
Joined: Wed Dec 12, 2007 3:20 pm

Re: Firefox on Android benchmark

Postposted on Wed Nov 13, 2013 10:50 am

codedivine wrote:Does anyone have a Cortex A7 based device, such as the Mediatek MT8125 devices (like Memo Pad HD 7) or various Allwinner A31 based devices?


Okay, as promised, Cortex A7 results: (Onda v812 Allwinner A31, Firmware v3.2.1/Android 4.2.2)

Kraken 1.1: 21472.0 ms +/- 0.3%

Octane 2.0: 1432

For comparison's sake, I also ran this on another China tablet, ifive Mini 2 (RK3066 based Nexus 7 clone, Android 4.1.1)

Kraken 1.1: 16585.8 ms +/- 3.8%

Octane 2.0: 2368

That's it. I'm almost curious to see how my oldest device would bench, a HTC Desire S (msm8255) :)
DAUNTLESS: AMD Phenom II 960T@3.6GHz || MSI 890GXM-G65 || Sapphire HD6950 2GB Ref || 2x4GB Kingston HyperX blu DDR1600 || Creative X-Fi Titanium || Samsung 1TB F3 || Seagate 1TB Barracuda
k00k
Gerbil
 
Posts: 23
Joined: Sun Sep 11, 2011 8:04 pm

Re: Firefox on Android benchmark

Postposted on Wed Nov 13, 2013 9:50 pm

Thanks k00k! Added
codedivine
Gerbil Elite
Silver subscriber
 
 
Posts: 700
Joined: Sat Jan 24, 2009 7:13 am

Re: Firefox on Android benchmark

Postposted on Sat Nov 16, 2013 10:09 am

Firefox update (25.0.1) improved kraken on my galaxy S3 (exynos quad): 13670.9ms
On the other hand, Octane 2.0 got lower: 2220

On my Hisense Sero 7 Lite, kraken got a lil higher than before: 17667.2ms
On the Octane side: 2083
hakron
Gerbil
 
Posts: 25
Joined: Sun Oct 31, 2010 6:17 am

Re: Firefox on Android benchmark

Postposted on Tue Nov 19, 2013 1:46 am

Definitely not Android and not FireFox either, but I thought it would be amusing to post results from my PS4!

Kraken: 19676.1ms +/1.4%
Octane 2.0: PS4 claimed it ran out of memory
2600K @ 4.8GHz; XSPC Rasa/RX240/RX120 Phobya Xtreme 200; Asus P8Z68-V Pro; 16GB Corsair Vengeance 1333 C9; 2x7970 OC w/ Razor 7970; Force GT 120GB; 3x F3 1TB; Corsair HX750; X-Fi Titanium; Corsair Obsidian 650D; Dell 2408WFP Rev. A01; 2x Dell U2412m
mortifiedPenguin
Gerbil Elite
 
Posts: 812
Joined: Mon Oct 08, 2007 6:46 pm

Re: Firefox on Android benchmark

Postposted on Tue Nov 19, 2013 7:31 am

mortifiedPenguin wrote:Definitely not Android and not FireFox either, but I thought it would be amusing to post results from my PS4!

Kraken: 19676.1ms +/1.4%
Octane 2.0: PS4 claimed it ran out of memory







Awesome! Too bad 8GB of RAM isn't enough for octane ;-) Does the PS4 browser give any information on the underlying rendering engine & javascript engine it uses?
4770K @ 4.7 GHz; 32GB DDR3-2133; GTX-770; 512GB 840 Pro (2x); Fractal Define XL-R2; NZXT Kraken-X60
--Many thanks to the TR Forum for advice in getting it built.
chuckula
Gerbil Elite
Gold subscriber
 
 
Posts: 544
Joined: Wed Jan 23, 2008 8:18 pm
Location: Probably where I don't belong.

Re: Firefox on Android benchmark

Postposted on Tue Nov 19, 2013 7:36 am

Nope, there's no way to see that info. Sony just says that it is a "WebKit-based".
My subscription allows you people to exist on this site and makes me a better human being than you'll ever be
JohnC
Gerbil Jedi
Gold subscriber
 
 
Posts: 1741
Joined: Fri Jan 28, 2011 1:08 pm
Location: NY/NJ/FL

Previous

Return to Mobile Tech

Who is online

Users browsing this forum: No registered users and 2 guests