Android owners, I have a fun request for you all. Would you mind downloading Firefox 25 (Download from: https://ftp.mozilla.org/pub/mozilla.org ... oid/en-US/) and reporting data about Kraken benchmark and Octane 2.0 benchmarks? I am linking to Mozilla's site instead of the Play store to ensure we all get the same browser version. Idea is to get an idea of performance differences across SoCs by ensuring that we are all running the same APK.

I will keep updating this table from scores I get below or on twitter. edit: People are seeing 10-15% variation between runs on some devices, so do be careful while drawing very precise conclusions but does give us a good qualitative idea.

Device

Kraken 1.1 (ms)

Nvidia Shield (Tegra 4, Cortex A15 @ 1.9GHz)

5215

Samsung Galaxy S4 (Exynos 5410)

6895

Nexus 5 (Snapdragon 800, 4.4)

7474

Galaxy S4 (Snapdragon 600, CM 10.2)

9535

Moto X (Snapdragon S4 MSM8960Pro, 1.7GHz)

9573

Xperia SP (Snapdragon S4 dual-core 1.7GHz)

9689

HTC One (Snapdragon 600, 1.7GHz)

10569

Nexus 7 (Snapdragon S4 Pro)

10944

Lenovo K900 (Atom Z2580, x86, FF25b10)

12861*

LG Optimus G (Snapdragon S4 Pro)

13217

Nexus 4 (Snapdragon S4 Pro)

13372

Asus TF700T (Nvidia Tegra 3 at 1.7GHz)

14615

Galaxy S3 (Snapdragon S4 1.1GHz, PAC-MAN nightly 9/30 (4.3))

15096

Hisense Sero 7 Lite (RK3066, Cortex A9 @ 1.6GHz)

16439

Nexus 7 (Tegra 3)

16547

ifive Mini 2 (RK3066, Android 4.1.1)

16589

HP Touchpad (Snapdragon S3, 1.728 GHz, Android 4.3)

16972

Cubot 6589a (MTK 6589, quad Cortex A7 @ 1GHz?)

17249

Sony Xperia acro S (Snapdragon S3 MSM 8260 1.5GHz, 4.1.2)

17741

Galaxy Nexus (OMAP 4460, 1.2GHz, 4.4)

17813

ASUS TF300T (Tegra 3 1.3GHz, CM10.1 nightly 4/07 (4.2.2))

19322

Galaxy S2X (Snapdragon S3 1.5GHz)

21016

Motorola Droid Razr MAXX (OMAP 4430, 1.2GHz)

21138

Onda v812 Allwinner A31, Firmware v3.2.1/Android 4.2.2

21472

Galaxy S3 (Exynos 4412)

21754

Device

Octane 2.0

Nvidia Shield (Tegra 4, Cortex A15 @ 1.9GHz)

4408

Nexus 5 (Snapdragon 800, 4.4)

3877

Samsung Galaxy S4 (Exynos 5410)

3656

Moto X (Snapdragon S4 MSM8960Pro, 1.7GHz)

2793

Galaxy S4 (Snapdragon 600, CM 10.2)

2736

Xperia SP (Snapdragon S4 dual-core 1.7GHz)

2625

Lenovo K900 (Atom Z2580, x86, FF25b10)

2612*

Asus TF700T (Nvidia Tegra 3 at 1.7GHz)

2494

Nexus 7 (Snapdragon S4 Pro)

2391

ifive Mini 2 (RK3066, Android 4.1.1)

2368

Galaxy S3 (Exynos 4412)

2303

Nexus 7 (Tegra 3)

2158

Nexus 4 (Snapdragon S4 Pro)

2099

Galaxy Nexus (OMAP 4460, 1.2GHz, 4.4)

2064

HTC One (Snapdragon 600, 1.7GHz, US edition)

2063

LG Optimus G (Snapdragon S4 Pro)

2042

Hisense Sero 7 Lite (RK3066, Cortex A9 @ 1.6GHz)

2040

ASUS TF300T (Tegra 3 1.3GHz, CM10.1 nightly 4/07 (4.2.2))

1744

Galaxy S3 (Snapdragon S4 1.1GHz, PAC-MAN nightly 9/30 (4.3))

1691

Motorola Droid Razr MAXX (OMAP 4430, 1.2GHz)

1687

HP Touchpad (Snapdragon S3, 1.728 GHz, Android 4.3)

1585**

Cubot 6589a (MTK 6589, quad Cortex A7 @ 1GHz?)

1573

Onda v812 Allwinner A31, Firmware v3.2.1/Android 4.2.2

1472

Sony Xperia acro S (Snapdragon S3 MSM 8260 1.5GHz, 4.1.2)

1478

Galaxy S2X (Snapdragon S3 1.5GHz)

1104

Last edited by codedivine on Wed Nov 13, 2013 10:50 pm, edited 29 times in total.

ChronoReverse wrote:You want the results from that specific version (I'm on the beta)?

Yeah, the idea is that we all run the same software release so that we can get a valid SoC performance comparison. With different browser versions, we will be running more of a software optimization test.

Not a problem! Got at least some Tegra love in there (or at least as close to love as I can give that tablet)!

Just for fun, I ran them in Firefox 25.0 on my desktop computer (specs in sig). Kraken got 2730.8ms (+/- 2.4%) and Octane got 11293. Seems like mobile performance has been catching desktop performance little by little, but it's still a ways away...

Thanks. As for ART vs Dalvik, I don't think the VM will matter very much. My understanding (may be wrong) is that Firefox UI is done in Java but the Javascript JIT compiler in Firefox (IonMonkey) is producing native code anyway and will not be affected by which Java VM you use.

I reverted to 4.2.2 stock from 4.4. Partially because my Galaxy Nexus was starting to get really glitchy (no mobile data and graphical artifacts) and partially because I was really curious what the benchmark results would be.