Skip to content

Instantly share code, notes, and snippets.

@eliperelman

eliperelman/_baseline.md Secret

Last active October 12, 2015 19:35
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save eliperelman/7868c7144a6805ec4f2d to your computer and use it in GitHub Desktop.
Save eliperelman/7868c7144a6805ec4f2d to your computer and use it in GitHub Desktop.
Download ZIP
v2.2 Performance Baseline, 512MB Flame-KK
Raw
_baseline.md

v2.2 Performance Baseline

Flame-KK, 512MB

Instructions

  • Update Flame to v18D_nightly_v4
  • Change memory to 512MB
  • Use latest v2.2 build, October 7th
  • Checkout Gaia v2.2 branch
  • Reset Gaia using GAIA_OPTIMIZE=1 DEVICE_DEBUG=1 PERF_LOGGING=1 RAPTOR=1 NO_LOCK_SCREEN=1 NOFTU=1 SCREEN_TIMEOUT=0 make reset-gaia
  • Install workload[1]: make reference-workload-light
  • Ensure using Raptor v3.x
  • Run Raptor for each app: raptor test coldlaunch --app <app> --runs 30
  • Record results for visuallyLoaded and uss 95% Bound

[1] Except for Calendar! Test Calendar first, then other apps using the workload!

Information

  • GC at fullyLoaded before memory capture
  • 10 seconds between application launches
  • B2G restart between application tests
Raw
calendar.md
Metric Mean Median Min Max StdDev 95% Bound
navigationLoaded 1382.467 1395 1242 1476 69.517 1407.343
navigationInteractive 1399.300 1415.500 1259 1490 68.651 1423.867
visuallyLoaded 1550.867 1561.500 1394 1644 62.423 1573.205
contentInteractive 1551.400 1562 1395 1644 62.423 1573.738
fullyLoaded 2146.100 2163.500 1990 2239 71.124 2171.551
uss 11.097 11.100 10.800 11.400 0.125 11.141
pss 15.210 15.200 15 15.600 0.133 15.257
rss 28.287 28.300 28 28.600 0.118 28.329
Raw
camera.md
Metric Mean Median Min Max StdDev 95% Bound
navigationLoaded 1014.900 1013 941 1071 32.715 1026.607
navigationInteractive 1017.867 1014.500 942 1102 35.488 1030.566
visuallyLoaded 1444 1444.500 1311 1567 70.627 1469.274
contentInteractive 2234.633 2233.500 2138 2312 41.219 2249.383
fullyLoaded 2235.133 2234.500 2139 2312 41.092 2249.838
pss 15.437 15.400 15.400 15.700 0.066 15.460
uss 11.080 11.100 11 11.300 0.060 11.101
rss 29.277 29.300 29.200 29.500 0.062 29.299
Raw
clock.md
Metric Mean Median Min Max StdDev 95% Bound
navigationLoaded 988.367 985 887 1072 45.770 1004.745
navigationInteractive 1115.467 1108 1018 1194 41.798 1130.424
visuallyLoaded 1342.133 1346 1242 1417 36.591 1355.227
contentInteractive 1342.633 1348 1242 1417 36.698 1355.766
fullyLoaded 1343.333 1349 1243 1418 36.539 1356.409
uss 9.837 9.900 9.500 10 0.154 9.892
pss 13.923 14 13.600 14.100 0.150 13.977
rss 26.957 27 26.700 27.100 0.120 27.000
Raw
contacts.md
Metric Mean Median Min Max StdDev 95% Bound
navigationLoaded 589.100 591.500 500 732 44.003 604.846
visuallyLoaded 703.567 699 613 830 43.535 719.146
contentInteractive 1126.900 1131.500 959 1253 55.132 1146.629
navigationInteractive 1127.433 1131.500 959 1254 55.271 1147.212
fullyLoaded 2549.433 2544 2427 2696 52.476 2568.212
uss 16.373 16.400 14.500 17.300 0.459 16.538
pss 20.620 20.550 18.800 21.600 0.450 20.781
rss 33.933 34 32 34.900 0.464 34.099
Raw
dialer.md
Metric Mean Median Min Max StdDev 95% Bound
navigationLoaded 860 871 743 929 42.208 875.104
visuallyLoaded 860.900 871 743 930 42.613 876.149
contentInteractive 974.333 983 883 1047 39.685 988.534
navigationInteractive 992.400 998.500 899 1071 40.115 1006.755
fullyLoaded 1425.233 1425.500 1378 1477 27.274 1434.993
uss 11.207 11.200 11.100 11.300 0.036 11.220
pss 15.290 15.300 15.200 15.300 0.030 15.301
rss 28.187 28.200 28 28.200 0.043 28.202
Raw
email.md
Metric Mean Median Min Max StdDev 95% Bound
navigationLoaded 420.667 369.500 313 1864 269.741 517.192
navigationInteractive 1741.733 1732.500 1660 1864 52.447 1760.501
visuallyLoaded 422.400 371 318 1876 271.615 519.596
contentInteractive 1741.367 1732 1659 1876 53.343 1760.455
fullyLoaded 2505.867 2519.500 1876 2660 133.040 2553.474
uss 12.387 12.200 12 12.900 0.327 12.504
rss 29.810 29.600 29.500 30.400 0.337 29.931
pss 16.467 16.200 16 17 0.350 16.592

Email seems to always exhibit these large values in standard deviation. I'm not sure what the problem is, but I assume the keyboard opening every time isn't helpful.

Raw
fm.md
Metric Mean Median Min Max StdDev 95% Bound
navigationLoaded 363.700 362.500 317 413 25.467 372.813
navigationInteractive 689.600 688.500 617 794 41.160 704.329
visuallyLoaded 690.433 689.500 618 795 41.140 705.155
contentInteractive 691.333 690 619 796 41.050 706.023
fullyLoaded 1092.400 1100.500 968 1173 48.477 1109.747
uss 8.613 8.600 8.500 8.700 0.043 8.629
pss 12.583 12.600 12.500 12.700 0.045 12.600
rss 25.303 25.300 25.100 25.400 0.055 25.323
Raw
music.md
Metric Mean Median Min Max StdDev 95% Bound
navigationLoaded 671.600 664.500 618 804 35.838 684.425
navigationInteractive 879.667 875 780 971 41.795 894.623
visuallyLoaded 1057.333 1050 962 1192 62.855 1079.826
contentInteractive 1058.367 1050.500 962 1192 62.999 1080.910
fullyLoaded 1878.267 1885 1685 2041 72.489 1904.207
pss 15.443 15.400 15.300 15.700 0.072 15.469
uss 11.187 11.200 11.100 11.400 0.072 11.212
rss 28.703 28.700 28.600 28.900 0.071 28.729
Raw
settings.md
Metric Mean Median Min Max StdDev 95% Bound
contentInteractive 830.733 823 757 922 40.189 845.115
navigationLoaded 1428.500 1418 1388 1502 32.685 1440.196
navigationInteractive 1428.833 1418 1388 1503 32.745 1440.551
visuallyLoaded 2499.400 2503.500 2375 2601 59.613 2520.732
fullyLoaded 5276.233 5279 5208 5372 47.135 5293.100
pss 18.327 18.300 18 18.900 0.190 18.395
uss 14.513 14.500 14.200 15 0.182 14.578
rss 32.183 32.200 31.900 32.700 0.192 32.252
Raw
sms.md
Metric Mean Median Min Max StdDev 95% Bound
navigationLoaded 926.933 922 847 1018 36.872 940.128
willRenderThreads 966.933 965 889 1057 36.716 980.072
navigationInteractive 971.533 968 894 1059 36.565 984.618
visuallyLoaded 1329.133 1321 1254 1424 33.485 1341.116
contentInteractive 1834.900 1836 1745 1923 44.551 1850.842
objectsInitEnd 1953.767 1951.500 1847 2068 48.803 1971.231
fullyLoaded 3094.567 3109.500 2955 3207 74.487 3121.222
uss 17.007 17.100 16.700 17.200 0.153 17.061
rss 34.797 34.900 34.500 35 0.156 34.852
pss 20.903 20.900 20.600 21.200 0.147 20.956
Raw
video.md
Metric Mean Median Min Max StdDev 95% Bound
navigationLoaded 673.167 678 589 741 33.679 685.219
navigationInteractive 820.433 824.500 748 895 34.094 832.634
visuallyLoaded 1110.267 1122 936 1170 48.480 1127.615
contentInteractive 1110.767 1123 937 1171 48.461 1128.108
fullyLoaded 1447.833 1474.500 1084 1528 78.588 1475.956
uss 10.303 10.100 10 14.100 0.791 10.587
pss 14.453 14.200 14.100 18.600 0.900 14.775
rss 27.523 27.100 27.100 32.300 1.090 27.913
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment