Skip to content

Instantly share code, notes, and snippets.

@eliperelman

eliperelman/1.md Secret

Last active August 29, 2015 14:24
Show Gist options
  • Save eliperelman/5aac3b94e2f815dbb827 to your computer and use it in GitHub Desktop.
Save eliperelman/5aac3b94e2f815dbb827 to your computer and use it in GitHub Desktop.
Download ZIP
v2.2 Application Performance Baselines
Raw
1.md

v2.2 Application Performance Baselines

Details

  • Application load time baseline is 95th percentile of visuallyLoaded
  • Light reference workload
  • 30 runs per application
  • 6-second intervals between application launches
  • B2G restart between application sets
  • Flashed using latest v2.2 Tinderbox build for July 2, 2015

Notes

  • Email values seem anomalous. I remember them being much smaller than they are, and the values for master are also much smaller. There is either a regression or the 6-second interval isn't long enough to test email on v2.2.
  • Camera results appear here, but won't be in Raptor results for master until bug 1169674 gets resolved.
Raw
calendar.md
Metric Mean Median Min Max StdDev p95
coldlaunch.navigationLoaded 1177.067 1155.500 1101.000 1407.000 70.769 1314.000
coldlaunch.navigationInteractive 1194.367 1176.000 1119.000 1424.000 68.906 1326.000
coldlaunch.visuallyLoaded 1326.933 1315.500 1261.000 1539.000 60.026 1454.000
coldlaunch.contentInteractive 1327.500 1316.000 1262.000 1540.000 60.025 1454.000
coldlaunch.fullyLoaded 1937.333 1910.000 1861.000 2179.000 72.203 2076.000
Raw
camera.md
Metric Mean Median Min Max StdDev p95
coldlaunch.navigationLoaded 997.267 987.500 934.000 1132.000 44.892 1066.000
coldlaunch.navigationInteractive 999.033 989.000 935.000 1132.000 45.680 1082.000
coldlaunch.visuallyLoaded 1379.933 1377.000 1282.000 1552.000 65.378 1492.000
coldlaunch.contentInteractive 2059.467 2046.500 1969.000 2289.000 71.838 2253.000
coldlaunch.fullyLoaded 2059.967 2046.500 1969.000 2290.000 72.035 2254.000
Raw
clock.md
Metric Mean Median Min Max StdDev p95
coldlaunch.navigationLoaded 802.433 801.000 729.000 928.000 39.336 867.000
coldlaunch.navigationInteractive 920.367 921.500 836.000 1056.000 40.131 982.000
coldlaunch.visuallyLoaded 1141.867 1137.500 1029.000 1274.000 49.293 1232.000
coldlaunch.contentInteractive 1142.300 1138.000 1030.000 1274.000 49.228 1232.000
coldlaunch.fullyLoaded 1142.867 1138.000 1030.000 1275.000 49.394 1233.000
Raw
contacts.md
Metric Mean Median Min Max StdDev p95
coldlaunch.navigationLoaded 577.700 573.000 531.000 714.000 42.208 685.000
coldlaunch.visuallyLoaded 679.833 678.000 615.000 782.000 43.748 773.000
coldlaunch.contentInteractive 1042.567 1052.000 890.000 1160.000 58.692 1132.000
coldlaunch.navigationInteractive 1043.133 1052.500 890.000 1161.000 58.758 1133.000
coldlaunch.fullyLoaded 2935.400 2927.000 2845.000 3123.000 65.234 3046.000
Raw
dialer.md
Metric Mean Median Min Max StdDev p95
coldlaunch.navigationLoaded 799.900 808.500 675.000 885.000 44.716 851.000
coldlaunch.visuallyLoaded 800.467 808.500 675.000 886.000 44.729 851.000
coldlaunch.contentInteractive 901.533 911.500 790.000 1002.000 45.043 955.000
coldlaunch.navigationInteractive 920.100 927.000 807.000 1023.000 45.398 974.000
coldlaunch.fullyLoaded 1323.500 1323.000 1260.000 1374.000 28.385 1366.000
Raw
email.md
Metric Mean Median Min Max StdDev p95
coldlaunch.navigationLoaded 2012.300 1998.000 1929.000 2140.000 52.983 2119.000
coldlaunch.navigationInteractive 2012.600 1998.500 1930.000 2140.000 52.775 2119.000
coldlaunch.visuallyLoaded 2022.800 2009.000 1939.000 2150.000 53.022 2129.000
coldlaunch.contentInteractive 2023.267 2009.000 1940.000 2150.000 52.871 2129.000
coldlaunch.fullyLoaded 2023.800 2010.000 1940.000 2151.000 53.138 2130.000
Raw
fm.md
Metric Mean Median Min Max StdDev p95
coldlaunch.navigationLoaded 294.567 290.000 272.000 376.000 22.805 339.000
coldlaunch.navigationInteractive 539.900 525.000 501.000 650.000 33.977 603.000
coldlaunch.visuallyLoaded 540.800 525.500 502.000 650.000 33.783 604.000
coldlaunch.contentInteractive 541.567 526.000 504.000 651.000 33.619 605.000
coldlaunch.fullyLoaded 946.067 933.500 831.000 1119.000 60.062 1102.000
Raw
music.md
Metric Mean Median Min Max StdDev p95
coldlaunch.navigationLoaded 639.300 639.000 579.000 733.000 33.051 686.000
coldlaunch.navigationInteractive 804.533 795.500 751.000 878.000 34.473 861.000
coldlaunch.visuallyLoaded 973.400 970.000 897.000 1073.000 49.151 1066.000
coldlaunch.contentInteractive 974.033 971.000 898.000 1073.000 49.242 1068.000
coldlaunch.fullyLoaded 1683.567 1648.000 1532.000 1957.000 118.177 1934.000
Raw
settings.md
Metric Mean Median Min Max StdDev p95
coldlaunch.contentInteractive 733.233 713.500 685.000 842.000 43.872 830.000
coldlaunch.navigationLoaded 1306.567 1289.500 1252.000 1427.000 50.462 1425.000
coldlaunch.navigationInteractive 1307.100 1290.500 1252.000 1427.000 50.486 1425.000
coldlaunch.visuallyLoaded 2339.933 2329.500 2225.000 2499.000 64.133 2474.000
coldlaunch.fullyLoaded 5224.900 5213.000 5146.000 5318.000 39.162 5294.000
Raw
sms.md
Metric Mean Median Min Max StdDev p95
coldlaunch.navigationLoaded 931.067 928.500 864.000 1015.000 35.496 1001.000
coldlaunch.willRenderThreads 961.567 961.500 898.000 1047.000 37.504 1047.000
coldlaunch.navigationInteractive 965.133 964.000 902.000 1051.000 37.415 1050.000
coldlaunch.visuallyLoaded 1249.800 1239.000 1194.000 1350.000 38.428 1340.000
coldlaunch.contentInteractive 1720.300 1712.000 1651.000 1815.000 41.044 1805.000
coldlaunch.objectsInitEnd 1823.500 1815.000 1751.000 1915.000 43.076 1913.000
coldlaunch.fullyLoaded 2911.100 2905.000 2799.000 3053.000 59.173 3005.000
Raw
video.md
Metric Mean Median Min Max StdDev p95
coldlaunch.navigationLoaded 641.100 637.000 576.000 720.000 33.823 704.000
coldlaunch.navigationInteractive 756.067 744.500 686.000 881.000 53.413 863.000
coldlaunch.visuallyLoaded 1020.500 1021.000 919.000 1146.000 48.629 1115.000
coldlaunch.contentInteractive 1021.033 1021.500 920.000 1146.000 48.608 1116.000
coldlaunch.fullyLoaded 1347.667 1359.500 1019.000 1452.000 74.174 1439.000
coldlaunch.scanEnd 1358.000 1367.000 1022.000 1530.000 83.034 1468.400
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment