Skip to content

Instantly share code, notes, and snippets.

@rwood-moz
Last active August 29, 2015 14:17
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save rwood-moz/d16e44d7d48203d8f92c to your computer and use it in GitHub Desktop.
Save rwood-moz/d16e44d7d48203d8f92c to your computer and use it in GitHub Desktop.
Raptor on Emulator - Template App - Ramdisk
AWS r3.xlarge ubuntu 14.04
Emulator (NOT emulator-kk)
** Emulator running on a RAMDISK mounted into the docker container **
Cfg: 2048 RAM, 2047 partition (max partition size)
Removed: -skin, -skindir, -camera-back
Added: -wipe-data, -no-skin (rest of settings default)
Added: '-net none -bt hci,null' to end of -qemu $TAIL_ARGS
Cmd: DEBUG=* RUNS=30 APPS='template' RAPTOR_EMULATOR=1 node tests/raptor/emulator_launch_test.js
Iterations: 10 (shutdown and restart emulator and do make raptor before each cmd iteration)
Results direct from console:
Iteration 1
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1771.033 1746.500 1284.000 2210.000 181.253 2128.000
coldlaunch.navigationInteractive 1777.800 1754.500 1284.000 2211.000 180.660 2128.000
coldlaunch.visuallyLoaded 1783.967 1760.000 1291.000 2222.000 180.900 2136.000
coldlaunch.contentInteractive 1785.300 1761.000 1291.000 2222.000 180.627 2136.000
coldlaunch.fullyLoaded 1786.733 1762.000 1292.000 2229.000 181.390 2140.000
coldlaunch.uss 5.833 5.800 5.300 6.000 0.202 6.000
coldlaunch.rss 22.970 23.000 22.500 23.100 0.195 23.100
coldlaunch.pss 10.167 10.200 9.700 10.300 0.194 10.300
Iteration 2
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1790.167 1785.500 1566.000 2051.000 130.714 2047.000
coldlaunch.navigationInteractive 1802.633 1798.000 1586.000 2066.000 131.730 2054.000
coldlaunch.visuallyLoaded 1805.700 1799.000 1586.000 2066.000 130.206 2055.000
coldlaunch.contentInteractive 1808.267 1805.000 1594.000 2067.000 130.088 2056.000
coldlaunch.fullyLoaded 1808.900 1805.000 1594.000 2072.000 130.430 2056.000
coldlaunch.uss 5.313 5.300 5.300 5.700 0.072 5.300
coldlaunch.pss 9.617 9.600 9.600 10.100 0.090 9.600
coldlaunch.rss 22.307 22.300 22.200 22.700 0.077 22.300
Iteration 3
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1766.833 1772.000 1350.000 2011.000 140.996 1994.000
coldlaunch.navigationInteractive 1775.267 1772.500 1350.000 2019.000 140.610 2002.000
coldlaunch.visuallyLoaded 1779.800 1776.500 1390.000 2020.000 137.358 2009.000
coldlaunch.contentInteractive 1782.500 1777.500 1391.000 2029.000 136.905 2009.000
coldlaunch.fullyLoaded 1784.300 1785.000 1394.000 2029.000 136.774 2010.000
coldlaunch.uss 5.510 5.500 5.500 5.600 0.030 5.600
coldlaunch.rss 22.503 22.500 22.500 22.600 0.018 22.500
coldlaunch.pss 9.810 9.800 9.800 9.900 0.030 9.900
Iteration 4
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1802.900 1751.000 1358.000 2158.000 176.737 2154.000
coldlaunch.navigationInteractive 1810.600 1758.000 1359.000 2171.000 179.387 2159.000
coldlaunch.visuallyLoaded 1814.233 1762.000 1363.000 2172.000 178.716 2161.000
coldlaunch.contentInteractive 1815.967 1762.500 1364.000 2173.000 179.145 2162.000
coldlaunch.fullyLoaded 1817.433 1764.500 1364.000 2174.000 178.965 2162.000
coldlaunch.pss 9.800 9.800 9.800 9.800 0.000 9.800
coldlaunch.rss 22.477 22.500 22.400 22.500 0.042 22.500
coldlaunch.uss 5.500 5.500 5.500 5.500 0.000 5.500
Iteration 5
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1821.933 1786.500 1453.000 2117.000 146.385 2078.000
coldlaunch.navigationInteractive 1832.000 1800.500 1454.000 2117.000 147.133 2079.000
coldlaunch.visuallyLoaded 1835.267 1802.000 1455.000 2118.000 146.762 2080.000
coldlaunch.contentInteractive 1838.300 1808.500 1455.000 2119.000 146.173 2080.000
coldlaunch.fullyLoaded 1841.000 1809.500 1460.000 2119.000 145.905 2084.000
coldlaunch.pss 9.673 9.600 9.500 10.200 0.186 10.100
coldlaunch.uss 5.370 5.300 5.200 5.900 0.188 5.800
coldlaunch.rss 22.370 22.300 22.200 22.900 0.188 22.800
Iteration 6
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1808.000 1787.500 1528.000 2139.000 136.490 2049.000
coldlaunch.navigationInteractive 1816.500 1794.000 1551.000 2154.000 139.130 2049.000
coldlaunch.visuallyLoaded 1821.800 1800.500 1553.000 2154.000 137.953 2050.000
coldlaunch.contentInteractive 1823.067 1801.500 1553.000 2163.000 138.508 2051.000
coldlaunch.fullyLoaded 1824.400 1802.500 1556.000 2164.000 138.327 2051.000
coldlaunch.pss 10.000 10.000 10.000 10.000 0.000 10.000
coldlaunch.rss 22.603 22.600 22.600 22.700 0.018 22.600
coldlaunch.uss 5.600 5.600 5.600 5.600 0.000 5.600
Iteration 7
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1820.367 1753.000 1573.000 2192.000 169.053 2150.000
coldlaunch.navigationInteractive 1828.800 1759.500 1587.000 2193.000 170.360 2177.000
coldlaunch.visuallyLoaded 1834.600 1761.000 1587.000 2210.000 170.881 2178.000
coldlaunch.contentInteractive 1836.133 1762.000 1588.000 2211.000 170.947 2179.000
coldlaunch.fullyLoaded 1837.367 1762.500 1588.000 2213.000 171.097 2179.000
coldlaunch.rss 22.800 22.800 22.800 22.800 0.000 22.800
coldlaunch.uss 5.800 5.800 5.800 5.800 0.000 5.800
coldlaunch.pss 10.177 10.200 10.100 10.200 0.042 10.200
Iteration 8
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1905.567 1890.500 1704.000 2174.000 144.022 2158.000
coldlaunch.navigationInteractive 1915.400 1891.000 1722.000 2187.000 143.605 2171.000
coldlaunch.visuallyLoaded 1920.200 1898.000 1722.000 2188.000 142.329 2171.000
coldlaunch.contentInteractive 1923.533 1899.000 1745.000 2198.000 142.085 2172.000
coldlaunch.fullyLoaded 1925.600 1899.500 1749.000 2198.000 140.671 2172.000
coldlaunch.rss 22.977 22.900 22.900 23.200 0.102 23.100
coldlaunch.pss 10.173 10.100 10.100 10.300 0.096 10.300
coldlaunch.uss 5.870 5.800 5.700 6.000 0.100 6.000
Iteration 9
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1925.267 1908.500 1596.000 2238.000 175.316 2236.000
coldlaunch.navigationInteractive 1932.167 1924.500 1596.000 2239.000 177.125 2236.000
coldlaunch.visuallyLoaded 1939.533 1930.500 1597.000 2277.000 179.279 2263.000
coldlaunch.contentInteractive 1942.233 1932.000 1598.000 2281.000 179.540 2263.000
coldlaunch.fullyLoaded 1943.733 1934.000 1598.000 2283.000 179.690 2264.000
coldlaunch.uss 5.340 5.300 5.300 5.700 0.120 5.700
coldlaunch.rss 22.340 22.300 22.300 22.700 0.120 22.700
coldlaunch.pss 9.647 9.600 9.600 10.100 0.141 10.100
Iteration 10
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1794.267 1767.500 1592.000 2179.000 150.285 2120.000
coldlaunch.navigationInteractive 1805.667 1773.000 1616.000 2194.000 150.193 2135.000
coldlaunch.visuallyLoaded 1809.867 1780.500 1617.000 2194.000 149.284 2136.000
coldlaunch.contentInteractive 1812.233 1781.000 1617.000 2225.000 152.099 2137.000
coldlaunch.fullyLoaded 1814.100 1781.500 1622.000 2226.000 152.258 2139.000
coldlaunch.pss 9.927 9.900 9.900 10.100 0.051 10.000
coldlaunch.rss 22.607 22.600 22.600 22.800 0.036 22.600
coldlaunch.uss 5.607 5.600 5.600 5.800 0.036 5.600
fullyLoaded Coefficient of varation: 100 * (std dev / mean)
Iteration 1: 10.15
Iteration 2: 7.21
Iteration 3: 7.66
Iteration 4: 9.84
Iteration 5: 7.92
Iteration 6: 7.58
Iteration 7: 9.31
Iteration 8: 7.30
Iteration 9: 9.24
Iteration 10: 8.39
Average: 8.46
AWS r3.xlarge ubuntu 14.04
Emulator (NOT emulator-kk)
** Emulator running on a RAMDISK mounted into the docker container **
Cfg: 2048 RAM, 2047 partition (max partition size)
Removed: -skin, -skindir, -camera-back
Added: -wipe-data, -no-skin (rest of settings default)
Added: '-net none -bt hci,null' to end of -qemu $TAIL_ARGS
Added: -cache-size 2048
Cmd: DEBUG=* RUNS=30 APPS='template' RAPTOR_EMULATOR=1 node tests/raptor/emulator_launch_test.js
Iterations: 10 (shutdown and restart emulator and do make raptor before each cmd iteration)
Results direct from console:
Iteration 1
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1772.433 1761.500 1311.000 2063.000 160.241 2021.000
coldlaunch.navigationInteractive 1777.333 1762.000 1312.000 2063.000 161.943 2021.000
coldlaunch.visuallyLoaded 1782.600 1768.000 1313.000 2064.000 161.297 2025.000
coldlaunch.contentInteractive 1783.767 1772.000 1313.000 2065.000 161.774 2026.000
coldlaunch.fullyLoaded 1784.900 1772.500 1314.000 2065.000 162.002 2027.000
coldlaunch.uss 5.803 5.800 5.800 5.900 0.018 5.800
coldlaunch.rss 22.800 22.800 22.800 22.800 0.000 22.800
coldlaunch.pss 10.197 10.200 10.100 10.200 0.018 10.200
Iteration 2
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1684.000 1655.000 1474.000 1951.000 115.982 1904.000
coldlaunch.navigationInteractive 1695.100 1672.000 1528.000 1981.000 113.724 1910.000
coldlaunch.visuallyLoaded 1700.700 1673.000 1529.000 1982.000 116.294 1940.000
coldlaunch.contentInteractive 1702.167 1674.000 1532.000 1983.000 116.320 1941.000
coldlaunch.fullyLoaded 1703.400 1674.000 1532.000 1984.000 116.844 1941.000
coldlaunch.rss 22.587 22.600 22.400 22.600 0.043 22.600
coldlaunch.pss 10.607 10.600 10.500 10.700 0.036 10.700
coldlaunch.uss 7.013 7.000 6.900 7.100 0.043 7.100
Iteration 3
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1797.600 1765.000 1211.000 2190.000 197.157 2165.000
coldlaunch.navigationInteractive 1806.867 1797.500 1213.000 2192.000 199.419 2190.000
coldlaunch.visuallyLoaded 1812.100 1805.500 1228.000 2202.000 197.653 2193.000
coldlaunch.contentInteractive 1813.233 1811.000 1229.000 2203.000 197.487 2194.000
coldlaunch.fullyLoaded 1814.067 1812.000 1229.000 2204.000 197.602 2195.000
coldlaunch.pss 10.787 10.800 10.700 10.900 0.081 10.900
coldlaunch.uss 7.137 7.100 7.000 7.300 0.084 7.300
coldlaunch.rss 22.993 23.000 22.800 23.100 0.089 23.100
Iteration 4
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1658.467 1625.000 1451.000 1951.000 131.037 1927.000
coldlaunch.navigationInteractive 1669.667 1638.500 1460.000 1974.000 127.282 1928.000
coldlaunch.visuallyLoaded 1673.033 1638.500 1460.000 1975.000 128.839 1939.000
coldlaunch.contentInteractive 1675.667 1645.500 1461.000 1983.000 128.703 1939.000
coldlaunch.fullyLoaded 1676.733 1645.500 1461.000 1984.000 128.754 1942.000
coldlaunch.rss 23.000 23.000 23.000 23.000 0.000 23.000
coldlaunch.uss 6.000 6.000 6.000 6.000 0.000 6.000
coldlaunch.pss 10.297 10.300 10.200 10.300 0.018 10.300
Iteration 5
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1699.367 1674.500 1262.000 2020.000 144.265 1945.000
coldlaunch.navigationInteractive 1711.533 1676.500 1267.000 2048.000 147.468 1975.000
coldlaunch.visuallyLoaded 1715.700 1681.500 1268.000 2048.000 146.475 1975.000
coldlaunch.contentInteractive 1717.467 1684.500 1269.000 2056.000 146.880 1976.000
coldlaunch.fullyLoaded 1718.967 1685.000 1269.000 2057.000 146.615 1976.000
coldlaunch.pss 10.600 10.600 10.500 10.700 0.058 10.700
coldlaunch.uss 7.003 7.000 6.900 7.100 0.060 7.100
coldlaunch.rss 22.580 22.600 22.400 22.700 0.054 22.600
Iteration 6
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1717.200 1720.500 1362.000 1979.000 142.417 1914.000
coldlaunch.navigationInteractive 1724.467 1728.500 1363.000 1980.000 140.088 1937.000
coldlaunch.visuallyLoaded 1729.733 1729.000 1368.000 1984.000 142.252 1938.000
coldlaunch.contentInteractive 1732.233 1730.500 1369.000 1984.000 142.009 1949.000
coldlaunch.fullyLoaded 1733.133 1731.000 1370.000 1992.000 142.292 1949.000
coldlaunch.rss 22.980 23.000 22.400 23.100 0.128 23.100
coldlaunch.pss 10.790 10.800 10.200 10.900 0.125 10.900
coldlaunch.uss 7.100 7.100 6.600 7.200 0.113 7.200
Iteration 7
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1677.767 1676.500 1336.000 2073.000 159.572 1929.000
coldlaunch.navigationInteractive 1685.967 1686.500 1341.000 2078.000 159.377 1952.000
coldlaunch.visuallyLoaded 1692.433 1691.500 1342.000 2079.000 161.291 1972.000
coldlaunch.contentInteractive 1694.467 1699.000 1342.000 2079.000 160.726 1973.000
coldlaunch.fullyLoaded 1695.433 1700.000 1343.000 2080.000 160.760 1974.000
coldlaunch.pss 10.777 10.800 10.400 10.900 0.084 10.900
coldlaunch.uss 7.103 7.100 6.700 7.300 0.087 7.200
coldlaunch.rss 22.977 23.000 22.600 23.100 0.084 23.100
Iteration 8
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1755.433 1730.000 1633.000 2038.000 107.706 1978.000
coldlaunch.navigationInteractive 1764.600 1733.500 1641.000 2062.000 110.029 1983.000
coldlaunch.visuallyLoaded 1768.533 1735.000 1647.000 2063.000 108.491 1984.000
coldlaunch.contentInteractive 1770.133 1736.000 1647.000 2070.000 109.053 1985.000
coldlaunch.fullyLoaded 1771.500 1737.000 1648.000 2070.000 109.220 1985.000
coldlaunch.uss 7.130 7.100 7.100 7.200 0.046 7.200
coldlaunch.rss 22.700 22.700 22.700 22.700 0.000 22.700
coldlaunch.pss 10.730 10.700 10.700 10.800 0.046 10.800
Iteration 9
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1729.767 1715.500 1529.000 2018.000 112.103 1991.000
coldlaunch.navigationInteractive 1740.200 1721.500 1538.000 2018.000 113.708 2012.000
coldlaunch.visuallyLoaded 1744.700 1722.500 1539.000 2045.000 116.865 2013.000
coldlaunch.contentInteractive 1746.367 1724.000 1539.000 2045.000 116.565 2014.000
coldlaunch.fullyLoaded 1747.800 1724.500 1540.000 2048.000 117.463 2014.000
coldlaunch.uss 6.820 6.800 6.400 7.100 0.108 7.000
coldlaunch.rss 22.407 22.400 22.000 22.600 0.096 22.600
coldlaunch.pss 10.417 10.400 10.000 10.700 0.107 10.600
Iteration 10
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1712.600 1681.500 1533.000 2031.000 119.369 1963.000
coldlaunch.navigationInteractive 1723.100 1690.500 1534.000 2031.000 118.479 1964.000
coldlaunch.visuallyLoaded 1726.467 1691.500 1535.000 2035.000 117.841 1973.000
coldlaunch.contentInteractive 1729.167 1692.500 1545.000 2035.000 116.115 1973.000
coldlaunch.fullyLoaded 1730.400 1693.000 1545.000 2036.000 116.374 1974.000
coldlaunch.rss 22.630 22.600 22.600 22.700 0.046 22.700
coldlaunch.pss 10.680 10.700 10.600 10.700 0.040 10.700
coldlaunch.uss 7.083 7.100 7.000 7.200 0.045 7.100
fullyLoaded Coefficient of varation: 100 * (std dev / mean)
Iteration 1: 9.07
Iteration 2: 6.86
Iteration 3: 10.89
Iteration 4: 7.67
Iteration 5: 8.52
Iteration 6: 8.21
Iteration 7: 9.48
Iteration 8: 6.16
Iteration 9: 6.72
Iteration 10: 6.72
Average: 8.03
AWS r3.xlarge ubuntu 14.04
Emulator (NOT emulator-kk)
** Emulator running on a RAMDISK mounted into the docker container **
Cfg: 2048 RAM, 2047 partition (max partition size)
Removed: -skin, -skindir, -camera-back
Added: -wipe-data, -no-skin (rest of settings default)
Added: '-net none -bt hci,null' to end of -qemu $TAIL_ARGS
Added: -prop heapSize=96
Cmd: DEBUG=* RUNS=30 APPS='template' RAPTOR_EMULATOR=1 node tests/raptor/emulator_launch_test.js
Iterations: 10 (shutdown and restart emulator and do make raptor before each cmd iteration)
Results direct from console:
Iteration 1
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1858.067 1853.500 1336.000 2144.000 192.217 2137.000
coldlaunch.navigationInteractive 1865.900 1858.500 1336.000 2145.000 192.006 2138.000
coldlaunch.visuallyLoaded 1872.333 1866.500 1341.000 2146.000 192.704 2139.000
coldlaunch.contentInteractive 1873.167 1866.500 1342.000 2146.000 192.248 2139.000
coldlaunch.fullyLoaded 1875.467 1868.500 1343.000 2157.000 192.198 2140.000
coldlaunch.pss 10.433 10.400 10.400 10.700 0.065 10.500
coldlaunch.uss 6.833 6.800 6.800 7.100 0.065 6.900
coldlaunch.rss 22.407 22.400 22.400 22.600 0.036 22.400
Iteration 2
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1806.433 1772.500 1439.000 2134.000 186.625 2113.000
coldlaunch.navigationInteractive 1820.633 1782.500 1440.000 2135.000 186.282 2120.000
coldlaunch.visuallyLoaded 1824.600 1783.500 1471.000 2143.000 184.500 2124.000
coldlaunch.contentInteractive 1826.233 1784.500 1471.000 2143.000 184.285 2125.000
coldlaunch.fullyLoaded 1827.467 1784.500 1472.000 2144.000 184.406 2127.000
coldlaunch.rss 22.620 22.600 22.600 22.700 0.040 22.700
coldlaunch.uss 7.063 7.100 7.000 7.100 0.048 7.100
coldlaunch.pss 10.637 10.600 10.600 10.700 0.048 10.700
Iteration 3
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1718.600 1716.000 1251.000 1994.000 163.330 1990.000
coldlaunch.navigationInteractive 1730.133 1731.000 1252.000 1995.000 161.331 1991.000
coldlaunch.visuallyLoaded 1733.700 1731.000 1256.000 2001.000 163.036 1998.000
coldlaunch.contentInteractive 1735.367 1733.500 1257.000 2002.000 162.689 1998.000
coldlaunch.fullyLoaded 1736.400 1736.000 1258.000 2003.000 162.737 1999.000
coldlaunch.pss 10.837 10.850 10.700 10.900 0.071 10.900
coldlaunch.rss 23.040 23.050 22.900 23.100 0.066 23.100
coldlaunch.uss 7.193 7.200 7.100 7.300 0.089 7.300
Iteration 4
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1732.333 1718.500 1536.000 2091.000 134.102 1954.000
coldlaunch.navigationInteractive 1745.833 1724.000 1537.000 2147.000 142.590 1966.000
coldlaunch.visuallyLoaded 1749.667 1725.000 1544.000 2148.000 140.734 1970.000
coldlaunch.contentInteractive 1750.833 1725.500 1545.000 2149.000 141.066 1974.000
coldlaunch.fullyLoaded 1752.233 1726.000 1545.000 2149.000 141.112 1974.000
coldlaunch.rss 22.597 22.600 22.400 22.700 0.071 22.700
coldlaunch.uss 7.013 7.000 6.900 7.100 0.056 7.100
coldlaunch.pss 10.603 10.600 10.500 10.700 0.055 10.700
Iteration 5
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1705.800 1682.000 1541.000 1955.000 115.521 1953.000
coldlaunch.navigationInteractive 1714.433 1683.000 1553.000 1973.000 113.910 1966.000
coldlaunch.visuallyLoaded 1718.533 1686.500 1554.000 1973.000 114.044 1966.000
coldlaunch.contentInteractive 1720.100 1687.500 1555.000 1975.000 114.159 1967.000
coldlaunch.fullyLoaded 1721.033 1687.500 1555.000 1976.000 114.159 1968.000
coldlaunch.uss 7.040 7.000 7.000 7.100 0.049 7.100
coldlaunch.pss 10.613 10.600 10.600 10.700 0.034 10.700
coldlaunch.rss 22.603 22.600 22.600 22.700 0.018 22.600
Iteration 6
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1767.933 1710.000 1589.000 2123.000 152.108 2098.000
coldlaunch.navigationInteractive 1778.667 1720.500 1601.000 2124.000 152.004 2099.000
coldlaunch.visuallyLoaded 1783.167 1723.000 1603.000 2128.000 152.115 2115.000
coldlaunch.contentInteractive 1784.767 1724.000 1604.000 2129.000 152.350 2115.000
coldlaunch.fullyLoaded 1786.633 1731.000 1604.000 2130.000 153.234 2125.000
coldlaunch.rss 22.607 22.600 22.600 22.700 0.025 22.700
coldlaunch.uss 7.060 7.100 7.000 7.100 0.049 7.100
coldlaunch.pss 10.623 10.600 10.600 10.700 0.042 10.700
Iteration 7
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1717.400 1684.500 1558.000 1897.000 104.357 1879.000
coldlaunch.navigationInteractive 1728.367 1703.000 1559.000 1916.000 104.760 1893.000
coldlaunch.visuallyLoaded 1731.767 1705.500 1560.000 1917.000 105.200 1893.000
coldlaunch.contentInteractive 1735.767 1707.500 1587.000 1918.000 103.411 1899.000
coldlaunch.fullyLoaded 1736.633 1709.500 1587.000 1918.000 103.792 1900.000
coldlaunch.rss 22.517 22.500 22.500 22.700 0.052 22.700
coldlaunch.uss 7.003 7.000 6.900 7.200 0.060 7.200
coldlaunch.pss 10.550 10.500 10.500 10.700 0.062 10.700
Iteration 8
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1837.333 1788.000 1255.000 2191.000 215.999 2164.000
coldlaunch.navigationInteractive 1847.233 1813.000 1281.000 2198.000 216.311 2193.000
coldlaunch.visuallyLoaded 1852.533 1817.500 1282.000 2217.000 216.458 2199.000
coldlaunch.contentInteractive 1855.633 1822.000 1283.000 2217.000 217.309 2200.000
coldlaunch.fullyLoaded 1856.800 1822.000 1283.000 2218.000 217.132 2201.000
coldlaunch.rss 22.570 22.600 22.400 22.700 0.078 22.700
coldlaunch.pss 10.593 10.600 10.500 10.700 0.057 10.700
coldlaunch.uss 7.003 7.000 6.900 7.200 0.080 7.200
Iteration 9
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1728.867 1690.500 1523.000 2055.000 139.333 2026.000
coldlaunch.navigationInteractive 1739.033 1703.000 1542.000 2056.000 138.432 2027.000
coldlaunch.visuallyLoaded 1741.533 1704.000 1542.000 2057.000 137.998 2028.000
coldlaunch.contentInteractive 1743.467 1708.500 1543.000 2057.000 137.622 2029.000
coldlaunch.fullyLoaded 1744.567 1709.500 1544.000 2058.000 137.383 2030.000
coldlaunch.rss 22.663 22.700 22.500 22.700 0.075 22.700
coldlaunch.pss 10.717 10.700 10.500 10.800 0.078 10.800
coldlaunch.uss 7.150 7.200 6.900 7.200 0.085 7.200
Iteration 10
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1825.667 1778.000 1419.000 2176.000 192.815 2160.000
coldlaunch.navigationInteractive 1836.267 1799.000 1420.000 2177.000 193.895 2161.000
coldlaunch.visuallyLoaded 1841.933 1799.000 1427.000 2184.000 192.889 2181.000
coldlaunch.contentInteractive 1845.867 1805.000 1427.000 2185.000 193.089 2181.000
coldlaunch.fullyLoaded 1847.400 1808.000 1427.000 2186.000 192.812 2182.000
coldlaunch.uss 7.073 7.100 6.900 7.200 0.077 7.200
coldlaunch.pss 10.643 10.700 10.500 10.800 0.088 10.800
coldlaunch.rss 22.593 22.600 22.500 22.700 0.057 22.700
fullyLoaded Coefficient of varation: 100 * (std dev / mean)
Iteration 1: 10.24
Iteration 2: 10.09
Iteration 3: 9.37
Iteration 4: 8.05
Iteration 5: 6.63
Iteration 6: 8.57
Iteration 7: 5.97
Iteration 8: 11.69
Iteration 9: 7.87
Iteration 10: 10.43
Average: 8.89
Repeat of ramdisk_2 above:
AWS r3.xlarge ubuntu 14.04
Emulator (NOT emulator-kk)
** Emulator running on a 1024MB RAMDISK mounted into the docker container **
Cfg: 2048 RAM, 2047 partition (max partition size)
Removed: -skin, -skindir, -camera-back
Added: -wipe-data, -no-skin (rest of settings default)
Added: '-net none -bt hci,null' to end of -qemu $TAIL_ARGS
Added: -cache-size 2048
Cmd: DEBUG=* RUNS=30 APPS='template' RAPTOR_EMULATOR=1 node tests/raptor/emulator_launch_test.js
Iterations: 10 (shutdown and restart emulator and do make raptor before each cmd iteration)
Results direct from console:
Iteration 1
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1841.133 1815.000 1282.000 2148.000 158.434 2113.000
coldlaunch.navigationInteractive 1850.600 1835.000 1283.000 2174.000 159.806 2123.000
coldlaunch.visuallyLoaded 1856.067 1836.500 1286.000 2175.000 160.829 2124.000
coldlaunch.contentInteractive 1858.233 1838.000 1289.000 2181.000 161.510 2134.000
coldlaunch.fullyLoaded 1859.333 1838.000 1289.000 2182.000 161.920 2136.000
coldlaunch.pss 10.653 10.700 10.600 10.700 0.050 10.700
coldlaunch.rss 22.630 22.600 22.600 22.700 0.046 22.700
coldlaunch.uss 7.070 7.100 7.000 7.100 0.046 7.100
Iteration 2
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1694.900 1697.000 1489.000 1970.000 113.440 1891.000
coldlaunch.navigationInteractive 1708.133 1701.000 1490.000 1971.000 110.148 1900.000
coldlaunch.visuallyLoaded 1712.100 1713.500 1491.000 1978.000 111.478 1901.000
coldlaunch.contentInteractive 1713.400 1713.500 1492.000 1978.000 111.235 1901.000
coldlaunch.fullyLoaded 1714.200 1714.500 1492.000 1979.000 111.104 1901.000
coldlaunch.rss 22.603 22.600 22.600 22.700 0.018 22.600
coldlaunch.pss 10.623 10.600 10.600 10.800 0.050 10.700
coldlaunch.uss 7.040 7.000 7.000 7.200 0.055 7.100
Iteration 3
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1847.300 1835.500 1275.000 2211.000 187.231 2096.000
coldlaunch.navigationInteractive 1858.333 1852.500 1276.000 2211.000 186.954 2096.000
coldlaunch.visuallyLoaded 1864.467 1859.000 1279.000 2228.000 188.571 2097.000
coldlaunch.contentInteractive 1866.433 1859.500 1280.000 2228.000 188.009 2098.000
coldlaunch.fullyLoaded 1867.833 1860.500 1280.000 2230.000 188.241 2098.000
coldlaunch.uss 7.080 7.100 6.900 7.200 0.098 7.200
coldlaunch.rss 22.613 22.600 22.400 22.800 0.099 22.800
coldlaunch.pss 10.680 10.700 10.500 10.800 0.098 10.800
Iteration 4
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1752.233 1682.500 1574.000 2088.000 132.615 1995.000
coldlaunch.navigationInteractive 1763.400 1703.500 1574.000 2113.000 133.148 2006.000
coldlaunch.visuallyLoaded 1767.467 1704.000 1584.000 2114.000 131.787 2007.000
coldlaunch.contentInteractive 1768.867 1705.000 1584.000 2115.000 131.900 2010.000
coldlaunch.fullyLoaded 1770.700 1705.500 1585.000 2116.000 131.709 2011.000
coldlaunch.rss 22.507 22.500 22.500 22.700 0.036 22.500
coldlaunch.uss 7.007 7.000 7.000 7.200 0.036 7.000
coldlaunch.pss 10.593 10.600 10.500 10.800 0.051 10.600
Iteration 5
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1722.867 1698.000 1525.000 1973.000 125.239 1960.000
coldlaunch.navigationInteractive 1734.767 1700.000 1526.000 1981.000 125.350 1966.000
coldlaunch.visuallyLoaded 1739.067 1702.000 1531.000 1984.000 125.806 1981.000
coldlaunch.contentInteractive 1741.400 1702.500 1533.000 1986.000 125.979 1981.000
coldlaunch.fullyLoaded 1742.667 1704.500 1538.000 1988.000 125.675 1982.000
coldlaunch.uss 7.030 7.000 7.000 7.100 0.046 7.100
coldlaunch.rss 22.607 22.600 22.600 22.700 0.025 22.700
coldlaunch.pss 10.617 10.600 10.600 10.700 0.037 10.700
Iteration 6
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1691.767 1671.500 1383.000 2060.000 155.359 1974.000
coldlaunch.navigationInteractive 1698.100 1672.000 1384.000 2061.000 154.123 1975.000
coldlaunch.visuallyLoaded 1703.800 1678.000 1385.000 2071.000 155.634 1976.000
coldlaunch.contentInteractive 1705.767 1680.000 1386.000 2072.000 154.722 1977.000
coldlaunch.fullyLoaded 1707.600 1692.500 1386.000 2073.000 154.665 1977.000
coldlaunch.rss 23.017 23.000 22.600 23.100 0.104 23.100
coldlaunch.pss 10.817 10.800 10.400 10.900 0.104 10.900
coldlaunch.uss 7.167 7.150 6.700 7.300 0.122 7.300
Iteration 7
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1710.633 1686.000 1550.000 1955.000 105.230 1934.000
coldlaunch.navigationInteractive 1720.833 1697.500 1551.000 1964.000 105.925 1955.000
coldlaunch.visuallyLoaded 1726.533 1704.500 1574.000 1964.000 104.480 1955.000
coldlaunch.contentInteractive 1728.033 1705.000 1574.000 1965.000 104.564 1956.000
coldlaunch.fullyLoaded 1730.100 1705.500 1579.000 1965.000 103.677 1958.000
coldlaunch.uss 7.070 7.100 6.900 7.200 0.069 7.100
coldlaunch.rss 22.593 22.600 22.400 22.700 0.051 22.700
coldlaunch.pss 10.610 10.600 10.500 10.800 0.060 10.700
Iteration 8
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1723.700 1701.000 1474.000 2016.000 137.532 1982.000
coldlaunch.navigationInteractive 1731.267 1701.500 1475.000 2047.000 139.171 1994.000
coldlaunch.visuallyLoaded 1736.733 1703.000 1500.000 2047.000 137.134 1994.000
coldlaunch.contentInteractive 1737.967 1704.500 1501.000 2049.000 137.047 1995.000
coldlaunch.fullyLoaded 1739.033 1704.500 1505.000 2049.000 136.583 1995.000
coldlaunch.rss 22.443 22.400 22.400 22.700 0.102 22.700
coldlaunch.uss 6.933 6.900 6.900 7.200 0.087 7.200
coldlaunch.pss 10.513 10.500 10.400 10.700 0.081 10.700
Iteration 9
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1689.867 1660.500 1442.000 2139.000 152.015 2017.000
coldlaunch.navigationInteractive 1698.633 1674.500 1443.000 2158.000 155.576 2038.000
coldlaunch.visuallyLoaded 1701.567 1675.500 1446.000 2159.000 154.871 2039.000
coldlaunch.contentInteractive 1703.367 1676.500 1447.000 2160.000 154.874 2039.000
coldlaunch.fullyLoaded 1705.200 1677.000 1448.000 2160.000 155.817 2040.000
coldlaunch.rss 22.587 22.600 22.400 22.700 0.050 22.600
coldlaunch.pss 10.610 10.600 10.500 10.700 0.060 10.700
coldlaunch.uss 7.010 7.000 6.900 7.100 0.060 7.100
Iteration 10
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1779.833 1743.500 1548.000 2103.000 134.615 2042.000
coldlaunch.navigationInteractive 1794.167 1754.000 1574.000 2104.000 132.514 2043.000
coldlaunch.visuallyLoaded 1798.267 1766.500 1574.000 2112.000 132.582 2044.000
coldlaunch.contentInteractive 1801.100 1769.500 1575.000 2112.000 132.028 2044.000
coldlaunch.fullyLoaded 1802.400 1770.000 1576.000 2113.000 131.838 2048.000
coldlaunch.pss 10.613 10.600 10.600 10.700 0.034 10.700
coldlaunch.rss 22.603 22.600 22.600 22.700 0.018 22.600
coldlaunch.uss 7.030 7.000 7.000 7.100 0.046 7.100
fullyLoaded Coefficient of varation: 100 * (std dev / mean)
Iteration 1: 8.70
Iteration 2: 6.48
Iteration 3: 10.07
Iteration 4: 7.43
Iteration 5: 7.21
Iteration 6: 9.05
Iteration 7: 5.99
Iteration 8: 7.85
Iteration 9: 9.13
Iteration 10: 7.31
Average: 7.92
Repeat of ramdisk_1 above.
AWS r3.xlarge ubuntu 14.04
Emulator (NOT emulator-kk)
** Emulator running on a RAMDISK mounted into the docker container **
Cfg: 2048 RAM, 2047 partition (max partition size)
Removed: -skin, -skindir, -camera-back
Added: -wipe-data, -no-skin (rest of settings default)
Added: '-net none -bt hci,null' to end of -qemu $TAIL_ARGS
Cmd: DEBUG=* RUNS=30 APPS='template' RAPTOR_EMULATOR=1 node tests/raptor/emulator_launch_test.js
Iterations: 10 (shutdown and restart emulator and do make raptor before each cmd iteration)
Results direct from console:
Iteration 1
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1855.200 1878.500 1305.000 2290.000 211.586 2221.000
coldlaunch.navigationInteractive 1864.300 1879.000 1306.000 2294.000 210.509 2221.000
coldlaunch.visuallyLoaded 1871.833 1882.000 1331.000 2295.000 208.754 2231.000
coldlaunch.contentInteractive 1875.200 1886.500 1331.000 2295.000 207.052 2232.000
coldlaunch.fullyLoaded 1878.000 1887.000 1333.000 2296.000 207.669 2233.000
coldlaunch.pss 10.627 10.600 10.600 10.700 0.044 10.700
coldlaunch.uss 7.057 7.100 7.000 7.100 0.050 7.100
coldlaunch.rss 22.613 22.600 22.600 22.700 0.034 22.700
Iteration 2
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1808.033 1755.000 1270.000 2110.000 188.457 2089.000
coldlaunch.navigationInteractive 1820.300 1784.500 1271.000 2113.000 190.060 2102.000
coldlaunch.visuallyLoaded 1824.600 1787.500 1275.000 2114.000 189.770 2102.000
coldlaunch.contentInteractive 1825.433 1788.500 1276.000 2114.000 189.850 2103.000
coldlaunch.fullyLoaded 1826.767 1792.000 1276.000 2115.000 190.506 2107.000
coldlaunch.rss 22.620 22.600 22.600 22.700 0.040 22.700
coldlaunch.pss 10.633 10.600 10.600 10.800 0.054 10.700
coldlaunch.uss 7.090 7.100 7.000 7.200 0.047 7.200
Iteration 3
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1692.267 1661.500 1479.000 2072.000 129.187 1967.000
coldlaunch.navigationInteractive 1702.633 1677.000 1499.000 2097.000 130.995 1968.000
coldlaunch.visuallyLoaded 1705.833 1677.500 1500.000 2097.000 129.903 1969.000
coldlaunch.contentInteractive 1707.533 1679.500 1507.000 2099.000 129.319 1969.000
coldlaunch.fullyLoaded 1708.467 1680.500 1507.000 2099.000 129.060 1970.000
coldlaunch.uss 7.003 7.000 6.900 7.300 0.075 7.100
coldlaunch.rss 22.590 22.600 22.400 22.800 0.065 22.700
coldlaunch.pss 10.603 10.600 10.500 10.900 0.075 10.700
Iteration 4
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1675.767 1631.000 1532.000 2008.000 116.412 1928.000
coldlaunch.navigationInteractive 1681.667 1641.500 1532.000 2009.000 116.002 1942.000
coldlaunch.visuallyLoaded 1686.100 1645.500 1534.000 2024.000 117.847 1943.000
coldlaunch.contentInteractive 1687.767 1646.000 1534.000 2025.000 118.291 1947.000
coldlaunch.fullyLoaded 1688.900 1647.000 1535.000 2026.000 118.603 1948.000
coldlaunch.rss 23.000 23.000 23.000 23.000 0.000 23.000
coldlaunch.pss 10.257 10.300 10.200 10.300 0.050 10.300
coldlaunch.uss 5.900 5.900 5.900 5.900 0.000 5.900
Iteration 5
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1689.167 1653.500 1512.000 2078.000 123.995 1905.000
coldlaunch.navigationInteractive 1697.033 1662.500 1515.000 2079.000 126.659 1913.000
coldlaunch.visuallyLoaded 1699.600 1664.500 1517.000 2091.000 126.788 1913.000
coldlaunch.contentInteractive 1701.833 1665.500 1517.000 2091.000 126.793 1914.000
coldlaunch.fullyLoaded 1703.267 1666.000 1518.000 2092.000 126.915 1915.000
coldlaunch.uss 7.123 7.100 6.700 7.300 0.105 7.300
coldlaunch.rss 23.000 23.000 22.600 23.100 0.082 23.100
coldlaunch.pss 10.800 10.800 10.400 10.900 0.082 10.900
Iteration 6
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1920.267 1929.500 1301.000 2196.000 185.942 2173.000
coldlaunch.navigationInteractive 1932.100 1944.500 1310.000 2197.000 184.276 2173.000
coldlaunch.visuallyLoaded 1934.833 1951.000 1311.000 2199.000 184.707 2176.000
coldlaunch.contentInteractive 1936.533 1952.000 1311.000 2199.000 184.705 2179.000
coldlaunch.fullyLoaded 1938.533 1955.500 1311.000 2200.000 184.374 2179.000
coldlaunch.rss 22.667 22.700 22.600 22.800 0.060 22.800
coldlaunch.pss 10.720 10.700 10.700 10.800 0.040 10.800
coldlaunch.uss 7.137 7.100 7.100 7.200 0.048 7.200
Iteration 7
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1704.167 1683.500 1380.000 2028.000 144.838 1986.000
coldlaunch.navigationInteractive 1715.833 1697.500 1399.000 2038.000 146.242 1989.000
coldlaunch.visuallyLoaded 1718.467 1701.000 1399.000 2039.000 147.121 2002.000
coldlaunch.contentInteractive 1719.800 1702.000 1400.000 2040.000 147.361 2005.000
coldlaunch.fullyLoaded 1721.300 1703.000 1400.000 2040.000 147.296 2006.000
coldlaunch.pss 10.603 10.600 10.500 10.700 0.048 10.700
coldlaunch.uss 7.000 7.000 6.900 7.100 0.052 7.100
coldlaunch.rss 22.590 22.600 22.400 22.700 0.060 22.700
Iteration 8
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1743.867 1713.000 1492.000 2208.000 140.689 1953.000
coldlaunch.navigationInteractive 1757.400 1718.000 1497.000 2218.000 142.400 1959.000
coldlaunch.visuallyLoaded 1759.167 1720.000 1498.000 2219.000 142.667 1963.000
coldlaunch.contentInteractive 1760.600 1720.500 1498.000 2219.000 142.999 1968.000
coldlaunch.fullyLoaded 1761.933 1721.000 1499.000 2220.000 143.159 1969.000
coldlaunch.uss 7.050 7.050 7.000 7.100 0.050 7.100
coldlaunch.rss 22.607 22.600 22.600 22.700 0.025 22.700
coldlaunch.pss 10.633 10.600 10.600 10.700 0.047 10.700
Iteration 9
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1685.933 1655.000 1287.000 2027.000 140.279 1905.000
coldlaunch.navigationInteractive 1704.300 1663.000 1295.000 2063.000 142.642 1906.000
coldlaunch.visuallyLoaded 1706.267 1666.000 1295.000 2064.000 143.118 1910.000
coldlaunch.contentInteractive 1709.333 1668.500 1296.000 2065.000 144.318 1940.000
coldlaunch.fullyLoaded 1712.100 1672.500 1296.000 2066.000 143.245 1941.000
coldlaunch.rss 22.587 22.600 22.400 22.700 0.050 22.600
coldlaunch.uss 7.000 7.000 6.900 7.100 0.052 7.100
coldlaunch.pss 10.597 10.600 10.500 10.700 0.048 10.700
Iteration 10
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1753.967 1706.500 1473.000 2075.000 181.511 2066.000
coldlaunch.navigationInteractive 1762.433 1707.500 1474.000 2086.000 181.818 2070.000
coldlaunch.visuallyLoaded 1768.333 1710.000 1475.000 2086.000 180.832 2071.000
coldlaunch.contentInteractive 1769.833 1711.000 1475.000 2090.000 180.720 2072.000
coldlaunch.fullyLoaded 1770.600 1712.000 1476.000 2091.000 180.702 2073.000
coldlaunch.rss 22.623 22.600 22.600 22.700 0.042 22.700
coldlaunch.pss 10.637 10.600 10.600 10.700 0.048 10.700
coldlaunch.uss 7.040 7.000 7.000 7.100 0.049 7.100
fullyLoaded Coefficient of varation: 100 * (std dev / mean)
Iteration 1: 11.42
Iteration 2: 10.42
Iteration 3: 7.55
Iteration 4: 7.02
Iteration 5: 7.45
Iteration 6: 9.54
Iteration 7: 8.55
Iteration 8: 8.12
Iteration 9: 8.36
Iteration 10: 10.20
Average: 8.86
Repeat of ramdisk_2 above except on a different AWS intance type.
AWS c4.2xlarge ubuntu 14.04
Emulator (NOT emulator-kk)
** Emulator running on a 1024MB RAMDISK mounted into the docker container **
Cfg: 2048 RAM, 2047 partition (max partition size)
Removed: -skin, -skindir, -camera-back
Added: -wipe-data, -no-skin (rest of settings default)
Added: '-net none -bt hci,null' to end of -qemu $TAIL_ARGS
Added: -cache-size 2048
Cmd: DEBUG=* RUNS=30 APPS='template' RAPTOR_EMULATOR=1 node tests/raptor/emulator_launch_test.js
Iterations: 10 (shutdown and restart emulator and do make raptor before each cmd iteration)
Results direct from console:
Iteration 1
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------ --------
coldlaunch.navigationLoaded 1170.400 1180.500 1036.000 1371.000 87.786 1317.000
coldlaunch.navigationInteractive 1177.767 1187.500 1037.000 1372.000 90.150 1329.000
coldlaunch.visuallyLoaded 1181.800 1193.500 1038.000 1380.000 90.502 1329.000
coldlaunch.contentInteractive 1182.733 1194.000 1038.000 1380.000 90.358 1330.000
coldlaunch.fullyLoaded 1183.367 1194.500 1038.000 1380.000 90.050 1330.000
coldlaunch.pss 11.000 11.000 11.000 11.000 0.000 11.000
coldlaunch.rss 23.200 23.200 23.200 23.200 0.000 23.200
coldlaunch.uss 7.300 7.300 7.300 7.300 0.000 7.300
Iteration 2
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- ------- -------- ------- --------
coldlaunch.navigationLoaded 1177.367 1201.500 914.000 1417.000 112.899 1367.000
coldlaunch.navigationInteractive 1187.033 1217.500 959.000 1417.000 108.965 1386.000
coldlaunch.visuallyLoaded 1189.833 1218.500 959.000 1419.000 108.564 1386.000
coldlaunch.contentInteractive 1191.733 1228.000 960.000 1423.000 109.055 1387.000
coldlaunch.fullyLoaded 1192.800 1228.000 961.000 1424.000 109.484 1387.000
coldlaunch.pss 10.907 10.900 10.900 11.000 0.025 11.000
coldlaunch.uss 7.300 7.300 7.300 7.300 0.000 7.300
coldlaunch.rss 23.200 23.200 23.200 23.200 0.000 23.200
Iteration 3
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------ --------
coldlaunch.navigationLoaded 1212.167 1205.500 1083.000 1420.000 96.505 1410.000
coldlaunch.navigationInteractive 1217.900 1206.000 1083.000 1420.000 96.114 1411.000
coldlaunch.visuallyLoaded 1220.000 1213.500 1085.000 1421.000 96.432 1412.000
coldlaunch.contentInteractive 1221.667 1214.500 1085.000 1421.000 95.366 1412.000
coldlaunch.fullyLoaded 1223.133 1215.000 1085.000 1422.000 95.415 1413.000
coldlaunch.uss 7.003 7.000 7.000 7.100 0.018 7.000
coldlaunch.pss 10.603 10.600 10.600 10.700 0.018 10.600
coldlaunch.rss 22.697 22.700 22.600 22.700 0.018 22.700
Iteration 4
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- ------- -------- ------- --------
coldlaunch.navigationLoaded 1172.367 1153.500 992.000 1353.000 99.587 1334.000
coldlaunch.navigationInteractive 1180.733 1162.000 995.000 1379.000 102.806 1347.000
coldlaunch.visuallyLoaded 1182.467 1163.000 998.000 1379.000 102.787 1348.000
coldlaunch.contentInteractive 1183.900 1163.500 999.000 1380.000 102.511 1348.000
coldlaunch.fullyLoaded 1184.667 1166.000 999.000 1380.000 102.486 1349.000
coldlaunch.pss 10.700 10.700 10.700 10.700 0.000 10.700
coldlaunch.rss 22.700 22.700 22.700 22.700 0.000 22.700
coldlaunch.uss 7.100 7.100 7.100 7.100 0.000 7.100
Iteration 5
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------ --------
coldlaunch.navigationLoaded 1151.700 1142.000 1021.000 1384.000 81.512 1318.000
coldlaunch.navigationInteractive 1161.267 1142.500 1045.000 1385.000 81.127 1336.000
coldlaunch.visuallyLoaded 1163.667 1146.500 1045.000 1386.000 80.383 1336.000
coldlaunch.contentInteractive 1165.433 1147.000 1059.000 1386.000 79.759 1338.000
coldlaunch.fullyLoaded 1166.433 1147.500 1061.000 1387.000 79.977 1339.000
coldlaunch.uss 7.343 7.300 7.300 7.400 0.050 7.400
coldlaunch.pss 11.000 11.000 11.000 11.000 0.000 11.000
coldlaunch.rss 23.200 23.200 23.200 23.200 0.000 23.200
Iteration 6
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1160.433 1123.500 1012.000 1482.000 114.807 1441.000
coldlaunch.navigationInteractive 1170.467 1125.000 1024.000 1496.000 118.279 1466.000
coldlaunch.visuallyLoaded 1174.633 1134.000 1025.000 1514.000 118.541 1467.000
coldlaunch.contentInteractive 1176.000 1134.500 1032.000 1514.000 118.351 1467.000
coldlaunch.fullyLoaded 1176.933 1135.000 1032.000 1515.000 118.072 1468.000
coldlaunch.rss 23.200 23.200 23.200 23.200 0.000 23.200
coldlaunch.pss 10.907 10.900 10.900 11.000 0.025 11.000
coldlaunch.uss 7.300 7.300 7.300 7.300 0.000 7.300
Iteration 7
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1238.733 1201.000 1072.000 1599.000 131.761 1469.000
coldlaunch.navigationInteractive 1246.700 1207.500 1074.000 1612.000 132.033 1470.000
coldlaunch.visuallyLoaded 1251.633 1210.500 1084.000 1612.000 133.764 1496.000
coldlaunch.contentInteractive 1253.567 1217.000 1084.000 1615.000 133.719 1496.000
coldlaunch.fullyLoaded 1254.767 1219.000 1084.000 1616.000 133.915 1501.000
coldlaunch.uss 7.100 7.100 7.100 7.100 0.000 7.100
coldlaunch.pss 10.700 10.700 10.700 10.700 0.000 10.700
coldlaunch.rss 22.700 22.700 22.700 22.700 0.000 22.700
Iteration 8
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------ --------
coldlaunch.navigationLoaded 1168.433 1150.500 1052.000 1393.000 96.213 1347.000
coldlaunch.navigationInteractive 1178.200 1161.500 1060.000 1408.000 98.147 1361.000
coldlaunch.visuallyLoaded 1181.467 1162.000 1065.000 1409.000 97.374 1361.000
coldlaunch.contentInteractive 1183.400 1162.500 1072.000 1410.000 97.238 1368.000
coldlaunch.fullyLoaded 1184.133 1166.500 1072.000 1410.000 97.081 1368.000
coldlaunch.rss 23.100 23.100 23.100 23.100 0.000 23.100
coldlaunch.uss 7.200 7.200 7.200 7.200 0.000 7.200
coldlaunch.pss 10.893 10.900 10.800 10.900 0.025 10.900
Iteration 9
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------ --------
coldlaunch.navigationLoaded 1144.100 1139.000 1022.000 1285.000 74.823 1275.000
coldlaunch.navigationInteractive 1153.933 1149.000 1033.000 1286.000 75.017 1276.000
coldlaunch.visuallyLoaded 1156.600 1149.500 1033.000 1287.000 74.453 1284.000
coldlaunch.contentInteractive 1158.167 1152.500 1034.000 1287.000 73.864 1284.000
coldlaunch.fullyLoaded 1158.933 1154.500 1034.000 1287.000 73.738 1284.000
coldlaunch.uss 7.300 7.300 7.300 7.300 0.000 7.300
coldlaunch.rss 23.197 23.200 23.100 23.200 0.018 23.200
coldlaunch.pss 10.900 10.900 10.900 10.900 0.000 10.900
Iteration 10
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- ------- -------- ------- --------
coldlaunch.navigationLoaded 1164.967 1149.500 946.000 1371.000 107.602 1360.000
coldlaunch.navigationInteractive 1175.900 1150.500 947.000 1377.000 105.546 1371.000
coldlaunch.visuallyLoaded 1178.600 1155.500 965.000 1378.000 105.126 1375.000
coldlaunch.contentInteractive 1180.100 1156.000 966.000 1385.000 105.535 1378.000
coldlaunch.fullyLoaded 1180.800 1156.500 966.000 1385.000 105.564 1379.000
coldlaunch.pss 10.980 11.000 10.700 11.000 0.065 11.000
coldlaunch.rss 23.183 23.200 22.900 23.200 0.058 23.200
coldlaunch.uss 7.283 7.300 7.000 7.300 0.058 7.300
fullyLoaded Coefficient of varation: 100 * (std dev / mean)
Iteration 1: 7.60
Iteration 2: 9.17
Iteration 3: 7.80
Iteration 4: 8.65
Iteration 5: 6.85
Iteration 6: 10.03
Iteration 7: 10.67
Iteration 8: 8.19
Iteration 9: 6.36
Iteration 10: 8.94
Average: 8.42
Another run on the c4.2xlarge.
AWS c4.2xlarge ubuntu 14.04
Emulator (NOT emulator-kk)
** Emulator running on a 1024MB RAMDISK mounted into the docker container **
Cfg: 2048 RAM, 2047 partition (max partition size)
Removed: -skin, -skindir, -camera-back
Added: -wipe-data, -no-skin (rest of settings default)
Added: '-net none -bt hci,null' to end of -qemu $TAIL_ARGS
Added: -cache-size 2048
Cmd: DEBUG=* RUNS=30 APPS='template' RAPTOR_EMULATOR=1 node tests/raptor/emulator_launch_test.js
Iterations: 10 (shutdown and restart emulator and do make raptor before each cmd iteration)
Results direct from console:
Iteration 1
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1241.967 1208.000 1058.000 1669.000 148.499 1589.000
coldlaunch.navigationInteractive 1249.467 1210.000 1059.000 1670.000 149.924 1615.000
coldlaunch.visuallyLoaded 1255.167 1212.000 1065.000 1680.000 149.772 1615.000
coldlaunch.contentInteractive 1255.933 1212.500 1065.000 1680.000 149.708 1616.000
coldlaunch.fullyLoaded 1258.267 1212.500 1066.000 1699.000 152.278 1616.000
coldlaunch.pss 10.793 10.800 10.200 11.000 0.177 11.000
coldlaunch.uss 7.100 7.100 6.500 7.400 0.183 7.300
coldlaunch.rss 23.000 23.000 22.400 23.200 0.167 23.200
Iteration 2
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1172.400 1136.500 1003.000 1389.000 110.448 1387.000
coldlaunch.navigationInteractive 1179.100 1136.500 1028.000 1404.000 110.530 1389.000
coldlaunch.visuallyLoaded 1181.667 1143.000 1028.000 1404.000 110.502 1390.000
coldlaunch.contentInteractive 1183.433 1143.500 1029.000 1405.000 110.843 1391.000
coldlaunch.fullyLoaded 1184.733 1144.500 1029.000 1405.000 111.656 1391.000
coldlaunch.rss 23.100 23.100 23.100 23.100 0.000 23.100
coldlaunch.uss 7.200 7.200 7.200 7.200 0.000 7.200
coldlaunch.pss 10.900 10.900 10.900 10.900 0.000 10.900
Iteration 3
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1186.667 1177.500 1020.000 1455.000 113.903 1419.000
coldlaunch.navigationInteractive 1195.633 1181.500 1035.000 1462.000 113.772 1425.000
coldlaunch.visuallyLoaded 1199.400 1187.500 1035.000 1462.000 112.171 1425.000
coldlaunch.contentInteractive 1200.933 1190.500 1043.000 1463.000 112.332 1432.000
coldlaunch.fullyLoaded 1202.033 1191.000 1048.000 1463.000 111.791 1432.000
coldlaunch.pss 10.897 10.900 10.700 11.000 0.060 11.000
coldlaunch.uss 7.237 7.200 7.100 7.300 0.060 7.300
coldlaunch.rss 23.103 23.100 23.000 23.200 0.041 23.200
Iteration 4
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1231.300 1202.500 1054.000 1568.000 128.596 1501.000
coldlaunch.navigationInteractive 1242.200 1203.500 1092.000 1591.000 127.792 1522.000
coldlaunch.visuallyLoaded 1245.333 1210.000 1093.000 1591.000 128.932 1523.000
coldlaunch.contentInteractive 1246.100 1210.000 1094.000 1592.000 128.735 1523.000
coldlaunch.fullyLoaded 1246.933 1211.000 1094.000 1593.000 128.919 1524.000
coldlaunch.rss 22.613 22.600 22.600 22.800 0.050 22.800
coldlaunch.pss 10.613 10.600 10.600 10.800 0.050 10.800
coldlaunch.uss 7.013 7.000 7.000 7.200 0.050 7.200
Iteration 5
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------ --------
coldlaunch.navigationLoaded 1195.933 1207.000 1031.000 1370.000 84.273 1367.000
coldlaunch.navigationInteractive 1207.800 1214.500 1075.000 1403.000 83.661 1377.000
coldlaunch.visuallyLoaded 1210.567 1221.500 1075.000 1404.000 84.402 1377.000
coldlaunch.contentInteractive 1212.600 1223.000 1076.000 1405.000 84.882 1378.000
coldlaunch.fullyLoaded 1214.033 1223.000 1076.000 1405.000 84.752 1379.000
coldlaunch.uss 7.193 7.200 7.100 7.200 0.025 7.200
coldlaunch.rss 22.800 22.800 22.800 22.800 0.000 22.800
coldlaunch.pss 10.793 10.800 10.700 10.800 0.025 10.800
Iteration 6
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- ------- -------- ------- --------
coldlaunch.navigationLoaded 1163.567 1126.500 967.000 1379.000 112.269 1346.000
coldlaunch.navigationInteractive 1174.567 1131.000 967.000 1401.000 110.585 1346.000
coldlaunch.visuallyLoaded 1177.467 1134.000 968.000 1402.000 111.131 1359.000
coldlaunch.contentInteractive 1179.333 1134.000 968.000 1403.000 111.423 1360.000
coldlaunch.fullyLoaded 1180.167 1135.000 969.000 1404.000 111.471 1361.000
coldlaunch.uss 7.050 7.050 7.000 7.100 0.050 7.100
coldlaunch.pss 10.600 10.600 10.600 10.600 0.000 10.600
coldlaunch.rss 22.700 22.700 22.700 22.700 0.000 22.700
Iteration 7
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1204.767 1200.500 1067.000 1433.000 115.131 1406.000
coldlaunch.navigationInteractive 1213.900 1211.500 1075.000 1433.000 111.858 1407.000
coldlaunch.visuallyLoaded 1217.167 1220.000 1076.000 1441.000 112.353 1408.000
coldlaunch.contentInteractive 1218.900 1220.500 1076.000 1441.000 112.200 1408.000
coldlaunch.fullyLoaded 1220.733 1221.500 1076.000 1470.000 114.269 1415.000
coldlaunch.uss 6.900 6.900 6.900 6.900 0.000 6.900
coldlaunch.rss 22.500 22.500 22.500 22.500 0.000 22.500
coldlaunch.pss 10.500 10.500 10.500 10.500 0.000 10.500
Iteration 8
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- ------- -------- ------- --------
coldlaunch.navigationLoaded 1173.967 1171.000 962.000 1387.000 100.663 1361.000
coldlaunch.navigationInteractive 1184.333 1184.500 966.000 1399.000 102.417 1365.000
coldlaunch.visuallyLoaded 1187.467 1188.500 978.000 1399.000 101.375 1366.000
coldlaunch.contentInteractive 1189.367 1189.500 978.000 1400.000 101.286 1366.000
coldlaunch.fullyLoaded 1189.933 1190.000 979.000 1400.000 101.098 1366.000
coldlaunch.uss 7.270 7.300 7.200 7.300 0.046 7.300
coldlaunch.pss 10.907 10.900 10.900 11.000 0.025 11.000
coldlaunch.rss 23.170 23.200 23.100 23.200 0.046 23.200
Iteration 9
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- ------- -------- ------ --------
coldlaunch.navigationLoaded 1107.133 1106.500 885.000 1260.000 96.843 1234.000
coldlaunch.navigationInteractive 1117.300 1131.000 888.000 1263.000 98.450 1261.000
coldlaunch.visuallyLoaded 1121.133 1131.500 889.000 1266.000 97.670 1261.000
coldlaunch.contentInteractive 1123.233 1132.500 890.000 1267.000 96.500 1262.000
coldlaunch.fullyLoaded 1124.567 1133.000 890.000 1267.000 96.871 1262.000
coldlaunch.rss 22.717 22.700 22.700 22.800 0.037 22.800
coldlaunch.uss 7.100 7.100 7.100 7.100 0.000 7.100
coldlaunch.pss 10.700 10.700 10.700 10.700 0.000 10.700
Iteration 10
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------ --------
coldlaunch.navigationLoaded 1190.800 1181.500 1031.000 1372.000 92.546 1334.000
coldlaunch.navigationInteractive 1196.833 1192.500 1036.000 1396.000 95.700 1336.000
coldlaunch.visuallyLoaded 1201.533 1197.000 1041.000 1397.000 94.956 1338.000
coldlaunch.contentInteractive 1202.667 1198.500 1042.000 1399.000 95.197 1339.000
coldlaunch.fullyLoaded 1203.167 1199.000 1042.000 1399.000 95.141 1339.000
coldlaunch.pss 11.000 11.000 11.000 11.000 0.000 11.000
coldlaunch.uss 7.337 7.300 7.300 7.400 0.048 7.400
coldlaunch.rss 23.200 23.200 23.200 23.200 0.000 23.200
fullyLoaded Coefficient of varation: 100 * (std dev / mean)
Iteration 1: 12.10
Iteration 2: 9.42
Iteration 3: 9.30
Iteration 4: 10.33
Iteration 5: 6.98
Iteration 6: 9.44
Iteration 7: 9.36
Iteration 8: 8.49
Iteration 9: 8.61
Iteration 10: 7.69
Average: 9.17
Another run on the c4.2xlarge.
AWS c4.2xlarge ubuntu 14.04
Emulator (NOT emulator-kk)
** Emulator running on a 1024MB RAMDISK mounted into the docker container **
Cfg: 2048 RAM, 2047 partition (max partition size)
Removed: -skin, -skindir, -camera-back
Added: -wipe-data, -no-skin (rest of settings default)
Added: '-net none -bt hci,null' to end of -qemu $TAIL_ARGS
Added: -cache-size 2048
Cmd: DEBUG=* RUNS=30 APPS='template' RAPTOR_EMULATOR=1 node tests/raptor/emulator_launch_test.js
Iterations: 10 (shutdown and restart emulator and do make raptor before each cmd iteration)
Results direct from console:
Iteration 1
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------ --------
coldlaunch.navigationLoaded 1170.367 1160.000 1030.000 1375.000 89.404 1331.000
coldlaunch.navigationInteractive 1179.300 1167.500 1031.000 1376.000 90.841 1362.000
coldlaunch.visuallyLoaded 1183.867 1171.500 1032.000 1398.000 90.898 1363.000
coldlaunch.contentInteractive 1184.900 1172.000 1032.000 1398.000 91.056 1367.000
coldlaunch.fullyLoaded 1185.633 1172.500 1032.000 1399.000 91.300 1370.000
coldlaunch.uss 7.187 7.200 7.100 7.200 0.034 7.200
coldlaunch.pss 10.787 10.800 10.700 10.800 0.034 10.800
coldlaunch.rss 22.803 22.800 22.800 22.900 0.018 22.800
Iteration 2
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1253.167 1266.000 1004.000 1435.000 102.773 1422.000
coldlaunch.navigationInteractive 1263.800 1276.500 1038.000 1457.000 101.463 1435.000
coldlaunch.visuallyLoaded 1266.333 1277.500 1038.000 1457.000 101.779 1441.000
coldlaunch.contentInteractive 1267.767 1279.000 1039.000 1458.000 101.789 1446.000
coldlaunch.fullyLoaded 1268.667 1279.500 1039.000 1459.000 101.988 1447.000
coldlaunch.uss 5.800 5.800 5.800 5.800 0.000 5.800
coldlaunch.rss 22.600 22.600 22.600 22.600 0.000 22.600
coldlaunch.pss 10.090 10.100 10.000 10.100 0.030 10.100
Iteration 3
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------ --------
coldlaunch.navigationLoaded 1214.000 1217.500 1026.000 1406.000 95.348 1374.000
coldlaunch.navigationInteractive 1222.500 1220.000 1027.000 1416.000 96.071 1374.000
coldlaunch.visuallyLoaded 1225.700 1222.500 1035.000 1417.000 95.013 1375.000
coldlaunch.contentInteractive 1226.767 1224.500 1035.000 1425.000 95.580 1376.000
coldlaunch.fullyLoaded 1228.067 1228.500 1037.000 1425.000 95.150 1376.000
coldlaunch.uss 7.100 7.100 7.100 7.100 0.000 7.100
coldlaunch.pss 10.700 10.700 10.700 10.700 0.000 10.700
coldlaunch.rss 22.700 22.700 22.700 22.700 0.000 22.700
Iteration 4
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- ------- -------- ------ --------
coldlaunch.navigationLoaded 1188.800 1181.500 957.000 1408.000 94.273 1347.000
coldlaunch.navigationInteractive 1200.467 1187.500 958.000 1409.000 95.268 1359.000
coldlaunch.visuallyLoaded 1203.267 1191.000 966.000 1409.000 94.045 1359.000
coldlaunch.contentInteractive 1205.433 1191.000 967.000 1410.000 94.686 1366.000
coldlaunch.fullyLoaded 1206.500 1191.500 969.000 1410.000 94.349 1366.000
coldlaunch.rss 22.657 22.700 22.600 22.700 0.050 22.700
coldlaunch.pss 10.657 10.700 10.600 10.700 0.050 10.700
coldlaunch.uss 7.057 7.100 7.000 7.100 0.050 7.100
Iteration 5
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1168.600 1174.000 1001.000 1375.000 105.252 1321.000
coldlaunch.navigationInteractive 1176.900 1177.500 1022.000 1401.000 107.842 1346.000
coldlaunch.visuallyLoaded 1179.667 1179.500 1023.000 1403.000 108.778 1347.000
coldlaunch.contentInteractive 1180.933 1181.000 1023.000 1403.000 108.980 1347.000
coldlaunch.fullyLoaded 1181.900 1182.000 1026.000 1404.000 108.928 1348.000
coldlaunch.pss 10.900 10.900 10.900 10.900 0.000 10.900
coldlaunch.rss 23.123 23.100 23.100 23.200 0.042 23.200
coldlaunch.uss 7.250 7.250 7.200 7.300 0.050 7.300
Iteration 6
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1192.567 1184.500 1001.000 1427.000 108.915 1382.000
coldlaunch.navigationInteractive 1204.767 1203.500 1012.000 1444.000 107.501 1399.000
coldlaunch.visuallyLoaded 1207.200 1204.000 1012.000 1444.000 108.858 1399.000
coldlaunch.contentInteractive 1209.400 1204.500 1013.000 1451.000 109.209 1400.000
coldlaunch.fullyLoaded 1210.967 1204.500 1013.000 1452.000 108.246 1400.000
coldlaunch.uss 7.013 7.000 7.000 7.200 0.050 7.200
coldlaunch.pss 10.613 10.600 10.600 10.800 0.050 10.800
coldlaunch.rss 22.613 22.600 22.600 22.800 0.050 22.800
Iteration 7
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1190.667 1176.000 1029.000 1469.000 101.841 1355.000
coldlaunch.navigationInteractive 1202.300 1186.500 1030.000 1470.000 100.682 1363.000
coldlaunch.visuallyLoaded 1205.667 1187.500 1037.000 1476.000 100.110 1363.000
coldlaunch.contentInteractive 1207.567 1188.000 1037.000 1476.000 100.358 1364.000
coldlaunch.fullyLoaded 1208.567 1188.500 1037.000 1477.000 100.448 1368.000
coldlaunch.rss 22.503 22.500 22.400 22.700 0.041 22.500
coldlaunch.pss 10.477 10.500 10.400 10.600 0.050 10.500
coldlaunch.uss 6.907 6.900 6.900 7.100 0.036 6.900
Iteration 8
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1258.300 1269.000 1086.000 1446.000 109.903 1435.000
coldlaunch.navigationInteractive 1270.433 1279.500 1092.000 1461.000 111.517 1446.000
coldlaunch.visuallyLoaded 1273.333 1284.000 1100.000 1461.000 110.817 1450.000
coldlaunch.contentInteractive 1274.667 1287.000 1101.000 1462.000 111.174 1451.000
coldlaunch.fullyLoaded 1275.900 1287.500 1101.000 1463.000 110.913 1451.000
coldlaunch.uss 7.280 7.300 7.000 7.300 0.060 7.300
coldlaunch.pss 10.973 11.000 10.700 11.000 0.073 11.000
coldlaunch.rss 23.180 23.200 22.900 23.200 0.060 23.200
Iteration 9
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- ------- -------- ------- --------
coldlaunch.navigationLoaded 1200.367 1211.500 965.000 1433.000 112.024 1414.000
coldlaunch.navigationInteractive 1210.600 1219.000 966.000 1434.000 114.013 1433.000
coldlaunch.visuallyLoaded 1212.267 1220.000 972.000 1443.000 114.029 1434.000
coldlaunch.contentInteractive 1213.300 1220.500 972.000 1444.000 114.134 1435.000
coldlaunch.fullyLoaded 1213.900 1220.500 973.000 1445.000 113.969 1436.000
coldlaunch.rss 22.703 22.700 22.700 22.800 0.018 22.700
coldlaunch.uss 7.103 7.100 7.100 7.200 0.018 7.100
coldlaunch.pss 10.703 10.700 10.700 10.800 0.018 10.700
Iteration 10
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1195.767 1216.500 1048.000 1456.000 101.133 1363.000
coldlaunch.navigationInteractive 1203.167 1219.000 1049.000 1465.000 102.464 1363.000
coldlaunch.visuallyLoaded 1207.233 1227.500 1054.000 1466.000 102.110 1364.000
coldlaunch.contentInteractive 1208.600 1229.500 1055.000 1466.000 102.348 1365.000
coldlaunch.fullyLoaded 1209.467 1231.000 1055.000 1467.000 102.347 1365.000
coldlaunch.pss 10.803 10.800 10.800 10.900 0.018 10.800
coldlaunch.rss 23.003 23.000 23.000 23.100 0.018 23.000
coldlaunch.uss 7.103 7.100 7.100 7.200 0.018 7.100
fullyLoaded Coefficient of varation: 100 * (std dev / mean)
Iteration 1: 7.70
Iteration 2: 8.03
Iteration 3: 7.74
Iteration 4: 7.82
Iteration 5: 9.21
Iteration 6: 8.93
Iteration 7: 8.31
Iteration 8: 8.69
Iteration 9: 9.38
Iteration 10: 8.46
Average: 8.42
Another run on the c4.2xlarge.
AWS c4.2xlarge ubuntu 14.04
Emulator (NOT emulator-kk)
** Emulator running on a 1024MB RAMDISK mounted into the docker container **
Cfg: 2048 RAM, 2047 partition (max partition size)
Removed: -skin, -skindir, -camera-back
Added: -wipe-data, -no-skin (rest of settings default)
Added: '-net none -bt hci,null' to end of -qemu $TAIL_ARGS
Added: -cache-size 2048
Cmd: DEBUG=* RUNS=30 APPS='template' RAPTOR_EMULATOR=1 node tests/raptor/emulator_launch_test.js
Iterations: 10 (shutdown and restart emulator and do make raptor before each cmd iteration)
Results direct from console:
Iteration 1
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- ------- -------- ------- --------
coldlaunch.navigationLoaded 1139.833 1127.500 904.000 1393.000 120.567 1369.000
coldlaunch.navigationInteractive 1146.600 1137.500 905.000 1393.000 122.943 1371.000
coldlaunch.visuallyLoaded 1149.967 1142.000 913.000 1394.000 122.507 1377.000
coldlaunch.contentInteractive 1150.933 1144.500 913.000 1394.000 122.461 1378.000
coldlaunch.fullyLoaded 1153.100 1148.500 917.000 1395.000 121.693 1384.000
coldlaunch.pss 10.907 10.900 10.900 11.000 0.025 11.000
coldlaunch.uss 7.253 7.300 7.200 7.300 0.050 7.300
coldlaunch.rss 23.107 23.100 23.100 23.200 0.025 23.200
Iteration 2
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------ --------
coldlaunch.navigationLoaded 1172.100 1158.000 1037.000 1440.000 88.277 1300.000
coldlaunch.navigationInteractive 1185.533 1179.500 1037.000 1455.000 86.602 1301.000
coldlaunch.visuallyLoaded 1187.933 1186.500 1040.000 1456.000 86.178 1308.000
coldlaunch.contentInteractive 1189.033 1187.500 1041.000 1456.000 86.361 1308.000
coldlaunch.fullyLoaded 1190.733 1187.500 1041.000 1457.000 87.176 1309.000
coldlaunch.uss 6.907 6.900 6.900 7.100 0.036 6.900
coldlaunch.pss 10.507 10.500 10.500 10.700 0.036 10.500
coldlaunch.rss 22.507 22.500 22.500 22.700 0.036 22.500
Iteration 3
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1181.400 1200.500 1022.000 1440.000 115.306 1438.000
coldlaunch.navigationInteractive 1190.333 1200.500 1032.000 1465.000 113.155 1441.000
coldlaunch.visuallyLoaded 1194.167 1207.500 1038.000 1465.000 111.578 1441.000
coldlaunch.contentInteractive 1195.433 1208.000 1039.000 1469.000 111.635 1442.000
coldlaunch.fullyLoaded 1196.000 1208.500 1039.000 1469.000 111.311 1442.000
coldlaunch.rss 23.200 23.200 23.200 23.200 0.000 23.200
coldlaunch.pss 10.900 10.900 10.900 10.900 0.000 10.900
coldlaunch.uss 7.300 7.300 7.300 7.300 0.000 7.300
Iteration 4
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1200.533 1175.500 1040.000 1424.000 113.821 1412.000
coldlaunch.navigationInteractive 1208.967 1192.500 1050.000 1424.000 112.747 1424.000
coldlaunch.visuallyLoaded 1212.433 1193.000 1051.000 1432.000 113.215 1425.000
coldlaunch.contentInteractive 1214.267 1198.500 1051.000 1432.000 112.640 1427.000
coldlaunch.fullyLoaded 1215.300 1199.500 1052.000 1433.000 112.127 1427.000
coldlaunch.pss 10.803 10.800 10.700 11.000 0.041 10.800
coldlaunch.rss 23.003 23.000 22.900 23.200 0.041 23.000
coldlaunch.uss 7.110 7.100 7.100 7.400 0.054 7.100
Iteration 5
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- ------- -------- ------- --------
coldlaunch.navigationLoaded 1186.367 1197.000 950.000 1411.000 106.888 1352.000
coldlaunch.navigationInteractive 1193.000 1205.500 959.000 1412.000 108.060 1367.000
coldlaunch.visuallyLoaded 1196.567 1210.000 960.000 1431.000 110.004 1368.000
coldlaunch.contentInteractive 1197.567 1211.000 960.000 1431.000 109.913 1369.000
coldlaunch.fullyLoaded 1200.133 1211.500 971.000 1437.000 110.013 1370.000
coldlaunch.pss 10.480 10.500 10.400 10.500 0.040 10.500
coldlaunch.rss 22.497 22.500 22.400 22.500 0.018 22.500
coldlaunch.uss 6.893 6.900 6.800 6.900 0.025 6.900
Iteration 6
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- ------- -------- ------- --------
coldlaunch.navigationLoaded 1155.133 1157.500 952.000 1477.000 105.555 1295.000
coldlaunch.navigationInteractive 1162.167 1159.500 977.000 1477.000 105.414 1297.000
coldlaunch.visuallyLoaded 1166.833 1164.000 977.000 1478.000 103.966 1300.000
coldlaunch.contentInteractive 1167.767 1164.000 982.000 1479.000 103.921 1303.000
coldlaunch.fullyLoaded 1169.600 1165.000 984.000 1479.000 104.209 1304.000
coldlaunch.pss 10.903 10.900 10.900 11.000 0.018 10.900
coldlaunch.uss 7.297 7.300 7.200 7.300 0.018 7.300
coldlaunch.rss 23.197 23.200 23.100 23.200 0.018 23.200
Iteration 7
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1174.767 1146.500 1036.000 1453.000 111.745 1377.000
coldlaunch.navigationInteractive 1184.700 1160.500 1044.000 1485.000 113.794 1377.000
coldlaunch.visuallyLoaded 1187.800 1160.500 1048.000 1486.000 113.457 1385.000
coldlaunch.contentInteractive 1188.967 1161.500 1057.000 1487.000 112.882 1385.000
coldlaunch.fullyLoaded 1190.067 1161.500 1057.000 1488.000 113.226 1386.000
coldlaunch.pss 11.000 11.000 11.000 11.000 0.000 11.000
coldlaunch.uss 7.347 7.300 7.300 7.400 0.050 7.400
coldlaunch.rss 23.200 23.200 23.200 23.200 0.000 23.200
Iteration 8
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1175.333 1170.500 1024.000 1366.000 96.593 1341.000
coldlaunch.navigationInteractive 1184.233 1171.000 1028.000 1395.000 100.868 1370.000
coldlaunch.visuallyLoaded 1188.100 1175.500 1039.000 1396.000 98.778 1370.000
coldlaunch.contentInteractive 1189.733 1177.000 1039.000 1396.000 98.601 1371.000
coldlaunch.fullyLoaded 1191.167 1177.500 1043.000 1397.000 98.563 1371.000
coldlaunch.uss 7.293 7.300 7.200 7.300 0.025 7.300
coldlaunch.rss 23.183 23.200 23.100 23.200 0.037 23.200
coldlaunch.pss 10.983 11.000 10.900 11.000 0.037 11.000
Iteration 9
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------ --------
coldlaunch.navigationLoaded 1196.467 1172.000 1084.000 1417.000 90.820 1383.000
coldlaunch.navigationInteractive 1207.200 1180.500 1101.000 1443.000 91.345 1385.000
coldlaunch.visuallyLoaded 1210.133 1181.000 1103.000 1443.000 90.626 1386.000
coldlaunch.contentInteractive 1212.967 1187.500 1104.000 1447.000 91.715 1387.000
coldlaunch.fullyLoaded 1213.633 1188.500 1104.000 1447.000 91.838 1387.000
coldlaunch.pss 10.700 10.700 10.700 10.700 0.000 10.700
coldlaunch.rss 22.700 22.700 22.700 22.700 0.000 22.700
coldlaunch.uss 7.100 7.100 7.100 7.100 0.000 7.100
Iteration 10
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1234.900 1240.000 1058.000 1493.000 118.069 1451.000
coldlaunch.navigationInteractive 1245.900 1244.000 1082.000 1507.000 118.384 1466.000
coldlaunch.visuallyLoaded 1248.767 1248.500 1082.000 1508.000 118.448 1466.000
coldlaunch.contentInteractive 1251.800 1249.000 1083.000 1532.000 120.106 1469.000
coldlaunch.fullyLoaded 1252.767 1249.500 1086.000 1532.000 119.763 1470.000
coldlaunch.rss 23.200 23.200 23.200 23.200 0.000 23.200
coldlaunch.pss 11.000 11.000 11.000 11.000 0.000 11.000
coldlaunch.uss 7.300 7.300 7.300 7.300 0.000 7.300
fullyLoaded Coefficient of varation: 100 * (std dev / mean)
Iteration 1: 10.55
Iteration 2: 7.32
Iteration 3: 9.30
Iteration 4: 9.22
Iteration 5: 9.16
Iteration 6: 8.90
Iteration 7: 9.51
Iteration 8: 8.27
Iteration 9: 7.56
Iteration 10: 9.55
Average: 8.93
Same setup as above this time on emulator-kk
c4.2xlarge ubuntu 14.04
** Emulator-KK running on a 1024MB RAMDISK mounted into the docker container **
Cfg: 2048 RAM, 2047 partition (max partition size)
Removed: -skin, -skindir, -camera-back
Added: -no-skin (NOT -wipe-data b/c that actually removes /data on emulator-kk, need that)
Added: '-net none -bt hci,null' to end of -qemu $TAIL_ARGS
Added: -cache-size 2048
Cmd: DEBUG=* RUNS=30 APPS='template' RAPTOR_EMULATOR=1 node tests/raptor/emulator_launch_test.js
Iterations: 10 (shutdown and restart emulator and do make raptor before each cmd iteration)
Results direct from console:
Iteration 1
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1550.100 1524.500 1153.000 2558.000 270.026 2082.000
coldlaunch.navigationInteractive 1553.200 1531.500 1153.000 2559.000 269.906 2083.000
coldlaunch.visuallyLoaded 1554.433 1532.500 1155.000 2559.000 269.851 2084.000
coldlaunch.contentInteractive 1555.033 1532.500 1155.000 2560.000 269.874 2084.000
coldlaunch.fullyLoaded 1557.100 1533.500 1156.000 2560.000 270.178 2085.000
coldlaunch.uss 6.390 6.500 5.900 6.500 0.164 6.500
coldlaunch.rss 22.973 23.100 22.500 23.200 0.179 23.100
coldlaunch.pss 10.207 10.300 9.700 10.400 0.167 10.400
Iteration 2
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1649.400 1577.000 1282.000 2447.000 277.888 2338.000
coldlaunch.navigationInteractive 1651.833 1577.500 1283.000 2449.000 277.256 2338.000
coldlaunch.visuallyLoaded 1653.033 1578.500 1284.000 2450.000 277.425 2339.000
coldlaunch.contentInteractive 1654.067 1579.000 1284.000 2451.000 277.215 2340.000
coldlaunch.fullyLoaded 1656.267 1579.500 1286.000 2451.000 277.089 2340.000
coldlaunch.rss 22.590 22.600 22.400 22.700 0.094 22.700
coldlaunch.uss 5.977 6.000 5.800 6.100 0.102 6.100
coldlaunch.pss 9.807 9.800 9.600 9.900 0.085 9.900
Iteration 3
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1631.900 1652.500 1138.000 2853.000 320.488 2095.000
coldlaunch.navigationInteractive 1633.533 1655.000 1139.000 2854.000 320.400 2095.000
coldlaunch.visuallyLoaded 1637.700 1655.000 1140.000 2854.000 319.037 2096.000
coldlaunch.contentInteractive 1638.800 1656.000 1140.000 2855.000 319.460 2100.000
coldlaunch.fullyLoaded 1639.433 1656.000 1141.000 2855.000 319.320 2100.000
coldlaunch.pss 10.153 10.200 9.800 10.200 0.092 10.200
coldlaunch.rss 22.983 23.000 22.600 23.100 0.110 23.100
coldlaunch.uss 6.257 6.300 5.900 6.300 0.084 6.300
Iteration 4
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1560.867 1503.500 1164.000 2295.000 264.282 2220.000
coldlaunch.navigationInteractive 1563.900 1504.500 1165.000 2296.000 266.831 2247.000
coldlaunch.visuallyLoaded 1565.533 1505.000 1166.000 2298.000 267.220 2254.000
coldlaunch.contentInteractive 1566.733 1505.000 1166.000 2299.000 267.448 2256.000
coldlaunch.fullyLoaded 1569.233 1506.500 1166.000 2300.000 267.639 2261.000
coldlaunch.rss 22.143 22.200 22.000 22.400 0.088 22.200
coldlaunch.uss 5.540 5.600 5.400 5.800 0.092 5.600
coldlaunch.pss 9.447 9.500 9.300 9.700 0.088 9.500
Iteration 5
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1503.500 1494.000 1174.000 2247.000 223.812 1920.000
coldlaunch.navigationInteractive 1505.633 1495.000 1196.000 2249.000 223.150 1921.000
coldlaunch.visuallyLoaded 1508.267 1495.500 1197.000 2250.000 223.674 1924.000
coldlaunch.contentInteractive 1509.333 1496.000 1197.000 2250.000 223.518 1925.000
coldlaunch.fullyLoaded 1509.867 1497.500 1198.000 2251.000 223.775 1925.000
coldlaunch.rss 23.023 23.100 22.500 23.100 0.180 23.100
coldlaunch.pss 10.220 10.300 9.700 10.300 0.178 10.300
coldlaunch.uss 6.313 6.400 5.800 6.400 0.177 6.400
Iteration 6
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1700.433 1568.500 1319.000 3603.000 438.701 2435.000
coldlaunch.navigationInteractive 1702.800 1569.000 1320.000 3604.000 438.208 2436.000
coldlaunch.visuallyLoaded 1704.600 1572.000 1320.000 3605.000 438.632 2437.000
coldlaunch.contentInteractive 1705.333 1573.000 1321.000 3605.000 438.392 2437.000
coldlaunch.fullyLoaded 1706.200 1573.500 1321.000 3606.000 438.671 2440.000
coldlaunch.pss 9.780 9.800 9.700 9.900 0.054 9.900
coldlaunch.uss 6.180 6.200 6.100 6.200 0.040 6.200
coldlaunch.rss 22.180 22.200 22.100 22.300 0.060 22.300
Iteration 7
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1557.900 1522.000 1095.000 2483.000 342.256 2397.000
coldlaunch.navigationInteractive 1559.900 1522.500 1096.000 2484.000 342.174 2398.000
coldlaunch.visuallyLoaded 1560.900 1523.500 1097.000 2485.000 342.220 2399.000
coldlaunch.contentInteractive 1561.467 1524.500 1097.000 2486.000 342.234 2399.000
coldlaunch.fullyLoaded 1564.867 1524.500 1097.000 2486.000 342.042 2400.000
coldlaunch.uss 6.330 6.400 6.100 6.400 0.090 6.400
coldlaunch.rss 22.300 22.300 22.000 22.400 0.106 22.400
coldlaunch.pss 9.927 10.000 9.700 10.000 0.096 10.000
Iteration 8
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- ------- -------- ------- --------
coldlaunch.navigationLoaded 1563.533 1495.000 988.000 2379.000 292.473 2106.000
coldlaunch.navigationInteractive 1564.500 1496.000 989.000 2379.000 292.389 2107.000
coldlaunch.visuallyLoaded 1566.433 1498.000 990.000 2381.000 291.968 2108.000
coldlaunch.contentInteractive 1568.100 1501.000 990.000 2382.000 292.524 2112.000
coldlaunch.fullyLoaded 1568.733 1501.500 991.000 2382.000 292.384 2113.000
coldlaunch.uss 5.787 5.500 5.500 6.200 0.307 6.200
coldlaunch.rss 22.363 22.100 22.000 22.800 0.306 22.800
coldlaunch.pss 9.683 9.400 9.300 10.100 0.311 10.100
Iteration 9
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1590.900 1530.500 1237.000 2579.000 304.228 2399.000
coldlaunch.navigationInteractive 1592.700 1531.500 1237.000 2579.000 303.771 2399.000
coldlaunch.visuallyLoaded 1594.167 1532.500 1239.000 2580.000 304.138 2407.000
coldlaunch.contentInteractive 1594.700 1532.500 1239.000 2581.000 304.230 2408.000
coldlaunch.fullyLoaded 1595.233 1533.500 1239.000 2581.000 304.183 2408.000
coldlaunch.rss 22.263 22.100 22.000 22.800 0.289 22.700
coldlaunch.pss 9.573 9.400 9.300 10.100 0.289 10.000
coldlaunch.uss 5.653 5.500 5.400 6.200 0.303 6.100
Iteration 10
Metric Mean Median Min Max StdDev p95
-------------------------------- -------- -------- -------- -------- ------- --------
coldlaunch.navigationLoaded 1535.567 1483.000 1178.000 2162.000 228.724 1908.000
coldlaunch.navigationInteractive 1538.233 1483.000 1179.000 2175.000 229.484 1909.000
coldlaunch.visuallyLoaded 1540.900 1484.000 1186.000 2176.000 228.831 1910.000
coldlaunch.contentInteractive 1541.567 1486.000 1187.000 2177.000 228.735 1910.000
coldlaunch.fullyLoaded 1543.533 1496.500 1187.000 2177.000 227.910 1910.000
coldlaunch.uss 5.943 6.000 5.400 6.000 0.171 6.000
coldlaunch.pss 9.867 9.900 9.400 10.000 0.149 10.000
coldlaunch.rss 22.617 22.700 22.100 22.700 0.149 22.700
fullyLoaded Coefficient of varation: 100 * (std dev / mean)
Iteration 1: 17.35
Iteration 2: 16.72
Iteration 3: 19.47
Iteration 4: 17.05
Iteration 5: 14.82
Iteration 6: 25.71
Iteration 7: 21.85
Iteration 8: 18.63
Iteration 9: 19.06
Iteration 10: 14.76
Average: 18.54
Same setup but emulator-kk with 'settings' app
c4.2xlarge ubuntu 14.04
This time the 'settings' app
** Emulator-KK running on a 1024MB RAMDISK mounted into the docker container **
Cfg: 2048 RAM, 2047 partition (max partition size)
Removed: -skin, -skindir, -camera-back
Added: -no-skin (NOT -wipe-data b/c that actually removes /data on emulator-kk, need that)
Added: '-net none -bt hci,null' to end of -qemu $TAIL_ARGS
Added: -cache-size 2048
Cmd: DEBUG=* RUNS=30 APPS='settings' RAPTOR_EMULATOR=1 node tests/raptor/emulator_launch_test.js
Iterations: 10 (shutdown and restart emulator and do make raptor before each cmd iteration)
Results direct from console:
Iteration 1
Metric Mean Median Min Max StdDev p95
-------------------------------- --------- --------- --------- --------- -------- ---------
coldlaunch.contentInteractive 4151.667 4102.500 3303.000 5552.000 626.004 5492.000
coldlaunch.navigationLoaded 4768.600 4610.000 3888.000 6436.000 712.627 6300.000
coldlaunch.navigationInteractive 4769.800 4610.500 3888.000 6437.000 712.739 6301.000
coldlaunch.visuallyLoaded 10295.200 9918.500 9149.000 13805.000 1156.327 13102.000
coldlaunch.fullyLoaded 12890.800 12355.500 11330.000 18854.000 1858.683 18242.000
coldlaunch.pss 21.823 22.100 20.500 23.500 0.955 23.400
coldlaunch.rss 35.510 35.750 34.100 37.500 0.994 37.000
coldlaunch.uss 18.400 18.700 17.000 20.000 0.943 19.900
Iteration 2
Metric Mean Median Min Max StdDev p95
-------------------------------- --------- --------- --------- --------- -------- ---------
coldlaunch.contentInteractive 3860.933 3708.000 3021.000 5372.000 631.292 5344.000
coldlaunch.navigationLoaded 4495.533 4342.000 3650.000 6243.000 664.865 6086.000
coldlaunch.navigationInteractive 4497.433 4343.500 3665.000 6244.000 664.322 6087.000
coldlaunch.visuallyLoaded 10076.200 9714.500 8957.000 13765.000 1166.603 13204.000
coldlaunch.fullyLoaded 12706.767 12110.500 11054.000 19226.000 1906.392 17793.000
coldlaunch.rss 35.917 36.200 34.100 37.200 0.880 37.100
coldlaunch.pss 22.247 22.500 20.500 23.400 0.827 23.300
coldlaunch.uss 18.843 19.100 17.100 20.000 0.820 19.900
Iteration 3
Metric Mean Median Min Max StdDev p95
-------------------------------- --------- --------- --------- --------- -------- ---------
coldlaunch.contentInteractive 4144.967 3903.500 3223.000 7138.000 869.662 6312.000
coldlaunch.navigationLoaded 4758.800 4464.000 3870.000 8198.000 958.386 7118.000
coldlaunch.navigationInteractive 4760.333 4465.000 3871.000 8199.000 958.212 7119.000
coldlaunch.visuallyLoaded 10342.933 9800.500 9085.000 15961.000 1570.499 13651.000
coldlaunch.fullyLoaded 12910.167 12208.500 11153.000 18722.000 2076.657 18092.000
coldlaunch.pss 21.927 21.650 20.600 23.300 0.881 23.200
coldlaunch.uss 18.473 18.150 17.200 19.800 0.864 19.700
coldlaunch.rss 35.790 35.600 34.400 37.300 0.912 37.300
Iteration 4
Metric Mean Median Min Max StdDev p95
-------------------------------- --------- --------- --------- --------- ------- ---------
coldlaunch.contentInteractive 4009.800 3922.500 3341.000 5651.000 429.355 4554.000
coldlaunch.navigationLoaded 4592.433 4487.500 3975.000 6484.000 473.138 5210.000
coldlaunch.navigationInteractive 4593.933 4488.500 3976.000 6495.000 474.397 5211.000
coldlaunch.visuallyLoaded 10160.200 10034.500 9327.000 12703.000 595.388 10829.000
coldlaunch.fullyLoaded 12517.867 12504.000 11168.000 15078.000 681.141 13155.000
coldlaunch.uss 18.813 19.150 17.300 20.000 0.789 19.800
coldlaunch.rss 36.167 36.450 34.500 37.300 0.887 37.300
coldlaunch.pss 22.270 22.600 20.700 23.500 0.815 23.300
Iteration 5
Metric Mean Median Min Max StdDev p95
-------------------------------- --------- --------- --------- --------- -------- ---------
coldlaunch.contentInteractive 4060.200 3867.000 3205.000 5644.000 681.325 5500.000
coldlaunch.navigationLoaded 4665.533 4413.500 3796.000 6381.000 721.694 6260.000
coldlaunch.navigationInteractive 4666.933 4414.500 3796.000 6382.000 721.578 6261.000
coldlaunch.visuallyLoaded 10199.600 9858.500 8925.000 13428.000 1172.295 13290.000
coldlaunch.fullyLoaded 12726.800 12105.500 11365.000 18016.000 1773.315 17944.000
coldlaunch.pss 21.857 22.150 20.600 23.400 0.909 23.200
coldlaunch.rss 35.567 35.800 34.200 37.400 0.977 37.100
coldlaunch.uss 18.440 18.800 17.200 19.800 0.882 19.700
Iteration 6
Metric Mean Median Min Max StdDev p95
-------------------------------- --------- --------- --------- --------- -------- ---------
coldlaunch.contentInteractive 3895.867 3746.500 3230.000 5357.000 580.972 5219.000
coldlaunch.navigationLoaded 4502.800 4320.000 3821.000 6106.000 620.437 6066.000
coldlaunch.navigationInteractive 4503.967 4321.000 3822.000 6107.000 620.359 6067.000
coldlaunch.visuallyLoaded 10096.233 9851.000 9043.000 12969.000 1021.399 12901.000
coldlaunch.fullyLoaded 12799.900 12195.000 11236.000 18531.000 1911.792 18495.000
coldlaunch.rss 35.810 36.050 34.300 37.300 0.962 37.200
coldlaunch.uss 18.590 18.900 17.300 19.800 0.863 19.700
coldlaunch.pss 22.047 22.300 20.600 23.300 0.880 23.300
Iteration 7
Metric Mean Median Min Max StdDev p95
-------------------------------- --------- --------- --------- --------- -------- ---------
coldlaunch.contentInteractive 3984.767 3862.500 3313.000 5776.000 567.029 5416.000
coldlaunch.navigationLoaded 4600.133 4390.500 3931.000 6560.000 612.941 6066.000
coldlaunch.navigationInteractive 4601.467 4391.500 3932.000 6560.000 612.804 6067.000
coldlaunch.visuallyLoaded 10118.600 9730.500 9040.000 13541.000 1104.230 12906.000
coldlaunch.fullyLoaded 12705.833 12173.000 11188.000 17913.000 1738.797 17611.000
coldlaunch.pss 22.087 22.450 20.600 23.400 0.873 23.000
coldlaunch.rss 35.807 36.100 34.200 37.400 0.950 36.900
coldlaunch.uss 18.663 19.050 17.200 19.900 0.860 19.600
Iteration 8
Metric Mean Median Min Max StdDev p95
-------------------------------- --------- --------- --------- --------- -------- ---------
coldlaunch.contentInteractive 3898.767 3707.000 3043.000 5813.000 678.482 5606.000
coldlaunch.navigationLoaded 4524.600 4233.000 3683.000 6647.000 747.295 6369.000
coldlaunch.navigationInteractive 4526.033 4234.000 3683.000 6648.000 748.212 6371.000
coldlaunch.visuallyLoaded 10031.233 9585.000 8752.000 13992.000 1275.370 12980.000
coldlaunch.fullyLoaded 12613.200 11896.500 10711.000 18757.000 1983.563 18126.000
coldlaunch.uss 18.580 18.950 16.200 20.100 0.960 20.100
coldlaunch.pss 22.003 22.350 19.600 23.600 0.980 23.500
coldlaunch.rss 35.717 36.050 33.300 37.400 1.004 37.200
Iteration 9
Metric Mean Median Min Max StdDev p95
-------------------------------- --------- --------- --------- --------- -------- ---------
coldlaunch.contentInteractive 4068.233 3953.500 3310.000 6159.000 655.850 5606.000
coldlaunch.navigationLoaded 4675.367 4487.000 3984.000 6908.000 703.318 6380.000
coldlaunch.navigationInteractive 4677.567 4488.000 3985.000 6920.000 704.198 6381.000
coldlaunch.visuallyLoaded 10222.733 9970.500 9329.000 13810.000 1145.939 13413.000
coldlaunch.fullyLoaded 12862.633 12367.500 11482.000 18717.000 1932.624 18527.000
coldlaunch.pss 22.017 22.300 20.500 23.300 0.786 23.000
coldlaunch.uss 18.617 18.900 17.100 19.900 0.777 19.600
coldlaunch.rss 35.673 35.950 34.100 37.100 0.807 36.800
Iteration 10
Metric Mean Median Min Max StdDev p95
-------------------------------- --------- --------- --------- --------- -------- ---------
coldlaunch.contentInteractive 4000.100 3866.000 3237.000 5847.000 606.153 5258.000
coldlaunch.navigationLoaded 4606.400 4445.000 3833.000 6659.000 648.045 6043.000
coldlaunch.navigationInteractive 4607.500 4446.500 3834.000 6662.000 648.363 6044.000
coldlaunch.visuallyLoaded 10174.567 9842.500 9145.000 13599.000 1084.421 13117.000
coldlaunch.fullyLoaded 12748.967 12205.500 11128.000 17989.000 1720.066 17641.000
coldlaunch.pss 21.650 21.400 20.300 23.100 0.810 22.800
coldlaunch.rss 35.343 35.100 34.000 36.800 0.820 36.600
coldlaunch.uss 18.253 18.050 16.800 19.800 0.832 19.300
fullyLoaded Coefficient of varation: 100 * (std dev / mean)
Iteration 1: 14.41
Iteration 2: 15.00
Iteration 3: 16.08
Iteration 4: 5.44
Iteration 5: 13.93
Iteration 6: 14.93
Iteration 7: 13.68
Iteration 8: 15.72
Iteration 9: 15.02
Iteration 10: 13.49
Average: 13.77
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment