-
-
Save rwood-moz/53ee14e19de8ac63bcaf to your computer and use it in GitHub Desktop.
Raptor on Emulator - Template App Continued
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| AWS r3.xlarge ubuntu 14.04 | |
| Emulator (NOT emulator-kk) | |
| Cfg: 2048 RAM, 2047 partition (max partition size) | |
| Removed: -skin, -skindir, -camera-back | |
| Added: -wipe-data, -no-skin, -no-cache, -no-snapstorage (rest of settings default) | |
| Cmd: DEBUG=* RUNS=30 APPS='template' RAPTOR_EMULATOR=1 node tests/raptor/emulator_launch_test.js | |
| Iterations: 10 (shutdown and restart emulator and do make raptor before each cmd iteration) | |
| Results direct from console: | |
| Iteration 1 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1959.833 1891.500 1368.000 2351.000 232.417 2340.000 | |
| coldlaunch.navigationInteractive 1968.700 1903.500 1378.000 2352.000 232.041 2345.000 | |
| coldlaunch.visuallyLoaded 1972.433 1914.000 1378.000 2355.000 231.734 2348.000 | |
| coldlaunch.contentInteractive 1974.500 1918.500 1378.000 2356.000 231.953 2349.000 | |
| coldlaunch.fullyLoaded 1977.367 1919.500 1383.000 2356.000 232.099 2349.000 | |
| coldlaunch.uss 5.513 5.400 5.400 6.000 0.196 6.000 | |
| coldlaunch.pss 9.867 9.800 9.800 10.300 0.170 10.300 | |
| coldlaunch.rss 22.670 22.600 22.600 23.200 0.179 23.100 | |
| Iteration 2 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1933.900 1893.000 1525.000 2317.000 212.834 2284.000 | |
| coldlaunch.navigationInteractive 1946.467 1916.000 1525.000 2318.000 214.245 2313.000 | |
| coldlaunch.visuallyLoaded 1949.800 1917.000 1526.000 2334.000 215.517 2314.000 | |
| coldlaunch.contentInteractive 1951.767 1917.500 1527.000 2335.000 215.699 2315.000 | |
| coldlaunch.fullyLoaded 1953.700 1920.000 1527.000 2336.000 215.944 2316.000 | |
| coldlaunch.pss 10.137 10.100 9.800 10.300 0.105 10.300 | |
| coldlaunch.uss 5.837 5.800 5.500 6.000 0.105 6.000 | |
| coldlaunch.rss 22.937 22.900 22.600 23.100 0.105 23.100 | |
| Iteration 3 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1835.733 1808.500 1575.000 2172.000 180.464 2161.000 | |
| coldlaunch.navigationInteractive 1842.700 1809.500 1582.000 2183.000 183.119 2174.000 | |
| coldlaunch.visuallyLoaded 1847.333 1811.000 1583.000 2184.000 183.442 2178.000 | |
| coldlaunch.contentInteractive 1849.100 1812.000 1584.000 2185.000 182.896 2179.000 | |
| coldlaunch.fullyLoaded 1849.933 1812.000 1588.000 2185.000 182.840 2179.000 | |
| coldlaunch.uss 5.800 5.900 5.500 6.000 0.186 6.000 | |
| coldlaunch.rss 22.923 23.000 22.600 23.100 0.158 23.100 | |
| coldlaunch.pss 10.123 10.200 9.800 10.300 0.158 10.300 | |
| Iteration 4 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1935.933 1943.000 1624.000 2268.000 172.697 2266.000 | |
| coldlaunch.navigationInteractive 1943.667 1952.500 1629.000 2301.000 172.387 2267.000 | |
| coldlaunch.visuallyLoaded 1947.167 1955.500 1630.000 2301.000 171.825 2268.000 | |
| coldlaunch.contentInteractive 1950.867 1956.500 1658.000 2305.000 171.426 2268.000 | |
| coldlaunch.fullyLoaded 1953.167 1957.500 1659.000 2306.000 170.323 2269.000 | |
| coldlaunch.uss 5.850 5.800 5.500 6.000 0.131 6.000 | |
| coldlaunch.rss 22.953 22.900 22.600 23.100 0.131 23.100 | |
| coldlaunch.pss 10.153 10.100 9.800 10.300 0.131 10.300 | |
| Iteration 5 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1888.100 1873.500 1270.000 2200.000 182.097 2151.000 | |
| coldlaunch.navigationInteractive 1897.400 1881.000 1271.000 2207.000 181.960 2167.000 | |
| coldlaunch.visuallyLoaded 1901.667 1883.500 1272.000 2208.000 181.457 2168.000 | |
| coldlaunch.contentInteractive 1904.833 1885.500 1291.000 2217.000 179.926 2169.000 | |
| coldlaunch.fullyLoaded 1907.000 1886.500 1292.000 2217.000 180.682 2169.000 | |
| coldlaunch.pss 10.157 10.100 10.100 10.400 0.096 10.300 | |
| coldlaunch.uss 5.853 5.800 5.800 6.000 0.088 6.000 | |
| coldlaunch.rss 22.957 22.900 22.900 23.200 0.096 23.100 | |
| Iteration 6 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1803.933 1765.500 1357.000 2389.000 204.809 2158.000 | |
| coldlaunch.navigationInteractive 1813.533 1766.500 1365.000 2390.000 206.418 2159.000 | |
| coldlaunch.visuallyLoaded 1815.633 1770.000 1365.000 2392.000 206.648 2161.000 | |
| coldlaunch.contentInteractive 1816.833 1772.500 1365.000 2392.000 206.560 2161.000 | |
| coldlaunch.fullyLoaded 1817.867 1773.000 1366.000 2393.000 206.712 2162.000 | |
| coldlaunch.rss 22.603 22.500 22.500 23.000 0.192 23.000 | |
| coldlaunch.pss 9.880 9.800 9.800 10.300 0.162 10.200 | |
| coldlaunch.uss 5.543 5.500 5.400 5.900 0.176 5.900 | |
| Iteration 7 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1808.500 1780.000 1543.000 2255.000 173.872 2161.000 | |
| coldlaunch.navigationInteractive 1815.500 1780.500 1548.000 2266.000 177.034 2192.000 | |
| coldlaunch.visuallyLoaded 1820.600 1789.000 1566.000 2266.000 176.175 2196.000 | |
| coldlaunch.contentInteractive 1821.967 1789.500 1567.000 2267.000 176.395 2197.000 | |
| coldlaunch.fullyLoaded 1823.733 1793.000 1568.000 2268.000 175.751 2197.000 | |
| coldlaunch.uss 5.583 5.500 5.500 6.000 0.186 6.000 | |
| coldlaunch.pss 9.883 9.800 9.800 10.300 0.186 10.300 | |
| coldlaunch.rss 22.683 22.600 22.600 23.100 0.186 23.100 | |
| Iteration 8 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1801.100 1774.000 1549.000 2193.000 141.626 2165.000 | |
| coldlaunch.navigationInteractive 1807.033 1775.000 1549.000 2194.000 143.932 2182.000 | |
| coldlaunch.visuallyLoaded 1812.533 1779.000 1565.000 2201.000 143.404 2184.000 | |
| coldlaunch.contentInteractive 1814.867 1780.000 1566.000 2202.000 143.088 2184.000 | |
| coldlaunch.fullyLoaded 1816.100 1781.000 1567.000 2202.000 142.963 2184.000 | |
| coldlaunch.uss 5.877 5.900 5.500 5.900 0.088 5.900 | |
| coldlaunch.pss 10.210 10.200 9.800 10.300 0.108 10.300 | |
| coldlaunch.rss 23.067 23.100 22.600 23.100 0.114 23.100 | |
| Iteration 9 | |
| coldlaunch.navigationLoaded 1787.567 1779.500 1313.000 2136.000 173.894 2129.000 | |
| coldlaunch.navigationInteractive 1798.367 1780.000 1313.000 2137.000 173.830 2133.000 | |
| coldlaunch.visuallyLoaded 1801.567 1788.500 1314.000 2142.000 173.313 2134.000 | |
| coldlaunch.contentInteractive 1803.533 1789.500 1315.000 2153.000 173.934 2135.000 | |
| coldlaunch.fullyLoaded 1804.500 1790.000 1315.000 2154.000 173.980 2135.000 | |
| coldlaunch.uss 5.827 5.900 5.500 6.000 0.184 6.000 | |
| coldlaunch.rss 22.940 23.000 22.600 23.100 0.170 23.100 | |
| coldlaunch.pss 10.140 10.200 9.800 10.300 0.170 10.300 | |
| Iteration 10 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1776.867 1767.500 1305.000 2027.000 172.070 2026.000 | |
| coldlaunch.navigationInteractive 1787.067 1769.500 1305.000 2042.000 171.618 2039.000 | |
| coldlaunch.visuallyLoaded 1791.467 1781.000 1306.000 2042.000 172.033 2040.000 | |
| coldlaunch.contentInteractive 1794.733 1781.500 1307.000 2064.000 174.458 2047.000 | |
| coldlaunch.fullyLoaded 1795.867 1782.000 1307.000 2065.000 174.164 2047.000 | |
| coldlaunch.uss 5.850 5.800 5.700 6.000 0.092 6.000 | |
| coldlaunch.rss 22.960 22.900 22.900 23.200 0.102 23.200 | |
| coldlaunch.pss 10.157 10.100 10.100 10.400 0.096 10.300 | |
| fullyLoaded Coefficient of varation: 100 * (std dev / mean) | |
| Iteration 1: 11.73 | |
| Iteration 2: 11.05 | |
| Iteration 3: 9.88 | |
| Iteration 4: 8.72 | |
| Iteration 5: 9.47 | |
| Iteration 6: 11.37 | |
| Iteration 7: 9.63 | |
| Iteration 8: 7.87 | |
| Iteration 9: 9.64 | |
| Iteration 10: 9.69 | |
| Average: 9.90 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| AWS r3.xlarge ubuntu 14.04 | |
| Emulator (NOT emulator-kk) | |
| Cfg: 2048 RAM, 2047 partition (max partition size) | |
| Removed: -skin, -skindir, -camera-back | |
| Added: -wipe-data, -no-skin (rest of settings default) | |
| Added: '-net none -bt hci,null' to end of -qemu $TAIL_ARGS | |
| Cmd: DEBUG=* RUNS=30 APPS='template' RAPTOR_EMULATOR=1 node tests/raptor/emulator_launch_test.js | |
| Iterations: 10 (shutdown and restart emulator and do make raptor before each cmd iteration) | |
| Results direct from console: | |
| Iteration 1 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1861.200 1816.500 1286.000 2261.000 207.904 2213.000 | |
| coldlaunch.navigationInteractive 1870.433 1842.000 1286.000 2261.000 207.140 2217.000 | |
| coldlaunch.visuallyLoaded 1874.800 1843.000 1288.000 2280.000 209.285 2218.000 | |
| coldlaunch.contentInteractive 1877.367 1843.500 1288.000 2280.000 210.354 2219.000 | |
| coldlaunch.fullyLoaded 1878.767 1844.000 1288.000 2282.000 210.266 2219.000 | |
| coldlaunch.uss 5.863 5.900 5.500 6.000 0.143 6.000 | |
| coldlaunch.pss 10.163 10.200 9.800 10.300 0.143 10.300 | |
| coldlaunch.rss 22.967 23.000 22.600 23.200 0.147 23.100 | |
| Iteration 2 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1926.167 1895.500 1365.000 2268.000 187.421 2220.000 | |
| coldlaunch.navigationInteractive 1934.700 1896.500 1366.000 2269.000 184.837 2221.000 | |
| coldlaunch.visuallyLoaded 1940.000 1901.000 1373.000 2285.000 186.409 2223.000 | |
| coldlaunch.contentInteractive 1942.000 1901.500 1373.000 2286.000 185.736 2224.000 | |
| coldlaunch.fullyLoaded 1943.667 1904.000 1374.000 2289.000 185.786 2225.000 | |
| coldlaunch.pss 10.010 10.000 10.000 10.100 0.030 10.100 | |
| coldlaunch.rss 22.710 22.700 22.700 22.800 0.030 22.800 | |
| coldlaunch.uss 5.620 5.600 5.600 5.800 0.060 5.800 | |
| Iteration 3 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1751.400 1743.000 1276.000 2171.000 179.745 1987.000 | |
| coldlaunch.navigationInteractive 1761.967 1752.500 1276.000 2175.000 180.575 2004.000 | |
| coldlaunch.visuallyLoaded 1764.333 1754.500 1281.000 2177.000 180.082 2004.000 | |
| coldlaunch.contentInteractive 1767.567 1761.000 1282.000 2178.000 179.952 2007.000 | |
| coldlaunch.fullyLoaded 1769.200 1761.500 1310.000 2179.000 177.383 2007.000 | |
| coldlaunch.uss 5.747 5.800 5.400 6.000 0.245 6.000 | |
| coldlaunch.pss 10.060 10.150 9.800 10.400 0.248 10.400 | |
| coldlaunch.rss 22.860 22.950 22.600 23.200 0.248 23.200 | |
| Iteration 4 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1739.533 1684.500 1296.000 2017.000 164.044 1964.000 | |
| coldlaunch.navigationInteractive 1744.933 1694.500 1298.000 2018.000 164.086 1984.000 | |
| coldlaunch.visuallyLoaded 1751.300 1695.000 1299.000 2019.000 165.030 1984.000 | |
| coldlaunch.contentInteractive 1752.700 1697.500 1300.000 2020.000 165.210 1987.000 | |
| coldlaunch.fullyLoaded 1754.500 1698.500 1300.000 2021.000 165.024 1990.000 | |
| coldlaunch.rss 22.763 22.800 22.200 22.900 0.152 22.900 | |
| coldlaunch.uss 5.747 5.800 5.200 5.800 0.145 5.800 | |
| coldlaunch.pss 10.057 10.100 9.500 10.200 0.148 10.200 | |
| Iteration 5 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1862.467 1804.500 1606.000 2221.000 173.550 2150.000 | |
| coldlaunch.navigationInteractive 1872.667 1807.500 1607.000 2222.000 175.513 2158.000 | |
| coldlaunch.visuallyLoaded 1878.033 1823.500 1625.000 2232.000 174.599 2162.000 | |
| coldlaunch.contentInteractive 1879.633 1823.500 1626.000 2232.000 175.077 2163.000 | |
| coldlaunch.fullyLoaded 1881.433 1829.500 1628.000 2233.000 174.055 2164.000 | |
| coldlaunch.pss 10.183 10.200 9.900 10.300 0.134 10.300 | |
| coldlaunch.uss 5.877 5.900 5.500 6.000 0.150 6.000 | |
| coldlaunch.rss 22.987 23.000 22.700 23.200 0.138 23.100 | |
| Iteration 6 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1773.967 1748.500 1599.000 2099.000 131.603 2069.000 | |
| coldlaunch.navigationInteractive 1785.367 1762.500 1611.000 2101.000 135.178 2100.000 | |
| coldlaunch.visuallyLoaded 1789.233 1763.500 1612.000 2106.000 134.453 2101.000 | |
| coldlaunch.contentInteractive 1791.267 1766.000 1612.000 2107.000 134.973 2102.000 | |
| coldlaunch.fullyLoaded 1792.533 1766.500 1612.000 2115.000 135.567 2103.000 | |
| coldlaunch.pss 9.880 9.800 9.700 10.300 0.214 10.300 | |
| coldlaunch.rss 22.693 22.600 22.500 23.100 0.206 23.100 | |
| coldlaunch.uss 5.540 5.500 5.300 6.000 0.196 6.000 | |
| Iteration 7 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1725.767 1723.000 1228.000 2000.000 153.849 1955.000 | |
| coldlaunch.navigationInteractive 1731.900 1726.500 1234.000 2005.000 154.354 1975.000 | |
| coldlaunch.visuallyLoaded 1735.700 1730.500 1234.000 2007.000 154.498 1985.000 | |
| coldlaunch.contentInteractive 1737.733 1730.500 1235.000 2007.000 155.343 1985.000 | |
| coldlaunch.fullyLoaded 1738.867 1732.000 1235.000 2007.000 155.430 1986.000 | |
| coldlaunch.pss 10.237 10.300 9.800 10.300 0.138 10.300 | |
| coldlaunch.rss 23.033 23.100 22.600 23.100 0.145 23.100 | |
| coldlaunch.uss 5.927 6.000 5.500 6.000 0.150 6.000 | |
| Iteration 8 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1905.033 1878.500 1328.000 2396.000 215.223 2250.000 | |
| coldlaunch.navigationInteractive 1912.100 1885.000 1351.000 2424.000 213.408 2251.000 | |
| coldlaunch.visuallyLoaded 1917.667 1892.500 1351.000 2424.000 213.719 2257.000 | |
| coldlaunch.contentInteractive 1919.733 1893.000 1352.000 2425.000 213.637 2259.000 | |
| coldlaunch.fullyLoaded 1921.333 1894.000 1352.000 2425.000 213.972 2261.000 | |
| coldlaunch.pss 9.997 10.000 9.900 10.100 0.055 10.100 | |
| coldlaunch.rss 22.633 22.600 22.600 22.800 0.070 22.800 | |
| coldlaunch.uss 5.627 5.600 5.600 5.800 0.068 5.800 | |
| Iteration 9 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1721.200 1689.500 1276.000 2130.000 185.666 2032.000 | |
| coldlaunch.navigationInteractive 1728.567 1705.000 1284.000 2131.000 186.048 2033.000 | |
| coldlaunch.visuallyLoaded 1731.467 1706.500 1284.000 2137.000 186.460 2034.000 | |
| coldlaunch.contentInteractive 1732.933 1707.500 1284.000 2138.000 186.774 2034.000 | |
| coldlaunch.fullyLoaded 1734.800 1708.000 1285.000 2139.000 185.440 2034.000 | |
| coldlaunch.rss 22.997 22.950 22.900 23.200 0.102 23.100 | |
| coldlaunch.pss 10.207 10.200 10.100 10.300 0.089 10.300 | |
| coldlaunch.uss 5.887 5.800 5.800 6.000 0.099 6.000 | |
| Iteration 10 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1763.833 1728.500 1593.000 2031.000 120.010 1994.000 | |
| coldlaunch.navigationInteractive 1772.067 1737.000 1608.000 2043.000 120.655 1995.000 | |
| coldlaunch.visuallyLoaded 1775.600 1741.500 1608.000 2044.000 119.741 1996.000 | |
| coldlaunch.contentInteractive 1778.367 1742.000 1619.000 2055.000 119.010 1997.000 | |
| coldlaunch.fullyLoaded 1779.667 1742.500 1622.000 2055.000 118.666 1997.000 | |
| coldlaunch.uss 5.300 5.300 5.300 5.300 0.000 5.300 | |
| coldlaunch.pss 9.600 9.600 9.600 9.600 0.000 9.600 | |
| coldlaunch.rss 22.207 22.200 22.200 22.300 0.025 22.300 | |
| fullyLoaded Coefficient of varation: 100 * (std dev / mean) | |
| Iteration 1: 11.19 | |
| Iteration 2: 9.55 | |
| Iteration 3: 10.02 | |
| Iteration 4: 9.40 | |
| Iteration 5: 9.25 | |
| Iteration 6: 7.56 | |
| Iteration 7: 8.93 | |
| Iteration 8: 11.13 | |
| Iteration 9: 10.68 | |
| Iteration 10: 6.66 | |
| Average: 9.43 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| AWS r3.xlarge ubuntu 14.04 | |
| Emulator (NOT emulator-kk) | |
| Cfg: 2048 RAM, 2047 partition (max partition size) | |
| Removed: -skin, -skindir, -camera-back | |
| Added: -wipe-data, -no-skin (rest of settings default) | |
| Added: '-net none' to end of -qemu $TAIL_ARGS | |
| Cmd: DEBUG=* RUNS=30 APPS='template' RAPTOR_EMULATOR=1 node tests/raptor/emulator_launch_test.js | |
| Iterations: 10 (shutdown and restart emulator and do make raptor before each cmd iteration) | |
| Results direct from console: | |
| Iteration 1 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1903.133 1902.500 1474.000 2328.000 234.019 2281.000 | |
| coldlaunch.navigationInteractive 1914.033 1920.500 1485.000 2342.000 234.274 2282.000 | |
| coldlaunch.visuallyLoaded 1918.333 1921.500 1485.000 2342.000 234.350 2292.000 | |
| coldlaunch.contentInteractive 1920.000 1922.500 1488.000 2342.000 234.277 2293.000 | |
| coldlaunch.fullyLoaded 1922.733 1924.500 1498.000 2343.000 234.101 2302.000 | |
| coldlaunch.rss 22.983 23.000 22.600 23.200 0.132 23.100 | |
| coldlaunch.uss 5.880 5.900 5.500 6.100 0.140 6.000 | |
| coldlaunch.pss 10.183 10.200 9.800 10.400 0.132 10.300 | |
| Iteration 2 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1789.133 1780.500 1520.000 2237.000 167.145 2066.000 | |
| coldlaunch.navigationInteractive 1797.333 1782.000 1520.000 2238.000 165.597 2067.000 | |
| coldlaunch.visuallyLoaded 1803.400 1788.000 1525.000 2246.000 167.578 2068.000 | |
| coldlaunch.contentInteractive 1806.700 1790.000 1525.000 2247.000 166.620 2069.000 | |
| coldlaunch.fullyLoaded 1808.767 1791.500 1526.000 2247.000 166.653 2075.000 | |
| coldlaunch.rss 22.970 23.000 22.600 23.200 0.139 23.100 | |
| coldlaunch.uss 5.867 5.900 5.500 6.100 0.147 6.000 | |
| coldlaunch.pss 10.170 10.200 9.800 10.400 0.139 10.300 | |
| Iteration 3 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1925.700 1897.000 1346.000 2296.000 180.407 2232.000 | |
| coldlaunch.navigationInteractive 1932.300 1898.500 1347.000 2318.000 181.026 2241.000 | |
| coldlaunch.visuallyLoaded 1937.133 1909.000 1353.000 2318.000 180.590 2242.000 | |
| coldlaunch.contentInteractive 1938.733 1909.500 1354.000 2319.000 179.737 2242.000 | |
| coldlaunch.fullyLoaded 1940.333 1912.500 1354.000 2320.000 179.957 2243.000 | |
| coldlaunch.pss 9.690 9.600 9.600 10.000 0.164 10.000 | |
| coldlaunch.rss 22.350 22.300 22.200 22.700 0.186 22.700 | |
| coldlaunch.uss 5.383 5.300 5.200 5.700 0.163 5.700 | |
| Iteration 4 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1786.567 1781.000 1568.000 2088.000 129.357 2018.000 | |
| coldlaunch.navigationInteractive 1795.700 1795.500 1568.000 2089.000 130.122 2019.000 | |
| coldlaunch.visuallyLoaded 1799.567 1798.500 1572.000 2101.000 130.079 2019.000 | |
| coldlaunch.contentInteractive 1801.233 1800.000 1578.000 2102.000 129.991 2023.000 | |
| coldlaunch.fullyLoaded 1803.000 1801.000 1578.000 2103.000 131.310 2024.000 | |
| coldlaunch.uss 5.843 5.800 5.700 6.000 0.088 6.000 | |
| coldlaunch.pss 10.147 10.100 10.100 10.300 0.085 10.300 | |
| coldlaunch.rss 22.950 22.900 22.900 23.200 0.092 23.100 | |
| Iteration 5 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1919.600 1898.500 1366.000 2245.000 203.468 2233.000 | |
| coldlaunch.navigationInteractive 1931.833 1912.500 1366.000 2260.000 205.197 2248.000 | |
| coldlaunch.visuallyLoaded 1934.300 1913.000 1367.000 2261.000 206.126 2249.000 | |
| coldlaunch.contentInteractive 1937.633 1915.000 1368.000 2265.000 205.515 2256.000 | |
| coldlaunch.fullyLoaded 1938.767 1916.000 1368.000 2265.000 205.183 2256.000 | |
| coldlaunch.uss 5.343 5.300 5.100 5.800 0.176 5.800 | |
| coldlaunch.pss 9.650 9.600 9.500 10.100 0.169 10.100 | |
| coldlaunch.rss 22.347 22.300 22.100 22.800 0.173 22.800 | |
| Iteration 6 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1976.800 1943.500 1359.000 2314.000 212.178 2298.000 | |
| coldlaunch.navigationInteractive 1983.733 1944.000 1359.000 2335.000 211.713 2320.000 | |
| coldlaunch.visuallyLoaded 1989.633 1961.500 1393.000 2336.000 209.058 2321.000 | |
| coldlaunch.contentInteractive 1991.933 1967.500 1393.000 2337.000 208.558 2325.000 | |
| coldlaunch.fullyLoaded 1992.833 1968.000 1394.000 2338.000 208.633 2326.000 | |
| coldlaunch.pss 10.000 10.000 9.900 10.100 0.052 10.100 | |
| coldlaunch.rss 22.637 22.600 22.600 22.800 0.071 22.800 | |
| coldlaunch.uss 5.627 5.600 5.600 5.800 0.068 5.800 | |
| Iteration 7 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1939.700 1893.000 1459.000 2254.000 197.803 2213.000 | |
| coldlaunch.navigationInteractive 1947.033 1902.500 1459.000 2255.000 198.213 2235.000 | |
| coldlaunch.visuallyLoaded 1953.100 1911.500 1460.000 2265.000 198.410 2235.000 | |
| coldlaunch.contentInteractive 1955.700 1917.000 1461.000 2266.000 199.434 2246.000 | |
| coldlaunch.fullyLoaded 1957.400 1918.000 1461.000 2267.000 199.505 2247.000 | |
| coldlaunch.uss 5.290 5.300 5.200 5.300 0.030 5.300 | |
| coldlaunch.pss 9.600 9.600 9.600 9.600 0.000 9.600 | |
| coldlaunch.rss 22.300 22.300 22.300 22.300 0.000 22.300 | |
| Iteration 8 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1827.333 1805.000 1566.000 2233.000 148.664 2091.000 | |
| coldlaunch.navigationInteractive 1833.367 1807.500 1567.000 2246.000 151.482 2112.000 | |
| coldlaunch.visuallyLoaded 1837.033 1816.000 1569.000 2247.000 150.924 2120.000 | |
| coldlaunch.contentInteractive 1838.700 1816.500 1577.000 2249.000 150.614 2120.000 | |
| coldlaunch.fullyLoaded 1839.800 1817.000 1578.000 2249.000 150.579 2120.000 | |
| coldlaunch.pss 9.997 10.000 9.900 10.000 0.018 10.000 | |
| coldlaunch.rss 22.617 22.600 22.600 22.700 0.037 22.700 | |
| coldlaunch.uss 5.600 5.600 5.600 5.600 0.000 5.600 | |
| Iteration 9 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1975.133 1946.000 1395.000 2345.000 203.519 2286.000 | |
| coldlaunch.navigationInteractive 1981.867 1959.000 1395.000 2346.000 204.453 2288.000 | |
| coldlaunch.visuallyLoaded 1989.100 1974.000 1396.000 2358.000 204.635 2292.000 | |
| coldlaunch.contentInteractive 1990.767 1974.500 1397.000 2359.000 204.833 2292.000 | |
| coldlaunch.fullyLoaded 1993.367 1976.000 1397.000 2364.000 206.297 2307.000 | |
| coldlaunch.uss 5.627 5.600 5.600 5.800 0.068 5.800 | |
| coldlaunch.rss 22.627 22.600 22.600 22.800 0.068 22.800 | |
| coldlaunch.pss 9.937 9.900 9.900 10.100 0.071 10.100 | |
| Iteration 10 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1857.600 1805.500 1496.000 2257.000 161.152 2249.000 | |
| coldlaunch.navigationInteractive 1867.533 1824.500 1496.000 2258.000 160.356 2256.000 | |
| coldlaunch.visuallyLoaded 1871.067 1829.500 1507.000 2269.000 160.747 2257.000 | |
| coldlaunch.contentInteractive 1872.333 1830.000 1508.000 2269.000 160.105 2257.000 | |
| coldlaunch.fullyLoaded 1873.967 1832.000 1508.000 2270.000 160.867 2258.000 | |
| coldlaunch.rss 22.787 22.800 22.600 22.800 0.050 22.800 | |
| coldlaunch.uss 5.787 5.800 5.600 5.800 0.050 5.800 | |
| coldlaunch.pss 10.087 10.100 9.900 10.100 0.050 10.100 | |
| fullyLoaded Coefficient of varation: 100 * (std dev / mean) | |
| Iteration 1: 12.17 | |
| Iteration 2: 9.21 | |
| Iteration 3: 9.27 | |
| Iteration 4: 7.28 | |
| Iteration 5: 10.58 | |
| Iteration 6: 10.46 | |
| Iteration 7: 10.19 | |
| Iteration 8: 8.18 | |
| Iteration 9: 10.34 | |
| Iteration 10: 8.58 | |
| Average: 9.62 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| AWS r3.xlarge ubuntu 14.04 | |
| Emulator (NOT emulator-kk) | |
| Cfg: 2048 RAM, 2047 partition (max partition size) | |
| Removed: -skin, -skindir, -camera-back | |
| Added: -wipe-data, -no-skin (rest of settings default) | |
| Added: '-net none -bt hci,null' to end of -qemu $TAIL_ARGS | |
| Added: | |
| -prop hw.gps=no \ | |
| -prop hw.gsmModem=no \ | |
| -prop hw.accelerometer=no \ | |
| -prop hw.audioInput=no \ | |
| -prop hw.audioOutput=no \ | |
| -prop hw.camera.back=none \ | |
| -prop hw.camera.front=none \ | |
| -prop hw.sensors.proximity=no \ | |
| -prop hw.sensors.magnetic_field=no \ | |
| -prop hw.sensors.orientation=no \ | |
| -prop hw.sensors.temperature=no \ | |
| -prop hw.bluetooth=no \ | |
| Cmd: DEBUG=* RUNS=30 APPS='template' RAPTOR_EMULATOR=1 node tests/raptor/emulator_launch_test.js | |
| Iterations: 10 (shutdown and restart emulator and do make raptor before each cmd iteration) | |
| Results direct from console: | |
| Iteration 1 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1944.333 1901.500 1485.000 2302.000 207.122 2251.000 | |
| coldlaunch.navigationInteractive 1952.700 1925.000 1495.000 2303.000 205.694 2252.000 | |
| coldlaunch.visuallyLoaded 1958.400 1926.000 1498.000 2311.000 205.523 2259.000 | |
| coldlaunch.contentInteractive 1959.833 1929.000 1498.000 2312.000 205.255 2259.000 | |
| coldlaunch.fullyLoaded 1962.633 1930.000 1512.000 2318.000 204.405 2260.000 | |
| coldlaunch.pss 10.223 10.300 9.900 10.300 0.154 10.300 | |
| coldlaunch.rss 23.013 23.100 22.700 23.100 0.159 23.100 | |
| coldlaunch.uss 5.910 6.000 5.600 6.000 0.158 6.000 | |
| Iteration 2 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 2020.033 2010.000 1715.000 2342.000 171.350 2342.000 | |
| coldlaunch.navigationInteractive 2028.133 2010.500 1716.000 2358.000 171.473 2346.000 | |
| coldlaunch.visuallyLoaded 2034.667 2014.500 1729.000 2368.000 170.792 2358.000 | |
| coldlaunch.contentInteractive 2037.533 2015.500 1730.000 2371.000 170.470 2368.000 | |
| coldlaunch.fullyLoaded 2039.300 2015.500 1731.000 2371.000 169.843 2369.000 | |
| coldlaunch.pss 10.220 10.200 9.800 10.400 0.135 10.400 | |
| coldlaunch.rss 22.977 22.950 22.600 23.200 0.131 23.100 | |
| coldlaunch.uss 5.873 5.850 5.500 6.000 0.126 6.000 | |
| Iteration 3 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1819.933 1807.000 1251.000 2332.000 189.840 2096.000 | |
| coldlaunch.navigationInteractive 1828.133 1816.500 1251.000 2343.000 190.771 2097.000 | |
| coldlaunch.visuallyLoaded 1832.800 1821.000 1252.000 2344.000 190.443 2114.000 | |
| coldlaunch.contentInteractive 1835.200 1822.500 1253.000 2345.000 190.440 2114.000 | |
| coldlaunch.fullyLoaded 1837.567 1828.000 1273.000 2345.000 188.149 2116.000 | |
| coldlaunch.uss 5.607 5.600 5.600 5.800 0.036 5.600 | |
| coldlaunch.pss 9.907 9.900 9.900 10.100 0.036 9.900 | |
| coldlaunch.rss 22.610 22.600 22.600 22.800 0.040 22.700 | |
| Iteration 4 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1885.900 1866.000 1617.000 2320.000 145.843 2113.000 | |
| coldlaunch.navigationInteractive 1900.367 1869.000 1618.000 2322.000 145.930 2125.000 | |
| coldlaunch.visuallyLoaded 1904.133 1874.500 1636.000 2326.000 143.640 2128.000 | |
| coldlaunch.contentInteractive 1906.400 1875.000 1637.000 2329.000 143.867 2133.000 | |
| coldlaunch.fullyLoaded 1908.233 1875.500 1638.000 2338.000 144.019 2134.000 | |
| coldlaunch.uss 5.607 5.600 5.600 5.800 0.036 5.600 | |
| coldlaunch.rss 22.607 22.600 22.600 22.800 0.036 22.600 | |
| coldlaunch.pss 9.907 9.900 9.900 10.100 0.036 9.900 | |
| Iteration 5 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1962.067 1925.500 1428.000 2376.000 202.383 2362.000 | |
| coldlaunch.navigationInteractive 1975.533 1943.500 1428.000 2397.000 204.220 2396.000 | |
| coldlaunch.visuallyLoaded 1980.300 1947.000 1429.000 2398.000 203.699 2396.000 | |
| coldlaunch.contentInteractive 1981.300 1948.000 1430.000 2400.000 204.243 2399.000 | |
| coldlaunch.fullyLoaded 1982.967 1948.000 1431.000 2402.000 204.583 2400.000 | |
| coldlaunch.pss 9.640 9.600 9.600 10.000 0.120 10.000 | |
| coldlaunch.uss 5.317 5.300 5.200 5.700 0.134 5.700 | |
| coldlaunch.rss 22.280 22.200 22.200 22.700 0.147 22.700 | |
| Iteration 6 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1985.233 1968.500 1376.000 2281.000 199.919 2277.000 | |
| coldlaunch.navigationInteractive 1996.633 1977.500 1377.000 2290.000 200.075 2281.000 | |
| coldlaunch.visuallyLoaded 2000.500 1980.500 1378.000 2293.000 199.546 2283.000 | |
| coldlaunch.contentInteractive 2002.333 1981.500 1379.000 2295.000 200.609 2283.000 | |
| coldlaunch.fullyLoaded 2004.533 1983.000 1410.000 2295.000 197.532 2284.000 | |
| coldlaunch.pss 9.933 9.900 9.900 10.100 0.075 10.100 | |
| coldlaunch.rss 22.633 22.600 22.600 22.800 0.075 22.800 | |
| coldlaunch.uss 5.633 5.600 5.600 5.800 0.075 5.800 | |
| Iteration 7 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1840.800 1816.500 1399.000 2251.000 183.257 2146.000 | |
| coldlaunch.navigationInteractive 1853.067 1820.500 1401.000 2252.000 183.371 2161.000 | |
| coldlaunch.visuallyLoaded 1855.567 1825.000 1402.000 2255.000 183.735 2162.000 | |
| coldlaunch.contentInteractive 1858.167 1826.000 1403.000 2256.000 184.735 2185.000 | |
| coldlaunch.fullyLoaded 1859.533 1826.500 1403.000 2258.000 184.568 2185.000 | |
| coldlaunch.uss 5.600 5.600 5.600 5.600 0.000 5.600 | |
| coldlaunch.rss 22.610 22.600 22.600 22.700 0.030 22.700 | |
| coldlaunch.pss 9.997 10.000 9.900 10.000 0.018 10.000 | |
| Iteration 8 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1755.233 1766.500 1529.000 2166.000 127.871 1925.000 | |
| coldlaunch.navigationInteractive 1763.333 1775.000 1533.000 2173.000 129.907 1925.000 | |
| coldlaunch.visuallyLoaded 1766.900 1777.500 1534.000 2173.000 129.408 1936.000 | |
| coldlaunch.contentInteractive 1770.033 1779.500 1534.000 2174.000 129.191 1937.000 | |
| coldlaunch.fullyLoaded 1771.633 1780.000 1535.000 2174.000 128.873 1938.000 | |
| coldlaunch.pss 10.117 10.100 10.100 10.400 0.064 10.300 | |
| coldlaunch.uss 5.813 5.800 5.800 6.000 0.050 6.000 | |
| coldlaunch.rss 22.917 22.900 22.900 23.200 0.064 23.100 | |
| Iteration 9 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1973.533 1931.500 1697.000 2244.000 138.011 2188.000 | |
| coldlaunch.navigationInteractive 1984.533 1938.500 1709.000 2267.000 140.850 2209.000 | |
| coldlaunch.visuallyLoaded 1987.567 1940.500 1709.000 2268.000 140.190 2209.000 | |
| coldlaunch.contentInteractive 1991.967 1954.000 1718.000 2268.000 139.096 2215.000 | |
| coldlaunch.fullyLoaded 1993.633 1954.500 1718.000 2269.000 139.066 2219.000 | |
| coldlaunch.uss 5.720 5.800 5.200 5.800 0.183 5.800 | |
| coldlaunch.rss 22.753 22.800 22.200 22.900 0.203 22.900 | |
| coldlaunch.pss 10.053 10.100 9.500 10.200 0.203 10.200 | |
| Iteration 10 | |
| Metric Mean Median Min Max StdDev p95 | |
| -------------------------------- -------- -------- -------- -------- ------- -------- | |
| coldlaunch.navigationLoaded 1905.233 1890.500 1534.000 2246.000 172.073 2201.000 | |
| coldlaunch.navigationInteractive 1914.500 1893.000 1544.000 2248.000 170.388 2208.000 | |
| coldlaunch.visuallyLoaded 1918.600 1900.500 1544.000 2254.000 170.506 2209.000 | |
| coldlaunch.contentInteractive 1921.167 1901.500 1547.000 2255.000 170.572 2209.000 | |
| coldlaunch.fullyLoaded 1922.433 1902.000 1548.000 2256.000 170.190 2209.000 | |
| coldlaunch.pss 9.923 9.900 9.900 10.100 0.062 10.100 | |
| coldlaunch.rss 22.623 22.600 22.600 22.800 0.062 22.800 | |
| coldlaunch.uss 5.620 5.600 5.600 5.800 0.060 5.800 | |
| fullyLoaded Coefficient of varation: 100 * (std dev / mean) | |
| Iteration 1: 10.41 | |
| Iteration 2: 8.32 | |
| Iteration 3: 10.23 | |
| Iteration 4: 7.54 | |
| Iteration 5: 10.31 | |
| Iteration 6: 9.85 | |
| Iteration 7: 9.92 | |
| Iteration 8: 7.27 | |
| Iteration 9: 6.97 | |
| Iteration 10: 8.85 | |
| Average: 8.96 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment