Skip to content

Instantly share code, notes, and snippets.

@mmarchini
Created March 5, 2018 14:40
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save mmarchini/6b3fd16a57c1f7509965ed65c80bce96 to your computer and use it in GitHub Desktop.
Save mmarchini/6b3fd16a57c1f7509965ed65c80bce96 to your computer and use it in GitHub Desktop.
Benchmark results for mmarchini/node@hack-the-stack
$ node benchmark/compare.js --old ./node-master --new ./node-hack-the-stack http > compare-hack-the-stack.http.csv
$ cat compare-hack-the-stack.http.csv  | Rscript benchmark/compare.R
                                                                                                confidence improvement accuracy (*)    (**)   (***)
 http/bench-parser.js n=100000 len=16                                                                          -1.17 %       ±3.73%  ±4.96%  ±6.46%
 http/bench-parser.js n=100000 len=32                                                                          -1.55 %       ±3.19%  ±4.24%  ±5.52%
 http/bench-parser.js n=100000 len=4                                                                           -2.90 %       ±4.20%  ±5.59%  ±7.27%
 http/bench-parser.js n=100000 len=8                                                                           -2.39 %       ±3.41%  ±4.54%  ±5.91%
 http/check_invalid_header_char.js n=1000000 input=''                                                           1.93 %       ±6.12%  ±8.15% ±10.61%
 http/check_invalid_header_char.js n=1000000 input='\177'                                                       5.83 %       ±8.53% ±11.35% ±14.79%
 http/check_invalid_header_char.js n=1000000 input='\\t\\t\\t\\t\\t\\t\\t\\t\\t\\tFoo bar baz'                  1.09 %       ±5.91%  ±7.87% ±10.25%
 http/check_invalid_header_char.js n=1000000 input='1'                                                         -0.43 %       ±6.91%  ±9.20% ±11.98%
 http/check_invalid_header_char.js n=1000000 input='20091'                                                      3.63 %       ±8.78% ±11.68% ±15.21%
 http/check_invalid_header_char.js n=1000000 input='close'                                              **     -8.74 %       ±6.48%  ±8.66% ±11.34%
 http/check_invalid_header_char.js n=1000000 input='en-US'                                                      0.92 %       ±8.32% ±11.08% ±14.43%
 http/check_invalid_header_char.js n=1000000 input='foo\\nbar'                                                  2.59 %       ±7.72% ±10.27% ±13.36%
 http/check_invalid_header_char.js n=1000000 input='group_acmeair'                                              2.62 %       ±6.72%  ±8.95% ±11.67%
 http/check_invalid_header_char.js n=1000000 input='gzip'                                                      -2.80 %       ±6.08%  ±8.10% ±10.56%
 http/check_invalid_header_char.js n=1000000 input='keep-alive'                                                 3.25 %       ±6.30%  ±8.39% ±10.95%
 http/check_invalid_header_char.js n=1000000 input='LONG_AND_INVALID'                                          -3.90 %       ±4.63%  ±6.17%  ±8.03%
 http/check_invalid_header_char.js n=1000000 input='private'                                                   -1.55 %       ±7.49%  ±9.96% ±12.97%
 http/check_invalid_header_char.js n=1000000 input='SAMEORIGIN'                                                 0.11 %       ±6.89%  ±9.17% ±11.94%
 http/check_invalid_header_char.js n=1000000 input='Sat, 07 May 2016 16:54:48 GMT'                              2.26 %       ±5.01%  ±6.67%  ±8.69%
 http/check_invalid_header_char.js n=1000000 input='text/html; charset=utf-8'                                  -1.18 %       ±5.46%  ±7.27%  ±9.47%
 http/check_invalid_header_char.js n=1000000 input='text/plain'                                                -1.16 %       ±6.00%  ±7.98% ±10.38%
 http/check_invalid_header_char.js n=1000000 input='中文呢'                                                    -3.55 %       ±5.58%  ±7.47%  ±9.80%
 http/check_is_http_token.js n=1000000 key=':'                                                                 -2.68 %       ±8.76% ±11.66% ±15.18%
 http/check_is_http_token.js n=1000000 key=':alternate-protocol'                                               -4.39 %       ±6.41%  ±8.53% ±11.10%
 http/check_is_http_token.js n=1000000 key='((((())))'                                                          1.08 %       ±7.37%  ±9.81% ±12.76%
 http/check_is_http_token.js n=1000000 key='@@'                                                                -1.07 %       ±7.20%  ±9.59% ±12.48%
 http/check_is_http_token.js n=1000000 key='Accept-Ranges'                                                     -2.41 %       ±5.74%  ±7.65%  ±9.96%
 http/check_is_http_token.js n=1000000 key='alt-svc'                                                           -3.30 %       ±6.74%  ±8.97% ±11.69%
 http/check_is_http_token.js n=1000000 key='alternate-protocol:'                                        **      7.04 %       ±4.79%  ±6.38%  ±8.34%
 http/check_is_http_token.js n=1000000 key='alternate-protocol'                                                -4.79 %       ±5.91%  ±7.89% ±10.32%
 http/check_is_http_token.js n=1000000 key='Cache-Control'                                                     -2.02 %       ±6.77%  ±9.01% ±11.74%
 http/check_is_http_token.js n=1000000 key='Connection'                                                        -2.37 %       ±5.83%  ±7.75% ±10.09%
 http/check_is_http_token.js n=1000000 key='Content-Encoding'                                                  -1.57 %       ±5.93%  ±7.89% ±10.27%
 http/check_is_http_token.js n=1000000 key='content-length'                                                    -0.51 %       ±5.37%  ±7.17%  ±9.37%
 http/check_is_http_token.js n=1000000 key='Content-Location'                                                   0.46 %       ±4.99%  ±6.65%  ±8.66%
 http/check_is_http_token.js n=1000000 key='content-type'                                                *     -6.20 %       ±5.24%  ±7.02%  ±9.21%
 http/check_is_http_token.js n=1000000 key='Content-Type'                                                      -1.05 %       ±6.36%  ±8.46% ±11.01%
 http/check_is_http_token.js n=1000000 key='date'                                                               1.82 %       ±7.76% ±10.32% ±13.44%
 http/check_is_http_token.js n=1000000 key='ETag'                                                              -0.85 %       ±5.91%  ±7.86% ±10.23%
 http/check_is_http_token.js n=1000000 key='Expires'                                                            0.14 %       ±7.98% ±10.62% ±13.83%
 http/check_is_http_token.js n=1000000 key='Keep-Alive'                                                        -1.88 %       ±5.82%  ±7.74% ±10.08%
 http/check_is_http_token.js n=1000000 key='Last-Modified'                                                      1.67 %       ±6.54%  ±8.70% ±11.32%
 http/check_is_http_token.js n=1000000 key='location'                                                           4.49 %       ±7.01%  ±9.34% ±12.19%
 http/check_is_http_token.js n=1000000 key='server'                                                             0.20 %       ±6.53%  ±8.69% ±11.31%
 http/check_is_http_token.js n=1000000 key='Server'                                                             2.54 %       ±6.76%  ±9.00% ±11.72%
 http/check_is_http_token.js n=1000000 key='status'                                                            -0.91 %       ±5.76%  ±7.66%  ±9.97%
 http/check_is_http_token.js n=1000000 key='TCN'                                                               -0.20 %       ±4.95%  ±6.59%  ±8.58%
 http/check_is_http_token.js n=1000000 key='Transfer-Encoding'                                                 -2.35 %       ±6.22%  ±8.28% ±10.77%
 http/check_is_http_token.js n=1000000 key='Vary'                                                               1.41 %       ±5.30%  ±7.06%  ±9.19%
 http/check_is_http_token.js n=1000000 key='version'                                                            3.68 %       ±6.07%  ±8.09% ±10.56%
 http/check_is_http_token.js n=1000000 key='x-frame-options'                                                    2.22 %       ±6.19%  ±8.24% ±10.73%
 http/check_is_http_token.js n=1000000 key='x-xss-protection'                                                  -0.03 %       ±5.99%  ±7.97% ±10.38%
 http/check_is_http_token.js n=1000000 key='中文呢'                                                            -3.43 %       ±7.48%  ±9.96% ±12.98%
 http/chunked.js c=100 len=1 n=1 benchmarker='test-double'                                                      0.70 %       ±1.07%  ±1.43%  ±1.86%
 http/chunked.js c=100 len=1 n=16 benchmarker='test-double'                                                    -0.18 %       ±0.84%  ±1.11%  ±1.45%
 http/chunked.js c=100 len=1 n=4 benchmarker='test-double'                                                     -0.41 %       ±0.84%  ±1.12%  ±1.46%
 http/chunked.js c=100 len=1 n=8 benchmarker='test-double'                                                     -0.41 %       ±0.81%  ±1.08%  ±1.40%
 http/chunked.js c=100 len=256 n=1 benchmarker='test-double'                                                    0.29 %       ±0.80%  ±1.07%  ±1.39%
 http/chunked.js c=100 len=256 n=16 benchmarker='test-double'                                                  -0.37 %       ±0.77%  ±1.02%  ±1.33%
 http/chunked.js c=100 len=256 n=4 benchmarker='test-double'                                                    0.03 %       ±1.10%  ±1.47%  ±1.91%
 http/chunked.js c=100 len=256 n=8 benchmarker='test-double'                                                   -0.03 %       ±1.01%  ±1.34%  ±1.74%
 http/chunked.js c=100 len=64 n=1 benchmarker='test-double'                                                    -0.09 %       ±1.22%  ±1.62%  ±2.11%
 http/chunked.js c=100 len=64 n=16 benchmarker='test-double'                                             *     -1.23 %       ±0.99%  ±1.31%  ±1.71%
 http/chunked.js c=100 len=64 n=4 benchmarker='test-double'                                                    -0.16 %       ±0.93%  ±1.23%  ±1.60%
 http/chunked.js c=100 len=64 n=8 benchmarker='test-double'                                                    -0.78 %       ±0.83%  ±1.10%  ±1.44%
 http/client-request-body.js method='end' len=1024 type='asc' dur=5                                      *     -2.75 %       ±2.29%  ±3.04%  ±3.96%
 http/client-request-body.js method='end' len=1024 type='buf' dur=5                                     **     -3.55 %       ±2.50%  ±3.33%  ±4.33%
 http/client-request-body.js method='end' len=1024 type='utf' dur=5                                      *     -2.92 %       ±2.35%  ±3.12%  ±4.06%
 http/client-request-body.js method='end' len=256 type='asc' dur=5                                             -1.28 %       ±2.83%  ±3.76%  ±4.90%
 http/client-request-body.js method='end' len=256 type='buf' dur=5                                             -1.79 %       ±2.55%  ±3.40%  ±4.42%
 http/client-request-body.js method='end' len=256 type='utf' dur=5                                             -1.71 %       ±2.53%  ±3.37%  ±4.39%
 http/client-request-body.js method='end' len=32 type='asc' dur=5                                      ***     -4.52 %       ±2.00%  ±2.66%  ±3.46%
 http/client-request-body.js method='end' len=32 type='buf' dur=5                                              -1.88 %       ±2.06%  ±2.74%  ±3.56%
 http/client-request-body.js method='end' len=32 type='utf' dur=5                                              -1.60 %       ±2.75%  ±3.66%  ±4.77%
 http/client-request-body.js method='write' len=1024 type='asc' dur=5                                    *     -2.98 %       ±2.60%  ±3.48%  ±4.56%
 http/client-request-body.js method='write' len=1024 type='buf' dur=5                                    *     -2.70 %       ±2.28%  ±3.03%  ±3.95%
 http/client-request-body.js method='write' len=1024 type='utf' dur=5                                    *     -3.36 %       ±2.99%  ±3.98%  ±5.18%
 http/client-request-body.js method='write' len=256 type='asc' dur=5                                           -0.52 %       ±2.67%  ±3.56%  ±4.63%
 http/client-request-body.js method='write' len=256 type='buf' dur=5                                     *     -2.98 %       ±2.71%  ±3.61%  ±4.69%
 http/client-request-body.js method='write' len=256 type='utf' dur=5                                    **     -3.52 %       ±2.44%  ±3.25%  ±4.23%
 http/client-request-body.js method='write' len=32 type='asc' dur=5                                     **     -3.70 %       ±2.75%  ±3.66%  ±4.76%
 http/client-request-body.js method='write' len=32 type='buf' dur=5                                      *     -2.54 %       ±2.18%  ±2.90%  ±3.78%
 http/client-request-body.js method='write' len=32 type='utf' dur=5                                            -0.59 %       ±2.32%  ±3.09%  ±4.02%
 http/cluster.js c=50 len=1024 type='buffer' benchmarker='test-double'                                         -1.11 %       ±3.15%  ±4.19%  ±5.46%
 http/cluster.js c=50 len=1024 type='bytes' benchmarker='test-double'                                          -0.51 %       ±3.25%  ±4.32%  ±5.62%
 http/cluster.js c=50 len=102400 type='buffer' benchmarker='test-double'                                       -2.38 %       ±2.96%  ±3.93%  ±5.12%
 http/cluster.js c=50 len=102400 type='bytes' benchmarker='test-double'                                        -0.36 %       ±2.80%  ±3.72%  ±4.85%
 http/cluster.js c=50 len=4 type='buffer' benchmarker='test-double'                                            -0.47 %       ±2.92%  ±3.88%  ±5.05%
 http/cluster.js c=50 len=4 type='bytes' benchmarker='test-double'                                             -0.21 %       ±2.95%  ±3.93%  ±5.12%
 http/cluster.js c=500 len=1024 type='buffer' benchmarker='test-double'                                  *     -3.78 %       ±3.13%  ±4.16%  ±5.42%
 http/cluster.js c=500 len=1024 type='bytes' benchmarker='test-double'                                         -0.37 %       ±3.07%  ±4.09%  ±5.32%
 http/cluster.js c=500 len=102400 type='buffer' benchmarker='test-double'                                      -1.28 %       ±2.98%  ±3.97%  ±5.16%
 http/cluster.js c=500 len=102400 type='bytes' benchmarker='test-double'                                       -2.01 %       ±2.75%  ±3.66%  ±4.77%
 http/cluster.js c=500 len=4 type='buffer' benchmarker='test-double'                                           -2.17 %       ±2.72%  ±3.63%  ±4.73%
 http/cluster.js c=500 len=4 type='bytes' benchmarker='test-double'                                             0.65 %       ±2.77%  ±3.69%  ±4.81%
 http/create-clientrequest.js n=1000000 len=1                                                                  -0.29 %       ±4.39%  ±5.85%  ±7.63%
 http/create-clientrequest.js n=1000000 len=128                                                                 1.79 %       ±3.02%  ±4.01%  ±5.23%
 http/create-clientrequest.js n=1000000 len=16                                                                  0.30 %       ±3.62%  ±4.82%  ±6.28%
 http/create-clientrequest.js n=1000000 len=32                                                                  0.55 %       ±3.25%  ±4.33%  ±5.64%
 http/create-clientrequest.js n=1000000 len=64                                                                  1.00 %       ±3.29%  ±4.39%  ±5.74%
 http/create-clientrequest.js n=1000000 len=8                                                                   0.56 %       ±3.10%  ±4.13%  ±5.39%
 http/end-vs-write-end.js method='end' c=100 len=1048576 type='asc' benchmarker='test-double'                   1.21 %       ±3.58%  ±4.76%  ±6.20%
 http/end-vs-write-end.js method='end' c=100 len=1048576 type='buf' benchmarker='test-double'                   1.10 %       ±2.87%  ±3.81%  ±4.96%
 http/end-vs-write-end.js method='end' c=100 len=1048576 type='utf' benchmarker='test-double'                   0.65 %       ±4.00%  ±5.32%  ±6.92%
 http/end-vs-write-end.js method='end' c=100 len=131072 type='asc' benchmarker='test-double'                    0.09 %       ±3.19%  ±4.24%  ±5.53%
 http/end-vs-write-end.js method='end' c=100 len=131072 type='buf' benchmarker='test-double'                    0.00 %       ±4.54%  ±6.04%  ±7.86%
 http/end-vs-write-end.js method='end' c=100 len=131072 type='utf' benchmarker='test-double'                   -1.42 %       ±3.35%  ±4.45%  ±5.80%
 http/end-vs-write-end.js method='end' c=100 len=262144 type='asc' benchmarker='test-double'                    1.41 %       ±3.27%  ±4.36%  ±5.68%
 http/end-vs-write-end.js method='end' c=100 len=262144 type='buf' benchmarker='test-double'                    2.32 %       ±5.05%  ±6.73%  ±8.76%
 http/end-vs-write-end.js method='end' c=100 len=262144 type='utf' benchmarker='test-double'                    0.52 %       ±3.42%  ±4.55%  ±5.93%
 http/end-vs-write-end.js method='end' c=100 len=65536 type='asc' benchmarker='test-double'                    -0.73 %       ±3.11%  ±4.14%  ±5.39%
 http/end-vs-write-end.js method='end' c=100 len=65536 type='buf' benchmarker='test-double'                    -2.18 %       ±5.00%  ±6.65%  ±8.66%
 http/end-vs-write-end.js method='end' c=100 len=65536 type='utf' benchmarker='test-double'                    -0.71 %       ±3.97%  ±5.29%  ±6.88%
 http/end-vs-write-end.js method='write' c=100 len=1048576 type='asc' benchmarker='test-double'                 3.32 %       ±4.31%  ±5.74%  ±7.47%
 http/end-vs-write-end.js method='write' c=100 len=1048576 type='buf' benchmarker='test-double'                -1.16 %       ±3.02%  ±4.01%  ±5.22%
 http/end-vs-write-end.js method='write' c=100 len=1048576 type='utf' benchmarker='test-double'                 0.68 %       ±4.45%  ±5.93%  ±7.71%
 http/end-vs-write-end.js method='write' c=100 len=131072 type='asc' benchmarker='test-double'                  0.03 %       ±4.36%  ±5.80%  ±7.55%
 http/end-vs-write-end.js method='write' c=100 len=131072 type='buf' benchmarker='test-double'                 -0.88 %       ±5.27%  ±7.02%  ±9.14%
 http/end-vs-write-end.js method='write' c=100 len=131072 type='utf' benchmarker='test-double'                  0.11 %       ±3.98%  ±5.29%  ±6.89%
 http/end-vs-write-end.js method='write' c=100 len=262144 type='asc' benchmarker='test-double'                 -0.85 %       ±4.10%  ±5.46%  ±7.10%
 http/end-vs-write-end.js method='write' c=100 len=262144 type='buf' benchmarker='test-double'                  0.96 %       ±4.78%  ±6.36%  ±8.27%
 http/end-vs-write-end.js method='write' c=100 len=262144 type='utf' benchmarker='test-double'                  1.09 %       ±3.91%  ±5.21%  ±6.78%
 http/end-vs-write-end.js method='write' c=100 len=65536 type='asc' benchmarker='test-double'                   1.59 %       ±4.39%  ±5.85%  ±7.61%
 http/end-vs-write-end.js method='write' c=100 len=65536 type='buf' benchmarker='test-double'                  -1.83 %       ±5.56%  ±7.39%  ±9.62%
 http/end-vs-write-end.js method='write' c=100 len=65536 type='utf' benchmarker='test-double'                   2.57 %       ±4.97%  ±6.62%  ±8.61%
 http/http_server_for_chunky_client.js type='send' n=2000 len=1                                         **     -3.49 %       ±2.28%  ±3.04%  ±3.95%
 http/http_server_for_chunky_client.js type='send' n=2000 len=128                                        *     -3.57 %       ±3.01%  ±4.01%  ±5.24%
 http/http_server_for_chunky_client.js type='send' n=2000 len=16                                       ***     -4.77 %       ±2.38%  ±3.17%  ±4.14%
 http/http_server_for_chunky_client.js type='send' n=2000 len=32                                        **     -3.86 %       ±2.89%  ±3.84%  ±5.00%
 http/http_server_for_chunky_client.js type='send' n=2000 len=4                                          *     -2.85 %       ±2.43%  ±3.23%  ±4.21%
 http/http_server_for_chunky_client.js type='send' n=2000 len=64                                        **     -4.24 %       ±2.71%  ±3.62%  ±4.72%
 http/http_server_for_chunky_client.js type='send' n=2000 len=8                                                -1.82 %       ±2.26%  ±3.01%  ±3.93%
 http/http_server_for_chunky_client.js type='send' n=5 len=1                                                   -4.59 %       ±4.81%  ±6.41%  ±8.36%
 http/http_server_for_chunky_client.js type='send' n=5 len=128                                                -12.47 %      ±19.73% ±26.26% ±34.19%
 http/http_server_for_chunky_client.js type='send' n=5 len=16                                                  -1.06 %      ±16.14% ±21.48% ±27.98%
 http/http_server_for_chunky_client.js type='send' n=5 len=32                                                 -15.46 %      ±17.95% ±23.88% ±31.09%
 http/http_server_for_chunky_client.js type='send' n=5 len=4                                                   -7.40 %      ±13.35% ±17.76% ±23.12%
 http/http_server_for_chunky_client.js type='send' n=5 len=64                                                  -0.11 %      ±17.42% ±23.19% ±30.21%
 http/http_server_for_chunky_client.js type='send' n=5 len=8                                                    7.43 %      ±16.56% ±22.05% ±28.74%
 http/http_server_for_chunky_client.js type='send' n=50 len=1                                                   0.48 %      ±12.15% ±16.17% ±21.04%
 http/http_server_for_chunky_client.js type='send' n=50 len=128                                               -12.00 %      ±12.62% ±16.79% ±21.85%
 http/http_server_for_chunky_client.js type='send' n=50 len=16                                                  2.56 %      ±12.20% ±16.23% ±21.13%
 http/http_server_for_chunky_client.js type='send' n=50 len=32                                                 -4.91 %      ±14.87% ±19.78% ±25.75%
 http/http_server_for_chunky_client.js type='send' n=50 len=4                                                   5.39 %      ±14.00% ±18.63% ±24.25%
 http/http_server_for_chunky_client.js type='send' n=50 len=64                                                 -6.35 %      ±13.71% ±18.26% ±23.81%
 http/http_server_for_chunky_client.js type='send' n=50 len=8                                                  -2.76 %      ±12.32% ±16.39% ±21.33%
 http/http_server_for_chunky_client.js type='send' n=500 len=1                                                 -3.95 %       ±4.16%  ±5.53%  ±7.20%
 http/http_server_for_chunky_client.js type='send' n=500 len=128                                               -1.01 %       ±3.95%  ±5.26%  ±6.85%
 http/http_server_for_chunky_client.js type='send' n=500 len=16                                                -3.75 %       ±3.85%  ±5.13%  ±6.67%
 http/http_server_for_chunky_client.js type='send' n=500 len=32                                                -0.99 %       ±5.20%  ±6.92%  ±9.00%
 http/http_server_for_chunky_client.js type='send' n=500 len=4                                           *     -5.05 %       ±3.92%  ±5.22%  ±6.79%
 http/http_server_for_chunky_client.js type='send' n=500 len=64                                                -4.61 %       ±4.75%  ±6.33%  ±8.25%
 http/http_server_for_chunky_client.js type='send' n=500 len=8                                                 -2.77 %       ±4.66%  ±6.20%  ±8.07%
 http/set_header.js n=1000000 value='Connection'                                                               -1.83 %       ±4.43%  ±5.92%  ±7.73%
 http/set_header.js n=1000000 value='Content-Length'                                                            2.03 %       ±3.04%  ±4.04%  ±5.26%
 http/set_header.js n=1000000 value='Content-Type'                                                             -0.92 %       ±4.12%  ±5.49%  ±7.15%
 http/set_header.js n=1000000 value='Set-Cookie'                                                               -2.00 %       ±3.92%  ±5.22%  ±6.79%
 http/set_header.js n=1000000 value='Transfer-Encoding'                                                         0.18 %       ±3.67%  ±4.89%  ±6.36%
 http/set_header.js n=1000000 value='Vary'                                                                     -0.89 %       ±3.57%  ±4.74%  ±6.18%
 http/set_header.js n=1000000 value='X-Powered-By'                                                      **     -4.24 %       ±3.06%  ±4.07%  ±5.31%
 http/set-header.js res='normal' benchmarker='test-double'                                               *     -3.59 %       ±3.36%  ±4.47%  ±5.82%
 http/set-header.js res='setHeader' benchmarker='test-double'                                                  -1.36 %       ±2.84%  ±3.78%  ±4.93%
 http/set-header.js res='setHeaderWH' benchmarker='test-double'                                                -1.83 %       ±2.50%  ±3.32%  ±4.33%
 http/simple.js chunkedEnc=0 c=50 chunks=1 len=1024 type='buffer' benchmarker='test-double'                    -2.56 %       ±2.87%  ±3.82%  ±4.97%
 http/simple.js chunkedEnc=0 c=50 chunks=1 len=1024 type='bytes' benchmarker='test-double'                     -2.47 %       ±3.25%  ±4.32%  ±5.63%
 http/simple.js chunkedEnc=0 c=50 chunks=1 len=102400 type='buffer' benchmarker='test-double'                  -2.60 %       ±3.51%  ±4.67%  ±6.08%
 http/simple.js chunkedEnc=0 c=50 chunks=1 len=102400 type='bytes' benchmarker='test-double'                   -1.52 %       ±1.78%  ±2.37%  ±3.09%
 http/simple.js chunkedEnc=0 c=50 chunks=1 len=4 type='buffer' benchmarker='test-double'                       -0.01 %       ±3.09%  ±4.11%  ±5.36%
 http/simple.js chunkedEnc=0 c=50 chunks=1 len=4 type='bytes' benchmarker='test-double'                        -0.07 %       ±2.74%  ±3.65%  ±4.75%
 http/simple.js chunkedEnc=0 c=50 chunks=4 len=1024 type='buffer' benchmarker='test-double'                    -0.69 %       ±2.93%  ±3.90%  ±5.07%
 http/simple.js chunkedEnc=0 c=50 chunks=4 len=1024 type='bytes' benchmarker='test-double'                     -1.92 %       ±2.81%  ±3.74%  ±4.88%
 http/simple.js chunkedEnc=0 c=50 chunks=4 len=102400 type='buffer' benchmarker='test-double'                  -1.39 %       ±3.81%  ±5.07%  ±6.60%
 http/simple.js chunkedEnc=0 c=50 chunks=4 len=102400 type='bytes' benchmarker='test-double'                    1.10 %       ±2.26%  ±3.01%  ±3.92%
 http/simple.js chunkedEnc=0 c=50 chunks=4 len=4 type='buffer' benchmarker='test-double'                       -1.63 %       ±2.56%  ±3.41%  ±4.44%
 http/simple.js chunkedEnc=0 c=50 chunks=4 len=4 type='bytes' benchmarker='test-double'                        -0.22 %       ±3.01%  ±4.01%  ±5.24%
 http/simple.js chunkedEnc=0 c=500 chunks=1 len=1024 type='buffer' benchmarker='test-double'                   -1.43 %       ±3.11%  ±4.15%  ±5.41%
 http/simple.js chunkedEnc=0 c=500 chunks=1 len=1024 type='bytes' benchmarker='test-double'                    -0.84 %       ±3.34%  ±4.45%  ±5.80%
 http/simple.js chunkedEnc=0 c=500 chunks=1 len=102400 type='buffer' benchmarker='test-double'                 -1.83 %       ±3.40%  ±4.53%  ±5.90%
 http/simple.js chunkedEnc=0 c=500 chunks=1 len=102400 type='bytes' benchmarker='test-double'            *     -1.61 %       ±1.47%  ±1.95%  ±2.54%
 http/simple.js chunkedEnc=0 c=500 chunks=1 len=4 type='buffer' benchmarker='test-double'                      -1.54 %       ±2.55%  ±3.39%  ±4.42%
 http/simple.js chunkedEnc=0 c=500 chunks=1 len=4 type='bytes' benchmarker='test-double'                       -1.71 %       ±2.60%  ±3.46%  ±4.50%
 http/simple.js chunkedEnc=0 c=500 chunks=4 len=1024 type='buffer' benchmarker='test-double'                   -1.17 %       ±2.50%  ±3.33%  ±4.34%
 http/simple.js chunkedEnc=0 c=500 chunks=4 len=1024 type='bytes' benchmarker='test-double'                    -0.18 %       ±2.62%  ±3.48%  ±4.53%
 http/simple.js chunkedEnc=0 c=500 chunks=4 len=102400 type='buffer' benchmarker='test-double'                 -2.06 %       ±3.39%  ±4.51%  ±5.87%
 http/simple.js chunkedEnc=0 c=500 chunks=4 len=102400 type='bytes' benchmarker='test-double'                  -2.44 %       ±3.10%  ±4.12%  ±5.36%
 http/simple.js chunkedEnc=0 c=500 chunks=4 len=4 type='buffer' benchmarker='test-double'                      -2.06 %       ±2.51%  ±3.34%  ±4.35%
 http/simple.js chunkedEnc=0 c=500 chunks=4 len=4 type='bytes' benchmarker='test-double'                       -2.76 %       ±3.10%  ±4.13%  ±5.37%
 http/simple.js chunkedEnc=1 c=50 chunks=1 len=1024 type='buffer' benchmarker='test-double'                    -0.27 %       ±2.00%  ±2.66%  ±3.47%
 http/simple.js chunkedEnc=1 c=50 chunks=1 len=1024 type='bytes' benchmarker='test-double'                     -2.67 %       ±2.97%  ±3.96%  ±5.15%
 http/simple.js chunkedEnc=1 c=50 chunks=1 len=102400 type='buffer' benchmarker='test-double'                   0.04 %       ±3.65%  ±4.86%  ±6.33%
 http/simple.js chunkedEnc=1 c=50 chunks=1 len=102400 type='bytes' benchmarker='test-double'                   -0.93 %       ±3.05%  ±4.06%  ±5.29%
 http/simple.js chunkedEnc=1 c=50 chunks=1 len=4 type='buffer' benchmarker='test-double'                        0.43 %       ±2.58%  ±3.43%  ±4.46%
 http/simple.js chunkedEnc=1 c=50 chunks=1 len=4 type='bytes' benchmarker='test-double'                        -1.21 %       ±3.06%  ±4.08%  ±5.31%
 http/simple.js chunkedEnc=1 c=50 chunks=4 len=1024 type='buffer' benchmarker='test-double'                    -2.16 %       ±2.37%  ±3.15%  ±4.10%
 http/simple.js chunkedEnc=1 c=50 chunks=4 len=1024 type='bytes' benchmarker='test-double'                     -0.40 %       ±3.11%  ±4.16%  ±5.45%
 http/simple.js chunkedEnc=1 c=50 chunks=4 len=102400 type='buffer' benchmarker='test-double'                  -1.63 %       ±3.69%  ±4.91%  ±6.39%
 http/simple.js chunkedEnc=1 c=50 chunks=4 len=102400 type='bytes' benchmarker='test-double'             *     -3.09 %       ±2.70%  ±3.60%  ±4.68%
 http/simple.js chunkedEnc=1 c=50 chunks=4 len=4 type='buffer' benchmarker='test-double'                 *     -2.95 %       ±2.42%  ±3.22%  ±4.20%
 http/simple.js chunkedEnc=1 c=50 chunks=4 len=4 type='bytes' benchmarker='test-double'                        -0.68 %       ±3.01%  ±4.01%  ±5.23%
 http/simple.js chunkedEnc=1 c=500 chunks=1 len=1024 type='buffer' benchmarker='test-double'                   -0.54 %       ±2.32%  ±3.08%  ±4.02%
 http/simple.js chunkedEnc=1 c=500 chunks=1 len=1024 type='bytes' benchmarker='test-double'              *     -2.98 %       ±2.68%  ±3.57%  ±4.65%
 http/simple.js chunkedEnc=1 c=500 chunks=1 len=102400 type='buffer' benchmarker='test-double'                 -2.13 %       ±3.70%  ±4.92%  ±6.41%
 http/simple.js chunkedEnc=1 c=500 chunks=1 len=102400 type='bytes' benchmarker='test-double'                  -0.64 %       ±3.02%  ±4.02%  ±5.23%
 http/simple.js chunkedEnc=1 c=500 chunks=1 len=4 type='buffer' benchmarker='test-double'                      -0.66 %       ±2.58%  ±3.44%  ±4.50%
 http/simple.js chunkedEnc=1 c=500 chunks=1 len=4 type='bytes' benchmarker='test-double'                 *     -2.70 %       ±2.47%  ±3.29%  ±4.29%
 http/simple.js chunkedEnc=1 c=500 chunks=4 len=1024 type='buffer' benchmarker='test-double'                   -0.23 %       ±2.75%  ±3.65%  ±4.75%
 http/simple.js chunkedEnc=1 c=500 chunks=4 len=1024 type='bytes' benchmarker='test-double'                    -2.81 %       ±2.89%  ±3.85%  ±5.01%
 http/simple.js chunkedEnc=1 c=500 chunks=4 len=102400 type='buffer' benchmarker='test-double'                  1.98 %       ±3.28%  ±4.36%  ±5.68%
 http/simple.js chunkedEnc=1 c=500 chunks=4 len=102400 type='bytes' benchmarker='test-double'                  -1.19 %       ±3.53%  ±4.70%  ±6.12%
 http/simple.js chunkedEnc=1 c=500 chunks=4 len=4 type='buffer' benchmarker='test-double'                *     -2.71 %       ±2.42%  ±3.22%  ±4.19%
 http/simple.js chunkedEnc=1 c=500 chunks=4 len=4 type='bytes' benchmarker='test-double'                       -1.36 %       ±3.03%  ±4.03%  ±5.25%
 http/upgrade.js n=1000                                                                                        -0.59 %       ±2.30%  ±3.06%  ±3.98%
 http/upgrade.js n=5                                                                                           -1.55 %       ±4.00%  ±5.32%  ±6.93%

Be aware that when doing many comparisions the risk of a false-positive
result increases. In this case there are 213 comparisions, you can thus
expect the following amount of false-positive results:
  10.65 false positives, when considering a   5% risk acceptance (*, **, ***),
  2.13 false positives, when considering a   1% risk acceptance (**, ***),
  0.21 false positives, when considering a 0.1% risk acceptance (***)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment