gistfile1.txt

$ git status
On branch devel
Your branch is up-to-date with 'origin/devel'.

nothing to commit, working directory clean
$ ./bootstrap.py --cxx "clang++ -stdlib=libc++"
$ ninja -v examples
[1/6] clang++ -stdlib=libc++ -MMD -MF obj/examples/example2.o.d -c -Wall -Wextra -pedantic -Werror -std=c++11 -g -Iinclude -isystem deps/catch/include -isystem deps/wheels/include  examples/example2.c++ -o obj/examples/example2.o
[2/6] clang++ -stdlib=libc++ -MMD -MF obj/examples/example1.o.d -c -Wall -Wextra -pedantic -Werror -std=c++11 -g -Iinclude -isystem deps/catch/include -isystem deps/wheels/include  examples/example1.c++ -o obj/examples/example1.o
[3/6] clang++ -stdlib=libc++ -MMD -MF obj/examples/example3.o.d -c -Wall -Wextra -pedantic -Werror -std=c++11 -g -Iinclude -isystem deps/catch/include -isystem deps/wheels/include  examples/example3.c++ -o obj/examples/example3.o
[4/6] clang++ -stdlib=libc++ -Wall -Wextra -pedantic -Werror -std=c++11 -g -flto obj/examples/example1.o -o bin/examples/example1 
[5/6] clang++ -stdlib=libc++ -Wall -Wextra -pedantic -Werror -std=c++11 -g -flto obj/examples/example2.o -o bin/examples/example2 
[6/6] clang++ -stdlib=libc++ -Wall -Wextra -pedantic -Werror -std=c++11 -g -flto obj/examples/example3.o -o bin/examples/example3 
$ bin/examples/example1
estimating clock resolution...
mean is 46.6284 ns (5120002 iterations)
found 275382 outliers among 5120000 samples (5.38%)
  41039 (0.802%) high mild
  234343 (4.58%) high severe
estimating cost of a clock call...
mean is 20 ns (1 iterations)
found 0 outliers among 1 samples (0%)

benchmarking to_string(42)
collecting 100 samples, 261 iterations each, in estimated 4.6458 ms
bootstrapping with 100000 resamples
mean: 192.873 ns, lb 192.519 ns, ub 193.875 ns, ci 0.95
std dev: 2.81334 ns, lb 1.22946 ns, ub 6.10945 ns, ci 0.95
found 2 outliers among 100 samples (2%)
  1 (1%) high mild
  1 (1%) high severe
variance introduced by outliers: 7.53%
variance is slightly inflated by outliers

benchmarking to_string(4.2)
collecting 100 samples, 85 iterations each, in estimated 4.6835 ms
bootstrapping with 100000 resamples
mean: 367.676 ns, lb 351.868 ns, ub 386.304 ns, ci 0.95
std dev: 87.0421 ns, lb 76.5649 ns, ub 96.9483 ns, ci 0.95
found 0 outliers among 100 samples (0%)
variance introduced by outliers: 95.7%
variance is severely inflated by outliers
$ bin/examples/example2
$ cat example2.csv
"to_string(4.2)","to_string(42)"
0.000000366422819,0.000000216218623
0.000000308637584,0.000000185923077
0.000000306516779,0.000000184979757
0.000000306483221,0.000000182307692
0.000000306959732,0.000000184931174
0.000000306832215,0.000000188190283
0.000000305838926,0.000000183643725
0.000000305557047,0.000000230987854
0.000000305261745,0.000000280218623
0.000000305295302,0.000000285129555
0.000000304127517,0.000000284785425
0.000000305140940,0.000000185651822
0.000000306308725,0.000000188866397
0.000000305671141,0.000000184566802
0.000000306724832,0.000000188307692
0.000000305832215,0.000000186809717
0.000000303503356,0.000000188161943
0.000000305731544,0.000000192506073
0.000000309241611,0.000000226457490
0.000000304006711,0.000000299275304
0.000000308402685,0.000000289473684
0.000000304496644,0.000000292967611
0.000000301798658,0.000000293910931
0.000000309684564,0.000000295890688
0.000000305328859,0.000000194194332
0.000000303328859,0.000000184060729
0.000000309241611,0.000000187623482
0.000000310711409,0.000000185178138
0.000000303382550,0.000000185279352
0.000000304503356,0.000000192850202
0.000000304731544,0.000000187331984
0.000000308000000,0.000000185064777
0.000000312838926,0.000000189336032
0.000000305550336,0.000000190238866
0.000000305174497,0.000000185817814
0.000000308214765,0.000000185870445
0.000000308738255,0.000000186129555
0.000000306469799,0.000000182923077
0.000000309107383,0.000000182558704
0.000000306154362,0.000000190542510
0.000000304697987,0.000000187234818
0.000000309302013,0.000000185817814
0.000000302624161,0.000000240186235
0.000000302449664,0.000000290340081
0.000000310107383,0.000000290113360
0.000000306134228,0.000000229445344
0.000000303322148,0.000000181404858
0.000000305651007,0.000000183987854
0.000000306241611,0.000000182170040
0.000000306241611,0.000000188676113
0.000000305872483,0.000000186129555
0.000000344154362,0.000000187773279
0.000000307456376,0.000000189789474
0.000000310570470,0.000000289477733
0.000000306026846,0.000000293089069
0.000000310275168,0.000000332141700
0.000000305161074,0.000000292611336
0.000000312060403,0.000000296340081
0.000000304248322,0.000000206327935
0.000000306624161,0.000000182153846
0.000000304026846,0.000000181708502
0.000000304906040,0.000000184809717
0.000000307798658,0.000000180688259
0.000000307724832,0.000000188910931
0.000000306140940,0.000000184704453
0.000000303449664,0.000000187712551
0.000000307503356,0.000000184299595
0.000000309322148,0.000000186975709
0.000000303463087,0.000000188473684
0.000000304053691,0.000000186570850
0.000000306523490,0.000000186267206
0.000000304523490,0.000000184898785
0.000000307798658,0.000000185469636
0.000000309516779,0.000000184380567
0.000000305597315,0.000000180174089
0.000000304402685,0.000000189368421
0.000000304026846,0.000000260356275
0.000000312107383,0.000000293109312
0.000000306570470,0.000000289008097
0.000000306295302,0.000000203275304
0.000000305275168,0.000000180732794
0.000000313597315,0.000000183012146
0.000000308946309,0.000000183582996
0.000000302543624,0.000000187331984
0.000000305228188,0.000000186834008
0.000000308812081,0.000000186538462
0.000000309154362,0.000000231417004
0.000000305395973,0.000000294983806
0.000000306087248,0.000000292817814
0.000000308442953,0.000000296623482
0.000000305785235,0.000000293449393
0.000000307617450,0.000000283518219
0.000000306758389,0.000000182793522
0.000000309362416,0.000000182931174
0.000000309073826,0.000000185437247
0.000000305664430,0.000000190732794
0.000000304006711,0.000000186975709
0.000000308174497,0.000000186574899
0.000000307946309,0.000000186186235
0.000000304644295,0.000000187072874
$ bin/examples/example3
estimating clock resolution...
mean is 65.9464 ns (5120002 iterations)
found 131712 outliers among 5120000 samples (2.57%)
  14192 (0.277%) low mild
  61089 (1.19%) high mild
  56431 (1.1%) high severe
estimating cost of a clock call...
mean is 30 ns (1 iterations)
found 0 outliers among 1 samples (0%)

benchmarking to_string(42)
collecting 100 samples, 231 iterations each, in estimated 6.5835 ms
bootstrapping with 100000 resamples
mean: 297.329 ns, lb 295.529 ns, ub 299.716 ns, ci 0.95
std dev: 10.5002 ns, lb 8.41996 ns, ub 14.7923 ns, ci 0.95
found 4 outliers among 100 samples (4%)
  2 (2%) high mild
  2 (2%) high severe
variance introduced by outliers: 31.6%
variance is moderately inflated by outliers

benchmarking to_string(4.2)
collecting 100 samples, 124 iterations each, in estimated 6.6092 ms
bootstrapping with 100000 resamples
mean: 473.708 ns, lb 471.154 ns, ub 477.987 ns, ci 0.95
std dev: 16.4209 ns, lb 10.7394 ns, ub 27.6263 ns, ci 0.95
found 2 outliers among 100 samples (2%)
  2 (2%) high severe
variance introduced by outliers: 30.7%
variance is moderately inflated by outliers
$ bin/examples/example3 -s 50
estimating clock resolution...
mean is 86.9204 ns (5120002 iterations)
found 162884 outliers among 5120000 samples (3.18%)
  1 (1.95e-05%) low mild
  90108 (1.76%) high mild
  72775 (1.42%) high severe
estimating cost of a clock call...
mean is 72 ns (1 iterations)
found 0 outliers among 1 samples (0%)

benchmarking to_string(42)
collecting 50 samples, 277 iterations each, in estimated 4.3489 ms
bootstrapping with 100000 resamples
mean: 328.727 ns, lb 326.351 ns, ub 332.298 ns, ci 0.95
std dev: 10.3502 ns, lb 7.04561 ns, ub 17.8929 ns, ci 0.95
found 2 outliers among 50 samples (4%)
  1 (2%) low mild
  1 (2%) high severe
variance introduced by outliers: 15.2%
variance is moderately inflated by outliers

benchmarking to_string(4.2)
collecting 50 samples, 166 iterations each, in estimated 4.3575 ms
bootstrapping with 100000 resamples
mean: 527.025 ns, lb 522.498 ns, ub 532.927 ns, ci 0.95
std dev: 18.5459 ns, lb 14.0057 ns, ub 28.2899 ns, ci 0.95
found 2 outliers among 50 samples (4%)
  1 (2%) high mild
  1 (2%) high severe
variance introduced by outliers: 19%
variance is moderately inflated by outliers
$