Ran on an c3.8xlarge; significantly less background noise.

ec2-benchmarking.txt

tracing/tracing-subscriber on  david/downcast_ref-registry is 📦 v0.1.5 via v1.39.0
❯ cargo bench --bench=fmt
    Finished release [optimized] target(s) in 0.09s
     Running /local/home/dbarsky/Developer/tracing/target/release/deps/fmt-a1a7fd83bd4e2201
Gnuplot not found, disabling plotting
new_span/single_thread/1
                        time:   [542.32 ns 542.57 ns 542.80 ns]
                        thrpt:  [1.8423 Melem/s 1.8431 Melem/s 1.8439 Melem/s]
                 change:
                        time:   [+1.5380% +1.6310% +1.7080%] (p = 0.00 < 0.05)
                        thrpt:  [-1.6794% -1.6048% -1.5147%]
                        Performance has regressed.
Benchmarking new_span/multithreaded/1: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 43.6s or reduce sample count to 20
new_span/multithreaded/1
                        time:   [38.680 us 38.961 us 39.284 us]
                        thrpt:  [25.455 Kelem/s 25.667 Kelem/s 25.853 Kelem/s]
                 change:
                        time:   [-2.7203% -1.3175% -0.0269%] (p = 0.06 > 0.05)
                        thrpt:  [+0.0269% +1.3351% +2.7964%]
                        No change in performance detected.
Found 6 outliers among 100 measurements (6.00%)
  5 (5.00%) high mild
  1 (1.00%) high severe
new_span/single_thread/10
                        time:   [5.5780 us 5.5860 us 5.5939 us]
                        thrpt:  [1.7877 Melem/s 1.7902 Melem/s 1.7928 Melem/s]
                 change:
                        time:   [+3.1402% +3.2600% +3.3729%] (p = 0.00 < 0.05)
                        thrpt:  [-3.2629% -3.1571% -3.0446%]
                        Performance has regressed.
Benchmarking new_span/multithreaded/10: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 43.0s or reduce sample count to 20
new_span/multithreaded/10
                        time:   [42.908 us 43.156 us 43.412 us]
                        thrpt:  [230.35 Kelem/s 231.72 Kelem/s 233.06 Kelem/s]
                 change:
                        time:   [-1.9495% -0.7866% +0.3166%] (p = 0.18 > 0.05)
                        thrpt:  [-0.3156% +0.7928% +1.9882%]
                        No change in performance detected.
Found 4 outliers among 100 measurements (4.00%)
  3 (3.00%) high mild
  1 (1.00%) high severe
new_span/single_thread/50
                        time:   [27.876 us 27.882 us 27.888 us]
                        thrpt:  [1.7929 Melem/s 1.7933 Melem/s 1.7937 Melem/s]
                 change:
                        time:   [+2.3292% +2.4052% +2.4833%] (p = 0.00 < 0.05)
                        thrpt:  [-2.4231% -2.3487% -2.2762%]
                        Performance has regressed.
Found 2 outliers among 100 measurements (2.00%)
  1 (1.00%) high mild
  1 (1.00%) high severe
Benchmarking new_span/multithreaded/50: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 48.7s or reduce sample count to 20
new_span/multithreaded/50
                        time:   [88.768 us 89.401 us 90.100 us]
                        thrpt:  [554.94 Kelem/s 559.28 Kelem/s 563.26 Kelem/s]
                 change:
                        time:   [-2.0803% -1.2292% -0.3183%] (p = 0.01 < 0.05)
                        thrpt:  [+0.3193% +1.2445% +2.1245%]
                        Change within noise threshold.
Found 4 outliers among 100 measurements (4.00%)
  1 (1.00%) low mild
  3 (3.00%) high mild

event/root/single_threaded/1
                        time:   [3.6799 us 3.6824 us 3.6849 us]
                        thrpt:  [271.38 Kelem/s 271.56 Kelem/s 271.74 Kelem/s]
                 change:
                        time:   [-0.4927% -0.3554% -0.2123%] (p = 0.00 < 0.05)
                        thrpt:  [+0.2128% +0.3567% +0.4952%]
                        Change within noise threshold.
Found 6 outliers among 100 measurements (6.00%)
  4 (4.00%) low mild
  1 (1.00%) high mild
  1 (1.00%) high severe
Benchmarking event/root/multithreaded/1: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 52.7s or reduce sample count to 20
event/root/multithreaded/1
                        time:   [54.904 us 55.253 us 55.595 us]
                        thrpt:  [17.987 Kelem/s 18.098 Kelem/s 18.214 Kelem/s]
                 change:
                        time:   [+6.2067% +7.4746% +8.7558%] (p = 0.00 < 0.05)
                        thrpt:  [-8.0509% -6.9548% -5.8439%]
                        Performance has regressed.
Found 3 outliers among 100 measurements (3.00%)
  1 (1.00%) low mild
  2 (2.00%) high mild
event/unique_parent/single_threaded/1
                        time:   [4.7524 us 4.7559 us 4.7598 us]
                        thrpt:  [210.09 Kelem/s 210.27 Kelem/s 210.42 Kelem/s]
                 change:
                        time:   [-4.4125% -4.2820% -4.1433%] (p = 0.00 < 0.05)
                        thrpt:  [+4.3224% +4.4735% +4.6162%]
                        Performance has improved.
Found 3 outliers among 100 measurements (3.00%)
  3 (3.00%) high mild
Benchmarking event/unique_parent/multithreaded/1: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 50.3s or reduce sample count to 20
event/unique_parent/multithreaded/1
                        time:   [56.309 us 56.625 us 56.937 us]
                        thrpt:  [17.563 Kelem/s 17.660 Kelem/s 17.759 Kelem/s]
                 change:
                        time:   [-0.1184% +1.2494% +2.6550%] (p = 0.08 > 0.05)
                        thrpt:  [-2.5864% -1.2340% +0.1185%]
                        No change in performance detected.
Found 5 outliers among 100 measurements (5.00%)
  2 (2.00%) low severe
  1 (1.00%) low mild
  1 (1.00%) high mild
  1 (1.00%) high severe
Benchmarking event/shared_parent/multithreaded/1: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 49.6s or reduce sample count to 20
event/shared_parent/multithreaded/1
                        time:   [55.888 us 56.267 us 56.660 us]
                        thrpt:  [17.649 Kelem/s 17.773 Kelem/s 17.893 Kelem/s]
                 change:
                        time:   [+0.6762% +2.3038% +3.8176%] (p = 0.00 < 0.05)
                        thrpt:  [-3.6772% -2.2519% -0.6717%]
                        Change within noise threshold.
Found 4 outliers among 100 measurements (4.00%)
  1 (1.00%) low severe
  2 (2.00%) low mild
  1 (1.00%) high mild
event/root/single_threaded/10
                        time:   [36.771 us 36.798 us 36.824 us]
                        thrpt:  [271.56 Kelem/s 271.75 Kelem/s 271.95 Kelem/s]
                 change:
                        time:   [-1.1391% -1.0070% -0.8684%] (p = 0.00 < 0.05)
                        thrpt:  [+0.8760% +1.0173% +1.1522%]
                        Change within noise threshold.
Found 2 outliers among 100 measurements (2.00%)
  2 (2.00%) low mild
Benchmarking event/root/multithreaded/10: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 55.2s or reduce sample count to 20
event/root/multithreaded/10
                        time:   [124.77 us 125.22 us 125.70 us]
                        thrpt:  [79.555 Kelem/s 79.861 Kelem/s 80.150 Kelem/s]
                 change:
                        time:   [-2.4544% -1.6091% -0.7586%] (p = 0.00 < 0.05)
                        thrpt:  [+0.7644% +1.6354% +2.5162%]
                        Change within noise threshold.
Found 3 outliers among 100 measurements (3.00%)
  2 (2.00%) high mild
  1 (1.00%) high severe
event/unique_parent/single_threaded/10
                        time:   [48.393 us 48.431 us 48.472 us]
                        thrpt:  [206.31 Kelem/s 206.48 Kelem/s 206.64 Kelem/s]
                 change:
                        time:   [-3.1069% -2.9679% -2.8297%] (p = 0.00 < 0.05)
                        thrpt:  [+2.9121% +3.0587% +3.2065%]
                        Performance has improved.
Found 7 outliers among 100 measurements (7.00%)
  1 (1.00%) low severe
  5 (5.00%) high mild
  1 (1.00%) high severe
Benchmarking event/unique_parent/multithreaded/10: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 51.4s or reduce sample count to 20
event/unique_parent/multithreaded/10
                        time:   [133.78 us 134.41 us 135.05 us]
                        thrpt:  [74.048 Kelem/s 74.397 Kelem/s 74.747 Kelem/s]
                 change:
                        time:   [-3.9407% -2.8356% -1.8473%] (p = 0.00 < 0.05)
                        thrpt:  [+1.8821% +2.9183% +4.1024%]
                        Performance has improved.
Found 4 outliers among 100 measurements (4.00%)
  1 (1.00%) low severe
  2 (2.00%) low mild
  1 (1.00%) high mild
Benchmarking event/shared_parent/multithreaded/10: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 48.6s or reduce sample count to 20
event/shared_parent/multithreaded/10
                        time:   [131.81 us 132.47 us 133.13 us]
                        thrpt:  [75.113 Kelem/s 75.489 Kelem/s 75.867 Kelem/s]
                 change:
                        time:   [-3.6329% -2.8100% -1.9243%] (p = 0.00 < 0.05)
                        thrpt:  [+1.9620% +2.8912% +3.7699%]
                        Performance has improved.
Found 4 outliers among 100 measurements (4.00%)
  1 (1.00%) low severe
  1 (1.00%) low mild
  2 (2.00%) high mild
event/root/single_threaded/50
                        time:   [183.74 us 183.85 us 183.95 us]
                        thrpt:  [271.81 Kelem/s 271.96 Kelem/s 272.12 Kelem/s]
                 change:
                        time:   [-1.0155% -0.8690% -0.7341%] (p = 0.00 < 0.05)
                        thrpt:  [+0.7395% +0.8766% +1.0259%]
                        Change within noise threshold.
Found 9 outliers among 100 measurements (9.00%)
  1 (1.00%) low severe
  2 (2.00%) low mild
  3 (3.00%) high mild
  3 (3.00%) high severe
Benchmarking event/root/multithreaded/50: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 53.4s or reduce sample count to 20
event/root/multithreaded/50
                        time:   [427.30 us 428.99 us 430.71 us]
                        thrpt:  [116.09 Kelem/s 116.55 Kelem/s 117.01 Kelem/s]
                 change:
                        time:   [-2.9446% -2.4563% -1.9304%] (p = 0.00 < 0.05)
                        thrpt:  [+1.9684% +2.5182% +3.0339%]
                        Performance has improved.
Found 7 outliers among 100 measurements (7.00%)
  2 (2.00%) low mild
  4 (4.00%) high mild
  1 (1.00%) high severe
event/unique_parent/single_threaded/50
                        time:   [237.21 us 237.31 us 237.41 us]
                        thrpt:  [210.60 Kelem/s 210.69 Kelem/s 210.78 Kelem/s]
                 change:
                        time:   [-4.1261% -3.9860% -3.8424%] (p = 0.00 < 0.05)
                        thrpt:  [+3.9959% +4.1515% +4.3037%]
                        Performance has improved.
Found 6 outliers among 100 measurements (6.00%)
  4 (4.00%) high mild
  2 (2.00%) high severe
Benchmarking event/unique_parent/multithreaded/50: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 53.1s or reduce sample count to 20
event/unique_parent/multithreaded/50
                        time:   [450.62 us 452.38 us 454.21 us]
                        thrpt:  [110.08 Kelem/s 110.53 Kelem/s 110.96 Kelem/s]
                 change:
                        time:   [-5.2355% -4.3927% -3.4915%] (p = 0.00 < 0.05)
                        thrpt:  [+3.6178% +4.5945% +5.5248%]
                        Performance has improved.
Found 6 outliers among 100 measurements (6.00%)
  1 (1.00%) low mild
  2 (2.00%) high mild
  3 (3.00%) high severe
Benchmarking event/shared_parent/multithreaded/50: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 47.1s or reduce sample count to 20
event/shared_parent/multithreaded/50
                        time:   [449.78 us 451.51 us 453.29 us]
                        thrpt:  [110.31 Kelem/s 110.74 Kelem/s 111.17 Kelem/s]
                 change:
                        time:   [-6.6322% -6.0505% -5.4164%] (p = 0.00 < 0.05)
                        thrpt:  [+5.7266% +6.4402% +7.1033%]
                        Performance has improved.
Found 5 outliers among 100 measurements (5.00%)
  2 (2.00%) low mild
  3 (3.00%) high mild

Gnuplot not found, disabling plotting

tracing/tracing-subscriber on  david/downcast_ref-registry is 📦 v0.1.5 via v1.39.0 took 12m34s
❯