benchmark-results.txt

datasets/census1881_srt/and                                                                            
                        time:   [193.05 us 193.94 us 194.80 us]
                        change: [-23.186% -21.697% -20.022%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 2 outliers among 100 measurements (2.00%)
  2 (2.00%) high severe

Benchmarking datasets/census-income_srt/and: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 6.1s, enable flat sampling, or reduce sample count to 60.
datasets/census-income_srt/and                                                                             
                        time:   [1.1591 ms 1.1659 ms 1.1737 ms]
                        change: [-16.039% -15.366% -14.738%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 2 outliers among 100 measurements (2.00%)
  2 (2.00%) high mild

Benchmarking datasets/weather_sept_85_srt/and: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 10.0s, enable flat sampling, or reduce sample count to 40.
datasets/weather_sept_85_srt/and                                                                             
                        time:   [1.9554 ms 1.9708 ms 1.9872 ms]
                        change: [-18.314% -17.347% -16.471%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) high mild

datasets/wikileaks-noquotes_srt/and                                                                            
                        time:   [108.23 us 108.66 us 109.10 us]
                        change: [-23.502% -23.090% -22.705%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 4 outliers among 100 measurements (4.00%)
  4 (4.00%) high mild

datasets/census1881_srt/or                                                                            
                        time:   [874.84 us 878.71 us 883.01 us]
                        change: [-4.5601% -3.8256% -2.8885%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 7 outliers among 100 measurements (7.00%)
  3 (3.00%) low mild
  1 (1.00%) high mild
  3 (3.00%) high severe

Benchmarking datasets/census-income_srt/or: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 6.2s, enable flat sampling, or reduce sample count to 60.
datasets/census-income_srt/or                                                                             
                        time:   [1.2065 ms 1.2136 ms 1.2217 ms]
                        change: [-7.6801% -7.1790% -6.6463%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 6 outliers among 100 measurements (6.00%)
  4 (4.00%) high mild
  2 (2.00%) high severe

datasets/weather_sept_85_srt/or                                                                             
                        time:   [2.6266 ms 2.6486 ms 2.6755 ms]
                        change: [-8.0846% -7.2821% -6.2993%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 4 outliers among 100 measurements (4.00%)
  2 (2.00%) high mild
  2 (2.00%) high severe

datasets/wikileaks-noquotes_srt/or                                                                            
                        time:   [572.78 us 574.93 us 577.28 us]
                        change: [-4.1045% -2.8338% -1.8153%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 6 outliers among 100 measurements (6.00%)
  1 (1.00%) low mild
  2 (2.00%) high mild
  3 (3.00%) high severe

Benchmarking datasets/census1881_srt/is_subset: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.9s, enable flat sampling, or reduce sample count to 60.
datasets/census1881_srt/is_subset                                                                             
                        time:   [1.1736 ms 1.1803 ms 1.1868 ms]
                        change: [-3.1202% -2.5058% -1.8609%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 2 outliers among 100 measurements (2.00%)
  2 (2.00%) high mild

Benchmarking datasets/census-income_srt/is_subset: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 8.6s, enable flat sampling, or reduce sample count to 50.
datasets/census-income_srt/is_subset                                                                             
                        time:   [1.6584 ms 1.6670 ms 1.6762 ms]
                        change: [-6.6790% -5.9852% -5.3309%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 8 outliers among 100 measurements (8.00%)
  8 (8.00%) high mild

datasets/weather_sept_85_srt/is_subset                                                                             
                        time:   [3.6476 ms 3.6713 ms 3.6967 ms]
                        change: [-6.3961% -5.7290% -5.0784%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 8 outliers among 100 measurements (8.00%)
  7 (7.00%) high mild
  1 (1.00%) high severe

datasets/wikileaks-noquotes_srt/is_subset                                                                            
                        time:   [892.14 us 898.68 us 906.65 us]
                        change: [+0.4575% +1.2180% +2.0611%] (p = 0.00 < 0.05)
                        Change within noise threshold.
Found 3 outliers among 100 measurements (3.00%)
  1 (1.00%) high mild
  2 (2.00%) high severe

datasets/census1881_srt/is_subset #2                                                                             
                        time:   [6.3391 us 6.3794 us 6.4227 us]
                        change: [+1.6749% +2.2715% +2.8988%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 3 outliers among 100 measurements (3.00%)
  3 (3.00%) high mild

datasets/census-income_srt/is_subset #2                                                                             
                        time:   [24.228 us 24.315 us 24.410 us]
                        change: [+2.8141% +3.7965% +4.5961%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 7 outliers among 100 measurements (7.00%)
  3 (3.00%) high mild
  4 (4.00%) high severe

datasets/weather_sept_85_srt/is_subset #2                                                                             
                        time:   [30.371 us 30.494 us 30.621 us]
                        change: [+4.7832% +5.6426% +6.3911%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 3 outliers among 100 measurements (3.00%)
  3 (3.00%) high mild

datasets/wikileaks-noquotes_srt/is_subset #2                                                                             
                        time:   [5.0875 us 5.1067 us 5.1269 us]
                        change: [+2.9715% +3.9000% +4.6623%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 6 outliers among 100 measurements (6.00%)
  6 (6.00%) high mild

datasets/census1881_srt/iter                                                                             
                        time:   [3.1927 ms 3.2033 ms 3.2142 ms]
                        change: [+0.2569% +0.7614% +1.2522%] (p = 0.00 < 0.05)
                        Change within noise threshold.
Found 2 outliers among 100 measurements (2.00%)
  2 (2.00%) high mild

datasets/census-income_srt/iter                                                                            
                        time:   [28.699 ms 28.830 ms 28.966 ms]
                        change: [-0.1688% +0.7220% +1.5057%] (p = 0.09 > 0.05)
                        No change in performance detected.
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) high mild

Benchmarking datasets/weather_sept_85_srt/iter: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 7.6s, or reduce sample count to 60.
datasets/weather_sept_85_srt/iter                                                                            
                        time:   [75.074 ms 75.357 ms 75.651 ms]
                        change: [-0.3468% +0.1163% +0.5719%] (p = 0.63 > 0.05)
                        No change in performance detected.
Found 6 outliers among 100 measurements (6.00%)
  6 (6.00%) high mild

Benchmarking datasets/wikileaks-noquotes_srt/iter: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 6.8s, enable flat sampling, or reduce sample count to 60.
datasets/wikileaks-noquotes_srt/iter                                                                             
                        time:   [1.3397 ms 1.3452 ms 1.3518 ms]
                        change: [-1.7046% -0.6832% +0.4245%] (p = 0.20 > 0.05)
                        No change in performance detected.
Found 5 outliers among 100 measurements (5.00%)
  3 (3.00%) high mild
  2 (2.00%) high severe

datasets/census1881_srt/serialize                                                                            
                        time:   [314.47 us 315.97 us 317.57 us]
                        change: [-0.6772% -0.2467% +0.1867%] (p = 0.28 > 0.05)
                        No change in performance detected.
Found 3 outliers among 100 measurements (3.00%)
  2 (2.00%) high mild
  1 (1.00%) high severe

datasets/census-income_srt/serialize                                                                            
                        time:   [850.41 us 854.84 us 861.02 us]
                        change: [-1.7053% -1.1139% -0.4416%] (p = 0.00 < 0.05)
                        Change within noise threshold.
Found 4 outliers among 100 measurements (4.00%)
  2 (2.00%) high mild
  2 (2.00%) high severe

datasets/weather_sept_85_srt/serialize                                                                             
                        time:   [2.3146 ms 2.3227 ms 2.3313 ms]
                        change: [-4.0378% -3.1103% -2.1961%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 5 outliers among 100 measurements (5.00%)
  5 (5.00%) high mild

datasets/wikileaks-noquotes_srt/serialize                                                                            
                        time:   [201.95 us 202.57 us 203.20 us]
                        change: [-2.2845% -1.8956% -1.5015%] (p = 0.00 < 0.05)
                        Performance has improved.

Benchmarking datasets/census1881_srt/from_sorted_iter: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.2s, or reduce sample count to 90.
datasets/census1881_srt/from_sorted_iter                                                                            
                        time:   [51.415 ms 51.756 ms 52.231 ms]
                        change: [-21.616% -20.807% -19.982%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 5 outliers among 100 measurements (5.00%)
  3 (3.00%) high mild
  2 (2.00%) high severe

Benchmarking datasets/census-income_srt/from_sorted_iter: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 54.7s, or reduce sample count to 10.
datasets/census-income_srt/from_sorted_iter                                                                            
                        time:   [531.47 ms 533.34 ms 535.21 ms]
                        change: [-21.397% -21.026% -20.645%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) high mild

Benchmarking datasets/weather_sept_85_srt/from_sorted_iter: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 141.0s, or reduce sample count to 10.
datasets/weather_sept_85_srt/from_sorted_iter                                                                            
                        time:   [1.3558 s 1.3595 s 1.3632 s]
                        change: [-20.865% -20.559% -20.236%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 7 outliers among 100 measurements (7.00%)
  1 (1.00%) low mild
  6 (6.00%) high mild

datasets/wikileaks-noquotes_srt/from_sorted_iter                                                                            
                        time:   [10.774 ms 10.822 ms 10.875 ms]
                        change: [-18.566% -18.147% -17.720%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 2 outliers among 100 measurements (2.00%)
  1 (1.00%) high mild
  1 (1.00%) high severe

Successive And/datasets/census1881_srt/Successive And Assign Ref                                                                            
                        time:   [166.84 us 167.39 us 167.97 us]
                        change: [-0.7414% -0.1672% +0.4303%] (p = 0.59 > 0.05)
                        No change in performance detected.
Found 3 outliers among 100 measurements (3.00%)
  2 (2.00%) high mild
  1 (1.00%) high severe
Successive And/datasets/census1881_srt/Successive And Assign Owned                                                                            
                        time:   [168.36 us 169.92 us 172.59 us]
                        change: [-0.9168% +0.0255% +0.9441%] (p = 0.96 > 0.05)
                        No change in performance detected.
Found 8 outliers among 100 measurements (8.00%)
  5 (5.00%) high mild
  3 (3.00%) high severe
Successive And/datasets/census1881_srt/Successive And Ref Ref                                                                            
                        time:   [169.59 us 170.09 us 170.63 us]
                        change: [-3.3650% -0.7774% +1.1525%] (p = 0.57 > 0.05)
                        No change in performance detected.
Found 7 outliers among 100 measurements (7.00%)
  2 (2.00%) high mild
  5 (5.00%) high severe

Successive And/datasets/census-income_srt/Successive And Assign Ref                                                                            
                        time:   [62.766 us 63.081 us 63.411 us]
                        change: [-0.7818% -0.0030% +0.7348%] (p = 0.99 > 0.05)
                        No change in performance detected.
Found 2 outliers among 100 measurements (2.00%)
  2 (2.00%) high mild
Successive And/datasets/census-income_srt/Successive And Assign Owned                                                                            
                        time:   [63.560 us 63.903 us 64.271 us]
                        change: [-1.5368% +0.5231% +3.1585%] (p = 0.69 > 0.05)
                        No change in performance detected.
Found 6 outliers among 100 measurements (6.00%)
  6 (6.00%) high severe
Successive And/datasets/census-income_srt/Successive And Ref Ref                                                                            
                        time:   [63.836 us 64.213 us 64.606 us]
                        change: [-3.7432% -2.1283% -0.8317%] (p = 0.00 < 0.05)
                        Change within noise threshold.
Found 4 outliers among 100 measurements (4.00%)
  2 (2.00%) high mild
  2 (2.00%) high severe

Benchmarking Successive And/datasets/weather_sept_85_srt/Successive And Assign Ref: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.3s, enable flat sampling, or reduce sample count to 60.
Successive And/datasets/weather_sept_85_srt/Successive And Assign Ref                                                                             
                        time:   [235.75 us 236.73 us 237.73 us]
                        change: [+7.2895% +7.9754% +8.6331%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 9 outliers among 100 measurements (9.00%)
  3 (3.00%) low severe
  4 (4.00%) low mild
  2 (2.00%) high mild
Benchmarking Successive And/datasets/weather_sept_85_srt/Successive And Assign Owned: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.3s, enable flat sampling, or reduce sample count to 60.
Successive And/datasets/weather_sept_85_srt/Successive And Assign Owned                                                                             
                        time:   [235.98 us 237.62 us 239.81 us]
                        change: [+9.5287% +10.855% +12.244%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 11 outliers among 100 measurements (11.00%)
  3 (3.00%) low severe
  3 (3.00%) low mild
  5 (5.00%) high severe
Benchmarking Successive And/datasets/weather_sept_85_srt/Successive And Ref Ref: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.3s, enable flat sampling, or reduce sample count to 60.
Successive And/datasets/weather_sept_85_srt/Successive And Ref Ref                                                                             
                        time:   [245.02 us 245.96 us 247.10 us]
                        change: [+6.1544% +7.1169% +8.1255%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 13 outliers among 100 measurements (13.00%)
  3 (3.00%) low severe
  4 (4.00%) low mild
  2 (2.00%) high mild
  4 (4.00%) high severe

Successive And/datasets/wikileaks-noquotes_srt/Successive And Assign Ref                                                                            
                        time:   [112.71 us 113.20 us 113.70 us]
                        change: [-2.3489% -1.6867% -1.0614%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 3 outliers among 100 measurements (3.00%)
  3 (3.00%) high mild
Successive And/datasets/wikileaks-noquotes_srt/Successive And Assign Owned                                                                            
                        time:   [112.58 us 113.25 us 113.97 us]
                        change: [-2.5809% -1.2719% +0.1168%] (p = 0.06 > 0.05)
                        No change in performance detected.
Found 6 outliers among 100 measurements (6.00%)
  2 (2.00%) high mild
  4 (4.00%) high severe
Successive And/datasets/wikileaks-noquotes_srt/Successive And Ref Ref                                                                            
                        time:   [112.81 us 113.27 us 113.77 us]
                        change: [-1.3665% -0.7221% -0.1019%] (p = 0.03 < 0.05)
                        Change within noise threshold.
Found 4 outliers among 100 measurements (4.00%)
  2 (2.00%) high mild
  2 (2.00%) high severe

Successive Or/datasets/census1881_srt/Successive Or Assign Ref                                                                             
                        time:   [3.8648 ms 3.8773 ms 3.8905 ms]
                        change: [-3.6450% -3.1385% -2.6622%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) high mild
Successive Or/datasets/census1881_srt/Successive Or Assign Owned                                                                             
                        time:   [4.0320 ms 4.0475 ms 4.0644 ms]
                        change: [-2.9956% -2.4287% -1.8720%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 7 outliers among 100 measurements (7.00%)
  5 (5.00%) high mild
  2 (2.00%) high severe
Successive Or/datasets/census1881_srt/Successive Or Ref Ref                                                                            
                        time:   [6.9543 ms 6.9776 ms 7.0027 ms]
                        change: [-5.5658% -5.0504% -4.5220%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 5 outliers among 100 measurements (5.00%)
  3 (3.00%) high mild
  2 (2.00%) high severe

Successive Or/datasets/census-income_srt/Successive Or Assign Ref                                                                            
                        time:   [960.45 us 965.41 us 971.07 us]
                        change: [+0.3571% +1.1301% +1.9248%] (p = 0.01 < 0.05)
                        Change within noise threshold.
Found 6 outliers among 100 measurements (6.00%)
  4 (4.00%) high mild
  2 (2.00%) high severe
Benchmarking Successive Or/datasets/census-income_srt/Successive Or Assign Owned: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 6.3s, enable flat sampling, or reduce sample count to 60.
Successive Or/datasets/census-income_srt/Successive Or Assign Owned                                                                             
                        time:   [1.0367 ms 1.0406 ms 1.0448 ms]
                        change: [+1.3924% +2.1817% +2.9237%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 5 outliers among 100 measurements (5.00%)
  3 (3.00%) high mild
  2 (2.00%) high severe
Benchmarking Successive Or/datasets/census-income_srt/Successive Or Ref Ref: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.8s, enable flat sampling, or reduce sample count to 60.
Successive Or/datasets/census-income_srt/Successive Or Ref Ref                                                                             
                        time:   [1.1403 ms 1.1456 ms 1.1515 ms]
                        change: [-5.0980% -4.2023% -3.3538%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) high mild

Benchmarking Successive Or/datasets/weather_sept_85_srt/Successive Or Assign Ref: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 6.6s, enable flat sampling, or reduce sample count to 60.
Successive Or/datasets/weather_sept_85_srt/Successive Or Assign Ref                                                                             
                        time:   [1.2819 ms 1.2891 ms 1.2971 ms]
                        change: [-5.2059% -4.2096% -3.2876%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 4 outliers among 100 measurements (4.00%)
  3 (3.00%) high mild
  1 (1.00%) high severe
Successive Or/datasets/weather_sept_85_srt/Successive Or Assign Owned                                                                             
                        time:   [1.7412 ms 1.7488 ms 1.7564 ms]
                        change: [+0.3699% +1.1626% +1.8815%] (p = 0.00 < 0.05)
                        Change within noise threshold.
Successive Or/datasets/weather_sept_85_srt/Successive Or Ref Ref                                                                             
                        time:   [2.3942 ms 2.4179 ms 2.4460 ms]
                        change: [-11.025% -9.9843% -8.8982%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 13 outliers among 100 measurements (13.00%)
  10 (10.00%) high mild
  3 (3.00%) high severe

Successive Or/datasets/wikileaks-noquotes_srt/Successive Or Assign Ref                                                                             
                        time:   [2.0458 ms 2.0532 ms 2.0613 ms]
                        change: [-8.2578% -7.1931% -6.3409%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 7 outliers among 100 measurements (7.00%)
  4 (4.00%) high mild
  3 (3.00%) high severe
Successive Or/datasets/wikileaks-noquotes_srt/Successive Or Assign Owned                                                                             
                        time:   [2.1405 ms 2.1469 ms 2.1537 ms]
                        change: [-9.3867% -8.8617% -8.3339%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 3 outliers among 100 measurements (3.00%)
  3 (3.00%) high mild
Successive Or/datasets/wikileaks-noquotes_srt/Successive Or Ref Ref                                                                             
                        time:   [3.0973 ms 3.1162 ms 3.1434 ms]
                        change: [-12.260% -11.534% -10.713%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 4 outliers among 100 measurements (4.00%)
  2 (2.00%) high mild
  2 (2.00%) high severe