Created
March 19, 2023 18:42
-
-
Save zamazan4ik/bbffbdf9b10e2a281f5d5373347f48ef to your computer and use it in GitHub Desktop.
Bevy bench results: Release run after PGO
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| cargo bench | |
| Finished bench [optimized] target(s) in 0.18s | |
| Running benches/bevy_math/bezier.rs (target/release/deps/bezier-17cb82cb782e4598) | |
| Gnuplot not found, using plotters backend | |
| easing_1000 time: [10.461 µs 10.470 µs 10.479 µs] | |
| change: [-2.3215% -2.0838% -1.8365%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 2 (2.00%) high mild | |
| 4 (4.00%) high severe | |
| cubic_position_Vec2 time: [1.5156 ns 1.5596 ns 1.6180 ns] | |
| change: [-0.2155% +1.6449% +4.0952%] (p = 0.16 > 0.05) | |
| No change in performance detected. | |
| Found 11 outliers among 100 measurements (11.00%) | |
| 1 (1.00%) low mild | |
| 4 (4.00%) high mild | |
| 6 (6.00%) high severe | |
| cubic_position_Vec3 time: [2.3811 ns 2.3853 ns 2.3921 ns] | |
| change: [-1.0456% -0.5018% +0.4240%] (p = 0.18 > 0.05) | |
| No change in performance detected. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 2 (2.00%) low mild | |
| 5 (5.00%) high mild | |
| 3 (3.00%) high severe | |
| cubic_position_Vec3A time: [2.5388 ns 2.5414 ns 2.5444 ns] | |
| change: [-0.9997% -0.6103% -0.2283%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 2 (2.00%) low mild | |
| 1 (1.00%) high mild | |
| 1 (1.00%) high severe | |
| build_pos_cubic_100_points | |
| time: [244.53 ns 244.76 ns 245.04 ns] | |
| change: [+26.565% +27.495% +28.054%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 3 (3.00%) low mild | |
| 4 (4.00%) high mild | |
| 3 (3.00%) high severe | |
| build_accel_cubic_100_points | |
| time: [241.77 ns 242.05 ns 242.36 ns] | |
| change: [+26.212% +26.638% +26.965%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 1 (1.00%) low mild | |
| 6 (6.00%) high mild | |
| 1 (1.00%) high severe | |
| Running benches/bevy_ecs/change_detection.rs (target/release/deps/change_detection-0edce8b8eaad5ed3) | |
| Gnuplot not found, using plotters backend | |
| all_added_detection/50000_entities_change_detection::Table | |
| time: [116.33 µs 116.62 µs 116.94 µs] | |
| change: [-1.3278% -0.6145% +0.0275%] (p = 0.07 > 0.05) | |
| No change in performance detected. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 1 (1.00%) low severe | |
| 1 (1.00%) low mild | |
| 5 (5.00%) high mild | |
| 1 (1.00%) high severe | |
| all_added_detection/50000_entities_change_detection::Sparse | |
| time: [130.84 µs 132.21 µs 133.66 µs] | |
| change: [-5.7859% -4.1792% -2.5371%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 3 (3.00%) high mild | |
| all_added_detection/60000_entities_change_detection::Table | |
| time: [142.04 µs 142.46 µs 142.91 µs] | |
| change: [-3.5069% -1.7320% -0.3646%] (p = 0.02 < 0.05) | |
| Change within noise threshold. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 3 (3.00%) high mild | |
| all_added_detection/60000_entities_change_detection::Sparse | |
| time: [193.28 µs 223.79 µs 267.31 µs] | |
| change: [+16.030% +33.732% +57.823%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 12 outliers among 100 measurements (12.00%) | |
| 3 (3.00%) high mild | |
| 9 (9.00%) high severe | |
| all_changed_detection/50000_entities_change_detection::Table | |
| time: [118.63 µs 119.04 µs 119.46 µs] | |
| change: [-0.2342% +0.6219% +1.5024%] (p = 0.16 > 0.05) | |
| No change in performance detected. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 1 (1.00%) low mild | |
| 3 (3.00%) high mild | |
| 4 (4.00%) high severe | |
| all_changed_detection/50000_entities_change_detection::Sparse | |
| time: [129.38 µs 131.17 µs 132.99 µs] | |
| change: [-6.2490% -4.2016% -2.2526%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Benchmarking all_changed_detection/60000_entities_change_detection::Table: Warming up for 500.00 ms | |
| Warning: Unable to complete 100 samples in 4.0s. You may wish to increase target time to 4.0s, enable flat sampling, or reduce sample count to 70. | |
| all_changed_detection/60000_entities_change_detection::Table | |
| time: [137.44 µs 138.21 µs 139.01 µs] | |
| change: [-1.1289% -0.2345% +0.6741%] (p = 0.61 > 0.05) | |
| No change in performance detected. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 2 (2.00%) low mild | |
| 1 (1.00%) high mild | |
| all_changed_detection/60000_entities_change_detection::Sparse | |
| time: [150.50 µs 152.77 µs 155.06 µs] | |
| change: [-0.9425% +1.5271% +3.8501%] (p = 0.19 > 0.05) | |
| No change in performance detected. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) high mild | |
| Benchmarking few_changed_detection/50000_entities_change_detection::Table: Warming up for 500.00 ms | |
| Warning: Unable to complete 100 samples in 4.0s. You may wish to increase target time to 6.2s, enable flat sampling, or reduce sample count to 50. | |
| few_changed_detection/50000_entities_change_detection::Table | |
| time: [60.491 µs 61.539 µs 62.591 µs] | |
| change: [-13.456% -10.294% -6.9317%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 1 (1.00%) high mild | |
| 1 (1.00%) high severe | |
| few_changed_detection/50000_entities_change_detection::Sparse | |
| time: [107.42 µs 109.81 µs 112.21 µs] | |
| change: [-7.4345% -4.0668% -0.5808%] (p = 0.02 < 0.05) | |
| Change within noise threshold. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high mild | |
| Benchmarking few_changed_detection/60000_entities_change_detection::Table: Warming up for 500.00 ms | |
| Warning: Unable to complete 100 samples in 4.0s. You may wish to increase target time to 7.3s, enable flat sampling, or reduce sample count to 50. | |
| few_changed_detection/60000_entities_change_detection::Table | |
| time: [73.541 µs 74.442 µs 75.327 µs] | |
| change: [-6.8648% -3.7758% -0.5676%] (p = 0.02 < 0.05) | |
| Change within noise threshold. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 7 (7.00%) low mild | |
| 3 (3.00%) high mild | |
| few_changed_detection/60000_entities_change_detection::Sparse | |
| time: [124.64 µs 126.93 µs 129.23 µs] | |
| change: [-16.228% -13.984% -11.686%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high mild | |
| none_changed_detection/50000_entities_change_detection::Table | |
| time: [30.283 µs 31.076 µs 31.866 µs] | |
| change: [-6.9911% -2.6994% +2.1817%] (p = 0.24 > 0.05) | |
| No change in performance detected. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 3 (3.00%) high mild | |
| none_changed_detection/50000_entities_change_detection::Sparse | |
| time: [66.244 µs 69.045 µs 72.029 µs] | |
| change: [+5.3103% +13.077% +21.261%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 1 (1.00%) high mild | |
| 1 (1.00%) high severe | |
| none_changed_detection/60000_entities_change_detection::Table | |
| time: [33.511 µs 34.048 µs 34.607 µs] | |
| change: [-6.6053% -3.3839% +0.0227%] (p = 0.04 < 0.05) | |
| Change within noise threshold. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 2 (2.00%) high mild | |
| 1 (1.00%) high severe | |
| none_changed_detection/60000_entities_change_detection::Sparse | |
| time: [65.325 µs 67.318 µs 69.340 µs] | |
| change: [+6.9035% +12.962% +19.092%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) high mild | |
| Running benches/bevy_ecs/benches.rs (target/release/deps/ecs-e7867f34e168868e) | |
| Gnuplot not found, using plotters backend | |
| iter_fragmented/base time: [353.29 ns 357.28 ns 361.05 ns] | |
| change: [-4.5127% -3.4798% -2.4057%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| iter_fragmented/wide time: [3.1024 µs 3.1168 µs 3.1318 µs] | |
| change: [+0.3339% +1.0032% +1.7127%] (p = 0.01 < 0.05) | |
| Change within noise threshold. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 4 (4.00%) high mild | |
| iter_fragmented/foreach time: [161.64 ns 161.95 ns 162.27 ns] | |
| change: [+47.154% +47.984% +48.722%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 2 (2.00%) low mild | |
| 3 (3.00%) high mild | |
| 1 (1.00%) high severe | |
| iter_fragmented/foreach_wide | |
| time: [3.0470 µs 3.0803 µs 3.1260 µs] | |
| change: [-1.6686% -0.4854% +0.7370%] (p = 0.52 > 0.05) | |
| No change in performance detected. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 1 (1.00%) high mild | |
| 2 (2.00%) high severe | |
| iter_fragmented_sparse/base | |
| time: [6.0990 ns 6.4147 ns 6.8802 ns] | |
| change: [-34.838% -33.316% -31.225%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 15 outliers among 100 measurements (15.00%) | |
| 1 (1.00%) low mild | |
| 2 (2.00%) high mild | |
| 12 (12.00%) high severe | |
| iter_fragmented_sparse/wide | |
| time: [29.610 ns 29.679 ns 29.763 ns] | |
| change: [+5.2248% +5.5016% +5.8383%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 1 (1.00%) high mild | |
| 3 (3.00%) high severe | |
| iter_fragmented_sparse/foreach | |
| time: [6.2676 ns 6.2783 ns 6.2893 ns] | |
| change: [+26.435% +26.758% +27.052%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 3 (3.00%) high mild | |
| iter_fragmented_sparse/foreach_wide | |
| time: [29.655 ns 29.684 ns 29.713 ns] | |
| change: [+3.8857% +4.3576% +4.8207%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 1 (1.00%) low severe | |
| 2 (2.00%) high mild | |
| 1 (1.00%) high severe | |
| iter_simple/base time: [8.3985 µs 8.4694 µs 8.5597 µs] | |
| change: [-0.9871% +1.4595% +4.7065%] (p = 0.51 > 0.05) | |
| No change in performance detected. | |
| Found 14 outliers among 100 measurements (14.00%) | |
| 1 (1.00%) high mild | |
| 13 (13.00%) high severe | |
| iter_simple/wide time: [36.522 µs 36.568 µs 36.620 µs] | |
| change: [-5.1013% -2.1452% -0.1295%] (p = 0.09 > 0.05) | |
| No change in performance detected. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 1 (1.00%) low severe | |
| 4 (4.00%) high mild | |
| 1 (1.00%) high severe | |
| iter_simple/system time: [8.2380 µs 8.2488 µs 8.2633 µs] | |
| change: [-3.4641% -3.2069% -2.9800%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 1 (1.00%) low severe | |
| 2 (2.00%) high severe | |
| iter_simple/sparse_set time: [21.260 µs 21.305 µs 21.373 µs] | |
| change: [-0.4703% +0.0359% +0.5260%] (p = 0.89 > 0.05) | |
| No change in performance detected. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 2 (2.00%) low severe | |
| 4 (4.00%) high mild | |
| 2 (2.00%) high severe | |
| iter_simple/wide_sparse_set | |
| time: [100.83 µs 101.07 µs 101.35 µs] | |
| change: [-16.122% -14.170% -12.954%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 1 (1.00%) low mild | |
| 1 (1.00%) high severe | |
| iter_simple/foreach time: [3.9434 µs 3.9625 µs 3.9896 µs] | |
| change: [+0.2553% +0.5340% +0.8499%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 1 (1.00%) low mild | |
| 5 (5.00%) high mild | |
| 2 (2.00%) high severe | |
| iter_simple/foreach_wide | |
| time: [18.253 µs 18.299 µs 18.365 µs] | |
| change: [+1.1337% +1.3375% +1.5421%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 4 (4.00%) high mild | |
| 1 (1.00%) high severe | |
| iter_simple/foreach_sparse_set | |
| time: [20.685 µs 20.707 µs 20.730 µs] | |
| change: [+0.3559% +0.5344% +0.7043%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 2 (2.00%) low mild | |
| 3 (3.00%) high mild | |
| 1 (1.00%) high severe | |
| iter_simple/foreach_wide_sparse_set | |
| time: [97.369 µs 97.504 µs 97.655 µs] | |
| change: [-17.761% -16.401% -15.351%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 2 (2.00%) low mild | |
| 2 (2.00%) high severe | |
| heavy_compute/base time: [691.48 µs 693.48 µs 695.34 µs] | |
| change: [+25.808% +27.617% +28.810%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 2 (2.00%) low mild | |
| 2 (2.00%) high mild | |
| 1 (1.00%) high severe | |
| add_remove/table time: [797.24 µs 800.73 µs 806.26 µs] | |
| change: [+15.202% +15.779% +16.388%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 1 (1.00%) high mild | |
| 1 (1.00%) high severe | |
| add_remove/sparse_set time: [505.98 µs 506.71 µs 507.40 µs] | |
| change: [+12.601% +13.660% +14.614%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 1 (1.00%) low mild | |
| 4 (4.00%) high mild | |
| 5 (5.00%) high severe | |
| add_remove_big/table time: [3.2467 ms 3.2593 ms 3.2744 ms] | |
| change: [-2.7259% -2.0592% -1.3737%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 1 (1.00%) low mild | |
| 5 (5.00%) high mild | |
| 3 (3.00%) high severe | |
| add_remove_big/sparse_set | |
| time: [524.37 µs 526.13 µs 528.30 µs] | |
| change: [+7.9505% +9.2094% +10.452%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 13 outliers among 100 measurements (13.00%) | |
| 7 (7.00%) high mild | |
| 6 (6.00%) high severe | |
| insert_simple/base time: [303.80 µs 307.14 µs 310.60 µs] | |
| change: [-10.617% -9.1686% -7.7865%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) low mild | |
| insert_simple/unbatched time: [649.99 µs 653.89 µs 657.75 µs] | |
| change: [-6.0283% -5.1823% -4.4337%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 1 (1.00%) low mild | |
| 1 (1.00%) high mild | |
| no_archetypes/system_count/0 | |
| time: [2.8879 ns 2.8900 ns 2.8923 ns] | |
| change: [+39.110% +39.775% +40.252%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 2 (2.00%) low mild | |
| 2 (2.00%) high mild | |
| 1 (1.00%) high severe | |
| no_archetypes/system_count/20 | |
| time: [12.476 µs 12.819 µs 13.259 µs] | |
| change: [+15.649% +19.939% +24.866%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 12 outliers among 100 measurements (12.00%) | |
| 7 (7.00%) high mild | |
| 5 (5.00%) high severe | |
| no_archetypes/system_count/40 | |
| time: [22.486 µs 23.831 µs 25.283 µs] | |
| change: [+33.551% +39.532% +45.742%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 4 (4.00%) high mild | |
| 2 (2.00%) high severe | |
| no_archetypes/system_count/60 | |
| time: [30.243 µs 31.111 µs 32.039 µs] | |
| change: [-10.836% -5.5186% +0.6791%] (p = 0.07 > 0.05) | |
| No change in performance detected. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 2 (2.00%) high mild | |
| 5 (5.00%) high severe | |
| no_archetypes/system_count/80 | |
| time: [52.852 µs 54.859 µs 57.326 µs] | |
| change: [+61.677% +75.819% +95.917%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 4 (4.00%) high mild | |
| 4 (4.00%) high severe | |
| no_archetypes/system_count/100 | |
| time: [69.251 µs 73.123 µs 77.452 µs] | |
| change: [+51.047% +60.811% +70.827%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 2 (2.00%) low mild | |
| 3 (3.00%) high mild | |
| 4 (4.00%) high severe | |
| added_archetypes/archetype_count/100 | |
| time: [84.680 µs 86.597 µs 88.862 µs] | |
| change: [+19.839% +27.498% +34.788%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 13 outliers among 100 measurements (13.00%) | |
| 6 (6.00%) high mild | |
| 7 (7.00%) high severe | |
| added_archetypes/archetype_count/200 | |
| time: [115.81 µs 118.21 µs 121.05 µs] | |
| change: [+14.386% +17.362% +20.639%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 12 outliers among 100 measurements (12.00%) | |
| 7 (7.00%) high mild | |
| 5 (5.00%) high severe | |
| Benchmarking added_archetypes/archetype_count/500: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.8s, enable flat sampling, or reduce sample count to 60. | |
| added_archetypes/archetype_count/500 | |
| time: [246.20 µs 250.79 µs 256.09 µs] | |
| change: [+9.6113% +12.148% +14.792%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 1 (1.00%) low mild | |
| 4 (4.00%) high mild | |
| 4 (4.00%) high severe | |
| added_archetypes/archetype_count/1000 | |
| time: [454.66 µs 459.26 µs 464.13 µs] | |
| change: [+11.412% +13.138% +14.938%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 3 (3.00%) high mild | |
| 1 (1.00%) high severe | |
| added_archetypes/archetype_count/2000 | |
| time: [1.0034 ms 1.0182 ms 1.0363 ms] | |
| change: [+13.268% +15.150% +17.401%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 4 (4.00%) high mild | |
| 2 (2.00%) high severe | |
| added_archetypes/archetype_count/5000 | |
| time: [2.7572 ms 2.7781 ms 2.8012 ms] | |
| change: [+6.6400% +8.3604% +9.9393%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 1 (1.00%) high mild | |
| 2 (2.00%) high severe | |
| added_archetypes/archetype_count/10000 | |
| time: [6.2446 ms 6.3252 ms 6.4338 ms] | |
| change: [-3.2372% +0.1057% +3.2439%] (p = 0.95 > 0.05) | |
| No change in performance detected. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 1 (1.00%) high mild | |
| 4 (4.00%) high severe | |
| run_condition/yes/001_systems | |
| time: [6.3558 µs 6.7057 µs 7.4089 µs] | |
| change: [+5.3251% +12.343% +24.350%] (p = 0.01 < 0.05) | |
| Performance has regressed. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 1 (1.00%) low mild | |
| 1 (1.00%) high mild | |
| 8 (8.00%) high severe | |
| run_condition/yes/006_systems | |
| time: [7.8060 µs 7.9142 µs 8.0375 µs] | |
| change: [+3.6116% +6.8058% +8.9337%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 1 (1.00%) low mild | |
| 2 (2.00%) high mild | |
| 6 (6.00%) high severe | |
| run_condition/yes/011_systems | |
| time: [9.5307 µs 9.9070 µs 10.437 µs] | |
| change: [+11.286% +14.340% +17.964%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 2 (2.00%) high mild | |
| 6 (6.00%) high severe | |
| run_condition/yes/016_systems | |
| time: [11.103 µs 11.734 µs 12.850 µs] | |
| change: [+13.410% +20.753% +28.375%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 15 outliers among 100 measurements (15.00%) | |
| 8 (8.00%) high mild | |
| 7 (7.00%) high severe | |
| run_condition/yes/021_systems | |
| time: [12.894 µs 13.288 µs 13.740 µs] | |
| change: [+12.048% +16.153% +20.240%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 5 (5.00%) high mild | |
| run_condition/yes/026_systems | |
| time: [14.914 µs 15.328 µs 15.771 µs] | |
| change: [+19.150% +23.145% +26.621%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high mild | |
| run_condition/yes/031_systems | |
| time: [18.524 µs 18.871 µs 19.223 µs] | |
| change: [+28.486% +31.830% +34.982%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 1 (1.00%) low mild | |
| 3 (3.00%) high mild | |
| 1 (1.00%) high severe | |
| run_condition/yes/036_systems | |
| time: [20.608 µs 21.299 µs 22.013 µs] | |
| change: [+20.830% +27.522% +33.921%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 3 (3.00%) high mild | |
| 1 (1.00%) high severe | |
| run_condition/yes/041_systems | |
| time: [24.399 µs 25.398 µs 26.480 µs] | |
| change: [+23.469% +29.069% +34.562%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 7 (7.00%) high mild | |
| 2 (2.00%) high severe | |
| run_condition/yes/046_systems | |
| time: [26.784 µs 27.977 µs 29.492 µs] | |
| change: [+29.892% +37.682% +45.544%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 3 (3.00%) high mild | |
| 3 (3.00%) high severe | |
| run_condition/yes/051_systems | |
| time: [29.350 µs 30.422 µs 31.767 µs] | |
| change: [+27.125% +35.389% +43.636%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 3 (3.00%) high mild | |
| 3 (3.00%) high severe | |
| run_condition/yes/056_systems | |
| time: [30.196 µs 31.650 µs 33.220 µs] | |
| change: [+10.937% +19.245% +27.080%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 3 (3.00%) high mild | |
| run_condition/yes/061_systems | |
| time: [32.095 µs 33.140 µs 34.194 µs] | |
| change: [+31.566% +38.904% +48.318%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 2 (2.00%) high mild | |
| 3 (3.00%) high severe | |
| run_condition/yes/066_systems | |
| time: [37.136 µs 38.650 µs 40.327 µs] | |
| change: [+42.476% +71.542% +102.13%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 15 outliers among 100 measurements (15.00%) | |
| 5 (5.00%) high mild | |
| 10 (10.00%) high severe | |
| run_condition/yes/071_systems | |
| time: [42.404 µs 45.473 µs 49.634 µs] | |
| change: [+37.700% +55.628% +75.995%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 1 (1.00%) high mild | |
| 4 (4.00%) high severe | |
| run_condition/yes/076_systems | |
| time: [49.099 µs 50.900 µs 52.837 µs] | |
| change: [+41.934% +53.796% +65.742%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 3 (3.00%) high mild | |
| 1 (1.00%) high severe | |
| run_condition/yes/081_systems | |
| time: [51.649 µs 54.121 µs 56.920 µs] | |
| change: [+44.049% +59.793% +85.502%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 1 (1.00%) high mild | |
| 3 (3.00%) high severe | |
| run_condition/yes/086_systems | |
| time: [52.199 µs 54.152 µs 56.275 µs] | |
| change: [+37.588% +46.806% +56.297%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 11 outliers among 100 measurements (11.00%) | |
| 3 (3.00%) low mild | |
| 4 (4.00%) high mild | |
| 4 (4.00%) high severe | |
| run_condition/yes/091_systems | |
| time: [60.887 µs 63.108 µs 65.593 µs] | |
| change: [+47.178% +57.239% +68.243%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 3 (3.00%) low mild | |
| 4 (4.00%) high mild | |
| 2 (2.00%) high severe | |
| run_condition/yes/096_systems | |
| time: [66.761 µs 68.238 µs 69.787 µs] | |
| change: [+44.612% +55.340% +66.287%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 3 (3.00%) low mild | |
| 2 (2.00%) high mild | |
| 1 (1.00%) high severe | |
| run_condition/yes/101_systems | |
| time: [68.404 µs 70.270 µs 72.275 µs] | |
| change: [+38.967% +46.837% +54.502%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 3 (3.00%) low mild | |
| 4 (4.00%) high mild | |
| 2 (2.00%) high severe | |
| run_condition/no/001_systems | |
| time: [5.7417 µs 5.7670 µs 5.7942 µs] | |
| change: [+3.7528% +4.8719% +6.1873%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 2 (2.00%) low severe | |
| 4 (4.00%) high mild | |
| 1 (1.00%) high severe | |
| run_condition/no/006_systems | |
| time: [5.9024 µs 5.9532 µs 6.0266 µs] | |
| change: [-1.2886% +2.7111% +5.3251%] (p = 0.11 > 0.05) | |
| No change in performance detected. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 1 (1.00%) low mild | |
| 2 (2.00%) high mild | |
| 2 (2.00%) high severe | |
| run_condition/no/011_systems | |
| time: [6.1480 µs 6.6096 µs 7.2618 µs] | |
| change: [-2.2888% +1.0427% +6.0138%] (p = 0.66 > 0.05) | |
| No change in performance detected. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 1 (1.00%) low mild | |
| 3 (3.00%) high mild | |
| 4 (4.00%) high severe | |
| run_condition/no/016_systems | |
| time: [6.2052 µs 6.3676 µs 6.6299 µs] | |
| change: [+1.7138% +11.186% +22.298%] (p = 0.01 < 0.05) | |
| Performance has regressed. | |
| Found 12 outliers among 100 measurements (12.00%) | |
| 5 (5.00%) high mild | |
| 7 (7.00%) high severe | |
| run_condition/no/021_systems | |
| time: [6.3068 µs 6.3944 µs 6.5077 µs] | |
| change: [-8.5025% +0.2567% +7.2968%] (p = 0.96 > 0.05) | |
| No change in performance detected. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 1 (1.00%) low mild | |
| 4 (4.00%) high mild | |
| 3 (3.00%) high severe | |
| run_condition/no/026_systems | |
| time: [6.3799 µs 6.4342 µs 6.5203 µs] | |
| change: [+5.3079% +6.4978% +7.5445%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 2 (2.00%) low severe | |
| 2 (2.00%) low mild | |
| 1 (1.00%) high mild | |
| 4 (4.00%) high severe | |
| run_condition/no/031_systems | |
| time: [6.4921 µs 6.5770 µs 6.7287 µs] | |
| change: [+6.3260% +7.3586% +8.8060%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 1 (1.00%) low mild | |
| 4 (4.00%) high mild | |
| 2 (2.00%) high severe | |
| run_condition/no/036_systems | |
| time: [6.6982 µs 6.7200 µs 6.7430 µs] | |
| change: [+9.3272% +10.020% +10.831%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 12 outliers among 100 measurements (12.00%) | |
| 4 (4.00%) low mild | |
| 7 (7.00%) high mild | |
| 1 (1.00%) high severe | |
| run_condition/no/041_systems | |
| time: [6.8762 µs 6.9430 µs 7.0469 µs] | |
| change: [+7.6124% +8.9024% +10.177%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 2 (2.00%) low mild | |
| 2 (2.00%) high mild | |
| 4 (4.00%) high severe | |
| run_condition/no/046_systems | |
| time: [7.0808 µs 7.1577 µs 7.2601 µs] | |
| change: [+6.4426% +9.8416% +12.680%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 1 (1.00%) low mild | |
| 4 (4.00%) high mild | |
| 5 (5.00%) high severe | |
| run_condition/no/051_systems | |
| time: [7.2512 µs 7.3273 µs 7.4194 µs] | |
| change: [+10.479% +12.021% +14.014%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 6 (6.00%) high mild | |
| 3 (3.00%) high severe | |
| run_condition/no/056_systems | |
| time: [7.4970 µs 7.7334 µs 8.0639 µs] | |
| change: [+11.675% +22.431% +40.972%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 12 outliers among 100 measurements (12.00%) | |
| 2 (2.00%) high mild | |
| 10 (10.00%) high severe | |
| run_condition/no/061_systems | |
| time: [7.6191 µs 7.7063 µs 7.8040 µs] | |
| change: [+9.1538% +10.338% +11.383%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 2 (2.00%) low mild | |
| 6 (6.00%) high mild | |
| 1 (1.00%) high severe | |
| run_condition/no/066_systems | |
| time: [7.6431 µs 7.6729 µs 7.7040 µs] | |
| change: [+1.3647% +5.8673% +9.6454%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 3 (3.00%) low mild | |
| 3 (3.00%) high mild | |
| run_condition/no/071_systems | |
| time: [7.7572 µs 7.8219 µs 7.9180 µs] | |
| change: [+7.2437% +8.9447% +11.075%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 1 (1.00%) low mild | |
| 5 (5.00%) high mild | |
| 2 (2.00%) high severe | |
| run_condition/no/076_systems | |
| time: [7.9318 µs 7.9928 µs 8.0733 µs] | |
| change: [+5.3093% +7.0347% +8.4624%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 3 (3.00%) low mild | |
| 3 (3.00%) high mild | |
| 2 (2.00%) high severe | |
| run_condition/no/081_systems | |
| time: [8.0639 µs 8.1335 µs 8.2200 µs] | |
| change: [+2.6845% +5.3526% +7.5489%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 2 (2.00%) low mild | |
| 1 (1.00%) high mild | |
| 3 (3.00%) high severe | |
| run_condition/no/086_systems | |
| time: [8.1455 µs 8.1732 µs 8.2002 µs] | |
| change: [-15.610% -8.4819% -3.6353%] (p = 0.01 < 0.05) | |
| Performance has improved. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 2 (2.00%) low mild | |
| 1 (1.00%) high mild | |
| 2 (2.00%) high severe | |
| run_condition/no/091_systems | |
| time: [8.3268 µs 8.3622 µs 8.3999 µs] | |
| change: [-5.3593% -3.2102% -0.8690%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 1 (1.00%) low mild | |
| 4 (4.00%) high mild | |
| 4 (4.00%) high severe | |
| run_condition/no/096_systems | |
| time: [8.4236 µs 8.4914 µs 8.5841 µs] | |
| change: [-8.0664% -2.7367% +0.9026%] (p = 0.35 > 0.05) | |
| No change in performance detected. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 1 (1.00%) low mild | |
| 4 (4.00%) high mild | |
| 4 (4.00%) high severe | |
| run_condition/no/101_systems | |
| time: [8.5967 µs 8.6722 µs 8.7933 µs] | |
| change: [-5.2737% -3.9361% -2.6453%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 3 (3.00%) low mild | |
| 4 (4.00%) high mild | |
| 3 (3.00%) high severe | |
| run_condition/yes_using_query/001_systems | |
| time: [6.2971 µs 6.3599 µs 6.4510 µs] | |
| change: [-6.4508% -3.2652% -0.6703%] (p = 0.02 < 0.05) | |
| Change within noise threshold. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 4 (4.00%) high mild | |
| 6 (6.00%) high severe | |
| run_condition/yes_using_query/006_systems | |
| time: [7.8579 µs 7.8999 µs 7.9452 µs] | |
| change: [-6.2986% -5.1081% -3.8719%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 1 (1.00%) low mild | |
| 2 (2.00%) high mild | |
| 4 (4.00%) high severe | |
| run_condition/yes_using_query/011_systems | |
| time: [9.6155 µs 9.8192 µs 10.067 µs] | |
| change: [-7.2805% -3.6462% -0.6689%] (p = 0.03 < 0.05) | |
| Change within noise threshold. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 3 (3.00%) high mild | |
| 7 (7.00%) high severe | |
| run_condition/yes_using_query/016_systems | |
| time: [11.808 µs 12.122 µs 12.484 µs] | |
| change: [-1.1222% +2.5199% +6.0269%] (p = 0.18 > 0.05) | |
| No change in performance detected. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 4 (4.00%) high mild | |
| 4 (4.00%) high severe | |
| run_condition/yes_using_query/021_systems | |
| time: [13.567 µs 14.007 µs 14.512 µs] | |
| change: [+2.2893% +7.6335% +12.830%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 1 (1.00%) high mild | |
| 1 (1.00%) high severe | |
| run_condition/yes_using_query/026_systems | |
| time: [17.743 µs 18.143 µs 18.539 µs] | |
| change: [+5.2574% +11.382% +18.114%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 13 outliers among 100 measurements (13.00%) | |
| 8 (8.00%) low mild | |
| 3 (3.00%) high mild | |
| 2 (2.00%) high severe | |
| run_condition/yes_using_query/031_systems | |
| time: [18.958 µs 19.475 µs 20.001 µs] | |
| change: [-3.3785% +3.4239% +11.798%] (p = 0.38 > 0.05) | |
| No change in performance detected. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 3 (3.00%) high mild | |
| 7 (7.00%) high severe | |
| run_condition/yes_using_query/036_systems | |
| time: [23.226 µs 23.709 µs 24.250 µs] | |
| change: [+3.0102% +8.8234% +14.674%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 11 outliers among 100 measurements (11.00%) | |
| 3 (3.00%) low mild | |
| 6 (6.00%) high mild | |
| 2 (2.00%) high severe | |
| run_condition/yes_using_query/041_systems | |
| time: [25.322 µs 26.060 µs 26.832 µs] | |
| change: [-27.506% -19.682% -11.955%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 3 (3.00%) high mild | |
| 1 (1.00%) high severe | |
| run_condition/yes_using_query/046_systems | |
| time: [27.924 µs 28.936 µs 30.009 µs] | |
| change: [-29.260% -22.648% -15.594%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 4 (4.00%) low mild | |
| 3 (3.00%) high mild | |
| 3 (3.00%) high severe | |
| run_condition/yes_using_query/051_systems | |
| time: [33.226 µs 35.111 µs 37.624 µs] | |
| change: [-23.413% -14.244% -5.0932%] (p = 0.01 < 0.05) | |
| Performance has improved. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 5 (5.00%) high mild | |
| 1 (1.00%) high severe | |
| run_condition/yes_using_query/056_systems | |
| time: [31.433 µs 33.371 µs 35.516 µs] | |
| change: [-25.074% -15.154% -2.0306%] (p = 0.01 < 0.05) | |
| Performance has improved. | |
| Found 14 outliers among 100 measurements (14.00%) | |
| 4 (4.00%) high mild | |
| 10 (10.00%) high severe | |
| run_condition/yes_using_query/061_systems | |
| time: [38.471 µs 39.881 µs 41.277 µs] | |
| change: [-1.6382% +8.6713% +19.343%] (p = 0.09 > 0.05) | |
| No change in performance detected. | |
| Found 20 outliers among 100 measurements (20.00%) | |
| 13 (13.00%) low mild | |
| 5 (5.00%) high mild | |
| 2 (2.00%) high severe | |
| run_condition/yes_using_query/066_systems | |
| time: [42.553 µs 43.946 µs 45.317 µs] | |
| change: [+16.650% +25.820% +39.113%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 1 (1.00%) low mild | |
| 3 (3.00%) high mild | |
| 3 (3.00%) high severe | |
| run_condition/yes_using_query/071_systems | |
| time: [52.889 µs 54.407 µs 55.975 µs] | |
| change: [-9.8143% -0.3747% +9.7582%] (p = 0.95 > 0.05) | |
| No change in performance detected. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 4 (4.00%) low mild | |
| 4 (4.00%) high mild | |
| 1 (1.00%) high severe | |
| run_condition/yes_using_query/076_systems | |
| time: [54.961 µs 56.952 µs 58.922 µs] | |
| change: [-15.902% -6.2897% +3.1393%] (p = 0.25 > 0.05) | |
| No change in performance detected. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 6 (6.00%) low mild | |
| 1 (1.00%) high mild | |
| 1 (1.00%) high severe | |
| run_condition/yes_using_query/081_systems | |
| time: [56.295 µs 58.235 µs 60.162 µs] | |
| change: [-11.566% -7.0606% -2.0577%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 1 (1.00%) high mild | |
| 1 (1.00%) high severe | |
| run_condition/yes_using_query/086_systems | |
| time: [57.037 µs 59.488 µs 61.911 µs] | |
| change: [-16.724% -9.3032% +0.1419%] (p = 0.02 < 0.05) | |
| Change within noise threshold. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 4 (4.00%) high mild | |
| 3 (3.00%) high severe | |
| run_condition/yes_using_query/091_systems | |
| time: [55.958 µs 59.928 µs 65.128 µs] | |
| change: [-21.265% -12.848% -3.7205%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 2 (2.00%) high mild | |
| 2 (2.00%) high severe | |
| run_condition/yes_using_query/096_systems | |
| time: [66.174 µs 69.011 µs 71.981 µs] | |
| change: [-12.915% -7.6509% -2.2556%] (p = 0.01 < 0.05) | |
| Performance has improved. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 3 (3.00%) high mild | |
| 3 (3.00%) high severe | |
| run_condition/yes_using_query/101_systems | |
| time: [78.925 µs 86.360 µs 95.685 µs] | |
| change: [+4.8596% +20.071% +38.982%] (p = 0.02 < 0.05) | |
| Performance has regressed. | |
| Found 14 outliers among 100 measurements (14.00%) | |
| 2 (2.00%) high mild | |
| 12 (12.00%) high severe | |
| run_condition/yes_using_resource/001_systems | |
| time: [6.3826 µs 6.4888 µs 6.6574 µs] | |
| change: [-15.012% -8.2132% -2.3493%] (p = 0.01 < 0.05) | |
| Performance has improved. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 5 (5.00%) high severe | |
| run_condition/yes_using_resource/006_systems | |
| time: [8.0855 µs 8.4384 µs 8.9594 µs] | |
| change: [+1.7393% +7.3000% +15.672%] (p = 0.01 < 0.05) | |
| Performance has regressed. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 2 (2.00%) high mild | |
| 6 (6.00%) high severe | |
| run_condition/yes_using_resource/011_systems | |
| time: [10.321 µs 10.527 µs 10.782 µs] | |
| change: [+3.6845% +9.0976% +13.957%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 4 (4.00%) high mild | |
| 4 (4.00%) high severe | |
| run_condition/yes_using_resource/016_systems | |
| time: [11.732 µs 12.056 µs 12.409 µs] | |
| change: [+7.4037% +10.836% +13.963%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 6 (6.00%) high mild | |
| 1 (1.00%) high severe | |
| run_condition/yes_using_resource/021_systems | |
| time: [14.536 µs 14.952 µs 15.336 µs] | |
| change: [+15.755% +19.457% +23.538%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high severe | |
| run_condition/yes_using_resource/026_systems | |
| time: [16.954 µs 17.376 µs 17.791 µs] | |
| change: [+28.418% +31.753% +35.266%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) high mild | |
| run_condition/yes_using_resource/031_systems | |
| time: [18.144 µs 18.690 µs 19.235 µs] | |
| change: [+12.588% +17.195% +21.957%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 3 (3.00%) high mild | |
| 1 (1.00%) high severe | |
| run_condition/yes_using_resource/036_systems | |
| time: [20.728 µs 21.233 µs 21.757 µs] | |
| change: [+19.980% +24.902% +30.219%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 2 (2.00%) high mild | |
| 1 (1.00%) high severe | |
| run_condition/yes_using_resource/041_systems | |
| time: [24.908 µs 25.551 µs 26.208 µs] | |
| change: [+23.662% +29.445% +35.468%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 5 (5.00%) high mild | |
| 2 (2.00%) high severe | |
| run_condition/yes_using_resource/046_systems | |
| time: [26.765 µs 27.683 µs 28.711 µs] | |
| change: [-0.2536% +7.0338% +14.675%] (p = 0.06 > 0.05) | |
| No change in performance detected. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 2 (2.00%) high mild | |
| 3 (3.00%) high severe | |
| run_condition/yes_using_resource/051_systems | |
| time: [30.048 µs 30.766 µs 31.492 µs] | |
| change: [+11.152% +15.795% +20.876%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 3 (3.00%) high mild | |
| 1 (1.00%) high severe | |
| run_condition/yes_using_resource/056_systems | |
| time: [29.885 µs 30.795 µs 31.728 µs] | |
| change: [-6.3475% -0.7566% +5.4634%] (p = 0.80 > 0.05) | |
| No change in performance detected. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 3 (3.00%) high mild | |
| 2 (2.00%) high severe | |
| run_condition/yes_using_resource/061_systems | |
| time: [30.339 µs 31.518 µs 32.649 µs] | |
| change: [-4.9211% +0.3981% +6.3294%] (p = 0.89 > 0.05) | |
| No change in performance detected. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 4 (4.00%) high mild | |
| run_condition/yes_using_resource/066_systems | |
| time: [41.945 µs 43.628 µs 45.405 µs] | |
| change: [+42.904% +53.890% +67.915%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 3 (3.00%) low mild | |
| 1 (1.00%) high mild | |
| 3 (3.00%) high severe | |
| run_condition/yes_using_resource/071_systems | |
| time: [47.516 µs 49.914 µs 52.493 µs] | |
| change: [+16.571% +24.014% +30.904%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 3 (3.00%) low mild | |
| 5 (5.00%) high mild | |
| 1 (1.00%) high severe | |
| run_condition/yes_using_resource/076_systems | |
| time: [53.099 µs 56.094 µs 60.018 µs] | |
| change: [+7.1448% +18.607% +32.431%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 3 (3.00%) low mild | |
| 1 (1.00%) high mild | |
| 3 (3.00%) high severe | |
| run_condition/yes_using_resource/081_systems | |
| time: [57.013 µs 58.423 µs 59.791 µs] | |
| change: [+2.2896% +13.562% +26.436%] (p = 0.02 < 0.05) | |
| Performance has regressed. | |
| Found 12 outliers among 100 measurements (12.00%) | |
| 6 (6.00%) low mild | |
| 3 (3.00%) high mild | |
| 3 (3.00%) high severe | |
| run_condition/yes_using_resource/086_systems | |
| time: [61.619 µs 63.146 µs 64.683 µs] | |
| change: [+4.8533% +11.934% +20.031%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 2 (2.00%) high mild | |
| 1 (1.00%) high severe | |
| run_condition/yes_using_resource/091_systems | |
| time: [66.334 µs 68.117 µs 69.971 µs] | |
| change: [+3.5509% +11.716% +19.693%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 2 (2.00%) high mild | |
| 3 (3.00%) high severe | |
| run_condition/yes_using_resource/096_systems | |
| time: [71.787 µs 73.340 µs 74.978 µs] | |
| change: [+12.103% +17.854% +24.322%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 1 (1.00%) low mild | |
| 5 (5.00%) high mild | |
| 2 (2.00%) high severe | |
| run_condition/yes_using_resource/101_systems | |
| time: [75.038 µs 76.798 µs 78.780 µs] | |
| change: [-4.1925% +3.5259% +12.701%] (p = 0.41 > 0.05) | |
| No change in performance detected. | |
| Found 19 outliers among 100 measurements (19.00%) | |
| 14 (14.00%) low mild | |
| 2 (2.00%) high mild | |
| 3 (3.00%) high severe | |
| empty_systems/000_systems | |
| time: [2.9076 ns 2.9119 ns 2.9173 ns] | |
| change: [+38.887% +39.192% +39.466%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 1 (1.00%) high mild | |
| 1 (1.00%) high severe | |
| empty_systems/001_systems | |
| time: [6.8378 µs 6.9885 µs 7.1602 µs] | |
| change: [+13.055% +15.467% +18.067%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 3 (3.00%) high mild | |
| 1 (1.00%) high severe | |
| empty_systems/002_systems | |
| time: [6.6777 µs 6.7553 µs 6.8624 µs] | |
| change: [+2.5092% +6.7306% +12.106%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 1 (1.00%) high mild | |
| 7 (7.00%) high severe | |
| empty_systems/003_systems | |
| time: [6.8836 µs 7.0317 µs 7.2082 µs] | |
| change: [+4.0152% +6.2730% +8.7571%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 20 outliers among 100 measurements (20.00%) | |
| 6 (6.00%) high mild | |
| 14 (14.00%) high severe | |
| empty_systems/004_systems | |
| time: [7.2804 µs 7.3999 µs 7.5339 µs] | |
| change: [+3.6333% +6.3159% +9.3113%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 1 (1.00%) high mild | |
| 2 (2.00%) high severe | |
| empty_systems/005_systems | |
| time: [8.1704 µs 8.4031 µs 8.6662 µs] | |
| change: [+9.5866% +12.962% +16.065%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 4 (4.00%) high mild | |
| empty_systems/010_systems | |
| time: [10.691 µs 11.094 µs 11.467 µs] | |
| change: [+13.399% +16.854% +20.831%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) high mild | |
| empty_systems/015_systems | |
| time: [13.658 µs 14.432 µs 15.402 µs] | |
| change: [+66.846% +85.340% +110.45%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 3 (3.00%) high mild | |
| 1 (1.00%) high severe | |
| empty_systems/020_systems | |
| time: [13.685 µs 14.570 µs 15.734 µs] | |
| change: [+25.925% +31.435% +37.745%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 1 (1.00%) high mild | |
| 1 (1.00%) high severe | |
| empty_systems/025_systems | |
| time: [14.536 µs 15.164 µs 15.912 µs] | |
| change: [+14.213% +18.690% +23.986%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 4 (4.00%) high mild | |
| 1 (1.00%) high severe | |
| empty_systems/030_systems | |
| time: [16.874 µs 17.532 µs 18.321 µs] | |
| change: [+1.9395% +7.3613% +12.966%] (p = 0.01 < 0.05) | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 4 (4.00%) high mild | |
| empty_systems/035_systems | |
| time: [19.670 µs 20.671 µs 21.847 µs] | |
| change: [+19.904% +24.867% +30.969%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 3 (3.00%) high mild | |
| 6 (6.00%) high severe | |
| empty_systems/040_systems | |
| time: [23.922 µs 24.519 µs 25.173 µs] | |
| change: [+33.335% +39.568% +46.408%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 4 (4.00%) high mild | |
| 1 (1.00%) high severe | |
| empty_systems/045_systems | |
| time: [25.406 µs 26.264 µs 27.303 µs] | |
| change: [-14.721% +1.0768% +17.842%] (p = 0.91 > 0.05) | |
| No change in performance detected. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 4 (4.00%) high mild | |
| 1 (1.00%) high severe | |
| empty_systems/050_systems | |
| time: [29.548 µs 30.415 µs 31.354 µs] | |
| change: [-0.8534% +7.6041% +16.554%] (p = 0.08 > 0.05) | |
| No change in performance detected. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 4 (4.00%) high mild | |
| 2 (2.00%) high severe | |
| empty_systems/055_systems | |
| time: [32.941 µs 34.232 µs 35.612 µs] | |
| change: [+9.4338% +16.217% +23.590%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 1 (1.00%) high mild | |
| 2 (2.00%) high severe | |
| empty_systems/060_systems | |
| time: [34.011 µs 36.197 µs 38.881 µs] | |
| change: [-14.920% -2.0795% +12.415%] (p = 0.79 > 0.05) | |
| No change in performance detected. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 3 (3.00%) high severe | |
| empty_systems/065_systems | |
| time: [31.939 µs 33.839 µs 36.078 µs] | |
| change: [+5.4834% +20.851% +40.220%] (p = 0.01 < 0.05) | |
| Performance has regressed. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 1 (1.00%) high mild | |
| 2 (2.00%) high severe | |
| empty_systems/070_systems | |
| time: [34.269 µs 39.253 µs 45.611 µs] | |
| change: [-8.5910% +3.7859% +18.324%] (p = 0.59 > 0.05) | |
| No change in performance detected. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 3 (3.00%) high mild | |
| 3 (3.00%) high severe | |
| empty_systems/075_systems | |
| time: [45.986 µs 49.070 µs 52.422 µs] | |
| change: [+57.878% +72.473% +87.285%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 17 outliers among 100 measurements (17.00%) | |
| 12 (12.00%) high mild | |
| 5 (5.00%) high severe | |
| empty_systems/080_systems | |
| time: [56.146 µs 62.045 µs 69.018 µs] | |
| change: [+13.883% +24.919% +39.846%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 1 (1.00%) high mild | |
| 5 (5.00%) high severe | |
| empty_systems/085_systems | |
| time: [57.996 µs 63.008 µs 68.838 µs] | |
| change: [+12.646% +22.262% +31.906%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 11 outliers among 100 measurements (11.00%) | |
| 1 (1.00%) low mild | |
| 4 (4.00%) high mild | |
| 6 (6.00%) high severe | |
| empty_systems/090_systems | |
| time: [59.826 µs 62.934 µs 66.786 µs] | |
| change: [+4.8127% +16.538% +29.871%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 1 (1.00%) high mild | |
| 5 (5.00%) high severe | |
| empty_systems/095_systems | |
| time: [65.493 µs 67.234 µs 68.987 µs] | |
| change: [+13.759% +18.966% +24.250%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 1 (1.00%) low mild | |
| 3 (3.00%) high mild | |
| empty_systems/100_systems | |
| time: [69.309 µs 72.651 µs 76.441 µs] | |
| change: [+0.0030% +7.1127% +15.196%] (p = 0.05 < 0.05) | |
| Change within noise threshold. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 2 (2.00%) high mild | |
| 2 (2.00%) high severe | |
| busy_systems/01x_entities_03_systems | |
| time: [28.481 µs 28.936 µs 29.492 µs] | |
| change: [+3.4061% +5.6187% +7.9505%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 4 (4.00%) high mild | |
| 3 (3.00%) high severe | |
| busy_systems/01x_entities_06_systems | |
| time: [46.786 µs 48.157 µs 50.606 µs] | |
| change: [+0.2996% +2.8489% +5.7369%] (p = 0.03 < 0.05) | |
| Change within noise threshold. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 1 (1.00%) high mild | |
| 4 (4.00%) high severe | |
| busy_systems/01x_entities_09_systems | |
| time: [63.703 µs 64.089 µs 64.548 µs] | |
| change: [+1.2209% +2.3862% +3.5914%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 6 (6.00%) high mild | |
| 4 (4.00%) high severe | |
| busy_systems/01x_entities_12_systems | |
| time: [81.518 µs 82.270 µs 83.180 µs] | |
| change: [+0.9104% +2.1901% +3.5158%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 6 (6.00%) high mild | |
| 4 (4.00%) high severe | |
| busy_systems/01x_entities_15_systems | |
| time: [102.00 µs 103.18 µs 104.42 µs] | |
| change: [+0.5179% +2.4315% +4.2291%] (p = 0.01 < 0.05) | |
| Change within noise threshold. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 7 (7.00%) high mild | |
| busy_systems/02x_entities_03_systems | |
| time: [49.100 µs 50.464 µs 52.013 µs] | |
| change: [+6.0093% +9.3143% +13.798%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 5 (5.00%) high mild | |
| 4 (4.00%) high severe | |
| busy_systems/02x_entities_06_systems | |
| time: [84.279 µs 87.131 µs 91.550 µs] | |
| change: [+13.718% +16.687% +20.435%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 3 (3.00%) high mild | |
| 2 (2.00%) high severe | |
| busy_systems/02x_entities_09_systems | |
| time: [109.22 µs 110.21 µs 111.48 µs] | |
| change: [+0.7374% +1.8233% +2.9081%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 4 (4.00%) high mild | |
| 4 (4.00%) high severe | |
| busy_systems/02x_entities_12_systems | |
| time: [150.88 µs 157.51 µs 165.70 µs] | |
| change: [+4.3433% +8.7145% +13.833%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 15 outliers among 100 measurements (15.00%) | |
| 7 (7.00%) high mild | |
| 8 (8.00%) high severe | |
| busy_systems/02x_entities_15_systems | |
| time: [179.80 µs 183.67 µs 190.15 µs] | |
| change: [+0.7257% +2.5378% +4.9533%] (p = 0.01 < 0.05) | |
| Change within noise threshold. | |
| Found 11 outliers among 100 measurements (11.00%) | |
| 6 (6.00%) high mild | |
| 5 (5.00%) high severe | |
| busy_systems/03x_entities_03_systems | |
| time: [62.584 µs 62.943 µs 63.384 µs] | |
| change: [-0.4114% +0.7775% +2.0374%] (p = 0.23 > 0.05) | |
| No change in performance detected. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 4 (4.00%) high mild | |
| 4 (4.00%) high severe | |
| busy_systems/03x_entities_06_systems | |
| time: [102.44 µs 105.49 µs 110.26 µs] | |
| change: [-1.8500% +0.1918% +2.9231%] (p = 0.89 > 0.05) | |
| No change in performance detected. | |
| Found 16 outliers among 100 measurements (16.00%) | |
| 4 (4.00%) high mild | |
| 12 (12.00%) high severe | |
| busy_systems/03x_entities_09_systems | |
| time: [155.89 µs 156.55 µs 157.39 µs] | |
| change: [-0.9817% -0.1019% +0.8326%] (p = 0.83 > 0.05) | |
| No change in performance detected. | |
| Found 12 outliers among 100 measurements (12.00%) | |
| 6 (6.00%) high mild | |
| 6 (6.00%) high severe | |
| busy_systems/03x_entities_12_systems | |
| time: [203.52 µs 206.40 µs 210.53 µs] | |
| change: [-0.8122% +1.1576% +4.0939%] (p = 0.42 > 0.05) | |
| No change in performance detected. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 1 (1.00%) high mild | |
| 7 (7.00%) high severe | |
| busy_systems/03x_entities_15_systems | |
| time: [257.38 µs 258.24 µs 259.24 µs] | |
| change: [+0.1345% +0.5639% +1.0005%] (p = 0.01 < 0.05) | |
| Change within noise threshold. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 1 (1.00%) low mild | |
| 3 (3.00%) high mild | |
| 1 (1.00%) high severe | |
| busy_systems/04x_entities_03_systems | |
| time: [78.523 µs 80.756 µs 84.618 µs] | |
| change: [+0.6602% +2.1271% +4.1712%] (p = 0.01 < 0.05) | |
| Change within noise threshold. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 4 (4.00%) high mild | |
| 4 (4.00%) high severe | |
| busy_systems/04x_entities_06_systems | |
| time: [137.22 µs 137.71 µs 138.31 µs] | |
| change: [+5.2251% +5.8136% +6.4136%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 14 outliers among 100 measurements (14.00%) | |
| 2 (2.00%) low mild | |
| 7 (7.00%) high mild | |
| 5 (5.00%) high severe | |
| busy_systems/04x_entities_09_systems | |
| time: [201.75 µs 206.68 µs 216.28 µs] | |
| change: [-0.4407% +0.9250% +3.1576%] (p = 0.37 > 0.05) | |
| No change in performance detected. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 5 (5.00%) high mild | |
| 4 (4.00%) high severe | |
| busy_systems/04x_entities_12_systems | |
| time: [263.35 µs 264.44 µs 265.90 µs] | |
| change: [+0.2794% +1.0899% +2.0883%] (p = 0.01 < 0.05) | |
| Change within noise threshold. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 1 (1.00%) low mild | |
| 1 (1.00%) high mild | |
| 8 (8.00%) high severe | |
| busy_systems/04x_entities_15_systems | |
| time: [330.73 µs 331.58 µs 332.49 µs] | |
| change: [-2.0236% -1.0317% -0.2640%] (p = 0.02 < 0.05) | |
| Change within noise threshold. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 2 (2.00%) low mild | |
| 3 (3.00%) high mild | |
| 4 (4.00%) high severe | |
| busy_systems/05x_entities_03_systems | |
| time: [92.806 µs 93.312 µs 93.930 µs] | |
| change: [-5.1568% -2.8485% -1.0290%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 2 (2.00%) high mild | |
| 5 (5.00%) high severe | |
| busy_systems/05x_entities_06_systems | |
| time: [169.62 µs 170.50 µs 171.64 µs] | |
| change: [-1.1500% -0.4447% +0.4314%] (p = 0.27 > 0.05) | |
| No change in performance detected. | |
| Found 11 outliers among 100 measurements (11.00%) | |
| 5 (5.00%) high mild | |
| 6 (6.00%) high severe | |
| busy_systems/05x_entities_09_systems | |
| time: [251.78 µs 256.93 µs 265.86 µs] | |
| change: [+2.4628% +4.0875% +6.3238%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 1 (1.00%) high mild | |
| 3 (3.00%) high severe | |
| busy_systems/05x_entities_12_systems | |
| time: [324.24 µs 326.14 µs 328.32 µs] | |
| change: [-2.6978% -1.8274% -0.9775%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 1 (1.00%) high mild | |
| 7 (7.00%) high severe | |
| busy_systems/05x_entities_15_systems | |
| time: [406.74 µs 411.97 µs 420.95 µs] | |
| change: [-0.2130% +1.0895% +3.0036%] (p = 0.22 > 0.05) | |
| No change in performance detected. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 3 (3.00%) high mild | |
| 6 (6.00%) high severe | |
| contrived/01x_entities_03_systems | |
| time: [19.083 µs 19.401 µs 19.703 µs] | |
| change: [-1.0253% +1.7821% +4.4012%] (p = 0.20 > 0.05) | |
| No change in performance detected. | |
| Found 21 outliers among 100 measurements (21.00%) | |
| 2 (2.00%) low severe | |
| 16 (16.00%) low mild | |
| 2 (2.00%) high mild | |
| 1 (1.00%) high severe | |
| contrived/01x_entities_06_systems | |
| time: [29.662 µs 29.986 µs 30.302 µs] | |
| change: [+4.3004% +6.5707% +9.0447%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 16 outliers among 100 measurements (16.00%) | |
| 3 (3.00%) low mild | |
| 3 (3.00%) high mild | |
| 10 (10.00%) high severe | |
| contrived/01x_entities_09_systems | |
| time: [40.204 µs 40.945 µs 42.033 µs] | |
| change: [-0.6242% +1.8812% +5.0901%] (p = 0.25 > 0.05) | |
| No change in performance detected. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 3 (3.00%) high mild | |
| 4 (4.00%) high severe | |
| contrived/01x_entities_12_systems | |
| time: [51.050 µs 51.619 µs 52.402 µs] | |
| change: [-9.5714% -2.7598% +1.8144%] (p = 0.51 > 0.05) | |
| No change in performance detected. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 2 (2.00%) high mild | |
| 3 (3.00%) high severe | |
| contrived/01x_entities_15_systems | |
| time: [60.785 µs 62.556 µs 65.489 µs] | |
| change: [-11.970% -6.2821% -0.9366%] (p = 0.02 < 0.05) | |
| Change within noise threshold. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 1 (1.00%) low mild | |
| 1 (1.00%) high mild | |
| 4 (4.00%) high severe | |
| contrived/02x_entities_03_systems | |
| time: [27.795 µs 28.009 µs 28.227 µs] | |
| change: [-2.9432% -1.5734% -0.0465%] (p = 0.03 < 0.05) | |
| Change within noise threshold. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 3 (3.00%) low mild | |
| 4 (4.00%) high mild | |
| 3 (3.00%) high severe | |
| contrived/02x_entities_06_systems | |
| time: [45.857 µs 46.302 µs 46.842 µs] | |
| change: [-2.1986% -0.5883% +1.2275%] (p = 0.51 > 0.05) | |
| No change in performance detected. | |
| Found 11 outliers among 100 measurements (11.00%) | |
| 6 (6.00%) high mild | |
| 5 (5.00%) high severe | |
| contrived/02x_entities_09_systems | |
| time: [65.561 µs 65.903 µs 66.357 µs] | |
| change: [+1.8155% +3.9091% +6.5228%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 13 outliers among 100 measurements (13.00%) | |
| 5 (5.00%) high mild | |
| 8 (8.00%) high severe | |
| contrived/02x_entities_12_systems | |
| time: [80.303 µs 81.135 µs 82.117 µs] | |
| change: [+0.3888% +1.5732% +2.8578%] (p = 0.01 < 0.05) | |
| Change within noise threshold. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 2 (2.00%) high mild | |
| 6 (6.00%) high severe | |
| contrived/02x_entities_15_systems | |
| time: [95.348 µs 98.872 µs 103.62 µs] | |
| change: [+0.9999% +2.9264% +5.3000%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 2 (2.00%) low mild | |
| 3 (3.00%) high mild | |
| 5 (5.00%) high severe | |
| contrived/03x_entities_03_systems | |
| time: [37.053 µs 37.422 µs 37.882 µs] | |
| change: [-2.4779% -1.4542% -0.2196%] (p = 0.01 < 0.05) | |
| Change within noise threshold. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 1 (1.00%) high mild | |
| 2 (2.00%) high severe | |
| contrived/03x_entities_06_systems | |
| time: [59.430 µs 59.704 µs 59.995 µs] | |
| change: [-1.8253% -0.6128% +0.6050%] (p = 0.34 > 0.05) | |
| No change in performance detected. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 2 (2.00%) low mild | |
| 3 (3.00%) high mild | |
| 5 (5.00%) high severe | |
| contrived/03x_entities_09_systems | |
| time: [86.622 µs 87.354 µs 88.433 µs] | |
| change: [+0.7440% +4.8124% +12.474%] (p = 0.07 > 0.05) | |
| No change in performance detected. | |
| Found 14 outliers among 100 measurements (14.00%) | |
| 5 (5.00%) high mild | |
| 9 (9.00%) high severe | |
| contrived/03x_entities_12_systems | |
| time: [106.93 µs 107.36 µs 107.85 µs] | |
| change: [+0.4608% +1.8977% +3.8188%] (p = 0.02 < 0.05) | |
| Change within noise threshold. | |
| Found 11 outliers among 100 measurements (11.00%) | |
| 2 (2.00%) high mild | |
| 9 (9.00%) high severe | |
| contrived/03x_entities_15_systems | |
| time: [128.23 µs 131.58 µs 137.14 µs] | |
| change: [-1.2030% +0.5803% +2.7378%] (p = 0.60 > 0.05) | |
| No change in performance detected. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 5 (5.00%) high severe | |
| contrived/04x_entities_03_systems | |
| time: [44.726 µs 45.066 µs 45.553 µs] | |
| change: [-1.5301% -0.2706% +1.0044%] (p = 0.69 > 0.05) | |
| No change in performance detected. | |
| Found 12 outliers among 100 measurements (12.00%) | |
| 4 (4.00%) low severe | |
| 4 (4.00%) high mild | |
| 4 (4.00%) high severe | |
| contrived/04x_entities_06_systems | |
| time: [73.636 µs 73.938 µs 74.278 µs] | |
| change: [-2.9789% -2.2571% -1.3409%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 1 (1.00%) low mild | |
| 2 (2.00%) high mild | |
| 4 (4.00%) high severe | |
| contrived/04x_entities_09_systems | |
| time: [101.10 µs 102.32 µs 104.72 µs] | |
| change: [-1.6643% +0.9102% +5.2815%] (p = 0.73 > 0.05) | |
| No change in performance detected. | |
| Found 11 outliers among 100 measurements (11.00%) | |
| 1 (1.00%) low mild | |
| 6 (6.00%) high mild | |
| 4 (4.00%) high severe | |
| contrived/04x_entities_12_systems | |
| time: [126.12 µs 126.64 µs 127.22 µs] | |
| change: [-1.5629% -0.4041% +0.9101%] (p = 0.52 > 0.05) | |
| No change in performance detected. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 2 (2.00%) high mild | |
| 5 (5.00%) high severe | |
| contrived/04x_entities_15_systems | |
| time: [154.17 µs 154.99 µs 156.03 µs] | |
| change: [-0.5203% +0.6451% +2.0148%] (p = 0.34 > 0.05) | |
| No change in performance detected. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 2 (2.00%) high mild | |
| 4 (4.00%) high severe | |
| contrived/05x_entities_03_systems | |
| time: [52.683 µs 53.086 µs 53.644 µs] | |
| change: [-0.2874% +0.8210% +1.9402%] (p = 0.16 > 0.05) | |
| No change in performance detected. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 1 (1.00%) low mild | |
| 1 (1.00%) high mild | |
| 6 (6.00%) high severe | |
| contrived/05x_entities_06_systems | |
| time: [87.067 µs 87.908 µs 88.990 µs] | |
| change: [-0.6594% +0.2784% +1.2982%] (p = 0.58 > 0.05) | |
| No change in performance detected. | |
| Found 14 outliers among 100 measurements (14.00%) | |
| 1 (1.00%) low mild | |
| 6 (6.00%) high mild | |
| 7 (7.00%) high severe | |
| contrived/05x_entities_09_systems | |
| time: [119.77 µs 121.78 µs 125.50 µs] | |
| change: [-0.9177% +0.8864% +3.9181%] (p = 0.60 > 0.05) | |
| No change in performance detected. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 1 (1.00%) low mild | |
| 4 (4.00%) high mild | |
| 4 (4.00%) high severe | |
| contrived/05x_entities_12_systems | |
| time: [151.10 µs 151.60 µs 152.17 µs] | |
| change: [-3.8272% -2.7228% -1.7015%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 2 (2.00%) high mild | |
| 3 (3.00%) high severe | |
| contrived/05x_entities_15_systems | |
| time: [193.20 µs 198.64 µs 208.18 µs] | |
| change: [+4.9690% +7.3067% +9.8689%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 7 (7.00%) high mild | |
| 1 (1.00%) high severe | |
| schedule/base time: [27.617 µs 27.981 µs 28.429 µs] | |
| change: [-0.6839% +1.2328% +3.2544%] (p = 0.22 > 0.05) | |
| No change in performance detected. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 2 (2.00%) high mild | |
| 5 (5.00%) high severe | |
| build_schedule/100_schedule_noconstraints | |
| time: [390.19 µs 395.94 µs 403.04 µs] | |
| change: [+6.5795% +8.5858% +10.707%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 2 (2.00%) high mild | |
| 5 (5.00%) high severe | |
| build_schedule/100_schedule | |
| time: [12.342 ms 12.399 ms 12.459 ms] | |
| change: [+36.783% +37.658% +38.490%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high mild | |
| Benchmarking build_schedule/500_schedule_noconstraints: Warming up for 500.00 ms | |
| Warning: Unable to complete 100 samples in 15.0s. You may wish to increase target time to 21.6s, enable flat sampling, or reduce sample count to 50. | |
| build_schedule/500_schedule_noconstraints | |
| time: [4.2115 ms 4.2605 ms 4.3238 ms] | |
| change: [+13.009% +14.980% +17.241%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 1 (1.00%) low mild | |
| 3 (3.00%) high mild | |
| 2 (2.00%) high severe | |
| Benchmarking build_schedule/500_schedule: Warming up for 500.00 ms | |
| Warning: Unable to complete 100 samples in 15.0s. You may wish to increase target time to 40.1s, or reduce sample count to 30. | |
| build_schedule/500_schedule | |
| time: [403.71 ms 407.47 ms 411.36 ms] | |
| change: [+9.9113% +11.063% +12.104%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| build_schedule/1000_schedule_noconstraints | |
| time: [18.923 ms 19.018 ms 19.122 ms] | |
| change: [+4.0172% +4.6697% +5.3349%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 1 (1.00%) high mild | |
| 1 (1.00%) high severe | |
| Benchmarking build_schedule/1000_schedule: Warming up for 500.00 ms | |
| Warning: Unable to complete 100 samples in 15.0s. You may wish to increase target time to 231.1s, or reduce sample count to 10. | |
| build_schedule/1000_schedule | |
| time: [2.2503 s 2.2628 s 2.2768 s] | |
| change: [-2.9625% -2.3340% -1.6849%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 11 outliers among 100 measurements (11.00%) | |
| 4 (4.00%) high mild | |
| 7 (7.00%) high severe | |
| empty_commands/0_entities | |
| time: [2.9526 ns 2.9565 ns 2.9608 ns] | |
| change: [+117.33% +117.84% +118.38%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 12 outliers among 100 measurements (12.00%) | |
| 2 (2.00%) low mild | |
| 7 (7.00%) high mild | |
| 3 (3.00%) high severe | |
| spawn_commands/2000_entities | |
| time: [109.53 µs 111.74 µs 114.35 µs] | |
| change: [-5.5717% +1.4131% +7.3261%] (p = 0.71 > 0.05) | |
| No change in performance detected. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 1 (1.00%) high mild | |
| 6 (6.00%) high severe | |
| spawn_commands/4000_entities | |
| time: [217.67 µs 219.07 µs 220.58 µs] | |
| change: [+5.6993% +8.4918% +11.411%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 1 (1.00%) low mild | |
| 1 (1.00%) high mild | |
| 3 (3.00%) high severe | |
| spawn_commands/6000_entities | |
| time: [333.99 µs 336.98 µs 340.16 µs] | |
| change: [+7.8377% +9.9971% +12.194%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 4 (4.00%) high mild | |
| 3 (3.00%) high severe | |
| spawn_commands/8000_entities | |
| time: [446.12 µs 453.92 µs 463.56 µs] | |
| change: [+1.1704% +7.7436% +14.624%] (p = 0.01 < 0.05) | |
| Performance has regressed. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 3 (3.00%) high mild | |
| 4 (4.00%) high severe | |
| insert_commands/insert time: [270.42 µs 270.85 µs 271.33 µs] | |
| change: [+16.022% +17.697% +19.229%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 2 (2.00%) high mild | |
| 8 (8.00%) high severe | |
| insert_commands/insert_batch | |
| time: [227.31 µs 228.08 µs 228.95 µs] | |
| change: [+44.979% +46.466% +48.168%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 13 outliers among 100 measurements (13.00%) | |
| 9 (9.00%) high mild | |
| 4 (4.00%) high severe | |
| fake_commands/2000_commands | |
| time: [5.4449 µs 5.4521 µs 5.4596 µs] | |
| change: [+92.287% +92.861% +93.492%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 3 (3.00%) high mild | |
| 3 (3.00%) high severe | |
| fake_commands/4000_commands | |
| time: [10.928 µs 11.170 µs 11.676 µs] | |
| change: [+92.877% +94.632% +97.860%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 11 outliers among 100 measurements (11.00%) | |
| 1 (1.00%) low severe | |
| 1 (1.00%) low mild | |
| 7 (7.00%) high mild | |
| 2 (2.00%) high severe | |
| fake_commands/6000_commands | |
| time: [16.371 µs 16.502 µs 16.766 µs] | |
| change: [+90.551% +93.406% +97.240%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 1 (1.00%) low mild | |
| 2 (2.00%) high mild | |
| 3 (3.00%) high severe | |
| fake_commands/8000_commands | |
| time: [21.863 µs 21.885 µs 21.907 µs] | |
| change: [+92.874% +93.651% +94.240%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 1 (1.00%) low mild | |
| 3 (3.00%) high mild | |
| 2 (2.00%) high severe | |
| sized_commands_0_bytes/2000_commands | |
| time: [2.8226 µs 2.8256 µs 2.8287 µs] | |
| change: [+28.954% +29.241% +29.549%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 2 (2.00%) low mild | |
| 2 (2.00%) high mild | |
| 3 (3.00%) high severe | |
| sized_commands_0_bytes/4000_commands | |
| time: [5.6630 µs 5.6721 µs 5.6825 µs] | |
| change: [+18.913% +24.841% +29.184%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 4 (4.00%) high mild | |
| sized_commands_0_bytes/6000_commands | |
| time: [8.5123 µs 8.5658 µs 8.6405 µs] | |
| change: [+30.201% +32.962% +36.635%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 3 (3.00%) high mild | |
| 4 (4.00%) high severe | |
| sized_commands_0_bytes/8000_commands | |
| time: [11.311 µs 11.330 µs 11.350 µs] | |
| change: [+28.590% +29.206% +29.730%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 1 (1.00%) low mild | |
| 2 (2.00%) high mild | |
| 4 (4.00%) high severe | |
| sized_commands_12_bytes/2000_commands | |
| time: [3.1363 µs 3.1463 µs 3.1601 µs] | |
| change: [-15.538% -10.255% -5.6400%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 1 (1.00%) high mild | |
| 3 (3.00%) high severe | |
| sized_commands_12_bytes/4000_commands | |
| time: [6.2524 µs 6.2613 µs 6.2703 µs] | |
| change: [-4.2965% -4.0617% -3.8405%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) high mild | |
| sized_commands_12_bytes/6000_commands | |
| time: [9.4536 µs 9.4820 µs 9.5188 µs] | |
| change: [-4.2687% -3.7807% -3.1624%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 4 (4.00%) high mild | |
| 3 (3.00%) high severe | |
| sized_commands_12_bytes/8000_commands | |
| time: [15.562 µs 15.590 µs 15.621 µs] | |
| change: [-6.8576% -6.6372% -6.3859%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high severe | |
| sized_commands_512_bytes/2000_commands | |
| time: [49.104 µs 49.282 µs 49.481 µs] | |
| change: [-20.014% -19.338% -18.653%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 2 (2.00%) high mild | |
| 8 (8.00%) high severe | |
| sized_commands_512_bytes/4000_commands | |
| time: [97.917 µs 98.143 µs 98.379 µs] | |
| change: [-21.696% -20.572% -19.617%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 5 (5.00%) high mild | |
| 3 (3.00%) high severe | |
| sized_commands_512_bytes/6000_commands | |
| time: [147.84 µs 148.13 µs 148.45 µs] | |
| change: [-21.000% -19.300% -17.509%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 1 (1.00%) high mild | |
| 7 (7.00%) high severe | |
| sized_commands_512_bytes/8000_commands | |
| time: [198.46 µs 198.92 µs 199.49 µs] | |
| change: [-22.620% -20.194% -18.390%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 14 outliers among 100 measurements (14.00%) | |
| 7 (7.00%) high mild | |
| 7 (7.00%) high severe | |
| get_or_spawn/individual time: [325.70 µs 326.92 µs 328.45 µs] | |
| change: [+20.503% +25.181% +31.012%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 19 outliers among 100 measurements (19.00%) | |
| 3 (3.00%) low mild | |
| 7 (7.00%) high mild | |
| 9 (9.00%) high severe | |
| get_or_spawn/batched time: [225.75 µs 226.04 µs 226.34 µs] | |
| change: [+44.545% +45.990% +47.528%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 4 (4.00%) high mild | |
| 4 (4.00%) high severe | |
| world_entity/50000_entities | |
| time: [62.570 µs 62.688 µs 62.839 µs] | |
| change: [-7.6214% -7.1508% -6.7139%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 2 (2.00%) high mild | |
| 2 (2.00%) high severe | |
| world_get/50000_entities_table | |
| time: [122.12 µs 122.31 µs 122.52 µs] | |
| change: [+6.5851% +6.8270% +7.0785%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) high mild | |
| world_get/50000_entities_sparse | |
| time: [144.30 µs 144.54 µs 144.86 µs] | |
| change: [+4.7009% +5.0038% +5.3755%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 5 (5.00%) high mild | |
| 2 (2.00%) high severe | |
| world_query_get/50000_entities_table | |
| time: [111.42 µs 111.57 µs 111.74 µs] | |
| change: [-5.0180% -4.5127% -4.0170%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 4 (4.00%) low mild | |
| 2 (2.00%) high mild | |
| 4 (4.00%) high severe | |
| world_query_get/50000_entities_table_wide | |
| time: [171.04 µs 171.90 µs 173.02 µs] | |
| change: [+22.976% +23.580% +24.329%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 1 (1.00%) high mild | |
| 2 (2.00%) high severe | |
| world_query_get/50000_entities_sparse | |
| time: [85.270 µs 87.853 µs 91.106 µs] | |
| change: [-46.906% -44.968% -43.015%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 15 outliers among 100 measurements (15.00%) | |
| 7 (7.00%) high mild | |
| 8 (8.00%) high severe | |
| world_query_get/50000_entities_sparse_wide | |
| time: [126.07 µs 126.35 µs 126.69 µs] | |
| change: [-67.660% -67.382% -67.043%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 3 (3.00%) high mild | |
| 3 (3.00%) high severe | |
| world_query_iter/50000_entities_table | |
| time: [19.626 µs 19.651 µs 19.680 µs] | |
| change: [-0.4513% -0.2221% +0.0415%] (p = 0.07 > 0.05) | |
| No change in performance detected. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 1 (1.00%) low severe | |
| 1 (1.00%) low mild | |
| 3 (3.00%) high mild | |
| 4 (4.00%) high severe | |
| world_query_iter/50000_entities_sparse | |
| time: [45.193 µs 45.230 µs 45.270 µs] | |
| change: [-1.5667% -1.2576% -0.9836%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Found 12 outliers among 100 measurements (12.00%) | |
| 3 (3.00%) low mild | |
| 6 (6.00%) high mild | |
| 3 (3.00%) high severe | |
| world_query_for_each/50000_entities_table | |
| time: [22.036 µs 22.061 µs 22.087 µs] | |
| change: [-1.2753% -1.0588% -0.8365%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 1 (1.00%) low severe | |
| 2 (2.00%) low mild | |
| 2 (2.00%) high mild | |
| 5 (5.00%) high severe | |
| world_query_for_each/50000_entities_sparse | |
| time: [43.873 µs 44.097 µs 44.459 µs] | |
| change: [+24.696% +25.614% +26.865%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 1 (1.00%) low severe | |
| 4 (4.00%) high severe | |
| spawn_world/1_entities time: [54.965 ns 55.555 ns 56.100 ns] | |
| change: [-4.0841% -1.0680% +2.3798%] (p = 0.55 > 0.05) | |
| No change in performance detected. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 5 (5.00%) high mild | |
| 2 (2.00%) high severe | |
| spawn_world/10_entities time: [566.22 ns 573.57 ns 581.29 ns] | |
| change: [-0.4413% +3.2203% +7.6411%] (p = 0.16 > 0.05) | |
| No change in performance detected. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 1 (1.00%) low severe | |
| 1 (1.00%) low mild | |
| 4 (4.00%) high mild | |
| 3 (3.00%) high severe | |
| spawn_world/100_entities | |
| time: [5.5896 µs 5.6525 µs 5.7152 µs] | |
| change: [-3.1807% +0.6302% +4.4414%] (p = 0.76 > 0.05) | |
| No change in performance detected. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 1 (1.00%) low mild | |
| 2 (2.00%) high mild | |
| 2 (2.00%) high severe | |
| spawn_world/1000_entities | |
| time: [55.823 µs 56.566 µs 57.341 µs] | |
| change: [-3.3484% -0.3368% +2.6494%] (p = 0.83 > 0.05) | |
| No change in performance detected. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 4 (4.00%) high mild | |
| 1 (1.00%) high severe | |
| spawn_world/10000_entities | |
| time: [529.60 µs 545.23 µs 568.13 µs] | |
| change: [-5.0892% -0.2756% +3.9541%] (p = 0.91 > 0.05) | |
| No change in performance detected. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 1 (1.00%) high mild | |
| 1 (1.00%) high severe | |
| query_get_component_simple/unchecked | |
| time: [354.32 µs 355.20 µs 356.13 µs] | |
| change: [-4.3978% -3.5651% -2.8696%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 4 (4.00%) high mild | |
| 1 (1.00%) high severe | |
| query_get_component_simple/system | |
| time: [346.46 µs 348.14 µs 350.95 µs] | |
| change: [-1.8842% -1.4539% -0.9017%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 1 (1.00%) high mild | |
| 1 (1.00%) high severe | |
| query_get_component/50000_entities_table | |
| time: [344.32 µs 344.88 µs 345.49 µs] | |
| change: [-2.7273% -2.5245% -2.3046%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 3 (3.00%) low mild | |
| 2 (2.00%) high mild | |
| 5 (5.00%) high severe | |
| query_get_component/50000_entities_sparse | |
| time: [379.94 µs 380.64 µs 381.54 µs] | |
| change: [+0.0129% +0.4125% +0.7814%] (p = 0.03 < 0.05) | |
| Change within noise threshold. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) high severe | |
| query_get/50000_entities_table | |
| time: [175.00 µs 175.16 µs 175.36 µs] | |
| change: [-23.316% -10.637% -2.4915%] (p = 0.18 > 0.05) | |
| No change in performance detected. | |
| Found 12 outliers among 100 measurements (12.00%) | |
| 5 (5.00%) low severe | |
| 2 (2.00%) low mild | |
| 3 (3.00%) high mild | |
| 2 (2.00%) high severe | |
| query_get/50000_entities_sparse | |
| time: [168.71 µs 169.02 µs 169.37 µs] | |
| change: [-16.892% -16.295% -15.833%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 2 (2.00%) low mild | |
| 3 (3.00%) high mild | |
| 2 (2.00%) high severe | |
| query_get_many_2/50000_calls_table | |
| time: [443.66 µs 444.62 µs 445.80 µs] | |
| change: [-2.9540% -2.0453% -1.3664%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 1 (1.00%) low mild | |
| 4 (4.00%) high mild | |
| 3 (3.00%) high severe | |
| query_get_many_2/50000_calls_sparse | |
| time: [385.60 µs 388.96 µs 393.17 µs] | |
| change: [-13.848% -12.094% -10.217%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 13 outliers among 100 measurements (13.00%) | |
| 5 (5.00%) high mild | |
| 8 (8.00%) high severe | |
| query_get_many_5/50000_calls_table | |
| time: [1.1066 ms 1.1272 ms 1.1522 ms] | |
| change: [-6.9545% -4.6884% -2.5237%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 4 (4.00%) high mild | |
| 5 (5.00%) high severe | |
| query_get_many_5/50000_calls_sparse | |
| time: [991.90 µs 1.0064 ms 1.0233 ms] | |
| change: [-24.149% -21.746% -19.295%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 6 (6.00%) high mild | |
| 3 (3.00%) high severe | |
| query_get_many_10/50000_calls_table | |
| time: [2.9250 ms 3.0243 ms 3.1120 ms] | |
| change: [-12.117% -9.7579% -7.3907%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Benchmarking query_get_many_10/50000_calls_sparse: Warming up for 500.00 ms | |
| Warning: Unable to complete 100 samples in 20.0s. You may wish to increase target time to 24.9s, enable flat sampling, or reduce sample count to 60. | |
| query_get_many_10/50000_calls_sparse | |
| time: [4.0392 ms 4.2615 ms 4.5391 ms] | |
| change: [+15.748% +21.814% +28.321%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 3 (3.00%) high mild | |
| 1 (1.00%) high severe | |
| Running benches/bevy_tasks/iter.rs (target/release/deps/iter-aa1877e0314fea28) | |
| Gnuplot not found, using plotters backend | |
| Benchmarking overhead_iter: AnalyzingCriterion.rs ERROR: At least one measurement of benchmark overhead_iter took zero time per iteration. This should not be possible. If using iter_custom, please verify that your routine is correctly measured. | |
| overhead_par_iter/threads/1 | |
| time: [25.859 µs 26.066 µs 26.305 µs] | |
| change: [-9.5344% -8.3734% -7.1676%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 1 (1.00%) low mild | |
| 3 (3.00%) high mild | |
| 5 (5.00%) high severe | |
| overhead_par_iter/threads/2 | |
| time: [41.798 µs 43.096 µs 44.570 µs] | |
| change: [-5.5633% -0.5577% +4.5971%] (p = 0.84 > 0.05) | |
| No change in performance detected. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 4 (4.00%) high mild | |
| 2 (2.00%) high severe | |
| overhead_par_iter/threads/4 | |
| time: [61.944 µs 63.684 µs 65.301 µs] | |
| change: [-13.582% -7.2082% -1.4307%] (p = 0.02 < 0.05) | |
| Performance has improved. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 3 (3.00%) low mild | |
| overhead_par_iter/threads/8 | |
| time: [62.595 µs 64.531 µs 66.426 µs] | |
| change: [-10.051% -6.7528% -3.1621%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 1 (1.00%) low mild | |
| 1 (1.00%) high mild | |
| overhead_par_iter/threads/16 | |
| time: [65.855 µs 70.120 µs 76.521 µs] | |
| change: [-4.2027% +1.0247% +6.8564%] (p = 0.72 > 0.05) | |
| No change in performance detected. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 1 (1.00%) high mild | |
| 1 (1.00%) high severe | |
| overhead_par_iter/threads/32 | |
| time: [67.630 µs 69.119 µs 70.475 µs] | |
| change: [+3.9669% +9.0525% +14.294%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 15 outliers among 100 measurements (15.00%) | |
| 1 (1.00%) low severe | |
| 6 (6.00%) low mild | |
| 2 (2.00%) high mild | |
| 6 (6.00%) high severe | |
| Benchmarking for_each_iter: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 21.8s, or reduce sample count to 20. | |
| for_each_iter time: [217.80 ms 218.15 ms 218.64 ms] | |
| change: [-0.2454% -0.0713% +0.1636%] (p = 0.55 > 0.05) | |
| No change in performance detected. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) high severe | |
| Benchmarking for_each_par_iter/threads/1: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 11.0s, or reduce sample count to 40. | |
| for_each_par_iter/threads/1 | |
| time: [110.05 ms 110.14 ms 110.23 ms] | |
| change: [-1.5090% -0.6122% -0.0864%] (p = 0.10 > 0.05) | |
| No change in performance detected. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) high mild | |
| Benchmarking for_each_par_iter/threads/2: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 7.9s, or reduce sample count to 60. | |
| for_each_par_iter/threads/2 | |
| time: [75.638 ms 79.189 ms 85.330 ms] | |
| change: [+0.2372% +4.8927% +12.692%] (p = 0.17 > 0.05) | |
| No change in performance detected. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 2 (2.00%) high mild | |
| 6 (6.00%) high severe | |
| for_each_par_iter/threads/4 | |
| time: [46.918 ms 47.101 ms 47.288 ms] | |
| change: [+1.3447% +1.7987% +2.1992%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high mild | |
| for_each_par_iter/threads/8 | |
| time: [35.848 ms 36.093 ms 36.413 ms] | |
| change: [-1.6992% +0.0965% +1.5337%] (p = 0.93 > 0.05) | |
| No change in performance detected. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high severe | |
| for_each_par_iter/threads/16 | |
| time: [35.947 ms 36.235 ms 36.557 ms] | |
| change: [-0.3400% +0.7064% +1.7253%] (p = 0.18 > 0.05) | |
| No change in performance detected. | |
| Found 11 outliers among 100 measurements (11.00%) | |
| 2 (2.00%) low mild | |
| 2 (2.00%) high mild | |
| 7 (7.00%) high severe | |
| for_each_par_iter/threads/32 | |
| time: [35.443 ms 35.832 ms 36.297 ms] | |
| change: [-1.8289% -0.5216% +0.9996%] (p = 0.47 > 0.05) | |
| No change in performance detected. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 4 (4.00%) high mild | |
| 3 (3.00%) high severe | |
| Benchmarking many_maps_iter: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 19.0s, or reduce sample count to 20. | |
| many_maps_iter time: [190.35 ms 191.00 ms 192.11 ms] | |
| change: [-1.4568% -0.1201% +0.9157%] (p = 0.88 > 0.05) | |
| No change in performance detected. | |
| Found 11 outliers among 100 measurements (11.00%) | |
| 6 (6.00%) low mild | |
| 2 (2.00%) high mild | |
| 3 (3.00%) high severe | |
| Benchmarking many_maps_par_iter/threads/1: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 9.6s, or reduce sample count to 50. | |
| many_maps_par_iter/threads/1 | |
| time: [96.346 ms 96.858 ms 97.591 ms] | |
| change: [+0.1766% +0.7401% +1.4791%] (p = 0.02 < 0.05) | |
| Change within noise threshold. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 3 (3.00%) high mild | |
| 5 (5.00%) high severe | |
| Benchmarking many_maps_par_iter/threads/2: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 6.6s, or reduce sample count to 70. | |
| many_maps_par_iter/threads/2 | |
| time: [65.699 ms 66.595 ms 68.318 ms] | |
| change: [-0.2397% +1.3725% +4.2250%] (p = 0.35 > 0.05) | |
| No change in performance detected. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 1 (1.00%) low mild | |
| 2 (2.00%) high severe | |
| many_maps_par_iter/threads/4 | |
| time: [42.380 ms 44.088 ms 46.159 ms] | |
| change: [+5.4309% +9.3559% +14.788%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 3 (3.00%) high mild | |
| 6 (6.00%) high severe | |
| many_maps_par_iter/threads/8 | |
| time: [31.602 ms 31.727 ms 31.857 ms] | |
| change: [-0.5908% +0.0111% +0.6458%] (p = 0.98 > 0.05) | |
| No change in performance detected. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) high mild | |
| many_maps_par_iter/threads/16 | |
| time: [31.533 ms 31.716 ms 31.927 ms] | |
| change: [-0.5844% +0.1948% +0.9758%] (p = 0.63 > 0.05) | |
| No change in performance detected. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 1 (1.00%) high mild | |
| 2 (2.00%) high severe | |
| many_maps_par_iter/threads/32 | |
| time: [31.560 ms 31.790 ms 32.072 ms] | |
| change: [-17.055% -10.654% -5.2943%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 2 (2.00%) high mild | |
| 2 (2.00%) high severe | |
| Running benches/bevy_reflect/list.rs (target/release/deps/reflect_list-bd9157d51588d401) | |
| Gnuplot not found, using plotters backend | |
| concrete_list_apply/empty_base_concrete_patch/100 | |
| time: [2.1283 µs 2.1360 µs 2.1481 µs] | |
| thrpt: [46.552 Melem/s 46.817 Melem/s 46.986 Melem/s] | |
| change: | |
| time: [+7.4794% +8.0002% +8.4655%] (p = 0.00 < 0.05) | |
| thrpt: [-7.8048% -7.4075% -6.9589%] | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 2 (2.00%) low mild | |
| 2 (2.00%) high severe | |
| concrete_list_apply/empty_base_concrete_patch/316 | |
| time: [6.2885 µs 6.2954 µs 6.3024 µs] | |
| thrpt: [50.140 Melem/s 50.196 Melem/s 50.251 Melem/s] | |
| change: | |
| time: [+9.2996% +9.5397% +9.7708%] (p = 0.00 < 0.05) | |
| thrpt: [-8.9011% -8.7089% -8.5084%] | |
| Performance has regressed. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 2 (2.00%) low mild | |
| 5 (5.00%) high mild | |
| concrete_list_apply/empty_base_concrete_patch/1000 | |
| time: [18.961 µs 19.312 µs 20.074 µs] | |
| thrpt: [49.817 Melem/s 51.782 Melem/s 52.741 Melem/s] | |
| change: | |
| time: [+9.8412% +11.311% +13.960%] (p = 0.00 < 0.05) | |
| thrpt: [-12.250% -10.161% -8.9595%] | |
| Performance has regressed. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 1 (1.00%) low severe | |
| 4 (4.00%) low mild | |
| 2 (2.00%) high severe | |
| concrete_list_apply/empty_base_concrete_patch/3162 | |
| time: [58.822 µs 58.892 µs 58.967 µs] | |
| thrpt: [53.623 Melem/s 53.692 Melem/s 53.755 Melem/s] | |
| change: | |
| time: [+9.3380% +9.5986% +9.8920%] (p = 0.00 < 0.05) | |
| thrpt: [-9.0016% -8.7580% -8.5405%] | |
| Performance has regressed. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 3 (3.00%) low mild | |
| 4 (4.00%) high mild | |
| 2 (2.00%) high severe | |
| concrete_list_apply/empty_base_concrete_patch/10000 | |
| time: [194.57 µs 195.20 µs 196.01 µs] | |
| thrpt: [51.017 Melem/s 51.229 Melem/s 51.395 Melem/s] | |
| change: | |
| time: [+9.6507% +10.247% +11.014%] (p = 0.00 < 0.05) | |
| thrpt: [-9.9212% -9.2943% -8.8013%] | |
| Performance has regressed. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 2 (2.00%) low mild | |
| 1 (1.00%) high mild | |
| 2 (2.00%) high severe | |
| concrete_list_apply/empty_base_dynamic_patch/100 | |
| time: [2.1535 µs 2.1568 µs 2.1601 µs] | |
| thrpt: [46.295 Melem/s 46.365 Melem/s 46.436 Melem/s] | |
| change: | |
| time: [+8.3862% +8.5943% +8.8200%] (p = 0.00 < 0.05) | |
| thrpt: [-8.1051% -7.9141% -7.7373%] | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 3 (3.00%) high mild | |
| 1 (1.00%) high severe | |
| concrete_list_apply/empty_base_dynamic_patch/316 | |
| time: [6.3533 µs 6.3675 µs 6.3826 µs] | |
| thrpt: [49.510 Melem/s 49.627 Melem/s 49.738 Melem/s] | |
| change: | |
| time: [+10.224% +10.572% +10.923%] (p = 0.00 < 0.05) | |
| thrpt: [-9.8477% -9.5613% -9.2756%] | |
| Performance has regressed. | |
| Found 13 outliers among 100 measurements (13.00%) | |
| 2 (2.00%) low mild | |
| 9 (9.00%) high mild | |
| 2 (2.00%) high severe | |
| concrete_list_apply/empty_base_dynamic_patch/1000 | |
| time: [18.923 µs 18.944 µs 18.966 µs] | |
| thrpt: [52.726 Melem/s 52.786 Melem/s 52.847 Melem/s] | |
| change: | |
| time: [+9.1158% +9.3397% +9.5641%] (p = 0.00 < 0.05) | |
| thrpt: [-8.7292% -8.5419% -8.3542%] | |
| Performance has regressed. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 5 (5.00%) high mild | |
| concrete_list_apply/empty_base_dynamic_patch/3162 | |
| time: [58.882 µs 58.953 µs 59.027 µs] | |
| thrpt: [53.569 Melem/s 53.636 Melem/s 53.700 Melem/s] | |
| change: | |
| time: [+9.4625% +9.7238% +9.9688%] (p = 0.00 < 0.05) | |
| thrpt: [-9.0651% -8.8620% -8.6445%] | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 2 (2.00%) high mild | |
| 2 (2.00%) high severe | |
| concrete_list_apply/empty_base_dynamic_patch/10000 | |
| time: [191.37 µs 191.85 µs 192.32 µs] | |
| thrpt: [51.996 Melem/s 52.124 Melem/s 52.255 Melem/s] | |
| change: | |
| time: [+8.3088% +8.8550% +9.3533%] (p = 0.00 < 0.05) | |
| thrpt: [-8.5533% -8.1347% -7.6714%] | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 2 (2.00%) low severe | |
| 1 (1.00%) high mild | |
| 1 (1.00%) high severe | |
| concrete_list_apply/same_len_concrete_patch/100 | |
| time: [327.46 ns 329.97 ns 332.31 ns] | |
| thrpt: [300.92 Melem/s 303.06 Melem/s 305.38 Melem/s] | |
| change: | |
| time: [+49.789% +51.971% +54.225%] (p = 0.00 < 0.05) | |
| thrpt: [-35.160% -34.198% -33.239%] | |
| Performance has regressed. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 3 (3.00%) low mild | |
| concrete_list_apply/same_len_concrete_patch/316 | |
| time: [866.89 ns 872.99 ns 879.87 ns] | |
| thrpt: [359.14 Melem/s 361.98 Melem/s 364.52 Melem/s] | |
| change: | |
| time: [+38.016% +47.354% +55.916%] (p = 0.00 < 0.05) | |
| thrpt: [-35.863% -32.136% -27.545%] | |
| Performance has regressed. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 7 (7.00%) high mild | |
| concrete_list_apply/same_len_concrete_patch/1000 | |
| time: [2.7410 µs 2.7644 µs 2.7879 µs] | |
| thrpt: [358.69 Melem/s 361.74 Melem/s 364.84 Melem/s] | |
| change: | |
| time: [+64.661% +66.981% +69.242%] (p = 0.00 < 0.05) | |
| thrpt: [-40.913% -40.113% -39.269%] | |
| Performance has regressed. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high mild | |
| concrete_list_apply/same_len_concrete_patch/3162 | |
| time: [8.2834 µs 8.3298 µs 8.3752 µs] | |
| thrpt: [377.55 Melem/s 379.60 Melem/s 381.73 Melem/s] | |
| change: | |
| time: [+64.422% +66.016% +67.702%] (p = 0.00 < 0.05) | |
| thrpt: [-40.370% -39.765% -39.181%] | |
| Performance has regressed. | |
| concrete_list_apply/same_len_concrete_patch/10000 | |
| time: [27.655 µs 27.807 µs 27.957 µs] | |
| thrpt: [357.69 Melem/s 359.63 Melem/s 361.60 Melem/s] | |
| change: | |
| time: [+24.182% +40.644% +51.864%] (p = 0.00 < 0.05) | |
| thrpt: [-34.151% -28.898% -19.473%] | |
| Performance has regressed. | |
| Found 13 outliers among 100 measurements (13.00%) | |
| 3 (3.00%) low severe | |
| 3 (3.00%) high mild | |
| 7 (7.00%) high severe | |
| concrete_list_apply/same_len_dynamic_patch/100 | |
| time: [324.09 ns 325.91 ns 327.64 ns] | |
| thrpt: [305.22 Melem/s 306.83 Melem/s 308.56 Melem/s] | |
| change: | |
| time: [+29.688% +31.975% +34.317%] (p = 0.00 < 0.05) | |
| thrpt: [-25.550% -24.228% -22.892%] | |
| Performance has regressed. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 1 (1.00%) high mild | |
| 1 (1.00%) high severe | |
| concrete_list_apply/same_len_dynamic_patch/316 | |
| time: [861.83 ns 868.21 ns 875.35 ns] | |
| thrpt: [361.00 Melem/s 363.97 Melem/s 366.66 Melem/s] | |
| change: | |
| time: [+44.527% +46.789% +49.018%] (p = 0.00 < 0.05) | |
| thrpt: [-32.894% -31.875% -30.809%] | |
| Performance has regressed. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 5 (5.00%) high mild | |
| concrete_list_apply/same_len_dynamic_patch/1000 | |
| time: [2.6745 µs 2.6973 µs 2.7202 µs] | |
| thrpt: [367.62 Melem/s 370.74 Melem/s 373.90 Melem/s] | |
| change: | |
| time: [+47.388% +49.187% +50.931%] (p = 0.00 < 0.05) | |
| thrpt: [-33.744% -32.970% -32.152%] | |
| Performance has regressed. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 7 (7.00%) high mild | |
| 1 (1.00%) high severe | |
| concrete_list_apply/same_len_dynamic_patch/3162 | |
| time: [8.2868 µs 8.3229 µs 8.3569 µs] | |
| thrpt: [378.37 Melem/s 379.92 Melem/s 381.57 Melem/s] | |
| change: | |
| time: [+49.861% +51.285% +52.769%] (p = 0.00 < 0.05) | |
| thrpt: [-34.542% -33.899% -33.272%] | |
| Performance has regressed. | |
| concrete_list_apply/same_len_dynamic_patch/10000 | |
| time: [27.916 µs 28.147 µs 28.382 µs] | |
| thrpt: [352.33 Melem/s 355.28 Melem/s 358.22 Melem/s] | |
| change: | |
| time: [+6.7832% +23.707% +35.877%] (p = 0.00 < 0.05) | |
| thrpt: [-26.404% -19.164% -6.3523%] | |
| Performance has regressed. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) high mild | |
| concrete_list_clone_dynamic/100 | |
| time: [1.6184 µs 1.6207 µs 1.6231 µs] | |
| thrpt: [61.612 Melem/s 61.702 Melem/s 61.788 Melem/s] | |
| change: | |
| time: [+7.5971% +8.2385% +8.7315%] (p = 0.00 < 0.05) | |
| thrpt: [-8.0303% -7.6114% -7.0607%] | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 3 (3.00%) low mild | |
| 1 (1.00%) high mild | |
| concrete_list_clone_dynamic/316 | |
| time: [5.0006 µs 5.0069 µs 5.0132 µs] | |
| thrpt: [63.034 Melem/s 63.113 Melem/s 63.192 Melem/s] | |
| change: | |
| time: [+7.2967% +7.6163% +7.9653%] (p = 0.00 < 0.05) | |
| thrpt: [-7.3776% -7.0772% -6.8005%] | |
| Performance has regressed. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 3 (3.00%) low mild | |
| 5 (5.00%) high mild | |
| 1 (1.00%) high severe | |
| concrete_list_clone_dynamic/1000 | |
| time: [15.677 µs 15.699 µs 15.721 µs] | |
| thrpt: [63.608 Melem/s 63.697 Melem/s 63.787 Melem/s] | |
| change: | |
| time: [+5.8426% +6.2485% +6.6046%] (p = 0.00 < 0.05) | |
| thrpt: [-6.1954% -5.8810% -5.5201%] | |
| Performance has regressed. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 2 (2.00%) low mild | |
| 1 (1.00%) high mild | |
| concrete_list_clone_dynamic/3162 | |
| time: [52.722 µs 52.916 µs 53.130 µs] | |
| thrpt: [59.514 Melem/s 59.755 Melem/s 59.976 Melem/s] | |
| change: | |
| time: [+5.5901% +6.1115% +6.5964%] (p = 0.00 < 0.05) | |
| thrpt: [-6.1882% -5.7595% -5.2941%] | |
| Performance has regressed. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 3 (3.00%) low mild | |
| 3 (3.00%) high mild | |
| 1 (1.00%) high severe | |
| concrete_list_clone_dynamic/10000 | |
| time: [168.51 µs 169.28 µs 170.44 µs] | |
| thrpt: [58.670 Melem/s 59.073 Melem/s 59.344 Melem/s] | |
| change: | |
| time: [+4.9033% +6.1230% +7.2407%] (p = 0.00 < 0.05) | |
| thrpt: [-6.7518% -5.7697% -4.6741%] | |
| Performance has regressed. | |
| Found 11 outliers among 100 measurements (11.00%) | |
| 5 (5.00%) high mild | |
| 6 (6.00%) high severe | |
| dynamic_list_apply/empty_base_concrete_patch/100 | |
| time: [1.8902 µs 1.8944 µs 1.8997 µs] | |
| thrpt: [52.639 Melem/s 52.786 Melem/s 52.905 Melem/s] | |
| change: | |
| time: [-0.2957% +0.0364% +0.3506%] (p = 0.83 > 0.05) | |
| thrpt: [-0.3494% -0.0364% +0.2965%] | |
| No change in performance detected. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 4 (4.00%) low mild | |
| 3 (3.00%) high severe | |
| dynamic_list_apply/empty_base_concrete_patch/316 | |
| time: [5.4131 µs 5.4225 µs 5.4322 µs] | |
| thrpt: [58.172 Melem/s 58.275 Melem/s 58.377 Melem/s] | |
| change: | |
| time: [-0.6157% -0.2906% +0.0310%] (p = 0.08 > 0.05) | |
| thrpt: [-0.0309% +0.2915% +0.6195%] | |
| No change in performance detected. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 1 (1.00%) high mild | |
| 2 (2.00%) high severe | |
| dynamic_list_apply/empty_base_concrete_patch/1000 | |
| time: [16.153 µs 16.177 µs 16.201 µs] | |
| thrpt: [61.723 Melem/s 61.817 Melem/s 61.909 Melem/s] | |
| change: | |
| time: [-1.2728% -1.0086% -0.7488%] (p = 0.00 < 0.05) | |
| thrpt: [+0.7545% +1.0189% +1.2892%] | |
| Change within noise threshold. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 3 (3.00%) low mild | |
| 1 (1.00%) high mild | |
| dynamic_list_apply/empty_base_concrete_patch/3162 | |
| time: [54.620 µs 54.820 µs 55.037 µs] | |
| thrpt: [57.453 Melem/s 57.680 Melem/s 57.891 Melem/s] | |
| change: | |
| time: [+0.1376% +0.7385% +1.3048%] (p = 0.01 < 0.05) | |
| thrpt: [-1.2880% -0.7331% -0.1375%] | |
| Change within noise threshold. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 1 (1.00%) low mild | |
| 1 (1.00%) high mild | |
| 1 (1.00%) high severe | |
| dynamic_list_apply/empty_base_concrete_patch/10000 | |
| time: [246.11 µs 251.84 µs 257.81 µs] | |
| thrpt: [38.788 Melem/s 39.707 Melem/s 40.633 Melem/s] | |
| change: | |
| time: [-14.590% -10.679% -6.6188%] (p = 0.00 < 0.05) | |
| thrpt: [+7.0880% +11.956% +17.083%] | |
| Performance has improved. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high mild | |
| dynamic_list_apply/empty_base_dynamic_patch/100 | |
| time: [1.9407 µs 1.9551 µs 1.9730 µs] | |
| thrpt: [50.684 Melem/s 51.148 Melem/s 51.527 Melem/s] | |
| change: | |
| time: [+3.0635% +3.6640% +4.2644%] (p = 0.00 < 0.05) | |
| thrpt: [-4.0900% -3.5345% -2.9724%] | |
| Performance has regressed. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 1 (1.00%) high mild | |
| 1 (1.00%) high severe | |
| dynamic_list_apply/empty_base_dynamic_patch/316 | |
| time: [5.6719 µs 5.9287 µs 6.3749 µs] | |
| thrpt: [49.569 Melem/s 53.300 Melem/s 55.713 Melem/s] | |
| change: | |
| time: [+3.7312% +5.9988% +9.6256%] (p = 0.00 < 0.05) | |
| thrpt: [-8.7804% -5.6593% -3.5970%] | |
| Performance has regressed. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 1 (1.00%) low mild | |
| 5 (5.00%) high mild | |
| 4 (4.00%) high severe | |
| dynamic_list_apply/empty_base_dynamic_patch/1000 | |
| time: [16.779 µs 16.862 µs 16.948 µs] | |
| thrpt: [59.003 Melem/s 59.304 Melem/s 59.597 Melem/s] | |
| change: | |
| time: [+2.6977% +3.2624% +3.9393%] (p = 0.00 < 0.05) | |
| thrpt: [-3.7900% -3.1593% -2.6268%] | |
| Performance has regressed. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 2 (2.00%) high mild | |
| 1 (1.00%) high severe | |
| dynamic_list_apply/empty_base_dynamic_patch/3162 | |
| time: [54.136 µs 54.314 µs 54.518 µs] | |
| thrpt: [57.999 Melem/s 58.217 Melem/s 58.409 Melem/s] | |
| change: | |
| time: [-1.8378% -0.8493% -0.1239%] (p = 0.05 < 0.05) | |
| thrpt: [+0.1241% +0.8566% +1.8722%] | |
| Change within noise threshold. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 2 (2.00%) high mild | |
| 1 (1.00%) high severe | |
| dynamic_list_apply/empty_base_dynamic_patch/10000 | |
| time: [186.03 µs 188.21 µs 190.74 µs] | |
| thrpt: [52.426 Melem/s 53.132 Melem/s 53.756 Melem/s] | |
| change: | |
| time: [-28.338% -25.683% -22.857%] (p = 0.00 < 0.05) | |
| thrpt: [+29.630% +34.558% +39.543%] | |
| Performance has improved. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) high mild | |
| dynamic_list_apply/same_len_concrete_patch/100 | |
| time: [339.11 ns 344.01 ns 349.98 ns] | |
| thrpt: [285.73 Melem/s 290.69 Melem/s 294.89 Melem/s] | |
| change: | |
| time: [+54.578% +59.742% +65.840%] (p = 0.00 < 0.05) | |
| thrpt: [-39.701% -37.399% -35.308%] | |
| Performance has regressed. | |
| Found 12 outliers among 100 measurements (12.00%) | |
| 2 (2.00%) low mild | |
| 3 (3.00%) high mild | |
| 7 (7.00%) high severe | |
| dynamic_list_apply/same_len_concrete_patch/316 | |
| time: [873.36 ns 877.14 ns 881.10 ns] | |
| thrpt: [358.64 Melem/s 360.26 Melem/s 361.82 Melem/s] | |
| change: | |
| time: [+64.690% +66.270% +67.906%] (p = 0.00 < 0.05) | |
| thrpt: [-40.443% -39.857% -39.280%] | |
| Performance has regressed. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) high mild | |
| dynamic_list_apply/same_len_concrete_patch/1000 | |
| time: [2.6784 µs 2.6968 µs 2.7169 µs] | |
| thrpt: [368.06 Melem/s 370.80 Melem/s 373.36 Melem/s] | |
| change: | |
| time: [+66.697% +68.386% +70.088%] (p = 0.00 < 0.05) | |
| thrpt: [-41.207% -40.613% -40.011%] | |
| Performance has regressed. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 7 (7.00%) high mild | |
| dynamic_list_apply/same_len_concrete_patch/3162 | |
| time: [8.1837 µs 8.2105 µs 8.2377 µs] | |
| thrpt: [383.85 Melem/s 385.12 Melem/s 386.38 Melem/s] | |
| change: | |
| time: [+65.504% +67.027% +68.565%] (p = 0.00 < 0.05) | |
| thrpt: [-40.676% -40.129% -39.579%] | |
| Performance has regressed. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 7 (7.00%) high mild | |
| 1 (1.00%) high severe | |
| dynamic_list_apply/same_len_concrete_patch/10000 | |
| time: [27.614 µs 27.801 µs 27.995 µs] | |
| thrpt: [357.21 Melem/s 359.70 Melem/s 362.13 Melem/s] | |
| change: | |
| time: [+50.634% +55.094% +60.280%] (p = 0.00 < 0.05) | |
| thrpt: [-37.609% -35.523% -33.614%] | |
| Performance has regressed. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 3 (3.00%) high mild | |
| 6 (6.00%) high severe | |
| dynamic_list_apply/same_len_dynamic_patch/100 | |
| time: [327.86 ns 330.09 ns 332.19 ns] | |
| thrpt: [301.03 Melem/s 302.95 Melem/s 305.01 Melem/s] | |
| change: | |
| time: [+29.625% +33.451% +36.561%] (p = 0.00 < 0.05) | |
| thrpt: [-26.772% -25.066% -22.854%] | |
| Performance has regressed. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high severe | |
| dynamic_list_apply/same_len_dynamic_patch/316 | |
| time: [861.68 ns 865.85 ns 870.21 ns] | |
| thrpt: [363.13 Melem/s 364.96 Melem/s 366.73 Melem/s] | |
| change: | |
| time: [+48.096% +49.712% +51.174%] (p = 0.00 < 0.05) | |
| thrpt: [-33.851% -33.205% -32.476%] | |
| Performance has regressed. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 3 (3.00%) high mild | |
| dynamic_list_apply/same_len_dynamic_patch/1000 | |
| time: [2.6534 µs 2.6672 µs 2.6823 µs] | |
| thrpt: [372.82 Melem/s 374.93 Melem/s 376.88 Melem/s] | |
| change: | |
| time: [+48.856% +50.203% +51.582%] (p = 0.00 < 0.05) | |
| thrpt: [-34.029% -33.424% -32.821%] | |
| Performance has regressed. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 5 (5.00%) high mild | |
| dynamic_list_apply/same_len_dynamic_patch/3162 | |
| time: [8.4489 µs 8.6563 µs 8.9142 µs] | |
| thrpt: [354.71 Melem/s 365.28 Melem/s 374.25 Melem/s] | |
| change: | |
| time: [+52.626% +54.787% +57.315%] (p = 0.00 < 0.05) | |
| thrpt: [-36.433% -35.395% -34.480%] | |
| Performance has regressed. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 2 (2.00%) high mild | |
| 3 (3.00%) high severe | |
| dynamic_list_apply/same_len_dynamic_patch/10000 | |
| time: [31.667 µs 33.859 µs 36.243 µs] | |
| thrpt: [275.91 Melem/s 295.34 Melem/s 315.78 Melem/s] | |
| change: | |
| time: [+49.017% +68.146% +87.867%] (p = 0.00 < 0.05) | |
| thrpt: [-46.771% -40.528% -32.893%] | |
| Performance has regressed. | |
| Found 11 outliers among 100 measurements (11.00%) | |
| 3 (3.00%) high mild | |
| 8 (8.00%) high severe | |
| dynamic_list_push/100 time: [453.53 ns 459.60 ns 471.14 ns] | |
| thrpt: [212.25 Melem/s 217.58 Melem/s 220.49 Melem/s] | |
| change: | |
| time: [+8.6558% +12.303% +15.190%] (p = 0.00 < 0.05) | |
| thrpt: [-13.187% -10.956% -7.9662%] | |
| Performance has regressed. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 1 (1.00%) high mild | |
| 5 (5.00%) high severe | |
| dynamic_list_push/316 time: [1.0859 µs 1.1504 µs 1.2349 µs] | |
| thrpt: [255.89 Melem/s 274.68 Melem/s 290.99 Melem/s] | |
| change: | |
| time: [+17.671% +22.993% +28.556%] (p = 0.00 < 0.05) | |
| thrpt: [-22.213% -18.694% -15.017%] | |
| Performance has regressed. | |
| Found 14 outliers among 100 measurements (14.00%) | |
| 3 (3.00%) high mild | |
| 11 (11.00%) high severe | |
| dynamic_list_push/1000 time: [2.7116 µs 2.8100 µs 3.0183 µs] | |
| thrpt: [331.32 Melem/s 355.87 Melem/s 368.78 Melem/s] | |
| change: | |
| time: [+20.901% +24.664% +29.594%] (p = 0.00 < 0.05) | |
| thrpt: [-22.836% -19.785% -17.288%] | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 1 (1.00%) high mild | |
| 3 (3.00%) high severe | |
| dynamic_list_push/3162 time: [8.2850 µs 8.2979 µs 8.3119 µs] | |
| thrpt: [380.42 Melem/s 381.06 Melem/s 381.65 Melem/s] | |
| change: | |
| time: [+12.621% +14.909% +16.816%] (p = 0.00 < 0.05) | |
| thrpt: [-14.396% -12.974% -11.207%] | |
| Performance has regressed. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 3 (3.00%) low mild | |
| 6 (6.00%) high mild | |
| dynamic_list_push/10000 time: [43.744 µs 43.957 µs 44.172 µs] | |
| thrpt: [226.39 Melem/s 227.50 Melem/s 228.60 Melem/s] | |
| change: | |
| time: [-75.783% -75.261% -74.723%] (p = 0.00 < 0.05) | |
| thrpt: [+295.61% +304.22% +312.94%] | |
| Performance has improved. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high severe | |
| Running benches/bevy_reflect/map.rs (target/release/deps/reflect_map-0d8bc4819b49528d) | |
| Gnuplot not found, using plotters backend | |
| concrete_map_apply/empty_base_concrete_patch/100 | |
| time: [9.4607 µs 9.4832 µs 9.5124 µs] | |
| thrpt: [10.513 Melem/s 10.545 Melem/s 10.570 Melem/s] | |
| change: | |
| time: [+0.6940% +1.2886% +2.1289%] (p = 0.00 < 0.05) | |
| thrpt: [-2.0845% -1.2722% -0.6892%] | |
| Change within noise threshold. | |
| Found 13 outliers among 100 measurements (13.00%) | |
| 1 (1.00%) low severe | |
| 2 (2.00%) low mild | |
| 5 (5.00%) high mild | |
| 5 (5.00%) high severe | |
| concrete_map_apply/empty_base_concrete_patch/316 | |
| time: [48.554 µs 48.627 µs 48.709 µs] | |
| thrpt: [6.4874 Melem/s 6.4984 Melem/s 6.5083 Melem/s] | |
| change: | |
| time: [-8.6739% -8.4711% -8.2661%] (p = 0.00 < 0.05) | |
| thrpt: [+9.0110% +9.2551% +9.4978%] | |
| Performance has improved. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 3 (3.00%) low mild | |
| 3 (3.00%) high mild | |
| concrete_map_apply/empty_base_concrete_patch/1000 | |
| time: [339.48 µs 339.82 µs 340.24 µs] | |
| thrpt: [2.9391 Melem/s 2.9427 Melem/s 2.9457 Melem/s] | |
| change: | |
| time: [-13.840% -13.506% -13.125%] (p = 0.00 < 0.05) | |
| thrpt: [+15.108% +15.615% +16.063%] | |
| Performance has improved. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 1 (1.00%) high mild | |
| 8 (8.00%) high severe | |
| concrete_map_apply/empty_base_concrete_patch/3162 | |
| time: [4.4417 ms 4.4510 ms 4.4603 ms] | |
| thrpt: [708.92 Kelem/s 710.41 Kelem/s 711.89 Kelem/s] | |
| change: | |
| time: [-7.4699% -7.2214% -6.9757%] (p = 0.00 < 0.05) | |
| thrpt: [+7.4988% +7.7835% +8.0730%] | |
| Performance has improved. | |
| Benchmarking concrete_map_apply/empty_base_concrete_patch/10000: Warming up for 500.00 ms | |
| Warning: Unable to complete 100 samples in 4.0s. You may wish to increase target time to 5.7s, or reduce sample count to 70. | |
| concrete_map_apply/empty_base_concrete_patch/10000 | |
| time: [55.949 ms 56.275 ms 56.607 ms] | |
| thrpt: [176.66 Kelem/s 177.70 Kelem/s 178.73 Kelem/s] | |
| change: | |
| time: [-1.8186% -1.0354% -0.2815%] (p = 0.01 < 0.05) | |
| thrpt: [+0.2823% +1.0463% +1.8522%] | |
| Change within noise threshold. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 1 (1.00%) low mild | |
| 5 (5.00%) high mild | |
| concrete_map_apply/empty_base_dynamic_patch/100 | |
| time: [7.7753 µs 7.7962 µs 7.8195 µs] | |
| thrpt: [12.789 Melem/s 12.827 Melem/s 12.861 Melem/s] | |
| change: | |
| time: [+12.325% +13.257% +14.417%] (p = 0.00 < 0.05) | |
| thrpt: [-12.600% -11.706% -10.972%] | |
| Performance has regressed. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 1 (1.00%) low severe | |
| 3 (3.00%) low mild | |
| 1 (1.00%) high mild | |
| 2 (2.00%) high severe | |
| concrete_map_apply/empty_base_dynamic_patch/316 | |
| time: [24.938 µs 25.077 µs 25.232 µs] | |
| thrpt: [12.524 Melem/s 12.601 Melem/s 12.671 Melem/s] | |
| change: | |
| time: [+3.1153% +9.1151% +13.202%] (p = 0.00 < 0.05) | |
| thrpt: [-11.662% -8.3537% -3.0212%] | |
| Performance has regressed. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 1 (1.00%) low mild | |
| 4 (4.00%) high mild | |
| 1 (1.00%) high severe | |
| concrete_map_apply/empty_base_dynamic_patch/1000 | |
| time: [80.793 µs 81.032 µs 81.263 µs] | |
| thrpt: [12.306 Melem/s 12.341 Melem/s 12.377 Melem/s] | |
| change: | |
| time: [+8.5242% +9.3003% +10.058%] (p = 0.00 < 0.05) | |
| thrpt: [-9.1387% -8.5089% -7.8547%] | |
| Performance has regressed. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 1 (1.00%) high mild | |
| 1 (1.00%) high severe | |
| concrete_map_apply/empty_base_dynamic_patch/3162 | |
| time: [244.68 µs 245.40 µs 246.14 µs] | |
| thrpt: [12.846 Melem/s 12.885 Melem/s 12.923 Melem/s] | |
| change: | |
| time: [-37.384% -18.717% +2.0333%] (p = 0.16 > 0.05) | |
| thrpt: [-1.9928% +23.026% +59.704%] | |
| No change in performance detected. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 2 (2.00%) low mild | |
| 4 (4.00%) high mild | |
| 1 (1.00%) high severe | |
| Benchmarking concrete_map_apply/empty_base_dynamic_patch/10000: Warming up for 500.00 ms | |
| Warning: Unable to complete 100 samples in 4.0s. You may wish to increase target time to 6.4s, enable flat sampling, or reduce sample count to 50. | |
| concrete_map_apply/empty_base_dynamic_patch/10000 | |
| time: [809.09 µs 811.77 µs 814.44 µs] | |
| thrpt: [12.278 Melem/s 12.319 Melem/s 12.359 Melem/s] | |
| change: | |
| time: [+6.3983% +9.9500% +12.183%] (p = 0.00 < 0.05) | |
| thrpt: [-10.860% -9.0495% -6.0136%] | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 2 (2.00%) low mild | |
| 2 (2.00%) high severe | |
| concrete_map_apply/same_keys_concrete_patch/100 | |
| time: [4.7178 µs 4.7233 µs 4.7287 µs] | |
| thrpt: [21.148 Melem/s 21.171 Melem/s 21.196 Melem/s] | |
| change: | |
| time: [-12.168% -11.835% -11.481%] (p = 0.00 < 0.05) | |
| thrpt: [+12.970% +13.424% +13.854%] | |
| Performance has improved. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 2 (2.00%) low mild | |
| 4 (4.00%) high mild | |
| 2 (2.00%) high severe | |
| concrete_map_apply/same_keys_concrete_patch/316 | |
| time: [32.945 µs 33.033 µs 33.122 µs] | |
| thrpt: [9.5404 Melem/s 9.5662 Melem/s 9.5917 Melem/s] | |
| change: | |
| time: [-16.017% -15.726% -15.438%] (p = 0.00 < 0.05) | |
| thrpt: [+18.257% +18.660% +19.072%] | |
| Performance has improved. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 2 (2.00%) high mild | |
| 1 (1.00%) high severe | |
| concrete_map_apply/same_keys_concrete_patch/1000 | |
| time: [290.12 µs 290.65 µs 291.23 µs] | |
| thrpt: [3.4338 Melem/s 3.4405 Melem/s 3.4469 Melem/s] | |
| change: | |
| time: [-17.095% -16.700% -16.295%] (p = 0.00 < 0.05) | |
| thrpt: [+19.468% +20.047% +20.620%] | |
| Performance has improved. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 1 (1.00%) low mild | |
| 3 (3.00%) high mild | |
| 3 (3.00%) high severe | |
| concrete_map_apply/same_keys_concrete_patch/3162 | |
| time: [4.2641 ms 4.2734 ms 4.2826 ms] | |
| thrpt: [738.33 Kelem/s 739.93 Kelem/s 741.54 Kelem/s] | |
| change: | |
| time: [-8.5076% -8.2169% -7.9456%] (p = 0.00 < 0.05) | |
| thrpt: [+8.6315% +8.9526% +9.2987%] | |
| Performance has improved. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) low mild | |
| Benchmarking concrete_map_apply/same_keys_concrete_patch/10000: Warming up for 500.00 ms | |
| Warning: Unable to complete 100 samples in 4.0s. You may wish to increase target time to 5.7s, or reduce sample count to 60. | |
| concrete_map_apply/same_keys_concrete_patch/10000 | |
| time: [56.786 ms 57.147 ms 57.518 ms] | |
| thrpt: [173.86 Kelem/s 174.99 Kelem/s 176.10 Kelem/s] | |
| change: | |
| time: [-0.2741% +0.5533% +1.3756%] (p = 0.18 > 0.05) | |
| thrpt: [-1.3569% -0.5503% +0.2748%] | |
| No change in performance detected. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 3 (3.00%) high mild | |
| concrete_map_apply/same_keys_dynamic_patch/100 | |
| time: [3.0154 µs 3.0624 µs 3.1081 µs] | |
| thrpt: [32.174 Melem/s 32.655 Melem/s 33.163 Melem/s] | |
| change: | |
| time: [+5.5616% +7.3493% +9.2742%] (p = 0.00 < 0.05) | |
| thrpt: [-8.4871% -6.8461% -5.2686%] | |
| Performance has regressed. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high severe | |
| concrete_map_apply/same_keys_dynamic_patch/316 | |
| time: [9.3855 µs 9.7546 µs 10.202 µs] | |
| thrpt: [30.973 Melem/s 32.395 Melem/s 33.669 Melem/s] | |
| change: | |
| time: [+5.5502% +8.6608% +11.978%] (p = 0.00 < 0.05) | |
| thrpt: [-10.697% -7.9705% -5.2584%] | |
| Performance has regressed. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 2 (2.00%) high mild | |
| 1 (1.00%) high severe | |
| concrete_map_apply/same_keys_dynamic_patch/1000 | |
| time: [34.881 µs 35.457 µs 36.050 µs] | |
| thrpt: [27.739 Melem/s 28.203 Melem/s 28.669 Melem/s] | |
| change: | |
| time: [+5.1442% +10.641% +16.797%] (p = 0.00 < 0.05) | |
| thrpt: [-14.381% -9.6174% -4.8926%] | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 4 (4.00%) high severe | |
| concrete_map_apply/same_keys_dynamic_patch/3162 | |
| time: [106.28 µs 107.56 µs 108.85 µs] | |
| thrpt: [29.050 Melem/s 29.398 Melem/s 29.752 Melem/s] | |
| change: | |
| time: [+5.3037% +9.1457% +13.551%] (p = 0.00 < 0.05) | |
| thrpt: [-11.934% -8.3794% -5.0365%] | |
| Performance has regressed. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 5 (5.00%) high mild | |
| 5 (5.00%) high severe | |
| Benchmarking concrete_map_apply/same_keys_dynamic_patch/10000: Warming up for 500.00 ms | |
| Warning: Unable to complete 100 samples in 4.0s. You may wish to increase target time to 4.3s, enable flat sampling, or reduce sample count to 60. | |
| concrete_map_apply/same_keys_dynamic_patch/10000 | |
| time: [332.65 µs 338.41 µs 345.05 µs] | |
| thrpt: [28.981 Melem/s 29.550 Melem/s 30.062 Melem/s] | |
| change: | |
| time: [+7.7420% +10.773% +14.760%] (p = 0.00 < 0.05) | |
| thrpt: [-12.861% -9.7250% -7.1857%] | |
| Performance has regressed. | |
| Found 12 outliers among 100 measurements (12.00%) | |
| 2 (2.00%) low mild | |
| 5 (5.00%) high mild | |
| 5 (5.00%) high severe | |
| concrete_map_apply/disjoint_keys_concrete_patch/100 | |
| time: [9.3554 µs 9.3727 µs 9.3913 µs] | |
| thrpt: [10.648 Melem/s 10.669 Melem/s 10.689 Melem/s] | |
| change: | |
| time: [-0.4995% -0.1807% +0.1184%] (p = 0.24 > 0.05) | |
| thrpt: [-0.1182% +0.1810% +0.5020%] | |
| No change in performance detected. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 1 (1.00%) low mild | |
| 1 (1.00%) high mild | |
| 1 (1.00%) high severe | |
| concrete_map_apply/disjoint_keys_concrete_patch/316 | |
| time: [49.083 µs 49.302 µs 49.554 µs] | |
| thrpt: [6.3769 Melem/s 6.4095 Melem/s 6.4381 Melem/s] | |
| change: | |
| time: [-7.9724% -7.5774% -7.1149%] (p = 0.00 < 0.05) | |
| thrpt: [+7.6598% +8.1986% +8.6630%] | |
| Performance has improved. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 3 (3.00%) low mild | |
| 4 (4.00%) high mild | |
| 1 (1.00%) high severe | |
| concrete_map_apply/disjoint_keys_concrete_patch/1000 | |
| time: [348.32 µs 349.17 µs 350.12 µs] | |
| thrpt: [2.8562 Melem/s 2.8639 Melem/s 2.8710 Melem/s] | |
| change: | |
| time: [-14.590% -13.684% -12.645%] (p = 0.00 < 0.05) | |
| thrpt: [+14.476% +15.854% +17.083%] | |
| Performance has improved. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 4 (4.00%) high mild | |
| 4 (4.00%) high severe | |
| concrete_map_apply/disjoint_keys_concrete_patch/3162 | |
| time: [4.5636 ms 4.5759 ms 4.5882 ms] | |
| thrpt: [689.15 Kelem/s 691.01 Kelem/s 692.87 Kelem/s] | |
| change: | |
| time: [-6.5809% -6.1918% -5.8340%] (p = 0.00 < 0.05) | |
| thrpt: [+6.1954% +6.6005% +7.0445%] | |
| Performance has improved. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 1 (1.00%) low mild | |
| 1 (1.00%) high mild | |
| Benchmarking concrete_map_apply/disjoint_keys_concrete_patch/10000: Warming up for 500.00 ms | |
| Warning: Unable to complete 100 samples in 4.0s. You may wish to increase target time to 5.7s, or reduce sample count to 60. | |
| concrete_map_apply/disjoint_keys_concrete_patch/10000 | |
| time: [56.977 ms 57.235 ms 57.498 ms] | |
| thrpt: [173.92 Kelem/s 174.72 Kelem/s 175.51 Kelem/s] | |
| change: | |
| time: [+0.2921% +0.9890% +1.6528%] (p = 0.01 < 0.05) | |
| thrpt: [-1.6259% -0.9793% -0.2913%] | |
| Change within noise threshold. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 6 (6.00%) high mild | |
| concrete_map_apply/disjoint_keys_dynamic_patch/100 | |
| time: [7.7071 µs 7.7404 µs 7.7750 µs] | |
| thrpt: [12.862 Melem/s 12.919 Melem/s 12.975 Melem/s] | |
| change: | |
| time: [+12.021% +12.778% +13.519%] (p = 0.00 < 0.05) | |
| thrpt: [-11.909% -11.330% -10.731%] | |
| Performance has regressed. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) high mild | |
| concrete_map_apply/disjoint_keys_dynamic_patch/316 | |
| time: [24.998 µs 25.120 µs 25.239 µs] | |
| thrpt: [12.520 Melem/s 12.579 Melem/s 12.641 Melem/s] | |
| change: | |
| time: [+12.923% +13.800% +14.713%] (p = 0.00 < 0.05) | |
| thrpt: [-12.826% -12.126% -11.444%] | |
| Performance has regressed. | |
| concrete_map_apply/disjoint_keys_dynamic_patch/1000 | |
| time: [83.055 µs 83.673 µs 84.253 µs] | |
| thrpt: [11.869 Melem/s 11.951 Melem/s 12.040 Melem/s] | |
| change: | |
| time: [+12.926% +14.686% +16.844%] (p = 0.00 < 0.05) | |
| thrpt: [-14.416% -12.805% -11.446%] | |
| Performance has regressed. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) high severe | |
| concrete_map_apply/disjoint_keys_dynamic_patch/3162 | |
| time: [248.40 µs 250.73 µs 253.46 µs] | |
| thrpt: [12.476 Melem/s 12.611 Melem/s 12.729 Melem/s] | |
| change: | |
| time: [+6.2248% +10.952% +14.778%] (p = 0.00 < 0.05) | |
| thrpt: [-12.875% -9.8712% -5.8600%] | |
| Performance has regressed. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 4 (4.00%) high mild | |
| 1 (1.00%) high severe | |
| Benchmarking concrete_map_apply/disjoint_keys_dynamic_patch/10000: Warming up for 500.00 ms | |
| Warning: Unable to complete 100 samples in 4.0s. You may wish to increase target time to 7.1s, enable flat sampling, or reduce sample count to 50. | |
| concrete_map_apply/disjoint_keys_dynamic_patch/10000 | |
| time: [841.83 µs 848.91 µs 856.06 µs] | |
| thrpt: [11.681 Melem/s 11.780 Melem/s 11.879 Melem/s] | |
| change: | |
| time: [-9.3775% -0.9829% +6.2705%] (p = 0.84 > 0.05) | |
| thrpt: [-5.9005% +0.9927% +10.348%] | |
| No change in performance detected. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high mild | |
| dynamic_map_apply/empty_base_concrete_patch/100 | |
| time: [9.5322 µs 9.5464 µs 9.5604 µs] | |
| thrpt: [10.460 Melem/s 10.475 Melem/s 10.491 Melem/s] | |
| change: | |
| time: [-3.5240% -3.2586% -2.9968%] (p = 0.00 < 0.05) | |
| thrpt: [+3.0893% +3.3684% +3.6527%] | |
| Performance has improved. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 1 (1.00%) low mild | |
| 2 (2.00%) high mild | |
| 1 (1.00%) high severe | |
| dynamic_map_apply/empty_base_concrete_patch/316 | |
| time: [48.594 µs 48.694 µs 48.803 µs] | |
| thrpt: [6.4750 Melem/s 6.4894 Melem/s 6.5028 Melem/s] | |
| change: | |
| time: [-9.4493% -9.1259% -8.7527%] (p = 0.00 < 0.05) | |
| thrpt: [+9.5923% +10.042% +10.435%] | |
| Performance has improved. | |
| Found 12 outliers among 100 measurements (12.00%) | |
| 5 (5.00%) low mild | |
| 4 (4.00%) high mild | |
| 3 (3.00%) high severe | |
| dynamic_map_apply/empty_base_concrete_patch/1000 | |
| time: [347.08 µs 347.64 µs 348.23 µs] | |
| thrpt: [2.8716 Melem/s 2.8766 Melem/s 2.8812 Melem/s] | |
| change: | |
| time: [-14.320% -13.068% -11.823%] (p = 0.00 < 0.05) | |
| thrpt: [+13.408% +15.032% +16.713%] | |
| Performance has improved. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 5 (5.00%) high mild | |
| 5 (5.00%) high severe | |
| dynamic_map_apply/empty_base_concrete_patch/3162 | |
| time: [4.5839 ms 4.5981 ms 4.6129 ms] | |
| thrpt: [685.47 Kelem/s 687.67 Kelem/s 689.81 Kelem/s] | |
| change: | |
| time: [-6.3018% -5.9476% -5.5805%] (p = 0.00 < 0.05) | |
| thrpt: [+5.9104% +6.3237% +6.7257%] | |
| Performance has improved. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 2 (2.00%) low mild | |
| 3 (3.00%) high mild | |
| 1 (1.00%) high severe | |
| Benchmarking dynamic_map_apply/empty_base_concrete_patch/10000: Warming up for 500.00 ms | |
| Warning: Unable to complete 100 samples in 4.0s. You may wish to increase target time to 5.8s, or reduce sample count to 60. | |
| dynamic_map_apply/empty_base_concrete_patch/10000 | |
| time: [57.017 ms 57.346 ms 57.679 ms] | |
| thrpt: [173.37 Kelem/s 174.38 Kelem/s 175.39 Kelem/s] | |
| change: | |
| time: [-0.5885% +0.1416% +0.9593%] (p = 0.72 > 0.05) | |
| thrpt: [-0.9502% -0.1414% +0.5920%] | |
| No change in performance detected. | |
| dynamic_map_apply/empty_base_dynamic_patch/100 | |
| time: [7.9372 µs 8.0436 µs 8.1684 µs] | |
| thrpt: [12.242 Melem/s 12.432 Melem/s 12.599 Melem/s] | |
| change: | |
| time: [+5.3423% +6.5409% +7.8371%] (p = 0.00 < 0.05) | |
| thrpt: [-7.2676% -6.1394% -5.0714%] | |
| Performance has regressed. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 1 (1.00%) high mild | |
| 5 (5.00%) high severe | |
| dynamic_map_apply/empty_base_dynamic_patch/316 | |
| time: [24.551 µs 24.696 µs 24.871 µs] | |
| thrpt: [12.705 Melem/s 12.796 Melem/s 12.871 Melem/s] | |
| change: | |
| time: [+6.2605% +7.2356% +8.4746%] (p = 0.00 < 0.05) | |
| thrpt: [-7.8126% -6.7474% -5.8916%] | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 1 (1.00%) low mild | |
| 1 (1.00%) high mild | |
| 2 (2.00%) high severe | |
| dynamic_map_apply/empty_base_dynamic_patch/1000 | |
| time: [81.421 µs 81.802 µs 82.194 µs] | |
| thrpt: [12.166 Melem/s 12.225 Melem/s 12.282 Melem/s] | |
| change: | |
| time: [+6.8908% +8.6056% +10.636%] (p = 0.00 < 0.05) | |
| thrpt: [-9.6138% -7.9237% -6.4465%] | |
| Performance has regressed. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 1 (1.00%) low mild | |
| 4 (4.00%) high mild | |
| 3 (3.00%) high severe | |
| dynamic_map_apply/empty_base_dynamic_patch/3162 | |
| time: [261.72 µs 269.57 µs 282.05 µs] | |
| thrpt: [11.211 Melem/s 11.730 Melem/s 12.082 Melem/s] | |
| change: | |
| time: [-1.8456% +5.7644% +13.444%] (p = 0.16 > 0.05) | |
| thrpt: [-11.851% -5.4502% +1.8803%] | |
| No change in performance detected. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 2 (2.00%) high mild | |
| 4 (4.00%) high severe | |
| Benchmarking dynamic_map_apply/empty_base_dynamic_patch/10000: Warming up for 500.00 ms | |
| Warning: Unable to complete 100 samples in 4.0s. You may wish to increase target time to 6.8s, enable flat sampling, or reduce sample count to 50. | |
| dynamic_map_apply/empty_base_dynamic_patch/10000 | |
| time: [914.35 µs 922.14 µs 929.53 µs] | |
| thrpt: [10.758 Melem/s 10.844 Melem/s 10.937 Melem/s] | |
| change: | |
| time: [+5.1702% +8.1494% +11.610%] (p = 0.00 < 0.05) | |
| thrpt: [-10.403% -7.5353% -4.9160%] | |
| Performance has regressed. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 1 (1.00%) high mild | |
| 4 (4.00%) high severe | |
| dynamic_map_apply/same_keys_concrete_patch/100 | |
| time: [7.0645 µs 7.0936 µs 7.1204 µs] | |
| thrpt: [14.044 Melem/s 14.097 Melem/s 14.155 Melem/s] | |
| change: | |
| time: [-6.5049% -5.8839% -5.3194%] (p = 0.00 < 0.05) | |
| thrpt: [+5.6182% +6.2518% +6.9575%] | |
| Performance has improved. | |
| dynamic_map_apply/same_keys_concrete_patch/316 | |
| time: [40.932 µs 41.086 µs 41.233 µs] | |
| thrpt: [7.6638 Melem/s 7.6911 Melem/s 7.7201 Melem/s] | |
| change: | |
| time: [-11.155% -10.513% -9.8982%] (p = 0.00 < 0.05) | |
| thrpt: [+10.986% +11.748% +12.555%] | |
| Performance has improved. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) high severe | |
| dynamic_map_apply/same_keys_concrete_patch/1000 | |
| time: [319.41 µs 320.42 µs 321.47 µs] | |
| thrpt: [3.1107 Melem/s 3.1209 Melem/s 3.1308 Melem/s] | |
| change: | |
| time: [-16.143% -14.737% -13.292%] (p = 0.00 < 0.05) | |
| thrpt: [+15.330% +17.285% +19.251%] | |
| Performance has improved. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 3 (3.00%) high mild | |
| 4 (4.00%) high severe | |
| dynamic_map_apply/same_keys_concrete_patch/3162 | |
| time: [4.5137 ms 4.5297 ms 4.5457 ms] | |
| thrpt: [695.61 Kelem/s 698.06 Kelem/s 700.53 Kelem/s] | |
| change: | |
| time: [-7.3241% -6.8502% -6.4047%] (p = 0.00 < 0.05) | |
| thrpt: [+6.8430% +7.3540% +7.9029%] | |
| Performance has improved. | |
| Benchmarking dynamic_map_apply/same_keys_concrete_patch/10000: Warming up for 500.00 ms | |
| Warning: Unable to complete 100 samples in 4.0s. You may wish to increase target time to 5.8s, or reduce sample count to 60. | |
| dynamic_map_apply/same_keys_concrete_patch/10000 | |
| time: [57.705 ms 58.021 ms 58.338 ms] | |
| thrpt: [171.41 Kelem/s 172.35 Kelem/s 173.30 Kelem/s] | |
| change: | |
| time: [-0.8145% +0.0139% +0.8216%] (p = 0.98 > 0.05) | |
| thrpt: [-0.8149% -0.0138% +0.8212%] | |
| No change in performance detected. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high mild | |
| dynamic_map_apply/same_keys_dynamic_patch/100 | |
| time: [5.3057 µs 5.3511 µs 5.3984 µs] | |
| thrpt: [18.524 Melem/s 18.688 Melem/s 18.848 Melem/s] | |
| change: | |
| time: [+6.2219% +7.4764% +8.6514%] (p = 0.00 < 0.05) | |
| thrpt: [-7.9625% -6.9563% -5.8575%] | |
| Performance has regressed. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high mild | |
| dynamic_map_apply/same_keys_dynamic_patch/316 | |
| time: [16.561 µs 16.789 µs 17.010 µs] | |
| thrpt: [18.577 Melem/s 18.822 Melem/s 19.081 Melem/s] | |
| change: | |
| time: [+5.9989% +7.7789% +9.5480%] (p = 0.00 < 0.05) | |
| thrpt: [-8.7158% -7.2175% -5.6594%] | |
| Performance has regressed. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) high mild | |
| dynamic_map_apply/same_keys_dynamic_patch/1000 | |
| time: [59.766 µs 60.463 µs 61.214 µs] | |
| thrpt: [16.336 Melem/s 16.539 Melem/s 16.732 Melem/s] | |
| change: | |
| time: [+13.484% +17.856% +22.476%] (p = 0.00 < 0.05) | |
| thrpt: [-18.352% -15.150% -11.882%] | |
| Performance has regressed. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 2 (2.00%) high mild | |
| 4 (4.00%) high severe | |
| dynamic_map_apply/same_keys_dynamic_patch/3162 | |
| time: [196.99 µs 199.94 µs 203.29 µs] | |
| thrpt: [15.554 Melem/s 15.815 Melem/s 16.052 Melem/s] | |
| change: | |
| time: [+4.5140% +13.199% +20.335%] (p = 0.00 < 0.05) | |
| thrpt: [-16.899% -11.660% -4.3191%] | |
| Performance has regressed. | |
| Found 12 outliers among 100 measurements (12.00%) | |
| 6 (6.00%) high mild | |
| 6 (6.00%) high severe | |
| Benchmarking dynamic_map_apply/same_keys_dynamic_patch/10000: Warming up for 500.00 ms | |
| Warning: Unable to complete 100 samples in 4.0s. You may wish to increase target time to 8.0s, enable flat sampling, or reduce sample count to 40. | |
| dynamic_map_apply/same_keys_dynamic_patch/10000 | |
| time: [645.95 µs 666.93 µs 694.73 µs] | |
| thrpt: [14.394 Melem/s 14.994 Melem/s 15.481 Melem/s] | |
| change: | |
| time: [+31.147% +53.313% +78.365%] (p = 0.00 < 0.05) | |
| thrpt: [-43.935% -34.774% -23.750%] | |
| Performance has regressed. | |
| Found 17 outliers among 100 measurements (17.00%) | |
| 2 (2.00%) high mild | |
| 15 (15.00%) high severe | |
| dynamic_map_apply/disjoint_keys_concrete_patch/100 | |
| time: [11.741 µs 11.846 µs 11.967 µs] | |
| thrpt: [8.3561 Melem/s 8.4418 Melem/s 8.5168 Melem/s] | |
| change: | |
| time: [-0.5785% +0.4925% +1.4341%] (p = 0.36 > 0.05) | |
| thrpt: [-1.4139% -0.4901% +0.5819%] | |
| No change in performance detected. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 3 (3.00%) high mild | |
| 2 (2.00%) high severe | |
| dynamic_map_apply/disjoint_keys_concrete_patch/316 | |
| time: [55.945 µs 59.636 µs 65.528 µs] | |
| thrpt: [4.8224 Melem/s 5.2988 Melem/s 5.6484 Melem/s] | |
| change: | |
| time: [-4.5456% +2.9185% +11.968%] (p = 0.55 > 0.05) | |
| thrpt: [-10.689% -2.8357% +4.7621%] | |
| No change in performance detected. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 1 (1.00%) low mild | |
| 1 (1.00%) high mild | |
| 8 (8.00%) high severe | |
| dynamic_map_apply/disjoint_keys_concrete_patch/1000 | |
| time: [371.36 µs 372.87 µs 374.35 µs] | |
| thrpt: [2.6713 Melem/s 2.6819 Melem/s 2.6928 Melem/s] | |
| change: | |
| time: [-16.709% -15.404% -14.118%] (p = 0.00 < 0.05) | |
| thrpt: [+16.439% +18.209% +20.061%] | |
| Performance has improved. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) high mild | |
| dynamic_map_apply/disjoint_keys_concrete_patch/3162 | |
| time: [4.6232 ms 4.6373 ms 4.6523 ms] | |
| thrpt: [679.66 Kelem/s 681.86 Kelem/s 683.94 Kelem/s] | |
| change: | |
| time: [-16.430% -12.232% -9.3150%] (p = 0.00 < 0.05) | |
| thrpt: [+10.272% +13.936% +19.660%] | |
| Performance has improved. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 1 (1.00%) high mild | |
| 1 (1.00%) high severe | |
| Benchmarking dynamic_map_apply/disjoint_keys_concrete_patch/10000: Warming up for 500.00 ms | |
| Warning: Unable to complete 100 samples in 4.0s. You may wish to increase target time to 5.9s, or reduce sample count to 60. | |
| dynamic_map_apply/disjoint_keys_concrete_patch/10000 | |
| time: [56.713 ms 56.997 ms 57.283 ms] | |
| thrpt: [174.57 Kelem/s 175.45 Kelem/s 176.33 Kelem/s] | |
| change: | |
| time: [-2.3697% -1.6337% -0.9366%] (p = 0.00 < 0.05) | |
| thrpt: [+0.9455% +1.6608% +2.4272%] | |
| Change within noise threshold. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high mild | |
| dynamic_map_apply/disjoint_keys_dynamic_patch/100 | |
| time: [9.8509 µs 9.9050 µs 9.9560 µs] | |
| thrpt: [10.044 Melem/s 10.096 Melem/s 10.151 Melem/s] | |
| change: | |
| time: [+5.0757% +6.0036% +6.9058%] (p = 0.00 < 0.05) | |
| thrpt: [-6.4597% -5.6636% -4.8305%] | |
| Performance has regressed. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high mild | |
| dynamic_map_apply/disjoint_keys_dynamic_patch/316 | |
| time: [30.566 µs 30.787 µs 31.005 µs] | |
| thrpt: [10.192 Melem/s 10.264 Melem/s 10.338 Melem/s] | |
| change: | |
| time: [+4.5847% +5.4530% +6.2825%] (p = 0.00 < 0.05) | |
| thrpt: [-5.9111% -5.1710% -4.3837%] | |
| Performance has regressed. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high mild | |
| dynamic_map_apply/disjoint_keys_dynamic_patch/1000 | |
| time: [110.84 µs 112.31 µs 113.77 µs] | |
| thrpt: [8.7900 Melem/s 8.9036 Melem/s 9.0222 Melem/s] | |
| change: | |
| time: [+2.0827% +4.4026% +6.6730%] (p = 0.00 < 0.05) | |
| thrpt: [-6.2555% -4.2169% -2.0402%] | |
| Performance has regressed. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) high mild | |
| dynamic_map_apply/disjoint_keys_dynamic_patch/3162 | |
| time: [356.77 µs 362.05 µs 368.10 µs] | |
| thrpt: [8.5900 Melem/s 8.7337 Melem/s 8.8630 Melem/s] | |
| change: | |
| time: [+5.7025% +8.7537% +11.766%] (p = 0.00 < 0.05) | |
| thrpt: [-10.528% -8.0491% -5.3949%] | |
| Performance has regressed. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 6 (6.00%) high mild | |
| 2 (2.00%) high severe | |
| dynamic_map_apply/disjoint_keys_dynamic_patch/10000 | |
| time: [1.1463 ms 1.1558 ms 1.1656 ms] | |
| thrpt: [8.5791 Melem/s 8.6519 Melem/s 8.7241 Melem/s] | |
| change: | |
| time: [+5.8293% +7.0506% +8.2247%] (p = 0.00 < 0.05) | |
| thrpt: [-7.5997% -6.5862% -5.5082%] | |
| Performance has regressed. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high mild | |
| dynamic_map_get/u64_keys/100 | |
| time: [415.21 ns 417.04 ns 418.98 ns] | |
| thrpt: [238.68 Melem/s 239.79 Melem/s 240.84 Melem/s] | |
| change: | |
| time: [+7.9224% +8.6132% +9.2830%] (p = 0.00 < 0.05) | |
| thrpt: [-8.4944% -7.9302% -7.3409%] | |
| Performance has regressed. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 1 (1.00%) low mild | |
| 2 (2.00%) high mild | |
| dynamic_map_get/u64_keys/316 | |
| time: [1.2866 µs 1.2926 µs 1.2983 µs] | |
| thrpt: [243.39 Melem/s 244.48 Melem/s 245.60 Melem/s] | |
| change: | |
| time: [+5.8663% +6.4491% +7.0885%] (p = 0.00 < 0.05) | |
| thrpt: [-6.6192% -6.0584% -5.5412%] | |
| Performance has regressed. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 1 (1.00%) low mild | |
| 3 (3.00%) high mild | |
| 1 (1.00%) high severe | |
| dynamic_map_get/u64_keys/1000 | |
| time: [4.0606 µs 4.0732 µs 4.0860 µs] | |
| thrpt: [244.74 Melem/s 245.51 Melem/s 246.27 Melem/s] | |
| change: | |
| time: [+6.4670% +6.8633% +7.2828%] (p = 0.00 < 0.05) | |
| thrpt: [-6.7884% -6.4225% -6.0742%] | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 3 (3.00%) high mild | |
| 1 (1.00%) high severe | |
| dynamic_map_get/u64_keys/3162 | |
| time: [13.160 µs 13.182 µs 13.205 µs] | |
| thrpt: [239.46 Melem/s 239.87 Melem/s 240.28 Melem/s] | |
| change: | |
| time: [+7.1818% +7.4444% +7.7062%] (p = 0.00 < 0.05) | |
| thrpt: [-7.1549% -6.9286% -6.7005%] | |
| Performance has regressed. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 1 (1.00%) low mild | |
| 4 (4.00%) high mild | |
| dynamic_map_get/u64_keys/10000 | |
| time: [41.982 µs 42.192 µs 42.551 µs] | |
| thrpt: [235.01 Melem/s 237.01 Melem/s 238.20 Melem/s] | |
| change: | |
| time: [+7.7113% +8.1851% +8.8257%] (p = 0.00 < 0.05) | |
| thrpt: [-8.1099% -7.5659% -7.1592%] | |
| Performance has regressed. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 2 (2.00%) low mild | |
| 2 (2.00%) high mild | |
| 5 (5.00%) high severe | |
| dynamic_map_get/64_byte_keys/100 | |
| time: [775.52 ns 780.05 ns 784.71 ns] | |
| thrpt: [127.44 Melem/s 128.20 Melem/s 128.95 Melem/s] | |
| change: | |
| time: [-2.3816% -1.7011% -1.0884%] (p = 0.00 < 0.05) | |
| thrpt: [+1.1004% +1.7306% +2.4397%] | |
| Performance has improved. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 3 (3.00%) low mild | |
| 4 (4.00%) high mild | |
| 1 (1.00%) high severe | |
| dynamic_map_get/64_byte_keys/316 | |
| time: [2.4537 µs 2.4665 µs 2.4795 µs] | |
| thrpt: [127.44 Melem/s 128.12 Melem/s 128.79 Melem/s] | |
| change: | |
| time: [-0.9681% -0.2717% +0.6964%] (p = 0.53 > 0.05) | |
| thrpt: [-0.6916% +0.2724% +0.9776%] | |
| No change in performance detected. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 1 (1.00%) high mild | |
| 1 (1.00%) high severe | |
| dynamic_map_get/64_byte_keys/1000 | |
| time: [8.1056 µs 8.1336 µs 8.1713 µs] | |
| thrpt: [122.38 Melem/s 122.95 Melem/s 123.37 Melem/s] | |
| change: | |
| time: [-2.3398% -1.8399% -1.3693%] (p = 0.00 < 0.05) | |
| thrpt: [+1.3883% +1.8744% +2.3958%] | |
| Performance has improved. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 3 (3.00%) low mild | |
| 2 (2.00%) high severe | |
| dynamic_map_get/64_byte_keys/3162 | |
| time: [26.621 µs 26.705 µs 26.799 µs] | |
| thrpt: [117.99 Melem/s 118.41 Melem/s 118.78 Melem/s] | |
| change: | |
| time: [+0.0693% +0.7236% +1.5291%] (p = 0.05 < 0.05) | |
| thrpt: [-1.5061% -0.7184% -0.0693%] | |
| Change within noise threshold. | |
| Found 12 outliers among 100 measurements (12.00%) | |
| 4 (4.00%) high mild | |
| 8 (8.00%) high severe | |
| dynamic_map_get/64_byte_keys/10000 | |
| time: [85.190 µs 85.349 µs 85.531 µs] | |
| thrpt: [116.92 Melem/s 117.17 Melem/s 117.38 Melem/s] | |
| change: | |
| time: [-0.8856% -0.5774% -0.2207%] (p = 0.00 < 0.05) | |
| thrpt: [+0.2212% +0.5807% +0.8935%] | |
| Change within noise threshold. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 2 (2.00%) high mild | |
| 5 (5.00%) high severe | |
| dynamic_map_insert/u64_keys/100 | |
| time: [4.8908 µs 4.9086 µs 4.9334 µs] | |
| thrpt: [20.270 Melem/s 20.372 Melem/s 20.447 Melem/s] | |
| change: | |
| time: [+5.7367% +6.7787% +8.3463%] (p = 0.00 < 0.05) | |
| thrpt: [-7.7034% -6.3483% -5.4255%] | |
| Performance has regressed. | |
| Found 13 outliers among 100 measurements (13.00%) | |
| 1 (1.00%) low mild | |
| 6 (6.00%) high mild | |
| 6 (6.00%) high severe | |
| dynamic_map_insert/u64_keys/316 | |
| time: [15.266 µs 15.284 µs 15.302 µs] | |
| thrpt: [20.651 Melem/s 20.675 Melem/s 20.699 Melem/s] | |
| change: | |
| time: [+4.6521% +5.0580% +5.4221%] (p = 0.00 < 0.05) | |
| thrpt: [-5.1432% -4.8145% -4.4453%] | |
| Performance has regressed. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 4 (4.00%) low mild | |
| 1 (1.00%) high mild | |
| 1 (1.00%) high severe | |
| dynamic_map_insert/u64_keys/1000 | |
| time: [51.530 µs 51.631 µs 51.738 µs] | |
| thrpt: [19.328 Melem/s 19.368 Melem/s 19.406 Melem/s] | |
| change: | |
| time: [+0.4687% +2.4196% +4.1300%] (p = 0.01 < 0.05) | |
| thrpt: [-3.9662% -2.3625% -0.4665%] | |
| Change within noise threshold. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 4 (4.00%) low mild | |
| 3 (3.00%) high mild | |
| 1 (1.00%) high severe | |
| dynamic_map_insert/u64_keys/3162 | |
| time: [156.07 µs 157.34 µs 158.74 µs] | |
| thrpt: [19.920 Melem/s 20.097 Melem/s 20.261 Melem/s] | |
| change: | |
| time: [-4.3398% -2.3132% -0.2270%] (p = 0.03 < 0.05) | |
| thrpt: [+0.2275% +2.3680% +4.5366%] | |
| Change within noise threshold. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 6 (6.00%) high mild | |
| dynamic_map_insert/u64_keys/10000 | |
| time: [550.03 µs 551.36 µs 552.95 µs] | |
| thrpt: [18.085 Melem/s 18.137 Melem/s 18.181 Melem/s] | |
| change: | |
| time: [-7.4862% -6.9323% -6.3828%] (p = 0.00 < 0.05) | |
| thrpt: [+6.8180% +7.4486% +8.0919%] | |
| Performance has improved. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 2 (2.00%) low mild | |
| 5 (5.00%) high mild | |
| 2 (2.00%) high severe | |
| dynamic_map_insert/64_byte_keys/100 | |
| time: [7.2527 µs 7.2782 µs 7.3022 µs] | |
| thrpt: [13.694 Melem/s 13.740 Melem/s 13.788 Melem/s] | |
| change: | |
| time: [+2.8044% +3.3820% +3.9544%] (p = 0.00 < 0.05) | |
| thrpt: [-3.8040% -3.2713% -2.7279%] | |
| Performance has regressed. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) low mild | |
| dynamic_map_insert/64_byte_keys/316 | |
| time: [22.788 µs 22.904 µs 23.019 µs] | |
| thrpt: [13.728 Melem/s 13.797 Melem/s 13.867 Melem/s] | |
| change: | |
| time: [+1.8387% +2.5405% +3.2081%] (p = 0.00 < 0.05) | |
| thrpt: [-3.1084% -2.4776% -1.8055%] | |
| Performance has regressed. | |
| dynamic_map_insert/64_byte_keys/1000 | |
| time: [72.948 µs 73.154 µs 73.353 µs] | |
| thrpt: [13.633 Melem/s 13.670 Melem/s 13.708 Melem/s] | |
| change: | |
| time: [+1.9413% +2.4579% +2.9702%] (p = 0.00 < 0.05) | |
| thrpt: [-2.8845% -2.3990% -1.9043%] | |
| Performance has regressed. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 4 (4.00%) low mild | |
| 1 (1.00%) high mild | |
| dynamic_map_insert/64_byte_keys/3162 | |
| time: [232.42 µs 233.29 µs 234.16 µs] | |
| thrpt: [13.504 Melem/s 13.554 Melem/s 13.604 Melem/s] | |
| change: | |
| time: [-2.8580% -1.3899% -0.0971%] (p = 0.05 > 0.05) | |
| thrpt: [+0.0972% +1.4094% +2.9421%] | |
| No change in performance detected. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high mild | |
| Benchmarking dynamic_map_insert/64_byte_keys/10000: Warming up for 500.00 ms | |
| Warning: Unable to complete 100 samples in 4.0s. You may wish to increase target time to 4.9s, enable flat sampling, or reduce sample count to 60. | |
| dynamic_map_insert/64_byte_keys/10000 | |
| time: [806.28 µs 810.39 µs 814.52 µs] | |
| thrpt: [12.277 Melem/s 12.340 Melem/s 12.403 Melem/s] | |
| change: | |
| time: [-5.1644% -4.2446% -3.3439%] (p = 0.00 < 0.05) | |
| thrpt: [+3.4596% +4.4327% +5.4457%] | |
| Performance has improved. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 1 (1.00%) low mild | |
| 1 (1.00%) high mild | |
| 1 (1.00%) high severe | |
| Running benches/bevy_reflect/struct.rs (target/release/deps/reflect_struct-05ded20b06d18eac) | |
| Gnuplot not found, using plotters backend | |
| concrete_struct_apply/apply_concrete/16 | |
| time: [151.18 ns 151.48 ns 151.82 ns] | |
| thrpt: [105.39 Melem/s 105.62 Melem/s 105.84 Melem/s] | |
| change: | |
| time: [-3.2238% -2.2721% -1.4702%] (p = 0.00 < 0.05) | |
| thrpt: [+1.4922% +2.3249% +3.3312%] | |
| Performance has improved. | |
| Found 13 outliers among 100 measurements (13.00%) | |
| 7 (7.00%) low mild | |
| 3 (3.00%) high mild | |
| 3 (3.00%) high severe | |
| concrete_struct_apply/apply_concrete/32 | |
| time: [299.50 ns 300.29 ns 301.18 ns] | |
| thrpt: [106.25 Melem/s 106.57 Melem/s 106.84 Melem/s] | |
| change: | |
| time: [+0.4553% +1.0609% +1.6562%] (p = 0.00 < 0.05) | |
| thrpt: [-1.6292% -1.0498% -0.4533%] | |
| Change within noise threshold. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 2 (2.00%) low mild | |
| 2 (2.00%) high mild | |
| 2 (2.00%) high severe | |
| concrete_struct_apply/apply_concrete/64 | |
| time: [788.99 ns 790.21 ns 791.44 ns] | |
| thrpt: [80.865 Melem/s 80.992 Melem/s 81.116 Melem/s] | |
| change: | |
| time: [-14.522% -14.027% -13.632%] (p = 0.00 < 0.05) | |
| thrpt: [+15.784% +16.315% +16.989%] | |
| Performance has improved. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 3 (3.00%) low mild | |
| 1 (1.00%) high mild | |
| concrete_struct_apply/apply_concrete/128 | |
| time: [1.9848 µs 1.9911 µs 1.9976 µs] | |
| thrpt: [64.075 Melem/s 64.286 Melem/s 64.490 Melem/s] | |
| change: | |
| time: [-12.836% -12.419% -11.981%] (p = 0.00 < 0.05) | |
| thrpt: [+13.612% +14.179% +14.726%] | |
| Performance has improved. | |
| concrete_struct_apply/apply_dynamic/16 | |
| time: [738.38 ns 742.26 ns 745.51 ns] | |
| thrpt: [21.462 Melem/s 21.556 Melem/s 21.669 Melem/s] | |
| change: | |
| time: [-4.0768% -3.0936% -2.1439%] (p = 0.00 < 0.05) | |
| thrpt: [+2.1909% +3.1924% +4.2501%] | |
| Performance has improved. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high mild | |
| concrete_struct_apply/apply_dynamic/32 | |
| time: [1.3558 µs 1.3672 µs 1.3790 µs] | |
| thrpt: [23.204 Melem/s 23.405 Melem/s 23.602 Melem/s] | |
| change: | |
| time: [-0.8272% -0.0176% +0.8738%] (p = 0.97 > 0.05) | |
| thrpt: [-0.8662% +0.0176% +0.8341%] | |
| No change in performance detected. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 3 (3.00%) low mild | |
| 5 (5.00%) high mild | |
| 1 (1.00%) high severe | |
| concrete_struct_apply/apply_dynamic/64 | |
| time: [2.9326 µs 2.9925 µs 3.0656 µs] | |
| thrpt: [20.877 Melem/s 21.387 Melem/s 21.824 Melem/s] | |
| change: | |
| time: [-1.6128% -0.0963% +1.4301%] (p = 0.90 > 0.05) | |
| thrpt: [-1.4100% +0.0964% +1.6393%] | |
| No change in performance detected. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 5 (5.00%) high mild | |
| 2 (2.00%) high severe | |
| concrete_struct_apply/apply_dynamic/128 | |
| time: [6.1588 µs 6.2436 µs 6.3250 µs] | |
| thrpt: [20.237 Melem/s 20.501 Melem/s 20.783 Melem/s] | |
| change: | |
| time: [-2.5671% -1.2398% +0.0622%] (p = 0.06 > 0.05) | |
| thrpt: [-0.0621% +1.2554% +2.6347%] | |
| No change in performance detected. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 5 (5.00%) high mild | |
| concrete_struct_field/16 | |
| time: [46.404 ns 46.494 ns 46.584 ns] | |
| change: [+491.77% +493.54% +495.38%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 1 (1.00%) low severe | |
| 4 (4.00%) low mild | |
| 3 (3.00%) high mild | |
| 1 (1.00%) high severe | |
| concrete_struct_field/32 | |
| time: [119.66 ns 119.82 ns 120.02 ns] | |
| change: [+740.49% +742.72% +744.88%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 11 outliers among 100 measurements (11.00%) | |
| 2 (2.00%) low severe | |
| 3 (3.00%) low mild | |
| 4 (4.00%) high mild | |
| 2 (2.00%) high severe | |
| concrete_struct_field/64 | |
| time: [482.57 ns 483.81 ns 485.96 ns] | |
| change: [+1692.5% +1696.4% +1701.4%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 1 (1.00%) low severe | |
| 1 (1.00%) high mild | |
| 1 (1.00%) high severe | |
| concrete_struct_field/128 | |
| time: [1.3911 µs 1.3926 µs 1.3944 µs] | |
| change: [-10.646% -10.477% -10.309%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 1 (1.00%) low severe | |
| 1 (1.00%) low mild | |
| 6 (6.00%) high mild | |
| dynamic_struct_apply/apply_concrete/16 | |
| time: [850.36 ns 856.14 ns 864.66 ns] | |
| thrpt: [18.504 Melem/s 18.689 Melem/s 18.816 Melem/s] | |
| change: | |
| time: [+10.311% +12.006% +14.189%] (p = 0.00 < 0.05) | |
| thrpt: [-12.426% -10.719% -9.3476%] | |
| Performance has regressed. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 1 (1.00%) low mild | |
| 2 (2.00%) high mild | |
| 3 (3.00%) high severe | |
| dynamic_struct_apply/apply_concrete/32 | |
| time: [1.6337 µs 1.6517 µs 1.6673 µs] | |
| thrpt: [19.192 Melem/s 19.373 Melem/s 19.588 Melem/s] | |
| change: | |
| time: [+8.7702% +10.422% +12.126%] (p = 0.00 < 0.05) | |
| thrpt: [-10.815% -9.4381% -8.0631%] | |
| Performance has regressed. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 8 (8.00%) high mild | |
| dynamic_struct_apply/apply_concrete/64 | |
| time: [3.2038 µs 3.2336 µs 3.2597 µs] | |
| thrpt: [19.634 Melem/s 19.792 Melem/s 19.976 Melem/s] | |
| change: | |
| time: [+6.5161% +8.4374% +10.416%] (p = 0.00 < 0.05) | |
| thrpt: [-9.4335% -7.7809% -6.1175%] | |
| Performance has regressed. | |
| dynamic_struct_apply/apply_concrete/128 | |
| time: [6.8633 µs 6.9670 µs 7.0570 µs] | |
| thrpt: [18.138 Melem/s 18.372 Melem/s 18.650 Melem/s] | |
| change: | |
| time: [+13.080% +15.285% +17.612%] (p = 0.00 < 0.05) | |
| thrpt: [-14.975% -13.259% -11.567%] | |
| Performance has regressed. | |
| dynamic_struct_apply/apply_dynamic/16 | |
| time: [835.62 ns 842.20 ns 851.69 ns] | |
| thrpt: [18.786 Melem/s 18.998 Melem/s 19.148 Melem/s] | |
| change: | |
| time: [+10.594% +11.775% +12.983%] (p = 0.00 < 0.05) | |
| thrpt: [-11.491% -10.535% -9.5795%] | |
| Performance has regressed. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high severe | |
| dynamic_struct_apply/apply_dynamic/32 | |
| time: [1.6265 µs 1.6472 µs 1.6656 µs] | |
| thrpt: [19.213 Melem/s 19.427 Melem/s 19.674 Melem/s] | |
| change: | |
| time: [+10.926% +12.736% +14.527%] (p = 0.00 < 0.05) | |
| thrpt: [-12.685% -11.297% -9.8495%] | |
| Performance has regressed. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) high mild | |
| dynamic_struct_apply/apply_dynamic/64 | |
| time: [3.6763 µs 4.3321 µs 5.2936 µs] | |
| thrpt: [12.090 Melem/s 14.773 Melem/s 17.409 Melem/s] | |
| change: | |
| time: [+21.002% +34.166% +55.531%] (p = 0.00 < 0.05) | |
| thrpt: [-35.704% -25.466% -17.356%] | |
| Performance has regressed. | |
| Found 11 outliers among 100 measurements (11.00%) | |
| 2 (2.00%) high mild | |
| 9 (9.00%) high severe | |
| dynamic_struct_apply/apply_dynamic/128 | |
| time: [7.1004 µs 7.4965 µs 8.0900 µs] | |
| thrpt: [15.822 Melem/s 17.075 Melem/s 18.027 Melem/s] | |
| change: | |
| time: [+14.094% +19.096% +24.530%] (p = 0.00 < 0.05) | |
| thrpt: [-19.698% -16.034% -12.353%] | |
| Performance has regressed. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 3 (3.00%) high severe | |
| dynamic_struct_get/16 time: [4.2094 ns 4.2458 ns 4.2975 ns] | |
| thrpt: [3.7231 Gelem/s 3.7684 Gelem/s 3.8010 Gelem/s] | |
| change: | |
| time: [+61.321% +67.063% +73.224%] (p = 0.00 < 0.05) | |
| thrpt: [-42.271% -40.142% -38.012%] | |
| Performance has regressed. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 3 (3.00%) high mild | |
| 5 (5.00%) high severe | |
| dynamic_struct_get/32 time: [4.1921 ns 4.3028 ns 4.4728 ns] | |
| thrpt: [7.1543 Gelem/s 7.4370 Gelem/s 7.6335 Gelem/s] | |
| change: | |
| time: [+59.497% +66.161% +74.153%] (p = 0.00 < 0.05) | |
| thrpt: [-42.579% -39.817% -37.303%] | |
| Performance has regressed. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 1 (1.00%) high mild | |
| 4 (4.00%) high severe | |
| dynamic_struct_get/64 time: [10.432 ns 10.759 ns 11.194 ns] | |
| thrpt: [5.7173 Gelem/s 5.9485 Gelem/s 6.1351 Gelem/s] | |
| change: | |
| time: [+117.93% +123.77% +131.47%] (p = 0.00 < 0.05) | |
| thrpt: [-56.798% -55.311% -54.114%] | |
| Performance has regressed. | |
| Found 12 outliers among 100 measurements (12.00%) | |
| 2 (2.00%) high mild | |
| 10 (10.00%) high severe | |
| dynamic_struct_get/128 time: [10.328 ns 10.366 ns 10.411 ns] | |
| thrpt: [12.294 Gelem/s 12.348 Gelem/s 12.394 Gelem/s] | |
| change: | |
| time: [+114.38% +115.08% +115.80%] (p = 0.00 < 0.05) | |
| thrpt: [-53.661% -53.506% -53.354%] | |
| Performance has regressed. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 6 (6.00%) high mild | |
| 4 (4.00%) high severe | |
| dynamic_struct_insert/16 | |
| time: [1.0644 µs 1.0933 µs 1.1290 µs] | |
| thrpt: [14.171 Melem/s 14.635 Melem/s 15.032 Melem/s] | |
| change: | |
| time: [+2.4210% +5.0748% +8.1898%] (p = 0.00 < 0.05) | |
| thrpt: [-7.5699% -4.8297% -2.3637%] | |
| Performance has regressed. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 1 (1.00%) high mild | |
| 5 (5.00%) high severe | |
| dynamic_struct_insert/32 | |
| time: [1.8302 µs 1.8541 µs 1.8816 µs] | |
| thrpt: [17.007 Melem/s 17.259 Melem/s 17.485 Melem/s] | |
| change: | |
| time: [+1.6042% +2.9509% +4.6181%] (p = 0.00 < 0.05) | |
| thrpt: [-4.4142% -2.8663% -1.5789%] | |
| Performance has regressed. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 1 (1.00%) high mild | |
| 2 (2.00%) high severe | |
| dynamic_struct_insert/64 | |
| time: [3.5102 µs 3.6122 µs 3.7387 µs] | |
| thrpt: [17.118 Melem/s 17.718 Melem/s 18.233 Melem/s] | |
| change: | |
| time: [+1.8620% +5.3146% +9.4836%] (p = 0.00 < 0.05) | |
| thrpt: [-8.6621% -5.0464% -1.8280%] | |
| Performance has regressed. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 5 (5.00%) high severe | |
| dynamic_struct_insert/128 | |
| time: [6.5551 µs 6.6914 µs 6.8445 µs] | |
| thrpt: [18.701 Melem/s 19.129 Melem/s 19.527 Melem/s] | |
| change: | |
| time: [-1.4759% +0.4354% +2.3898%] (p = 0.68 > 0.05) | |
| thrpt: [-2.3340% -0.4335% +1.4981%] | |
| No change in performance detected. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 1 (1.00%) high mild | |
| 1 (1.00%) high severe |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment