Skip to content

Instantly share code, notes, and snippets.

@zamazan4ik
Created January 8, 2024 01:54
Show Gist options
  • Save zamazan4ik/2adb489319886015c98e393cac5e2e57 to your computer and use it in GitHub Desktop.
Save zamazan4ik/2adb489319886015c98e393cac5e2e57 to your computer and use it in GitHub Desktop.
sage: PGO optimized compared to Release
Running benches/frontend.rs (target/x86_64-unknown-linux-gnu/release/deps/frontend-0e3d174564dee189)
Benchmarking GCC Backend/Hashmap (GCC precompiled run)
Benchmarking GCC Backend/Hashmap (GCC precompiled run): Warming up for 3.0000 s
Warning: Unable to complete 50 samples in 5.0s. You may wish to increase target time to 7.8s, enable flat sampling, or reduce sample count to 20.
Benchmarking GCC Backend/Hashmap (GCC precompiled run): Collecting 50 samples in estimated 7.7614 s (1275 iterations)
Benchmarking GCC Backend/Hashmap (GCC precompiled run): Analyzing
GCC Backend/Hashmap (GCC precompiled run)
time: [6.0850 ms 6.1152 ms 6.1455 ms]
change: [-0.4999% +0.1902% +0.8604%] (p = 0.58 > 0.05)
No change in performance detected.
Found 1 outliers among 50 measurements (2.00%)
1 (2.00%) high mild
Benchmarking GCC Backend/Vector (GCC precompiled run)
Benchmarking GCC Backend/Vector (GCC precompiled run): Warming up for 3.0000 s
Benchmarking GCC Backend/Vector (GCC precompiled run): Collecting 50 samples in estimated 5.5734 s (7650 iterations)
Benchmarking GCC Backend/Vector (GCC precompiled run): Analyzing
GCC Backend/Vector (GCC precompiled run)
time: [725.82 µs 728.59 µs 730.80 µs]
change: [-0.5322% +0.0465% +0.6030%] (p = 0.88 > 0.05)
No change in performance detected.
Found 7 outliers among 50 measurements (14.00%)
3 (6.00%) low severe
3 (6.00%) low mild
1 (2.00%) high mild
Benchmarking GCC Backend/Vector2 (GCC precompiled run)
Benchmarking GCC Backend/Vector2 (GCC precompiled run): Warming up for 3.0000 s
Benchmarking GCC Backend/Vector2 (GCC precompiled run): Collecting 50 samples in estimated 5.5777 s (7650 iterations)
Benchmarking GCC Backend/Vector2 (GCC precompiled run): Analyzing
GCC Backend/Vector2 (GCC precompiled run)
time: [726.23 µs 728.63 µs 730.78 µs]
change: [-0.0252% +0.4577% +1.0022%] (p = 0.09 > 0.05)
No change in performance detected.
Found 5 outliers among 50 measurements (10.00%)
4 (8.00%) low mild
1 (2.00%) high mild
Benchmarking GCC Backend/AES (GCC precompiled run)
Benchmarking GCC Backend/AES (GCC precompiled run): Warming up for 3.0000 s
Warning: Unable to complete 50 samples in 5.0s. You may wish to increase target time to 9.7s, enable flat sampling, or reduce sample count to 20.
Benchmarking GCC Backend/AES (GCC precompiled run): Collecting 50 samples in estimated 9.7439 s (1275 iterations)
Benchmarking GCC Backend/AES (GCC precompiled run): Analyzing
GCC Backend/AES (GCC precompiled run)
time: [7.6036 ms 7.6334 ms 7.6607 ms]
change: [-1.1452% -0.3900% +0.3518%] (p = 0.32 > 0.05)
No change in performance detected.
Found 2 outliers among 50 measurements (4.00%)
2 (4.00%) high mild
Benchmarking VM Backend/Hashmap (compile + VM run)
Benchmarking VM Backend/Hashmap (compile + VM run): Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target time to 8.7s or enable flat sampling.
Benchmarking VM Backend/Hashmap (compile + VM run): Collecting 10 samples in estimated 8.7283 s (55 iterations)
Benchmarking VM Backend/Hashmap (compile + VM run): Analyzing
VM Backend/Hashmap (compile + VM run)
time: [157.96 ms 158.09 ms 158.34 ms]
change: [-26.419% -26.081% -25.731%] (p = 0.00 < 0.05)
Performance has improved.
Found 1 outliers among 10 measurements (10.00%)
1 (10.00%) high severe
Benchmarking VM Backend/Vector (compile + VM run)
Benchmarking VM Backend/Vector (compile + VM run): Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target time to 6.7s or enable flat sampling.
Benchmarking VM Backend/Vector (compile + VM run): Collecting 10 samples in estimated 6.6579 s (55 iterations)
Benchmarking VM Backend/Vector (compile + VM run): Analyzing
VM Backend/Vector (compile + VM run)
time: [120.58 ms 120.62 ms 120.67 ms]
change: [-20.179% -20.116% -20.048%] (p = 0.00 < 0.05)
Performance has improved.
Benchmarking VM Backend/Vector2 (compile + VM run)
Benchmarking VM Backend/Vector2 (compile + VM run): Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target time to 8.7s or enable flat sampling.
Benchmarking VM Backend/Vector2 (compile + VM run): Collecting 10 samples in estimated 8.7197 s (55 iterations)
Benchmarking VM Backend/Vector2 (compile + VM run): Analyzing
VM Backend/Vector2 (compile + VM run)
time: [158.42 ms 158.45 ms 158.48 ms]
change: [-23.618% -23.476% -23.385%] (p = 0.00 < 0.05)
Performance has improved.
Benchmarking VM Backend/AES (compile + VM run)
Benchmarking VM Backend/AES (compile + VM run): Warming up for 3.0000 s
Benchmarking VM Backend/AES (compile + VM run): Collecting 10 samples in estimated 8.0842 s (20 iterations)
Benchmarking VM Backend/AES (compile + VM run): Analyzing
VM Backend/AES (compile + VM run)
time: [403.10 ms 404.37 ms 405.86 ms]
change: [-27.902% -27.088% -26.525%] (p = 0.00 < 0.05)
Performance has improved.
Found 1 outliers among 10 measurements (10.00%)
1 (10.00%) high mild
Benchmarking VM Backend/Hashmap (compile)
Benchmarking VM Backend/Hashmap (compile): Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target time to 5.6s or enable flat sampling.
Benchmarking VM Backend/Hashmap (compile): Collecting 10 samples in estimated 5.5756 s (55 iterations)
Benchmarking VM Backend/Hashmap (compile): Analyzing
VM Backend/Hashmap (compile)
time: [101.46 ms 101.49 ms 101.53 ms]
change: [-20.593% -20.516% -20.435%] (p = 0.00 < 0.05)
Performance has improved.
Benchmarking VM Backend/Vector (compile)
Benchmarking VM Backend/Vector (compile): Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target time to 6.6s or enable flat sampling.
Benchmarking VM Backend/Vector (compile): Collecting 10 samples in estimated 6.6050 s (55 iterations)
Benchmarking VM Backend/Vector (compile): Analyzing
VM Backend/Vector (compile)
time: [120.01 ms 120.06 ms 120.12 ms]
change: [-19.890% -19.823% -19.762%] (p = 0.00 < 0.05)
Performance has improved.
Benchmarking VM Backend/Vector2 (compile)
Benchmarking VM Backend/Vector2 (compile): Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target time to 8.7s or enable flat sampling.
Benchmarking VM Backend/Vector2 (compile): Collecting 10 samples in estimated 8.7014 s (55 iterations)
Benchmarking VM Backend/Vector2 (compile): Analyzing
VM Backend/Vector2 (compile)
time: [157.87 ms 158.23 ms 158.71 ms]
change: [-23.714% -23.372% -23.063%] (p = 0.00 < 0.05)
Performance has improved.
Found 1 outliers among 10 measurements (10.00%)
1 (10.00%) high mild
Benchmarking VM Backend/AES (compile)
Benchmarking VM Backend/AES (compile): Warming up for 3.0000 s
Benchmarking VM Backend/AES (compile): Collecting 10 samples in estimated 6.7149 s (20 iterations)
Benchmarking VM Backend/AES (compile): Analyzing
VM Backend/AES (compile)
time: [333.81 ms 335.12 ms 336.61 ms]
change: [-26.093% -25.376% -24.824%] (p = 0.00 < 0.05)
Performance has improved.
Benchmarking VM Backend/Hashmap (VM precompiled run)
Benchmarking VM Backend/Hashmap (VM precompiled run): Warming up for 3.0000 s
Benchmarking VM Backend/Hashmap (VM precompiled run): Collecting 10 samples in estimated 6.7130 s (110 iterations)
Benchmarking VM Backend/Hashmap (VM precompiled run): Analyzing
VM Backend/Hashmap (VM precompiled run)
time: [61.526 ms 61.817 ms 62.014 ms]
change: [-28.895% -28.420% -27.974%] (p = 0.00 < 0.05)
Performance has improved.
Found 2 outliers among 10 measurements (20.00%)
2 (20.00%) high severe
Benchmarking VM Backend/Vector (VM precompiled run)
Benchmarking VM Backend/Vector (VM precompiled run): Warming up for 3.0000 s
Benchmarking VM Backend/Vector (VM precompiled run): Collecting 10 samples in estimated 5.0010 s (4730 iterations)
Benchmarking VM Backend/Vector (VM precompiled run): Analyzing
VM Backend/Vector (VM precompiled run)
time: [1.0585 ms 1.0586 ms 1.0587 ms]
change: [-26.484% -26.054% -25.595%] (p = 0.00 < 0.05)
Performance has improved.
Found 2 outliers among 10 measurements (20.00%)
1 (10.00%) high mild
1 (10.00%) high severe
Benchmarking VM Backend/Vector2 (VM precompiled run)
Benchmarking VM Backend/Vector2 (VM precompiled run): Warming up for 3.0000 s
Benchmarking VM Backend/Vector2 (VM precompiled run): Collecting 10 samples in estimated 5.0478 s (5115 iterations)
Benchmarking VM Backend/Vector2 (VM precompiled run): Analyzing
VM Backend/Vector2 (VM precompiled run)
time: [1.0177 ms 1.0268 ms 1.0329 ms]
change: [-27.851% -27.308% -26.838%] (p = 0.00 < 0.05)
Performance has improved.
Found 2 outliers among 10 measurements (20.00%)
1 (10.00%) low severe
1 (10.00%) high severe
Benchmarking VM Backend/AES (VM precompiled run)
Benchmarking VM Backend/AES (VM precompiled run): Warming up for 3.0000 s
Benchmarking VM Backend/AES (VM precompiled run): Collecting 10 samples in estimated 7.8114 s (110 iterations)
Benchmarking VM Backend/AES (VM precompiled run): Analyzing
VM Backend/AES (VM precompiled run)
time: [71.020 ms 71.129 ms 71.221 ms]
change: [-31.765% -31.290% -30.918%] (p = 0.00 < 0.05)
Performance has improved.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment