Skip to content

Instantly share code, notes, and snippets.

@zamazan4ik
Last active June 22, 2024 09:54
Show Gist options
  • Save zamazan4ik/1ab804b086615e991aca8bbfe829f37c to your computer and use it in GitHub Desktop.
Save zamazan4ik/1ab804b086615e991aca8bbfe829f37c to your computer and use it in GitHub Desktop.
lady-deirdre: PGO optimized compared to Release
taskset -c 0 cargo pgo optimize bench -- --workspace --all-features
Benchmarking Entire Text Parsing/Lady Deirdre (mutable)/Small File
Benchmarking Entire Text Parsing/Lady Deirdre (mutable)/Small File: Warming up for 3.0000 s
Benchmarking Entire Text Parsing/Lady Deirdre (mutable)/Small File: Collecting 100 samples in estimated 6.5840 s (10k iterations)
Benchmarking Entire Text Parsing/Lady Deirdre (mutable)/Small File: Analyzing
Entire Text Parsing/Lady Deirdre (mutable)/Small File
time: [547.68 µs 548.20 µs 548.79 µs]
change: [-10.072% -9.9477% -9.7865%] (p = 0.00 < 0.05)
Performance has improved.
Found 8 outliers among 100 measurements (8.00%)
2 (2.00%) low mild
3 (3.00%) high mild
3 (3.00%) high severe
Benchmarking Entire Text Parsing/Lady Deirdre (mutable)/Large File
Benchmarking Entire Text Parsing/Lady Deirdre (mutable)/Large File: Warming up for 3.0000 s
Benchmarking Entire Text Parsing/Lady Deirdre (mutable)/Large File: Collecting 100 samples in estimated 5.2212 s (300 iterations)
Benchmarking Entire Text Parsing/Lady Deirdre (mutable)/Large File: Analyzing
Entire Text Parsing/Lady Deirdre (mutable)/Large File
time: [13.672 ms 13.745 ms 13.839 ms]
change: [-12.274% -11.776% -11.153%] (p = 0.00 < 0.05)
Performance has improved.
Found 12 outliers among 100 measurements (12.00%)
2 (2.00%) low mild
7 (7.00%) high mild
3 (3.00%) high severe
Benchmarking Entire Text Parsing/Lady Deirdre (immutable)/Small File
Benchmarking Entire Text Parsing/Lady Deirdre (immutable)/Small File: Warming up for 3.0000 s
Benchmarking Entire Text Parsing/Lady Deirdre (immutable)/Small File: Collecting 100 samples in estimated 5.9990 s (15k iterations)
Benchmarking Entire Text Parsing/Lady Deirdre (immutable)/Small File: Analyzing
Entire Text Parsing/Lady Deirdre (immutable)/Small File
time: [372.50 µs 372.85 µs 373.21 µs]
change: [-13.262% -13.152% -13.039%] (p = 0.00 < 0.05)
Performance has improved.
Found 7 outliers among 100 measurements (7.00%)
1 (1.00%) low mild
4 (4.00%) high mild
2 (2.00%) high severe
Benchmarking Entire Text Parsing/Lady Deirdre (immutable)/Large File
Benchmarking Entire Text Parsing/Lady Deirdre (immutable)/Large File: Warming up for 3.0000 s
Benchmarking Entire Text Parsing/Lady Deirdre (immutable)/Large File: Collecting 100 samples in estimated 5.8772 s (600 iterations)
Benchmarking Entire Text Parsing/Lady Deirdre (immutable)/Large File: Analyzing
Entire Text Parsing/Lady Deirdre (immutable)/Large File
time: [9.2580 ms 9.2625 ms 9.2674 ms]
change: [-15.597% -15.528% -15.457%] (p = 0.00 < 0.05)
Performance has improved.
Found 13 outliers among 100 measurements (13.00%)
4 (4.00%) high mild
9 (9.00%) high severe
Benchmarking Entire Text Parsing/Nom/Small File
Benchmarking Entire Text Parsing/Nom/Small File: Warming up for 3.0000 s
Benchmarking Entire Text Parsing/Nom/Small File: Collecting 100 samples in estimated 6.0670 s (20k iterations)
Benchmarking Entire Text Parsing/Nom/Small File: Analyzing
Entire Text Parsing/Nom/Small File
time: [300.76 µs 301.02 µs 301.29 µs]
change: [-23.002% -22.914% -22.818%] (p = 0.00 < 0.05)
Performance has improved.
Found 4 outliers among 100 measurements (4.00%)
3 (3.00%) high mild
1 (1.00%) high severe
Benchmarking Entire Text Parsing/Nom/Large File
Benchmarking Entire Text Parsing/Nom/Large File: Warming up for 3.0000 s
Benchmarking Entire Text Parsing/Nom/Large File: Collecting 100 samples in estimated 5.3653 s (700 iterations)
Benchmarking Entire Text Parsing/Nom/Large File: Analyzing
Entire Text Parsing/Nom/Large File
time: [7.6507 ms 7.6563 ms 7.6619 ms]
change: [-14.558% -14.457% -14.353%] (p = 0.00 < 0.05)
Performance has improved.
Found 17 outliers among 100 measurements (17.00%)
4 (4.00%) low severe
5 (5.00%) low mild
5 (5.00%) high mild
3 (3.00%) high severe
Benchmarking Entire Text Parsing/Tree-Sitter/Small File
Benchmarking Entire Text Parsing/Tree-Sitter/Small File: Warming up for 3.0000 s
Benchmarking Entire Text Parsing/Tree-Sitter/Small File: Collecting 100 samples in estimated 5.0096 s (2400 iterations)
Benchmarking Entire Text Parsing/Tree-Sitter/Small File: Analyzing
Entire Text Parsing/Tree-Sitter/Small File
time: [1.9603 ms 1.9625 ms 1.9649 ms]
change: [-1.2781% -1.1519% -1.0033%] (p = 0.00 < 0.05)
Performance has improved.
Found 17 outliers among 100 measurements (17.00%)
16 (16.00%) high mild
1 (1.00%) high severe
Benchmarking Entire Text Parsing/Tree-Sitter/Large File
Benchmarking Entire Text Parsing/Tree-Sitter/Large File: Warming up for 3.0000 s
Benchmarking Entire Text Parsing/Tree-Sitter/Large File: Collecting 100 samples in estimated 9.5060 s (200 iterations)
Benchmarking Entire Text Parsing/Tree-Sitter/Large File: Analyzing
Entire Text Parsing/Tree-Sitter/Large File
time: [44.874 ms 44.921 ms 44.991 ms]
change: [-1.3326% -1.1555% -0.9669%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 13 outliers among 100 measurements (13.00%)
1 (1.00%) low mild
8 (8.00%) high mild
4 (4.00%) high severe
Loading bench data...
Bench data "small-file" with seed 324601853275 loaded from file.
Bench data "large-file" with seed 324601853275 loaded from file.
Benchmarking Keystrokes Reparsing/Lady Deirdre/Small File
Benchmarking Keystrokes Reparsing/Lady Deirdre/Small File: Warming up for 3.0000 s
Benchmarking Keystrokes Reparsing/Lady Deirdre/Small File: Collecting 100 samples in estimated 5.5192 s (400 iterations)
Benchmarking Keystrokes Reparsing/Lady Deirdre/Small File: Analyzing
Keystrokes Reparsing/Lady Deirdre/Small File
time: [12.591 ms 12.619 ms 12.649 ms]
change: [-4.1129% -3.8754% -3.6479%] (p = 0.00 < 0.05)
Performance has improved.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
Benchmarking Keystrokes Reparsing/Lady Deirdre/Large File
Benchmarking Keystrokes Reparsing/Lady Deirdre/Large File: Warming up for 3.0000 s
Warning: Unable to complete 20 samples in 5.0s. You may wish to increase target time to 6.2s, or reduce sample count to 10.
Benchmarking Keystrokes Reparsing/Lady Deirdre/Large File: Collecting 20 samples in estimated 6.2047 s (20 iterations)
Benchmarking Keystrokes Reparsing/Lady Deirdre/Large File: Analyzing
Keystrokes Reparsing/Lady Deirdre/Large File
time: [273.88 ms 274.36 ms 274.87 ms]
change: [-5.2005% -4.9876% -4.7603%] (p = 0.00 < 0.05)
Performance has improved.
Benchmarking Keystrokes Reparsing/Tree-Sitter/Small File
Benchmarking Keystrokes Reparsing/Tree-Sitter/Small File: Warming up for 3.0000 s
Benchmarking Keystrokes Reparsing/Tree-Sitter/Small File: Collecting 100 samples in estimated 8.8595 s (200 iterations)
Benchmarking Keystrokes Reparsing/Tree-Sitter/Small File: Analyzing
Keystrokes Reparsing/Tree-Sitter/Small File
time: [42.219 ms 42.248 ms 42.278 ms]
change: [-0.8121% -0.7121% -0.6086%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 3 outliers among 100 measurements (3.00%)
2 (2.00%) high mild
1 (1.00%) high severe
Benchmarking Keystrokes Reparsing/Tree-Sitter/Large File
Benchmarking Keystrokes Reparsing/Tree-Sitter/Large File: Warming up for 3.0000 s
Benchmarking Keystrokes Reparsing/Tree-Sitter/Large File: Collecting 20 samples in estimated 5.5712 s (60 iterations)
Benchmarking Keystrokes Reparsing/Tree-Sitter/Large File: Analyzing
Keystrokes Reparsing/Tree-Sitter/Large File
time: [45.154 ms 45.232 ms 45.326 ms]
change: [-0.6432% -0.4543% -0.2296%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 1 outliers among 20 measurements (5.00%)
1 (5.00%) high mild
Loading bench data...
Bench data "small-file" with seed 324601853275 loaded from file.
Bench data "large-file" with seed 324601853275 loaded from file.
Benchmarking Entire Text Input/Lady Deirdre (immutable)/Small File
Benchmarking Entire Text Input/Lady Deirdre (immutable)/Small File: Warming up for 3.0000 s
Benchmarking Entire Text Input/Lady Deirdre (immutable)/Small File: Collecting 100 samples in estimated 5.1979 s (35k iterations)
Benchmarking Entire Text Input/Lady Deirdre (immutable)/Small File: Analyzing
Entire Text Input/Lady Deirdre (immutable)/Small File
time: [146.56 µs 146.62 µs 146.69 µs]
change: [-1.2590% -1.1725% -1.0894%] (p = 0.00 < 0.05)
Performance has improved.
Found 5 outliers among 100 measurements (5.00%)
2 (2.00%) low mild
2 (2.00%) high mild
1 (1.00%) high severe
Benchmarking Entire Text Input/Lady Deirdre (immutable)/Large File
Benchmarking Entire Text Input/Lady Deirdre (immutable)/Large File: Warming up for 3.0000 s
Benchmarking Entire Text Input/Lady Deirdre (immutable)/Large File: Collecting 100 samples in estimated 5.3792 s (1300 iterations)
Benchmarking Entire Text Input/Lady Deirdre (immutable)/Large File: Analyzing
Entire Text Input/Lady Deirdre (immutable)/Large File
time: [4.1310 ms 4.1329 ms 4.1349 ms]
change: [-2.9484% -2.8833% -2.8215%] (p = 0.00 < 0.05)
Performance has improved.
Found 20 outliers among 100 measurements (20.00%)
10 (10.00%) low mild
6 (6.00%) high mild
4 (4.00%) high severe
Benchmarking Entire Text Input/Lady Deirdre (mutable)/Small File
Benchmarking Entire Text Input/Lady Deirdre (mutable)/Small File: Warming up for 3.0000 s
Benchmarking Entire Text Input/Lady Deirdre (mutable)/Small File: Collecting 100 samples in estimated 5.4081 s (30k iterations)
Benchmarking Entire Text Input/Lady Deirdre (mutable)/Small File: Analyzing
Entire Text Input/Lady Deirdre (mutable)/Small File
time: [170.58 µs 170.72 µs 170.87 µs]
change: [-1.5015% -1.3910% -1.2758%] (p = 0.00 < 0.05)
Performance has improved.
Found 15 outliers among 100 measurements (15.00%)
4 (4.00%) low mild
8 (8.00%) high mild
3 (3.00%) high severe
Benchmarking Entire Text Input/Lady Deirdre (mutable)/Large File
Benchmarking Entire Text Input/Lady Deirdre (mutable)/Large File: Warming up for 3.0000 s
Benchmarking Entire Text Input/Lady Deirdre (mutable)/Large File: Collecting 100 samples in estimated 5.4606 s (1100 iterations)
Benchmarking Entire Text Input/Lady Deirdre (mutable)/Large File: Analyzing
Entire Text Input/Lady Deirdre (mutable)/Large File
time: [4.7077 ms 4.7094 ms 4.7114 ms]
change: [-3.2616% -3.0212% -2.8727%] (p = 0.00 < 0.05)
Performance has improved.
Found 7 outliers among 100 measurements (7.00%)
6 (6.00%) high mild
1 (1.00%) high severe
Benchmarking Entire Text Input/Ropey/Small File
Benchmarking Entire Text Input/Ropey/Small File: Warming up for 3.0000 s
Benchmarking Entire Text Input/Ropey/Small File: Collecting 100 samples in estimated 5.0263 s (192k iterations)
Benchmarking Entire Text Input/Ropey/Small File: Analyzing
Entire Text Input/Ropey/Small File
time: [24.626 µs 24.640 µs 24.655 µs]
change: [+5.6637% +5.9056% +6.0944%] (p = 0.00 < 0.05)
Performance has regressed.
Found 8 outliers among 100 measurements (8.00%)
6 (6.00%) high mild
2 (2.00%) high severe
Benchmarking Entire Text Input/Ropey/Large File
Benchmarking Entire Text Input/Ropey/Large File: Warming up for 3.0000 s
Benchmarking Entire Text Input/Ropey/Large File: Collecting 100 samples in estimated 8.8544 s (10k iterations)
Benchmarking Entire Text Input/Ropey/Large File: Analyzing
Entire Text Input/Ropey/Large File
time: [814.53 µs 814.86 µs 815.20 µs]
change: [+5.8970% +5.9806% +6.0583%] (p = 0.00 < 0.05)
Performance has regressed.
Found 11 outliers among 100 measurements (11.00%)
8 (8.00%) high mild
3 (3.00%) high severe
Benchmarking Keystroke Writes/Lady Deirdre/Small File
Benchmarking Keystroke Writes/Lady Deirdre/Small File: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 7.8s, enable flat sampling, or reduce sample count to 50.
Benchmarking Keystroke Writes/Lady Deirdre/Small File: Collecting 100 samples in estimated 7.8376 s (5050 iterations)
Benchmarking Keystroke Writes/Lady Deirdre/Small File: Analyzing
Keystroke Writes/Lady Deirdre/Small File
time: [1.2400 ms 1.2407 ms 1.2415 ms]
change: [-5.5917% -5.4421% -5.2961%] (p = 0.00 < 0.05)
Performance has improved.
Found 9 outliers among 100 measurements (9.00%)
4 (4.00%) high mild
5 (5.00%) high severe
Benchmarking Keystroke Writes/Lady Deirdre/Large File
Benchmarking Keystroke Writes/Lady Deirdre/Large File: Warming up for 3.0000 s
Benchmarking Keystroke Writes/Lady Deirdre/Large File: Collecting 100 samples in estimated 6.3290 s (400 iterations)
Benchmarking Keystroke Writes/Lady Deirdre/Large File: Analyzing
Keystroke Writes/Lady Deirdre/Large File
time: [9.7293 ms 9.7376 ms 9.7464 ms]
change: [-2.9014% -2.7910% -2.6922%] (p = 0.00 < 0.05)
Performance has improved.
Found 5 outliers among 100 measurements (5.00%)
5 (5.00%) high mild
Benchmarking Keystroke Writes/Ropey/Small File
Benchmarking Keystroke Writes/Ropey/Small File: Warming up for 3.0000 s
Benchmarking Keystroke Writes/Ropey/Small File: Collecting 100 samples in estimated 6.7432 s (15k iterations)
Benchmarking Keystroke Writes/Ropey/Small File: Analyzing
Keystroke Writes/Ropey/Small File
time: [338.55 µs 338.70 µs 338.85 µs]
change: [-8.4448% -8.3495% -8.2660%] (p = 0.00 < 0.05)
Performance has improved.
Found 10 outliers among 100 measurements (10.00%)
1 (1.00%) low severe
2 (2.00%) low mild
5 (5.00%) high mild
2 (2.00%) high severe
Benchmarking Keystroke Writes/Ropey/Large File
Benchmarking Keystroke Writes/Ropey/Large File: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 7.1s, enable flat sampling, or reduce sample count to 50.
Benchmarking Keystroke Writes/Ropey/Large File: Collecting 100 samples in estimated 7.0551 s (5050 iterations)
Benchmarking Keystroke Writes/Ropey/Large File: Analyzing
Keystroke Writes/Ropey/Large File
time: [455.62 µs 455.91 µs 456.23 µs]
change: [-4.6259% -4.5124% -4.3937%] (p = 0.00 < 0.05)
Performance has improved.
Found 9 outliers among 100 measurements (9.00%)
4 (4.00%) high mild
5 (5.00%) high severe
Loading bench data...
Bench data "small-file" with seed 324601853275 loaded from file.
Bench data "large-file" with seed 324601853275 loaded from file.
Benchmarking Scanner/Lady Deirdre/Small File
Benchmarking Scanner/Lady Deirdre/Small File: Warming up for 3.0000 s
Benchmarking Scanner/Lady Deirdre/Small File: Collecting 100 samples in estimated 5.4363 s (40k iterations)
Benchmarking Scanner/Lady Deirdre/Small File: Analyzing
Scanner/Lady Deirdre/Small File
time: [138.00 µs 138.26 µs 138.50 µs]
change: [-22.701% -22.503% -22.313%] (p = 0.00 < 0.05)
Performance has improved.
Found 5 outliers among 100 measurements (5.00%)
1 (1.00%) low severe
3 (3.00%) low mild
1 (1.00%) high mild
Benchmarking Scanner/Lady Deirdre/Large File
Benchmarking Scanner/Lady Deirdre/Large File: Warming up for 3.0000 s
Benchmarking Scanner/Lady Deirdre/Large File: Collecting 100 samples in estimated 5.2057 s (1400 iterations)
Benchmarking Scanner/Lady Deirdre/Large File: Analyzing
Scanner/Lady Deirdre/Large File
time: [3.7159 ms 3.7186 ms 3.7213 ms]
change: [-24.778% -24.593% -24.468%] (p = 0.00 < 0.05)
Performance has improved.
Found 5 outliers among 100 measurements (5.00%)
1 (1.00%) low mild
4 (4.00%) high mild
Benchmarking Scanner/Logos/Small File
Benchmarking Scanner/Logos/Small File: Warming up for 3.0000 s
Benchmarking Scanner/Logos/Small File: Collecting 100 samples in estimated 5.0888 s (71k iterations)
Benchmarking Scanner/Logos/Small File: Analyzing
Scanner/Logos/Small File
time: [72.731 µs 72.922 µs 73.093 µs]
change: [-15.931% -15.714% -15.500%] (p = 0.00 < 0.05)
Performance has improved.
Benchmarking Scanner/Logos/Large File
Benchmarking Scanner/Logos/Large File: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 9.9s, enable flat sampling, or reduce sample count to 40.
Benchmarking Scanner/Logos/Large File: Collecting 100 samples in estimated 9.9343 s (5050 iterations)
Benchmarking Scanner/Logos/Large File: Analyzing
Scanner/Logos/Large File
time: [2.0310 ms 2.0373 ms 2.0430 ms]
change: [-9.5623% -9.1221% -8.6669%] (p = 0.00 < 0.05)
Performance has improved.
[2024-06-22T09:48:25Z WARN cargo_pgo::pgo::optimize] PGO profile data was not found for 314 functions.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment