Skip to content

Instantly share code, notes, and snippets.

Show Gist options
  • Save zamazan4ik/544c563492be3df26bcee00a1f816959 to your computer and use it in GitHub Desktop.
Save zamazan4ik/544c563492be3df26bcee00a1f816959 to your computer and use it in GitHub Desktop.
lady-deirdre: PGO instrumented compared to Release
taskset -c 0 cargo pgo bench -- --workspace --all-features
Running benches/benches.rs (target/x86_64-unknown-linux-gnu/release/deps/benches-0e48d1d87ff2a8d9)
Loading bench data...
Bench data "small-file" with seed 324601853275 loaded from file.
Bench data "large-file" with seed 324601853275 loaded from file.
Benchmarking Entire Text Parsing/Lady Deirdre (mutable)/Small File
Benchmarking Entire Text Parsing/Lady Deirdre (mutable)/Small File: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.2s, enable flat sampling, or reduce sample count to 60.
Benchmarking Entire Text Parsing/Lady Deirdre (mutable)/Small File: Collecting 100 samples in estimated 5.2048 s (5050 iterations)
Benchmarking Entire Text Parsing/Lady Deirdre (mutable)/Small File: Analyzing
Entire Text Parsing/Lady Deirdre (mutable)/Small File
time: [908.32 µs 908.87 µs 909.45 µs]
change: [+49.139% +49.311% +49.508%] (p = 0.00 < 0.05)
Performance has regressed.
Found 11 outliers among 100 measurements (11.00%)
8 (8.00%) high mild
3 (3.00%) high severe
Benchmarking Entire Text Parsing/Lady Deirdre (mutable)/Large File
Benchmarking Entire Text Parsing/Lady Deirdre (mutable)/Large File: Warming up for 3.0000 s
Benchmarking Entire Text Parsing/Lady Deirdre (mutable)/Large File: Collecting 100 samples in estimated 5.6416 s (200 iterations)
Benchmarking Entire Text Parsing/Lady Deirdre (mutable)/Large File: Analyzing
Entire Text Parsing/Lady Deirdre (mutable)/Large File
time: [23.154 ms 23.304 ms 23.487 ms]
change: [+48.481% +49.575% +50.809%] (p = 0.00 < 0.05)
Performance has regressed.
Found 16 outliers among 100 measurements (16.00%)
6 (6.00%) high mild
10 (10.00%) high severe
Benchmarking Entire Text Parsing/Lady Deirdre (immutable)/Small File
Benchmarking Entire Text Parsing/Lady Deirdre (immutable)/Small File: Warming up for 3.0000 s
Benchmarking Entire Text Parsing/Lady Deirdre (immutable)/Small File: Collecting 100 samples in estimated 6.8570 s (10k iterations)
Benchmarking Entire Text Parsing/Lady Deirdre (immutable)/Small File: Analyzing
Entire Text Parsing/Lady Deirdre (immutable)/Small File
time: [644.25 µs 644.67 µs 645.12 µs]
change: [+49.926% +50.089% +50.278%] (p = 0.00 < 0.05)
Performance has regressed.
Found 3 outliers among 100 measurements (3.00%)
2 (2.00%) high mild
1 (1.00%) high severe
Benchmarking Entire Text Parsing/Lady Deirdre (immutable)/Large File
Benchmarking Entire Text Parsing/Lady Deirdre (immutable)/Large File: Warming up for 3.0000 s
Benchmarking Entire Text Parsing/Lady Deirdre (immutable)/Large File: Collecting 100 samples in estimated 5.3949 s (300 iterations)
Benchmarking Entire Text Parsing/Lady Deirdre (immutable)/Large File: Analyzing
Entire Text Parsing/Lady Deirdre (immutable)/Large File
time: [16.880 ms 16.889 ms 16.899 ms]
change: [+53.887% +54.020% +54.151%] (p = 0.00 < 0.05)
Performance has regressed.
Found 18 outliers among 100 measurements (18.00%)
3 (3.00%) high mild
15 (15.00%) high severe
Benchmarking Entire Text Parsing/Nom/Small File
Benchmarking Entire Text Parsing/Nom/Small File: Warming up for 3.0000 s
Benchmarking Entire Text Parsing/Nom/Small File: Collecting 100 samples in estimated 6.1417 s (10k iterations)
Benchmarking Entire Text Parsing/Nom/Small File: Analyzing
Entire Text Parsing/Nom/Small File
time: [607.10 µs 607.78 µs 608.43 µs]
change: [+55.310% +55.506% +55.689%] (p = 0.00 < 0.05)
Performance has regressed.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
Benchmarking Entire Text Parsing/Nom/Large File
Benchmarking Entire Text Parsing/Nom/Large File: Warming up for 3.0000 s
Benchmarking Entire Text Parsing/Nom/Large File: Collecting 100 samples in estimated 6.1852 s (400 iterations)
Benchmarking Entire Text Parsing/Nom/Large File: Analyzing
Entire Text Parsing/Nom/Large File
time: [15.449 ms 15.458 ms 15.467 ms]
change: [+72.520% +72.708% +72.912%] (p = 0.00 < 0.05)
Performance has regressed.
Found 17 outliers among 100 measurements (17.00%)
1 (1.00%) low mild
2 (2.00%) high mild
14 (14.00%) high severe
Benchmarking Entire Text Parsing/Tree-Sitter/Small File
Benchmarking Entire Text Parsing/Tree-Sitter/Small File: Warming up for 3.0000 s
Benchmarking Entire Text Parsing/Tree-Sitter/Small File: Collecting 100 samples in estimated 5.2035 s (2400 iterations)
Benchmarking Entire Text Parsing/Tree-Sitter/Small File: Analyzing
Entire Text Parsing/Tree-Sitter/Small File
time: [2.0163 ms 2.0180 ms 2.0199 ms]
change: [+1.5323% +1.6448% +1.7580%] (p = 0.00 < 0.05)
Performance has regressed.
Found 5 outliers among 100 measurements (5.00%)
3 (3.00%) high mild
2 (2.00%) high severe
Benchmarking Entire Text Parsing/Tree-Sitter/Large File
Benchmarking Entire Text Parsing/Tree-Sitter/Large File: Warming up for 3.0000 s
Benchmarking Entire Text Parsing/Tree-Sitter/Large File: Collecting 100 samples in estimated 9.8183 s (200 iterations)
Benchmarking Entire Text Parsing/Tree-Sitter/Large File: Analyzing
Entire Text Parsing/Tree-Sitter/Large File
time: [46.497 ms 46.540 ms 46.584 ms]
change: [+2.2380% +2.4069% +2.5611%] (p = 0.00 < 0.05)
Performance has regressed.
Loading bench data...
Bench data "small-file" with seed 324601853275 loaded from file.
Bench data "large-file" with seed 324601853275 loaded from file.
Benchmarking Keystrokes Reparsing/Lady Deirdre/Small File
Benchmarking Keystrokes Reparsing/Lady Deirdre/Small File: Warming up for 3.0000 s
Benchmarking Keystrokes Reparsing/Lady Deirdre/Small File: Collecting 100 samples in estimated 5.5544 s (300 iterations)
Benchmarking Keystrokes Reparsing/Lady Deirdre/Small File: Analyzing
Keystrokes Reparsing/Lady Deirdre/Small File
time: [17.137 ms 17.156 ms 17.174 ms]
change: [+30.484% +30.682% +30.865%] (p = 0.00 < 0.05)
Performance has regressed.
Found 11 outliers among 100 measurements (11.00%)
1 (1.00%) low severe
1 (1.00%) low mild
8 (8.00%) high mild
1 (1.00%) high severe
Benchmarking Keystrokes Reparsing/Lady Deirdre/Large File
Benchmarking Keystrokes Reparsing/Lady Deirdre/Large File: Warming up for 3.0000 s
Warning: Unable to complete 20 samples in 5.0s. You may wish to increase target time to 7.4s, or reduce sample count to 10.
Benchmarking Keystrokes Reparsing/Lady Deirdre/Large File: Collecting 20 samples in estimated 7.4145 s (20 iterations)
Benchmarking Keystrokes Reparsing/Lady Deirdre/Large File: Analyzing
Keystrokes Reparsing/Lady Deirdre/Large File
time: [337.17 ms 337.56 ms 337.92 ms]
change: [+16.682% +16.897% +17.112%] (p = 0.00 < 0.05)
Performance has regressed.
Benchmarking Keystrokes Reparsing/Tree-Sitter/Small File
Benchmarking Keystrokes Reparsing/Tree-Sitter/Small File: Warming up for 3.0000 s
Benchmarking Keystrokes Reparsing/Tree-Sitter/Small File: Collecting 100 samples in estimated 9.0819 s (200 iterations)
Benchmarking Keystrokes Reparsing/Tree-Sitter/Small File: Analyzing
Keystrokes Reparsing/Tree-Sitter/Small File
time: [42.355 ms 42.385 ms 42.416 ms]
change: [-0.4889% -0.3897% -0.2816%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
Benchmarking Keystrokes Reparsing/Tree-Sitter/Large File
Benchmarking Keystrokes Reparsing/Tree-Sitter/Large File: Warming up for 3.0000 s
Benchmarking Keystrokes Reparsing/Tree-Sitter/Large File: Collecting 20 samples in estimated 5.7361 s (60 iterations)
Benchmarking Keystrokes Reparsing/Tree-Sitter/Large File: Analyzing
Keystrokes Reparsing/Tree-Sitter/Large File
time: [45.266 ms 45.335 ms 45.402 ms]
change: [-0.3972% -0.2270% -0.0461%] (p = 0.02 < 0.05)
Change within noise threshold.
Loading bench data...
Bench data "small-file" with seed 324601853275 loaded from file.
Bench data "large-file" with seed 324601853275 loaded from file.
Benchmarking Entire Text Input/Lady Deirdre (immutable)/Small File
Benchmarking Entire Text Input/Lady Deirdre (immutable)/Small File: Warming up for 3.0000 s
Benchmarking Entire Text Input/Lady Deirdre (immutable)/Small File: Collecting 100 samples in estimated 5.5017 s (35k iterations)
Benchmarking Entire Text Input/Lady Deirdre (immutable)/Small File: Analyzing
Entire Text Input/Lady Deirdre (immutable)/Small File
time: [155.29 µs 155.37 µs 155.46 µs]
change: [+4.6423% +4.7391% +4.8335%] (p = 0.00 < 0.05)
Performance has regressed.
Found 13 outliers among 100 measurements (13.00%)
2 (2.00%) high mild
11 (11.00%) high severe
Benchmarking Entire Text Input/Lady Deirdre (immutable)/Large File
Benchmarking Entire Text Input/Lady Deirdre (immutable)/Large File: Warming up for 3.0000 s
Benchmarking Entire Text Input/Lady Deirdre (immutable)/Large File: Collecting 100 samples in estimated 5.1287 s (1100 iterations)
Benchmarking Entire Text Input/Lady Deirdre (immutable)/Large File: Analyzing
Entire Text Input/Lady Deirdre (immutable)/Large File
time: [4.6580 ms 4.6606 ms 4.6635 ms]
change: [+9.4356% +9.5163% +9.5904%] (p = 0.00 < 0.05)
Performance has regressed.
Found 19 outliers among 100 measurements (19.00%)
19 (19.00%) high severe
Benchmarking Entire Text Input/Lady Deirdre (mutable)/Small File
Benchmarking Entire Text Input/Lady Deirdre (mutable)/Small File: Warming up for 3.0000 s
Benchmarking Entire Text Input/Lady Deirdre (mutable)/Small File: Collecting 100 samples in estimated 5.9689 s (30k iterations)
Benchmarking Entire Text Input/Lady Deirdre (mutable)/Small File: Analyzing
Entire Text Input/Lady Deirdre (mutable)/Small File
time: [187.54 µs 187.89 µs 188.50 µs]
change: [+8.2239% +8.3528% +8.5531%] (p = 0.00 < 0.05)
Performance has regressed.
Found 13 outliers among 100 measurements (13.00%)
7 (7.00%) high mild
6 (6.00%) high severe
Benchmarking Entire Text Input/Lady Deirdre (mutable)/Large File
Benchmarking Entire Text Input/Lady Deirdre (mutable)/Large File: Warming up for 3.0000 s
Benchmarking Entire Text Input/Lady Deirdre (mutable)/Large File: Collecting 100 samples in estimated 5.1210 s (900 iterations)
Benchmarking Entire Text Input/Lady Deirdre (mutable)/Large File: Analyzing
Entire Text Input/Lady Deirdre (mutable)/Large File
time: [5.4103 ms 5.4136 ms 5.4173 ms]
change: [+11.192% +11.478% +11.662%] (p = 0.00 < 0.05)
Performance has regressed.
Found 18 outliers among 100 measurements (18.00%)
3 (3.00%) high mild
15 (15.00%) high severe
Benchmarking Entire Text Input/Ropey/Small File
Benchmarking Entire Text Input/Ropey/Small File: Warming up for 3.0000 s
Benchmarking Entire Text Input/Ropey/Small File: Collecting 100 samples in estimated 5.0492 s (167k iterations)
Benchmarking Entire Text Input/Ropey/Small File: Analyzing
Entire Text Input/Ropey/Small File
time: [29.006 µs 29.024 µs 29.044 µs]
change: [+24.455% +24.747% +24.974%] (p = 0.00 < 0.05)
Performance has regressed.
Found 11 outliers among 100 measurements (11.00%)
5 (5.00%) high mild
6 (6.00%) high severe
Benchmarking Entire Text Input/Ropey/Large File
Benchmarking Entire Text Input/Ropey/Large File: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.1s, enable flat sampling, or reduce sample count to 60.
Benchmarking Entire Text Input/Ropey/Large File: Collecting 100 samples in estimated 5.0905 s (5050 iterations)
Benchmarking Entire Text Input/Ropey/Large File: Analyzing
Entire Text Input/Ropey/Large File
time: [961.30 µs 962.07 µs 962.90 µs]
change: [+24.900% +25.038% +25.196%] (p = 0.00 < 0.05)
Performance has regressed.
Found 15 outliers among 100 measurements (15.00%)
1 (1.00%) low mild
3 (3.00%) high mild
11 (11.00%) high severe
Benchmarking Keystroke Writes/Lady Deirdre/Small File
Benchmarking Keystroke Writes/Lady Deirdre/Small File: Warming up for 3.0000 s
Benchmarking Keystroke Writes/Lady Deirdre/Small File: Collecting 100 samples in estimated 5.0693 s (2100 iterations)
Benchmarking Keystroke Writes/Lady Deirdre/Small File: Analyzing
Keystroke Writes/Lady Deirdre/Small File
time: [1.9964 ms 1.9982 ms 2.0001 ms]
change: [+51.897% +52.141% +52.365%] (p = 0.00 < 0.05)
Performance has regressed.
Found 6 outliers among 100 measurements (6.00%)
6 (6.00%) high mild
Benchmarking Keystroke Writes/Lady Deirdre/Large File
Benchmarking Keystroke Writes/Lady Deirdre/Large File: Warming up for 3.0000 s
Benchmarking Keystroke Writes/Lady Deirdre/Large File: Collecting 100 samples in estimated 6.2308 s (300 iterations)
Benchmarking Keystroke Writes/Lady Deirdre/Large File: Analyzing
Keystroke Writes/Lady Deirdre/Large File
time: [11.166 ms 11.175 ms 11.185 ms]
change: [+11.439% +11.559% +11.690%] (p = 0.00 < 0.05)
Performance has regressed.
Found 12 outliers among 100 measurements (12.00%)
3 (3.00%) high mild
9 (9.00%) high severe
Benchmarking Keystroke Writes/Ropey/Small File
Benchmarking Keystroke Writes/Ropey/Small File: Warming up for 3.0000 s
Benchmarking Keystroke Writes/Ropey/Small File: Collecting 100 samples in estimated 5.9425 s (10k iterations)
Benchmarking Keystroke Writes/Ropey/Small File: Analyzing
Keystroke Writes/Ropey/Small File
time: [471.17 µs 471.53 µs 471.93 µs]
change: [+27.525% +27.673% +27.811%] (p = 0.00 < 0.05)
Performance has regressed.
Found 15 outliers among 100 measurements (15.00%)
11 (11.00%) high mild
4 (4.00%) high severe
Benchmarking Keystroke Writes/Ropey/Large File
Benchmarking Keystroke Writes/Ropey/Large File: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 8.5s, enable flat sampling, or reduce sample count to 50.
Benchmarking Keystroke Writes/Ropey/Large File: Collecting 100 samples in estimated 8.5418 s (5050 iterations)
Benchmarking Keystroke Writes/Ropey/Large File: Analyzing
Keystroke Writes/Ropey/Large File
time: [606.34 µs 607.58 µs 609.74 µs]
change: [+26.942% +27.140% +27.374%] (p = 0.00 < 0.05)
Performance has regressed.
Found 10 outliers among 100 measurements (10.00%)
5 (5.00%) high mild
5 (5.00%) high severe
Loading bench data...
Bench data "small-file" with seed 324601853275 loaded from file.
Bench data "large-file" with seed 324601853275 loaded from file.
Benchmarking Scanner/Lady Deirdre/Small File
Benchmarking Scanner/Lady Deirdre/Small File: Warming up for 3.0000 s
Benchmarking Scanner/Lady Deirdre/Small File: Collecting 100 samples in estimated 6.0559 s (20k iterations)
Benchmarking Scanner/Lady Deirdre/Small File: Analyzing
Scanner/Lady Deirdre/Small File
time: [300.92 µs 301.10 µs 301.29 µs]
change: [+69.195% +69.448% +69.666%] (p = 0.00 < 0.05)
Performance has regressed.
Found 6 outliers among 100 measurements (6.00%)
5 (5.00%) high mild
1 (1.00%) high severe
Benchmarking Scanner/Lady Deirdre/Large File
Benchmarking Scanner/Lady Deirdre/Large File: Warming up for 3.0000 s
Benchmarking Scanner/Lady Deirdre/Large File: Collecting 100 samples in estimated 5.7855 s (700 iterations)
Benchmarking Scanner/Lady Deirdre/Large File: Analyzing
Scanner/Lady Deirdre/Large File
time: [8.2631 ms 8.2672 ms 8.2715 ms]
change: [+67.254% +67.647% +67.909%] (p = 0.00 < 0.05)
Performance has regressed.
Found 12 outliers among 100 measurements (12.00%)
11 (11.00%) high mild
1 (1.00%) high severe
Benchmarking Scanner/Logos/Small File
Benchmarking Scanner/Logos/Small File: Warming up for 3.0000 s
Benchmarking Scanner/Logos/Small File: Collecting 100 samples in estimated 5.0452 s (45k iterations)
Benchmarking Scanner/Logos/Small File: Analyzing
Scanner/Logos/Small File
time: [110.35 µs 110.41 µs 110.48 µs]
change: [+27.471% +27.593% +27.712%] (p = 0.00 < 0.05)
Performance has regressed.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
Benchmarking Scanner/Logos/Large File
Benchmarking Scanner/Logos/Large File: Warming up for 3.0000 s
Benchmarking Scanner/Logos/Large File: Collecting 100 samples in estimated 5.0249 s (1900 iterations)
Benchmarking Scanner/Logos/Large File: Analyzing
Scanner/Logos/Large File
time: [2.6411 ms 2.6434 ms 2.6457 ms]
change: [+19.793% +19.964% +20.124%] (p = 0.00 < 0.05)
Performance has regressed.
Found 14 outliers among 100 measurements (14.00%)
8 (8.00%) low mild
5 (5.00%) high mild
1 (1.00%) high severe
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment