Created
November 17, 2023 21:34
-
-
Save zamazan4ik/fdbb9f8b2a1e16d6bbd162a01ea0f6b5 to your computer and use it in GitHub Desktop.
PGO-optimized compared to Release
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Running benches/benchmark.rs (x86_64-unknown-linux-gnu/release/deps/benchmark-8794d403276a2a52) | |
| Benchmarking language models/preload all language models | |
| Benchmarking language models/preload all language models: Warming up for 3.0000 s | |
| Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target time to 38.5s. | |
| Benchmarking language models/preload all language models: Collecting 10 samples in estimated 38.494 s (10 iterations) | |
| Benchmarking language models/preload all language models: Analyzing | |
| language models/preload all language models | |
| time: [3.6277 s 3.6771 s 3.7328 s] | |
| change: [-3.5757% -1.7443% +0.2470%] (p = 0.10 > 0.05) | |
| No change in performance detected. | |
| Benchmarking Lingua with all languages in single thread/low accuracy mode | |
| Benchmarking Lingua with all languages in single thread/low accuracy mode: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 31.7s, or reduce sample count to 10. | |
| Benchmarking Lingua with all languages in single thread/low accuracy mode: Collecting 100 samples in estimated 31.728 s (100 iterations) | |
| Benchmarking Lingua with all languages in single thread/low accuracy mode: Analyzing | |
| Lingua with all languages in single thread/low accuracy mode | |
| time: [314.73 ms 314.79 ms 314.87 ms] | |
| change: [-12.908% -12.857% -12.806%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high severe | |
| Benchmarking Lingua with all languages in single thread/high accuracy mode | |
| Benchmarking Lingua with all languages in single thread/high accuracy mode: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 64.7s, or reduce sample count to 10. | |
| Benchmarking Lingua with all languages in single thread/high accuracy mode: Collecting 100 samples in estimated 64.681 s (100 iterations) | |
| Benchmarking Lingua with all languages in single thread/high accuracy mode: Analyzing | |
| Lingua with all languages in single thread/high accuracy mode | |
| time: [644.64 ms 644.71 ms 644.78 ms] | |
| change: [-12.209% -12.188% -12.166%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high mild | |
| Benchmarking Lingua with all languages in multiple threads/low accuracy mode | |
| Benchmarking Lingua with all languages in multiple threads/low accuracy mode: Warming up for 3.0000 s | |
| Benchmarking Lingua with all languages in multiple threads/low accuracy mode: Collecting 100 samples in estimated 6.5909 s (300 iterations) | |
| Benchmarking Lingua with all languages in multiple threads/low accuracy mode: Analyzing | |
| Lingua with all languages in multiple threads/low accuracy mode | |
| time: [21.975 ms 22.004 ms 22.036 ms] | |
| change: [-11.952% -11.795% -11.630%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 13 outliers among 100 measurements (13.00%) | |
| 3 (3.00%) high mild | |
| 10 (10.00%) high severe | |
| Benchmarking Lingua with all languages in multiple threads/high accuracy mode | |
| Benchmarking Lingua with all languages in multiple threads/high accuracy mode: Warming up for 3.0000 s | |
| Benchmarking Lingua with all languages in multiple threads/high accuracy mode: Collecting 100 samples in estimated 9.1791 s (200 iterations) | |
| Benchmarking Lingua with all languages in multiple threads/high accuracy mode: Analyzing | |
| Lingua with all languages in multiple threads/high accuracy mode | |
| time: [45.741 ms 45.782 ms 45.830 ms] | |
| change: [-11.198% -10.982% -10.800%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 3 (3.00%) high mild | |
| 3 (3.00%) high severe | |
| Benchmarking Lingua with common languages in single thread/low accuracy mode | |
| Benchmarking Lingua with common languages in single thread/low accuracy mode: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 15.8s, or reduce sample count to 30. | |
| Benchmarking Lingua with common languages in single thread/low accuracy mode: Collecting 100 samples in estimated 15.792 s (100 iterations) | |
| Benchmarking Lingua with common languages in single thread/low accuracy mode: Analyzing | |
| Lingua with common languages in single thread/low accuracy mode | |
| time: [156.29 ms 156.34 ms 156.39 ms] | |
| change: [-11.114% -11.082% -11.040%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high mild | |
| Benchmarking Lingua with common languages in single thread/high accuracy mode | |
| Benchmarking Lingua with common languages in single thread/high accuracy mode: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 23.3s, or reduce sample count to 20. | |
| Benchmarking Lingua with common languages in single thread/high accuracy mode: Collecting 100 samples in estimated 23.335 s (100 iterations) | |
| Benchmarking Lingua with common languages in single thread/high accuracy mode: Analyzing | |
| Lingua with common languages in single thread/high accuracy mode | |
| time: [231.98 ms 232.01 ms 232.04 ms] | |
| change: [-11.439% -11.416% -11.394%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Benchmarking Lingua with common languages in multiple threads/low accuracy mode | |
| Benchmarking Lingua with common languages in multiple threads/low accuracy mode: Warming up for 3.0000 s | |
| Benchmarking Lingua with common languages in multiple threads/low accuracy mode: Collecting 100 samples in estimated 5.2596 s (500 iterations) | |
| Benchmarking Lingua with common languages in multiple threads/low accuracy mode: Analyzing | |
| Lingua with common languages in multiple threads/low accuracy mode | |
| time: [10.511 ms 10.528 ms 10.545 ms] | |
| change: [-11.722% -11.511% -11.294%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high mild | |
| Benchmarking Lingua with common languages in multiple threads/high accuracy mode | |
| Benchmarking Lingua with common languages in multiple threads/high accuracy mode: Warming up for 3.0000 s | |
| Benchmarking Lingua with common languages in multiple threads/high accuracy mode: Collecting 100 samples in estimated 6.2580 s (400 iterations) | |
| Benchmarking Lingua with common languages in multiple threads/high accuracy mode: Analyzing | |
| Lingua with common languages in multiple threads/high accuracy mode | |
| time: [15.637 ms 15.656 ms 15.675 ms] | |
| change: [-11.216% -11.072% -10.922%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 11 outliers among 100 measurements (11.00%) | |
| 11 (11.00%) high mild | |
| Benchmarking Whichlang/in single thread | |
| Benchmarking Whichlang/in single thread: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 9.7s, enable flat sampling, or reduce sample count to 50. | |
| Benchmarking Whichlang/in single thread: Collecting 100 samples in estimated 9.6646 s (5050 iterations) | |
| Benchmarking Whichlang/in single thread: Analyzing | |
| Whichlang/in single thread | |
| time: [1.9089 ms 1.9091 ms 1.9094 ms] | |
| change: [-1.7695% -1.7503% -1.7316%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high mild | |
| Benchmarking Whichlang/in multiple threads | |
| Benchmarking Whichlang/in multiple threads: Warming up for 3.0000 s | |
| Benchmarking Whichlang/in multiple threads: Collecting 100 samples in estimated 5.8358 s (30k iterations) | |
| Benchmarking Whichlang/in multiple threads: Analyzing | |
| Whichlang/in multiple threads | |
| time: [193.10 µs 193.56 µs 193.96 µs] | |
| change: [-2.7160% -2.4974% -2.2764%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 15 outliers among 100 measurements (15.00%) | |
| 8 (8.00%) low severe | |
| 2 (2.00%) low mild | |
| 4 (4.00%) high mild | |
| 1 (1.00%) high severe | |
| Benchmarking Whatlang with all languages/in single thread | |
| Benchmarking Whatlang with all languages/in single thread: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 13.6s, or reduce sample count to 30. | |
| Benchmarking Whatlang with all languages/in single thread: Collecting 100 samples in estimated 13.645 s (100 iterations) | |
| Benchmarking Whatlang with all languages/in single thread: Analyzing | |
| Whatlang with all languages/in single thread | |
| time: [136.49 ms 136.57 ms 136.65 ms] | |
| change: [+17.568% +17.693% +17.823%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) low mild | |
| Benchmarking Whatlang with all languages/in multiple threads | |
| Benchmarking Whatlang with all languages/in multiple threads: Warming up for 3.0000 s | |
| Benchmarking Whatlang with all languages/in multiple threads: Collecting 100 samples in estimated 5.1482 s (700 iterations) | |
| Benchmarking Whatlang with all languages/in multiple threads: Analyzing | |
| Whatlang with all languages/in multiple threads | |
| time: [7.2994 ms 7.3090 ms 7.3197 ms] | |
| change: [+7.7419% +7.9306% +8.1368%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 4 (4.00%) high mild | |
| 2 (2.00%) high severe | |
| Benchmarking Whatlang with common languages/in single thread | |
| Benchmarking Whatlang with common languages/in single thread: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.2s, or reduce sample count to 90. | |
| Benchmarking Whatlang with common languages/in single thread: Collecting 100 samples in estimated 5.1547 s (100 iterations) | |
| Benchmarking Whatlang with common languages/in single thread: Analyzing | |
| Whatlang with common languages/in single thread | |
| time: [51.506 ms 51.529 ms 51.551 ms] | |
| change: [+9.3523% +9.4215% +9.4889%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Benchmarking Whatlang with common languages/in multiple threads | |
| Benchmarking Whatlang with common languages/in multiple threads: Warming up for 3.0000 s | |
| Benchmarking Whatlang with common languages/in multiple threads: Collecting 100 samples in estimated 5.2878 s (1800 iterations) | |
| Benchmarking Whatlang with common languages/in multiple threads: Analyzing | |
| Whatlang with common languages/in multiple threads | |
| time: [2.9213 ms 2.9236 ms 2.9261 ms] | |
| change: [+4.8409% +4.9741% +5.0965%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) high mild | |
| Benchmarking CLD2/in single thread | |
| Benchmarking CLD2/in single thread: Warming up for 3.0000 s | |
| Benchmarking CLD2/in single thread: Collecting 100 samples in estimated 5.6236 s (700 iterations) | |
| Benchmarking CLD2/in single thread: Analyzing | |
| CLD2/in single thread time: [8.0328 ms 8.0346 ms 8.0371 ms] | |
| change: [+0.7064% +0.7334% +0.7670%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high severe | |
| Benchmarking CLD2/in multiple threads | |
| Benchmarking CLD2/in multiple threads: Warming up for 3.0000 s | |
| Benchmarking CLD2/in multiple threads: Collecting 100 samples in estimated 6.0123 s (10k iterations) | |
| Benchmarking CLD2/in multiple threads: Analyzing | |
| CLD2/in multiple threads | |
| time: [594.46 µs 595.08 µs 595.83 µs] | |
| change: [+2.1244% +2.5855% +3.0975%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 3 (3.00%) high mild | |
| 5 (5.00%) high severe | |
| [2023-11-17T13:16:33Z WARN cargo_pgo::pgo::optimize] PGO profile data was not found for 520 functions. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment