Last active
November 17, 2023 12:50
-
-
Save zamazan4ik/14973a900c780902462a29cccbe18ae8 to your computer and use it in GitHub Desktop.
Lingua-rs: Instrumented compared to Release
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Running benches/benchmark.rs (target/x86_64-unknown-linux-gnu/release/deps/benchmark-8794d403276a2a52) | |
| Benchmarking language models/preload all language models | |
| Benchmarking language models/preload all language models: Warming up for 3.0000 s | |
| Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target time to 108.1s. | |
| Benchmarking language models/preload all language models: Collecting 10 samples in estimated 108.11 s (10 iterations) | |
| Benchmarking language models/preload all language models: Analyzing | |
| language models/preload all language models | |
| time: [10.626 s 11.189 s 11.780 s] | |
| change: [+224.65% +244.02% +262.59%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Benchmarking Lingua with all languages in single thread/low accuracy mode | |
| Benchmarking Lingua with all languages in single thread/low accuracy mode: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 58.0s, or reduce sample count to 10. | |
| Benchmarking Lingua with all languages in single thread/low accuracy mode: Collecting 100 samples in estimated 58.004 s (100 iterations) | |
| Benchmarking Lingua with all languages in single thread/low accuracy mode: Analyzing | |
| Lingua with all languages in single thread/low accuracy mode | |
| time: [576.79 ms 576.89 ms 577.00 ms] | |
| change: [+96.263% +96.305% +96.346%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Benchmarking Lingua with all languages in single thread/high accuracy mode | |
| Benchmarking Lingua with all languages in single thread/high accuracy mode: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 102.0s, or reduce sample count to 10. | |
| Benchmarking Lingua with all languages in single thread/high accuracy mode: Collecting 100 samples in estimated 102.03 s (100 iterations) | |
| Benchmarking Lingua with all languages in single thread/high accuracy mode: Analyzing | |
| Lingua with all languages in single thread/high accuracy mode | |
| time: [1.0092 s 1.0094 s 1.0095 s] | |
| change: [+70.100% +70.144% +70.187%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Benchmarking Lingua with all languages in multiple threads/low accuracy mode | |
| Benchmarking Lingua with all languages in multiple threads/low accuracy mode: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 119.0s, or reduce sample count to 10. | |
| Benchmarking Lingua with all languages in multiple threads/low accuracy mode: Collecting 100 samples in estimated 119.00 s (100 iterations) | |
| Benchmarking Lingua with all languages in multiple threads/low accuracy mode: Analyzing | |
| Lingua with all languages in multiple threads/low accuracy mode | |
| time: [1.1011 s 1.1022 s 1.1034 s] | |
| change: [+5079.7% +5088.8% +5097.4%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 1 (1.00%) low mild | |
| 2 (2.00%) high mild | |
| Benchmarking Lingua with all languages in multiple threads/high accuracy mode | |
| Benchmarking Lingua with all languages in multiple threads/high accuracy mode: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 198.3s, or reduce sample count to 10. | |
| Benchmarking Lingua with all languages in multiple threads/high accuracy mode: Collecting 100 samples in estimated 198.35 s (100 iterations) | |
| Benchmarking Lingua with all languages in multiple threads/high accuracy mode: Analyzing | |
| Lingua with all languages in multiple threads/high accuracy mode | |
| time: [1.9816 s 1.9828 s 1.9839 s] | |
| change: [+4376.8% +4383.6% +4389.7%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) low mild | |
| Benchmarking Lingua with common languages in single thread/low accuracy mode | |
| Benchmarking Lingua with common languages in single thread/low accuracy mode: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 31.5s, or reduce sample count to 10. | |
| Benchmarking Lingua with common languages in single thread/low accuracy mode: Collecting 100 samples in estimated 31.476 s (100 iterations) | |
| Benchmarking Lingua with common languages in single thread/low accuracy mode: Analyzing | |
| Lingua with common languages in single thread/low accuracy mode | |
| time: [313.72 ms 313.88 ms 314.16 ms] | |
| change: [+117.23% +117.45% +117.73%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 2 (2.00%) low mild | |
| 5 (5.00%) high mild | |
| 2 (2.00%) high severe | |
| Benchmarking Lingua with common languages in single thread/high accuracy mode | |
| Benchmarking Lingua with common languages in single thread/high accuracy mode: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 43.1s, or reduce sample count to 10. | |
| Benchmarking Lingua with common languages in single thread/high accuracy mode: Collecting 100 samples in estimated 43.100 s (100 iterations) | |
| Benchmarking Lingua with common languages in single thread/high accuracy mode: Analyzing | |
| Lingua with common languages in single thread/high accuracy mode | |
| time: [427.79 ms 427.90 ms 428.02 ms] | |
| change: [+104.01% +104.48% +104.90%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Benchmarking Lingua with common languages in multiple threads/low accuracy mode | |
| Benchmarking Lingua with common languages in multiple threads/low accuracy mode: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 78.0s, or reduce sample count to 10. | |
| Benchmarking Lingua with common languages in multiple threads/low accuracy mode: Collecting 100 samples in estimated 78.001 s (100 iterations) | |
| Benchmarking Lingua with common languages in multiple threads/low accuracy mode: Analyzing | |
| Lingua with common languages in multiple threads/low accuracy mode | |
| time: [781.03 ms 781.33 ms 781.62 ms] | |
| change: [+7475.5% +7486.7% +7497.6%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) low mild | |
| Benchmarking Lingua with common languages in multiple threads/high accuracy mode | |
| Benchmarking Lingua with common languages in multiple threads/high accuracy mode: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 87.4s, or reduce sample count to 10. | |
| Benchmarking Lingua with common languages in multiple threads/high accuracy mode: Collecting 100 samples in estimated 87.371 s (100 iterations) | |
| Benchmarking Lingua with common languages in multiple threads/high accuracy mode: Analyzing | |
| Lingua with common languages in multiple threads/high accuracy mode | |
| time: [874.49 ms 874.99 ms 875.61 ms] | |
| change: [+5603.7% +5613.4% +5622.7%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high severe | |
| Benchmarking Whichlang/in single thread | |
| Benchmarking Whichlang/in single thread: Warming up for 3.0000 s | |
| Benchmarking Whichlang/in single thread: Collecting 100 samples in estimated 5.0969 s (2500 iterations) | |
| Benchmarking Whichlang/in single thread: Analyzing | |
| Whichlang/in single thread | |
| time: [2.0323 ms 2.0326 ms 2.0329 ms] | |
| change: [+31.812% +31.886% +31.952%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high mild | |
| Benchmarking Whichlang/in multiple threads | |
| Benchmarking Whichlang/in multiple threads: Warming up for 3.0000 s | |
| Benchmarking Whichlang/in multiple threads: Collecting 100 samples in estimated 5.4263 s (300 iterations) | |
| Benchmarking Whichlang/in multiple threads: Analyzing | |
| Whichlang/in multiple threads | |
| time: [18.035 ms 18.048 ms 18.063 ms] | |
| change: [+10364% +10376% +10387%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 1 (1.00%) high mild | |
| 1 (1.00%) high severe | |
| Benchmarking Whatlang with all languages/in single thread | |
| Benchmarking Whatlang with all languages/in single thread: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 12.3s, or reduce sample count to 40. | |
| Benchmarking Whatlang with all languages/in single thread: Collecting 100 samples in estimated 12.315 s (100 iterations) | |
| Benchmarking Whatlang with all languages/in single thread: Analyzing | |
| Whatlang with all languages/in single thread | |
| time: [123.25 ms 123.34 ms 123.43 ms] | |
| change: [+30.732% +30.871% +31.007%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Benchmarking Whatlang with all languages/in multiple threads | |
| Benchmarking Whatlang with all languages/in multiple threads: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 85.5s, or reduce sample count to 10. | |
| Benchmarking Whatlang with all languages/in multiple threads: Collecting 100 samples in estimated 85.507 s (100 iterations) | |
| Benchmarking Whatlang with all languages/in multiple threads: Analyzing | |
| Whatlang with all languages/in multiple threads | |
| time: [855.13 ms 855.37 ms 855.59 ms] | |
| change: [+14677% +14695% +14712%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 1 (1.00%) low severe | |
| 1 (1.00%) low mild | |
| Benchmarking Whatlang with common languages/in single thread | |
| Benchmarking Whatlang with common languages/in single thread: Warming up for 3.0000 s | |
| Benchmarking Whatlang with common languages/in single thread: Collecting 100 samples in estimated 9.9850 s (200 iterations) | |
| Benchmarking Whatlang with common languages/in single thread: Analyzing | |
| Whatlang with common languages/in single thread | |
| time: [49.851 ms 49.873 ms 49.896 ms] | |
| change: [+36.139% +36.233% +36.323%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) high mild | |
| Benchmarking Whatlang with common languages/in multiple threads | |
| Benchmarking Whatlang with common languages/in multiple threads: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 24.3s, or reduce sample count to 20. | |
| Benchmarking Whatlang with common languages/in multiple threads: Collecting 100 samples in estimated 24.319 s (100 iterations) | |
| Benchmarking Whatlang with common languages/in multiple threads: Analyzing | |
| Whatlang with common languages/in multiple threads | |
| time: [243.40 ms 243.55 ms 243.73 ms] | |
| change: [+10120% +10131% +10143%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 5 (5.00%) low mild | |
| 4 (4.00%) high severe | |
| Benchmarking CLD2/in single thread | |
| Benchmarking CLD2/in single thread: Warming up for 3.0000 s | |
| Benchmarking CLD2/in single thread: Collecting 100 samples in estimated 5.1001 s (800 iterations) | |
| Benchmarking CLD2/in single thread: Analyzing | |
| CLD2/in single thread time: [6.4041 ms 6.4061 ms 6.4082 ms] | |
| change: [+3.5994% +3.6445% +3.6915%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 2 (2.00%) low mild | |
| 2 (2.00%) high mild | |
| Benchmarking CLD2/in multiple threads | |
| Benchmarking CLD2/in multiple threads: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.5s, enable flat sampling, or reduce sample count to 60. | |
| Benchmarking CLD2/in multiple threads: Collecting 100 samples in estimated 5.4942 s (5050 iterations) | |
| Benchmarking CLD2/in multiple threads: Analyzing | |
| CLD2/in multiple threads | |
| time: [1.0899 ms 1.0934 ms 1.0969 ms] | |
| change: [+111.18% +112.41% +113.51%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 2 (2.00%) low severe | |
| 1 (1.00%) low mild | |
| 1 (1.00%) high mild | |
| 2 (2.00%) high severe |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment