-
-
Save michaelsproul/f759fa28dfa4003962507db34b439d6c to your computer and use it in GitHub Desktop.
blst 0.3.11 portable benchmarks
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| [profile.bench] | |
| lto = "fat" | |
| codegen-units = 1 | |
| incremental = false |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| verify_multi_aggregate/verify_multi_aggregate/8 | |
| time: [1.8231 ms 1.8528 ms 1.8839 ms] | |
| change: [-9.6164% -8.0981% -6.6137%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| verify_multi_aggregate/verify_multi_aggregate/16 | |
| time: [2.6438 ms 2.6733 ms 2.7021 ms] | |
| change: [+2.2900% +4.5539% +6.9174%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| verify_multi_aggregate/verify_multi_aggregate/32 | |
| time: [2.4205 ms 2.4323 ms 2.4441 ms] | |
| change: [+2.3023% +4.1483% +6.2091%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| verify_multi_aggregate/verify_multi_aggregate/64 | |
| time: [2.8885 ms 2.9714 ms 3.0593 ms] | |
| change: [-1.1183% +2.7895% +6.7997%] (p = 0.16 > 0.05) | |
| No change in performance detected. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 8 (8.00%) high mild | |
| verify_multi_aggregate/verify_multi_aggregate/128 | |
| time: [4.0126 ms 4.0257 ms 4.0413 ms] | |
| change: [-0.3896% +0.0636% +0.5349%] (p = 0.79 > 0.05) | |
| No change in performance detected. | |
| Found 12 outliers among 100 measurements (12.00%) | |
| 6 (6.00%) high mild | |
| 6 (6.00%) high severe | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify/8: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.9s, enable flat sampling, or reduce sample count to 60. | |
| fast_aggregate_verify/fast_aggregate_verify/8 | |
| time: [1.1895 ms 1.2085 ms 1.2235 ms] | |
| change: [-4.6928% -2.3772% +0.0024%] (p = 0.05 < 0.05) | |
| Change within noise threshold. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 6 (6.00%) low severe | |
| 3 (3.00%) low mild | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify_preagg/8: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.9s, enable flat sampling, or reduce sample count to 60. | |
| fast_aggregate_verify/fast_aggregate_verify_preagg/8 | |
| time: [1.1942 ms 1.2118 ms 1.2265 ms] | |
| change: [-0.9632% +1.1368% +3.4352%] (p = 0.32 > 0.05) | |
| No change in performance detected. | |
| Found 21 outliers among 100 measurements (21.00%) | |
| 12 (12.00%) low severe | |
| 1 (1.00%) low mild | |
| 3 (3.00%) high mild | |
| 5 (5.00%) high severe | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify/16: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.7s, enable flat sampling, or reduce sample count to 60. | |
| fast_aggregate_verify/fast_aggregate_verify/16 | |
| time: [1.1325 ms 1.1702 ms 1.2027 ms] | |
| change: [+7.5434% +11.501% +15.504%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 31 outliers among 100 measurements (31.00%) | |
| 16 (16.00%) low severe | |
| 3 (3.00%) low mild | |
| 5 (5.00%) high mild | |
| 7 (7.00%) high severe | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify_preagg/16: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.7s, enable flat sampling, or reduce sample count to 60. | |
| fast_aggregate_verify/fast_aggregate_verify_preagg/16 | |
| time: [1.2135 ms 1.2206 ms 1.2260 ms] | |
| change: [+6.2948% +8.5515% +10.818%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 14 outliers among 100 measurements (14.00%) | |
| 10 (10.00%) low severe | |
| 3 (3.00%) low mild | |
| 1 (1.00%) high severe | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify/32: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.9s, enable flat sampling, or reduce sample count to 60. | |
| fast_aggregate_verify/fast_aggregate_verify/32 | |
| time: [1.2004 ms 1.2265 ms 1.2478 ms] | |
| change: [+20.283% +23.416% +26.775%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 15 outliers among 100 measurements (15.00%) | |
| 8 (8.00%) low severe | |
| 3 (3.00%) low mild | |
| 3 (3.00%) high mild | |
| 1 (1.00%) high severe | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify_preagg/32: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.1s, enable flat sampling, or reduce sample count to 60. | |
| fast_aggregate_verify/fast_aggregate_verify_preagg/32 | |
| time: [1.0462 ms 1.0756 ms 1.1023 ms] | |
| change: [-11.907% -9.8253% -7.9610%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 15 outliers among 100 measurements (15.00%) | |
| 10 (10.00%) low severe | |
| 3 (3.00%) low mild | |
| 2 (2.00%) high mild | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify/64: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.1s, enable flat sampling, or reduce sample count to 70. | |
| fast_aggregate_verify/fast_aggregate_verify/64 | |
| time: [1.0700 ms 1.1109 ms 1.1505 ms] | |
| change: [-11.447% -9.1320% -7.1022%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 13 outliers among 100 measurements (13.00%) | |
| 4 (4.00%) low severe | |
| 8 (8.00%) low mild | |
| 1 (1.00%) high mild | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify_preagg/64: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.2s, enable flat sampling, or reduce sample count to 60. | |
| fast_aggregate_verify/fast_aggregate_verify_preagg/64 | |
| time: [1.1354 ms 1.1450 ms 1.1553 ms] | |
| change: [-9.8587% -8.3941% -6.8902%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 4 (4.00%) low severe | |
| 2 (2.00%) low mild | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify/128: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 6.1s, enable flat sampling, or reduce sample count to 60. | |
| fast_aggregate_verify/fast_aggregate_verify/128 | |
| time: [1.1164 ms 1.1563 ms 1.1951 ms] | |
| change: [+0.8268% +4.6623% +8.4764%] (p = 0.02 < 0.05) | |
| Change within noise threshold. | |
| Found 13 outliers among 100 measurements (13.00%) | |
| 6 (6.00%) low severe | |
| 7 (7.00%) low mild | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify_preagg/128: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.6s, enable flat sampling, or reduce sample count to 60. | |
| fast_aggregate_verify/fast_aggregate_verify_preagg/128 | |
| time: [1.1717 ms 1.1890 ms 1.2056 ms] | |
| change: [+17.349% +20.017% +22.872%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) low mild | |
| Benchmarking aggregate_verify/aggregate_verify/8: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 7.7s, enable flat sampling, or reduce sample count to 50. | |
| aggregate_verify/aggregate_verify/8 | |
| time: [1.2589 ms 1.2919 ms 1.3261 ms] | |
| change: [-18.454% -16.786% -15.128%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 5 (5.00%) high mild | |
| Benchmarking aggregate_verify/aggregate_verify/16: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 9.3s, enable flat sampling, or reduce sample count to 50. | |
| aggregate_verify/aggregate_verify/16 | |
| time: [1.8674 ms 1.9028 ms 1.9384 ms] | |
| change: [+3.5325% +6.8157% +10.335%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) low mild | |
| Benchmarking aggregate_verify/aggregate_verify/32: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 9.4s, enable flat sampling, or reduce sample count to 50. | |
| aggregate_verify/aggregate_verify/32 | |
| time: [1.8532 ms 1.8870 ms 1.9199 ms] | |
| change: [-0.3918% +1.3841% +3.1778%] (p = 0.14 > 0.05) | |
| No change in performance detected. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 1 (1.00%) low mild | |
| 2 (2.00%) high mild | |
| aggregate_verify/aggregate_verify/64 | |
| time: [2.7475 ms 2.7904 ms 2.8299 ms] | |
| change: [+2.6846% +5.3080% +7.9383%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 1 (1.00%) low severe | |
| 3 (3.00%) low mild | |
| aggregate_verify/aggregate_verify/128 | |
| time: [3.0715 ms 3.0847 ms 3.0991 ms] | |
| change: [-1.6374% -0.9231% -0.2197%] (p = 0.01 < 0.05) | |
| Change within noise threshold. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 5 (5.00%) high mild | |
| 2 (2.00%) high severe | |
| aggregate/aggregate_signature/10 | |
| time: [9.4598 us 9.4640 us 9.4694 us] | |
| change: [+5.8208% +5.9190% +6.0128%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 6 (6.00%) high mild | |
| 2 (2.00%) high severe | |
| aggregate/aggregate_public_key/10 | |
| time: [3.7678 us 3.7690 us 3.7703 us] | |
| change: [+0.5213% +0.5784% +0.6353%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high mild | |
| aggregate/aggregate_signature/50 | |
| time: [47.944 us 47.981 us 48.026 us] | |
| change: [-5.8235% -5.7670% -5.7124%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 4 (4.00%) high mild | |
| 4 (4.00%) high severe | |
| aggregate/aggregate_public_key/50 | |
| time: [20.155 us 20.222 us 20.295 us] | |
| change: [-1.2874% -0.7130% -0.1177%] (p = 0.02 < 0.05) | |
| Change within noise threshold. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 1 (1.00%) high mild | |
| 7 (7.00%) high severe | |
| aggregate/aggregate_signature/100 | |
| time: [100.35 us 100.39 us 100.44 us] | |
| change: [-2.4808% -2.4289% -2.3715%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 3 (3.00%) high mild | |
| 1 (1.00%) high severe | |
| aggregate/aggregate_public_key/100 | |
| time: [40.919 us 40.927 us 40.936 us] | |
| change: [+2.9054% +2.9474% +2.9910%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high severe | |
| aggregate/aggregate_signature/300 | |
| time: [301.09 us 301.15 us 301.23 us] | |
| change: [-2.6151% -2.5552% -2.4955%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 11 outliers among 100 measurements (11.00%) | |
| 4 (4.00%) low severe | |
| 3 (3.00%) low mild | |
| 2 (2.00%) high mild | |
| 2 (2.00%) high severe | |
| aggregate/aggregate_public_key/300 | |
| time: [125.55 us 125.58 us 125.62 us] | |
| change: [-1.1356% -1.0613% -0.9753%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 1 (1.00%) high mild | |
| 4 (4.00%) high severe | |
| Benchmarking aggregate/aggregate_signature/1000: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.2s, enable flat sampling, or reduce sample count to 60. | |
| aggregate/aggregate_signature/1000 | |
| time: [1.0276 ms 1.0279 ms 1.0283 ms] | |
| change: [+1.6635% +1.7694% +1.8949%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 3 (3.00%) high mild | |
| 4 (4.00%) high severe | |
| aggregate/aggregate_public_key/1000 | |
| time: [419.49 us 419.63 us 419.79 us] | |
| change: [+1.3361% +1.3931% +1.4498%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 3 (3.00%) high mild | |
| 7 (7.00%) high severe | |
| aggregate/aggregate_signature/4000 | |
| time: [4.1360 ms 4.1383 ms 4.1411 ms] | |
| change: [+2.0829% +2.1506% +2.2233%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 3 (3.00%) high mild | |
| 2 (2.00%) high severe | |
| Benchmarking aggregate/aggregate_public_key/4000: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 8.5s, enable flat sampling, or reduce sample count to 50. | |
| aggregate/aggregate_public_key/4000 | |
| time: [1.6830 ms 1.6833 ms 1.6836 ms] | |
| change: [-0.1602% -0.1208% -0.0791%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 4 (4.00%) high mild | |
| 3 (3.00%) high severe | |
| single_message/sign time: [277.64 us 277.67 us 277.71 us] | |
| change: [-1.0457% -1.0151% -0.9803%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 1 (1.00%) low severe | |
| 6 (6.00%) high mild | |
| 3 (3.00%) high severe | |
| Benchmarking single_message/verify: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.9s, enable flat sampling, or reduce sample count to 60. | |
| single_message/verify time: [1.1311 ms 1.1564 ms 1.1777 ms] | |
| change: [-0.8294% +2.5707% +6.0293%] (p = 0.14 > 0.05) | |
| No change in performance detected. | |
| Found 14 outliers among 100 measurements (14.00%) | |
| 9 (9.00%) low severe | |
| 3 (3.00%) low mild | |
| 2 (2.00%) high mild | |
| serdes/secret_key_serialize | |
| time: [31.157 ns 31.209 ns 31.261 ns] | |
| change: [+6.3172% +6.6466% +6.9376%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 3 (3.00%) low mild | |
| serdes/secret_key_deserialize | |
| time: [69.955 ns 70.489 ns 70.959 ns] | |
| change: [-7.0829% -6.2384% -5.4946%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| serdes/public_key_serialize | |
| time: [83.064 ns 83.215 ns 83.372 ns] | |
| change: [-6.6151% -6.3697% -6.1484%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 4 (4.00%) high mild | |
| 1 (1.00%) high severe | |
| serdes/public_key_compress | |
| time: [60.579 ns 60.635 ns 60.695 ns] | |
| change: [-0.3970% -0.1591% +0.0706%] (p = 0.18 > 0.05) | |
| No change in performance detected. | |
| Found 15 outliers among 100 measurements (15.00%) | |
| 4 (4.00%) high mild | |
| 11 (11.00%) high severe | |
| serdes/public_key_uncompress | |
| time: [11.565 us 11.567 us 11.570 us] | |
| change: [-2.3531% -2.3279% -2.2978%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 11 outliers among 100 measurements (11.00%) | |
| 10 (10.00%) high mild | |
| 1 (1.00%) high severe | |
| serdes/public_key_deserialize | |
| time: [215.09 ns 215.56 ns 216.11 ns] | |
| change: [+1.5216% +1.8529% +2.1947%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 19 outliers among 100 measurements (19.00%) | |
| 2 (2.00%) low mild | |
| 6 (6.00%) high mild | |
| 11 (11.00%) high severe | |
| serdes/signature_serialize | |
| time: [164.61 ns 164.89 ns 165.17 ns] | |
| change: [-3.7141% -2.5547% -1.8449%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 3 (3.00%) high mild | |
| 2 (2.00%) high severe | |
| serdes/signature_compress | |
| time: [116.74 ns 116.96 ns 117.19 ns] | |
| change: [+1.8900% +2.1663% +2.3858%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) high mild | |
| serdes/signature_uncompress | |
| time: [23.227 us 23.237 us 23.252 us] | |
| change: [-3.4463% -2.8987% -2.3297%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 2 (2.00%) high mild | |
| 5 (5.00%) high severe | |
| serdes/signature_deserialize | |
| time: [454.15 ns 454.54 ns 454.94 ns] | |
| change: [-0.9605% -0.8523% -0.7223%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 3 (3.00%) high mild | |
| 1 (1.00%) high severe | |
| serdes/p1_serialize time: [2.0475 us 2.0485 us 2.0497 us] | |
| change: [+0.5811% +0.6546% +0.7386%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Found 14 outliers among 100 measurements (14.00%) | |
| 6 (6.00%) high mild | |
| 8 (8.00%) high severe | |
| serdes/p1_compress time: [2.0193 us 2.0199 us 2.0206 us] | |
| change: [+2.5669% +2.6393% +2.6940%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 2 (2.00%) high mild | |
| 2 (2.00%) high severe | |
| serdes/p2_serialize time: [2.3614 us 2.3618 us 2.3623 us] | |
| change: [-2.2479% -2.1969% -2.1373%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 3 (3.00%) high mild | |
| 2 (2.00%) high severe | |
| serdes/p2_compress time: [2.3015 us 2.3018 us 2.3021 us] | |
| change: [+2.2531% +2.2876% +2.3204%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 4 (4.00%) high mild | |
| 5 (5.00%) high severe | |
| keys/key_gen time: [594.11 ns 594.51 ns 594.88 ns] | |
| change: [+4.5032% +4.5946% +4.6877%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| keys/sk_to_pk time: [79.663 us 79.684 us 79.708 us] | |
| change: [-0.3055% +0.1880% +0.9185%] (p = 0.70 > 0.05) | |
| No change in performance detected. | |
| Found 12 outliers among 100 measurements (12.00%) | |
| 9 (9.00%) low severe | |
| 1 (1.00%) high mild | |
| 2 (2.00%) high severe | |
| keys/key_validate time: [47.934 us 47.952 us 47.971 us] | |
| change: [-0.6286% -0.2754% +0.1198%] (p = 0.15 > 0.05) | |
| No change in performance detected. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 3 (3.00%) high mild | |
| 1 (1.00%) high severe |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Benchmarking verify_multi_aggregate/verify_multi_aggregate/8: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 9.5s, enable flat sampling, or reduce sample count to 50. | |
| verify_multi_aggregate/verify_multi_aggregate/8 | |
| time: [1.8325 ms 1.8625 ms 1.8932 ms] | |
| change: [-24.186% -22.405% -20.695%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) high mild | |
| verify_multi_aggregate/verify_multi_aggregate/16 | |
| time: [2.6035 ms 2.6605 ms 2.7132 ms] | |
| Found 23 outliers among 100 measurements (23.00%) | |
| 22 (22.00%) low severe | |
| 1 (1.00%) low mild | |
| verify_multi_aggregate/verify_multi_aggregate/32 | |
| time: [2.4150 ms 2.4281 ms 2.4418 ms] | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high mild | |
| verify_multi_aggregate/verify_multi_aggregate/64 | |
| time: [2.7985 ms 2.8502 ms 2.9057 ms] | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 4 (4.00%) high mild | |
| 3 (3.00%) high severe | |
| verify_multi_aggregate/verify_multi_aggregate/128 | |
| time: [4.0184 ms 4.0331 ms 4.0506 ms] | |
| Found 20 outliers among 100 measurements (20.00%) | |
| 10 (10.00%) high mild | |
| 10 (10.00%) high severe | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify/8: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 6.2s, enable flat sampling, or reduce sample count to 60. | |
| fast_aggregate_verify/fast_aggregate_verify/8 | |
| time: [1.0637 ms 1.1050 ms 1.1442 ms] | |
| Found 13 outliers among 100 measurements (13.00%) | |
| 9 (9.00%) low severe | |
| 4 (4.00%) low mild | |
| fast_aggregate_verify/fast_aggregate_verify_preagg/8 | |
| time: [1.0660 ms 1.0969 ms 1.1235 ms] | |
| Found 23 outliers among 100 measurements (23.00%) | |
| 13 (13.00%) low severe | |
| 2 (2.00%) low mild | |
| 2 (2.00%) high mild | |
| 6 (6.00%) high severe | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify/16: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.9s, enable flat sampling, or reduce sample count to 60. | |
| fast_aggregate_verify/fast_aggregate_verify/16 | |
| time: [1.1470 ms 1.1854 ms 1.2194 ms] | |
| Found 24 outliers among 100 measurements (24.00%) | |
| 16 (16.00%) low severe | |
| 1 (1.00%) low mild | |
| 2 (2.00%) high mild | |
| 5 (5.00%) high severe | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify_preagg/16: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 6.0s, enable flat sampling, or reduce sample count to 60. | |
| fast_aggregate_verify/fast_aggregate_verify_preagg/16 | |
| time: [1.2320 ms 1.2335 ms 1.2349 ms] | |
| Found 12 outliers among 100 measurements (12.00%) | |
| 5 (5.00%) low severe | |
| 6 (6.00%) low mild | |
| 1 (1.00%) high mild | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify/32: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.9s, enable flat sampling, or reduce sample count to 60. | |
| fast_aggregate_verify/fast_aggregate_verify/32 | |
| time: [1.2189 ms 1.2351 ms 1.2493 ms] | |
| Found 16 outliers among 100 measurements (16.00%) | |
| 8 (8.00%) low severe | |
| 3 (3.00%) low mild | |
| 2 (2.00%) high mild | |
| 3 (3.00%) high severe | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify_preagg/32: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 6.0s, enable flat sampling, or reduce sample count to 60. | |
| fast_aggregate_verify/fast_aggregate_verify_preagg/32 | |
| time: [1.2168 ms 1.2240 ms 1.2297 ms] | |
| Found 18 outliers among 100 measurements (18.00%) | |
| 7 (7.00%) low severe | |
| 3 (3.00%) low mild | |
| 8 (8.00%) high severe | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify/64: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 6.0s, enable flat sampling, or reduce sample count to 60. | |
| fast_aggregate_verify/fast_aggregate_verify/64 | |
| time: [1.2123 ms 1.2386 ms 1.2608 ms] | |
| Found 22 outliers among 100 measurements (22.00%) | |
| 13 (13.00%) low severe | |
| 4 (4.00%) low mild | |
| 1 (1.00%) high mild | |
| 4 (4.00%) high severe | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify_preagg/64: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.8s, enable flat sampling, or reduce sample count to 60. | |
| fast_aggregate_verify/fast_aggregate_verify_preagg/64 | |
| time: [1.1385 ms 1.1659 ms 1.1897 ms] | |
| Found 12 outliers among 100 measurements (12.00%) | |
| 8 (8.00%) low severe | |
| 2 (2.00%) low mild | |
| 2 (2.00%) high mild | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify/128: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 6.0s, enable flat sampling, or reduce sample count to 60. | |
| fast_aggregate_verify/fast_aggregate_verify/128 | |
| time: [1.0098 ms 1.0736 ms 1.1359 ms] | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify_preagg/128: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.3s, enable flat sampling, or reduce sample count to 60. | |
| fast_aggregate_verify/fast_aggregate_verify_preagg/128 | |
| time: [957.98 us 1.0196 ms 1.0736 ms] | |
| Benchmarking aggregate_verify/aggregate_verify/8: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 8.1s, enable flat sampling, or reduce sample count to 50. | |
| aggregate_verify/aggregate_verify/8 | |
| time: [1.4228 ms 1.4548 ms 1.4919 ms] | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high mild | |
| Benchmarking aggregate_verify/aggregate_verify/16: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 9.5s, enable flat sampling, or reduce sample count to 50. | |
| aggregate_verify/aggregate_verify/16 | |
| time: [1.7479 ms 1.8026 ms 1.8466 ms] | |
| Benchmarking aggregate_verify/aggregate_verify/32: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 9.1s, enable flat sampling, or reduce sample count to 50. | |
| aggregate_verify/aggregate_verify/32 | |
| time: [1.8569 ms 1.8889 ms 1.9231 ms] | |
| Found 16 outliers among 100 measurements (16.00%) | |
| 3 (3.00%) low severe | |
| 3 (3.00%) low mild | |
| 10 (10.00%) high mild | |
| aggregate_verify/aggregate_verify/64 | |
| time: [2.6857 ms 2.7339 ms 2.7801 ms] | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 3 (3.00%) low mild | |
| aggregate_verify/aggregate_verify/128 | |
| time: [3.0985 ms 3.1193 ms 3.1428 ms] | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 5 (5.00%) high mild | |
| 4 (4.00%) high severe | |
| aggregate/aggregate_signature/10 | |
| time: [9.3915 us 9.3946 us 9.3979 us] | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 4 (4.00%) high mild | |
| aggregate/aggregate_public_key/10 | |
| time: [3.7991 us 3.8006 us 3.8022 us] | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 3 (3.00%) low mild | |
| 1 (1.00%) high mild | |
| aggregate/aggregate_signature/50 | |
| time: [50.407 us 50.423 us 50.439 us] | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 3 (3.00%) high mild | |
| aggregate/aggregate_public_key/50 | |
| time: [20.586 us 20.592 us 20.599 us] | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high mild | |
| aggregate/aggregate_signature/100 | |
| time: [101.73 us 101.77 us 101.81 us] | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 3 (3.00%) high mild | |
| 1 (1.00%) high severe | |
| aggregate/aggregate_public_key/100 | |
| time: [41.571 us 41.587 us 41.605 us] | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 4 (4.00%) high mild | |
| 1 (1.00%) high severe | |
| aggregate/aggregate_signature/300 | |
| time: [308.83 us 308.96 us 309.10 us] | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 6 (6.00%) high mild | |
| 4 (4.00%) high severe | |
| aggregate/aggregate_public_key/300 | |
| time: [126.14 us 126.17 us 126.20 us] | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 2 (2.00%) high mild | |
| 3 (3.00%) high severe | |
| Benchmarking aggregate/aggregate_signature/1000: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.1s, enable flat sampling, or reduce sample count to 60. | |
| aggregate/aggregate_signature/1000 | |
| time: [1.0320 ms 1.0324 ms 1.0328 ms] | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 3 (3.00%) high mild | |
| aggregate/aggregate_public_key/1000 | |
| time: [399.14 us 399.27 us 399.40 us] | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) high severe | |
| aggregate/aggregate_signature/4000 | |
| time: [4.0129 ms 4.0160 ms 4.0193 ms] | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) high mild | |
| Benchmarking aggregate/aggregate_public_key/4000: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 8.2s, enable flat sampling, or reduce sample count to 50. | |
| aggregate/aggregate_public_key/4000 | |
| time: [1.6758 ms 1.6804 ms 1.6839 ms] | |
| single_message/sign time: [278.17 us 278.56 us 279.03 us] | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 3 (3.00%) high mild | |
| 5 (5.00%) high severe | |
| Benchmarking single_message/verify: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.5s, enable flat sampling, or reduce sample count to 60. | |
| single_message/verify time: [1.1705 ms 1.1901 ms 1.2057 ms] | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 7 (7.00%) low severe | |
| 1 (1.00%) low mild | |
| serdes/secret_key_serialize | |
| time: [30.942 ns 31.035 ns 31.135 ns] | |
| serdes/secret_key_deserialize | |
| time: [70.068 ns 70.376 ns 70.673 ns] | |
| serdes/public_key_serialize | |
| time: [86.280 ns 86.424 ns 86.593 ns] | |
| Found 14 outliers among 100 measurements (14.00%) | |
| 1 (1.00%) low severe | |
| 2 (2.00%) low mild | |
| 4 (4.00%) high mild | |
| 7 (7.00%) high severe | |
| serdes/public_key_compress | |
| time: [60.651 ns 60.692 ns 60.745 ns] | |
| Found 19 outliers among 100 measurements (19.00%) | |
| 5 (5.00%) low severe | |
| 5 (5.00%) low mild | |
| 4 (4.00%) high mild | |
| 5 (5.00%) high severe | |
| serdes/public_key_uncompress | |
| time: [10.948 us 10.949 us 10.951 us] | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 5 (5.00%) high mild | |
| 5 (5.00%) high severe | |
| serdes/public_key_deserialize | |
| time: [210.08 ns 211.03 ns 211.90 ns] | |
| Found 16 outliers among 100 measurements (16.00%) | |
| 15 (15.00%) high mild | |
| 1 (1.00%) high severe | |
| serdes/signature_serialize | |
| time: [168.50 ns 168.77 ns 169.06 ns] | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 4 (4.00%) high mild | |
| 1 (1.00%) high severe | |
| serdes/signature_compress | |
| time: [120.29 ns 120.41 ns 120.54 ns] | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 2 (2.00%) low mild | |
| 1 (1.00%) high mild | |
| serdes/signature_uncompress | |
| time: [23.444 us 23.483 us 23.514 us] | |
| serdes/signature_deserialize | |
| time: [451.37 ns 451.75 ns 452.15 ns] | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 6 (6.00%) high mild | |
| 2 (2.00%) high severe | |
| serdes/p1_serialize time: [2.0446 us 2.0449 us 2.0453 us] | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 2 (2.00%) high mild | |
| 3 (3.00%) high severe | |
| serdes/p1_compress time: [1.9073 us 1.9081 us 1.9090 us] | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 3 (3.00%) high mild | |
| 3 (3.00%) high severe | |
| serdes/p2_serialize time: [2.3962 us 2.4059 us 2.4134 us] | |
| serdes/p2_compress time: [2.3940 us 2.3944 us 2.3950 us] | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 3 (3.00%) high mild | |
| 3 (3.00%) high severe | |
| keys/key_gen time: [566.50 ns 570.77 ns 575.22 ns] | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 2 (2.00%) low mild | |
| 1 (1.00%) high mild | |
| 7 (7.00%) high severe | |
| keys/sk_to_pk time: [79.468 us 79.487 us 79.509 us] | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 3 (3.00%) low severe | |
| 2 (2.00%) low mild | |
| 1 (1.00%) high mild | |
| 2 (2.00%) high severe | |
| keys/key_validate time: [45.548 us 45.568 us 45.584 us] | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 1 (1.00%) low severe | |
| 8 (8.00%) low mild |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| verify_multi_aggregate/verify_multi_aggregate/8 | |
| time: [2.0043 ms 2.0161 ms 2.0278 ms] | |
| change: [+7.3864% +9.2490% +11.049%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 20 outliers among 100 measurements (20.00%) | |
| 13 (13.00%) low severe | |
| 1 (1.00%) low mild | |
| 3 (3.00%) high mild | |
| 3 (3.00%) high severe | |
| verify_multi_aggregate/verify_multi_aggregate/16 | |
| time: [2.5068 ms 2.5569 ms 2.6051 ms] | |
| change: [-6.6853% -3.8957% -1.1448%] (p = 0.01 < 0.05) | |
| Performance has improved. | |
| verify_multi_aggregate/verify_multi_aggregate/32 | |
| time: [2.2919 ms 2.3354 ms 2.3753 ms] | |
| change: [-5.5026% -3.8151% -1.9889%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 15 outliers among 100 measurements (15.00%) | |
| 15 (15.00%) low severe | |
| verify_multi_aggregate/verify_multi_aggregate/64 | |
| time: [2.8227 ms 2.8908 ms 2.9645 ms] | |
| change: [-1.6568% +1.4242% +4.8088%] (p = 0.38 > 0.05) | |
| No change in performance detected. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 7 (7.00%) high mild | |
| verify_multi_aggregate/verify_multi_aggregate/128 | |
| time: [4.0126 ms 4.0231 ms 4.0349 ms] | |
| change: [-0.7478% -0.2476% +0.2506%] (p = 0.33 > 0.05) | |
| No change in performance detected. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 3 (3.00%) high mild | |
| 5 (5.00%) high severe | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify/8: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 6.0s, enable flat sampling, or reduce sample count to 60. | |
| fast_aggregate_verify/fast_aggregate_verify/8 | |
| time: [1.1722 ms 1.1940 ms 1.2140 ms] | |
| change: [+0.3032% +2.8726% +5.7695%] (p = 0.04 < 0.05) | |
| Change within noise threshold. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 2 (2.00%) low severe | |
| 5 (5.00%) low mild | |
| 1 (1.00%) high mild | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify_preagg/8: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.8s, enable flat sampling, or reduce sample count to 60. | |
| fast_aggregate_verify/fast_aggregate_verify_preagg/8 | |
| time: [1.1977 ms 1.2206 ms 1.2415 ms] | |
| change: [+6.3552% +9.4845% +12.793%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 30 outliers among 100 measurements (30.00%) | |
| 15 (15.00%) low severe | |
| 3 (3.00%) low mild | |
| 4 (4.00%) high mild | |
| 8 (8.00%) high severe | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify/16: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.4s, enable flat sampling, or reduce sample count to 60. | |
| fast_aggregate_verify/fast_aggregate_verify/16 | |
| time: [1.0368 ms 1.0599 ms 1.0829 ms] | |
| change: [-14.164% -11.521% -8.5927%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify_preagg/16: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.1s, enable flat sampling, or reduce sample count to 60. | |
| fast_aggregate_verify/fast_aggregate_verify_preagg/16 | |
| time: [1.1264 ms 1.1394 ms 1.1537 ms] | |
| change: [-11.193% -9.5448% -8.1523%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 5 (5.00%) low severe | |
| 3 (3.00%) low mild | |
| 1 (1.00%) high mild | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify/32: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.6s, enable flat sampling, or reduce sample count to 60. | |
| fast_aggregate_verify/fast_aggregate_verify/32 | |
| time: [968.43 us 994.09 us 1.0194 ms] | |
| change: [-21.733% -19.683% -17.687%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify_preagg/32: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.4s, enable flat sampling, or reduce sample count to 60. | |
| fast_aggregate_verify/fast_aggregate_verify_preagg/32 | |
| time: [1.2171 ms 1.2207 ms 1.2242 ms] | |
| change: [-1.9065% -0.4374% +1.0130%] (p = 0.58 > 0.05) | |
| No change in performance detected. | |
| Found 11 outliers among 100 measurements (11.00%) | |
| 3 (3.00%) low severe | |
| 4 (4.00%) low mild | |
| 4 (4.00%) high mild | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify/64: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 6.1s, enable flat sampling, or reduce sample count to 60. | |
| fast_aggregate_verify/fast_aggregate_verify/64 | |
| time: [1.2867 ms 1.2935 ms 1.2996 ms] | |
| change: [+1.0327% +2.8337% +4.7909%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 11 outliers among 100 measurements (11.00%) | |
| 5 (5.00%) low severe | |
| 1 (1.00%) low mild | |
| 5 (5.00%) high mild | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify_preagg/64: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.8s, enable flat sampling, or reduce sample count to 60. | |
| fast_aggregate_verify/fast_aggregate_verify_preagg/64 | |
| time: [1.2294 ms 1.2335 ms 1.2373 ms] | |
| change: [+3.3937% +5.1201% +7.0758%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 12 outliers among 100 measurements (12.00%) | |
| 2 (2.00%) low severe | |
| 7 (7.00%) low mild | |
| 1 (1.00%) high mild | |
| 2 (2.00%) high severe | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify/128: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 6.5s, enable flat sampling, or reduce sample count to 60. | |
| fast_aggregate_verify/fast_aggregate_verify/128 | |
| time: [1.0417 ms 1.0763 ms 1.1128 ms] | |
| change: [-1.2477% +3.8897% +9.4128%] (p = 0.15 > 0.05) | |
| No change in performance detected. | |
| fast_aggregate_verify/fast_aggregate_verify_preagg/128 | |
| time: [944.16 us 959.58 us 977.23 us] | |
| change: [+3.5505% +9.3264% +15.467%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high mild | |
| Benchmarking aggregate_verify/aggregate_verify/8: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 7.1s, enable flat sampling, or reduce sample count to 50. | |
| aggregate_verify/aggregate_verify/8 | |
| time: [1.5327 ms 1.5615 ms 1.5940 ms] | |
| change: [-1.9633% +0.0956% +2.2997%] (p = 0.93 > 0.05) | |
| No change in performance detected. | |
| Found 27 outliers among 100 measurements (27.00%) | |
| 9 (9.00%) low severe | |
| 2 (2.00%) low mild | |
| 16 (16.00%) high severe | |
| Benchmarking aggregate_verify/aggregate_verify/16: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 9.5s, enable flat sampling, or reduce sample count to 50. | |
| aggregate_verify/aggregate_verify/16 | |
| time: [1.7012 ms 1.7729 ms 1.8372 ms] | |
| change: [+6.7529% +11.807% +16.782%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 9 (9.00%) low mild | |
| Benchmarking aggregate_verify/aggregate_verify/32: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 9.6s, enable flat sampling, or reduce sample count to 50. | |
| aggregate_verify/aggregate_verify/32 | |
| time: [1.8808 ms 1.9101 ms 1.9388 ms] | |
| change: [+0.3490% +2.4035% +4.6651%] (p = 0.03 < 0.05) | |
| Change within noise threshold. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 1 (1.00%) low mild | |
| 7 (7.00%) high mild | |
| aggregate_verify/aggregate_verify/64 | |
| time: [2.5941 ms 2.6498 ms 2.7028 ms] | |
| change: [-5.7734% -3.0777% -0.5410%] (p = 0.02 < 0.05) | |
| Change within noise threshold. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) low mild | |
| aggregate_verify/aggregate_verify/128 | |
| time: [3.0968 ms 3.1134 ms 3.1331 ms] | |
| change: [-1.0913% -0.1896% +0.7227%] (p = 0.68 > 0.05) | |
| No change in performance detected. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 5 (5.00%) high mild | |
| 2 (2.00%) high severe | |
| aggregate/aggregate_signature/10 | |
| time: [8.9198 us 8.9258 us 8.9324 us] | |
| change: [-4.9239% -4.8372% -4.7455%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 1 (1.00%) low mild | |
| 3 (3.00%) high mild | |
| 4 (4.00%) high severe | |
| aggregate/aggregate_public_key/10 | |
| time: [3.7455 us 3.7474 us 3.7493 us] | |
| change: [-1.4965% -1.4440% -1.3879%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 6 (6.00%) low mild | |
| 3 (3.00%) high mild | |
| 1 (1.00%) high severe | |
| aggregate/aggregate_signature/50 | |
| time: [50.895 us 50.912 us 50.930 us] | |
| change: [+0.8363% +0.8834% +0.9269%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high mild | |
| aggregate/aggregate_public_key/50 | |
| time: [19.779 us 19.865 us 19.976 us] | |
| change: [-2.0289% -1.4383% -0.8970%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| aggregate/aggregate_signature/100 | |
| time: [102.84 us 102.88 us 102.94 us] | |
| change: [+1.0142% +1.0659% +1.1140%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 4 (4.00%) high mild | |
| 2 (2.00%) high severe | |
| aggregate/aggregate_public_key/100 | |
| time: [39.728 us 39.748 us 39.768 us] | |
| change: [-4.4736% -4.4253% -4.3766%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) high mild | |
| aggregate/aggregate_signature/300 | |
| time: [309.09 us 309.33 us 309.62 us] | |
| change: [-0.1002% -0.0266% +0.0468%] (p = 0.48 > 0.05) | |
| No change in performance detected. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 1 (1.00%) high mild | |
| 1 (1.00%) high severe | |
| aggregate/aggregate_public_key/300 | |
| time: [126.92 us 126.99 us 127.06 us] | |
| change: [+0.5828% +0.6377% +0.6863%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) high mild | |
| Benchmarking aggregate/aggregate_signature/1000: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.1s, enable flat sampling, or reduce sample count to 60. | |
| aggregate/aggregate_signature/1000 | |
| time: [1.0108 ms 1.0111 ms 1.0113 ms] | |
| change: [-2.0468% -2.0069% -1.9667%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) high mild | |
| aggregate/aggregate_public_key/1000 | |
| time: [413.83 us 413.96 us 414.09 us] | |
| change: [+3.6805% +3.7285% +3.7758%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| aggregate/aggregate_signature/4000 | |
| time: [4.0498 ms 4.0511 ms 4.0527 ms] | |
| change: [+0.7855% +0.8748% +0.9630%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 1 (1.00%) low mild | |
| 3 (3.00%) high mild | |
| 2 (2.00%) high severe | |
| Benchmarking aggregate/aggregate_public_key/4000: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 8.5s, enable flat sampling, or reduce sample count to 50. | |
| aggregate/aggregate_public_key/4000 | |
| time: [1.6859 ms 1.6866 ms 1.6874 ms] | |
| change: [+1.5729% +2.0575% +2.5437%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high mild | |
| single_message/sign time: [280.48 us 280.52 us 280.56 us] | |
| change: [+0.7662% +0.8359% +0.8912%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 2 (2.00%) low mild | |
| 3 (3.00%) high mild | |
| 1 (1.00%) high severe | |
| Benchmarking single_message/verify: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.6s, enable flat sampling, or reduce sample count to 60. | |
| single_message/verify time: [1.0835 ms 1.1162 ms 1.1440 ms] | |
| change: [-8.0888% -4.9735% -1.8864%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 29 outliers among 100 measurements (29.00%) | |
| 17 (17.00%) low severe | |
| 3 (3.00%) low mild | |
| 9 (9.00%) high mild | |
| serdes/secret_key_serialize | |
| time: [29.229 ns 29.265 ns 29.308 ns] | |
| change: [-5.8615% -5.5435% -5.2092%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 3 (3.00%) low mild | |
| 3 (3.00%) high mild | |
| 2 (2.00%) high severe | |
| serdes/secret_key_deserialize | |
| time: [73.307 ns 73.786 ns 74.253 ns] | |
| change: [+4.5451% +5.2350% +5.8933%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 17 outliers among 100 measurements (17.00%) | |
| 2 (2.00%) low severe | |
| 10 (10.00%) low mild | |
| 3 (3.00%) high mild | |
| 2 (2.00%) high severe | |
| serdes/public_key_serialize | |
| time: [88.612 ns 88.781 ns 88.956 ns] | |
| change: [+2.2861% +2.6045% +2.9285%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 3 (3.00%) high mild | |
| 1 (1.00%) high severe | |
| serdes/public_key_compress | |
| time: [60.839 ns 60.939 ns 61.046 ns] | |
| change: [+0.0997% +0.2663% +0.4340%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Found 15 outliers among 100 measurements (15.00%) | |
| 12 (12.00%) high mild | |
| 3 (3.00%) high severe | |
| serdes/public_key_uncompress | |
| time: [11.843 us 11.845 us 11.848 us] | |
| change: [+8.1598% +8.1824% +8.2042%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 5 (5.00%) high mild | |
| 4 (4.00%) high severe | |
| serdes/public_key_deserialize | |
| time: [212.46 ns 212.66 ns 212.88 ns] | |
| change: [+1.1060% +1.4024% +1.6855%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) high mild | |
| serdes/signature_serialize | |
| time: [167.83 ns 168.11 ns 168.42 ns] | |
| change: [-0.7225% -0.0394% +1.5205%] (p = 0.95 > 0.05) | |
| No change in performance detected. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 1 (1.00%) low mild | |
| 1 (1.00%) high mild | |
| 2 (2.00%) high severe | |
| serdes/signature_compress | |
| time: [113.99 ns 114.18 ns 114.37 ns] | |
| change: [-5.6820% -5.4819% -5.2487%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high severe | |
| serdes/signature_uncompress | |
| time: [23.246 us 23.427 us 23.644 us] | |
| change: [+2.8344% +3.7104% +4.5273%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| serdes/signature_deserialize | |
| time: [458.39 ns 458.62 ns 458.87 ns] | |
| change: [+1.5576% +1.6474% +1.7403%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 2 (2.00%) high mild | |
| 1 (1.00%) high severe | |
| serdes/p1_serialize time: [2.0356 us 2.0360 us 2.0365 us] | |
| change: [-0.4799% -0.4497% -0.4201%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Found 11 outliers among 100 measurements (11.00%) | |
| 7 (7.00%) high mild | |
| 4 (4.00%) high severe | |
| serdes/p1_compress time: [1.9664 us 1.9666 us 1.9668 us] | |
| change: [+3.0807% +3.1369% +3.2078%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 3 (3.00%) high mild | |
| 4 (4.00%) high severe | |
| serdes/p2_serialize time: [2.4153 us 2.4157 us 2.4161 us] | |
| change: [+1.9881% +2.5720% +3.1500%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 2 (2.00%) high mild | |
| 5 (5.00%) high severe | |
| serdes/p2_compress time: [2.2501 us 2.2508 us 2.2516 us] | |
| change: [-6.0401% -6.0078% -5.9744%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 6 (6.00%) high mild | |
| 3 (3.00%) high severe | |
| keys/key_gen time: [567.25 ns 567.56 ns 567.88 ns] | |
| change: [-0.1689% +0.1749% +0.4777%] (p = 0.30 > 0.05) | |
| No change in performance detected. | |
| keys/sk_to_pk time: [79.539 us 79.569 us 79.600 us] | |
| change: [+0.0562% +0.0973% +0.1393%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 5 (5.00%) high mild | |
| 3 (3.00%) high severe | |
| keys/key_validate time: [47.207 us 47.572 us 47.964 us] | |
| change: [+5.2103% +5.6746% +6.0177%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 18 outliers among 100 measurements (18.00%) | |
| 12 (12.00%) low severe | |
| 1 (1.00%) low mild | |
| 2 (2.00%) high mild | |
| 3 (3.00%) high severe |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| verify_multi_aggregate/verify_multi_aggregate/8 | |
| time: [1.9787 ms 2.0341 ms 2.0879 ms] | |
| change: [+6.5649% +9.7840% +13.428%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| verify_multi_aggregate/verify_multi_aggregate/16 | |
| time: [2.8055 ms 2.8139 ms 2.8210 ms] | |
| change: [+4.1043% +5.2577% +6.4639%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 15 outliers among 100 measurements (15.00%) | |
| 8 (8.00%) low severe | |
| 2 (2.00%) low mild | |
| 4 (4.00%) high mild | |
| 1 (1.00%) high severe | |
| verify_multi_aggregate/verify_multi_aggregate/32 | |
| time: [2.3305 ms 2.3530 ms 2.3733 ms] | |
| change: [-4.3348% -3.2625% -2.2718%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 3 (3.00%) low severe | |
| 3 (3.00%) low mild | |
| 1 (1.00%) high mild | |
| verify_multi_aggregate/verify_multi_aggregate/64 | |
| time: [2.8245 ms 2.8812 ms 2.9429 ms] | |
| change: [-6.4405% -3.0362% +0.5557%] (p = 0.09 > 0.05) | |
| No change in performance detected. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 6 (6.00%) high mild | |
| 3 (3.00%) high severe | |
| verify_multi_aggregate/verify_multi_aggregate/128 | |
| time: [4.0228 ms 4.0344 ms 4.0471 ms] | |
| change: [-0.2630% +0.2164% +0.7157%] (p = 0.37 > 0.05) | |
| No change in performance detected. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 6 (6.00%) high mild | |
| 1 (1.00%) high severe | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify/8: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 6.1s, enable flat sampling, or reduce sample count to 60. | |
| fast_aggregate_verify/fast_aggregate_verify/8 | |
| time: [1.1316 ms 1.1569 ms 1.1786 ms] | |
| change: [-4.8577% -2.4883% +0.1121%] (p = 0.06 > 0.05) | |
| No change in performance detected. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 7 (7.00%) low mild | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify_preagg/8: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.1s, enable flat sampling, or reduce sample count to 70. | |
| fast_aggregate_verify/fast_aggregate_verify_preagg/8 | |
| time: [1.0841 ms 1.1164 ms 1.1436 ms] | |
| change: [-15.448% -12.969% -10.450%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 15 outliers among 100 measurements (15.00%) | |
| 15 (15.00%) low mild | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify/16: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.3s, enable flat sampling, or reduce sample count to 60. | |
| fast_aggregate_verify/fast_aggregate_verify/16 | |
| time: [977.13 us 1.0075 ms 1.0374 ms] | |
| change: [-14.811% -11.547% -8.2564%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify_preagg/16: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.9s, enable flat sampling, or reduce sample count to 60. | |
| fast_aggregate_verify/fast_aggregate_verify_preagg/16 | |
| time: [1.1317 ms 1.1682 ms 1.2015 ms] | |
| change: [-2.5473% -0.6898% +1.0767%] (p = 0.44 > 0.05) | |
| No change in performance detected. | |
| Found 16 outliers among 100 measurements (16.00%) | |
| 13 (13.00%) low severe | |
| 2 (2.00%) low mild | |
| 1 (1.00%) high mild | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify/32: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.1s, enable flat sampling, or reduce sample count to 60. | |
| fast_aggregate_verify/fast_aggregate_verify/32 | |
| time: [888.43 us 927.71 us 966.14 us] | |
| change: [-26.693% -24.399% -21.705%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify_preagg/32: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.4s, enable flat sampling, or reduce sample count to 60. | |
| fast_aggregate_verify/fast_aggregate_verify_preagg/32 | |
| time: [873.31 us 908.80 us 945.19 us] | |
| change: [-20.556% -17.652% -14.574%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| fast_aggregate_verify/fast_aggregate_verify/64 | |
| time: [1.1163 ms 1.1561 ms 1.1907 ms] | |
| change: [-9.0101% -5.7490% -2.2667%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify_preagg/64: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.0s, enable flat sampling, or reduce sample count to 70. | |
| fast_aggregate_verify/fast_aggregate_verify_preagg/64 | |
| time: [1.0750 ms 1.1027 ms 1.1287 ms] | |
| change: [+0.4382% +2.8136% +5.4171%] (p = 0.03 < 0.05) | |
| Change within noise threshold. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 6 (6.00%) low mild | |
| 1 (1.00%) high mild | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify/128: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.3s, enable flat sampling, or reduce sample count to 60. | |
| fast_aggregate_verify/fast_aggregate_verify/128 | |
| time: [1.0707 ms 1.1121 ms 1.1516 ms] | |
| change: [-9.4671% -6.4050% -2.8334%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Benchmarking fast_aggregate_verify/fast_aggregate_verify_preagg/128: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.9s, enable flat sampling, or reduce sample count to 60. | |
| fast_aggregate_verify/fast_aggregate_verify_preagg/128 | |
| time: [1.1797 ms 1.1891 ms 1.1996 ms] | |
| change: [+4.8182% +7.4420% +10.152%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 12 outliers among 100 measurements (12.00%) | |
| 3 (3.00%) low severe | |
| 7 (7.00%) high mild | |
| 2 (2.00%) high severe | |
| Benchmarking aggregate_verify/aggregate_verify/8: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 7.3s, enable flat sampling, or reduce sample count to 50. | |
| aggregate_verify/aggregate_verify/8 | |
| time: [1.4616 ms 1.4988 ms 1.5320 ms] | |
| change: [+2.9186% +6.0136% +9.4754%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Benchmarking aggregate_verify/aggregate_verify/16: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 9.5s, enable flat sampling, or reduce sample count to 50. | |
| aggregate_verify/aggregate_verify/16 | |
| time: [1.9570 ms 1.9716 ms 1.9850 ms] | |
| change: [+0.6134% +1.8335% +3.1751%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) low mild | |
| Benchmarking aggregate_verify/aggregate_verify/32: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 9.0s, enable flat sampling, or reduce sample count to 50. | |
| aggregate_verify/aggregate_verify/32 | |
| time: [1.8249 ms 1.8610 ms 1.8972 ms] | |
| change: [-5.7415% -3.6219% -1.2816%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 4 (4.00%) low mild | |
| aggregate_verify/aggregate_verify/64 | |
| time: [2.5056 ms 2.5591 ms 2.6128 ms] | |
| change: [-10.684% -8.2907% -5.9654%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| aggregate_verify/aggregate_verify/128 | |
| time: [3.1438 ms 3.1695 ms 3.2009 ms] | |
| change: [+1.7675% +2.7502% +3.8194%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 2 (2.00%) high mild | |
| 4 (4.00%) high severe | |
| aggregate/aggregate_signature/10 | |
| time: [9.3946 us 9.3970 us 9.3999 us] | |
| change: [-0.6983% -0.6493% -0.5993%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) high mild | |
| aggregate/aggregate_public_key/10 | |
| time: [3.6629 us 3.6903 us 3.7177 us] | |
| change: [-3.4436% -3.1199% -2.7527%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 10 (10.00%) high severe | |
| aggregate/aggregate_signature/50 | |
| time: [48.377 us 48.393 us 48.412 us] | |
| change: [+0.8613% +0.9255% +0.9871%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 1 (1.00%) high mild | |
| 1 (1.00%) high severe | |
| aggregate/aggregate_public_key/50 | |
| time: [19.633 us 19.641 us 19.650 us] | |
| change: [-2.7512% -2.5934% -2.4554%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 2 (2.00%) high mild | |
| aggregate/aggregate_signature/100 | |
| time: [101.81 us 101.84 us 101.87 us] | |
| change: [+1.4296% +1.4855% +1.5332%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high mild | |
| aggregate/aggregate_public_key/100 | |
| time: [41.719 us 41.752 us 41.785 us] | |
| change: [+1.9676% +2.0325% +2.1072%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 3 (3.00%) high mild | |
| 1 (1.00%) high severe | |
| aggregate/aggregate_signature/300 | |
| time: [310.38 us 310.49 us 310.59 us] | |
| change: [+3.0648% +3.1124% +3.1577%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 1 (1.00%) low severe | |
| 4 (4.00%) low mild | |
| 1 (1.00%) high mild | |
| 1 (1.00%) high severe | |
| aggregate/aggregate_public_key/300 | |
| time: [122.78 us 122.88 us 122.98 us] | |
| change: [-2.4409% -2.3304% -2.2208%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 2 outliers among 100 measurements (2.00%) | |
| 1 (1.00%) high mild | |
| 1 (1.00%) high severe | |
| Benchmarking aggregate/aggregate_signature/1000: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.2s, enable flat sampling, or reduce sample count to 60. | |
| aggregate/aggregate_signature/1000 | |
| time: [1.0264 ms 1.0267 ms 1.0270 ms] | |
| change: [-0.3514% -0.2101% -0.1023%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Found 5 outliers among 100 measurements (5.00%) | |
| 3 (3.00%) high mild | |
| 2 (2.00%) high severe | |
| aggregate/aggregate_public_key/1000 | |
| time: [410.46 us 410.72 us 410.98 us] | |
| change: [-2.2399% -2.1694% -2.0989%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high severe | |
| aggregate/aggregate_signature/4000 | |
| time: [4.1409 ms 4.1419 ms 4.1430 ms] | |
| change: [+0.0157% +0.0889% +0.1493%] (p = 0.01 < 0.05) | |
| Change within noise threshold. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 1 (1.00%) low mild | |
| 2 (2.00%) high mild | |
| Benchmarking aggregate/aggregate_public_key/4000: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 8.4s, enable flat sampling, or reduce sample count to 50. | |
| aggregate/aggregate_public_key/4000 | |
| time: [1.6592 ms 1.6655 ms 1.6718 ms] | |
| change: [-1.7378% -1.5677% -1.3699%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 10 (10.00%) high severe | |
| single_message/sign time: [284.98 us 285.05 us 285.14 us] | |
| change: [+2.6270% +2.6723% +2.7156%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 1 (1.00%) low mild | |
| 6 (6.00%) high mild | |
| 3 (3.00%) high severe | |
| Benchmarking single_message/verify: Warming up for 3.0000 s | |
| Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 6.1s, enable flat sampling, or reduce sample count to 60. | |
| single_message/verify time: [1.2240 ms 1.2315 ms 1.2372 ms] | |
| change: [+7.0782% +9.5580% +12.274%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 11 outliers among 100 measurements (11.00%) | |
| 3 (3.00%) low severe | |
| 2 (2.00%) high mild | |
| 6 (6.00%) high severe | |
| serdes/secret_key_serialize | |
| time: [29.022 ns 29.104 ns 29.195 ns] | |
| change: [-7.1417% -6.8956% -6.6142%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 6 (6.00%) high mild | |
| 1 (1.00%) high severe | |
| serdes/secret_key_deserialize | |
| time: [75.122 ns 75.330 ns 75.507 ns] | |
| change: [+7.5551% +8.2749% +9.0250%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 7 outliers among 100 measurements (7.00%) | |
| 1 (1.00%) low severe | |
| 3 (3.00%) low mild | |
| 3 (3.00%) high mild | |
| serdes/public_key_serialize | |
| time: [86.816 ns 87.061 ns 87.313 ns] | |
| change: [+4.8876% +5.1336% +5.3707%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| serdes/public_key_compress | |
| time: [58.777 ns 59.296 ns 59.826 ns] | |
| change: [-2.0574% -0.8820% +0.6150%] (p = 0.26 > 0.05) | |
| No change in performance detected. | |
| Found 15 outliers among 100 measurements (15.00%) | |
| 7 (7.00%) low severe | |
| 3 (3.00%) low mild | |
| 2 (2.00%) high mild | |
| 3 (3.00%) high severe | |
| serdes/public_key_uncompress | |
| time: [11.608 us 11.611 us 11.614 us] | |
| change: [+0.3288% +0.3733% +0.4213%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 1 (1.00%) low mild | |
| 4 (4.00%) high mild | |
| 4 (4.00%) high severe | |
| serdes/public_key_deserialize | |
| time: [212.74 ns 213.34 ns 214.08 ns] | |
| change: [-1.1616% -0.6115% -0.0962%] (p = 0.03 < 0.05) | |
| Change within noise threshold. | |
| serdes/signature_serialize | |
| time: [164.16 ns 164.36 ns 164.56 ns] | |
| change: [-0.2569% -0.0589% +0.1372%] (p = 0.57 > 0.05) | |
| No change in performance detected. | |
| Found 3 outliers among 100 measurements (3.00%) | |
| 3 (3.00%) high severe | |
| serdes/signature_compress | |
| time: [113.45 ns 113.54 ns 113.64 ns] | |
| change: [-2.7172% -2.5645% -2.4273%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 9 outliers among 100 measurements (9.00%) | |
| 8 (8.00%) high mild | |
| 1 (1.00%) high severe | |
| serdes/signature_uncompress | |
| time: [22.946 us 22.949 us 22.953 us] | |
| change: [-1.2966% -1.2507% -1.2125%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 6 outliers among 100 measurements (6.00%) | |
| 1 (1.00%) low mild | |
| 3 (3.00%) high mild | |
| 2 (2.00%) high severe | |
| serdes/signature_deserialize | |
| time: [456.41 ns 456.68 ns 456.97 ns] | |
| change: [+0.2845% +0.4182% +0.5407%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Found 8 outliers among 100 measurements (8.00%) | |
| 1 (1.00%) low severe | |
| 2 (2.00%) low mild | |
| 5 (5.00%) high mild | |
| serdes/p1_serialize time: [2.0488 us 2.0493 us 2.0499 us] | |
| change: [-0.0535% +0.0855% +0.2879%] (p = 0.35 > 0.05) | |
| No change in performance detected. | |
| Found 10 outliers among 100 measurements (10.00%) | |
| 7 (7.00%) high mild | |
| 3 (3.00%) high severe | |
| serdes/p1_compress time: [2.0230 us 2.0236 us 2.0243 us] | |
| change: [+0.2073% +0.2519% +0.3000%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Found 15 outliers among 100 measurements (15.00%) | |
| 6 (6.00%) high mild | |
| 9 (9.00%) high severe | |
| serdes/p2_serialize time: [2.3743 us 2.3749 us 2.3755 us] | |
| change: [+0.4431% +0.5038% +0.5520%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Found 11 outliers among 100 measurements (11.00%) | |
| 1 (1.00%) low mild | |
| 6 (6.00%) high mild | |
| 4 (4.00%) high severe | |
| serdes/p2_compress time: [2.2548 us 2.2554 us 2.2559 us] | |
| change: [-2.0912% -2.0566% -2.0208%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 11 outliers among 100 measurements (11.00%) | |
| 3 (3.00%) low mild | |
| 5 (5.00%) high mild | |
| 3 (3.00%) high severe | |
| keys/key_gen time: [1.3830 us 1.3836 us 1.3842 us] | |
| change: [+132.98% +133.19% +133.41%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Found 4 outliers among 100 measurements (4.00%) | |
| 3 (3.00%) high mild | |
| 1 (1.00%) high severe | |
| keys/sk_to_pk time: [77.644 us 77.681 us 77.721 us] | |
| change: [-3.2452% -2.5073% -2.0392%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Found 1 outliers among 100 measurements (1.00%) | |
| 1 (1.00%) high mild | |
| keys/key_validate time: [48.103 us 48.139 us 48.174 us] | |
| change: [+0.3341% +0.4092% +0.4887%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Found 26 outliers among 100 measurements (26.00%) | |
| 20 (20.00%) low severe | |
| 3 (3.00%) low mild | |
| 3 (3.00%) high severe |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment