bench.log

huitseeker@tencendur➜~/tmp/arecibo(feature/test-ipa✗)» cargo bench --bench pcs

                                                                         [15:27
:34]
   Compiling arecibo v0.2.0 (/home/huitseeker/tmp/arecibo)
    Finished bench [optimized] target(s) in 10.12s
     Running benches/pcs.rs (target/release/deps/pcs-c5d0ce116b326947)
Gnuplot not found, using plotters backend
PCS-Proving/IPA/10      time:   [58.279 ms 59.291 ms 60.424 ms]
                        change: [-3.7736% -1.4270% +1.0021%] (p = 0.29 > 0.05)
                        No change in performance detected.
PCS-Proving/MLKZG/10    time:   [7.5702 ms 7.6185 ms 7.6665 ms]
                        change: [-0.8835% +0.0447% +0.9414%] (p = 0.93 > 0.05)
                        No change in performance detected.
PCS-Proving/ZM/10       time:   [6.1236 ms 6.1535 ms 6.1872 ms]
                        change: [-0.8720% -0.2252% +0.4917%] (p = 0.54 > 0.05)
                        No change in performance detected.

PCS-Verifying/IPA/10    time:   [4.6494 ms 4.6879 ms 4.7299 ms]
                        change: [-1.5711% +0.2366% +2.1018%] (p = 0.81 > 0.05)
                        No change in performance detected.
Found 1 outliers among 10 measurements (10.00%)
  1 (10.00%) high mild
PCS-Verifying/MLKZG/10  time:   [2.7685 ms 2.7877 ms 2.8080 ms]
                        change: [-1.8388% -1.1388% -0.3822%] (p = 0.01 < 0.05)
                        Change within noise threshold.
PCS-Verifying/ZM/10     time:   [4.0193 ms 4.4207 ms 4.8324 ms]
                        change: [-22.110% -14.514% -5.8738%] (p = 0.01 < 0.05)
                        Performance has improved.

Benchmarking PCS-Proving/IPA/11: Collecting 10 samples in estimated 5.0517 s (5
0
PCS-Proving/IPA/11      time:   [99.639 ms 101.24 ms 102.93 ms]
                        change: [-2.4006% -0.1452% +2.2694%] (p = 0.91 > 0.05)
                        No change in performance detected.
PCS-Proving/MLKZG/11    time:   [11.295 ms 11.374 ms 11.464 ms]
                        change: [-1.2541% -0.2608% +0.7454%] (p = 0.63 > 0.05)
                        No change in performance detected.
PCS-Proving/ZM/11       time:   [9.6267 ms 9.6554 ms 9.6998 ms]
                        change: [-0.9892% -0.4966% +0.0730%] (p = 0.11 > 0.05)
                        No change in performance detected.
Found 1 outliers among 10 measurements (10.00%)
  1 (10.00%) high severe

PCS-Verifying/IPA/11    time:   [5.7756 ms 5.8183 ms 5.8766 ms]
                        change: [-0.2018% +0.8006% +1.9476%] (p = 0.20 > 0.05)
                        No change in performance detected.
Found 1 outliers among 10 measurements (10.00%)
  1 (10.00%) high severe
PCS-Verifying/MLKZG/11  time:   [5.8087 ms 6.1305 ms 6.4335 ms]
                        change: [-9.8852% -3.0559% +3.7174%] (p = 0.42 > 0.05)
                        No change in performance detected.
PCS-Verifying/ZM/11     time:   [4.9499 ms 5.1734 ms 5.4225 ms]
                        change: [-6.4949% -0.3197% +6.8598%] (p = 0.93 > 0.05)
                        No change in performance detected.

PCS-Proving/IPA/12      time:   [177.92 ms 180.99 ms 183.97 ms]
                        change: [-5.5683% -2.5603% +0.3978%] (p = 0.14 > 0.05)
                        No change in performance detected.
PCS-Proving/MLKZG/12    time:   [18.688 ms 18.734 ms 18.774 ms]
                        change: [-0.2325% +0.2314% +0.7687%] (p = 0.42 > 0.05)
                        No change in performance detected.
Found 2 outliers among 10 measurements (20.00%)
  2 (20.00%) low mild
PCS-Proving/ZM/12       time:   [15.226 ms 15.549 ms 15.888 ms]
                        change: [+0.3959% +2.5444% +4.7543%] (p = 0.05 < 0.05)
                        Change within noise threshold.

PCS-Verifying/IPA/12    time:   [8.2318 ms 8.3656 ms 8.4897 ms]
                        change: [-2.1589% -0.0383% +1.8509%] (p = 0.97 > 0.05)
                        No change in performance detected.
Found 1 outliers among 10 measurements (10.00%)
  1 (10.00%) low mild
PCS-Verifying/MLKZG/12  time:   [5.7435 ms 6.0537 ms 6.3962 ms]
                        change: [-12.159% -6.1017% +0.4142%] (p = 0.10 > 0.05)
                        No change in performance detected.
Found 1 outliers among 10 measurements (10.00%)
  1 (10.00%) high mild
PCS-Verifying/ZM/12     time:   [4.7694 ms 5.0559 ms 5.3775 ms]
                        change: [-7.3093% +0.7098% +10.255%] (p = 0.88 > 0.05)
                        No change in performance detected.

Benchmarking PCS-Proving/IPA/23: Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target
 time to 2840.5s.
Benchmarking PCS-Proving/IPA/23: Collecting 10 samples in estimated 2840.5 s (1
0
PCS-Proving/IPA/23      time:   [283.39 s 284.03 s 285.01 s]
                        change: [-0.4098% -0.0841% +0.2583%] (p = 0.69 > 0.05)
                        No change in performance detected.
Found 1 outliers among 10 measurements (10.00%)
  1 (10.00%) high severe
Benchmarking PCS-Proving/MLKZG/23: Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target
 time to 246.8s.
Benchmarking PCS-Proving/MLKZG/23: Collecting 10 samples in estimated 246.77 s
(
PCS-Proving/MLKZG/23    time:   [24.318 s 24.475 s 24.641 s]
                        change: [-1.6669% -0.5120% +0.5105%] (p = 0.40 > 0.05)
                        No change in performance detected.
Benchmarking PCS-Proving/ZM/23: Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target
 time to 169.1s.
Benchmarking PCS-Proving/ZM/23: Collecting 10 samples in estimated 169.09 s (10

PCS-Proving/ZM/23       time:   [17.348 s 17.467 s 17.587 s]
                        change: [+0.3071% +1.1534% +2.0033%] (p = 0.02 < 0.05)
                        Change within noise threshold.

Benchmarking PCS-Verifying/IPA/23: Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target
 time to 71.7s.
Benchmarking PCS-Verifying/IPA/23: Collecting 10 samples in estimated 71.728 s
(
PCS-Verifying/IPA/23    time:   [6.9513 s 7.0201 s 7.1090 s]
                        change: [-2.4634% -0.7279% +1.1347%] (p = 0.45 > 0.05)
                        No change in performance detected.
Found 1 outliers among 10 measurements (10.00%)
  1 (10.00%) high mild
Benchmarking PCS-Verifying/MLKZG/23: Collecting 10 samples in estimated 5.0442
s
PCS-Verifying/MLKZG/23  time:   [6.1646 ms 6.4629 ms 6.7138 ms]
                        change: [-9.4976% -2.9045% +3.8149%] (p = 0.45 > 0.05)
                        No change in performance detected.
Found 1 outliers among 10 measurements (10.00%)
  1 (10.00%) low mild
Benchmarking PCS-Verifying/ZM/23: Collecting 10 samples in estimated 5.0446 s (
8
PCS-Verifying/ZM/23     time:   [5.2256 ms 5.6290 ms 5.9975 ms]
                        change: [-8.6489% +0.0962% +9.2266%] (p = 0.99 > 0.05)
                        No change in performance detected.
Found 1 outliers among 10 measurements (10.00%)
  1 (10.00%) low mild

Benchmarking PCS-Proving/IPA/14: Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target
 time to 6.2s.
Benchmarking PCS-Proving/IPA/14: Collecting 10 samples in estimated 6.2016 s (1
0
PCS-Proving/IPA/14      time:   [606.92 ms 615.99 ms 624.57 ms]
                        change: [-1.9606% +0.1276% +2.0548%] (p = 0.91 > 0.05)
                        No change in performance detected.
Benchmarking PCS-Proving/MLKZG/14: Collecting 10 samples in estimated 5.4632 s
(
PCS-Proving/MLKZG/14    time:   [54.140 ms 54.400 ms 54.667 ms]
                        change: [-1.2585% -0.4965% +0.3636%] (p = 0.26 > 0.05)
                        No change in performance detected.
Found 2 outliers among 10 measurements (20.00%)
  1 (10.00%) low mild
  1 (10.00%) high mild
Benchmarking PCS-Proving/ZM/14: Collecting 10 samples in estimated 5.2712 s (11
0
PCS-Proving/ZM/14       time:   [46.402 ms 47.388 ms 48.320 ms]
                        change: [-3.4702% -0.5953% +2.4086%] (p = 0.71 > 0.05)
                        No change in performance detected.

Benchmarking PCS-Verifying/IPA/14: Collecting 10 samples in estimated 5.1591 s
(
PCS-Verifying/IPA/14    time:   [15.775 ms 16.093 ms 16.432 ms]
                        change: [-6.1188% -2.7209% +0.3869%] (p = 0.15 > 0.05)
                        No change in performance detected.
Found 2 outliers among 10 measurements (20.00%)
  1 (10.00%) low mild
  1 (10.00%) high mild
Benchmarking PCS-Verifying/MLKZG/14: Collecting 10 samples in estimated 5.0034
s
PCS-Verifying/MLKZG/14  time:   [5.2102 ms 5.6077 ms 5.9833 ms]
                        change: [-14.859% -7.4971% +0.1669%] (p = 0.10 > 0.05)
                        No change in performance detected.
Benchmarking PCS-Verifying/ZM/14: Collecting 10 samples in estimated 5.0250 s (
1
PCS-Verifying/ZM/14     time:   [4.5818 ms 4.8993 ms 5.1740 ms]
                        change: [+0.3143% +9.0626% +18.019%] (p = 0.07 > 0.05)
                        No change in performance detected.
Found 2 outliers among 10 measurements (20.00%)
  2 (20.00%) low mild

Benchmarking PCS-Proving/IPA/15: Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target
 time to 12.0s.
Benchmarking PCS-Proving/IPA/15: Collecting 10 samples in estimated 11.993 s (1
0
PCS-Proving/IPA/15      time:   [1.1925 s 1.2053 s 1.2186 s]
                        change: [-1.4758% -0.0595% +1.2243%] (p = 0.94 > 0.05)
                        No change in performance detected.
Benchmarking PCS-Proving/MLKZG/15: Collecting 10 samples in estimated 5.2137 s
(
PCS-Proving/MLKZG/15    time:   [101.70 ms 102.69 ms 103.74 ms]
                        change: [-1.4796% -0.2203% +1.0621%] (p = 0.75 > 0.05)
                        No change in performance detected.
Benchmarking PCS-Proving/ZM/15: Collecting 10 samples in estimated 5.2628 s (60

PCS-Proving/ZM/15       time:   [81.610 ms 83.858 ms 86.485 ms]
                        change: [-3.0665% +0.7777% +5.0812%] (p = 0.73 > 0.05)
                        No change in performance detected.
Found 1 outliers among 10 measurements (10.00%)
  1 (10.00%) high mild

Benchmarking PCS-Verifying/IPA/15: Collecting 10 samples in estimated 5.3239 s
(
PCS-Verifying/IPA/15    time:   [32.377 ms 32.815 ms 33.377 ms]
                        change: [-4.7188% -2.3657% +0.1629%] (p = 0.10 > 0.05)
                        No change in performance detected.
Found 1 outliers among 10 measurements (10.00%)
  1 (10.00%) high mild
Benchmarking PCS-Verifying/MLKZG/15: Collecting 10 samples in estimated 5.0085
s
PCS-Verifying/MLKZG/15  time:   [5.6042 ms 5.8590 ms 6.1627 ms]
                        change: [+0.8692% +7.6553% +15.193%] (p = 0.05 < 0.05)
                        Change within noise threshold.
Found 1 outliers among 10 measurements (10.00%)
  1 (10.00%) high mild
Benchmarking PCS-Verifying/ZM/15: Collecting 10 samples in estimated 5.0225 s (
1
PCS-Verifying/ZM/15     time:   [4.5676 ms 4.8043 ms 5.0192 ms]
                        change: [-3.7501% +2.5661% +8.7765%] (p = 0.46 > 0.05)
                        No change in performance detected.
Found 1 outliers among 10 measurements (10.00%)
  1 (10.00%) low mild

Benchmarking PCS-Proving/IPA/16: Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target
 time to 24.1s.
Benchmarking PCS-Proving/IPA/16: Collecting 10 samples in estimated 24.052 s (1
0
PCS-Proving/IPA/16      time:   [2.3002 s 2.3154 s 2.3328 s]
                        change: [-1.6207% -0.5849% +0.4557%] (p = 0.31 > 0.05)
                        No change in performance detected.
Benchmarking PCS-Proving/MLKZG/16: Collecting 10 samples in estimated 5.5504 s
(
PCS-Proving/MLKZG/16    time:   [182.11 ms 186.14 ms 189.90 ms]
                        change: [-2.3631% +0.2790% +2.7575%] (p = 0.85 > 0.05)
                        No change in performance detected.
Benchmarking PCS-Proving/ZM/16: Collecting 10 samples in estimated 5.0071 s (30

PCS-Proving/ZM/16       time:   [156.95 ms 164.62 ms 172.05 ms]
                        change: [-8.9265% -3.4114% +2.4351%] (p = 0.28 > 0.05)
                        No change in performance detected.

Benchmarking PCS-Verifying/IPA/16: Collecting 10 samples in estimated 5.2659 s
(
PCS-Verifying/IPA/16    time:   [51.456 ms 51.815 ms 52.181 ms]
                        change: [-2.0232% -0.8839% +0.1595%] (p = 0.16 > 0.05)
                        No change in performance detected.
Benchmarking PCS-Verifying/MLKZG/16: Collecting 10 samples in estimated 5.0371
s
PCS-Verifying/MLKZG/16  time:   [5.3963 ms 5.5997 ms 5.8080 ms]
                        change: [+7.5594% +12.051% +16.869%] (p = 0.00 < 0.05)
                        Performance has regressed.
Benchmarking PCS-Verifying/ZM/16: Collecting 10 samples in estimated 5.0452 s (
1
PCS-Verifying/ZM/16     time:   [4.7452 ms 5.2263 ms 5.7212 ms]
                        change: [-3.1824% +8.4221% +20.748%] (p = 0.19 > 0.05)
                        No change in performance detected.

Benchmarking PCS-Proving/IPA/17: Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target
 time to 47.0s.
Benchmarking PCS-Proving/IPA/17: Collecting 10 samples in estimated 46.967 s (1
0
PCS-Proving/IPA/17      time:   [4.5098 s 4.5304 s 4.5494 s]
                        change: [-0.7854% -0.1584% +0.4279%] (p = 0.63 > 0.05)
                        No change in performance detected.
Benchmarking PCS-Proving/MLKZG/17: Collecting 10 samples in estimated 7.1219 s
(
PCS-Proving/MLKZG/17    time:   [344.49 ms 352.99 ms 361.44 ms]
                        change: [-3.5977% +0.0233% +3.7046%] (p = 0.99 > 0.05)
                        No change in performance detected.
Benchmarking PCS-Proving/ZM/17: Collecting 10 samples in estimated 5.5670 s (20

PCS-Proving/ZM/17       time:   [268.40 ms 283.17 ms 297.54 ms]
                        change: [-10.796% -5.3921% -0.1922%] (p = 0.08 > 0.05)
                        No change in performance detected.

Benchmarking PCS-Verifying/IPA/17: Collecting 10 samples in estimated 5.8736 s
(
PCS-Verifying/IPA/17    time:   [94.272 ms 96.446 ms 98.893 ms]
                        change: [-3.3064% +0.3830% +4.0417%] (p = 0.86 > 0.05)
                        No change in performance detected.
Benchmarking PCS-Verifying/MLKZG/17: Collecting 10 samples in estimated 5.0353
s
PCS-Verifying/MLKZG/17  time:   [5.2598 ms 5.5524 ms 5.8020 ms]
                        change: [-6.7668% +0.0966% +7.6042%] (p = 0.98 > 0.05)
                        No change in performance detected.
Found 1 outliers among 10 measurements (10.00%)
  1 (10.00%) low mild
Benchmarking PCS-Verifying/ZM/17: Collecting 10 samples in estimated 5.0403 s (
8
PCS-Verifying/ZM/17     time:   [6.1967 ms 6.3733 ms 6.5826 ms]
                        change: [-2.2585% +2.0441% +7.4352%] (p = 0.47 > 0.05)
                        No change in performance detected.
Found 2 outliers among 10 measurements (20.00%)
  1 (10.00%) low mild
  1 (10.00%) high severe

Benchmarking PCS-Proving/IPA/18: Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target
 time to 88.5s.
Benchmarking PCS-Proving/IPA/18: Collecting 10 samples in estimated 88.486 s (1
0
PCS-Proving/IPA/18      time:   [8.8961 s 8.9586 s 9.0386 s]
                        change: [-0.6634% +0.3827% +1.4725%] (p = 0.52 > 0.05)
                        No change in performance detected.
Found 3 outliers among 10 measurements (30.00%)
  1 (10.00%) low severe
  1 (10.00%) low mild
  1 (10.00%) high severe
Benchmarking PCS-Proving/MLKZG/18: Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target
 time to 7.3s.
Benchmarking PCS-Proving/MLKZG/18: Collecting 10 samples in estimated 7.3134 s
(
PCS-Proving/MLKZG/18    time:   [689.99 ms 708.15 ms 724.49 ms]
                        change: [-3.9986% +0.9150% +5.7232%] (p = 0.72 > 0.05)
                        No change in performance detected.
Benchmarking PCS-Proving/ZM/18: Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target
 time to 5.1s.
Benchmarking PCS-Proving/ZM/18: Collecting 10 samples in estimated 5.1411 s (10

PCS-Proving/ZM/18       time:   [510.74 ms 531.64 ms 553.04 ms]
                        change: [-4.9424% +0.2409% +5.7019%] (p = 0.93 > 0.05)
                        No change in performance detected.

Benchmarking PCS-Verifying/IPA/18: Collecting 10 samples in estimated 5.2148 s
(
PCS-Verifying/IPA/18    time:   [180.27 ms 192.45 ms 204.99 ms]
                        change: [+7.3554% +14.750% +22.476%] (p = 0.00 < 0.05)
                        Performance has regressed.
Benchmarking PCS-Verifying/MLKZG/18: Collecting 10 samples in estimated 5.0039
s
PCS-Verifying/MLKZG/18  time:   [5.0049 ms 5.2348 ms 5.4669 ms]
                        change: [-11.113% -5.2824% +0.6995%] (p = 0.13 > 0.05)
                        No change in performance detected.
Benchmarking PCS-Verifying/ZM/18: Collecting 10 samples in estimated 5.0387 s (
8
PCS-Verifying/ZM/18     time:   [6.2932 ms 6.4910 ms 6.6892 ms]
                        change: [-2.9438% +1.5420% +6.7234%] (p = 0.57 > 0.05)
                        No change in performance detected.

Benchmarking PCS-Proving/IPA/19: Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target
 time to 186.4s.
Benchmarking PCS-Proving/IPA/19: Collecting 10 samples in estimated 186.40 s (1
0
PCS-Proving/IPA/19      time:   [18.372 s 18.467 s 18.560 s]
                        change: [-0.3415% +0.3160% +0.9465%] (p = 0.37 > 0.05)
                        No change in performance detected.
Benchmarking PCS-Proving/MLKZG/19: Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target
 time to 15.1s.
Benchmarking PCS-Proving/MLKZG/19: Collecting 10 samples in estimated 15.071 s
(
PCS-Proving/MLKZG/19    time:   [1.5051 s 1.5438 s 1.5873 s]
                        change: [+0.4340% +3.3048% +6.7527%] (p = 0.05 < 0.05)
                        Change within noise threshold.
Found 3 outliers among 10 measurements (30.00%)
  1 (10.00%) low mild
  2 (20.00%) high mild
Benchmarking PCS-Proving/ZM/19: Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target
 time to 9.5s.
Benchmarking PCS-Proving/ZM/19: Collecting 10 samples in estimated 9.5350 s (10

PCS-Proving/ZM/19       time:   [868.95 ms 895.27 ms 921.91 ms]
                        change: [-8.0991% -4.5608% -0.8280%] (p = 0.04 < 0.05)
                        Change within noise threshold.

Benchmarking PCS-Verifying/IPA/19: Collecting 10 samples in estimated 8.0566 s
(
PCS-Verifying/IPA/19    time:   [401.40 ms 407.80 ms 414.74 ms]
                        change: [-0.5929% +1.2248% +3.2412%] (p = 0.26 > 0.05)
                        No change in performance detected.
Benchmarking PCS-Verifying/MLKZG/19: Collecting 10 samples in estimated 5.0315
s
PCS-Verifying/MLKZG/19  time:   [5.1721 ms 5.3349 ms 5.4828 ms]
                        change: [-12.935% -5.3822% +2.0433%] (p = 0.24 > 0.05)
                        No change in performance detected.
Benchmarking PCS-Verifying/ZM/19: Collecting 10 samples in estimated 5.0278 s (
1
PCS-Verifying/ZM/19     time:   [5.2853 ms 5.7207 ms 6.1688 ms]
                        change: [-16.373% -8.5949% -0.2893%] (p = 0.07 > 0.05)
                        No change in performance detected.

Benchmarking PCS-Proving/IPA/20: Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target
 time to 360.4s.
Benchmarking PCS-Proving/IPA/20: Collecting 10 samples in estimated 360.40 s (1
0
PCS-Proving/IPA/20      time:   [35.655 s 35.785 s 35.911 s]
                        change: [-1.3245% -0.2153% +0.6623%] (p = 0.72 > 0.05)
                        No change in performance detected.
Benchmarking PCS-Proving/MLKZG/20: Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target
 time to 26.0s.
Benchmarking PCS-Proving/MLKZG/20: Collecting 10 samples in estimated 26.043 s
(
PCS-Proving/MLKZG/20    time:   [2.6043 s 2.6325 s 2.6577 s]
                        change: [-0.6641% +0.8832% +2.5095%] (p = 0.31 > 0.05)
                        No change in performance detected.
Benchmarking PCS-Proving/ZM/20: Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target
 time to 19.9s.
Benchmarking PCS-Proving/ZM/20: Collecting 10 samples in estimated 19.907 s (10

PCS-Proving/ZM/20       time:   [2.0363 s 2.0570 s 2.0789 s]
                        change: [-0.6482% +1.8009% +4.1801%] (p = 0.18 > 0.05)
                        No change in performance detected.

Benchmarking PCS-Verifying/IPA/20: Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target
 time to 6.7s.
Benchmarking PCS-Verifying/IPA/20: Collecting 10 samples in estimated 6.7070 s
(
PCS-Verifying/IPA/20    time:   [612.01 ms 634.31 ms 658.39 ms]
                        change: [-7.9084% -3.9913% -0.1126%] (p = 0.08 > 0.05)
                        No change in performance detected.
Benchmarking PCS-Verifying/MLKZG/20: Collecting 10 samples in estimated 5.0410
s
PCS-Verifying/MLKZG/20  time:   [6.9722 ms 7.2530 ms 7.5271 ms]
                        change: [-4.7932% +0.6828% +5.9426%] (p = 0.81 > 0.05)
                        No change in performance detected.
Benchmarking PCS-Verifying/ZM/20: Collecting 10 samples in estimated 5.0566 s (
8
PCS-Verifying/ZM/20     time:   [5.8055 ms 6.0622 ms 6.3250 ms]
                        change: [+0.0951% +9.4845% +21.713%] (p = 0.09 > 0.05)
                        No change in performance detected.