reed-solomon-simd vs novelpoly (https://github.com/paritytech/erasure-coding)

no-simd.txt

     Running benches/all.rs (target/release/deps/all-5e047026dbe59c3d)
construct/131072        time:   [2.4943 ms 2.5061 ms 2.5277 ms]
                        thrpt:  [49.453 MiB/s 49.878 MiB/s 50.114 MiB/s]
                 change:
                        time:   [-1.4690% -0.4133% +0.6267%] (p = 0.45 > 0.05)
                        thrpt:  [-0.6228% +0.4151% +1.4909%]
                        No change in performance detected.
construct/1048576       time:   [15.974 ms 15.992 ms 16.012 ms]
                        thrpt:  [62.454 MiB/s 62.533 MiB/s 62.603 MiB/s]
                 change:
                        time:   [-18.095% -17.493% -16.916%] (p = 0.00 < 0.05)
                        thrpt:  [+20.360% +21.202% +22.093%]
                        Performance has improved.
Benchmarking construct/5242880: Warming up for 200.00 ms
Warning: Unable to complete 15 samples in 5.0s. You may wish to increase target time to 9.4s, enable flat sampling, or reduce sample count to 10.
construct/5242880       time:   [77.563 ms 77.729 ms 77.933 ms]
                        thrpt:  [64.158 MiB/s 64.326 MiB/s 64.464 MiB/s]
                 change:
                        time:   [-20.338% -19.786% -19.256%] (p = 0.00 < 0.05)
                        thrpt:  [+23.848% +24.666% +25.530%]
                        Performance has improved.
Found 1 outliers among 15 measurements (6.67%)
  1 (6.67%) high severe

reconstruct_regular/131072
                        time:   [5.1612 ms 5.1860 ms 5.2139 ms]
                        thrpt:  [23.975 MiB/s 24.103 MiB/s 24.219 MiB/s]
                 change:
                        time:   [+4.0461% +4.5267% +5.0075%] (p = 0.00 < 0.05)
                        thrpt:  [-4.7687% -4.3307% -3.8887%]
                        Performance has regressed.
reconstruct_regular/1048576
                        time:   [33.501 ms 33.555 ms 33.623 ms]
                        thrpt:  [29.742 MiB/s 29.801 MiB/s 29.850 MiB/s]
                 change:
                        time:   [-5.2073% -4.7325% -4.1923%] (p = 0.00 < 0.05)
                        thrpt:  [+4.3758% +4.9675% +5.4933%]
                        Performance has improved.
reconstruct_regular/5242880
                        time:   [161.94 ms 162.41 ms 163.02 ms]
                        thrpt:  [30.671 MiB/s 30.787 MiB/s 30.876 MiB/s]
                 change:
                        time:   [-8.2040% -7.6302% -7.0562%] (p = 0.00 < 0.05)
                        thrpt:  [+7.5919% +8.2605% +8.9372%]
                        Performance has improved.
Found 2 outliers among 15 measurements (13.33%)
  2 (13.33%) high severe

reconstruct_systematic/131072
                        time:   [354.61 µs 357.46 µs 359.90 µs]
                        thrpt:  [347.32 MiB/s 349.69 MiB/s 352.50 MiB/s]
                 change:
                        time:   [+17.219% +18.910% +20.436%] (p = 0.00 < 0.05)
                        thrpt:  [-16.969% -15.903% -14.690%]
                        Performance has regressed.
reconstruct_systematic/1048576
                        time:   [2.3140 ms 2.3166 ms 2.3207 ms]
                        thrpt:  [430.90 MiB/s 431.67 MiB/s 432.15 MiB/s]
                 change:
                        time:   [+1.1497% +1.8026% +2.3850%] (p = 0.00 < 0.05)
                        thrpt:  [-2.3294% -1.7707% -1.1366%]
                        Performance has regressed.
Found 1 outliers among 15 measurements (6.67%)
  1 (6.67%) high severe
reconstruct_systematic/5242880
                        time:   [11.990 ms 12.054 ms 12.130 ms]
                        thrpt:  [412.19 MiB/s 414.81 MiB/s 417.01 MiB/s]
                 change:
                        time:   [+2.7472% +3.3694% +4.0428%] (p = 0.00 < 0.05)
                        thrpt:  [-3.8857% -3.2596% -2.6738%]
                        Performance has regressed.

merklize/131072         time:   [809.88 µs 816.63 µs 827.05 µs]
                        thrpt:  [151.14 MiB/s 153.07 MiB/s 154.34 MiB/s]
                 change:
                        time:   [+1.3796% +2.3840% +3.4645%] (p = 0.00 < 0.05)
                        thrpt:  [-3.3485% -2.3285% -1.3608%]
                        Performance has regressed.
merklize/1048576        time:   [3.4917 ms 3.5005 ms 3.5150 ms]
                        thrpt:  [284.49 MiB/s 285.67 MiB/s 286.39 MiB/s]
                 change:
                        time:   [-19.921% -19.560% -19.147%] (p = 0.00 < 0.05)
                        thrpt:  [+23.681% +24.317% +24.876%]
                        Performance has improved.
Found 2 outliers among 15 measurements (13.33%)
  2 (13.33%) high mild
merklize/5242880        time:   [16.776 ms 16.920 ms 17.058 ms]
                        thrpt:  [293.12 MiB/s 295.50 MiB/s 298.05 MiB/s]
                 change:
                        time:   [-22.949% -22.215% -21.422%] (p = 0.00 < 0.05)
                        thrpt:  [+27.261% +28.560% +29.783%]
                        Performance has improved.
Found 1 outliers among 15 measurements (6.67%)
  1 (6.67%) high mild

simd.txt

     Running benches/all.rs (target/release/deps/all-d5a0673224c9ff63)
construct/131072        time:   [850.07 µs 853.31 µs 859.92 µs]
                        thrpt:  [145.36 MiB/s 146.49 MiB/s 147.05 MiB/s]
                 change:
                        time:   [-66.264% -65.883% -65.491%] (p = 0.00 < 0.05)
                        thrpt:  [+189.78% +193.11% +196.42%]
                        Performance has improved.
construct/1048576       time:   [4.4436 ms 4.4478 ms 4.4537 ms]
                        thrpt:  [224.53 MiB/s 224.83 MiB/s 225.04 MiB/s]
                 change:
                        time:   [-72.179% -72.102% -72.002%] (p = 0.00 < 0.05)
                        thrpt:  [+257.17% +258.45% +259.44%]
                        Performance has improved.
Found 1 outliers among 15 measurements (6.67%)
  1 (6.67%) high mild
construct/5242880       time:   [21.000 ms 21.097 ms 21.187 ms]
                        thrpt:  [236.00 MiB/s 237.00 MiB/s 238.09 MiB/s]
                 change:
                        time:   [-73.084% -72.959% -72.833%] (p = 0.00 < 0.05)
                        thrpt:  [+268.09% +269.80% +271.53%]
                        Performance has improved.
Found 1 outliers among 15 measurements (6.67%)
  1 (6.67%) high mild

reconstruct_regular/131072
                        time:   [975.17 µs 978.40 µs 981.28 µs]
                        thrpt:  [127.39 MiB/s 127.76 MiB/s 128.18 MiB/s]
                 change:
                        time:   [-81.284% -81.186% -81.087%] (p = 0.00 < 0.05)
                        thrpt:  [+428.74% +431.51% +434.30%]
                        Performance has improved.
reconstruct_regular/1048576
                        time:   [4.1699 ms 4.2183 ms 4.2743 ms]
                        thrpt:  [233.95 MiB/s 237.06 MiB/s 239.81 MiB/s]
                 change:
                        time:   [-87.563% -87.446% -87.309%] (p = 0.00 < 0.05)
                        thrpt:  [+687.96% +696.54% +704.02%]
                        Performance has improved.
Found 2 outliers among 15 measurements (13.33%)
  1 (6.67%) high mild
  1 (6.67%) high severe
reconstruct_regular/5242880
                        time:   [19.341 ms 19.455 ms 19.609 ms]
                        thrpt:  [254.99 MiB/s 257.00 MiB/s 258.51 MiB/s]
                 change:
                        time:   [-88.070% -88.002% -87.941%] (p = 0.00 < 0.05)
                        thrpt:  [+729.24% +733.48% +738.23%]
                        Performance has improved.

reconstruct_systematic/131072
                        time:   [348.38 µs 353.42 µs 358.01 µs]
                        thrpt:  [349.15 MiB/s 353.69 MiB/s 358.80 MiB/s]
                 change:
                        time:   [-3.6433% -1.8398% +0.0992%] (p = 0.08 > 0.05)
                        thrpt:  [-0.0991% +1.8743% +3.7811%]
                        No change in performance detected.
reconstruct_systematic/1048576
                        time:   [2.3178 ms 2.3367 ms 2.3645 ms]
                        thrpt:  [422.92 MiB/s 427.95 MiB/s 431.45 MiB/s]
                 change:
                        time:   [+0.2109% +0.8781% +1.6665%] (p = 0.02 < 0.05)
                        thrpt:  [-1.6392% -0.8704% -0.2104%]
                        Change within noise threshold.
reconstruct_systematic/5242880
                        time:   [11.766 ms 11.842 ms 11.941 ms]
                        thrpt:  [418.71 MiB/s 422.22 MiB/s 424.94 MiB/s]
                 change:
                        time:   [-1.9267% -1.0978% -0.2454%] (p = 0.02 < 0.05)
                        thrpt:  [+0.2461% +1.1100% +1.9646%]
                        Change within noise threshold.

merklize/131072         time:   [803.24 µs 807.65 µs 811.58 µs]
                        thrpt:  [154.02 MiB/s 154.77 MiB/s 155.62 MiB/s]
                 change:
                        time:   [-3.4518% -2.4603% -1.4451%] (p = 0.00 < 0.05)
                        thrpt:  [+1.4663% +2.5224% +3.5752%]
                        Performance has improved.
merklize/1048576        time:   [3.5058 ms 3.5166 ms 3.5262 ms]
                        thrpt:  [283.59 MiB/s 284.37 MiB/s 285.24 MiB/s]
                 change:
                        time:   [-0.6406% -0.0615% +0.4373%] (p = 0.84 > 0.05)
                        thrpt:  [-0.4354% +0.0616% +0.6447%]
                        No change in performance detected.
merklize/5242880        time:   [16.136 ms 16.170 ms 16.214 ms]
                        thrpt:  [308.38 MiB/s 309.22 MiB/s 309.86 MiB/s]
                 change:
                        time:   [-4.5284% -3.7228% -3.0322%] (p = 0.00 < 0.05)
                        thrpt:  [+3.1270% +3.8668% +4.7432%]
                        Performance has improved.
Found 1 outliers among 15 measurements (6.67%)