Created
February 17, 2024 17:13
-
-
Save huitseeker/9094bf6b1c68d83f4c0290e68c6c5beb to your computer and use it in GitHub Desktop.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| huitseeker@sleipnir➜tmp/Nova/benches(dev✗)» git checkout rayon_parscan [11:46:17] | |
| Switched to branch 'rayon_parscan' | |
| huitseeker@sleipnir➜tmp/Nova/benches(rayon_parscan✗)» ARECIBO_BENCH_OUTPUT=commit-comment just gpu-bench-ci pcs | |
| /home/huitseeker//.gem/ruby/3.0.0/bin:/home/huitseeker/.opam/fiat/bin:/home/huitseeker//node_modules/.bin:/home/huitseeker//.local/share/ponyup/bin:/home/huitseeker//.local/bin:/bin:/home/huitseeker//golang/bin:/home/huitseeker//bin:/home/huitseeker//.g | |
| em/ruby/3.0.0/bin:/home/huitseeker/.opam/fiat/bin:/home/huitseeker//node_modules/.bin:/home/huitseeker//.local/share/ponyup/bin:/home/huitseeker//.local/bin:/bin:/home/huitseeker//golang/bin:/home/huitseeker//bin:/home/huitseeker//.cargo/bin:/usr/texbin | |
| /:/usr/local/bin:/usr/local/sbin:/home/huitseeker//bin:/home/huitseeker//.gem/ruby/3.0.0/bin:/home/huitseeker/.opam/fiat/bin:/home/huitseeker//node_modules/.bin:/home/huitseeker//.local/share/ponyup/bin:/home/huitseeker//.local/bin:/bin:/home/huitseeker | |
| //golang/bin:/home/huitseeker//bin:/home/huitseeker//.cargo/bin:/usr/texbin/:/usr/local/bin:/usr/local/sbin:/home/huitseeker//bin:/usr/local/sbin:/usr/local/bin:/usr/bin:/home/huitseeker/tmp/mvnw/bin:/opt/cuda/bin:/opt/cuda/nsight_compute:/opt/cuda/nsig | |
| ht_systems/bin:/usr/lib/jvm/default/bin:/usr/bin/site_perl:/usr/bin/vendor_perl:/usr/bin/core_perl:/usr/lib/rustup/bin:/var/lib/snapd/snap/bin:/opt/cuda/bin:/home/huitseeker/tmp/mvnw/bin:/opt/cuda/bin:/opt/cuda/bin | |
| Compiling rayon-scan v0.1.1 | |
| Compiling arecibo v0.2.0 (/home/huitseeker/tmp/Nova) | |
| Finished bench [optimized] target(s) in 8.02s | |
| Gnuplot not found, using plotters backend | |
| Benchmarking PCS-Proving 10/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::p Benchmarking PCS-Proving 10/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::p | |
| Benchmarking PCS-Proving 10/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::provider::Bn256Engine>/10: Collecting 10 samples in estimated 5.2582 s (220 iterati | |
| Benchmarking PCS-Proving 10/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::p | |
| PCS-Proving 10/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::provider::Bn256Engine>/10 | |
| time: [23.876 ms 23.927 ms 23.961 ms] | |
| change: [+0.3901% +0.9609% +1.5286%] (p = 0.01 < 0.05) | |
| Change within noise threshold. | |
| Benchmarking PCS-Proving 10/arecibo::provider::hyperkzg::EvaluationEngine<halo2cur Benchmarking PCS-Proving 10/arecibo::provider::hyperkzg::EvaluationEngine<halo2cur | |
| Benchmarking PCS-Proving 10/arecibo::provider::hyperkzg::EvaluationEngine<halo2curves::bn256::engine::Bn256, arec...: Collecting 10 samples in estimated 5.2533 s (9 | |
| Benchmarking PCS-Proving 10/arecibo::provider::hyperkzg::EvaluationEngine<halo2cur | |
| PCS-Proving 10/arecibo::provider::hyperkzg::EvaluationEngine<halo2curves::bn256::engine::Bn256, arec... | |
| time: [5.3010 ms 5.3071 ms 5.3111 ms] | |
| change: [-1.9609% -1.7245% -1.5197%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Benchmarking PCS-Proving 10/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2cu Benchmarking PCS-Proving 10/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2cu | |
| Benchmarking PCS-Proving 10/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2curves::bn256::engine::Bn256, are...: Collecting 10 samples in estimated 5.2184 s (9 | |
| Benchmarking PCS-Proving 10/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2cu | |
| PCS-Proving 10/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2curves::bn256::engine::Bn256, are... | |
| time: [5.5401 ms 5.5533 ms 5.5777 ms] | |
| change: [-7.9056% -6.2930% -4.3443%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Benchmarking PCS-Proving 10/arecibo::provider::shplonk::EvaluationEngine<halo2curv Benchmarking PCS-Proving 10/arecibo::provider::shplonk::EvaluationEngine<halo2curv | |
| Benchmarking PCS-Proving 10/arecibo::provider::shplonk::EvaluationEngine<halo2curves::bn256::engine::Bn256, areci...: Collecting 10 samples in estimated 5.0715 s (9 | |
| Benchmarking PCS-Proving 10/arecibo::provider::shplonk::EvaluationEngine<halo2curv | |
| PCS-Proving 10/arecibo::provider::shplonk::EvaluationEngine<halo2curves::bn256::engine::Bn256, areci... | |
| time: [5.0915 ms 5.1006 ms 5.1113 ms] | |
| change: [-1.4249% -0.9489% -0.4561%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Benchmarking PCS-Verifying 10/arecibo::provider::ipa_pc::EvaluationEngine<arecibo: Benchmarking PCS-Verifying 10/arecibo::provider::ipa_pc::EvaluationEngine<arecibo: | |
| Benchmarking PCS-Verifying 10/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::provider::Bn256Engine>/10: Collecting 10 samples in estimated 5.1094 s (1540 iter | |
| Benchmarking PCS-Verifying 10/arecibo::provider::ipa_pc::EvaluationEngine<arecibo: | |
| PCS-Verifying 10/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::provider::Bn256Engine>/10 | |
| time: [3.2910 ms 3.3175 ms 3.3344 ms] | |
| change: [-3.2102% -1.6683% -0.3506%] (p = 0.03 < 0.05) | |
| Change within noise threshold. | |
| Benchmarking PCS-Verifying 10/arecibo::provider::hyperkzg::EvaluationEngine<halo2c Benchmarking PCS-Verifying 10/arecibo::provider::hyperkzg::EvaluationEngine<halo2c | |
| Benchmarking PCS-Verifying 10/arecibo::provider::hyperkzg::EvaluationEngine<halo2curves::bn256::engine::Bn256, ar...: Collecting 10 samples in estimated 5.0320 s (2 | |
| Benchmarking PCS-Verifying 10/arecibo::provider::hyperkzg::EvaluationEngine<halo2c | |
| PCS-Verifying 10/arecibo::provider::hyperkzg::EvaluationEngine<halo2curves::bn256::engine::Bn256, ar... | |
| time: [1.7398 ms 1.7941 ms 1.8332 ms] | |
| change: [+1.4410% +5.8646% +10.456%] (p = 0.03 < 0.05) | |
| Performance has regressed. | |
| Benchmarking PCS-Verifying 10/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2 Benchmarking PCS-Verifying 10/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2 | |
| Benchmarking PCS-Verifying 10/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2curves::bn256::engine::Bn256, a...: Collecting 10 samples in estimated 5.0542 s (3 | |
| Benchmarking PCS-Verifying 10/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2 | |
| PCS-Verifying 10/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2curves::bn256::engine::Bn256, a... | |
| time: [1.4819 ms 1.4823 ms 1.4829 ms] | |
| change: [-4.4638% -4.3578% -4.2261%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Benchmarking PCS-Verifying 10/arecibo::provider::shplonk::EvaluationEngine<halo2cu Benchmarking PCS-Verifying 10/arecibo::provider::shplonk::EvaluationEngine<halo2cu | |
| Benchmarking PCS-Verifying 10/arecibo::provider::shplonk::EvaluationEngine<halo2curves::bn256::engine::Bn256, are...: Collecting 10 samples in estimated 5.0737 s (3 | |
| Benchmarking PCS-Verifying 10/arecibo::provider::shplonk::EvaluationEngine<halo2cu | |
| PCS-Verifying 10/arecibo::provider::shplonk::EvaluationEngine<halo2curves::bn256::engine::Bn256, are... | |
| time: [1.6421 ms 1.6721 ms 1.7167 ms] | |
| change: [-25.528% -23.891% -22.609%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Benchmarking PCS-Proving 12/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::p Benchmarking PCS-Proving 12/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::p | |
| Benchmarking PCS-Proving 12/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::provider::Bn256Engine>/12: Collecting 10 samples in estimated 6.9850 s (110 iterati | |
| Benchmarking PCS-Proving 12/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::p | |
| PCS-Proving 12/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::provider::Bn256Engine>/12 | |
| time: [63.334 ms 63.516 ms 63.734 ms] | |
| change: [+0.2738% +0.6860% +1.1573%] (p = 0.01 < 0.05) | |
| Change within noise threshold. | |
| Benchmarking PCS-Proving 12/arecibo::provider::hyperkzg::EvaluationEngine<halo2cur Benchmarking PCS-Proving 12/arecibo::provider::hyperkzg::EvaluationEngine<halo2cur | |
| Benchmarking PCS-Proving 12/arecibo::provider::hyperkzg::EvaluationEngine<halo2curves::bn256::engine::Bn256, arec...: Collecting 10 samples in estimated 5.3374 s (3 | |
| Benchmarking PCS-Proving 12/arecibo::provider::hyperkzg::EvaluationEngine<halo2cur | |
| PCS-Proving 12/arecibo::provider::hyperkzg::EvaluationEngine<halo2curves::bn256::engine::Bn256, arec... | |
| time: [13.860 ms 13.897 ms 13.922 ms] | |
| change: [-2.9355% -2.0591% -1.1507%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Benchmarking PCS-Proving 12/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2cu Benchmarking PCS-Proving 12/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2cu | |
| Benchmarking PCS-Proving 12/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2curves::bn256::engine::Bn256, are...: Collecting 10 samples in estimated 5.2887 s (4 | |
| Benchmarking PCS-Proving 12/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2cu | |
| PCS-Proving 12/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2curves::bn256::engine::Bn256, are... | |
| time: [11.856 ms 11.894 ms 11.923 ms] | |
| change: [-0.3110% +0.6286% +1.7426%] (p = 0.31 > 0.05) | |
| No change in performance detected. | |
| Benchmarking PCS-Proving 12/arecibo::provider::shplonk::EvaluationEngine<halo2curv Benchmarking PCS-Proving 12/arecibo::provider::shplonk::EvaluationEngine<halo2curv | |
| Benchmarking PCS-Proving 12/arecibo::provider::shplonk::EvaluationEngine<halo2curves::bn256::engine::Bn256, areci...: Collecting 10 samples in estimated 5.5296 s (4 | |
| Benchmarking PCS-Proving 12/arecibo::provider::shplonk::EvaluationEngine<halo2curv | |
| PCS-Proving 12/arecibo::provider::shplonk::EvaluationEngine<halo2curves::bn256::engine::Bn256, areci... | |
| time: [12.516 ms 12.894 ms 13.414 ms] | |
| change: [-1.9522% -0.1449% +2.1939%] (p = 0.92 > 0.05) | |
| No change in performance detected. | |
| Benchmarking PCS-Verifying 12/arecibo::provider::ipa_pc::EvaluationEngine<arecibo: Benchmarking PCS-Verifying 12/arecibo::provider::ipa_pc::EvaluationEngine<arecibo: | |
| Benchmarking PCS-Verifying 12/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::provider::Bn256Engine>/12: Collecting 10 samples in estimated 5.1261 s (825 itera | |
| Benchmarking PCS-Verifying 12/arecibo::provider::ipa_pc::EvaluationEngine<arecibo: | |
| PCS-Verifying 12/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::provider::Bn256Engine>/12 | |
| time: [6.1515 ms 6.2146 ms 6.2681 ms] | |
| change: [-0.7799% +1.5798% +4.4966%] (p = 0.29 > 0.05) | |
| No change in performance detected. | |
| Benchmarking PCS-Verifying 12/arecibo::provider::hyperkzg::EvaluationEngine<halo2c Benchmarking PCS-Verifying 12/arecibo::provider::hyperkzg::EvaluationEngine<halo2c | |
| Benchmarking PCS-Verifying 12/arecibo::provider::hyperkzg::EvaluationEngine<halo2curves::bn256::engine::Bn256, ar...: Collecting 10 samples in estimated 5.0356 s (2 | |
| Benchmarking PCS-Verifying 12/arecibo::provider::hyperkzg::EvaluationEngine<halo2c | |
| PCS-Verifying 12/arecibo::provider::hyperkzg::EvaluationEngine<halo2curves::bn256::engine::Bn256, ar... | |
| time: [1.7331 ms 1.7738 ms 1.8319 ms] | |
| change: [+4.0118% +8.5040% +13.413%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Benchmarking PCS-Verifying 12/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2 Benchmarking PCS-Verifying 12/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2 | |
| Benchmarking PCS-Verifying 12/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2curves::bn256::engine::Bn256, a...: Collecting 10 samples in estimated 5.0455 s (3 | |
| Benchmarking PCS-Verifying 12/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2 | |
| PCS-Verifying 12/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2curves::bn256::engine::Bn256, a... | |
| time: [1.5291 ms 1.5298 ms 1.5311 ms] | |
| change: [+1.1242% +1.3454% +1.6465%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Benchmarking PCS-Verifying 12/arecibo::provider::shplonk::EvaluationEngine<halo2cu Benchmarking PCS-Verifying 12/arecibo::provider::shplonk::EvaluationEngine<halo2cu | |
| Benchmarking PCS-Verifying 12/arecibo::provider::shplonk::EvaluationEngine<halo2curves::bn256::engine::Bn256, are...: Collecting 10 samples in estimated 5.0072 s (2 | |
| Benchmarking PCS-Verifying 12/arecibo::provider::shplonk::EvaluationEngine<halo2cu | |
| PCS-Verifying 12/arecibo::provider::shplonk::EvaluationEngine<halo2curves::bn256::engine::Bn256, are... | |
| time: [1.6813 ms 1.7043 ms 1.7406 ms] | |
| change: [-27.955% -25.826% -23.707%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Benchmarking PCS-Proving 14/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::p Benchmarking PCS-Proving 14/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::p | |
| Benchmarking PCS-Proving 14/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::provider::Bn256Engine>/14: Collecting 10 samples in estimated 6.4025 s (30 iteratio | |
| Benchmarking PCS-Proving 14/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::p | |
| PCS-Proving 14/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::provider::Bn256Engine>/14 | |
| time: [212.26 ms 213.10 ms 213.88 ms] | |
| change: [-3.5806% -2.7758% -1.7660%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Benchmarking PCS-Proving 14/arecibo::provider::hyperkzg::EvaluationEngine<halo2cur Benchmarking PCS-Proving 14/arecibo::provider::hyperkzg::EvaluationEngine<halo2cur | |
| Benchmarking PCS-Proving 14/arecibo::provider::hyperkzg::EvaluationEngine<halo2curves::bn256::engine::Bn256, arec...: Collecting 10 samples in estimated 5.0659 s (1 | |
| Benchmarking PCS-Proving 14/arecibo::provider::hyperkzg::EvaluationEngine<halo2cur | |
| PCS-Proving 14/arecibo::provider::hyperkzg::EvaluationEngine<halo2curves::bn256::engine::Bn256, arec... | |
| time: [45.807 ms 46.013 ms 46.171 ms] | |
| change: [-1.8652% -1.1684% -0.4207%] (p = 0.01 < 0.05) | |
| Change within noise threshold. | |
| Benchmarking PCS-Proving 14/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2cu Benchmarking PCS-Proving 14/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2cu | |
| Benchmarking PCS-Proving 14/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2curves::bn256::engine::Bn256, are...: Collecting 10 samples in estimated 5.7720 s (1 | |
| Benchmarking PCS-Proving 14/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2cu | |
| PCS-Proving 14/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2curves::bn256::engine::Bn256, are... | |
| time: [34.859 ms 35.102 ms 35.623 ms] | |
| change: [-0.5461% +1.5799% +4.1061%] (p = 0.24 > 0.05) | |
| No change in performance detected. | |
| Benchmarking PCS-Proving 14/arecibo::provider::shplonk::EvaluationEngine<halo2curv Benchmarking PCS-Proving 14/arecibo::provider::shplonk::EvaluationEngine<halo2curv | |
| Benchmarking PCS-Proving 14/arecibo::provider::shplonk::EvaluationEngine<halo2curves::bn256::engine::Bn256, areci...: Collecting 10 samples in estimated 6.6627 s (1 | |
| Benchmarking PCS-Proving 14/arecibo::provider::shplonk::EvaluationEngine<halo2curv | |
| PCS-Proving 14/arecibo::provider::shplonk::EvaluationEngine<halo2curves::bn256::engine::Bn256, areci... | |
| time: [40.215 ms 40.674 ms 41.234 ms] | |
| change: [-1.5516% -0.1620% +1.3679%] (p = 0.84 > 0.05) | |
| No change in performance detected. | |
| Benchmarking PCS-Verifying 14/arecibo::provider::ipa_pc::EvaluationEngine<arecibo: Benchmarking PCS-Verifying 14/arecibo::provider::ipa_pc::EvaluationEngine<arecibo: | |
| Benchmarking PCS-Verifying 14/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::provider::Bn256Engine>/14: Collecting 10 samples in estimated 5.3509 s (330 itera | |
| Benchmarking PCS-Verifying 14/arecibo::provider::ipa_pc::EvaluationEngine<arecibo: | |
| PCS-Verifying 14/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::provider::Bn256Engine>/14 | |
| time: [16.138 ms 16.480 ms 16.710 ms] | |
| change: [-5.2833% -2.0318% +1.0337%] (p = 0.25 > 0.05) | |
| No change in performance detected. | |
| Benchmarking PCS-Verifying 14/arecibo::provider::hyperkzg::EvaluationEngine<halo2c Benchmarking PCS-Verifying 14/arecibo::provider::hyperkzg::EvaluationEngine<halo2c | |
| Benchmarking PCS-Verifying 14/arecibo::provider::hyperkzg::EvaluationEngine<halo2curves::bn256::engine::Bn256, ar...: Collecting 10 samples in estimated 5.0190 s (2 | |
| Benchmarking PCS-Verifying 14/arecibo::provider::hyperkzg::EvaluationEngine<halo2c | |
| PCS-Verifying 14/arecibo::provider::hyperkzg::EvaluationEngine<halo2curves::bn256::engine::Bn256, ar... | |
| time: [1.6864 ms 1.7380 ms 1.7911 ms] | |
| change: [+3.3281% +6.5028% +9.7707%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Benchmarking PCS-Verifying 14/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2 Benchmarking PCS-Verifying 14/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2 | |
| Benchmarking PCS-Verifying 14/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2curves::bn256::engine::Bn256, a...: Collecting 10 samples in estimated 5.0713 s (3 | |
| Benchmarking PCS-Verifying 14/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2 | |
| PCS-Verifying 14/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2curves::bn256::engine::Bn256, a... | |
| time: [1.6459 ms 1.6464 ms 1.6471 ms] | |
| change: [+0.4766% +0.5857% +0.6945%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Benchmarking PCS-Verifying 14/arecibo::provider::shplonk::EvaluationEngine<halo2cu Benchmarking PCS-Verifying 14/arecibo::provider::shplonk::EvaluationEngine<halo2cu | |
| Benchmarking PCS-Verifying 14/arecibo::provider::shplonk::EvaluationEngine<halo2curves::bn256::engine::Bn256, are...: Collecting 10 samples in estimated 5.0295 s (2 | |
| Benchmarking PCS-Verifying 14/arecibo::provider::shplonk::EvaluationEngine<halo2cu | |
| PCS-Verifying 14/arecibo::provider::shplonk::EvaluationEngine<halo2curves::bn256::engine::Bn256, are... | |
| time: [1.6934 ms 1.7149 ms 1.7339 ms] | |
| change: [-38.309% -36.955% -35.256%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Benchmarking PCS-Proving 16/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::p Benchmarking PCS-Proving 16/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::provider | |
| ::Bn256Engine>/16: Warming up for 3.0000 s | |
| Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target time to 8.0s. | |
| Benchmarking PCS-Proving 16/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::provider::Bn256Engine>/16: Collecting 10 samples in estimated 7.9767 s (10 iteratio | |
| Benchmarking PCS-Proving 16/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::p | |
| PCS-Proving 16/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::provider::Bn256Engine>/16 | |
| time: [809.79 ms 816.30 ms 822.52 ms] | |
| change: [+0.5639% +1.4770% +2.2934%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Benchmarking PCS-Proving 16/arecibo::provider::hyperkzg::EvaluationEngine<halo2cur Benchmarking PCS-Proving 16/arecibo::provider::hyperkzg::EvaluationEngine<halo2cur | |
| Benchmarking PCS-Proving 16/arecibo::provider::hyperkzg::EvaluationEngine<halo2curves::bn256::engine::Bn256, arec...: Collecting 10 samples in estimated 6.3958 s (1 | |
| Benchmarking PCS-Proving 16/arecibo::provider::hyperkzg::EvaluationEngine<halo2cur | |
| PCS-Proving 16/arecibo::provider::hyperkzg::EvaluationEngine<halo2curves::bn256::engine::Bn256, arec... | |
| time: [56.960 ms 57.401 ms 57.911 ms] | |
| change: [-1.9650% -0.4809% +1.1637%] (p = 0.60 > 0.05) | |
| No change in performance detected. | |
| Benchmarking PCS-Proving 16/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2cu Benchmarking PCS-Proving 16/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2curves::b | |
| n256::engine::Bn256, are...: Warming up for 3.0000 s | |
| Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target time to 6.5s or enable flat sampling. | |
| Benchmarking PCS-Proving 16/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2curves::bn256::engine::Bn256, are...: Collecting 10 samples in estimated 6.5456 s (5 | |
| Benchmarking PCS-Proving 16/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2cu | |
| PCS-Proving 16/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2curves::bn256::engine::Bn256, are... | |
| time: [118.74 ms 119.38 ms 119.99 ms] | |
| change: [-1.0639% +0.7644% +2.8625%] (p = 0.52 > 0.05) | |
| No change in performance detected. | |
| Benchmarking PCS-Proving 16/arecibo::provider::shplonk::EvaluationEngine<halo2curv Benchmarking PCS-Proving 16/arecibo::provider::shplonk::EvaluationEngine<halo2curves::bn2 | |
| 56::engine::Bn256, areci...: Warming up for 3.0000 s | |
| Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target time to 8.0s or enable flat sampling. | |
| Benchmarking PCS-Proving 16/arecibo::provider::shplonk::EvaluationEngine<halo2curves::bn256::engine::Bn256, areci...: Collecting 10 samples in estimated 7.9602 s (5 | |
| Benchmarking PCS-Proving 16/arecibo::provider::shplonk::EvaluationEngine<halo2curv | |
| PCS-Proving 16/arecibo::provider::shplonk::EvaluationEngine<halo2curves::bn256::engine::Bn256, areci... | |
| time: [144.40 ms 146.11 ms 147.10 ms] | |
| change: [-3.0841% -1.3092% +0.1681%] (p = 0.16 > 0.05) | |
| No change in performance detected. | |
| Benchmarking PCS-Verifying 16/arecibo::provider::ipa_pc::EvaluationEngine<arecibo: Benchmarking PCS-Verifying 16/arecibo::provider::ipa_pc::EvaluationEngine<arecibo: | |
| Benchmarking PCS-Verifying 16/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::provider::Bn256Engine>/16: Collecting 10 samples in estimated 5.2484 s (550 itera | |
| Benchmarking PCS-Verifying 16/arecibo::provider::ipa_pc::EvaluationEngine<arecibo: | |
| PCS-Verifying 16/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::provider::Bn256Engine>/16 | |
| time: [9.4483 ms 9.4993 ms 9.5618 ms] | |
| change: [-2.5431% -0.6327% +1.5125%] (p = 0.63 > 0.05) | |
| No change in performance detected. | |
| Benchmarking PCS-Verifying 16/arecibo::provider::hyperkzg::EvaluationEngine<halo2c Benchmarking PCS-Verifying 16/arecibo::provider::hyperkzg::EvaluationEngine<halo2c | |
| Benchmarking PCS-Verifying 16/arecibo::provider::hyperkzg::EvaluationEngine<halo2curves::bn256::engine::Bn256, ar...: Collecting 10 samples in estimated 5.0632 s (2 | |
| Benchmarking PCS-Verifying 16/arecibo::provider::hyperkzg::EvaluationEngine<halo2c | |
| PCS-Verifying 16/arecibo::provider::hyperkzg::EvaluationEngine<halo2curves::bn256::engine::Bn256, ar... | |
| time: [1.7697 ms 1.8230 ms 1.8705 ms] | |
| change: [+8.8669% +11.972% +14.877%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Benchmarking PCS-Verifying 16/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2 Benchmarking PCS-Verifying 16/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2 | |
| Benchmarking PCS-Verifying 16/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2curves::bn256::engine::Bn256, a...: Collecting 10 samples in estimated 5.0715 s (3 | |
| Benchmarking PCS-Verifying 16/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2 | |
| PCS-Verifying 16/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2curves::bn256::engine::Bn256, a... | |
| time: [1.6636 ms 1.6819 ms 1.7010 ms] | |
| change: [-0.2470% +0.5507% +1.2909%] (p = 0.25 > 0.05) | |
| No change in performance detected. | |
| Benchmarking PCS-Verifying 16/arecibo::provider::shplonk::EvaluationEngine<halo2cu Benchmarking PCS-Verifying 16/arecibo::provider::shplonk::EvaluationEngine<halo2cu | |
| Benchmarking PCS-Verifying 16/arecibo::provider::shplonk::EvaluationEngine<halo2curves::bn256::engine::Bn256, are...: Collecting 10 samples in estimated 5.0531 s (2 | |
| Benchmarking PCS-Verifying 16/arecibo::provider::shplonk::EvaluationEngine<halo2cu | |
| PCS-Verifying 16/arecibo::provider::shplonk::EvaluationEngine<halo2curves::bn256::engine::Bn256, are... | |
| time: [1.7504 ms 1.7893 ms 1.8288 ms] | |
| change: [-39.552% -38.348% -37.334%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Benchmarking PCS-Proving 18/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::p Benchmarking PCS-Proving 18/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::provider | |
| ::Bn256Engine>/18: Warming up for 3.0000 s | |
| Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target time to 28.8s. | |
| Benchmarking PCS-Proving 18/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::provider::Bn256Engine>/18: Collecting 10 samples in estimated 28.753 s (10 iteratio | |
| Benchmarking PCS-Proving 18/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::p | |
| PCS-Proving 18/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::provider::Bn256Engine>/18 | |
| time: [2.8696 s 2.8730 s 2.8769 s] | |
| change: [-0.1863% -0.0389% +0.1265%] (p = 0.65 > 0.05) | |
| No change in performance detected. | |
| Benchmarking PCS-Proving 18/arecibo::provider::hyperkzg::EvaluationEngine<halo2cur Benchmarking PCS-Proving 18/arecibo::provider::hyperkzg::EvaluationEngine<halo2curves::bn | |
| 256::engine::Bn256, arec...: Warming up for 3.0000 s | |
| Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target time to 5.1s or enable flat sampling. | |
| Benchmarking PCS-Proving 18/arecibo::provider::hyperkzg::EvaluationEngine<halo2curves::bn256::engine::Bn256, arec...: Collecting 10 samples in estimated 5.1405 s (5 | |
| Benchmarking PCS-Proving 18/arecibo::provider::hyperkzg::EvaluationEngine<halo2cur | |
| PCS-Proving 18/arecibo::provider::hyperkzg::EvaluationEngine<halo2curves::bn256::engine::Bn256, arec... | |
| time: [92.503 ms 94.145 ms 95.466 ms] | |
| change: [-3.4856% -1.2100% +1.0332%] (p = 0.34 > 0.05) | |
| No change in performance detected. | |
| Benchmarking PCS-Proving 18/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2cu Benchmarking PCS-Proving 18/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2curves::b | |
| n256::engine::Bn256, are...: Warming up for 3.0000 s | |
| Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target time to 5.3s or enable flat sampling. | |
| Benchmarking PCS-Proving 18/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2curves::bn256::engine::Bn256, are...: Collecting 10 samples in estimated 5.3347 s (5 | |
| Benchmarking PCS-Proving 18/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2cu | |
| PCS-Proving 18/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2curves::bn256::engine::Bn256, are... | |
| time: [98.955 ms 99.605 ms 99.938 ms] | |
| change: [-0.0299% +1.3629% +2.6154%] (p = 0.07 > 0.05) | |
| No change in performance detected. | |
| Benchmarking PCS-Proving 18/arecibo::provider::shplonk::EvaluationEngine<halo2curv Benchmarking PCS-Proving 18/arecibo::provider::shplonk::EvaluationEngine<halo2curves::bn2 | |
| 56::engine::Bn256, areci...: Warming up for 3.0000 s | |
| Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target time to 7.0s or enable flat sampling. | |
| Benchmarking PCS-Proving 18/arecibo::provider::shplonk::EvaluationEngine<halo2curves::bn256::engine::Bn256, areci...: Collecting 10 samples in estimated 7.0020 s (5 | |
| Benchmarking PCS-Proving 18/arecibo::provider::shplonk::EvaluationEngine<halo2curv | |
| PCS-Proving 18/arecibo::provider::shplonk::EvaluationEngine<halo2curves::bn256::engine::Bn256, areci... | |
| time: [126.80 ms 127.90 ms 129.16 ms] | |
| change: [-0.2031% +0.6876% +1.6003%] (p = 0.17 > 0.05) | |
| No change in performance detected. | |
| Benchmarking PCS-Verifying 18/arecibo::provider::ipa_pc::EvaluationEngine<arecibo: Benchmarking PCS-Verifying 18/arecibo::provider::ipa_pc::EvaluationEngine<arecibo: | |
| Benchmarking PCS-Verifying 18/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::provider::Bn256Engine>/18: Collecting 10 samples in estimated 5.2773 s (220 itera | |
| Benchmarking PCS-Verifying 18/arecibo::provider::ipa_pc::EvaluationEngine<arecibo: | |
| PCS-Verifying 18/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::provider::Bn256Engine>/18 | |
| time: [24.043 ms 24.099 ms 24.147 ms] | |
| change: [-0.9601% -0.0936% +0.6836%] (p = 0.84 > 0.05) | |
| No change in performance detected. | |
| Benchmarking PCS-Verifying 18/arecibo::provider::hyperkzg::EvaluationEngine<halo2c Benchmarking PCS-Verifying 18/arecibo::provider::hyperkzg::EvaluationEngine<halo2c | |
| Benchmarking PCS-Verifying 18/arecibo::provider::hyperkzg::EvaluationEngine<halo2curves::bn256::engine::Bn256, ar...: Collecting 10 samples in estimated 5.0703 s (2 | |
| Benchmarking PCS-Verifying 18/arecibo::provider::hyperkzg::EvaluationEngine<halo2c | |
| PCS-Verifying 18/arecibo::provider::hyperkzg::EvaluationEngine<halo2curves::bn256::engine::Bn256, ar... | |
| time: [1.8290 ms 1.8495 ms 1.8756 ms] | |
| change: [+5.9647% +9.8855% +14.680%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Benchmarking PCS-Verifying 18/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2 Benchmarking PCS-Verifying 18/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2 | |
| Benchmarking PCS-Verifying 18/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2curves::bn256::engine::Bn256, a...: Collecting 10 samples in estimated 5.0405 s (2 | |
| Benchmarking PCS-Verifying 18/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2 | |
| PCS-Verifying 18/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2curves::bn256::engine::Bn256, a... | |
| time: [1.6978 ms 1.6988 ms 1.7004 ms] | |
| change: [-0.9400% -0.7913% -0.6531%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Benchmarking PCS-Verifying 18/arecibo::provider::shplonk::EvaluationEngine<halo2cu Benchmarking PCS-Verifying 18/arecibo::provider::shplonk::EvaluationEngine<halo2cu | |
| Benchmarking PCS-Verifying 18/arecibo::provider::shplonk::EvaluationEngine<halo2curves::bn256::engine::Bn256, are...: Collecting 10 samples in estimated 5.0204 s (2 | |
| Benchmarking PCS-Verifying 18/arecibo::provider::shplonk::EvaluationEngine<halo2cu | |
| PCS-Verifying 18/arecibo::provider::shplonk::EvaluationEngine<halo2curves::bn256::engine::Bn256, are... | |
| time: [1.7422 ms 1.7515 ms 1.7584 ms] | |
| change: [-45.244% -44.721% -44.209%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Benchmarking PCS-Proving 20/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::p Benchmarking PCS-Proving 20/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::provider | |
| ::Bn256Engine>/20: Warming up for 3.0000 s | |
| Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target time to 111.2s. | |
| Benchmarking PCS-Proving 20/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::provider::Bn256Engine>/20: Collecting 10 samples in estimated 111.18 s (10 iteratio | |
| Benchmarking PCS-Proving 20/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::p | |
| PCS-Proving 20/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::provider::Bn256Engine>/20 | |
| time: [11.108 s 11.126 s 11.156 s] | |
| change: [-0.0387% +0.2527% +0.5429%] (p = 0.15 > 0.05) | |
| No change in performance detected. | |
| Benchmarking PCS-Proving 20/arecibo::provider::hyperkzg::EvaluationEngine<halo2cur Benchmarking PCS-Proving 20/arecibo::provider::hyperkzg::EvaluationEngine<halo2cur | |
| Benchmarking PCS-Proving 20/arecibo::provider::hyperkzg::EvaluationEngine<halo2curves::bn256::engine::Bn256, arec...: Collecting 10 samples in estimated 5.9580 s (3 | |
| Benchmarking PCS-Proving 20/arecibo::provider::hyperkzg::EvaluationEngine<halo2cur | |
| PCS-Proving 20/arecibo::provider::hyperkzg::EvaluationEngine<halo2curves::bn256::engine::Bn256, arec... | |
| time: [197.93 ms 198.95 ms 199.83 ms] | |
| change: [+1.0665% +1.9132% +2.8369%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Benchmarking PCS-Proving 20/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2cu Benchmarking PCS-Proving 20/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2cu | |
| Benchmarking PCS-Proving 20/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2curves::bn256::engine::Bn256, are...: Collecting 10 samples in estimated 6.6910 s (3 | |
| Benchmarking PCS-Proving 20/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2cu | |
| PCS-Proving 20/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2curves::bn256::engine::Bn256, are... | |
| time: [221.59 ms 222.86 ms 224.19 ms] | |
| change: [+0.6661% +1.3529% +2.0203%] (p = 0.00 < 0.05) | |
| Change within noise threshold. | |
| Benchmarking PCS-Proving 20/arecibo::provider::shplonk::EvaluationEngine<halo2curv Benchmarking PCS-Proving 20/arecibo::provider::shplonk::EvaluationEngine<halo2curv | |
| Benchmarking PCS-Proving 20/arecibo::provider::shplonk::EvaluationEngine<halo2curves::bn256::engine::Bn256, areci...: Collecting 10 samples in estimated 6.6940 s (2 | |
| Benchmarking PCS-Proving 20/arecibo::provider::shplonk::EvaluationEngine<halo2curv | |
| PCS-Proving 20/arecibo::provider::shplonk::EvaluationEngine<halo2curves::bn256::engine::Bn256, areci... | |
| time: [333.84 ms 335.52 ms 337.42 ms] | |
| change: [-0.7533% +0.0132% +0.8489%] (p = 0.98 > 0.05) | |
| No change in performance detected. | |
| Benchmarking PCS-Verifying 20/arecibo::provider::ipa_pc::EvaluationEngine<arecibo: Benchmarking PCS-Verifying 20/arecibo::provider::ipa_pc::EvaluationEngine<arecibo: | |
| Benchmarking PCS-Verifying 20/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::provider::Bn256Engine>/20: Collecting 10 samples in estimated 8.1562 s (110 itera | |
| Benchmarking PCS-Verifying 20/arecibo::provider::ipa_pc::EvaluationEngine<arecibo: | |
| PCS-Verifying 20/arecibo::provider::ipa_pc::EvaluationEngine<arecibo::provider::Bn256Engine>/20 | |
| time: [73.326 ms 73.615 ms 73.788 ms] | |
| change: [+3.2240% +3.8809% +4.5744%] (p = 0.00 < 0.05) | |
| Performance has regressed. | |
| Benchmarking PCS-Verifying 20/arecibo::provider::hyperkzg::EvaluationEngine<halo2c Benchmarking PCS-Verifying 20/arecibo::provider::hyperkzg::EvaluationEngine<halo2c | |
| Benchmarking PCS-Verifying 20/arecibo::provider::hyperkzg::EvaluationEngine<halo2curves::bn256::engine::Bn256, ar...: Collecting 10 samples in estimated 5.0302 s (2 | |
| Benchmarking PCS-Verifying 20/arecibo::provider::hyperkzg::EvaluationEngine<halo2c | |
| PCS-Verifying 20/arecibo::provider::hyperkzg::EvaluationEngine<halo2curves::bn256::engine::Bn256, ar... | |
| time: [1.8954 ms 1.9183 ms 1.9365 ms] | |
| change: [+0.5823% +5.3112% +9.8971%] (p = 0.04 < 0.05) | |
| Change within noise threshold. | |
| Benchmarking PCS-Verifying 20/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2 Benchmarking PCS-Verifying 20/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2 | |
| Benchmarking PCS-Verifying 20/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2curves::bn256::engine::Bn256, a...: Collecting 10 samples in estimated 5.0374 s (2 | |
| Benchmarking PCS-Verifying 20/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2 | |
| PCS-Verifying 20/arecibo::provider::non_hiding_zeromorph::ZMPCS<halo2curves::bn256::engine::Bn256, a... | |
| time: [1.7332 ms 1.7344 ms 1.7363 ms] | |
| change: [-2.0355% -1.8869% -1.7365%] (p = 0.00 < 0.05) | |
| Performance has improved. | |
| Benchmarking PCS-Verifying 20/arecibo::provider::shplonk::EvaluationEngine<halo2cu Benchmarking PCS-Verifying 20/arecibo::provider::shplonk::EvaluationEngine<halo2cu | |
| Benchmarking PCS-Verifying 20/arecibo::provider::shplonk::EvaluationEngine<halo2curves::bn256::engine::Bn256, are...: Collecting 10 samples in estimated 5.0114 s (2 | |
| Benchmarking PCS-Verifying 20/arecibo::provider::shplonk::EvaluationEngine<halo2cu | |
| PCS-Verifying 20/arecibo::provider::shplonk::EvaluationEngine<halo2curves::bn256::engine::Bn256, are... | |
| time: [1.6963 ms 1.7098 ms 1.7195 ms] | |
| change: [-47.135% -46.221% -45.047%] (p = 0.00 < 0.05) | |
| Performance has improved. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment