Skip to content

Instantly share code, notes, and snippets.

@sifnoc

sifnoc/gist:ba9fd739838db2ff8426c0507949ea40

Created January 12, 2024 16:56
Show Gist options
  • Save sifnoc/ba9fd739838db2ff8426c0507949ea40 to your computer and use it in GitHub Desktop.
Save sifnoc/ba9fd739838db2ff8426c0507949ea40 to your computer and use it in GitHub Desktop.
Download ZIP
v2-gwc_from_2_16_to_2_20_bench_result.log
Raw
gistfile1.txt
running 16 tests
test chips::range::tests::testing::test_none_overflow_64bits ... ignored
test chips::range::tests::testing::test_overflow_64bits ... ignored
test chips::range::utils::testing::test_decompose_fp_byte_pairs_no_padding ... ignored
test chips::range::utils::testing::test_decompose_fp_to_byte_pairs_overflow ... ignored
test chips::range::utils::testing::test_decompose_fp_to_byte_pairs_padding ... ignored
test chips::range::utils::testing::test_decompose_fp_to_bytes_no_padding ... ignored
test chips::range::utils::testing::test_decompose_fp_to_bytes_overflow ... ignored
test chips::range::utils::testing::test_decompose_fp_to_bytes_overflow_2 ... ignored
test chips::range::utils::testing::test_decompose_fp_to_bytes_padding ... ignored
test chips::range::utils::testing::test_fp_to_big_uint ... ignored
test chips::range::utils::testing::test_pow_2 ... ignored
test circuits::tests::test::test_balance_not_in_range ... ignored
test circuits::tests::test::test_invalid_omega_univariate_grand_sum_proof ... ignored
test circuits::tests::test::test_invalid_poly_degree_univariate_grand_sum_full_prover ... ignored
test circuits::tests::test::test_valid_univariate_grand_sum_full_prover ... ignored
test circuits::tests::test::test_valid_univariate_grand_sum_prover ... ignored
test result: ok. 0 passed; 0 failed; 16 ignored; 0 measured; 0 filtered out; finished in 0.00s
WARNING: HTML report generation will become a non-default optional feature in Criterion.rs 0.4.0.
This feature is being moved to cargo-criterion (https://github.com/bheisler/cargo-criterion) and will be optional in a future version of Criterion.rs. To silence this warning, either switch to cargo-criterion or enable the 'html_reports' feature in your Cargo.toml.
Gnuplot not found, using plotters backend
Start: None Creating params
End: None Creating params ......................................................2.400s
Benchmarking <K = 17, N_USERS = 65530, N_CURRENCIES = 1> range check
Benchmarking <K = 17, N_USERS = 65530, N_CURRENCIES = 1> range check: Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target time to 64.5s.
Benchmarking <K = 17, N_USERS = 65530, N_CURRENCIES = 1> range check: Collecting 10 samples in estimated 64.508 s (10 iterations)
Benchmarking <K = 17, N_USERS = 65530, N_CURRENCIES = 1> range check: Analyzing
<K = 17, N_USERS = 65530, N_CURRENCIES = 1> range check
time: [6.4359 s 6.4459 s 6.4562 s]
change: [+3.3247% +3.6450% +3.9450%] (p = 0.00 < 0.05)
Performance has regressed.
Benchmarking <K = 17, N_USERS = 65530, N_CURRENCIES = 1> opening grand sum
Benchmarking <K = 17, N_USERS = 65530, N_CURRENCIES = 1> opening grand sum: Warming up for 3.0000 s
Benchmarking <K = 17, N_USERS = 65530, N_CURRENCIES = 1> opening grand sum: Collecting 10 samples in estimated 9.6521 s (110 iterations)
Benchmarking <K = 17, N_USERS = 65530, N_CURRENCIES = 1> opening grand sum: Analyzing
<K = 17, N_USERS = 65530, N_CURRENCIES = 1> opening grand sum
time: [86.728 ms 88.981 ms 91.207 ms]
change: [-51.383% -50.176% -48.917%] (p = 0.00 < 0.05)
Performance has improved.
Benchmarking <K = 17, N_USERS = 65530, N_CURRENCIES = 1> opening user inclusion
Benchmarking <K = 17, N_USERS = 65530, N_CURRENCIES = 1> opening user inclusion: Warming up for 3.0000 s
Benchmarking <K = 17, N_USERS = 65530, N_CURRENCIES = 1> opening user inclusion: Collecting 10 samples in estimated 9.8197 s (110 iterations)
Benchmarking <K = 17, N_USERS = 65530, N_CURRENCIES = 1> opening user inclusion: Analyzing
<K = 17, N_USERS = 65530, N_CURRENCIES = 1> opening user inclusion
time: [87.526 ms 88.355 ms 89.513 ms]
change: [-51.397% -50.122% -48.691%] (p = 0.00 < 0.05)
Performance has improved.
Found 2 outliers among 10 measurements (20.00%)
1 (10.00%) high mild
1 (10.00%) high severe
Benchmarking <K = 17, N_USERS = 65530, N_CURRENCIES = 1> verifying grand sum
Benchmarking <K = 17, N_USERS = 65530, N_CURRENCIES = 1> verifying grand sum: Warming up for 3.0000 s
Benchmarking <K = 17, N_USERS = 65530, N_CURRENCIES = 1> verifying grand sum: Collecting 10 samples in estimated 5.0297 s (2420 iterations)
Benchmarking <K = 17, N_USERS = 65530, N_CURRENCIES = 1> verifying grand sum: Analyzing
<K = 17, N_USERS = 65530, N_CURRENCIES = 1> verifying grand sum
time: [2.0799 ms 2.0802 ms 2.0806 ms]
change: [-11.968% -11.955% -11.943%] (p = 0.00 < 0.05)
Performance has improved.
Benchmarking <K = 17, N_USERS = 65530, N_CURRENCIES = 1> verifying user inclusion
Benchmarking <K = 17, N_USERS = 65530, N_CURRENCIES = 1> verifying user inclusion: Warming up for 3.0000 s
Benchmarking <K = 17, N_USERS = 65530, N_CURRENCIES = 1> verifying user inclusion: Collecting 10 samples in estimated 5.0531 s (2145 iterations)
Benchmarking <K = 17, N_USERS = 65530, N_CURRENCIES = 1> verifying user inclusion: Analyzing
<K = 17, N_USERS = 65530, N_CURRENCIES = 1> verifying user inclusion
time: [2.3483 ms 2.3485 ms 2.3488 ms]
change: [-3.8289% -3.8058% -3.7837%] (p = 0.00 < 0.05)
Performance has improved.
Start: None Creating params
End: None Creating params ......................................................4.706s
Benchmarking <K = 18, N_USERS = 131072, N_CURRENCIES = 1> range check
Benchmarking <K = 18, N_USERS = 131072, N_CURRENCIES = 1> range check: Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target time to 123.9s.
Benchmarking <K = 18, N_USERS = 131072, N_CURRENCIES = 1> range check: Collecting 10 samples in estimated 123.94 s (10 iterations)
Benchmarking <K = 18, N_USERS = 131072, N_CURRENCIES = 1> range check: Analyzing
<K = 18, N_USERS = 131072, N_CURRENCIES = 1> range check
time: [12.303 s 12.325 s 12.348 s]
change: [+2.9157% +3.1922% +3.4789%] (p = 0.00 < 0.05)
Performance has regressed.
Benchmarking <K = 18, N_USERS = 131072, N_CURRENCIES = 1> opening grand sum
Benchmarking <K = 18, N_USERS = 131072, N_CURRENCIES = 1> opening grand sum: Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target time to 8.6s or enable flat sampling.
Benchmarking <K = 18, N_USERS = 131072, N_CURRENCIES = 1> opening grand sum: Collecting 10 samples in estimated 8.6181 s (55 iterations)
Benchmarking <K = 18, N_USERS = 131072, N_CURRENCIES = 1> opening grand sum: Analyzing
<K = 18, N_USERS = 131072, N_CURRENCIES = 1> opening grand sum
time: [157.02 ms 159.59 ms 162.55 ms]
change: [-50.720% -49.094% -47.116%] (p = 0.00 < 0.05)
Performance has improved.
Benchmarking <K = 18, N_USERS = 131072, N_CURRENCIES = 1> opening user inclusion
Benchmarking <K = 18, N_USERS = 131072, N_CURRENCIES = 1> opening user inclusion: Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target time to 8.9s or enable flat sampling.
Benchmarking <K = 18, N_USERS = 131072, N_CURRENCIES = 1> opening user inclusion: Collecting 10 samples in estimated 8.8523 s (55 iterations)
Benchmarking <K = 18, N_USERS = 131072, N_CURRENCIES = 1> opening user inclusion: Analyzing
<K = 18, N_USERS = 131072, N_CURRENCIES = 1> opening user inclusion
time: [158.96 ms 160.91 ms 162.79 ms]
change: [-51.716% -50.175% -48.873%] (p = 0.00 < 0.05)
Performance has improved.
Found 1 outliers among 10 measurements (10.00%)
1 (10.00%) high severe
Benchmarking <K = 18, N_USERS = 131072, N_CURRENCIES = 1> verifying grand sum
Benchmarking <K = 18, N_USERS = 131072, N_CURRENCIES = 1> verifying grand sum: Warming up for 3.0000 s
Benchmarking <K = 18, N_USERS = 131072, N_CURRENCIES = 1> verifying grand sum: Collecting 10 samples in estimated 5.0408 s (2420 iterations)
Benchmarking <K = 18, N_USERS = 131072, N_CURRENCIES = 1> verifying grand sum: Analyzing
<K = 18, N_USERS = 131072, N_CURRENCIES = 1> verifying grand sum
time: [2.0846 ms 2.0847 ms 2.0849 ms]
change: [-12.000% -11.991% -11.981%] (p = 0.00 < 0.05)
Performance has improved.
Benchmarking <K = 18, N_USERS = 131072, N_CURRENCIES = 1> verifying user inclusion
Benchmarking <K = 18, N_USERS = 131072, N_CURRENCIES = 1> verifying user inclusion: Warming up for 3.0000 s
Benchmarking <K = 18, N_USERS = 131072, N_CURRENCIES = 1> verifying user inclusion: Collecting 10 samples in estimated 5.0660 s (2145 iterations)
Benchmarking <K = 18, N_USERS = 131072, N_CURRENCIES = 1> verifying user inclusion: Analyzing
<K = 18, N_USERS = 131072, N_CURRENCIES = 1> verifying user inclusion
time: [2.3539 ms 2.3541 ms 2.3543 ms]
change: [-3.7339% -3.7217% -3.7082%] (p = 0.00 < 0.05)
Performance has improved.
Found 1 outliers among 10 measurements (10.00%)
1 (10.00%) high mild
Start: None Creating params
End: None Creating params ......................................................9.420s
Benchmarking <K = 19, N_USERS = 262144, N_CURRENCIES = 1> range check
Benchmarking <K = 19, N_USERS = 262144, N_CURRENCIES = 1> range check: Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target time to 241.2s.
Benchmarking <K = 19, N_USERS = 262144, N_CURRENCIES = 1> range check: Collecting 10 samples in estimated 241.24 s (10 iterations)
Benchmarking <K = 19, N_USERS = 262144, N_CURRENCIES = 1> range check: Analyzing
<K = 19, N_USERS = 262144, N_CURRENCIES = 1> range check
time: [24.161 s 24.221 s 24.280 s]
change: [+3.2638% +3.5649% +3.8839%] (p = 0.00 < 0.05)
Performance has regressed.
Benchmarking <K = 19, N_USERS = 262144, N_CURRENCIES = 1> opening grand sum
Benchmarking <K = 19, N_USERS = 262144, N_CURRENCIES = 1> opening grand sum: Warming up for 3.0000 s
Benchmarking <K = 19, N_USERS = 262144, N_CURRENCIES = 1> opening grand sum: Collecting 10 samples in estimated 5.7043 s (20 iterations)
Benchmarking <K = 19, N_USERS = 262144, N_CURRENCIES = 1> opening grand sum: Analyzing
<K = 19, N_USERS = 262144, N_CURRENCIES = 1> opening grand sum
time: [277.66 ms 279.16 ms 280.91 ms]
change: [-53.148% -51.971% -51.004%] (p = 0.00 < 0.05)
Performance has improved.
Benchmarking <K = 19, N_USERS = 262144, N_CURRENCIES = 1> opening user inclusion
Benchmarking <K = 19, N_USERS = 262144, N_CURRENCIES = 1> opening user inclusion: Warming up for 3.0000 s
Benchmarking <K = 19, N_USERS = 262144, N_CURRENCIES = 1> opening user inclusion: Collecting 10 samples in estimated 5.8407 s (20 iterations)
Benchmarking <K = 19, N_USERS = 262144, N_CURRENCIES = 1> opening user inclusion: Analyzing
<K = 19, N_USERS = 262144, N_CURRENCIES = 1> opening user inclusion
time: [286.16 ms 289.83 ms 294.84 ms]
change: [-51.066% -50.030% -48.966%] (p = 0.00 < 0.05)
Performance has improved.
Found 2 outliers among 10 measurements (20.00%)
2 (20.00%) high severe
Benchmarking <K = 19, N_USERS = 262144, N_CURRENCIES = 1> verifying grand sum
Benchmarking <K = 19, N_USERS = 262144, N_CURRENCIES = 1> verifying grand sum: Warming up for 3.0000 s
Benchmarking <K = 19, N_USERS = 262144, N_CURRENCIES = 1> verifying grand sum: Collecting 10 samples in estimated 5.0383 s (2420 iterations)
Benchmarking <K = 19, N_USERS = 262144, N_CURRENCIES = 1> verifying grand sum: Analyzing
<K = 19, N_USERS = 262144, N_CURRENCIES = 1> verifying grand sum
time: [2.0835 ms 2.0839 ms 2.0844 ms]
change: [-12.129% -12.119% -12.107%] (p = 0.00 < 0.05)
Performance has improved.
Found 2 outliers among 10 measurements (20.00%)
1 (10.00%) low mild
1 (10.00%) high severe
Benchmarking <K = 19, N_USERS = 262144, N_CURRENCIES = 1> verifying user inclusion
Benchmarking <K = 19, N_USERS = 262144, N_CURRENCIES = 1> verifying user inclusion: Warming up for 3.0000 s
Benchmarking <K = 19, N_USERS = 262144, N_CURRENCIES = 1> verifying user inclusion: Collecting 10 samples in estimated 5.0583 s (2145 iterations)
Benchmarking <K = 19, N_USERS = 262144, N_CURRENCIES = 1> verifying user inclusion: Analyzing
<K = 19, N_USERS = 262144, N_CURRENCIES = 1> verifying user inclusion
time: [2.3499 ms 2.3501 ms 2.3503 ms]
change: [-3.8788% -3.8637% -3.8495%] (p = 0.00 < 0.05)
Performance has improved.
Start: None Creating params
End: None Creating params ......................................................18.714s
Benchmarking <K = 20, N_USERS = 524288, N_CURRENCIES = 1> range check
Benchmarking <K = 20, N_USERS = 524288, N_CURRENCIES = 1> range check: Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target time to 499.8s.
Benchmarking <K = 20, N_USERS = 524288, N_CURRENCIES = 1> range check: Collecting 10 samples in estimated 499.77 s (10 iterations)
Benchmarking <K = 20, N_USERS = 524288, N_CURRENCIES = 1> range check: Analyzing
<K = 20, N_USERS = 524288, N_CURRENCIES = 1> range check
time: [50.201 s 50.256 s 50.300 s]
change: [+4.7983% +5.0165% +5.2550%] (p = 0.00 < 0.05)
Performance has regressed.
Found 1 outliers among 10 measurements (10.00%)
1 (10.00%) low mild
Benchmarking <K = 20, N_USERS = 524288, N_CURRENCIES = 1> opening grand sum
Benchmarking <K = 20, N_USERS = 524288, N_CURRENCIES = 1> opening grand sum: Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target time to 5.2s.
Benchmarking <K = 20, N_USERS = 524288, N_CURRENCIES = 1> opening grand sum: Collecting 10 samples in estimated 5.2235 s (10 iterations)
Benchmarking <K = 20, N_USERS = 524288, N_CURRENCIES = 1> opening grand sum: Analyzing
<K = 20, N_USERS = 524288, N_CURRENCIES = 1> opening grand sum
time: [521.22 ms 521.97 ms 523.20 ms]
change: [-51.320% -50.796% -50.456%] (p = 0.00 < 0.05)
Performance has improved.
Found 1 outliers among 10 measurements (10.00%)
1 (10.00%) high severe
Benchmarking <K = 20, N_USERS = 524288, N_CURRENCIES = 1> opening user inclusion
Benchmarking <K = 20, N_USERS = 524288, N_CURRENCIES = 1> opening user inclusion: Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target time to 5.3s.
Benchmarking <K = 20, N_USERS = 524288, N_CURRENCIES = 1> opening user inclusion: Collecting 10 samples in estimated 5.2929 s (10 iterations)
Benchmarking <K = 20, N_USERS = 524288, N_CURRENCIES = 1> opening user inclusion: Analyzing
<K = 20, N_USERS = 524288, N_CURRENCIES = 1> opening user inclusion
time: [528.29 ms 530.98 ms 535.95 ms]
change: [-52.423% -52.112% -51.622%] (p = 0.00 < 0.05)
Performance has improved.
Found 1 outliers among 10 measurements (10.00%)
1 (10.00%) high severe
Benchmarking <K = 20, N_USERS = 524288, N_CURRENCIES = 1> verifying grand sum
Benchmarking <K = 20, N_USERS = 524288, N_CURRENCIES = 1> verifying grand sum: Warming up for 3.0000 s
Benchmarking <K = 20, N_USERS = 524288, N_CURRENCIES = 1> verifying grand sum: Collecting 10 samples in estimated 5.0472 s (2420 iterations)
Benchmarking <K = 20, N_USERS = 524288, N_CURRENCIES = 1> verifying grand sum: Analyzing
<K = 20, N_USERS = 524288, N_CURRENCIES = 1> verifying grand sum
time: [2.0865 ms 2.0867 ms 2.0871 ms]
change: [-11.871% -11.848% -11.827%] (p = 0.00 < 0.05)
Performance has improved.
Benchmarking <K = 20, N_USERS = 524288, N_CURRENCIES = 1> verifying user inclusion
Benchmarking <K = 20, N_USERS = 524288, N_CURRENCIES = 1> verifying user inclusion: Warming up for 3.0000 s
Benchmarking <K = 20, N_USERS = 524288, N_CURRENCIES = 1> verifying user inclusion: Collecting 10 samples in estimated 5.0741 s (2145 iterations)
Benchmarking <K = 20, N_USERS = 524288, N_CURRENCIES = 1> verifying user inclusion: Analyzing
<K = 20, N_USERS = 524288, N_CURRENCIES = 1> verifying user inclusion
time: [2.3573 ms 2.3580 ms 2.3584 ms]
change: [-3.6711% -3.6376% -3.6046%] (p = 0.00 < 0.05)
Performance has improved.
Start: None Creating params
End: None Creating params ......................................................37.626s
Benchmarking <K = 21, N_USERS = 1048576, N_CURRENCIES = 1> range check
Benchmarking <K = 21, N_USERS = 1048576, N_CURRENCIES = 1> range check: Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target time to 992.8s.
Benchmarking <K = 21, N_USERS = 1048576, N_CURRENCIES = 1> range check: Collecting 10 samples in estimated 992.84 s (10 iterations)
Benchmarking <K = 21, N_USERS = 1048576, N_CURRENCIES = 1> range check: Analyzing
<K = 21, N_USERS = 1048576, N_CURRENCIES = 1> range check
time: [100.21 s 103.54 s 107.68 s]
change: [+4.6166% +8.3546% +12.593%] (p = 0.00 < 0.05)
Performance has regressed.
Found 1 outliers among 10 measurements (10.00%)
1 (10.00%) high mild
Benchmarking <K = 21, N_USERS = 1048576, N_CURRENCIES = 1> opening grand sum
Benchmarking <K = 21, N_USERS = 1048576, N_CURRENCIES = 1> opening grand sum: Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target time to 12.8s.
Benchmarking <K = 21, N_USERS = 1048576, N_CURRENCIES = 1> opening grand sum: Collecting 10 samples in estimated 12.763 s (10 iterations)
Benchmarking <K = 21, N_USERS = 1048576, N_CURRENCIES = 1> opening grand sum: Analyzing
<K = 21, N_USERS = 1048576, N_CURRENCIES = 1> opening grand sum
time: [1.2405 s 1.3415 s 1.4613 s]
change: [-38.200% -32.745% -26.603%] (p = 0.00 < 0.05)
Performance has improved.
Found 1 outliers among 10 measurements (10.00%)
1 (10.00%) high mild
Benchmarking <K = 21, N_USERS = 1048576, N_CURRENCIES = 1> opening user inclusion
Benchmarking <K = 21, N_USERS = 1048576, N_CURRENCIES = 1> opening user inclusion: Warming up for 3.0000 s
Warning: Unable to complete 10 samples in 5.0s. You may wish to increase target time to 12.8s.
Benchmarking <K = 21, N_USERS = 1048576, N_CURRENCIES = 1> opening user inclusion: Collecting 10 samples in estimated 12.816 s (10 iterations)
Benchmarking <K = 21, N_USERS = 1048576, N_CURRENCIES = 1> opening user inclusion: Analyzing
<K = 21, N_USERS = 1048576, N_CURRENCIES = 1> opening user inclusion
time: [1.3741 s 1.4491 s 1.5429 s]
change: [-34.124% -30.600% -25.670%] (p = 0.00 < 0.05)
Performance has improved.
Found 1 outliers among 10 measurements (10.00%)
1 (10.00%) high mild
Benchmarking <K = 21, N_USERS = 1048576, N_CURRENCIES = 1> verifying grand sum
Benchmarking <K = 21, N_USERS = 1048576, N_CURRENCIES = 1> verifying grand sum: Warming up for 3.0000 s
Benchmarking <K = 21, N_USERS = 1048576, N_CURRENCIES = 1> verifying grand sum: Collecting 10 samples in estimated 5.0743 s (2365 iterations)
Benchmarking <K = 21, N_USERS = 1048576, N_CURRENCIES = 1> verifying grand sum: Analyzing
<K = 21, N_USERS = 1048576, N_CURRENCIES = 1> verifying grand sum
time: [2.0953 ms 2.1729 ms 2.3234 ms]
change: [-10.810% -6.8600% -2.2662%] (p = 0.01 < 0.05)
Performance has improved.
Benchmarking <K = 21, N_USERS = 1048576, N_CURRENCIES = 1> verifying user inclusion
Benchmarking <K = 21, N_USERS = 1048576, N_CURRENCIES = 1> verifying user inclusion: Warming up for 3.0000 s
Benchmarking <K = 21, N_USERS = 1048576, N_CURRENCIES = 1> verifying user inclusion: Collecting 10 samples in estimated 5.0622 s (2035 iterations)
Benchmarking <K = 21, N_USERS = 1048576, N_CURRENCIES = 1> verifying user inclusion: Analyzing
<K = 21, N_USERS = 1048576, N_CURRENCIES = 1> verifying user inclusion
time: [2.3620 ms 2.4360 ms 2.5602 ms]
change: [-3.4641% -0.7084% +3.2775%] (p = 0.75 > 0.05)
No change in performance detected.
Found 2 outliers among 10 measurements (20.00%)
1 (10.00%) high mild
1 (10.00%) high severe
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment