Last active
June 11, 2020 11:23
-
-
Save chfast/83b410db3cc7372c67d78a7ab468117d to your computer and use it in GitHub Desktop.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
# Get data with: | |
> bin/fizzy-bench ../../test/benchmarks --benchmark_min_time=1 --benchmark_repetitions=10 --be | |
nchmark_filter='(fizzy|wabt).*bls' --benchmark_out=bls | |
# Compare benchmark filters, aggregate data with compare.py from https://github.com/google/benchmark/blob/master/tools/compare.py (it requires some dependencies to be installed with pip). | |
> compare.py -a filters bls 'fizzy' ' wabt' | |
Comparing fizzy to wabt (from bls) | |
Benchmark Time CPU Time Old Time New CPU Old CPU New | |
---------------------------------------------------------------------------------------------------------------------------------------------------- | |
[fizzy vs. wabt]/parse/bls12_websnark_pvalue 0.0002 0.0002 U Test, Repetitions: 10 vs 10 | |
[fizzy vs. wabt]/parse/bls12_websnark_mean +2.9410 +2.9410 445 1755 445 1755 | |
[fizzy vs. wabt]/parse/bls12_websnark_median +2.9358 +2.9358 445 1753 445 1753 | |
[fizzy vs. wabt]/parse/bls12_websnark_stddev +1.0286 +1.0280 2 4 2 4 | |
[fizzy vs. wabt]/instantiate/bls12_websnark_pvalue 0.0002 0.0002 U Test, Repetitions: 10 vs 10 | |
[fizzy vs. wabt]/instantiate/bls12_websnark_mean +2.1949 +2.1948 509 1627 509 1627 | |
[fizzy vs. wabt]/instantiate/bls12_websnark_median +2.1285 +2.1284 509 1593 509 1593 | |
[fizzy vs. wabt]/instantiate/bls12_websnark_stddev +64.9332 +64.8631 1 69 1 69 | |
[fizzy vs. wabt]/execute/bls12_websnark/synth_pvalue 0.0002 0.0002 U Test, Repetitions: 10 vs 10 | |
[fizzy vs. wabt]/execute/bls12_websnark/synth_mean +0.5395 +0.5395 265302 408422 265305 408426 | |
[fizzy vs. wabt]/execute/bls12_websnark/synth_median +0.5350 +0.5350 264991 406771 264994 406775 | |
[fizzy vs. wabt]/execute/bls12_websnark/synth_stddev +3.1292 +3.1295 711 2934 710 2934 | |
# Only mean values: | |
[fizzy vs. wabt]/parse/bls12_websnark_mean +2.9410 +2.9410 445 1755 445 1755 | |
[fizzy vs. wabt]/instantiate/bls12_websnark_mean +2.1949 +2.1948 509 1627 509 1627 | |
[fizzy vs. wabt]/execute/bls12_websnark/synth_mean +0.5395 +0.5395 265302 408422 265305 408426 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment