This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
# Get data with: | |
> bin/fizzy-bench ../../test/benchmarks --benchmark_min_time=1 --benchmark_repetitions=10 --be | |
nchmark_filter='(fizzy|wabt).*bls' --benchmark_out=bls | |
# Compare benchmark filters, aggregate data with compare.py from https://github.com/google/benchmark/blob/master/tools/compare.py (it requires some dependencies to be installed with pip). | |
> compare.py -a filters bls 'fizzy' ' wabt' | |
Comparing fizzy to wabt (from bls) | |
Benchmark Time CPU Time Old Time New CPU Old CPU New | |
---------------------------------------------------------------------------------------------------------------------------------------------------- | |
[fizzy vs. wabt]/parse/bls12_websnark_pvalue 0.0002 0.0002 U Test, Repetitions: 10 vs 10 | |
[fizzy vs. wabt]/parse/bls12_websnark_mean +2.9410 +2.9410 445 1755 445 1755 | |
[fizzy vs. wabt]/parse/bls12_websnark_median +2.9358 +2.9358 445 1753 445 1753 | |
[fizzy vs. wabt]/parse/bls12_websnark_stddev +1.0286 +1.0280 2 4 2 4 | |
[fizzy vs. wabt]/instantiate/bls12_websnark_pvalue 0.0002 0.0002 U Test, Repetitions: 10 vs 10 | |
[fizzy vs. wabt]/instantiate/bls12_websnark_mean +2.1949 +2.1948 509 1627 509 1627 | |
[fizzy vs. wabt]/instantiate/bls12_websnark_median +2.1285 +2.1284 509 1593 509 1593 | |
[fizzy vs. wabt]/instantiate/bls12_websnark_stddev +64.9332 +64.8631 1 69 1 69 | |
[fizzy vs. wabt]/execute/bls12_websnark/synth_pvalue 0.0002 0.0002 U Test, Repetitions: 10 vs 10 | |
[fizzy vs. wabt]/execute/bls12_websnark/synth_mean +0.5395 +0.5395 265302 408422 265305 408426 | |
[fizzy vs. wabt]/execute/bls12_websnark/synth_median +0.5350 +0.5350 264991 406771 264994 406775 | |
[fizzy vs. wabt]/execute/bls12_websnark/synth_stddev +3.1292 +3.1295 711 2934 710 2934 | |
# Only mean values: | |
[fizzy vs. wabt]/parse/bls12_websnark_mean +2.9410 +2.9410 445 1755 445 1755 | |
[fizzy vs. wabt]/instantiate/bls12_websnark_mean +2.1949 +2.1948 509 1627 509 1627 | |
[fizzy vs. wabt]/execute/bls12_websnark/synth_mean +0.5395 +0.5395 265302 408422 265305 408426 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment