Skip to content

Instantly share code, notes, and snippets.

@chfast
Last active June 11, 2020 11:23
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save chfast/83b410db3cc7372c67d78a7ab468117d to your computer and use it in GitHub Desktop.
Save chfast/83b410db3cc7372c67d78a7ab468117d to your computer and use it in GitHub Desktop.
# Get data with:
> bin/fizzy-bench ../../test/benchmarks --benchmark_min_time=1 --benchmark_repetitions=10 --be
nchmark_filter='(fizzy|wabt).*bls' --benchmark_out=bls
# Compare benchmark filters, aggregate data with compare.py from https://github.com/google/benchmark/blob/master/tools/compare.py (it requires some dependencies to be installed with pip).
> compare.py -a filters bls 'fizzy' ' wabt'
Comparing fizzy to wabt (from bls)
Benchmark Time CPU Time Old Time New CPU Old CPU New
----------------------------------------------------------------------------------------------------------------------------------------------------
[fizzy vs. wabt]/parse/bls12_websnark_pvalue 0.0002 0.0002 U Test, Repetitions: 10 vs 10
[fizzy vs. wabt]/parse/bls12_websnark_mean +2.9410 +2.9410 445 1755 445 1755
[fizzy vs. wabt]/parse/bls12_websnark_median +2.9358 +2.9358 445 1753 445 1753
[fizzy vs. wabt]/parse/bls12_websnark_stddev +1.0286 +1.0280 2 4 2 4
[fizzy vs. wabt]/instantiate/bls12_websnark_pvalue 0.0002 0.0002 U Test, Repetitions: 10 vs 10
[fizzy vs. wabt]/instantiate/bls12_websnark_mean +2.1949 +2.1948 509 1627 509 1627
[fizzy vs. wabt]/instantiate/bls12_websnark_median +2.1285 +2.1284 509 1593 509 1593
[fizzy vs. wabt]/instantiate/bls12_websnark_stddev +64.9332 +64.8631 1 69 1 69
[fizzy vs. wabt]/execute/bls12_websnark/synth_pvalue 0.0002 0.0002 U Test, Repetitions: 10 vs 10
[fizzy vs. wabt]/execute/bls12_websnark/synth_mean +0.5395 +0.5395 265302 408422 265305 408426
[fizzy vs. wabt]/execute/bls12_websnark/synth_median +0.5350 +0.5350 264991 406771 264994 406775
[fizzy vs. wabt]/execute/bls12_websnark/synth_stddev +3.1292 +3.1295 711 2934 710 2934
# Only mean values:
[fizzy vs. wabt]/parse/bls12_websnark_mean +2.9410 +2.9410 445 1755 445 1755
[fizzy vs. wabt]/instantiate/bls12_websnark_mean +2.1949 +2.1948 509 1627 509 1627
[fizzy vs. wabt]/execute/bls12_websnark/synth_mean +0.5395 +0.5395 265302 408422 265305 408426
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment