Skip to content

Instantly share code, notes, and snippets.

@1st1
Created January 14, 2016 16:39
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save 1st1/e00f11586329f68fd490 to your computer and use it in GitHub Desktop.
Save 1st1/e00f11586329f68fd490 to your computer and use it in GitHub Desktop.
yury@ysmac ~/dev/py/benchmarks $ python3 perf.py -b calls,richards,all,-tornado_http,template ../cpython/python.exe ../cpython-git/python.exe
INFO:root:Automatically selected timer: perf_counter
INFO:root:Skipping benchmark spambayes; not compatible with Python 3.6
INFO:root:Skipping benchmark slowspitfire; not compatible with Python 3.6
INFO:root:Skipping benchmark rietveld; not compatible with Python 3.6
INFO:root:Skipping benchmark pybench; not compatible with Python 3.6
INFO:root:Skipping benchmark slowpickle; not compatible with Python 3.6
INFO:root:Skipping benchmark html5lib; not compatible with Python 3.6
INFO:root:Skipping benchmark html5lib_warmup; not compatible with Python 3.6
INFO:root:Skipping benchmark bzr_startup; not compatible with Python 3.6
INFO:root:Skipping benchmark hg_startup; not compatible with Python 3.6
INFO:root:Skipping benchmark slowunpickle; not compatible with Python 3.6
[ 1/42] 2to3...
INFO:root:Running `../cpython-git/python.exe lib3/2to3/2to3 -f all lib/2to3`
INFO:root:Running `../cpython-git/python.exe lib3/2to3/2to3 -f all lib/2to3` 1 time
INFO:root:Running `../cpython/python.exe lib3/2to3/2to3 -f all lib/2to3`
INFO:root:Running `../cpython/python.exe lib3/2to3/2to3 -f all lib/2to3` 1 time
[ 2/42] call_method...
INFO:root:Running `../cpython-git/python.exe performance/bm_call_method.py -n 150 --timer perf_counter`
INFO:root:Running `../cpython/python.exe performance/bm_call_method.py -n 150 --timer perf_counter`
[ 3/42] call_method_slots...
INFO:root:Running `../cpython-git/python.exe performance/bm_call_method_slots.py -n 150 --timer perf_counter`
INFO:root:Running `../cpython/python.exe performance/bm_call_method_slots.py -n 150 --timer perf_counter`
[ 4/42] call_method_unknown...
INFO:root:Running `../cpython-git/python.exe performance/bm_call_method_unknown.py -n 150 --timer perf_counter`
INFO:root:Running `../cpython/python.exe performance/bm_call_method_unknown.py -n 150 --timer perf_counter`
[ 5/42] call_simple...
INFO:root:Running `../cpython-git/python.exe performance/bm_call_simple.py -n 150 --timer perf_counter`
INFO:root:Running `../cpython/python.exe performance/bm_call_simple.py -n 150 --timer perf_counter`
[ 6/42] chameleon_v2...
INFO:root:Running `../cpython-git/python.exe performance/bm_chameleon_v2.py -n 50 --timer perf_counter`
INFO:root:Running `../cpython/python.exe performance/bm_chameleon_v2.py -n 50 --timer perf_counter`
[ 7/42] chaos...
INFO:root:Running `../cpython-git/python.exe performance/bm_chaos.py -n 50 --timer perf_counter`
INFO:root:Running `../cpython/python.exe performance/bm_chaos.py -n 50 --timer perf_counter`
[ 8/42] django_v3...
INFO:root:Running `../cpython-git/python.exe performance/bm_django_v3.py -n 50 --timer perf_counter`
INFO:root:Running `../cpython/python.exe performance/bm_django_v3.py -n 50 --timer perf_counter`
[ 9/42] etree_generate...
INFO:root:Running `../cpython-git/python.exe performance/bm_elementtree.py -n 50 --timer perf_counter generate`
INFO:root:Running `../cpython/python.exe performance/bm_elementtree.py -n 50 --timer perf_counter generate`
[10/42] etree_iterparse...
INFO:root:Running `../cpython-git/python.exe performance/bm_elementtree.py -n 50 --timer perf_counter iterparse`
INFO:root:Running `../cpython/python.exe performance/bm_elementtree.py -n 50 --timer perf_counter iterparse`
[11/42] etree_parse...
INFO:root:Running `../cpython-git/python.exe performance/bm_elementtree.py -n 50 --timer perf_counter parse`
INFO:root:Running `../cpython/python.exe performance/bm_elementtree.py -n 50 --timer perf_counter parse`
[12/42] etree_process...
INFO:root:Running `../cpython-git/python.exe performance/bm_elementtree.py -n 50 --timer perf_counter process`
INFO:root:Running `../cpython/python.exe performance/bm_elementtree.py -n 50 --timer perf_counter process`
[13/42] fannkuch...
INFO:root:Running `../cpython-git/python.exe performance/bm_fannkuch.py -n 50 --timer perf_counter`
INFO:root:Running `../cpython/python.exe performance/bm_fannkuch.py -n 50 --timer perf_counter`
[14/42] fastpickle...
INFO:root:Running `../cpython-git/python.exe performance/bm_pickle.py -n 50 --timer perf_counter --use_cpickle pickle`
INFO:root:Running `../cpython/python.exe performance/bm_pickle.py -n 50 --timer perf_counter --use_cpickle pickle`
[15/42] fastunpickle...
INFO:root:Running `../cpython-git/python.exe performance/bm_pickle.py -n 50 --timer perf_counter --use_cpickle unpickle`
INFO:root:Running `../cpython/python.exe performance/bm_pickle.py -n 50 --timer perf_counter --use_cpickle unpickle`
[16/42] float...
INFO:root:Running `../cpython-git/python.exe performance/bm_float.py -n 50 --timer perf_counter`
INFO:root:Running `../cpython/python.exe performance/bm_float.py -n 50 --timer perf_counter`
[17/42] formatted_logging...
INFO:root:Running `../cpython-git/python.exe performance/bm_logging.py -n 50 --timer perf_counter formatted_output`
INFO:root:Running `../cpython/python.exe performance/bm_logging.py -n 50 --timer perf_counter formatted_output`
[18/42] go...
INFO:root:Running `../cpython-git/python.exe performance/bm_go.py -n 50 --timer perf_counter`
INFO:root:Running `../cpython/python.exe performance/bm_go.py -n 50 --timer perf_counter`
[19/42] hexiom2...
INFO:root:Running `../cpython-git/python.exe performance/bm_hexiom2.py -n 2 --timer perf_counter`
INFO:root:Running `../cpython/python.exe performance/bm_hexiom2.py -n 2 --timer perf_counter`
[20/42] json_dump_v2...
INFO:root:Running `../cpython-git/python.exe performance/bm_json_v2.py -n 50 --timer perf_counter`
INFO:root:Running `../cpython/python.exe performance/bm_json_v2.py -n 50 --timer perf_counter`
[21/42] json_load...
INFO:root:Running `../cpython-git/python.exe performance/bm_json.py -n 50 --timer perf_counter json_load`
INFO:root:Running `../cpython/python.exe performance/bm_json.py -n 50 --timer perf_counter json_load`
[22/42] mako_v2...
INFO:root:Running `../cpython-git/python.exe performance/bm_mako_v2.py -n 500 --timer perf_counter`
INFO:root:Running `../cpython/python.exe performance/bm_mako_v2.py -n 500 --timer perf_counter`
[23/42] meteor_contest...
INFO:root:Running `../cpython-git/python.exe performance/bm_meteor_contest.py -n 50 --timer perf_counter`
INFO:root:Running `../cpython/python.exe performance/bm_meteor_contest.py -n 50 --timer perf_counter`
[24/42] nbody...
INFO:root:Running `../cpython-git/python.exe performance/bm_nbody.py -n 50 --timer perf_counter`
INFO:root:Running `../cpython/python.exe performance/bm_nbody.py -n 50 --timer perf_counter`
[25/42] normal_startup...
INFO:root:Running `../cpython-git/python.exe -c ` 1000 times
INFO:root:Running `../cpython/python.exe -c ` 1000 times
[26/42] nqueens...
INFO:root:Running `../cpython-git/python.exe performance/bm_nqueens.py -n 50 --timer perf_counter`
INFO:root:Running `../cpython/python.exe performance/bm_nqueens.py -n 50 --timer perf_counter`
[27/42] pathlib...
INFO:root:Running `../cpython-git/python.exe performance/bm_pathlib.py -n 500 --timer perf_counter`
INFO:root:Running `../cpython/python.exe performance/bm_pathlib.py -n 500 --timer perf_counter`
[28/42] pickle_dict...
INFO:root:Running `../cpython-git/python.exe performance/bm_pickle.py -n 50 --timer perf_counter --use_cpickle pickle_dict`
INFO:root:Running `../cpython/python.exe performance/bm_pickle.py -n 50 --timer perf_counter --use_cpickle pickle_dict`
[29/42] pickle_list...
INFO:root:Running `../cpython-git/python.exe performance/bm_pickle.py -n 50 --timer perf_counter --use_cpickle pickle_list`
INFO:root:Running `../cpython/python.exe performance/bm_pickle.py -n 50 --timer perf_counter --use_cpickle pickle_list`
[30/42] pidigits...
INFO:root:Running `../cpython-git/python.exe performance/bm_pidigits.py -n 50 --timer perf_counter`
INFO:root:Running `../cpython/python.exe performance/bm_pidigits.py -n 50 --timer perf_counter`
[31/42] raytrace...
INFO:root:Running `../cpython-git/python.exe performance/bm_raytrace.py -n 50 --timer perf_counter`
INFO:root:Running `../cpython/python.exe performance/bm_raytrace.py -n 50 --timer perf_counter`
[32/42] regex_compile...
INFO:root:Running `../cpython-git/python.exe performance/bm_regex_compile.py -n 50 --timer perf_counter`
INFO:root:Running `../cpython/python.exe performance/bm_regex_compile.py -n 50 --timer perf_counter`
[33/42] regex_effbot...
INFO:root:Running `../cpython-git/python.exe performance/bm_regex_effbot.py -n 50 --timer perf_counter`
INFO:root:Running `../cpython/python.exe performance/bm_regex_effbot.py -n 50 --timer perf_counter`
[34/42] regex_v8...
INFO:root:Running `../cpython-git/python.exe performance/bm_regex_v8.py -n 50 --timer perf_counter`
INFO:root:Running `../cpython/python.exe performance/bm_regex_v8.py -n 50 --timer perf_counter`
[35/42] richards...
INFO:root:Running `../cpython-git/python.exe performance/bm_richards.py -n 50 --timer perf_counter`
INFO:root:Running `../cpython/python.exe performance/bm_richards.py -n 50 --timer perf_counter`
[36/42] silent_logging...
INFO:root:Running `../cpython-git/python.exe performance/bm_logging.py -n 50 --timer perf_counter no_output`
INFO:root:Running `../cpython/python.exe performance/bm_logging.py -n 50 --timer perf_counter no_output`
[37/42] simple_logging...
INFO:root:Running `../cpython-git/python.exe performance/bm_logging.py -n 50 --timer perf_counter simple_output`
INFO:root:Running `../cpython/python.exe performance/bm_logging.py -n 50 --timer perf_counter simple_output`
[38/42] spectral_norm...
INFO:root:Running `../cpython-git/python.exe performance/bm_spectral_norm.py -n 50 --timer perf_counter`
INFO:root:Running `../cpython/python.exe performance/bm_spectral_norm.py -n 50 --timer perf_counter`
[39/42] startup_nosite...
INFO:root:Running `../cpython-git/python.exe -S -c ` 2000 times
INFO:root:Running `../cpython/python.exe -S -c ` 2000 times
[40/42] telco...
INFO:root:Running `../cpython-git/python.exe performance/bm_telco.py -n 50 --timer perf_counter`
INFO:root:Running `../cpython/python.exe performance/bm_telco.py -n 50 --timer perf_counter`
[41/42] unpack_sequence...
INFO:root:Running `../cpython-git/python.exe performance/bm_unpack_sequence.py -n 50000 --timer perf_counter`
INFO:root:Running `../cpython/python.exe performance/bm_unpack_sequence.py -n 50000 --timer perf_counter`
[42/42] unpickle_list...
INFO:root:Running `../cpython-git/python.exe performance/bm_pickle.py -n 50 --timer perf_counter --use_cpickle unpickle_list`
INFO:root:Running `../cpython/python.exe performance/bm_pickle.py -n 50 --timer perf_counter --use_cpickle unpickle_list`
Report on Darwin ysmac 15.2.0 Darwin Kernel Version 15.2.0: Fri Nov 13 19:56:56 PST 2015; root:xnu-3248.20.55~2/RELEASE_X86_64 x86_64 i386
Total CPU cores: 8
### 2to3 ###
6.204514 -> 6.125281: 1.01x faster
### call_method ###
Min: 0.305086 -> 0.260570: 1.17x faster
Avg: 0.330371 -> 0.281452: 1.17x faster
Significant (t=42.75)
Stddev: 0.01029 -> 0.00952: 1.0808x smaller
### call_method_slots ###
Min: 0.320291 -> 0.265991: 1.20x faster
Avg: 0.333489 -> 0.280612: 1.19x faster
Significant (t=17.51)
Stddev: 0.00741 -> 0.00905: 1.2218x larger
### call_method_unknown ###
Min: 0.305636 -> 0.266716: 1.15x faster
Avg: 0.330182 -> 0.286476: 1.15x faster
Significant (t=30.99)
Stddev: 0.01153 -> 0.01287: 1.1161x larger
### call_simple ###
Min: 0.244161 -> 0.237890: 1.03x faster
Avg: 0.264811 -> 0.257741: 1.03x faster
Significant (t=6.85)
Stddev: 0.00879 -> 0.00907: 1.0323x larger
### chameleon_v2 ###
Min: 4.258404 -> 4.334001: 1.02x slower
Avg: 4.329534 -> 4.425844: 1.02x slower
Significant (t=-9.37)
Stddev: 0.03972 -> 0.06087: 1.5323x larger
### etree_iterparse ###
Min: 0.179593 -> 0.186016: 1.04x slower
Avg: 0.194562 -> 0.204869: 1.05x slower
Significant (t=-6.40)
Stddev: 0.00547 -> 0.00999: 1.8259x larger
### fastpickle ###
Min: 0.452639 -> 0.420982: 1.08x faster
Avg: 0.483867 -> 0.447386: 1.08x faster
Significant (t=15.08)
Stddev: 0.01221 -> 0.01199: 1.0181x smaller
### json_dump_v2 ###
Min: 2.746053 -> 2.844394: 1.04x slower
Avg: 2.810367 -> 2.946974: 1.05x slower
Significant (t=-16.67)
Stddev: 0.04674 -> 0.03423: 1.3654x smaller
### mako_v2 ###
Min: 0.032359 -> 0.031621: 1.02x faster
Avg: 0.036266 -> 0.035266: 1.03x faster
Significant (t=6.92)
Stddev: 0.00226 -> 0.00230: 1.0172x larger
### meteor_contest ###
Min: 0.209897 -> 0.190742: 1.10x faster
Avg: 0.220775 -> 0.203443: 1.09x faster
Significant (t=12.92)
Stddev: 0.00687 -> 0.00654: 1.0513x smaller
### nbody ###
Min: 0.214686 -> 0.222613: 1.04x slower
Avg: 0.231524 -> 0.237883: 1.03x slower
Significant (t=-3.98)
Stddev: 0.00785 -> 0.00814: 1.0361x larger
### pickle_dict ###
Min: 0.462587 -> 0.441879: 1.05x faster
Avg: 0.499921 -> 0.472716: 1.06x faster
Significant (t=8.72)
Stddev: 0.01638 -> 0.01477: 1.1089x smaller
### pickle_list ###
Min: 0.273654 -> 0.265191: 1.03x faster
Avg: 0.292243 -> 0.286346: 1.02x faster
Significant (t=3.34)
Stddev: 0.00865 -> 0.00902: 1.0427x larger
### raytrace ###
Min: 1.203398 -> 1.182318: 1.02x faster
Avg: 1.272073 -> 1.237169: 1.03x faster
Significant (t=5.34)
Stddev: 0.03893 -> 0.02497: 1.5594x smaller
### regex_effbot ###
Min: 0.048941 -> 0.048624: 1.01x faster
Avg: 0.052992 -> 0.055063: 1.04x slower
Significant (t=-3.51)
Stddev: 0.00288 -> 0.00302: 1.0474x larger
### richards ###
Min: 0.139602 -> 0.135395: 1.03x faster
Avg: 0.159637 -> 0.148732: 1.07x faster
Significant (t=3.96)
Stddev: 0.02652 -> 0.00734: 3.6150x smaller
### silent_logging ###
Min: 0.067794 -> 0.063858: 1.06x faster
Avg: 0.075437 -> 0.071926: 1.05x faster
Significant (t=6.29)
Stddev: 0.00381 -> 0.00409: 1.0733x larger
### simple_logging ###
Min: 0.217997 -> 0.211726: 1.03x faster
Avg: 0.233119 -> 0.222751: 1.05x faster
Significant (t=7.33)
Stddev: 0.00751 -> 0.00660: 1.1367x smaller
The following not significant results are hidden, use -v to show them:
chaos, django_v3, etree_generate, etree_parse, etree_process, fannkuch, fastunpickle, float, formatted_logging, go, hexiom2, json_load, normal_startup, nqueens, pathlib, pidigits, regex_compile, regex_v8, spectral_norm, startup_nosite, telco, unpack_sequence, unpickle_list.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment