Created
January 14, 2016 16:39
-
-
Save 1st1/e00f11586329f68fd490 to your computer and use it in GitHub Desktop.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
yury@ysmac ~/dev/py/benchmarks $ python3 perf.py -b calls,richards,all,-tornado_http,template ../cpython/python.exe ../cpython-git/python.exe | |
INFO:root:Automatically selected timer: perf_counter | |
INFO:root:Skipping benchmark spambayes; not compatible with Python 3.6 | |
INFO:root:Skipping benchmark slowspitfire; not compatible with Python 3.6 | |
INFO:root:Skipping benchmark rietveld; not compatible with Python 3.6 | |
INFO:root:Skipping benchmark pybench; not compatible with Python 3.6 | |
INFO:root:Skipping benchmark slowpickle; not compatible with Python 3.6 | |
INFO:root:Skipping benchmark html5lib; not compatible with Python 3.6 | |
INFO:root:Skipping benchmark html5lib_warmup; not compatible with Python 3.6 | |
INFO:root:Skipping benchmark bzr_startup; not compatible with Python 3.6 | |
INFO:root:Skipping benchmark hg_startup; not compatible with Python 3.6 | |
INFO:root:Skipping benchmark slowunpickle; not compatible with Python 3.6 | |
[ 1/42] 2to3... | |
INFO:root:Running `../cpython-git/python.exe lib3/2to3/2to3 -f all lib/2to3` | |
INFO:root:Running `../cpython-git/python.exe lib3/2to3/2to3 -f all lib/2to3` 1 time | |
INFO:root:Running `../cpython/python.exe lib3/2to3/2to3 -f all lib/2to3` | |
INFO:root:Running `../cpython/python.exe lib3/2to3/2to3 -f all lib/2to3` 1 time | |
[ 2/42] call_method... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_call_method.py -n 150 --timer perf_counter` | |
INFO:root:Running `../cpython/python.exe performance/bm_call_method.py -n 150 --timer perf_counter` | |
[ 3/42] call_method_slots... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_call_method_slots.py -n 150 --timer perf_counter` | |
INFO:root:Running `../cpython/python.exe performance/bm_call_method_slots.py -n 150 --timer perf_counter` | |
[ 4/42] call_method_unknown... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_call_method_unknown.py -n 150 --timer perf_counter` | |
INFO:root:Running `../cpython/python.exe performance/bm_call_method_unknown.py -n 150 --timer perf_counter` | |
[ 5/42] call_simple... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_call_simple.py -n 150 --timer perf_counter` | |
INFO:root:Running `../cpython/python.exe performance/bm_call_simple.py -n 150 --timer perf_counter` | |
[ 6/42] chameleon_v2... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_chameleon_v2.py -n 50 --timer perf_counter` | |
INFO:root:Running `../cpython/python.exe performance/bm_chameleon_v2.py -n 50 --timer perf_counter` | |
[ 7/42] chaos... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_chaos.py -n 50 --timer perf_counter` | |
INFO:root:Running `../cpython/python.exe performance/bm_chaos.py -n 50 --timer perf_counter` | |
[ 8/42] django_v3... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_django_v3.py -n 50 --timer perf_counter` | |
INFO:root:Running `../cpython/python.exe performance/bm_django_v3.py -n 50 --timer perf_counter` | |
[ 9/42] etree_generate... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_elementtree.py -n 50 --timer perf_counter generate` | |
INFO:root:Running `../cpython/python.exe performance/bm_elementtree.py -n 50 --timer perf_counter generate` | |
[10/42] etree_iterparse... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_elementtree.py -n 50 --timer perf_counter iterparse` | |
INFO:root:Running `../cpython/python.exe performance/bm_elementtree.py -n 50 --timer perf_counter iterparse` | |
[11/42] etree_parse... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_elementtree.py -n 50 --timer perf_counter parse` | |
INFO:root:Running `../cpython/python.exe performance/bm_elementtree.py -n 50 --timer perf_counter parse` | |
[12/42] etree_process... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_elementtree.py -n 50 --timer perf_counter process` | |
INFO:root:Running `../cpython/python.exe performance/bm_elementtree.py -n 50 --timer perf_counter process` | |
[13/42] fannkuch... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_fannkuch.py -n 50 --timer perf_counter` | |
INFO:root:Running `../cpython/python.exe performance/bm_fannkuch.py -n 50 --timer perf_counter` | |
[14/42] fastpickle... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_pickle.py -n 50 --timer perf_counter --use_cpickle pickle` | |
INFO:root:Running `../cpython/python.exe performance/bm_pickle.py -n 50 --timer perf_counter --use_cpickle pickle` | |
[15/42] fastunpickle... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_pickle.py -n 50 --timer perf_counter --use_cpickle unpickle` | |
INFO:root:Running `../cpython/python.exe performance/bm_pickle.py -n 50 --timer perf_counter --use_cpickle unpickle` | |
[16/42] float... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_float.py -n 50 --timer perf_counter` | |
INFO:root:Running `../cpython/python.exe performance/bm_float.py -n 50 --timer perf_counter` | |
[17/42] formatted_logging... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_logging.py -n 50 --timer perf_counter formatted_output` | |
INFO:root:Running `../cpython/python.exe performance/bm_logging.py -n 50 --timer perf_counter formatted_output` | |
[18/42] go... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_go.py -n 50 --timer perf_counter` | |
INFO:root:Running `../cpython/python.exe performance/bm_go.py -n 50 --timer perf_counter` | |
[19/42] hexiom2... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_hexiom2.py -n 2 --timer perf_counter` | |
INFO:root:Running `../cpython/python.exe performance/bm_hexiom2.py -n 2 --timer perf_counter` | |
[20/42] json_dump_v2... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_json_v2.py -n 50 --timer perf_counter` | |
INFO:root:Running `../cpython/python.exe performance/bm_json_v2.py -n 50 --timer perf_counter` | |
[21/42] json_load... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_json.py -n 50 --timer perf_counter json_load` | |
INFO:root:Running `../cpython/python.exe performance/bm_json.py -n 50 --timer perf_counter json_load` | |
[22/42] mako_v2... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_mako_v2.py -n 500 --timer perf_counter` | |
INFO:root:Running `../cpython/python.exe performance/bm_mako_v2.py -n 500 --timer perf_counter` | |
[23/42] meteor_contest... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_meteor_contest.py -n 50 --timer perf_counter` | |
INFO:root:Running `../cpython/python.exe performance/bm_meteor_contest.py -n 50 --timer perf_counter` | |
[24/42] nbody... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_nbody.py -n 50 --timer perf_counter` | |
INFO:root:Running `../cpython/python.exe performance/bm_nbody.py -n 50 --timer perf_counter` | |
[25/42] normal_startup... | |
INFO:root:Running `../cpython-git/python.exe -c ` 1000 times | |
INFO:root:Running `../cpython/python.exe -c ` 1000 times | |
[26/42] nqueens... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_nqueens.py -n 50 --timer perf_counter` | |
INFO:root:Running `../cpython/python.exe performance/bm_nqueens.py -n 50 --timer perf_counter` | |
[27/42] pathlib... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_pathlib.py -n 500 --timer perf_counter` | |
INFO:root:Running `../cpython/python.exe performance/bm_pathlib.py -n 500 --timer perf_counter` | |
[28/42] pickle_dict... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_pickle.py -n 50 --timer perf_counter --use_cpickle pickle_dict` | |
INFO:root:Running `../cpython/python.exe performance/bm_pickle.py -n 50 --timer perf_counter --use_cpickle pickle_dict` | |
[29/42] pickle_list... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_pickle.py -n 50 --timer perf_counter --use_cpickle pickle_list` | |
INFO:root:Running `../cpython/python.exe performance/bm_pickle.py -n 50 --timer perf_counter --use_cpickle pickle_list` | |
[30/42] pidigits... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_pidigits.py -n 50 --timer perf_counter` | |
INFO:root:Running `../cpython/python.exe performance/bm_pidigits.py -n 50 --timer perf_counter` | |
[31/42] raytrace... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_raytrace.py -n 50 --timer perf_counter` | |
INFO:root:Running `../cpython/python.exe performance/bm_raytrace.py -n 50 --timer perf_counter` | |
[32/42] regex_compile... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_regex_compile.py -n 50 --timer perf_counter` | |
INFO:root:Running `../cpython/python.exe performance/bm_regex_compile.py -n 50 --timer perf_counter` | |
[33/42] regex_effbot... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_regex_effbot.py -n 50 --timer perf_counter` | |
INFO:root:Running `../cpython/python.exe performance/bm_regex_effbot.py -n 50 --timer perf_counter` | |
[34/42] regex_v8... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_regex_v8.py -n 50 --timer perf_counter` | |
INFO:root:Running `../cpython/python.exe performance/bm_regex_v8.py -n 50 --timer perf_counter` | |
[35/42] richards... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_richards.py -n 50 --timer perf_counter` | |
INFO:root:Running `../cpython/python.exe performance/bm_richards.py -n 50 --timer perf_counter` | |
[36/42] silent_logging... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_logging.py -n 50 --timer perf_counter no_output` | |
INFO:root:Running `../cpython/python.exe performance/bm_logging.py -n 50 --timer perf_counter no_output` | |
[37/42] simple_logging... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_logging.py -n 50 --timer perf_counter simple_output` | |
INFO:root:Running `../cpython/python.exe performance/bm_logging.py -n 50 --timer perf_counter simple_output` | |
[38/42] spectral_norm... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_spectral_norm.py -n 50 --timer perf_counter` | |
INFO:root:Running `../cpython/python.exe performance/bm_spectral_norm.py -n 50 --timer perf_counter` | |
[39/42] startup_nosite... | |
INFO:root:Running `../cpython-git/python.exe -S -c ` 2000 times | |
INFO:root:Running `../cpython/python.exe -S -c ` 2000 times | |
[40/42] telco... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_telco.py -n 50 --timer perf_counter` | |
INFO:root:Running `../cpython/python.exe performance/bm_telco.py -n 50 --timer perf_counter` | |
[41/42] unpack_sequence... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_unpack_sequence.py -n 50000 --timer perf_counter` | |
INFO:root:Running `../cpython/python.exe performance/bm_unpack_sequence.py -n 50000 --timer perf_counter` | |
[42/42] unpickle_list... | |
INFO:root:Running `../cpython-git/python.exe performance/bm_pickle.py -n 50 --timer perf_counter --use_cpickle unpickle_list` | |
INFO:root:Running `../cpython/python.exe performance/bm_pickle.py -n 50 --timer perf_counter --use_cpickle unpickle_list` | |
Report on Darwin ysmac 15.2.0 Darwin Kernel Version 15.2.0: Fri Nov 13 19:56:56 PST 2015; root:xnu-3248.20.55~2/RELEASE_X86_64 x86_64 i386 | |
Total CPU cores: 8 | |
### 2to3 ### | |
6.204514 -> 6.125281: 1.01x faster | |
### call_method ### | |
Min: 0.305086 -> 0.260570: 1.17x faster | |
Avg: 0.330371 -> 0.281452: 1.17x faster | |
Significant (t=42.75) | |
Stddev: 0.01029 -> 0.00952: 1.0808x smaller | |
### call_method_slots ### | |
Min: 0.320291 -> 0.265991: 1.20x faster | |
Avg: 0.333489 -> 0.280612: 1.19x faster | |
Significant (t=17.51) | |
Stddev: 0.00741 -> 0.00905: 1.2218x larger | |
### call_method_unknown ### | |
Min: 0.305636 -> 0.266716: 1.15x faster | |
Avg: 0.330182 -> 0.286476: 1.15x faster | |
Significant (t=30.99) | |
Stddev: 0.01153 -> 0.01287: 1.1161x larger | |
### call_simple ### | |
Min: 0.244161 -> 0.237890: 1.03x faster | |
Avg: 0.264811 -> 0.257741: 1.03x faster | |
Significant (t=6.85) | |
Stddev: 0.00879 -> 0.00907: 1.0323x larger | |
### chameleon_v2 ### | |
Min: 4.258404 -> 4.334001: 1.02x slower | |
Avg: 4.329534 -> 4.425844: 1.02x slower | |
Significant (t=-9.37) | |
Stddev: 0.03972 -> 0.06087: 1.5323x larger | |
### etree_iterparse ### | |
Min: 0.179593 -> 0.186016: 1.04x slower | |
Avg: 0.194562 -> 0.204869: 1.05x slower | |
Significant (t=-6.40) | |
Stddev: 0.00547 -> 0.00999: 1.8259x larger | |
### fastpickle ### | |
Min: 0.452639 -> 0.420982: 1.08x faster | |
Avg: 0.483867 -> 0.447386: 1.08x faster | |
Significant (t=15.08) | |
Stddev: 0.01221 -> 0.01199: 1.0181x smaller | |
### json_dump_v2 ### | |
Min: 2.746053 -> 2.844394: 1.04x slower | |
Avg: 2.810367 -> 2.946974: 1.05x slower | |
Significant (t=-16.67) | |
Stddev: 0.04674 -> 0.03423: 1.3654x smaller | |
### mako_v2 ### | |
Min: 0.032359 -> 0.031621: 1.02x faster | |
Avg: 0.036266 -> 0.035266: 1.03x faster | |
Significant (t=6.92) | |
Stddev: 0.00226 -> 0.00230: 1.0172x larger | |
### meteor_contest ### | |
Min: 0.209897 -> 0.190742: 1.10x faster | |
Avg: 0.220775 -> 0.203443: 1.09x faster | |
Significant (t=12.92) | |
Stddev: 0.00687 -> 0.00654: 1.0513x smaller | |
### nbody ### | |
Min: 0.214686 -> 0.222613: 1.04x slower | |
Avg: 0.231524 -> 0.237883: 1.03x slower | |
Significant (t=-3.98) | |
Stddev: 0.00785 -> 0.00814: 1.0361x larger | |
### pickle_dict ### | |
Min: 0.462587 -> 0.441879: 1.05x faster | |
Avg: 0.499921 -> 0.472716: 1.06x faster | |
Significant (t=8.72) | |
Stddev: 0.01638 -> 0.01477: 1.1089x smaller | |
### pickle_list ### | |
Min: 0.273654 -> 0.265191: 1.03x faster | |
Avg: 0.292243 -> 0.286346: 1.02x faster | |
Significant (t=3.34) | |
Stddev: 0.00865 -> 0.00902: 1.0427x larger | |
### raytrace ### | |
Min: 1.203398 -> 1.182318: 1.02x faster | |
Avg: 1.272073 -> 1.237169: 1.03x faster | |
Significant (t=5.34) | |
Stddev: 0.03893 -> 0.02497: 1.5594x smaller | |
### regex_effbot ### | |
Min: 0.048941 -> 0.048624: 1.01x faster | |
Avg: 0.052992 -> 0.055063: 1.04x slower | |
Significant (t=-3.51) | |
Stddev: 0.00288 -> 0.00302: 1.0474x larger | |
### richards ### | |
Min: 0.139602 -> 0.135395: 1.03x faster | |
Avg: 0.159637 -> 0.148732: 1.07x faster | |
Significant (t=3.96) | |
Stddev: 0.02652 -> 0.00734: 3.6150x smaller | |
### silent_logging ### | |
Min: 0.067794 -> 0.063858: 1.06x faster | |
Avg: 0.075437 -> 0.071926: 1.05x faster | |
Significant (t=6.29) | |
Stddev: 0.00381 -> 0.00409: 1.0733x larger | |
### simple_logging ### | |
Min: 0.217997 -> 0.211726: 1.03x faster | |
Avg: 0.233119 -> 0.222751: 1.05x faster | |
Significant (t=7.33) | |
Stddev: 0.00751 -> 0.00660: 1.1367x smaller | |
The following not significant results are hidden, use -v to show them: | |
chaos, django_v3, etree_generate, etree_parse, etree_process, fannkuch, fastunpickle, float, formatted_logging, go, hexiom2, json_load, normal_startup, nqueens, pathlib, pidigits, regex_compile, regex_v8, spectral_norm, startup_nosite, telco, unpack_sequence, unpickle_list. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment