Skip to content

Instantly share code, notes, and snippets.

@1st1
Created January 30, 2016 16:15
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save 1st1/b1978e17ee8b82cc6432 to your computer and use it in GitHub Desktop.
Save 1st1/b1978e17ee8b82cc6432 to your computer and use it in GitHub Desktop.
opcache5 (LOAD_ATTR)
yury@ares ~/benchmarks $ python3.5 perf.py -b all ../test2/cpython/python ../tmp/cpython/python -r
Report on Linux ares.sprymix.net 4.1.2 #10 SMP Fri Jul 10 19:14:52 EDT 2015 x86_64 Intel(R) Xeon(R) CPU E5-1620 v2 @ 3.70GHz
Total CPU cores: 8
### 2to3 ###
Min: 6.016000 -> 5.616000: 1.07x faster
Avg: 6.087200 -> 5.698400: 1.07x faster
Significant (t=6.60)
Stddev: 0.08072 -> 0.10402: 1.2887x larger
### call_method ###
Min: 0.256522 -> 0.191819: 1.34x faster
Avg: 0.273794 -> 0.203860: 1.34x faster
Significant (t=20.12)
Stddev: 0.04920 -> 0.03470: 1.4178x smaller
### call_method_slots ###
Min: 0.265510 -> 0.189875: 1.40x faster
Avg: 0.288215 -> 0.206745: 1.39x faster
Significant (t=18.92)
Stddev: 0.05779 -> 0.04714: 1.2260x smaller
### call_method_unknown ###
Min: 0.258748 -> 0.229086: 1.13x faster
Avg: 0.276151 -> 0.231345: 1.19x faster
Significant (t=15.53)
Stddev: 0.04985 -> 0.00360: 13.8651x smaller
### call_simple ###
Min: 0.199206 -> 0.171525: 1.16x faster
Avg: 0.201067 -> 0.175453: 1.15x faster
Significant (t=35.35)
Stddev: 0.00329 -> 0.01211: 3.6865x larger
### chameleon_v2 ###
Min: 4.998745 -> 4.214973: 1.19x faster
Avg: 5.054432 -> 4.247981: 1.19x faster
Significant (t=77.41)
Stddev: 0.09952 -> 0.03080: 3.2305x smaller
### chaos ###
Min: 0.254066 -> 0.244007: 1.04x faster
Avg: 0.272372 -> 0.258132: 1.06x faster
Significant (t=2.86)
Stddev: 0.03913 -> 0.03088: 1.2673x smaller
### etree_generate ###
Min: 0.230186 -> 0.232136: 1.01x slower
Avg: 0.232382 -> 0.237216: 1.02x slower
Significant (t=-4.72)
Stddev: 0.00124 -> 0.01016: 8.1852x larger
### etree_iterparse ###
Min: 0.176813 -> 0.159853: 1.11x faster
Avg: 0.179826 -> 0.161741: 1.11x faster
Significant (t=137.62)
Stddev: 0.00104 -> 0.00080: 1.2972x smaller
### fannkuch ###
Min: 0.844378 -> 0.867363: 1.03x slower
Avg: 0.884802 -> 0.914365: 1.03x slower
Significant (t=-2.03)
Stddev: 0.10636 -> 0.09933: 1.0708x smaller
### fastunpickle ###
Min: 0.466299 -> 0.463645: 1.01x faster
Avg: 0.470629 -> 0.495607: 1.05x slower
Significant (t=-3.46)
Stddev: 0.01235 -> 0.07105: 5.7541x larger
### float ###
Min: 0.228875 -> 0.201702: 1.13x faster
Avg: 0.234966 -> 0.207974: 1.13x faster
Significant (t=59.00)
Stddev: 0.00320 -> 0.00327: 1.0189x larger
### formatted_logging ###
Min: 0.300416 -> 0.282996: 1.06x faster
Avg: 0.303203 -> 0.287424: 1.05x faster
Significant (t=11.44)
Stddev: 0.00298 -> 0.01346: 4.5187x larger
### go ###
Min: 0.460726 -> 0.401970: 1.15x faster
Avg: 0.473761 -> 0.410894: 1.15x faster
Significant (t=12.05)
Stddev: 0.04504 -> 0.02630: 1.7127x smaller
### hexiom2 ###
Min: 116.495664 -> 94.607344: 1.23x faster
Avg: 118.296571 -> 100.270154: 1.18x faster
Significant (t=8.75)
Stddev: 1.51408 -> 3.83177: 2.5308x larger
### json_dump_v2 ###
Min: 2.396401 -> 2.171851: 1.10x faster
Avg: 2.598835 -> 2.286659: 1.14x faster
Significant (t=13.45)
Stddev: 0.17308 -> 0.15469: 1.1188x smaller
### mako_v2 ###
Min: 0.034776 -> 0.032617: 1.07x faster
Avg: 0.037338 -> 0.033639: 1.11x faster
Significant (t=15.06)
Stddev: 0.00709 -> 0.00318: 2.2310x smaller
### meteor_contest ###
Min: 0.163837 -> 0.162036: 1.01x faster
Avg: 0.165879 -> 0.169780: 1.02x slower
Significant (t=-2.11)
Stddev: 0.00222 -> 0.01834: 8.2506x larger
### nbody ###
Min: 0.199211 -> 0.194670: 1.02x faster
Avg: 0.218966 -> 0.200855: 1.09x faster
Significant (t=3.53)
Stddev: 0.04462 -> 0.02538: 1.7585x smaller
### pathlib ###
Min: 0.072583 -> 0.071157: 1.02x faster
Avg: 0.076082 -> 0.073154: 1.04x faster
Significant (t=6.41)
Stddev: 0.00849 -> 0.00568: 1.4939x smaller
### raytrace ###
Min: 1.116751 -> 1.065402: 1.05x faster
Avg: 1.127733 -> 1.076058: 1.05x faster
Significant (t=20.49)
Stddev: 0.02049 -> 0.01471: 1.3929x smaller
### regex_compile ###
Min: 0.293707 -> 0.262354: 1.12x faster
Avg: 0.295643 -> 0.264842: 1.12x faster
Significant (t=41.55)
Stddev: 0.00251 -> 0.00697: 2.7758x larger
### regex_v8 ###
Min: 0.035222 -> 0.034034: 1.03x faster
Avg: 0.035609 -> 0.034544: 1.03x faster
Significant (t=6.67)
Stddev: 0.00110 -> 0.00116: 1.0543x larger
### richards ###
Min: 0.141924 -> 0.126181: 1.12x faster
Avg: 0.151344 -> 0.128354: 1.18x faster
Significant (t=9.54)
Stddev: 0.02259 -> 0.00838: 2.6954x smaller
### silent_logging ###
Min: 0.062999 -> 0.052681: 1.20x faster
Avg: 0.063556 -> 0.053269: 1.19x faster
Significant (t=88.84)
Stddev: 0.00088 -> 0.00076: 1.1563x smaller
### simple_logging ###
Min: 0.254940 -> 0.245663: 1.04x faster
Avg: 0.258979 -> 0.248583: 1.04x faster
Significant (t=10.30)
Stddev: 0.00994 -> 0.00174: 5.7033x smaller
### spectral_norm ###
Min: 0.239344 -> 0.232552: 1.03x faster
Avg: 0.240804 -> 0.235764: 1.02x faster
Significant (t=4.10)
Stddev: 0.00241 -> 0.01205: 4.9881x larger
### telco ###
Min: 0.009381 -> 0.010642: 1.13x slower
Avg: 0.009570 -> 0.010831: 1.13x slower
Significant (t=-83.25)
Stddev: 0.00040 -> 0.00026: 1.5661x smaller
### tornado_http ###
Min: 0.226494 -> 0.221555: 1.02x faster
Avg: 0.228729 -> 0.223440: 1.02x faster
Significant (t=29.05)
Stddev: 0.00170 -> 0.00194: 1.1394x larger
### unpack_sequence ###
Min: 0.000038 -> 0.000038: 1.01x slower
Avg: 0.000040 -> 0.000039: 1.02x faster
Significant (t=71.72)
Stddev: 0.00000 -> 0.00000: 2.1185x smaller
The following not significant results are hidden, use -v to show them:
django_v3, etree_parse, etree_process, fastpickle, json_load, normal_startup, nqueens, pickle_dict, pickle_list, pidigits, regex_effbot, startup_nosite, unpickle_list.
yuri@einstein ~/benchmarks $ python3.5 perf.py -b all ../opy/cpython/python ../optpy/cpython/python -m
Report on Linux einstein.sprymix.net 4.4.0 #36 SMP Sun Jan 24 23:24:22 EST 2016 x86_64 Intel(R) Core(TM) i7 CPU 860 @ 2.80GHz
Total CPU cores: 8
### 2to3 ###
Mem max: 42272.000 -> 53076.000: 1.2556x larger
### call_method ###
Mem max: 7524.000 -> 7580.000: 1.0074x larger
### call_method_slots ###
Mem max: 7524.000 -> 7588.000: 1.0085x larger
### call_method_unknown ###
Mem max: 7588.000 -> 7644.000: 1.0074x larger
### call_simple ###
Mem max: 8216.000 -> 7568.000: 1.0856x smaller
### chameleon_v2 ###
Mem max: 385880.000 -> 364900.000: 1.0575x smaller
### chaos ###
Mem max: 17640.000 -> 17692.000: 1.0029x larger
### django_v3 ###
Mem max: 24300.000 -> 24280.000: 1.0008x smaller
### etree_generate ###
Mem max: 14924.000 -> 14100.000: 1.0584x smaller
### etree_iterparse ###
Mem max: 14116.000 -> 16476.000: 1.1672x larger
### etree_parse ###
Mem max: 13672.000 -> 14852.000: 1.0863x larger
### etree_process ###
Mem max: 14884.000 -> 14828.000: 1.0038x smaller
### fannkuch ###
Mem max: 7500.000 -> 7548.000: 1.0064x larger
### fastpickle ###
Mem max: 8768.000 -> 8808.000: 1.0046x larger
### fastunpickle ###
Mem max: 8776.000 -> 8812.000: 1.0041x larger
### float ###
Mem max: 32740.000 -> 33592.000: 1.0260x larger
### formatted_logging ###
Mem max: 55328.000 -> 56088.000: 1.0137x larger
### go ###
Mem max: 14260.000 -> 14616.000: 1.0250x larger
### hexiom2 ###
Mem max: 7872.000 -> 7916.000: 1.0056x larger
### json_dump_v2 ###
Mem max: 10584.000 -> 10648.000: 1.0060x larger
### json_load ###
Mem max: 8516.000 -> 8560.000: 1.0052x larger
### mako_v2 ###
Mem max: 24380.000 -> 24820.000: 1.0180x larger
### meteor_contest ###
Mem max: 9468.000 -> 9536.000: 1.0072x larger
### nbody ###
Mem max: 7532.000 -> 7556.000: 1.0032x larger
### normal_startup ###
Mem max: 5524.000 -> 5548.000: 1.0043x larger
### nqueens ###
Mem max: 7744.000 -> 7788.000: 1.0057x larger
### pathlib ###
Mem max: 11656.000 -> 11720.000: 1.0055x larger
### pickle_dict ###
Mem max: 8760.000 -> 8816.000: 1.0064x larger
### pickle_list ###
Mem max: 8780.000 -> 8808.000: 1.0032x larger
### pidigits ###
Mem max: 7596.000 -> 7644.000: 1.0063x larger
### raytrace ###
Mem max: 7984.000 -> 8064.000: 1.0100x larger
### regex_compile ###
Mem max: 15612.000 -> 15748.000: 1.0087x larger
### regex_effbot ###
Mem max: 8196.000 -> 8232.000: 1.0044x larger
### regex_v8 ###
Mem max: 12784.000 -> 12904.000: 1.0094x larger
### richards ###
Mem max: 7864.000 -> 8004.000: 1.0178x larger
### silent_logging ###
Mem max: 8060.000 -> 8128.000: 1.0084x larger
### simple_logging ###
Mem max: 47220.000 -> 47968.000: 1.0158x larger
### spectral_norm ###
Mem max: 7504.000 -> 7552.000: 1.0064x larger
### startup_nosite ###
Mem max: 4676.000 -> 4696.000: 1.0043x larger
### telco ###
Mem max: 8072.000 -> 8108.000: 1.0045x larger
### tornado_http ###
Mem max: 28636.000 -> 28836.000: 1.0070x larger
### unpack_sequence ###
Mem max: 12556.000 -> 12800.000: 1.0194x larger
### unpickle_list ###
Mem max: 8768.000 -> 8812.000: 1.0050x larger
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment