Skip to content

Instantly share code, notes, and snippets.

@pitrou
Created January 16, 2018 17:04
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save pitrou/29eb7592fa1eae2be390f3bfa3db0a3a to your computer and use it in GitHub Desktop.
Save pitrou/29eb7592fa1eae2be390f3bfa3db0a3a to your computer and use it in GitHub Desktop.
+-------------------------+-----------+--------------------------+--------------+------------------------+
| Benchmark | py37.perf | py37_insert_memmove.perf | Change | Significance |
+=========================+===========+==========================+==============+========================+
| 2to3 | 649 ms | 613 ms | 1.06x faster | Significant (t=26.33) |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| chameleon | 25.4 ms | 23.9 ms | 1.06x faster | Significant (t=20.96) |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| chaos | 258 ms | 245 ms | 1.05x faster | Significant (t=26.57) |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| crypto_pyaes | 214 ms | 200 ms | 1.07x faster | Significant (t=42.43) |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| deltablue | 15.6 ms | 14.5 ms | 1.08x faster | Significant (t=25.53) |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| django_template | 307 ms | 312 ms | 1.02x slower | Not significant |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| dulwich_log | 149 ms | 140 ms | 1.06x faster | Significant (t=9.95) |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| fannkuch | 965 ms | 949 ms | 1.02x faster | Not significant |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| float | 232 ms | 226 ms | 1.03x faster | Significant (t=6.01) |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| genshi_text | 80.4 ms | 74.8 ms | 1.07x faster | Significant (t=20.85) |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| genshi_xml | 167 ms | 165 ms | 1.02x faster | Not significant |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| go | 529 ms | 506 ms | 1.05x faster | Significant (t=22.74) |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| hexiom | 19.2 ms | 18.6 ms | 1.04x faster | Significant (t=21.24) |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| html5lib | 195 ms | 189 ms | 1.03x faster | Significant (t=5.47) |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| json_dumps | 26.2 ms | 25.4 ms | 1.03x faster | Significant (t=11.07) |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| json_loads | 55.9 us | 53.7 us | 1.04x faster | Significant (t=14.98) |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| logging_format | 25.2 us | 25.5 us | 1.01x slower | Not significant |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| logging_silent | 346 ns | 331 ns | 1.05x faster | Significant (t=13.07) |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| logging_simple | 21.2 us | 21.4 us | 1.01x slower | Not significant |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| mako | 36.4 ms | 32.8 ms | 1.11x faster | Significant (t=38.83) |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| meteor_contest | 175 ms | 176 ms | 1.00x slower | Not significant |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| nbody | 222 ms | 211 ms | 1.05x faster | Significant (t=15.00) |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| nqueens | 222 ms | 219 ms | 1.01x faster | Not significant |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| pathlib | 46.9 ms | 44.5 ms | 1.06x faster | Significant (t=10.38) |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| pickle | 23.2 us | 22.8 us | 1.01x faster | Not significant |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| pickle_dict | 62.0 us | 59.1 us | 1.05x faster | Significant (t=17.63) |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| pickle_list | 8.30 us | 8.18 us | 1.01x faster | Not significant |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| pickle_pure_python | 1.07 ms | 1.03 ms | 1.04x faster | Significant (t=10.34) |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| pidigits | 284 ms | 280 ms | 1.01x faster | Not significant |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| python_startup | 13.6 ms | 13.4 ms | 1.01x faster | Not significant |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| python_startup_no_site | 8.75 ms | 8.58 ms | 1.02x faster | Not significant |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| raytrace | 1.10 sec | 1.10 sec | 1.01x slower | Not significant |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| regex_compile | 369 ms | 374 ms | 1.01x slower | Not significant |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| regex_dna | 238 ms | 245 ms | 1.03x slower | Significant (t=-6.53) |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| regex_effbot | 4.52 ms | 4.50 ms | 1.00x faster | Not significant |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| regex_v8 | 45.2 ms | 37.5 ms | 1.21x faster | Significant (t=60.53) |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| richards | 152 ms | 156 ms | 1.03x slower | Significant (t=-6.33) |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| scimark_fft | 626 ms | 639 ms | 1.02x slower | Significant (t=-5.33) |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| scimark_lu | 332 ms | 324 ms | 1.02x faster | Significant (t=4.18) |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| scimark_monte_carlo | 215 ms | 218 ms | 1.01x slower | Not significant |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| scimark_sor | 423 ms | 408 ms | 1.04x faster | Significant (t=4.95) |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| scimark_sparse_mat_mult | 8.10 ms | 8.64 ms | 1.07x slower | Significant (t=-9.03) |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| spectral_norm | 246 ms | 247 ms | 1.00x slower | Not significant |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| sqlalchemy_declarative | 261 ms | 276 ms | 1.06x slower | Significant (t=-12.61) |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| sqlalchemy_imperative | 49.4 ms | 52.3 ms | 1.06x slower | Significant (t=-8.20) |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| sqlite_synth | 7.68 us | 7.99 us | 1.04x slower | Significant (t=-7.17) |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| sympy_expand | 838 ms | 902 ms | 1.08x slower | Significant (t=-33.68) |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| sympy_integrate | 40.1 ms | 40.0 ms | 1.00x faster | Not significant |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| sympy_str | 382 ms | 401 ms | 1.05x slower | Significant (t=-21.69) |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| sympy_sum | 183 ms | 182 ms | 1.00x faster | Not significant |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| telco | 18.2 ms | 17.7 ms | 1.02x faster | Significant (t=4.52) |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| tornado_http | 336 ms | 340 ms | 1.01x slower | Not significant |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| unpack_sequence | 109 ns | 109 ns | 1.00x slower | Not significant |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| unpickle | 27.9 us | 28.1 us | 1.01x slower | Not significant |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| unpickle_list | 6.80 us | 7.17 us | 1.05x slower | Significant (t=-18.45) |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| unpickle_pure_python | 777 us | 770 us | 1.01x faster | Not significant |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| xml_etree_generate | 257 ms | 245 ms | 1.05x faster | Significant (t=11.45) |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| xml_etree_iterparse | 195 ms | 194 ms | 1.00x faster | Not significant |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| xml_etree_parse | 292 ms | 286 ms | 1.02x faster | Not significant |
+-------------------------+-----------+--------------------------+--------------+------------------------+
| xml_etree_process | 210 ms | 216 ms | 1.03x slower | Significant (t=-8.06) |
+-------------------------+-----------+--------------------------+--------------+------------------------+
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment