Skip to content

Instantly share code, notes, and snippets.

@nascheme
Created October 19, 2021 03:31
Show Gist options
  • Save nascheme/9ddffe333956f31c55e7e9b1c75b1ecf to your computer and use it in GitHub Desktop.
Save nascheme/9ddffe333956f31c55e7e9b1c75b1ecf to your computer and use it in GitHub Desktop.
bench-py-base.json
==================
Performance version: 1.0.2
Report on Linux-5.10.0-8-amd64-x86_64-with-glibc2.31
Number of logical CPUs: 4
Start date: 2021-10-18 20:07:44.427781
End date: 2021-10-18 20:26:28.404799
bench-py-mimalloc.json
======================
Performance version: 1.0.2
Report on Linux-5.10.0-8-amd64-x86_64-with-glibc2.31
Number of logical CPUs: 4
Start date: 2021-10-18 19:48:54.756800
End date: 2021-10-18 20:07:25.087482
+-------------------------+--------------------+------------------------+--------------+------------------------+
| Benchmark | bench-py-base.json | bench-py-mimalloc.json | Change | Significance |
+=========================+====================+========================+==============+========================+
| 2to3 | 346 ms | 326 ms | 1.06x faster | Significant (t=18.14) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| chameleon | 9.00 ms | 8.79 ms | 1.02x faster | Significant (t=9.91) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| chaos | 115 ms | 111 ms | 1.03x faster | Significant (t=13.14) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| crypto_pyaes | 120 ms | 117 ms | 1.03x faster | Significant (t=10.54) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| deltablue | 8.00 ms | 7.66 ms | 1.04x faster | Significant (t=12.96) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| django_template | 50.4 ms | 46.7 ms | 1.08x faster | Significant (t=33.99) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| dulwich_log | 90.3 ms | 88.1 ms | 1.02x faster | Significant (t=13.60) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| fannkuch | 492 ms | 491 ms | 1.00x faster | Not significant |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| float | 114 ms | 109 ms | 1.05x faster | Significant (t=12.51) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| go | 239 ms | 229 ms | 1.04x faster | Significant (t=18.83) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| hexiom | 10.1 ms | 9.81 ms | 1.03x faster | Significant (t=20.58) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| json_dumps | 14.0 ms | 13.6 ms | 1.03x faster | Significant (t=8.68) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| json_loads | 27.2 us | 26.5 us | 1.03x faster | Significant (t=12.92) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| logging_format | 10.3 us | 9.85 us | 1.04x faster | Significant (t=11.40) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| logging_silent | 196 ns | 186 ns | 1.05x faster | Significant (t=14.22) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| logging_simple | 9.31 us | 8.92 us | 1.04x faster | Significant (t=19.23) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| mako | 16.7 ms | 15.5 ms | 1.08x faster | Significant (t=54.05) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| meteor_contest | 111 ms | 107 ms | 1.03x faster | Significant (t=46.53) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| nbody | 144 ms | 144 ms | 1.00x faster | Not significant |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| nqueens | 106 ms | 103 ms | 1.03x faster | Significant (t=21.27) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| pathlib | 23.0 ms | 22.2 ms | 1.04x faster | Significant (t=7.72) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| pickle | 10.6 us | 10.7 us | 1.01x slower | Not significant |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| pickle_dict | 28.5 us | 27.0 us | 1.06x faster | Significant (t=24.67) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| pickle_list | 4.37 us | 4.44 us | 1.02x slower | Not significant |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| pickle_pure_python | 489 us | 459 us | 1.07x faster | Significant (t=41.76) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| pidigits | 180 ms | 175 ms | 1.03x faster | Significant (t=59.45) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| pyflate | 687 ms | 658 ms | 1.04x faster | Significant (t=30.64) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| python_startup | 9.71 ms | 9.68 ms | 1.00x faster | Not significant |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| python_startup_no_site | 6.70 ms | 6.69 ms | 1.00x faster | Not significant |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| raytrace | 543 ms | 516 ms | 1.05x faster | Significant (t=19.84) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| regex_compile | 186 ms | 179 ms | 1.04x faster | Significant (t=29.31) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| regex_dna | 215 ms | 210 ms | 1.02x faster | Significant (t=17.52) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| regex_effbot | 3.21 ms | 3.32 ms | 1.03x slower | Significant (t=-22.04) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| regex_v8 | 23.6 ms | 23.9 ms | 1.01x slower | Not significant |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| richards | 80.9 ms | 75.8 ms | 1.07x faster | Significant (t=16.88) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| scimark_fft | 391 ms | 395 ms | 1.01x slower | Not significant |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| scimark_lu | 173 ms | 168 ms | 1.03x faster | Significant (t=14.16) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| scimark_monte_carlo | 106 ms | 105 ms | 1.01x faster | Not significant |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| scimark_sor | 205 ms | 199 ms | 1.03x faster | Significant (t=22.59) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| scimark_sparse_mat_mult | 5.37 ms | 5.37 ms | 1.00x slower | Not significant |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| spectral_norm | 156 ms | 157 ms | 1.00x slower | Not significant |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| sqlalchemy_declarative | 166 ms | 156 ms | 1.07x faster | Significant (t=16.52) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| sqlalchemy_imperative | 23.7 ms | 22.5 ms | 1.05x faster | Significant (t=24.82) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| sqlite_synth | 2.96 us | 2.93 us | 1.01x faster | Not significant |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| sympy_expand | 585 ms | 549 ms | 1.07x faster | Significant (t=43.65) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| sympy_integrate | 25.2 ms | 23.7 ms | 1.06x faster | Significant (t=50.02) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| sympy_str | 352 ms | 334 ms | 1.05x faster | Significant (t=44.66) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| sympy_sum | 200 ms | 187 ms | 1.07x faster | Significant (t=42.00) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| telco | 6.65 ms | 6.71 ms | 1.01x slower | Not significant |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| tornado_http | 179 ms | 167 ms | 1.07x faster | Significant (t=18.07) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| unpack_sequence | 52.8 ns | 65.1 ns | 1.23x slower | Significant (t=-53.95) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| unpickle | 14.2 us | 14.1 us | 1.01x faster | Not significant |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| unpickle_list | 4.72 us | 4.76 us | 1.01x slower | Not significant |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| unpickle_pure_python | 334 us | 328 us | 1.02x faster | Not significant |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| xml_etree_generate | 97.7 ms | 94.4 ms | 1.04x faster | Significant (t=16.56) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| xml_etree_iterparse | 109 ms | 106 ms | 1.03x faster | Significant (t=7.99) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| xml_etree_parse | 148 ms | 148 ms | 1.00x faster | Not significant |
+-------------------------+--------------------+------------------------+--------------+------------------------+
| xml_etree_process | 80.6 ms | 76.7 ms | 1.05x faster | Significant (t=33.17) |
+-------------------------+--------------------+------------------------+--------------+------------------------+
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment