Skip to content

Instantly share code, notes, and snippets.

@itamaro

itamaro/gist:fbcf5733d40fc3957d952f54d6d3e9e9

Created November 28, 2022 23:04
Show Gist options
  • Save itamaro/fbcf5733d40fc3957d952f54d6d3e9e9 to your computer and use it in GitHub Desktop.
Save itamaro/fbcf5733d40fc3957d952f54d6d3e9e9 to your computer and use it in GitHub Desktop.
Download ZIP
pyperformance benchmarks results for CPython gh-91054 - code object watchers
Raw
gistfile1.txt
$ pyperformance compare benchmarks/gh-91054.json benchmarks/gh-91054-baserev.json -O table
gh-91054.json
=============
Performance version: 1.0.6
Report on Linux-5.15.0-1022-aws-x86_64-with-glibc2.31
Number of logical CPUs: 72
Start date: 2022-11-28 21:33:26.652340
End date: 2022-11-28 22:52:43.947737
gh-91054-baserev.json
=====================
Performance version: 1.0.6
Report on Linux-5.15.0-1022-aws-x86_64-with-glibc2.31
Number of logical CPUs: 72
Start date: 2022-11-28 20:09:34.454634
End date: 2022-11-28 21:29:10.965141
+-------------------------+---------------+-----------------------+--------------+------------------------+
| Benchmark | gh-91054.json | gh-91054-baserev.json | Change | Significance |
+=========================+===============+=======================+==============+========================+
| 2to3 | 302 ms | 302 ms | 1.00x slower | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| async_generators | 371 ms | 368 ms | 1.01x faster | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| async_tree_cpu_io_mixed | 868 ms | 878 ms | 1.01x slower | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| async_tree_io | 1.54 sec | 1.55 sec | 1.01x slower | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| async_tree_memoization | 741 ms | 755 ms | 1.02x slower | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| async_tree_none | 610 ms | 616 ms | 1.01x slower | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| bench_mp_pool | 11.3 ms | 11.3 ms | 1.01x faster | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| bench_thread_pool | 1.80 ms | 1.72 ms | 1.05x faster | Significant (t=5.57) |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| chameleon | 8.06 ms | 7.59 ms | 1.06x faster | Significant (t=36.88) |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| chaos | 82.1 ms | 81.2 ms | 1.01x faster | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| coroutines | 31.4 ms | 29.9 ms | 1.05x faster | Significant (t=29.74) |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| coverage | 123 ms | 126 ms | 1.02x slower | Significant (t=-17.05) |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| crypto_pyaes | 92.0 ms | 91.9 ms | 1.00x faster | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| deepcopy | 397 us | 408 us | 1.03x slower | Significant (t=-23.77) |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| deepcopy_memo | 41.8 us | 42.2 us | 1.01x slower | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| deepcopy_reduce | 3.53 us | 3.64 us | 1.03x slower | Significant (t=-16.39) |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| deltablue | 3.93 ms | 3.94 ms | 1.00x slower | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| django_template | 40.1 ms | 40.2 ms | 1.00x slower | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| docutils | 2.96 sec | 2.96 sec | 1.00x slower | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| dulwich_log | 81.2 ms | 82.0 ms | 1.01x slower | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| fannkuch | 452 ms | 463 ms | 1.02x slower | Significant (t=-16.15) |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| float | 91.0 ms | 91.0 ms | 1.00x faster | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| generators | 64.2 ms | 62.8 ms | 1.02x faster | Significant (t=8.25) |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| genshi_text | 25.6 ms | 26.9 ms | 1.05x slower | Significant (t=-18.03) |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| genshi_xml | 56.6 ms | 58.1 ms | 1.03x slower | Significant (t=-9.00) |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| go | 167 ms | 162 ms | 1.03x faster | Significant (t=19.68) |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| hexiom | 7.49 ms | 7.38 ms | 1.01x faster | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| html5lib | 72.5 ms | 72.6 ms | 1.00x slower | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| json_dumps | 11.6 ms | 11.8 ms | 1.02x slower | Significant (t=-9.33) |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| json_loads | 29.4 us | 29.6 us | 1.01x slower | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| logging_format | 8.34 us | 8.29 us | 1.01x faster | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| logging_silent | 115 ns | 114 ns | 1.01x faster | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| logging_simple | 7.58 us | 7.57 us | 1.00x faster | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| mako | 12.6 ms | 12.3 ms | 1.02x faster | Significant (t=28.69) |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| mdp | 3.21 sec | 3.35 sec | 1.04x slower | Significant (t=-77.57) |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| meteor_contest | 127 ms | 127 ms | 1.00x faster | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| nbody | 118 ms | 113 ms | 1.04x faster | Significant (t=12.20) |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| nqueens | 98.4 ms | 100 ms | 1.02x slower | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| pathlib | 26.8 ms | 27.0 ms | 1.01x slower | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| pickle | 12.8 us | 12.6 us | 1.02x faster | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| pickle_dict | 38.3 us | 37.9 us | 1.01x faster | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| pickle_list | 5.08 us | 5.01 us | 1.01x faster | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| pickle_pure_python | 349 us | 353 us | 1.01x slower | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| pidigits | 237 ms | 233 ms | 1.02x faster | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| pprint_pformat | 1.70 sec | 1.71 sec | 1.00x slower | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| pprint_safe_repr | 829 ms | 833 ms | 1.00x slower | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| pyflate | 494 ms | 493 ms | 1.00x faster | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| python_startup | 11.7 ms | 11.7 ms | 1.00x slower | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| python_startup_no_site | 8.79 ms | 8.78 ms | 1.00x faster | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| raytrace | 344 ms | 342 ms | 1.01x faster | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| regex_compile | 157 ms | 157 ms | 1.00x slower | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| regex_dna | 262 ms | 255 ms | 1.03x faster | Significant (t=28.85) |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| regex_effbot | 4.70 ms | 4.98 ms | 1.06x slower | Significant (t=-26.01) |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| regex_v8 | 27.4 ms | 27.0 ms | 1.01x faster | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| richards | 51.1 ms | 50.5 ms | 1.01x faster | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| scimark_fft | 390 ms | 391 ms | 1.00x slower | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| scimark_lu | 133 ms | 134 ms | 1.01x slower | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| scimark_monte_carlo | 81.6 ms | 81.1 ms | 1.01x faster | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| scimark_sor | 130 ms | 129 ms | 1.00x faster | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| scimark_sparse_mat_mult | 5.15 ms | 5.24 ms | 1.02x slower | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| spectral_norm | 122 ms | 122 ms | 1.00x slower | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| sqlglot_normalize | 128 ms | 130 ms | 1.02x slower | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| sqlglot_optimize | 61.9 ms | 62.6 ms | 1.01x slower | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| sqlglot_parse | 1.63 ms | 1.65 ms | 1.01x slower | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| sqlglot_transpile | 1.98 ms | 1.99 ms | 1.01x slower | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| sqlite_synth | 3.23 us | 3.21 us | 1.01x faster | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| sympy_expand | 553 ms | 562 ms | 1.02x slower | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| sympy_integrate | 24.9 ms | 25.0 ms | 1.01x slower | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| sympy_str | 343 ms | 348 ms | 1.01x slower | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| sympy_sum | 200 ms | 201 ms | 1.01x slower | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| telco | 7.86 ms | 7.79 ms | 1.01x faster | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| tornado_http | 143 ms | 144 ms | 1.01x slower | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| unpack_sequence | 52.4 ns | 52.2 ns | 1.00x faster | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| unpickle | 17.4 us | 16.5 us | 1.06x faster | Significant (t=3.96) |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| unpickle_list | 6.23 us | 6.35 us | 1.02x slower | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| unpickle_pure_python | 246 us | 244 us | 1.01x faster | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| xml_etree_generate | 94.2 ms | 98.3 ms | 1.04x slower | Significant (t=-41.30) |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| xml_etree_iterparse | 126 ms | 127 ms | 1.00x slower | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| xml_etree_parse | 184 ms | 186 ms | 1.01x slower | Not significant |
+-------------------------+---------------+-----------------------+--------------+------------------------+
| xml_etree_process | 65.2 ms | 68.0 ms | 1.04x slower | Significant (t=-26.64) |
+-------------------------+---------------+-----------------------+--------------+------------------------+
$ python -m pyperf compare_to benchmarks/gh-91054.json benchmarks/gh-91054-baserev.json
Benchmarks with tag 'apps':
===========================
2to3: Mean +- std dev: [gh-91054] 302 ms +- 2 ms -> [gh-91054-baserev] 302 ms +- 1 ms: 1.00x slower
chameleon: Mean +- std dev: [gh-91054] 8.06 ms +- 0.10 ms -> [gh-91054-baserev] 7.59 ms +- 0.10 ms: 1.06x faster
tornado_http: Mean +- std dev: [gh-91054] 143 ms +- 2 ms -> [gh-91054-baserev] 144 ms +- 2 ms: 1.01x slower
Benchmark hidden because not significant (2): docutils, html5lib
Geometric mean: 1.01x faster
Benchmarks with tag 'math':
===========================
nbody: Mean +- std dev: [gh-91054] 118 ms +- 4 ms -> [gh-91054-baserev] 113 ms +- 2 ms: 1.04x faster
pidigits: Mean +- std dev: [gh-91054] 237 ms +- 0 ms -> [gh-91054-baserev] 233 ms +- 0 ms: 1.02x faster
Benchmark hidden because not significant (1): float
Geometric mean: 1.02x faster
Benchmarks with tag 'regex':
============================
regex_compile: Mean +- std dev: [gh-91054] 157 ms +- 1 ms -> [gh-91054-baserev] 157 ms +- 1 ms: 1.00x slower
regex_dna: Mean +- std dev: [gh-91054] 262 ms +- 1 ms -> [gh-91054-baserev] 255 ms +- 2 ms: 1.03x faster
regex_effbot: Mean +- std dev: [gh-91054] 4.70 ms +- 0.02 ms -> [gh-91054-baserev] 4.98 ms +- 0.12 ms: 1.06x slower
regex_v8: Mean +- std dev: [gh-91054] 27.4 ms +- 0.2 ms -> [gh-91054-baserev] 27.0 ms +- 0.1 ms: 1.01x faster
Geometric mean: 1.01x slower
Benchmarks with tag 'serialize':
================================
json_dumps: Mean +- std dev: [gh-91054] 11.6 ms +- 0.2 ms -> [gh-91054-baserev] 11.8 ms +- 0.2 ms: 1.02x slower
json_loads: Mean +- std dev: [gh-91054] 29.4 us +- 0.5 us -> [gh-91054-baserev] 29.6 us +- 0.3 us: 1.01x slower
pickle: Mean +- std dev: [gh-91054] 12.8 us +- 0.1 us -> [gh-91054-baserev] 12.6 us +- 0.1 us: 1.02x faster
pickle_dict: Mean +- std dev: [gh-91054] 38.3 us +- 0.2 us -> [gh-91054-baserev] 37.9 us +- 0.1 us: 1.01x faster
pickle_list: Mean +- std dev: [gh-91054] 5.08 us +- 0.07 us -> [gh-91054-baserev] 5.01 us +- 0.07 us: 1.01x faster
pickle_pure_python: Mean +- std dev: [gh-91054] 349 us +- 4 us -> [gh-91054-baserev] 353 us +- 4 us: 1.01x slower
unpickle: Mean +- std dev: [gh-91054] 17.4 us +- 2.4 us -> [gh-91054-baserev] 16.5 us +- 0.8 us: 1.06x faster
unpickle_list: Mean +- std dev: [gh-91054] 6.23 us +- 0.09 us -> [gh-91054-baserev] 6.35 us +- 0.07 us: 1.02x slower
unpickle_pure_python: Mean +- std dev: [gh-91054] 246 us +- 2 us -> [gh-91054-baserev] 244 us +- 2 us: 1.01x faster
xml_etree_parse: Mean +- std dev: [gh-91054] 184 ms +- 2 ms -> [gh-91054-baserev] 186 ms +- 4 ms: 1.01x slower
xml_etree_iterparse: Mean +- std dev: [gh-91054] 126 ms +- 1 ms -> [gh-91054-baserev] 127 ms +- 1 ms: 1.00x slower
xml_etree_generate: Mean +- std dev: [gh-91054] 94.2 ms +- 0.6 ms -> [gh-91054-baserev] 98.3 ms +- 0.9 ms: 1.04x slower
xml_etree_process: Mean +- std dev: [gh-91054] 65.2 ms +- 0.7 ms -> [gh-91054-baserev] 68.0 ms +- 0.9 ms: 1.04x slower
Geometric mean: 1.00x slower
Benchmarks with tag 'startup':
==============================
python_startup: Mean +- std dev: [gh-91054] 11.7 ms +- 0.1 ms -> [gh-91054-baserev] 11.7 ms +- 0.1 ms: 1.00x slower
Benchmark hidden because not significant (1): python_startup_no_site
Geometric mean: 1.00x slower
Benchmarks with tag 'template':
===============================
genshi_text: Mean +- std dev: [gh-91054] 25.6 ms +- 0.3 ms -> [gh-91054-baserev] 26.9 ms +- 0.7 ms: 1.05x slower
genshi_xml: Mean +- std dev: [gh-91054] 56.6 ms +- 0.9 ms -> [gh-91054-baserev] 58.1 ms +- 1.7 ms: 1.03x slower
mako: Mean +- std dev: [gh-91054] 12.6 ms +- 0.1 ms -> [gh-91054-baserev] 12.3 ms +- 0.1 ms: 1.02x faster
Benchmark hidden because not significant (1): django_template
Geometric mean: 1.01x slower
All benchmarks:
===============
2to3: Mean +- std dev: [gh-91054] 302 ms +- 2 ms -> [gh-91054-baserev] 302 ms +- 1 ms: 1.00x slower
async_generators: Mean +- std dev: [gh-91054] 371 ms +- 3 ms -> [gh-91054-baserev] 368 ms +- 3 ms: 1.01x faster
async_tree_none: Mean +- std dev: [gh-91054] 610 ms +- 17 ms -> [gh-91054-baserev] 616 ms +- 17 ms: 1.01x slower
async_tree_cpu_io_mixed: Mean +- std dev: [gh-91054] 868 ms +- 28 ms -> [gh-91054-baserev] 878 ms +- 28 ms: 1.01x slower
async_tree_io: Mean +- std dev: [gh-91054] 1.54 sec +- 0.02 sec -> [gh-91054-baserev] 1.55 sec +- 0.01 sec: 1.01x slower
async_tree_memoization: Mean +- std dev: [gh-91054] 741 ms +- 12 ms -> [gh-91054-baserev] 755 ms +- 10 ms: 1.02x slower
chameleon: Mean +- std dev: [gh-91054] 8.06 ms +- 0.10 ms -> [gh-91054-baserev] 7.59 ms +- 0.10 ms: 1.06x faster
chaos: Mean +- std dev: [gh-91054] 82.1 ms +- 1.4 ms -> [gh-91054-baserev] 81.2 ms +- 1.0 ms: 1.01x faster
bench_thread_pool: Mean +- std dev: [gh-91054] 1.80 ms +- 0.08 ms -> [gh-91054-baserev] 1.72 ms +- 0.14 ms: 1.05x faster
coroutines: Mean +- std dev: [gh-91054] 31.4 ms +- 0.3 ms -> [gh-91054-baserev] 29.9 ms +- 0.4 ms: 1.05x faster
coverage: Mean +- std dev: [gh-91054] 123 ms +- 1 ms -> [gh-91054-baserev] 126 ms +- 1 ms: 1.02x slower
deepcopy: Mean +- std dev: [gh-91054] 397 us +- 3 us -> [gh-91054-baserev] 408 us +- 4 us: 1.03x slower
deepcopy_reduce: Mean +- std dev: [gh-91054] 3.53 us +- 0.05 us -> [gh-91054-baserev] 3.64 us +- 0.05 us: 1.03x slower
deepcopy_memo: Mean +- std dev: [gh-91054] 41.8 us +- 0.3 us -> [gh-91054-baserev] 42.2 us +- 0.5 us: 1.01x slower
dulwich_log: Mean +- std dev: [gh-91054] 81.2 ms +- 0.7 ms -> [gh-91054-baserev] 82.0 ms +- 0.8 ms: 1.01x slower
fannkuch: Mean +- std dev: [gh-91054] 452 ms +- 4 ms -> [gh-91054-baserev] 463 ms +- 6 ms: 1.02x slower
generators: Mean +- std dev: [gh-91054] 64.2 ms +- 1.8 ms -> [gh-91054-baserev] 62.8 ms +- 0.5 ms: 1.02x faster
genshi_text: Mean +- std dev: [gh-91054] 25.6 ms +- 0.3 ms -> [gh-91054-baserev] 26.9 ms +- 0.7 ms: 1.05x slower
genshi_xml: Mean +- std dev: [gh-91054] 56.6 ms +- 0.9 ms -> [gh-91054-baserev] 58.1 ms +- 1.7 ms: 1.03x slower
go: Mean +- std dev: [gh-91054] 167 ms +- 1 ms -> [gh-91054-baserev] 162 ms +- 3 ms: 1.03x faster
hexiom: Mean +- std dev: [gh-91054] 7.49 ms +- 0.07 ms -> [gh-91054-baserev] 7.38 ms +- 0.07 ms: 1.01x faster
json_dumps: Mean +- std dev: [gh-91054] 11.6 ms +- 0.2 ms -> [gh-91054-baserev] 11.8 ms +- 0.2 ms: 1.02x slower
json_loads: Mean +- std dev: [gh-91054] 29.4 us +- 0.5 us -> [gh-91054-baserev] 29.6 us +- 0.3 us: 1.01x slower
logging_format: Mean +- std dev: [gh-91054] 8.34 us +- 0.08 us -> [gh-91054-baserev] 8.29 us +- 0.09 us: 1.01x faster
logging_silent: Mean +- std dev: [gh-91054] 115 ns +- 4 ns -> [gh-91054-baserev] 114 ns +- 2 ns: 1.01x faster
mako: Mean +- std dev: [gh-91054] 12.6 ms +- 0.1 ms -> [gh-91054-baserev] 12.3 ms +- 0.1 ms: 1.02x faster
mdp: Mean +- std dev: [gh-91054] 3.21 sec +- 0.01 sec -> [gh-91054-baserev] 3.35 sec +- 0.02 sec: 1.04x slower
nbody: Mean +- std dev: [gh-91054] 118 ms +- 4 ms -> [gh-91054-baserev] 113 ms +- 2 ms: 1.04x faster
nqueens: Mean +- std dev: [gh-91054] 98.4 ms +- 0.9 ms -> [gh-91054-baserev] 100 ms +- 1 ms: 1.02x slower
pathlib: Mean +- std dev: [gh-91054] 26.8 ms +- 0.5 ms -> [gh-91054-baserev] 27.0 ms +- 0.6 ms: 1.01x slower
pickle: Mean +- std dev: [gh-91054] 12.8 us +- 0.1 us -> [gh-91054-baserev] 12.6 us +- 0.1 us: 1.02x faster
pickle_dict: Mean +- std dev: [gh-91054] 38.3 us +- 0.2 us -> [gh-91054-baserev] 37.9 us +- 0.1 us: 1.01x faster
pickle_list: Mean +- std dev: [gh-91054] 5.08 us +- 0.07 us -> [gh-91054-baserev] 5.01 us +- 0.07 us: 1.01x faster
pickle_pure_python: Mean +- std dev: [gh-91054] 349 us +- 4 us -> [gh-91054-baserev] 353 us +- 4 us: 1.01x slower
pidigits: Mean +- std dev: [gh-91054] 237 ms +- 0 ms -> [gh-91054-baserev] 233 ms +- 0 ms: 1.02x faster
pprint_safe_repr: Mean +- std dev: [gh-91054] 829 ms +- 14 ms -> [gh-91054-baserev] 833 ms +- 10 ms: 1.00x slower
pprint_pformat: Mean +- std dev: [gh-91054] 1.70 sec +- 0.02 sec -> [gh-91054-baserev] 1.71 sec +- 0.02 sec: 1.00x slower
python_startup: Mean +- std dev: [gh-91054] 11.7 ms +- 0.1 ms -> [gh-91054-baserev] 11.7 ms +- 0.1 ms: 1.00x slower
raytrace: Mean +- std dev: [gh-91054] 344 ms +- 3 ms -> [gh-91054-baserev] 342 ms +- 4 ms: 1.01x faster
regex_compile: Mean +- std dev: [gh-91054] 157 ms +- 1 ms -> [gh-91054-baserev] 157 ms +- 1 ms: 1.00x slower
regex_dna: Mean +- std dev: [gh-91054] 262 ms +- 1 ms -> [gh-91054-baserev] 255 ms +- 2 ms: 1.03x faster
regex_effbot: Mean +- std dev: [gh-91054] 4.70 ms +- 0.02 ms -> [gh-91054-baserev] 4.98 ms +- 0.12 ms: 1.06x slower
regex_v8: Mean +- std dev: [gh-91054] 27.4 ms +- 0.2 ms -> [gh-91054-baserev] 27.0 ms +- 0.1 ms: 1.01x faster
richards: Mean +- std dev: [gh-91054] 51.1 ms +- 0.8 ms -> [gh-91054-baserev] 50.5 ms +- 0.8 ms: 1.01x faster
scimark_fft: Mean +- std dev: [gh-91054] 390 ms +- 6 ms -> [gh-91054-baserev] 391 ms +- 3 ms: 1.00x slower
scimark_lu: Mean +- std dev: [gh-91054] 133 ms +- 3 ms -> [gh-91054-baserev] 134 ms +- 3 ms: 1.01x slower
scimark_monte_carlo: Mean +- std dev: [gh-91054] 81.6 ms +- 0.7 ms -> [gh-91054-baserev] 81.1 ms +- 0.9 ms: 1.01x faster
scimark_sor: Mean +- std dev: [gh-91054] 130 ms +- 1 ms -> [gh-91054-baserev] 129 ms +- 2 ms: 1.00x faster
scimark_sparse_mat_mult: Mean +- std dev: [gh-91054] 5.15 ms +- 0.15 ms -> [gh-91054-baserev] 5.24 ms +- 0.08 ms: 1.02x slower
sqlglot_parse: Mean +- std dev: [gh-91054] 1.63 ms +- 0.02 ms -> [gh-91054-baserev] 1.65 ms +- 0.02 ms: 1.01x slower
sqlglot_transpile: Mean +- std dev: [gh-91054] 1.98 ms +- 0.02 ms -> [gh-91054-baserev] 1.99 ms +- 0.03 ms: 1.01x slower
sqlglot_optimize: Mean +- std dev: [gh-91054] 61.9 ms +- 0.3 ms -> [gh-91054-baserev] 62.6 ms +- 0.3 ms: 1.01x slower
sqlglot_normalize: Mean +- std dev: [gh-91054] 128 ms +- 1 ms -> [gh-91054-baserev] 130 ms +- 1 ms: 1.02x slower
sqlite_synth: Mean +- std dev: [gh-91054] 3.23 us +- 0.07 us -> [gh-91054-baserev] 3.21 us +- 0.06 us: 1.01x faster
sympy_expand: Mean +- std dev: [gh-91054] 553 ms +- 6 ms -> [gh-91054-baserev] 562 ms +- 3 ms: 1.02x slower
sympy_integrate: Mean +- std dev: [gh-91054] 24.9 ms +- 0.2 ms -> [gh-91054-baserev] 25.0 ms +- 0.2 ms: 1.01x slower
sympy_sum: Mean +- std dev: [gh-91054] 200 ms +- 2 ms -> [gh-91054-baserev] 201 ms +- 2 ms: 1.01x slower
sympy_str: Mean +- std dev: [gh-91054] 343 ms +- 4 ms -> [gh-91054-baserev] 348 ms +- 2 ms: 1.01x slower
telco: Mean +- std dev: [gh-91054] 7.86 ms +- 0.17 ms -> [gh-91054-baserev] 7.79 ms +- 0.17 ms: 1.01x faster
tornado_http: Mean +- std dev: [gh-91054] 143 ms +- 2 ms -> [gh-91054-baserev] 144 ms +- 2 ms: 1.01x slower
unpickle: Mean +- std dev: [gh-91054] 17.4 us +- 2.4 us -> [gh-91054-baserev] 16.5 us +- 0.8 us: 1.06x faster
unpickle_list: Mean +- std dev: [gh-91054] 6.23 us +- 0.09 us -> [gh-91054-baserev] 6.35 us +- 0.07 us: 1.02x slower
unpickle_pure_python: Mean +- std dev: [gh-91054] 246 us +- 2 us -> [gh-91054-baserev] 244 us +- 2 us: 1.01x faster
xml_etree_parse: Mean +- std dev: [gh-91054] 184 ms +- 2 ms -> [gh-91054-baserev] 186 ms +- 4 ms: 1.01x slower
xml_etree_iterparse: Mean +- std dev: [gh-91054] 126 ms +- 1 ms -> [gh-91054-baserev] 127 ms +- 1 ms: 1.00x slower
xml_etree_generate: Mean +- std dev: [gh-91054] 94.2 ms +- 0.6 ms -> [gh-91054-baserev] 98.3 ms +- 0.9 ms: 1.04x slower
xml_etree_process: Mean +- std dev: [gh-91054] 65.2 ms +- 0.7 ms -> [gh-91054-baserev] 68.0 ms +- 0.9 ms: 1.04x slower
Benchmark hidden because not significant (13): bench_mp_pool, crypto_pyaes, deltablue, django_template, docutils, float, html5lib, logging_simple, meteor_contest, pyflate, python_startup_no_site, spectral_norm, unpack_sequence
Geometric mean: 1.00x slower
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment