Skip to content

Instantly share code, notes, and snippets.

@ericsnowcurrently
Created October 21, 2022 16:35
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save ericsnowcurrently/d027ff4130dedec3b58ab1f55be11e8c to your computer and use it in GitHub Desktop.
Save ericsnowcurrently/d027ff4130dedec3b58ab1f55be11e8c to your computer and use it in GitHub Desktop.

Comparing:

left: https://github.com/Kronuz/cpython/commit/553d3c10172254b190078c50eb9f8e60522c8f41 right: https://github.com/Kronuz/cpython/commit/44b7e9b87676e0bccde43103a4c954c8d79de017 (aka kronuz/lazy_imports)

No change in performance

$ bench-jobs compare req-compile-bench-1666307353-esnow-linux req-compile-bench-1666307369-esnow-linux
[snip]

All benchmarks:
===============

+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| Benchmark               | req-compile-bench-1666307353-esnow-linux/pyperformance-results.json.gz | req-compile-bench-1666307369-esnow-linux/pyperformance-results.json.gz |
+=========================+========================================================================+========================================================================+
| telco                   | 6.69 ms                                                                | 6.42 ms: 1.04x faster                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| pickle_pure_python      | 297 us                                                                 | 285 us: 1.04x faster                                                   |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| sqlglot_parse           | 1.37 ms                                                                | 1.32 ms: 1.04x faster                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| sqlglot_transpile       | 1.66 ms                                                                | 1.62 ms: 1.03x faster                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| chameleon               | 6.72 ms                                                                | 6.56 ms: 1.03x faster                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| deltablue               | 3.39 ms                                                                | 3.32 ms: 1.02x faster                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| nbody                   | 96.5 ms                                                                | 94.4 ms: 1.02x faster                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| pycparser               | 1.09 sec                                                               | 1.07 sec: 1.02x faster                                                 |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| fannkuch                | 376 ms                                                                 | 369 ms: 1.02x faster                                                   |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| raytrace                | 287 ms                                                                 | 282 ms: 1.02x faster                                                   |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| django_template         | 33.3 ms                                                                | 32.8 ms: 1.02x faster                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| pyflate                 | 411 ms                                                                 | 404 ms: 1.02x faster                                                   |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| hexiom                  | 6.14 ms                                                                | 6.04 ms: 1.02x faster                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| async_tree_none         | 535 ms                                                                 | 527 ms: 1.02x faster                                                   |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| xml_etree_iterparse     | 103 ms                                                                 | 102 ms: 1.01x faster                                                   |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| pickle_dict             | 31.8 us                                                                | 31.4 us: 1.01x faster                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| regex_v8                | 21.5 ms                                                                | 21.2 ms: 1.01x faster                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| tornado_http            | 93.8 ms                                                                | 92.8 ms: 1.01x faster                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| coroutines              | 24.5 ms                                                                | 24.2 ms: 1.01x faster                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| sympy_str               | 283 ms                                                                 | 280 ms: 1.01x faster                                                   |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| xml_etree_generate      | 76.8 ms                                                                | 76.1 ms: 1.01x faster                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| float                   | 72.7 ms                                                                | 72.1 ms: 1.01x faster                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| xml_etree_process       | 53.9 ms                                                                | 53.4 ms: 1.01x faster                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| async_tree_cpu_io_mixed | 734 ms                                                                 | 728 ms: 1.01x faster                                                   |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| sympy_integrate         | 20.4 ms                                                                | 20.3 ms: 1.01x faster                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| go                      | 135 ms                                                                 | 134 ms: 1.01x faster                                                   |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| sqlglot_optimize        | 51.6 ms                                                                | 51.5 ms: 1.00x faster                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| python_startup          | 8.39 ms                                                                | 8.38 ms: 1.00x faster                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| python_startup_no_site  | 6.08 ms                                                                | 6.08 ms: 1.00x slower                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| aiohttp                 | 1.00 ms                                                                | 1.01 ms: 1.00x slower                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| regex_compile           | 129 ms                                                                 | 129 ms: 1.00x slower                                                   |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| sympy_sum               | 164 ms                                                                 | 165 ms: 1.00x slower                                                   |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| meteor_contest          | 103 ms                                                                 | 103 ms: 1.01x slower                                                   |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| unpickle_pure_python    | 205 us                                                                 | 207 us: 1.01x slower                                                   |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| 2to3                    | 249 ms                                                                 | 250 ms: 1.01x slower                                                   |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| sqlglot_normalize       | 105 ms                                                                 | 105 ms: 1.01x slower                                                   |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| pickle                  | 10.3 us                                                                | 10.4 us: 1.01x slower                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| logging_format          | 6.36 us                                                                | 6.42 us: 1.01x slower                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| logging_simple          | 5.72 us                                                                | 5.77 us: 1.01x slower                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| regex_dna               | 202 ms                                                                 | 204 ms: 1.01x slower                                                   |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| crypto_pyaes            | 73.8 ms                                                                | 74.5 ms: 1.01x slower                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| pprint_safe_repr        | 680 ms                                                                 | 687 ms: 1.01x slower                                                   |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| xml_etree_parse         | 145 ms                                                                 | 147 ms: 1.01x slower                                                   |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| chaos                   | 66.5 ms                                                                | 67.2 ms: 1.01x slower                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| unpickle_list           | 4.96 us                                                                | 5.02 us: 1.01x slower                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| nqueens                 | 79.6 ms                                                                | 80.6 ms: 1.01x slower                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| spectral_norm           | 97.5 ms                                                                | 98.8 ms: 1.01x slower                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| thrift                  | 745 us                                                                 | 756 us: 1.01x slower                                                   |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| genshi_xml              | 49.6 ms                                                                | 50.4 ms: 1.02x slower                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| coverage                | 96.7 ms                                                                | 98.4 ms: 1.02x slower                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| pathlib                 | 17.8 ms                                                                | 18.1 ms: 1.02x slower                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| richards                | 44.2 ms                                                                | 45.1 ms: 1.02x slower                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| pidigits                | 190 ms                                                                 | 193 ms: 1.02x slower                                                   |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| scimark_monte_carlo     | 65.2 ms                                                                | 66.6 ms: 1.02x slower                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| json_loads              | 24.1 us                                                                | 24.6 us: 1.02x slower                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| scimark_fft             | 311 ms                                                                 | 318 ms: 1.02x slower                                                   |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| deepcopy                | 332 us                                                                 | 340 us: 1.02x slower                                                   |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| scimark_lu              | 106 ms                                                                 | 109 ms: 1.02x slower                                                   |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| unpack_sequence         | 44.4 ns                                                                | 45.5 ns: 1.03x slower                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| pickle_list             | 4.06 us                                                                | 4.17 us: 1.03x slower                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| regex_effbot            | 3.33 ms                                                                | 3.43 ms: 1.03x slower                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| generators              | 73.5 ms                                                                | 75.7 ms: 1.03x slower                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| json_dumps              | 9.39 ms                                                                | 9.69 ms: 1.03x slower                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| deepcopy_memo           | 34.7 us                                                                | 35.8 us: 1.03x slower                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| scimark_sparse_mat_mult | 4.09 ms                                                                | 4.25 ms: 1.04x slower                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| logging_silent          | 93.0 ns                                                                | 96.6 ns: 1.04x slower                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| mdp                     | 2.49 sec                                                               | 2.60 sec: 1.05x slower                                                 |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| sqlite_synth            | 2.59 us                                                                | 2.71 us: 1.05x slower                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| deepcopy_reduce         | 2.90 us                                                                | 3.03 us: 1.05x slower                                                  |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+
| Geometric mean          | (ref)                                                                  | 1.00x slower                                                           |
+-------------------------+------------------------------------------------------------------------+------------------------------------------------------------------------+

Benchmark hidden because not significant (16): scimark_sor, sympy_expand, sqlalchemy_declarative, async_tree_io, genshi_text, dulwich_log, unpickle, gunicorn, mako, mypy, sqlalchemy_imperative, pprint_pformat, json, html5lib, pylint, async_tree_memoization
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment