Skip to content

Instantly share code, notes, and snippets.

@itamaro
Created April 24, 2023 20:23
Show Gist options
  • Save itamaro/3209189006b5a48bc9dc1207c6046b66 to your computer and use it in GitHub Desktop.
Save itamaro/3209189006b5a48bc9dc1207c6046b66 to your computer and use it in GitHub Desktop.
pyperformance results for deferring asyncio task name formatting
3.12-baseline.20230424.1.json
=============================
Performance version: 1.0.7
Report on Linux-5.15.0-1033-aws-x86_64-with-glibc2.31
Number of logical CPUs: 72
Start date: 2023-04-24 16:20:46.174823
End date: 2023-04-24 17:56:34.787522
3.12-defer-task-name-format.20230424.1.json
===========================================
Performance version: 1.0.7
Report on Linux-5.15.0-1033-aws-x86_64-with-glibc2.31
Number of logical CPUs: 72
Start date: 2023-04-24 18:18:46.562073
End date: 2023-04-24 19:55:28.499515
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| Benchmark | 3.12-baseline.20230424.1.json | 3.12-defer-task-name-format.20230424.1.json | Change | Significance |
+=========================+===============================+=============================================+==============+=========================+
| 2to3 | 329 ms | 329 ms | 1.00x faster | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| async_generators | 486 ms | 476 ms | 1.02x faster | Significant (t=13.40) |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| async_tree_cpu_io_mixed | 859 ms | 833 ms | 1.03x faster | Significant (t=7.85) |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| async_tree_io | 1.46 sec | 1.42 sec | 1.03x faster | Significant (t=9.57) |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| async_tree_memoization | 729 ms | 700 ms | 1.04x faster | Significant (t=21.87) |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| async_tree_none | 607 ms | 577 ms | 1.05x faster | Significant (t=13.19) |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| asyncio_tcp | 633 ms | 618 ms | 1.02x faster | Significant (t=12.82) |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| bench_mp_pool | 8.29 ms | 8.36 ms | 1.01x slower | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| bench_thread_pool | 1.73 ms | 1.73 ms | 1.00x faster | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| chameleon | 8.39 ms | 8.43 ms | 1.00x slower | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| chaos | 83.5 ms | 82.2 ms | 1.02x faster | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| comprehensions | 28.1 us | 27.9 us | 1.01x faster | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| coroutines | 27.8 ms | 26.8 ms | 1.04x faster | Significant (t=28.76) |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| coverage | 125 ms | 124 ms | 1.01x faster | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| create_gc_cycles | 1.69 ms | 1.76 ms | 1.04x slower | Significant (t=-33.08) |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| crypto_pyaes | 94.6 ms | 92.9 ms | 1.02x faster | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| dask | 619 ms | 622 ms | 1.00x slower | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| deepcopy | 434 us | 438 us | 1.01x slower | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| deepcopy_memo | 46.5 us | 46.7 us | 1.00x slower | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| deepcopy_reduce | 3.81 us | 3.91 us | 1.03x slower | Significant (t=-17.54) |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| deltablue | 4.44 ms | 4.43 ms | 1.00x faster | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| django_template | 41.9 ms | 42.1 ms | 1.00x slower | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| docutils | 3.20 sec | 3.20 sec | 1.00x slower | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| dulwich_log | 88.9 ms | 88.6 ms | 1.00x faster | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| fannkuch | 467 ms | 469 ms | 1.00x slower | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| float | 100 ms | 102 ms | 1.02x slower | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| gc_traversal | 4.46 ms | 4.75 ms | 1.06x slower | Significant (t=-144.67) |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| generators | 37.5 ms | 37.0 ms | 1.01x faster | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| genshi_text | 27.3 ms | 27.4 ms | 1.00x slower | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| genshi_xml | 63.3 ms | 62.2 ms | 1.02x faster | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| go | 166 ms | 166 ms | 1.00x faster | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| hexiom | 7.48 ms | 7.36 ms | 1.02x faster | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| html5lib | 79.5 ms | 79.1 ms | 1.00x faster | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| json_dumps | 12.1 ms | 12.1 ms | 1.00x faster | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| json_loads | 30.5 us | 30.9 us | 1.01x slower | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| logging_format | 9.03 us | 9.11 us | 1.01x slower | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| logging_silent | 122 ns | 124 ns | 1.02x slower | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| logging_simple | 8.22 us | 8.18 us | 1.00x faster | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| mako | 13.5 ms | 13.3 ms | 1.01x faster | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| mdp | 3.11 sec | 3.26 sec | 1.05x slower | Significant (t=-70.38) |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| meteor_contest | 137 ms | 137 ms | 1.00x faster | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| nbody | 108 ms | 108 ms | 1.01x faster | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| nqueens | 99.2 ms | 97.9 ms | 1.01x faster | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| pathlib | 27.2 ms | 27.2 ms | 1.00x slower | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| pickle | 13.2 us | 13.0 us | 1.02x faster | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| pickle_dict | 39.0 us | 37.8 us | 1.03x faster | Significant (t=29.40) |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| pickle_list | 5.29 us | 5.53 us | 1.05x slower | Significant (t=-32.55) |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| pickle_pure_python | 384 us | 383 us | 1.00x faster | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| pidigits | 242 ms | 242 ms | 1.00x faster | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| pprint_pformat | 1.81 sec | 1.80 sec | 1.00x faster | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| pprint_safe_repr | 884 ms | 885 ms | 1.00x slower | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| pyflate | 554 ms | 552 ms | 1.00x faster | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| python_startup | 12.4 ms | 12.5 ms | 1.00x slower | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| python_startup_no_site | 9.55 ms | 9.57 ms | 1.00x slower | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| raytrace | 365 ms | 366 ms | 1.00x slower | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| regex_compile | 174 ms | 173 ms | 1.00x faster | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| regex_dna | 264 ms | 240 ms | 1.10x faster | Significant (t=172.81) |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| regex_effbot | 4.23 ms | 4.37 ms | 1.03x slower | Significant (t=-39.31) |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| regex_v8 | 25.8 ms | 26.7 ms | 1.03x slower | Significant (t=-44.09) |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| richards | 52.8 ms | 52.8 ms | 1.00x slower | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| scimark_fft | 422 ms | 430 ms | 1.02x slower | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| scimark_lu | 137 ms | 134 ms | 1.02x faster | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| scimark_monte_carlo | 88.3 ms | 88.6 ms | 1.00x slower | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| scimark_sor | 150 ms | 148 ms | 1.01x faster | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| scimark_sparse_mat_mult | 5.61 ms | 5.90 ms | 1.05x slower | Significant (t=-37.53) |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| spectral_norm | 125 ms | 125 ms | 1.00x faster | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| sqlglot_normalize | 137 ms | 136 ms | 1.00x faster | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| sqlglot_optimize | 66.7 ms | 66.5 ms | 1.00x faster | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| sqlglot_parse | 1.62 ms | 1.63 ms | 1.00x slower | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| sqlglot_transpile | 2.00 ms | 2.01 ms | 1.00x slower | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| sqlite_synth | 3.35 us | 3.35 us | 1.00x slower | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| sympy_expand | 604 ms | 604 ms | 1.00x faster | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| sympy_integrate | 26.6 ms | 26.6 ms | 1.00x slower | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| sympy_str | 375 ms | 375 ms | 1.00x slower | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| sympy_sum | 221 ms | 221 ms | 1.00x faster | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| telco | 8.30 ms | 8.39 ms | 1.01x slower | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| tomli_loads | 2.71 sec | 2.75 sec | 1.02x slower | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| tornado_http | 153 ms | 152 ms | 1.01x faster | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| unpack_sequence | 62.1 ns | 59.6 ns | 1.04x faster | Significant (t=64.62) |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| unpickle | 17.7 us | 18.8 us | 1.06x slower | Significant (t=-4.91) |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| unpickle_list | 6.46 us | 6.34 us | 1.02x faster | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| unpickle_pure_python | 265 us | 264 us | 1.00x faster | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| xml_etree_generate | 100 ms | 102 ms | 1.01x slower | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| xml_etree_iterparse | 125 ms | 125 ms | 1.00x faster | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| xml_etree_parse | 189 ms | 190 ms | 1.01x slower | Not significant |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
| xml_etree_process | 70.0 ms | 71.5 ms | 1.02x slower | Significant (t=-12.44) |
+-------------------------+-------------------------------+---------------------------------------------+--------------+-------------------------+
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment