Skip to content

Instantly share code, notes, and snippets.

@ksamuel
Created October 3, 2023 16:35
Show Gist options
  • Save ksamuel/8a283a79d547e93366c85c7e043e70a1 to your computer and use it in GitHub Desktop.
Save ksamuel/8a283a79d547e93366c85c7e043e70a1 to your computer and use it in GitHub Desktop.
py311.json
==========
Performance version: 1.0.9
Report on Linux-5.15.0-84-generic-x86_64-with-glibc2.31
Number of logical CPUs: 8
Start date: 2023-10-03 15:46:40.037527
End date: 2023-10-03 16:30:51.189955
py312.json
==========
Performance version: 1.0.9
Report on Linux-5.15.0-84-generic-x86_64-with-glibc2.31
Number of logical CPUs: 8
Start date: 2023-10-03 16:51:38.432027
End date: 2023-10-03 17:38:09.827299
### 2to3 ###
Mean +- std dev: 310 ms +- 13 ms -> 285 ms +- 13 ms: 1.09x faster
Significant (t=10.34)
### async_generators ###
Mean +- std dev: 304 ms +- 53 ms -> 371 ms +- 6 ms: 1.22x slower
Significant (t=-9.81)
### async_tree_cpu_io_mixed ###
Mean +- std dev: 624 ms +- 47 ms -> 676 ms +- 20 ms: 1.08x slower
Significant (t=-7.82)
### async_tree_cpu_io_mixed_tg ###
Mean +- std dev: 589 ms +- 26 ms -> 679 ms +- 36 ms: 1.15x slower
Significant (t=-15.78)
### async_tree_io ###
Mean +- std dev: 934 ms +- 9 ms -> 992 ms +- 29 ms: 1.06x slower
Significant (t=-15.00)
### async_tree_io_tg ###
Mean +- std dev: 905 ms +- 5 ms -> 1014 ms +- 19 ms: 1.12x slower
Significant (t=-41.81)
### async_tree_memoization ###
Mean +- std dev: 493 ms +- 15 ms -> 521 ms +- 33 ms: 1.06x slower
Significant (t=-6.03)
### async_tree_memoization_tg ###
Mean +- std dev: 465 ms +- 12 ms -> 525 ms +- 21 ms: 1.13x slower
Significant (t=-19.37)
### async_tree_none ###
Mean +- std dev: 433 ms +- 75 ms -> 412 ms +- 8 ms: 1.05x faster
Significant (t=2.18)
### async_tree_none_tg ###
Mean +- std dev: 364 ms +- 4 ms -> 390 ms +- 7 ms: 1.07x slower
Significant (t=-25.80)
### asyncio_tcp ###
Mean +- std dev: 611 ms +- 5 ms -> 348 ms +- 3 ms: 1.76x faster
Significant (t=353.16)
### asyncio_tcp_ssl ###
Mean +- std dev: 2.11 sec +- 0.01 sec -> 1.17 sec +- 0.02 sec: 1.80x faster
Significant (t=303.48)
### bench_mp_pool ###
Mean +- std dev: 5.74 ms +- 1.20 ms -> 14.17 ms +- 6.45 ms: 2.47x slower
Significant (t=-9.94)
### bench_thread_pool ###
Mean +- std dev: 704 us +- 76 us -> 772 us +- 77 us: 1.10x slower
Significant (t=-4.83)
### chameleon ###
Mean +- std dev: 5.14 ms +- 0.08 ms -> 6.23 ms +- 0.13 ms: 1.21x slower
Significant (t=-55.85)
### chaos ###
Mean +- std dev: 50.4 ms +- 0.7 ms -> 55.9 ms +- 0.8 ms: 1.11x slower
Significant (t=-40.36)
### comprehensions ###
Mean +- std dev: 17.6 us +- 0.3 us -> 19.0 us +- 0.2 us: 1.08x slower
Significant (t=-29.67)
### coroutines ###
Mean +- std dev: 18.2 ms +- 0.3 ms -> 19.7 ms +- 0.3 ms: 1.08x slower
Significant (t=-27.58)
### coverage ###
Mean +- std dev: 317 ms +- 5 ms -> 634 ms +- 14 ms: 2.00x slower
Significant (t=-168.43)
### create_gc_cycles ###
Mean +- std dev: 905 us +- 6 us -> 972 us +- 7 us: 1.07x slower
Significant (t=-52.69)
### crypto_pyaes ###
Mean +- std dev: 58.6 ms +- 1.0 ms -> 65.6 ms +- 1.5 ms: 1.12x slower
Significant (t=-29.99)
### dask ###
Mean +- std dev: 375 ms +- 14 ms -> 461 ms +- 27 ms: 1.23x slower
Significant (t=-22.00)
### deepcopy ###
Mean +- std dev: 271 us +- 3 us -> 326 us +- 9 us: 1.20x slower
Significant (t=-44.68)
### deepcopy_memo ###
Mean +- std dev: 27.6 us +- 0.5 us -> 31.7 us +- 0.4 us: 1.15x slower
Significant (t=-48.08)
### deepcopy_reduce ###
Mean +- std dev: 2.46 us +- 0.03 us -> 3.10 us +- 0.05 us: 1.26x slower
Significant (t=-88.00)
### deltablue ###
Mean +- std dev: 2.82 ms +- 0.03 ms -> 2.71 ms +- 0.05 ms: 1.04x faster
Significant (t=14.81)
### django_template ###
Mean +- std dev: 26.1 ms +- 0.4 ms -> 33.7 ms +- 0.8 ms: 1.29x slower
Significant (t=-64.15)
### docutils ###
Mean +- std dev: 1.93 sec +- 0.02 sec -> 2.24 sec +- 0.05 sec: 1.16x slower
Significant (t=-42.17)
### dulwich_log ###
Mean +- std dev: 48.7 ms +- 0.7 ms -> 54.4 ms +- 1.1 ms: 1.12x slower
Significant (t=-33.24)
### fannkuch ###
Mean +- std dev: 287 ms +- 5 ms -> 315 ms +- 4 ms: 1.10x slower
Significant (t=-36.51)
### float ###
Mean +- std dev: 55.9 ms +- 1.0 ms -> 68.9 ms +- 1.3 ms: 1.23x slower
Significant (t=-63.74)
### gc_traversal ###
Mean +- std dev: 2.60 ms +- 0.02 ms -> 2.83 ms +- 0.03 ms: 1.09x slower
Significant (t=-52.25)
### generators ###
Mean +- std dev: 53.2 ms +- 0.7 ms -> 26.3 ms +- 0.4 ms: 2.02x faster
Significant (t=250.74)
### genshi_text ###
Mean +- std dev: 17.1 ms +- 0.3 ms -> 20.8 ms +- 0.5 ms: 1.22x slower
Significant (t=-50.48)
### genshi_xml ###
Mean +- std dev: 40.7 ms +- 0.7 ms -> 45.6 ms +- 0.6 ms: 1.12x slower
Significant (t=-40.56)
### go ###
Mean +- std dev: 107 ms +- 2 ms -> 112 ms +- 2 ms: 1.04x slower
Significant (t=-16.10)
### hexiom ###
Mean +- std dev: 4.79 ms +- 0.06 ms -> 4.80 ms +- 0.08 ms: 1.00x slower
Not significant
### html5lib ###
Mean +- std dev: 50.7 ms +- 2.0 ms -> 53.2 ms +- 2.5 ms: 1.05x slower
Significant (t=-6.08)
### json_dumps ###
Mean +- std dev: 9.77 ms +- 0.12 ms -> 9.29 ms +- 0.23 ms: 1.05x faster
Significant (t=14.27)
### json_loads ###
Mean +- std dev: 16.6 us +- 0.3 us -> 22.1 us +- 3.0 us: 1.34x slower
Significant (t=-14.48)
### logging_format ###
Mean +- std dev: 5.17 us +- 0.10 us -> 6.25 us +- 0.14 us: 1.21x slower
Significant (t=-48.23)
### logging_silent ###
Mean +- std dev: 76.1 ns +- 1.5 ns -> 89.3 ns +- 2.3 ns: 1.17x slower
Significant (t=-36.73)
### logging_simple ###
Mean +- std dev: 4.76 us +- 0.06 us -> 5.65 us +- 0.13 us: 1.19x slower
Significant (t=-47.77)
### mako ###
Mean +- std dev: 7.24 ms +- 0.15 ms -> 9.37 ms +- 0.24 ms: 1.29x slower
Significant (t=-58.60)
### mdp ###
Mean +- std dev: 1.97 sec +- 0.02 sec -> 2.44 sec +- 0.06 sec: 1.24x slower
Significant (t=-56.93)
### meteor_contest ###
Mean +- std dev: 81.6 ms +- 0.8 ms -> 89.9 ms +- 2.1 ms: 1.10x slower
Significant (t=-28.63)
### nbody ###
Mean +- std dev: 68.0 ms +- 1.0 ms -> 71.6 ms +- 1.7 ms: 1.05x slower
Significant (t=-14.31)
### nqueens ###
Mean +- std dev: 70.7 ms +- 0.9 ms -> 82.1 ms +- 3.6 ms: 1.16x slower
Significant (t=-23.67)
### pathlib ###
Mean +- std dev: 13.7 ms +- 0.2 ms -> 15.7 ms +- 0.3 ms: 1.14x slower
Significant (t=-50.10)
### pickle ###
Mean +- std dev: 6.71 us +- 0.11 us -> 8.28 us +- 0.09 us: 1.23x slower
Significant (t=-85.78)
### pickle_dict ###
Mean +- std dev: 21.6 us +- 0.4 us -> 21.6 us +- 0.3 us: 1.00x faster
Not significant
### pickle_list ###
Mean +- std dev: 2.78 us +- 0.04 us -> 3.23 us +- 0.07 us: 1.16x slower
Significant (t=-41.39)
### pickle_pure_python ###
Mean +- std dev: 236 us +- 12 us -> 269 us +- 3 us: 1.14x slower
Significant (t=-19.91)
### pidigits ###
Mean +- std dev: 175 ms +- 3 ms -> 179 ms +- 3 ms: 1.02x slower
Significant (t=-7.66)
### pprint_pformat ###
Mean +- std dev: 1.18 sec +- 0.01 sec -> 1.52 sec +- 0.04 sec: 1.29x slower
Significant (t=-58.58)
### pprint_safe_repr ###
Mean +- std dev: 573 ms +- 7 ms -> 753 ms +- 14 ms: 1.31x slower
Significant (t=-91.17)
### pyflate ###
Mean +- std dev: 325 ms +- 4 ms -> 358 ms +- 5 ms: 1.10x slower
Significant (t=-41.65)
### python_startup ###
Mean +- std dev: 6.72 ms +- 0.26 ms -> 8.15 ms +- 0.26 ms: 1.21x slower
Significant (t=-55.41)
### python_startup_no_site ###
Mean +- std dev: 4.86 ms +- 0.15 ms -> 6.44 ms +- 0.31 ms: 1.32x slower
Significant (t=-65.44)
### raytrace ###
Mean +- std dev: 225 ms +- 3 ms -> 274 ms +- 3 ms: 1.22x slower
Significant (t=-84.20)
### regex_compile ###
Mean +- std dev: 108 ms +- 2 ms -> 123 ms +- 2 ms: 1.14x slower
Significant (t=-40.31)
### regex_dna ###
Mean +- std dev: 141 ms +- 1 ms -> 144 ms +- 1 ms: 1.03x slower
Significant (t=-15.26)
### regex_effbot ###
Mean +- std dev: 2.17 ms +- 0.03 ms -> 2.35 ms +- 0.04 ms: 1.08x slower
Significant (t=-30.02)
### regex_v8 ###
Mean +- std dev: 15.8 ms +- 0.1 ms -> 17.6 ms +- 0.2 ms: 1.11x slower
Significant (t=-56.43)
### richards ###
Mean +- std dev: 37.2 ms +- 0.9 ms -> 37.6 ms +- 1.4 ms: 1.01x slower
Not significant
### richards_super ###
Mean +- std dev: 45.1 ms +- 1.1 ms -> 42.1 ms +- 1.2 ms: 1.07x faster
Significant (t=14.52)
### scimark_fft ###
Mean +- std dev: 209 ms +- 2 ms -> 246 ms +- 3 ms: 1.17x slower
Significant (t=-69.77)
### scimark_lu ###
Mean +- std dev: 72.9 ms +- 1.1 ms -> 92.9 ms +- 2.1 ms: 1.27x slower
Significant (t=-67.02)
### scimark_monte_carlo ###
Mean +- std dev: 50.1 ms +- 0.9 ms -> 58.3 ms +- 0.8 ms: 1.16x slower
Significant (t=-51.06)
### scimark_sor ###
Mean +- std dev: 86.9 ms +- 1.9 ms -> 102.6 ms +- 1.4 ms: 1.18x slower
Significant (t=-51.19)
### scimark_sparse_mat_mult ###
Mean +- std dev: 3.21 ms +- 0.08 ms -> 3.36 ms +- 0.11 ms: 1.05x slower
Significant (t=-8.89)
### spectral_norm ###
Mean +- std dev: 70.4 ms +- 1.2 ms -> 87.2 ms +- 1.4 ms: 1.24x slower
Significant (t=-69.46)
### sqlglot_normalize ###
Mean +- std dev: 221 ms +- 2 ms -> 103 ms +- 1 ms: 2.15x faster
Significant (t=350.67)
### sqlglot_optimize ###
Mean +- std dev: 41.2 ms +- 0.5 ms -> 50.2 ms +- 0.5 ms: 1.22x slower
Significant (t=-100.42)
### sqlglot_parse ###
Mean +- std dev: 1.04 ms +- 0.02 ms -> 1.12 ms +- 0.02 ms: 1.07x slower
Significant (t=-25.70)
### sqlglot_transpile ###
Mean +- std dev: 1.28 ms +- 0.02 ms -> 1.40 ms +- 0.02 ms: 1.10x slower
Significant (t=-30.61)
### sqlite_synth ###
Mean +- std dev: 1.96 us +- 0.04 us -> 2.36 us +- 0.04 us: 1.21x slower
Significant (t=-55.03)
### sympy_expand ###
Mean +- std dev: 388 ms +- 4 ms -> 443 ms +- 19 ms: 1.14x slower
Significant (t=-21.91)
### sympy_integrate ###
Mean +- std dev: 16.1 ms +- 0.2 ms -> 17.3 ms +- 0.3 ms: 1.07x slower
Significant (t=-26.28)
### sympy_str ###
Mean +- std dev: 227 ms +- 2 ms -> 252 ms +- 3 ms: 1.11x slower
Significant (t=-52.55)
### sympy_sum ###
Mean +- std dev: 121 ms +- 1 ms -> 128 ms +- 2 ms: 1.05x slower
Significant (t=-19.10)
### telco ###
Mean +- std dev: 5.22 ms +- 0.16 ms -> 6.47 ms +- 0.12 ms: 1.24x slower
Significant (t=-49.13)
### tomli_loads ###
Mean +- std dev: 1.64 sec +- 0.03 sec -> 1.98 sec +- 0.06 sec: 1.21x slower
Significant (t=-41.96)
### tornado_http ###
Mean +- std dev: 86.7 ms +- 2.1 ms -> 92.5 ms +- 2.3 ms: 1.07x slower
Significant (t=-14.57)
### typing_runtime_protocols ###
Mean +- std dev: 369 us +- 5 us -> 138 us +- 3 us: 2.67x faster
Significant (t=288.51)
### unpack_sequence ###
Mean +- std dev: 32.8 ns +- 0.7 ns -> 32.0 ns +- 0.5 ns: 1.03x faster
Significant (t=7.23)
### unpickle ###
Mean +- std dev: 9.40 us +- 0.15 us -> 12.33 us +- 0.42 us: 1.31x slower
Significant (t=-51.26)
### unpickle_list ###
Mean +- std dev: 2.88 us +- 0.07 us -> 3.71 us +- 0.11 us: 1.29x slower
Significant (t=-48.07)
### unpickle_pure_python ###
Mean +- std dev: 176 us +- 2 us -> 201 us +- 3 us: 1.14x slower
Significant (t=-52.27)
### xml_etree_generate ###
Mean +- std dev: 58.5 ms +- 1.0 ms -> 86.5 ms +- 2.2 ms: 1.48x slower
Significant (t=-88.39)
### xml_etree_iterparse ###
Mean +- std dev: 80.6 ms +- 0.8 ms -> 80.3 ms +- 1.2 ms: 1.00x faster
Not significant
### xml_etree_parse ###
Mean +- std dev: 119 ms +- 2 ms -> 117 ms +- 2 ms: 1.01x faster
Not significant
### xml_etree_process ###
Mean +- std dev: 40.7 ms +- 0.5 ms -> 58.7 ms +- 1.3 ms: 1.44x slower
Significant (t=-98.24)
Skipped 2 benchmarks only in py311.json: sqlalchemy_declarative, sqlalchemy_imperative
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment