Skip to content

Instantly share code, notes, and snippets.

@chris-eibl

chris-eibl/bench_all.rst

Last active March 13, 2025 06:23
Download ZIP
Raw
readme.md

Here are detailed 64bit pyperformance results on my Windows 10 PC (dusty i5-4570 CPU) run with --fast --affinity 0 for commit https://github.com/python/cpython/pull/129907/commits/9db1a297d95574cc3114854c8c427736d9521917, when working on

python/cpython#130090: Support PGO for clang-cl

Compilers used:

  • Microsoft Visual Studio 2022 17.13.0 Preview 5.0 which can do PGO again (python/cpython#129244)
  • which ships with clang-cl 19.1.1
  • for the clang-cl 18.1.18 builds I manually added <AdditionalOptions Condition="'$(Platform)' == 'x64' and $(PlatformToolset) == 'ClangCL'">/arch:AVX</AdditionalOptions>, hence dirty. See also python/cpython#130213
  • cg marks computed gotosbuilds, where I manually added HAVE_COMPUTED_GOTOS to PreprocessorDefinitions, hence "dirty"
  • tc marks tail call builds, where I manually added Py_TAIL_CALL_INTERP=1 to PreprocessorDefinitions, hence "dirty"
  • fixed in 20.x, backport not yet : llvm/llvm-project#130585

Raw data is here: https://gist.github.com/chris-eibl/c73b02762a7c467e9a410a0aa19c7701

Interestingly, clang 18.1.8 is faster than 19.1.1, but especially in case of the computed gotos this is a known issue

Unsurprisingly, that in case of "working" computed gotos, the regex benchmarks are faster, too, because they are there used as well.

So I propose to add --with-computed-gotos to build.bat, like --tail-call-interp (python/cpython#130040), since the latter won't speed up regex (yet).

Raw
bench_all.rst
Benchmark msvc.release.9db1a297d9 clang.release.18.1.8.9db1a297d9 clang.release.9db1a297d9 clang.release.cg.18.1.8.9db1a297d9 clang.release.cg.9db1a297d9 clang.release.tc.gc.20.1.0.rc2.9db1a297d9
Geometric mean (ref) 1.32x faster 1.27x faster 1.34x faster 1.27x faster 1.40x faster
Benchmark msvc.pgo.9db1a297d9 clang.pgo.18.1.8.9db1a297d9 clang.pgo.9db1a297d9 clang.pgo.cg.18.1.8.9db1a297d9 clang.pgo.cg.9db1a297d9 clang.pgo.tc.9db1a297d9 clang.pgo.tc.20.1.0.rc2.9db1a297d9 clang.pgo.tc.gc.20.1.0.rc2.9db1a297d9
Geometric mean (ref) 1.19x faster 1.15x faster 1.19x faster 1.10x faster 1.21x faster 1.25x faster 1.25x faster
Raw
bench_pgo.rst

Benchmarks with tag 'apps':

Benchmark msvc.release.9db1a297d9 msvc.pgo.9db1a297d9 clang.pgo.18.1.8.9db1a297d9 clang.pgo.9db1a297d9 clang.pgo.cg.18.1.8.9db1a297d9 clang.pgo.cg.9db1a297d9 clang.pgo.tc.9db1a297d9 clang.pgo.tc.20.1.0.rc2.9db1a297d9 clang.pgo.tc.gc.20.1.0.rc2.9db1a297d9
2to3 586 ms 462 ms: 1.27x faster 424 ms: 1.38x faster 426 ms: 1.38x faster 422 ms: 1.39x faster 444 ms: 1.32x faster 409 ms: 1.43x faster 398 ms: 1.47x faster 401 ms: 1.46x faster
docutils 4.27 sec 3.50 sec: 1.22x faster 3.22 sec: 1.33x faster 3.31 sec: 1.29x faster 3.22 sec: 1.32x faster 3.44 sec: 1.24x faster 3.16 sec: 1.35x faster 3.12 sec: 1.37x faster 3.12 sec: 1.37x faster
html5lib 104 ms 77.9 ms: 1.34x faster 69.2 ms: 1.51x faster 74.5 ms: 1.40x faster 72.1 ms: 1.44x faster 76.9 ms: 1.35x faster 67.8 ms: 1.54x faster 68.6 ms: 1.52x faster 69.2 ms: 1.50x faster
Geometric mean (ref) 1.28x faster 1.40x faster 1.35x faster 1.39x faster 1.30x faster 1.44x faster 1.45x faster 1.44x faster

Benchmarks with tag 'asyncio':

Benchmark msvc.release.9db1a297d9 msvc.pgo.9db1a297d9 clang.pgo.18.1.8.9db1a297d9 clang.pgo.9db1a297d9 clang.pgo.cg.18.1.8.9db1a297d9 clang.pgo.cg.9db1a297d9 clang.pgo.tc.9db1a297d9 clang.pgo.tc.20.1.0.rc2.9db1a297d9 clang.pgo.tc.gc.20.1.0.rc2.9db1a297d9
async_tree_none 511 ms 394 ms: 1.30x faster 347 ms: 1.47x faster 357 ms: 1.43x faster 347 ms: 1.47x faster 383 ms: 1.33x faster 351 ms: 1.45x faster 330 ms: 1.55x faster 326 ms: 1.57x faster
async_tree_cpu_io_mixed 933 ms 749 ms: 1.25x faster 682 ms: 1.37x faster 697 ms: 1.34x faster 677 ms: 1.38x faster 722 ms: 1.29x faster 676 ms: 1.38x faster 652 ms: 1.43x faster 636 ms: 1.47x faster
async_tree_cpu_io_mixed_tg 891 ms 716 ms: 1.24x faster 640 ms: 1.39x faster 665 ms: 1.34x faster 657 ms: 1.36x faster 692 ms: 1.29x faster 653 ms: 1.36x faster 630 ms: 1.41x faster 617 ms: 1.44x faster
async_tree_eager 209 ms 160 ms: 1.31x faster 128 ms: 1.64x faster 133 ms: 1.57x faster 130 ms: 1.62x faster 153 ms: 1.37x faster 127 ms: 1.65x faster 121 ms: 1.73x faster 122 ms: 1.71x faster
async_tree_eager_cpu_io_mixed 656 ms 567 ms: 1.16x faster 513 ms: 1.28x faster 535 ms: 1.23x faster 516 ms: 1.27x faster 566 ms: 1.16x faster 509 ms: 1.29x faster 492 ms: 1.33x faster 495 ms: 1.33x faster
async_tree_eager_cpu_io_mixed_tg 830 ms 681 ms: 1.22x faster 620 ms: 1.34x faster 646 ms: 1.28x faster 627 ms: 1.32x faster 675 ms: 1.23x faster 621 ms: 1.34x faster 596 ms: 1.39x faster 592 ms: 1.40x faster
async_tree_eager_io 1.12 sec 874 ms: 1.28x faster 783 ms: 1.43x faster 817 ms: 1.37x faster 810 ms: 1.39x faster 887 ms: 1.27x faster 790 ms: 1.42x faster 743 ms: 1.51x faster 740 ms: 1.52x faster
async_tree_eager_io_tg 1.12 sec 898 ms: 1.25x faster 812 ms: 1.38x faster 840 ms: 1.33x faster 837 ms: 1.34x faster 888 ms: 1.26x faster 807 ms: 1.39x faster 782 ms: 1.43x faster 765 ms: 1.46x faster
async_tree_eager_memoization 393 ms 304 ms: 1.29x faster 264 ms: 1.49x faster 281 ms: 1.40x faster 268 ms: 1.46x faster 312 ms: 1.26x faster 259 ms: 1.51x faster 246 ms: 1.59x faster 246 ms: 1.60x faster
async_tree_eager_memoization_tg 546 ms 427 ms: 1.28x faster 384 ms: 1.42x faster 397 ms: 1.37x faster 387 ms: 1.41x faster 431 ms: 1.27x faster 384 ms: 1.42x faster 363 ms: 1.51x faster 359 ms: 1.52x faster
async_tree_eager_tg 408 ms 321 ms: 1.27x faster 285 ms: 1.44x faster 297 ms: 1.38x faster 285 ms: 1.43x faster 321 ms: 1.27x faster 286 ms: 1.43x faster 275 ms: 1.48x faster 270 ms: 1.51x faster
async_tree_io 1.14 sec 889 ms: 1.28x faster 805 ms: 1.41x faster 824 ms: 1.38x faster 815 ms: 1.39x faster 870 ms: 1.30x faster 801 ms: 1.42x faster 766 ms: 1.48x faster 756 ms: 1.50x faster
async_tree_io_tg 1.14 sec 877 ms: 1.30x faster 794 ms: 1.43x faster 807 ms: 1.41x faster 803 ms: 1.42x faster 872 ms: 1.30x faster 790 ms: 1.44x faster 752 ms: 1.51x faster 740 ms: 1.54x faster
async_tree_memoization 649 ms 509 ms: 1.28x faster 449 ms: 1.45x faster 458 ms: 1.42x faster 455 ms: 1.42x faster 496 ms: 1.31x faster 451 ms: 1.44x faster 423 ms: 1.54x faster 425 ms: 1.53x faster
async_tree_memoization_tg 605 ms 462 ms: 1.31x faster 417 ms: 1.45x faster 425 ms: 1.42x faster 416 ms: 1.45x faster 459 ms: 1.32x faster 419 ms: 1.44x faster 396 ms: 1.53x faster 389 ms: 1.55x faster
async_tree_none_tg 497 ms 382 ms: 1.30x faster 341 ms: 1.45x faster 352 ms: 1.41x faster 343 ms: 1.45x faster 378 ms: 1.31x faster 342 ms: 1.45x faster 329 ms: 1.51x faster 324 ms: 1.53x faster
Geometric mean (ref) 1.27x faster 1.43x faster 1.38x faster 1.41x faster 1.28x faster 1.43x faster 1.49x faster 1.51x faster

Benchmarks with tag 'math':

Benchmark msvc.release.9db1a297d9 msvc.pgo.9db1a297d9 clang.pgo.18.1.8.9db1a297d9 clang.pgo.9db1a297d9 clang.pgo.cg.18.1.8.9db1a297d9 clang.pgo.cg.9db1a297d9 clang.pgo.tc.9db1a297d9 clang.pgo.tc.20.1.0.rc2.9db1a297d9 clang.pgo.tc.gc.20.1.0.rc2.9db1a297d9
float 145 ms 116 ms: 1.25x faster 95.7 ms: 1.52x faster 96.8 ms: 1.50x faster 93.2 ms: 1.56x faster 98.5 ms: 1.47x faster 93.3 ms: 1.56x faster 87.6 ms: 1.66x faster 87.6 ms: 1.66x faster
nbody 203 ms 171 ms: 1.19x faster 119 ms: 1.71x faster 128 ms: 1.58x faster 117 ms: 1.73x faster 139 ms: 1.45x faster 119 ms: 1.70x faster 118 ms: 1.72x faster 114 ms: 1.77x faster
pidigits 245 ms 250 ms: 1.02x slower 228 ms: 1.08x faster 240 ms: 1.02x faster 228 ms: 1.08x faster 236 ms: 1.04x faster 234 ms: 1.05x faster 233 ms: 1.05x faster 234 ms: 1.05x faster
Geometric mean (ref) 1.13x faster 1.41x faster 1.34x faster 1.43x faster 1.31x faster 1.40x faster 1.44x faster 1.45x faster

Benchmarks with tag 'regex':

Benchmark msvc.release.9db1a297d9 msvc.pgo.9db1a297d9 clang.pgo.18.1.8.9db1a297d9 clang.pgo.9db1a297d9 clang.pgo.cg.18.1.8.9db1a297d9 clang.pgo.cg.9db1a297d9 clang.pgo.tc.9db1a297d9 clang.pgo.tc.20.1.0.rc2.9db1a297d9 clang.pgo.tc.gc.20.1.0.rc2.9db1a297d9
regex_compile 237 ms 180 ms: 1.31x faster 148 ms: 1.60x faster 157 ms: 1.51x faster 145 ms: 1.63x faster 162 ms: 1.46x faster 141 ms: 1.68x faster 137 ms: 1.73x faster 140 ms: 1.69x faster
regex_dna 226 ms 210 ms: 1.07x faster 220 ms: 1.03x faster 211 ms: 1.07x faster 209 ms: 1.08x faster 207 ms: 1.09x faster 205 ms: 1.10x faster 207 ms: 1.09x faster 207 ms: 1.09x faster
regex_effbot 4.05 ms 3.66 ms: 1.11x faster 3.36 ms: 1.21x faster 3.39 ms: 1.20x faster 3.61 ms: 1.12x faster 3.52 ms: 1.15x faster 3.30 ms: 1.23x faster 3.20 ms: 1.27x faster 3.32 ms: 1.22x faster
regex_v8 38.7 ms 33.7 ms: 1.15x faster 29.2 ms: 1.32x faster 29.8 ms: 1.30x faster 28.2 ms: 1.37x faster 29.0 ms: 1.33x faster 28.7 ms: 1.35x faster 28.8 ms: 1.34x faster 28.2 ms: 1.37x faster
Geometric mean (ref) 1.16x faster 1.27x faster 1.26x faster 1.28x faster 1.25x faster 1.32x faster 1.34x faster 1.33x faster

Benchmarks with tag 'serialize':

Benchmark msvc.release.9db1a297d9 msvc.pgo.9db1a297d9 clang.pgo.18.1.8.9db1a297d9 clang.pgo.9db1a297d9 clang.pgo.cg.18.1.8.9db1a297d9 clang.pgo.cg.9db1a297d9 clang.pgo.tc.9db1a297d9 clang.pgo.tc.20.1.0.rc2.9db1a297d9 clang.pgo.tc.gc.20.1.0.rc2.9db1a297d9
json_dumps 19.6 ms 15.0 ms: 1.31x faster 12.4 ms: 1.58x faster 12.9 ms: 1.52x faster 13.3 ms: 1.48x faster 13.7 ms: 1.43x faster 12.2 ms: 1.60x faster 11.5 ms: 1.71x faster 11.6 ms: 1.69x faster
json_loads 48.1 us 36.8 us: 1.31x faster 32.2 us: 1.49x faster 32.7 us: 1.47x faster 31.9 us: 1.51x faster 32.7 us: 1.47x faster 31.9 us: 1.51x faster 30.5 us: 1.57x faster 29.9 us: 1.61x faster
pickle 21.5 us 19.1 us: 1.13x faster 15.1 us: 1.42x faster 15.0 us: 1.44x faster 15.6 us: 1.38x faster 14.3 us: 1.50x faster 14.3 us: 1.50x faster 14.3 us: 1.51x faster 14.5 us: 1.49x faster
pickle_dict 46.0 us 43.2 us: 1.07x faster 29.8 us: 1.54x faster 27.6 us: 1.67x faster 29.8 us: 1.55x faster 27.3 us: 1.69x faster 26.7 us: 1.72x faster 27.9 us: 1.65x faster 27.3 us: 1.68x faster
pickle_list 8.16 us 6.89 us: 1.18x faster 5.17 us: 1.58x faster 5.05 us: 1.62x faster 5.28 us: 1.55x faster 5.01 us: 1.63x faster 4.96 us: 1.65x faster 4.94 us: 1.65x faster 4.87 us: 1.68x faster
pickle_pure_python 672 us 463 us: 1.45x faster 359 us: 1.87x faster 378 us: 1.78x faster 373 us: 1.80x faster 412 us: 1.63x faster 361 us: 1.86x faster 350 us: 1.92x faster 359 us: 1.87x faster
tomli_loads 3.84 sec 2.88 sec: 1.33x faster 2.19 sec: 1.76x faster 2.38 sec: 1.61x faster 2.18 sec: 1.76x faster 2.53 sec: 1.52x faster 2.19 sec: 1.75x faster 2.13 sec: 1.81x faster 2.14 sec: 1.79x faster
unpickle 26.2 us 19.8 us: 1.32x faster 17.6 us: 1.49x faster 17.9 us: 1.46x faster 17.9 us: 1.46x faster 17.0 us: 1.54x faster 17.3 us: 1.51x faster 16.9 us: 1.55x faster 16.4 us: 1.60x faster
unpickle_list 7.29 us 6.87 us: 1.06x faster 5.17 us: 1.41x faster 5.38 us: 1.36x faster 5.39 us: 1.35x faster 5.12 us: 1.42x faster 5.19 us: 1.40x faster 5.08 us: 1.43x faster 5.13 us: 1.42x faster
unpickle_pure_python 505 us 336 us: 1.50x faster 247 us: 2.04x faster 257 us: 1.96x faster 252 us: 2.01x faster 279 us: 1.81x faster 236 us: 2.14x faster 235 us: 2.15x faster 236 us: 2.14x faster
xml_etree_parse 232 ms 200 ms: 1.16x faster 211 ms: 1.10x faster 210 ms: 1.10x faster 209 ms: 1.11x faster 219 ms: 1.06x faster 206 ms: 1.13x faster 202 ms: 1.15x faster 202 ms: 1.15x faster
xml_etree_iterparse 185 ms 154 ms: 1.21x faster 144 ms: 1.28x faster 145 ms: 1.27x faster 143 ms: 1.29x faster 150 ms: 1.23x faster 144 ms: 1.28x faster 140 ms: 1.32x faster 139 ms: 1.33x faster
xml_etree_generate 181 ms 135 ms: 1.35x faster 120 ms: 1.52x faster 119 ms: 1.53x faster 121 ms: 1.50x faster 121 ms: 1.50x faster 113 ms: 1.60x faster 109 ms: 1.67x faster 109 ms: 1.67x faster
xml_etree_process 128 ms 94.4 ms: 1.36x faster 81.3 ms: 1.58x faster 82.0 ms: 1.56x faster 82.2 ms: 1.56x faster 84.5 ms: 1.52x faster 76.8 ms: 1.67x faster 73.6 ms: 1.74x faster 74.7 ms: 1.72x faster
Geometric mean (ref) 1.26x faster 1.53x faster 1.51x faster 1.51x faster 1.49x faster 1.58x faster 1.61x faster 1.61x faster

Benchmarks with tag 'startup':

Benchmark msvc.release.9db1a297d9 msvc.pgo.9db1a297d9 clang.pgo.18.1.8.9db1a297d9 clang.pgo.9db1a297d9 clang.pgo.cg.18.1.8.9db1a297d9 clang.pgo.cg.9db1a297d9 clang.pgo.tc.9db1a297d9 clang.pgo.tc.20.1.0.rc2.9db1a297d9 clang.pgo.tc.gc.20.1.0.rc2.9db1a297d9
python_startup 45.4 ms 43.1 ms: 1.05x faster 44.2 ms: 1.03x faster 43.7 ms: 1.04x faster 43.9 ms: 1.03x faster 44.5 ms: 1.02x faster 43.0 ms: 1.05x faster 42.6 ms: 1.06x faster 42.4 ms: 1.07x faster
python_startup_no_site 37.1 ms 35.4 ms: 1.05x faster not significant 35.9 ms: 1.03x faster 36.4 ms: 1.02x faster not significant 35.9 ms: 1.03x faster 35.5 ms: 1.05x faster 35.1 ms: 1.06x faster
Geometric mean (ref) 1.05x faster 1.02x faster 1.04x faster 1.03x faster 1.01x faster 1.04x faster 1.06x faster 1.06x faster

Benchmarks with tag 'template':

Benchmark msvc.release.9db1a297d9 msvc.pgo.9db1a297d9 clang.pgo.18.1.8.9db1a297d9 clang.pgo.9db1a297d9 clang.pgo.cg.18.1.8.9db1a297d9 clang.pgo.cg.9db1a297d9 clang.pgo.tc.9db1a297d9 clang.pgo.tc.20.1.0.rc2.9db1a297d9 clang.pgo.tc.gc.20.1.0.rc2.9db1a297d9
django_template 75.6 ms 52.1 ms: 1.45x faster 44.5 ms: 1.70x faster 42.1 ms: 1.79x faster 42.6 ms: 1.78x faster 45.3 ms: 1.67x faster 40.3 ms: 1.88x faster 39.0 ms: 1.94x faster 39.3 ms: 1.92x faster
genshi_text 44.5 ms 32.5 ms: 1.37x faster 25.0 ms: 1.78x faster 26.3 ms: 1.69x faster 25.3 ms: 1.76x faster 28.3 ms: 1.57x faster 24.8 ms: 1.79x faster 24.2 ms: 1.84x faster 23.9 ms: 1.86x faster
genshi_xml 102 ms 74.6 ms: 1.36x faster 59.6 ms: 1.71x faster 63.1 ms: 1.61x faster 60.4 ms: 1.68x faster 68.3 ms: 1.49x faster 60.1 ms: 1.69x faster 57.2 ms: 1.78x faster 58.0 ms: 1.75x faster
mako 23.3 ms 16.7 ms: 1.39x faster 14.3 ms: 1.63x faster 14.4 ms: 1.61x faster 14.3 ms: 1.62x faster 15.5 ms: 1.50x faster 14.2 ms: 1.64x faster 13.2 ms: 1.76x faster 13.3 ms: 1.75x faster
Geometric mean (ref) 1.39x faster 1.70x faster 1.67x faster 1.71x faster 1.56x faster 1.75x faster 1.83x faster 1.82x faster

All benchmarks:

Benchmark msvc.release.9db1a297d9 msvc.pgo.9db1a297d9 clang.pgo.18.1.8.9db1a297d9 clang.pgo.9db1a297d9 clang.pgo.cg.18.1.8.9db1a297d9 clang.pgo.cg.9db1a297d9 clang.pgo.tc.9db1a297d9 clang.pgo.tc.20.1.0.rc2.9db1a297d9 clang.pgo.tc.gc.20.1.0.rc2.9db1a297d9
2to3 586 ms 462 ms: 1.27x faster 424 ms: 1.38x faster 426 ms: 1.38x faster 422 ms: 1.39x faster 444 ms: 1.32x faster 409 ms: 1.43x faster 398 ms: 1.47x faster 401 ms: 1.46x faster
async_generators 696 ms 577 ms: 1.21x faster 501 ms: 1.39x faster 514 ms: 1.35x faster 506 ms: 1.38x faster 524 ms: 1.33x faster 507 ms: 1.37x faster 469 ms: 1.49x faster 464 ms: 1.50x faster
async_tree_none 511 ms 394 ms: 1.30x faster 347 ms: 1.47x faster 357 ms: 1.43x faster 347 ms: 1.47x faster 383 ms: 1.33x faster 351 ms: 1.45x faster 330 ms: 1.55x faster 326 ms: 1.57x faster
async_tree_cpu_io_mixed 933 ms 749 ms: 1.25x faster 682 ms: 1.37x faster 697 ms: 1.34x faster 677 ms: 1.38x faster 722 ms: 1.29x faster 676 ms: 1.38x faster 652 ms: 1.43x faster 636 ms: 1.47x faster
async_tree_cpu_io_mixed_tg 891 ms 716 ms: 1.24x faster 640 ms: 1.39x faster 665 ms: 1.34x faster 657 ms: 1.36x faster 692 ms: 1.29x faster 653 ms: 1.36x faster 630 ms: 1.41x faster 617 ms: 1.44x faster
async_tree_eager 209 ms 160 ms: 1.31x faster 128 ms: 1.64x faster 133 ms: 1.57x faster 130 ms: 1.62x faster 153 ms: 1.37x faster 127 ms: 1.65x faster 121 ms: 1.73x faster 122 ms: 1.71x faster
async_tree_eager_cpu_io_mixed 656 ms 567 ms: 1.16x faster 513 ms: 1.28x faster 535 ms: 1.23x faster 516 ms: 1.27x faster 566 ms: 1.16x faster 509 ms: 1.29x faster 492 ms: 1.33x faster 495 ms: 1.33x faster
async_tree_eager_cpu_io_mixed_tg 830 ms 681 ms: 1.22x faster 620 ms: 1.34x faster 646 ms: 1.28x faster 627 ms: 1.32x faster 675 ms: 1.23x faster 621 ms: 1.34x faster 596 ms: 1.39x faster 592 ms: 1.40x faster
async_tree_eager_io 1.12 sec 874 ms: 1.28x faster 783 ms: 1.43x faster 817 ms: 1.37x faster 810 ms: 1.39x faster 887 ms: 1.27x faster 790 ms: 1.42x faster 743 ms: 1.51x faster 740 ms: 1.52x faster
async_tree_eager_io_tg 1.12 sec 898 ms: 1.25x faster 812 ms: 1.38x faster 840 ms: 1.33x faster 837 ms: 1.34x faster 888 ms: 1.26x faster 807 ms: 1.39x faster 782 ms: 1.43x faster 765 ms: 1.46x faster
async_tree_eager_memoization 393 ms 304 ms: 1.29x faster 264 ms: 1.49x faster 281 ms: 1.40x faster 268 ms: 1.46x faster 312 ms: 1.26x faster 259 ms: 1.51x faster 246 ms: 1.59x faster 246 ms: 1.60x faster
async_tree_eager_memoization_tg 546 ms 427 ms: 1.28x faster 384 ms: 1.42x faster 397 ms: 1.37x faster 387 ms: 1.41x faster 431 ms: 1.27x faster 384 ms: 1.42x faster 363 ms: 1.51x faster 359 ms: 1.52x faster
async_tree_eager_tg 408 ms 321 ms: 1.27x faster 285 ms: 1.44x faster 297 ms: 1.38x faster 285 ms: 1.43x faster 321 ms: 1.27x faster 286 ms: 1.43x faster 275 ms: 1.48x faster 270 ms: 1.51x faster
async_tree_io 1.14 sec 889 ms: 1.28x faster 805 ms: 1.41x faster 824 ms: 1.38x faster 815 ms: 1.39x faster 870 ms: 1.30x faster 801 ms: 1.42x faster 766 ms: 1.48x faster 756 ms: 1.50x faster
async_tree_io_tg 1.14 sec 877 ms: 1.30x faster 794 ms: 1.43x faster 807 ms: 1.41x faster 803 ms: 1.42x faster 872 ms: 1.30x faster 790 ms: 1.44x faster 752 ms: 1.51x faster 740 ms: 1.54x faster
async_tree_memoization 649 ms 509 ms: 1.28x faster 449 ms: 1.45x faster 458 ms: 1.42x faster 455 ms: 1.42x faster 496 ms: 1.31x faster 451 ms: 1.44x faster 423 ms: 1.54x faster 425 ms: 1.53x faster
async_tree_memoization_tg 605 ms 462 ms: 1.31x faster 417 ms: 1.45x faster 425 ms: 1.42x faster 416 ms: 1.45x faster 459 ms: 1.32x faster 419 ms: 1.44x faster 396 ms: 1.53x faster 389 ms: 1.55x faster
async_tree_none_tg 497 ms 382 ms: 1.30x faster 341 ms: 1.45x faster 352 ms: 1.41x faster 343 ms: 1.45x faster 378 ms: 1.31x faster 342 ms: 1.45x faster 329 ms: 1.51x faster 324 ms: 1.53x faster
asyncio_tcp 1.64 sec 1.48 sec: 1.11x faster 1.53 sec: 1.07x faster not significant not significant not significant 1.56 sec: 1.05x faster 1.40 sec: 1.17x faster 1.41 sec: 1.16x faster
asyncio_tcp_ssl 4.31 sec not significant not significant not significant not significant not significant not significant 3.91 sec: 1.10x faster 3.82 sec: 1.13x faster
asyncio_websockets 732 ms 758 ms: 1.04x slower 718 ms: 1.02x faster not significant not significant not significant 705 ms: 1.04x faster not significant 720 ms: 1.02x faster
chaos 132 ms 90.8 ms: 1.45x faster 66.8 ms: 1.97x faster 74.3 ms: 1.77x faster 69.3 ms: 1.90x faster 76.2 ms: 1.72x faster 68.4 ms: 1.92x faster 65.4 ms: 2.01x faster 66.5 ms: 1.98x faster
comprehensions 34.7 us 25.2 us: 1.38x faster 18.2 us: 1.90x faster 19.2 us: 1.80x faster 18.1 us: 1.92x faster 19.9 us: 1.74x faster 18.0 us: 1.93x faster 17.6 us: 1.97x faster 17.7 us: 1.96x faster
bench_mp_pool 213 ms 177 ms: 1.20x faster 186 ms: 1.15x faster 190 ms: 1.12x faster 182 ms: 1.17x faster 186 ms: 1.14x faster 174 ms: 1.23x faster 171 ms: 1.25x faster 172 ms: 1.24x faster
bench_thread_pool 1.95 ms 1.68 ms: 1.16x faster 1.65 ms: 1.19x faster 1.63 ms: 1.19x faster 1.66 ms: 1.18x faster 1.68 ms: 1.16x faster 1.61 ms: 1.22x faster 1.57 ms: 1.25x faster 1.58 ms: 1.23x faster
coroutines 45.3 ms 36.1 ms: 1.25x faster 25.3 ms: 1.79x faster 26.9 ms: 1.68x faster 26.4 ms: 1.71x faster 29.0 ms: 1.56x faster 24.9 ms: 1.82x faster 24.9 ms: 1.82x faster 24.6 ms: 1.84x faster
coverage 130 ms 120 ms: 1.09x faster 102 ms: 1.28x faster 103 ms: 1.26x faster 97.6 ms: 1.33x faster 126 ms: 1.03x faster 96.5 ms: 1.35x faster 93.3 ms: 1.40x faster 95.8 ms: 1.36x faster
crypto_pyaes 147 ms 109 ms: 1.35x faster 82.5 ms: 1.78x faster 86.3 ms: 1.70x faster 81.3 ms: 1.81x faster 90.0 ms: 1.63x faster 82.2 ms: 1.79x faster 78.0 ms: 1.88x faster 78.3 ms: 1.88x faster
deepcopy 516 us 388 us: 1.33x faster 306 us: 1.69x faster 309 us: 1.67x faster 292 us: 1.77x faster 329 us: 1.57x faster 295 us: 1.75x faster 289 us: 1.79x faster 290 us: 1.78x faster
deepcopy_reduce 5.30 us 3.95 us: 1.34x faster 3.34 us: 1.58x faster 3.23 us: 1.64x faster 3.16 us: 1.68x faster 3.40 us: 1.56x faster 3.10 us: 1.71x faster 3.08 us: 1.72x faster 2.96 us: 1.79x faster
deepcopy_memo 67.1 us 46.8 us: 1.44x faster 34.1 us: 1.97x faster 34.8 us: 1.93x faster 32.0 us: 2.10x faster 37.2 us: 1.80x faster 33.3 us: 2.02x faster 33.2 us: 2.02x faster 32.7 us: 2.05x faster
deltablue 7.72 ms 4.92 ms: 1.57x faster 3.41 ms: 2.26x faster 3.80 ms: 2.03x faster 3.42 ms: 2.26x faster 4.15 ms: 1.86x faster 3.41 ms: 2.26x faster 3.40 ms: 2.27x faster 3.34 ms: 2.31x faster
django_template 75.6 ms 52.1 ms: 1.45x faster 44.5 ms: 1.70x faster 42.1 ms: 1.79x faster 42.6 ms: 1.78x faster 45.3 ms: 1.67x faster 40.3 ms: 1.88x faster 39.0 ms: 1.94x faster 39.3 ms: 1.92x faster
docutils 4.27 sec 3.50 sec: 1.22x faster 3.22 sec: 1.33x faster 3.31 sec: 1.29x faster 3.22 sec: 1.32x faster 3.44 sec: 1.24x faster 3.16 sec: 1.35x faster 3.12 sec: 1.37x faster 3.12 sec: 1.37x faster
dulwich_log 156 ms 129 ms: 1.20x faster 126 ms: 1.23x faster 131 ms: 1.19x faster 127 ms: 1.23x faster 132 ms: 1.18x faster 124 ms: 1.25x faster 123 ms: 1.27x faster 122 ms: 1.27x faster
fannkuch 770 ms 637 ms: 1.21x faster 482 ms: 1.60x faster 516 ms: 1.49x faster 481 ms: 1.60x faster 527 ms: 1.46x faster 472 ms: 1.63x faster 456 ms: 1.69x faster 453 ms: 1.70x faster
float 145 ms 116 ms: 1.25x faster 95.7 ms: 1.52x faster 96.8 ms: 1.50x faster 93.2 ms: 1.56x faster 98.5 ms: 1.47x faster 93.3 ms: 1.56x faster 87.6 ms: 1.66x faster 87.6 ms: 1.66x faster
create_gc_cycles 1.62 ms not significant not significant 1.71 ms: 1.05x slower not significant not significant not significant not significant 1.57 ms: 1.03x faster
gc_traversal 5.03 ms 4.02 ms: 1.25x faster 5.43 ms: 1.08x slower 5.71 ms: 1.13x slower 5.37 ms: 1.07x slower 5.44 ms: 1.08x slower 5.29 ms: 1.05x slower 5.28 ms: 1.05x slower not significant
generators 65.1 ms 44.4 ms: 1.47x faster 34.2 ms: 1.90x faster 36.0 ms: 1.81x faster 36.0 ms: 1.81x faster 41.7 ms: 1.56x faster 33.3 ms: 1.95x faster 33.0 ms: 1.97x faster 32.8 ms: 1.98x faster
genshi_text 44.5 ms 32.5 ms: 1.37x faster 25.0 ms: 1.78x faster 26.3 ms: 1.69x faster 25.3 ms: 1.76x faster 28.3 ms: 1.57x faster 24.8 ms: 1.79x faster 24.2 ms: 1.84x faster 23.9 ms: 1.86x faster
genshi_xml 102 ms 74.6 ms: 1.36x faster 59.6 ms: 1.71x faster 63.1 ms: 1.61x faster 60.4 ms: 1.68x faster 68.3 ms: 1.49x faster 60.1 ms: 1.69x faster 57.2 ms: 1.78x faster 58.0 ms: 1.75x faster
go 255 ms 170 ms: 1.50x faster 125 ms: 2.05x faster 132 ms: 1.94x faster 123 ms: 2.08x faster 144 ms: 1.77x faster 122 ms: 2.09x faster 122 ms: 2.10x faster 120 ms: 2.13x faster
hexiom 13.4 ms 9.22 ms: 1.46x faster 6.57 ms: 2.05x faster 7.11 ms: 1.89x faster 6.59 ms: 2.04x faster 7.68 ms: 1.75x faster 6.53 ms: 2.06x faster 6.61 ms: 2.03x faster 6.50 ms: 2.07x faster
html5lib 104 ms 77.9 ms: 1.34x faster 69.2 ms: 1.51x faster 74.5 ms: 1.40x faster 72.1 ms: 1.44x faster 76.9 ms: 1.35x faster 67.8 ms: 1.54x faster 68.6 ms: 1.52x faster 69.2 ms: 1.50x faster
json_dumps 19.6 ms 15.0 ms: 1.31x faster 12.4 ms: 1.58x faster 12.9 ms: 1.52x faster 13.3 ms: 1.48x faster 13.7 ms: 1.43x faster 12.2 ms: 1.60x faster 11.5 ms: 1.71x faster 11.6 ms: 1.69x faster
json_loads 48.1 us 36.8 us: 1.31x faster 32.2 us: 1.49x faster 32.7 us: 1.47x faster 31.9 us: 1.51x faster 32.7 us: 1.47x faster 31.9 us: 1.51x faster 30.5 us: 1.57x faster 29.9 us: 1.61x faster
logging_format 21.2 us 14.7 us: 1.44x faster 13.3 us: 1.59x faster 13.6 us: 1.56x faster 13.1 us: 1.61x faster 14.3 us: 1.48x faster 12.0 us: 1.76x faster 11.6 us: 1.83x faster 11.5 us: 1.83x faster
logging_silent 213 ns 152 ns: 1.40x faster 103 ns: 2.06x faster 109 ns: 1.95x faster 101 ns: 2.10x faster 118 ns: 1.80x faster 106 ns: 2.00x faster 101 ns: 2.11x faster 101 ns: 2.11x faster
logging_simple 19.4 us 13.5 us: 1.44x faster 11.8 us: 1.65x faster 12.2 us: 1.60x faster 11.5 us: 1.69x faster 12.8 us: 1.52x faster 10.9 us: 1.78x faster 10.4 us: 1.86x faster 10.6 us: 1.84x faster
mako 23.3 ms 16.7 ms: 1.39x faster 14.3 ms: 1.63x faster 14.4 ms: 1.61x faster 14.3 ms: 1.62x faster 15.5 ms: 1.50x faster 14.2 ms: 1.64x faster 13.2 ms: 1.76x faster 13.3 ms: 1.75x faster
mdp 3.99 sec 3.76 sec: 1.06x faster 3.28 sec: 1.22x faster 3.37 sec: 1.18x faster 3.28 sec: 1.22x faster 3.40 sec: 1.18x faster 3.26 sec: 1.23x faster 2.91 sec: 1.37x faster 2.94 sec: 1.36x faster
meteor_contest 175 ms 139 ms: 1.26x faster 113 ms: 1.55x faster 124 ms: 1.41x faster 115 ms: 1.52x faster 126 ms: 1.39x faster 120 ms: 1.46x faster 117 ms: 1.50x faster 118 ms: 1.48x faster
nbody 203 ms 171 ms: 1.19x faster 119 ms: 1.71x faster 128 ms: 1.58x faster 117 ms: 1.73x faster 139 ms: 1.45x faster 119 ms: 1.70x faster 118 ms: 1.72x faster 114 ms: 1.77x faster
nqueens 179 ms 131 ms: 1.37x faster 98.6 ms: 1.81x faster 103 ms: 1.73x faster 98.2 ms: 1.82x faster 107 ms: 1.68x faster 98.3 ms: 1.82x faster 92.0 ms: 1.94x faster 91.7 ms: 1.95x faster
pathlib 278 ms 256 ms: 1.09x faster 252 ms: 1.11x faster 262 ms: 1.06x faster 253 ms: 1.10x faster 255 ms: 1.09x faster 245 ms: 1.14x faster 250 ms: 1.11x faster 247 ms: 1.13x faster
pickle 21.5 us 19.1 us: 1.13x faster 15.1 us: 1.42x faster 15.0 us: 1.44x faster 15.6 us: 1.38x faster 14.3 us: 1.50x faster 14.3 us: 1.50x faster 14.3 us: 1.51x faster 14.5 us: 1.49x faster
pickle_dict 46.0 us 43.2 us: 1.07x faster 29.8 us: 1.54x faster 27.6 us: 1.67x faster 29.8 us: 1.55x faster 27.3 us: 1.69x faster 26.7 us: 1.72x faster 27.9 us: 1.65x faster 27.3 us: 1.68x faster
pickle_list 8.16 us 6.89 us: 1.18x faster 5.17 us: 1.58x faster 5.05 us: 1.62x faster 5.28 us: 1.55x faster 5.01 us: 1.63x faster 4.96 us: 1.65x faster 4.94 us: 1.65x faster 4.87 us: 1.68x faster
pickle_pure_python 672 us 463 us: 1.45x faster 359 us: 1.87x faster 378 us: 1.78x faster 373 us: 1.80x faster 412 us: 1.63x faster 361 us: 1.86x faster 350 us: 1.92x faster 359 us: 1.87x faster
pidigits 245 ms 250 ms: 1.02x slower 228 ms: 1.08x faster 240 ms: 1.02x faster 228 ms: 1.08x faster 236 ms: 1.04x faster 234 ms: 1.05x faster 233 ms: 1.05x faster 234 ms: 1.05x faster
pprint_safe_repr 1.46 sec 1.09 sec: 1.34x faster 892 ms: 1.64x faster 934 ms: 1.57x faster 877 ms: 1.67x faster 986 ms: 1.48x faster 893 ms: 1.64x faster 812 ms: 1.80x faster 845 ms: 1.73x faster
pprint_pformat 3.00 sec 2.23 sec: 1.35x faster 1.81 sec: 1.66x faster 1.91 sec: 1.57x faster 1.79 sec: 1.67x faster 2.02 sec: 1.49x faster 1.81 sec: 1.65x faster 1.66 sec: 1.80x faster 1.73 sec: 1.74x faster
pyflate 875 ms 668 ms: 1.31x faster 531 ms: 1.65x faster 537 ms: 1.63x faster 519 ms: 1.69x faster 574 ms: 1.52x faster 522 ms: 1.68x faster 506 ms: 1.73x faster 507 ms: 1.73x faster
python_startup 45.4 ms 43.1 ms: 1.05x faster 44.2 ms: 1.03x faster 43.7 ms: 1.04x faster 43.9 ms: 1.03x faster 44.5 ms: 1.02x faster 43.0 ms: 1.05x faster 42.6 ms: 1.06x faster 42.4 ms: 1.07x faster
python_startup_no_site 37.1 ms 35.4 ms: 1.05x faster not significant 35.9 ms: 1.03x faster 36.4 ms: 1.02x faster not significant 35.9 ms: 1.03x faster 35.5 ms: 1.05x faster 35.1 ms: 1.06x faster
raytrace 587 ms 414 ms: 1.42x faster 303 ms: 1.94x faster 321 ms: 1.83x faster 307 ms: 1.91x faster 330 ms: 1.78x faster 307 ms: 1.91x faster 294 ms: 2.00x faster 292 ms: 2.01x faster
regex_compile 237 ms 180 ms: 1.31x faster 148 ms: 1.60x faster 157 ms: 1.51x faster 145 ms: 1.63x faster 162 ms: 1.46x faster 141 ms: 1.68x faster 137 ms: 1.73x faster 140 ms: 1.69x faster
regex_dna 226 ms 210 ms: 1.07x faster 220 ms: 1.03x faster 211 ms: 1.07x faster 209 ms: 1.08x faster 207 ms: 1.09x faster 205 ms: 1.10x faster 207 ms: 1.09x faster 207 ms: 1.09x faster
regex_effbot 4.05 ms 3.66 ms: 1.11x faster 3.36 ms: 1.21x faster 3.39 ms: 1.20x faster 3.61 ms: 1.12x faster 3.52 ms: 1.15x faster 3.30 ms: 1.23x faster 3.20 ms: 1.27x faster 3.32 ms: 1.22x faster
regex_v8 38.7 ms 33.7 ms: 1.15x faster 29.2 ms: 1.32x faster 29.8 ms: 1.30x faster 28.2 ms: 1.37x faster 29.0 ms: 1.33x faster 28.7 ms: 1.35x faster 28.8 ms: 1.34x faster 28.2 ms: 1.37x faster
richards 102 ms 64.7 ms: 1.58x faster 46.9 ms: 2.18x faster 49.7 ms: 2.05x faster 47.5 ms: 2.15x faster 56.8 ms: 1.80x faster 45.2 ms: 2.26x faster 45.9 ms: 2.22x faster 44.3 ms: 2.30x faster
richards_super 116 ms 74.7 ms: 1.56x faster 54.6 ms: 2.13x faster 56.2 ms: 2.07x faster 54.9 ms: 2.12x faster 62.3 ms: 1.87x faster 53.0 ms: 2.20x faster 52.2 ms: 2.23x faster 51.8 ms: 2.25x faster
scimark_fft 664 ms 493 ms: 1.35x faster 347 ms: 1.91x faster 358 ms: 1.85x faster 330 ms: 2.01x faster 383 ms: 1.73x faster 337 ms: 1.97x faster 315 ms: 2.10x faster 320 ms: 2.08x faster
scimark_lu 227 ms 164 ms: 1.39x faster 128 ms: 1.78x faster 132 ms: 1.72x faster 125 ms: 1.82x faster 134 ms: 1.69x faster 121 ms: 1.88x faster 119 ms: 1.91x faster 115 ms: 1.97x faster
scimark_monte_carlo 138 ms 101 ms: 1.37x faster 71.9 ms: 1.92x faster 74.6 ms: 1.85x faster 69.4 ms: 1.99x faster 81.7 ms: 1.69x faster 69.6 ms: 1.99x faster 69.6 ms: 1.99x faster 67.0 ms: 2.06x faster
scimark_sor 256 ms 195 ms: 1.31x faster 129 ms: 1.99x faster 151 ms: 1.69x faster 129 ms: 1.99x faster 154 ms: 1.67x faster 129 ms: 1.99x faster 126 ms: 2.04x faster 123 ms: 2.08x faster
scimark_sparse_mat_mult 8.76 ms 6.06 ms: 1.45x faster 4.85 ms: 1.81x faster 5.01 ms: 1.75x faster 4.63 ms: 1.89x faster 5.02 ms: 1.75x faster 4.94 ms: 1.78x faster 4.64 ms: 1.89x faster 4.62 ms: 1.90x faster
spectral_norm 179 ms 151 ms: 1.19x faster 101 ms: 1.77x faster 110 ms: 1.63x faster 103 ms: 1.74x faster 114 ms: 1.57x faster 101 ms: 1.78x faster 99.4 ms: 1.80x faster 97.2 ms: 1.84x faster
sqlglot_normalize 204 ms 151 ms: 1.35x faster 132 ms: 1.54x faster 131 ms: 1.55x faster 128 ms: 1.59x faster 135 ms: 1.51x faster 126 ms: 1.62x faster 119 ms: 1.70x faster 121 ms: 1.69x faster
sqlglot_optimize 97.0 ms 74.5 ms: 1.30x faster 65.8 ms: 1.47x faster 66.2 ms: 1.47x faster 64.5 ms: 1.50x faster 68.5 ms: 1.42x faster 63.4 ms: 1.53x faster 60.0 ms: 1.62x faster 62.0 ms: 1.56x faster
sqlglot_parse 2.52 ms 1.81 ms: 1.39x faster 1.43 ms: 1.76x faster 1.51 ms: 1.66x faster 1.41 ms: 1.79x faster 1.60 ms: 1.57x faster 1.38 ms: 1.83x faster 1.35 ms: 1.86x faster 1.38 ms: 1.83x faster
sqlglot_transpile 3.02 ms 2.21 ms: 1.37x faster 1.77 ms: 1.71x faster 1.85 ms: 1.63x faster 1.75 ms: 1.73x faster 1.95 ms: 1.55x faster 1.71 ms: 1.77x faster 1.70 ms: 1.78x faster 1.70 ms: 1.78x faster
sqlite_synth 4.08 us 3.75 us: 1.09x faster 3.76 us: 1.08x faster 3.44 us: 1.18x faster 3.55 us: 1.15x faster 3.39 us: 1.20x faster 3.31 us: 1.23x faster 3.26 us: 1.25x faster 3.45 us: 1.18x faster
sympy_expand 818 ms 640 ms: 1.28x faster 559 ms: 1.46x faster 578 ms: 1.42x faster 568 ms: 1.44x faster 598 ms: 1.37x faster 542 ms: 1.51x faster 518 ms: 1.58x faster 522 ms: 1.57x faster
sympy_integrate 33.5 ms 27.1 ms: 1.24x faster 23.9 ms: 1.40x faster 24.2 ms: 1.38x faster 24.1 ms: 1.39x faster 25.9 ms: 1.29x faster 23.2 ms: 1.45x faster 22.4 ms: 1.50x faster 22.7 ms: 1.48x faster
sympy_sum 258 ms 213 ms: 1.21x faster 190 ms: 1.36x faster 199 ms: 1.29x faster 192 ms: 1.34x faster 205 ms: 1.26x faster 184 ms: 1.40x faster 181 ms: 1.42x faster 182 ms: 1.41x faster
sympy_str 484 ms 383 ms: 1.26x faster 334 ms: 1.45x faster 344 ms: 1.41x faster 336 ms: 1.44x faster 356 ms: 1.36x faster 323 ms: 1.50x faster 315 ms: 1.54x faster 314 ms: 1.54x faster
telco 13.1 ms 10.7 ms: 1.22x faster 9.17 ms: 1.43x faster 9.37 ms: 1.40x faster 9.50 ms: 1.38x faster 9.43 ms: 1.39x faster 9.20 ms: 1.42x faster 8.70 ms: 1.51x faster 8.52 ms: 1.54x faster
tomli_loads 3.84 sec 2.88 sec: 1.33x faster 2.19 sec: 1.76x faster 2.38 sec: 1.61x faster 2.18 sec: 1.76x faster 2.53 sec: 1.52x faster 2.19 sec: 1.75x faster 2.13 sec: 1.81x faster 2.14 sec: 1.79x faster
typing_runtime_protocols 296 us 223 us: 1.32x faster 188 us: 1.57x faster 193 us: 1.53x faster 193 us: 1.53x faster 201 us: 1.47x faster 186 us: 1.59x faster 175 us: 1.69x faster 173 us: 1.71x faster
unpack_sequence 152 ns 84.8 ns: 1.79x faster 56.8 ns: 2.68x faster 59.3 ns: 2.56x faster 56.3 ns: 2.70x faster 64.5 ns: 2.35x faster 56.6 ns: 2.68x faster 57.2 ns: 2.66x faster 57.2 ns: 2.66x faster
unpickle 26.2 us 19.8 us: 1.32x faster 17.6 us: 1.49x faster 17.9 us: 1.46x faster 17.9 us: 1.46x faster 17.0 us: 1.54x faster 17.3 us: 1.51x faster 16.9 us: 1.55x faster 16.4 us: 1.60x faster
unpickle_list 7.29 us 6.87 us: 1.06x faster 5.17 us: 1.41x faster 5.38 us: 1.36x faster 5.39 us: 1.35x faster 5.12 us: 1.42x faster 5.19 us: 1.40x faster 5.08 us: 1.43x faster 5.13 us: 1.42x faster
unpickle_pure_python 505 us 336 us: 1.50x faster 247 us: 2.04x faster 257 us: 1.96x faster 252 us: 2.01x faster 279 us: 1.81x faster 236 us: 2.14x faster 235 us: 2.15x faster 236 us: 2.14x faster
xml_etree_parse 232 ms 200 ms: 1.16x faster 211 ms: 1.10x faster 210 ms: 1.10x faster 209 ms: 1.11x faster 219 ms: 1.06x faster 206 ms: 1.13x faster 202 ms: 1.15x faster 202 ms: 1.15x faster
xml_etree_iterparse 185 ms 154 ms: 1.21x faster 144 ms: 1.28x faster 145 ms: 1.27x faster 143 ms: 1.29x faster 150 ms: 1.23x faster 144 ms: 1.28x faster 140 ms: 1.32x faster 139 ms: 1.33x faster
xml_etree_generate 181 ms 135 ms: 1.35x faster 120 ms: 1.52x faster 119 ms: 1.53x faster 121 ms: 1.50x faster 121 ms: 1.50x faster 113 ms: 1.60x faster 109 ms: 1.67x faster 109 ms: 1.67x faster
xml_etree_process 128 ms 94.4 ms: 1.36x faster 81.3 ms: 1.58x faster 82.0 ms: 1.56x faster 82.2 ms: 1.56x faster 84.5 ms: 1.52x faster 76.8 ms: 1.67x faster 73.6 ms: 1.74x faster 74.7 ms: 1.72x faster
Geometric mean (ref) 1.28x faster 1.51x faster 1.47x faster 1.51x faster 1.41x faster 1.54x faster 1.59x faster 1.60x faster
Raw
bench_release.rst

Benchmarks with tag 'apps':

Benchmark msvc.release.9db1a297d9 clang.release.18.1.8.9db1a297d9 clang.release.9db1a297d9 clang.release.cg.18.1.8.9db1a297d9 clang.release.cg.9db1a297d9 clang.release.tc.gc.20.1.0.rc2.9db1a297d9
2to3 586 ms 473 ms: 1.24x faster 491 ms: 1.19x faster 459 ms: 1.28x faster 509 ms: 1.15x faster 434 ms: 1.35x faster
docutils 4.27 sec 3.63 sec: 1.18x faster 3.75 sec: 1.14x faster 3.59 sec: 1.19x faster 3.71 sec: 1.15x faster 3.44 sec: 1.24x faster
html5lib 104 ms 76.4 ms: 1.36x faster 81.6 ms: 1.28x faster 75.3 ms: 1.38x faster 80.0 ms: 1.30x faster 70.4 ms: 1.48x faster
Geometric mean (ref) 1.26x faster 1.20x faster 1.28x faster 1.20x faster 1.35x faster

Benchmarks with tag 'asyncio':

Benchmark msvc.release.9db1a297d9 clang.release.18.1.8.9db1a297d9 clang.release.9db1a297d9 clang.release.cg.18.1.8.9db1a297d9 clang.release.cg.9db1a297d9 clang.release.tc.gc.20.1.0.rc2.9db1a297d9
async_tree_none 511 ms 375 ms: 1.36x faster 383 ms: 1.33x faster 369 ms: 1.39x faster 391 ms: 1.31x faster 355 ms: 1.44x faster
async_tree_cpu_io_mixed 933 ms 785 ms: 1.19x faster 805 ms: 1.16x faster 775 ms: 1.20x faster 800 ms: 1.17x faster 754 ms: 1.24x faster
async_tree_cpu_io_mixed_tg 891 ms 758 ms: 1.17x faster 776 ms: 1.15x faster 752 ms: 1.18x faster 771 ms: 1.15x faster 726 ms: 1.23x faster
async_tree_eager 209 ms 153 ms: 1.37x faster 153 ms: 1.37x faster 147 ms: 1.42x faster 155 ms: 1.35x faster 138 ms: 1.52x faster
async_tree_eager_cpu_io_mixed 656 ms 605 ms: 1.08x faster 630 ms: 1.04x faster 596 ms: 1.10x faster 614 ms: 1.07x faster 588 ms: 1.12x faster
async_tree_eager_cpu_io_mixed_tg 830 ms 727 ms: 1.14x faster 741 ms: 1.12x faster 723 ms: 1.15x faster 743 ms: 1.12x faster 687 ms: 1.21x faster
async_tree_eager_io 1.12 sec 863 ms: 1.30x faster 870 ms: 1.29x faster 843 ms: 1.33x faster 887 ms: 1.26x faster 796 ms: 1.41x faster
async_tree_eager_io_tg 1.12 sec 890 ms: 1.26x faster 890 ms: 1.26x faster 865 ms: 1.29x faster 916 ms: 1.22x faster 822 ms: 1.36x faster
async_tree_eager_memoization 393 ms 297 ms: 1.32x faster 304 ms: 1.29x faster 293 ms: 1.34x faster 311 ms: 1.26x faster 274 ms: 1.43x faster
async_tree_eager_memoization_tg 546 ms 426 ms: 1.28x faster 420 ms: 1.30x faster 419 ms: 1.30x faster 437 ms: 1.25x faster 390 ms: 1.40x faster
async_tree_eager_tg 408 ms 318 ms: 1.29x faster 312 ms: 1.31x faster 317 ms: 1.29x faster 319 ms: 1.28x faster 286 ms: 1.43x faster
async_tree_io 1.14 sec 863 ms: 1.32x faster 868 ms: 1.31x faster 848 ms: 1.34x faster 881 ms: 1.29x faster 819 ms: 1.39x faster
async_tree_io_tg 1.14 sec 871 ms: 1.31x faster 871 ms: 1.31x faster 847 ms: 1.34x faster 883 ms: 1.29x faster 810 ms: 1.40x faster
async_tree_memoization 649 ms 491 ms: 1.32x faster 493 ms: 1.32x faster 480 ms: 1.35x faster 508 ms: 1.28x faster 462 ms: 1.40x faster
async_tree_memoization_tg 605 ms 459 ms: 1.32x faster 453 ms: 1.34x faster 448 ms: 1.35x faster 468 ms: 1.29x faster 428 ms: 1.41x faster
async_tree_none_tg 497 ms 372 ms: 1.33x faster 371 ms: 1.34x faster 367 ms: 1.35x faster 379 ms: 1.31x faster 349 ms: 1.42x faster
Geometric mean (ref) 1.27x faster 1.26x faster 1.29x faster 1.24x faster 1.36x faster

Benchmarks with tag 'math':

Benchmark msvc.release.9db1a297d9 clang.release.18.1.8.9db1a297d9 clang.release.9db1a297d9 clang.release.cg.18.1.8.9db1a297d9 clang.release.cg.9db1a297d9 clang.release.tc.gc.20.1.0.rc2.9db1a297d9
float 145 ms 103 ms: 1.41x faster 108 ms: 1.35x faster 103 ms: 1.41x faster 104 ms: 1.39x faster 97.8 ms: 1.48x faster
nbody 203 ms 128 ms: 1.59x faster 155 ms: 1.31x faster 129 ms: 1.58x faster 151 ms: 1.34x faster 127 ms: 1.60x faster
pidigits 245 ms not significant 250 ms: 1.02x slower not significant 250 ms: 1.02x slower not significant
Geometric mean (ref) 1.31x faster 1.20x faster 1.31x faster 1.23x faster 1.34x faster

Benchmarks with tag 'regex':

Benchmark msvc.release.9db1a297d9 clang.release.18.1.8.9db1a297d9 clang.release.9db1a297d9 clang.release.cg.18.1.8.9db1a297d9 clang.release.cg.9db1a297d9 clang.release.tc.gc.20.1.0.rc2.9db1a297d9
regex_compile 237 ms 165 ms: 1.44x faster 180 ms: 1.31x faster 165 ms: 1.44x faster 175 ms: 1.36x faster 155 ms: 1.53x faster
regex_dna 226 ms 245 ms: 1.09x slower 256 ms: 1.14x slower 232 ms: 1.03x slower 241 ms: 1.07x slower 238 ms: 1.05x slower
regex_effbot 4.05 ms 3.92 ms: 1.04x faster not significant 3.97 ms: 1.02x faster 3.96 ms: 1.02x faster 3.87 ms: 1.05x faster
regex_v8 38.7 ms 34.3 ms: 1.13x faster 35.7 ms: 1.08x faster 32.6 ms: 1.19x faster 33.3 ms: 1.16x faster 32.0 ms: 1.21x faster
Geometric mean (ref) 1.12x faster 1.06x faster 1.14x faster 1.11x faster 1.16x faster

Benchmarks with tag 'serialize':

Benchmark msvc.release.9db1a297d9 clang.release.18.1.8.9db1a297d9 clang.release.9db1a297d9 clang.release.cg.18.1.8.9db1a297d9 clang.release.cg.9db1a297d9 clang.release.tc.gc.20.1.0.rc2.9db1a297d9
json_dumps 19.6 ms 16.6 ms: 1.18x faster 16.9 ms: 1.16x faster 16.6 ms: 1.18x faster 16.8 ms: 1.17x faster 15.3 ms: 1.28x faster
json_loads 48.1 us not significant 46.7 us: 1.03x faster not significant 46.8 us: 1.03x faster 43.9 us: 1.10x faster
pickle 21.5 us 18.8 us: 1.15x faster 17.9 us: 1.20x faster 18.7 us: 1.15x faster 17.6 us: 1.22x faster 17.2 us: 1.25x faster
pickle_dict 46.0 us 35.7 us: 1.29x faster 34.3 us: 1.34x faster 36.6 us: 1.26x faster 33.7 us: 1.37x faster 33.0 us: 1.39x faster
pickle_list 8.16 us 6.39 us: 1.28x faster 6.19 us: 1.32x faster 6.40 us: 1.27x faster 5.91 us: 1.38x faster 5.73 us: 1.42x faster
pickle_pure_python 672 us 440 us: 1.53x faster 455 us: 1.48x faster 425 us: 1.58x faster 455 us: 1.48x faster 414 us: 1.62x faster
tomli_loads 3.84 sec 2.56 sec: 1.50x faster 2.79 sec: 1.38x faster 2.53 sec: 1.52x faster 2.71 sec: 1.42x faster 2.41 sec: 1.59x faster
unpickle 26.2 us 25.2 us: 1.04x faster 24.0 us: 1.09x faster 24.4 us: 1.07x faster 23.3 us: 1.12x faster 21.9 us: 1.20x faster
unpickle_list 7.29 us 5.89 us: 1.24x faster 6.03 us: 1.21x faster 5.81 us: 1.25x faster 5.69 us: 1.28x faster 5.49 us: 1.33x faster
unpickle_pure_python 505 us 296 us: 1.70x faster 321 us: 1.57x faster 284 us: 1.78x faster 306 us: 1.65x faster 273 us: 1.85x faster
xml_etree_parse 232 ms not significant 228 ms: 1.02x faster 226 ms: 1.03x faster not significant 216 ms: 1.08x faster
xml_etree_iterparse 185 ms 162 ms: 1.14x faster 160 ms: 1.16x faster 161 ms: 1.15x faster 163 ms: 1.14x faster 156 ms: 1.18x faster
xml_etree_generate 181 ms 145 ms: 1.25x faster 148 ms: 1.22x faster 144 ms: 1.26x faster 147 ms: 1.23x faster 136 ms: 1.34x faster
xml_etree_process 128 ms 97.6 ms: 1.31x faster 100 ms: 1.28x faster 97.2 ms: 1.32x faster 99.5 ms: 1.29x faster 89.2 ms: 1.44x faster
Geometric mean (ref) 1.24x faster 1.24x faster 1.26x faster 1.26x faster 1.35x faster

Benchmarks with tag 'startup':

Benchmark msvc.release.9db1a297d9 clang.release.18.1.8.9db1a297d9 clang.release.9db1a297d9 clang.release.cg.18.1.8.9db1a297d9 clang.release.cg.9db1a297d9 clang.release.tc.gc.20.1.0.rc2.9db1a297d9
python_startup 45.4 ms not significant not significant not significant 46.6 ms: 1.03x slower 44.2 ms: 1.03x faster
python_startup_no_site 37.1 ms 38.0 ms: 1.02x slower not significant not significant 38.6 ms: 1.04x slower 36.3 ms: 1.02x faster
Geometric mean (ref) 1.02x slower 1.00x faster 1.01x slower 1.03x slower 1.02x faster

Benchmarks with tag 'template':

Benchmark msvc.release.9db1a297d9 clang.release.18.1.8.9db1a297d9 clang.release.9db1a297d9 clang.release.cg.18.1.8.9db1a297d9 clang.release.cg.9db1a297d9 clang.release.tc.gc.20.1.0.rc2.9db1a297d9
django_template 75.6 ms 52.1 ms: 1.45x faster 55.6 ms: 1.36x faster 52.4 ms: 1.44x faster 54.8 ms: 1.38x faster 49.2 ms: 1.54x faster
genshi_text 44.5 ms 29.2 ms: 1.52x faster 31.4 ms: 1.42x faster 29.1 ms: 1.53x faster 30.7 ms: 1.45x faster 27.7 ms: 1.61x faster
genshi_xml 102 ms 68.5 ms: 1.48x faster 74.0 ms: 1.37x faster 67.9 ms: 1.50x faster 73.4 ms: 1.38x faster 64.6 ms: 1.57x faster
mako 23.3 ms 16.8 ms: 1.39x faster 17.7 ms: 1.31x faster 16.6 ms: 1.40x faster 18.5 ms: 1.26x faster 15.8 ms: 1.47x faster
Geometric mean (ref) 1.46x faster 1.36x faster 1.47x faster 1.37x faster 1.54x faster

All benchmarks:

Benchmark msvc.release.9db1a297d9 clang.release.18.1.8.9db1a297d9 clang.release.9db1a297d9 clang.release.cg.18.1.8.9db1a297d9 clang.release.cg.9db1a297d9 clang.release.tc.gc.20.1.0.rc2.9db1a297d9
2to3 586 ms 473 ms: 1.24x faster 491 ms: 1.19x faster 459 ms: 1.28x faster 509 ms: 1.15x faster 434 ms: 1.35x faster
async_generators 696 ms 546 ms: 1.27x faster 565 ms: 1.23x faster 549 ms: 1.27x faster 561 ms: 1.24x faster 515 ms: 1.35x faster
async_tree_none 511 ms 375 ms: 1.36x faster 383 ms: 1.33x faster 369 ms: 1.39x faster 391 ms: 1.31x faster 355 ms: 1.44x faster
async_tree_cpu_io_mixed 933 ms 785 ms: 1.19x faster 805 ms: 1.16x faster 775 ms: 1.20x faster 800 ms: 1.17x faster 754 ms: 1.24x faster
async_tree_cpu_io_mixed_tg 891 ms 758 ms: 1.17x faster 776 ms: 1.15x faster 752 ms: 1.18x faster 771 ms: 1.15x faster 726 ms: 1.23x faster
async_tree_eager 209 ms 153 ms: 1.37x faster 153 ms: 1.37x faster 147 ms: 1.42x faster 155 ms: 1.35x faster 138 ms: 1.52x faster
async_tree_eager_cpu_io_mixed 656 ms 605 ms: 1.08x faster 630 ms: 1.04x faster 596 ms: 1.10x faster 614 ms: 1.07x faster 588 ms: 1.12x faster
async_tree_eager_cpu_io_mixed_tg 830 ms 727 ms: 1.14x faster 741 ms: 1.12x faster 723 ms: 1.15x faster 743 ms: 1.12x faster 687 ms: 1.21x faster
async_tree_eager_io 1.12 sec 863 ms: 1.30x faster 870 ms: 1.29x faster 843 ms: 1.33x faster 887 ms: 1.26x faster 796 ms: 1.41x faster
async_tree_eager_io_tg 1.12 sec 890 ms: 1.26x faster 890 ms: 1.26x faster 865 ms: 1.29x faster 916 ms: 1.22x faster 822 ms: 1.36x faster
async_tree_eager_memoization 393 ms 297 ms: 1.32x faster 304 ms: 1.29x faster 293 ms: 1.34x faster 311 ms: 1.26x faster 274 ms: 1.43x faster
async_tree_eager_memoization_tg 546 ms 426 ms: 1.28x faster 420 ms: 1.30x faster 419 ms: 1.30x faster 437 ms: 1.25x faster 390 ms: 1.40x faster
async_tree_eager_tg 408 ms 318 ms: 1.29x faster 312 ms: 1.31x faster 317 ms: 1.29x faster 319 ms: 1.28x faster 286 ms: 1.43x faster
async_tree_io 1.14 sec 863 ms: 1.32x faster 868 ms: 1.31x faster 848 ms: 1.34x faster 881 ms: 1.29x faster 819 ms: 1.39x faster
async_tree_io_tg 1.14 sec 871 ms: 1.31x faster 871 ms: 1.31x faster 847 ms: 1.34x faster 883 ms: 1.29x faster 810 ms: 1.40x faster
async_tree_memoization 649 ms 491 ms: 1.32x faster 493 ms: 1.32x faster 480 ms: 1.35x faster 508 ms: 1.28x faster 462 ms: 1.40x faster
async_tree_memoization_tg 605 ms 459 ms: 1.32x faster 453 ms: 1.34x faster 448 ms: 1.35x faster 468 ms: 1.29x faster 428 ms: 1.41x faster
async_tree_none_tg 497 ms 372 ms: 1.33x faster 371 ms: 1.34x faster 367 ms: 1.35x faster 379 ms: 1.31x faster 349 ms: 1.42x faster
asyncio_tcp 1.64 sec not significant 1.55 sec: 1.06x faster not significant not significant 1.45 sec: 1.13x faster
asyncio_websockets 732 ms 574 ms: 1.27x faster 578 ms: 1.27x faster 578 ms: 1.27x faster 555 ms: 1.32x faster 566 ms: 1.29x faster
chaos 132 ms 78.5 ms: 1.67x faster 88.6 ms: 1.48x faster 79.6 ms: 1.65x faster 90.7 ms: 1.45x faster 77.1 ms: 1.71x faster
comprehensions 34.7 us 23.0 us: 1.51x faster 24.5 us: 1.42x faster 22.7 us: 1.53x faster 24.0 us: 1.44x faster 21.5 us: 1.61x faster
bench_mp_pool 213 ms not significant 196 ms: 1.09x faster not significant not significant 184 ms: 1.16x faster
bench_thread_pool 1.95 ms 1.76 ms: 1.11x faster 1.74 ms: 1.12x faster 1.74 ms: 1.12x faster 1.81 ms: 1.08x faster 1.67 ms: 1.17x faster
coroutines 45.3 ms 30.2 ms: 1.50x faster 33.9 ms: 1.34x faster 29.7 ms: 1.52x faster 32.9 ms: 1.37x faster 28.7 ms: 1.58x faster
coverage 130 ms 120 ms: 1.09x faster 119 ms: 1.09x faster 117 ms: 1.11x faster 119 ms: 1.09x faster 112 ms: 1.17x faster
crypto_pyaes 147 ms 101 ms: 1.45x faster 109 ms: 1.35x faster 99.7 ms: 1.47x faster 107 ms: 1.37x faster 97.2 ms: 1.51x faster
deepcopy 516 us 372 us: 1.39x faster 391 us: 1.32x faster 366 us: 1.41x faster 377 us: 1.37x faster 352 us: 1.47x faster
deepcopy_reduce 5.30 us 3.87 us: 1.37x faster 4.19 us: 1.26x faster 3.82 us: 1.39x faster 4.06 us: 1.30x faster 3.61 us: 1.47x faster
deepcopy_memo 67.1 us 40.4 us: 1.66x faster 41.6 us: 1.61x faster 38.2 us: 1.76x faster 40.5 us: 1.66x faster 37.8 us: 1.78x faster
deltablue 7.72 ms 4.25 ms: 1.82x faster 4.52 ms: 1.71x faster 4.22 ms: 1.83x faster 4.46 ms: 1.73x faster 4.04 ms: 1.91x faster
django_template 75.6 ms 52.1 ms: 1.45x faster 55.6 ms: 1.36x faster 52.4 ms: 1.44x faster 54.8 ms: 1.38x faster 49.2 ms: 1.54x faster
docutils 4.27 sec 3.63 sec: 1.18x faster 3.75 sec: 1.14x faster 3.59 sec: 1.19x faster 3.71 sec: 1.15x faster 3.44 sec: 1.24x faster
dulwich_log 156 ms 136 ms: 1.14x faster 141 ms: 1.11x faster 135 ms: 1.16x faster 141 ms: 1.10x faster 129 ms: 1.21x faster
fannkuch 770 ms 541 ms: 1.42x faster 592 ms: 1.30x faster 532 ms: 1.45x faster 594 ms: 1.30x faster 520 ms: 1.48x faster
float 145 ms 103 ms: 1.41x faster 108 ms: 1.35x faster 103 ms: 1.41x faster 104 ms: 1.39x faster 97.8 ms: 1.48x faster
create_gc_cycles 1.62 ms not significant 1.71 ms: 1.05x slower not significant 1.75 ms: 1.08x slower not significant
gc_traversal 5.03 ms 5.32 ms: 1.06x slower not significant 5.36 ms: 1.06x slower 5.40 ms: 1.07x slower not significant
generators 65.1 ms 37.5 ms: 1.74x faster 40.4 ms: 1.61x faster 37.5 ms: 1.73x faster 40.2 ms: 1.62x faster 35.5 ms: 1.84x faster
genshi_text 44.5 ms 29.2 ms: 1.52x faster 31.4 ms: 1.42x faster 29.1 ms: 1.53x faster 30.7 ms: 1.45x faster 27.7 ms: 1.61x faster
genshi_xml 102 ms 68.5 ms: 1.48x faster 74.0 ms: 1.37x faster 67.9 ms: 1.50x faster 73.4 ms: 1.38x faster 64.6 ms: 1.57x faster
go 255 ms 134 ms: 1.91x faster 147 ms: 1.73x faster 134 ms: 1.91x faster 147 ms: 1.74x faster 131 ms: 1.96x faster
hexiom 13.4 ms 7.73 ms: 1.74x faster 8.49 ms: 1.58x faster 7.53 ms: 1.78x faster 8.30 ms: 1.62x faster 7.49 ms: 1.79x faster
html5lib 104 ms 76.4 ms: 1.36x faster 81.6 ms: 1.28x faster 75.3 ms: 1.38x faster 80.0 ms: 1.30x faster 70.4 ms: 1.48x faster
json_dumps 19.6 ms 16.6 ms: 1.18x faster 16.9 ms: 1.16x faster 16.6 ms: 1.18x faster 16.8 ms: 1.17x faster 15.3 ms: 1.28x faster
json_loads 48.1 us not significant 46.7 us: 1.03x faster not significant 46.8 us: 1.03x faster 43.9 us: 1.10x faster
logging_format 21.2 us 14.9 us: 1.42x faster 16.4 us: 1.29x faster 15.4 us: 1.38x faster 16.5 us: 1.28x faster 14.1 us: 1.50x faster
logging_silent 213 ns 138 ns: 1.55x faster 143 ns: 1.49x faster 127 ns: 1.67x faster 132 ns: 1.61x faster 121 ns: 1.76x faster
logging_simple 19.4 us 13.2 us: 1.47x faster 14.6 us: 1.33x faster 13.5 us: 1.44x faster 14.8 us: 1.31x faster 12.5 us: 1.55x faster
mako 23.3 ms 16.8 ms: 1.39x faster 17.7 ms: 1.31x faster 16.6 ms: 1.40x faster 18.5 ms: 1.26x faster 15.8 ms: 1.47x faster
mdp 3.99 sec 4.05 sec: 1.01x slower 4.12 sec: 1.03x slower not significant 4.21 sec: 1.05x slower 3.74 sec: 1.07x faster
meteor_contest 175 ms 123 ms: 1.42x faster 133 ms: 1.32x faster 125 ms: 1.39x faster 132 ms: 1.32x faster 122 ms: 1.43x faster
nbody 203 ms 128 ms: 1.59x faster 155 ms: 1.31x faster 129 ms: 1.58x faster 151 ms: 1.34x faster 127 ms: 1.60x faster
nqueens 179 ms 118 ms: 1.51x faster 129 ms: 1.38x faster 120 ms: 1.49x faster 126 ms: 1.42x faster 112 ms: 1.60x faster
pathlib 278 ms 267 ms: 1.04x faster 266 ms: 1.04x faster 267 ms: 1.04x faster 268 ms: 1.04x faster 256 ms: 1.09x faster
pickle 21.5 us 18.8 us: 1.15x faster 17.9 us: 1.20x faster 18.7 us: 1.15x faster 17.6 us: 1.22x faster 17.2 us: 1.25x faster
pickle_dict 46.0 us 35.7 us: 1.29x faster 34.3 us: 1.34x faster 36.6 us: 1.26x faster 33.7 us: 1.37x faster 33.0 us: 1.39x faster
pickle_list 8.16 us 6.39 us: 1.28x faster 6.19 us: 1.32x faster 6.40 us: 1.27x faster 5.91 us: 1.38x faster 5.73 us: 1.42x faster
pickle_pure_python 672 us 440 us: 1.53x faster 455 us: 1.48x faster 425 us: 1.58x faster 455 us: 1.48x faster 414 us: 1.62x faster
pidigits 245 ms not significant 250 ms: 1.02x slower not significant 250 ms: 1.02x slower not significant
pprint_safe_repr 1.46 sec 1.01 sec: 1.44x faster 1.09 sec: 1.34x faster 992 ms: 1.47x faster 1.11 sec: 1.32x faster 946 ms: 1.55x faster
pprint_pformat 3.00 sec 2.04 sec: 1.47x faster 2.22 sec: 1.35x faster 1.99 sec: 1.51x faster 2.24 sec: 1.34x faster 1.93 sec: 1.55x faster
pyflate 875 ms 589 ms: 1.49x faster 626 ms: 1.40x faster 579 ms: 1.51x faster 623 ms: 1.40x faster 560 ms: 1.56x faster
python_startup 45.4 ms not significant not significant not significant 46.6 ms: 1.03x slower 44.2 ms: 1.03x faster
python_startup_no_site 37.1 ms 38.0 ms: 1.02x slower not significant not significant 38.6 ms: 1.04x slower 36.3 ms: 1.02x faster
raytrace 587 ms 360 ms: 1.63x faster 385 ms: 1.52x faster 355 ms: 1.65x faster 392 ms: 1.50x faster 343 ms: 1.71x faster
regex_compile 237 ms 165 ms: 1.44x faster 180 ms: 1.31x faster 165 ms: 1.44x faster 175 ms: 1.36x faster 155 ms: 1.53x faster
regex_dna 226 ms 245 ms: 1.09x slower 256 ms: 1.14x slower 232 ms: 1.03x slower 241 ms: 1.07x slower 238 ms: 1.05x slower
regex_effbot 4.05 ms 3.92 ms: 1.04x faster not significant 3.97 ms: 1.02x faster 3.96 ms: 1.02x faster 3.87 ms: 1.05x faster
regex_v8 38.7 ms 34.3 ms: 1.13x faster 35.7 ms: 1.08x faster 32.6 ms: 1.19x faster 33.3 ms: 1.16x faster 32.0 ms: 1.21x faster
richards 102 ms 62.4 ms: 1.64x faster 65.3 ms: 1.56x faster 61.6 ms: 1.66x faster 64.5 ms: 1.58x faster 57.6 ms: 1.77x faster
richards_super 116 ms 71.2 ms: 1.64x faster 74.3 ms: 1.57x faster 70.2 ms: 1.66x faster 73.2 ms: 1.59x faster 66.3 ms: 1.76x faster
scimark_fft 664 ms 433 ms: 1.53x faster 485 ms: 1.37x faster 429 ms: 1.55x faster 462 ms: 1.44x faster 393 ms: 1.69x faster
scimark_lu 227 ms 150 ms: 1.51x faster 159 ms: 1.43x faster 152 ms: 1.50x faster 151 ms: 1.50x faster 141 ms: 1.62x faster
scimark_monte_carlo 138 ms 83.7 ms: 1.65x faster 91.6 ms: 1.51x faster 82.0 ms: 1.68x faster 89.4 ms: 1.55x faster 77.2 ms: 1.79x faster
scimark_sor 256 ms 148 ms: 1.73x faster 176 ms: 1.46x faster 144 ms: 1.78x faster 172 ms: 1.49x faster 141 ms: 1.81x faster
scimark_sparse_mat_mult 8.76 ms 5.50 ms: 1.59x faster 6.31 ms: 1.39x faster 5.52 ms: 1.59x faster 6.04 ms: 1.45x faster 5.26 ms: 1.67x faster
spectral_norm 179 ms 120 ms: 1.49x faster 136 ms: 1.32x faster 114 ms: 1.58x faster 128 ms: 1.41x faster 114 ms: 1.57x faster
sqlglot_normalize 204 ms 150 ms: 1.35x faster 156 ms: 1.31x faster 150 ms: 1.36x faster 153 ms: 1.33x faster 143 ms: 1.43x faster
sqlglot_optimize 97.0 ms 77.3 ms: 1.25x faster 77.7 ms: 1.25x faster 75.8 ms: 1.28x faster 75.9 ms: 1.28x faster 70.9 ms: 1.37x faster
sqlglot_parse 2.52 ms 1.61 ms: 1.57x faster 1.72 ms: 1.46x faster 1.65 ms: 1.52x faster 1.73 ms: 1.45x faster 1.56 ms: 1.61x faster
sqlglot_transpile 3.02 ms 2.00 ms: 1.51x faster 2.15 ms: 1.41x faster 2.00 ms: 1.51x faster 2.18 ms: 1.39x faster 1.95 ms: 1.55x faster
sqlite_synth 4.08 us 3.79 us: 1.07x faster 3.81 us: 1.07x faster 3.70 us: 1.10x faster 3.87 us: 1.05x faster 3.51 us: 1.16x faster
sympy_expand 818 ms 650 ms: 1.26x faster 681 ms: 1.20x faster 650 ms: 1.26x faster 677 ms: 1.21x faster 612 ms: 1.34x faster
sympy_integrate 33.5 ms 27.1 ms: 1.24x faster 28.2 ms: 1.19x faster 27.5 ms: 1.22x faster 28.0 ms: 1.19x faster 25.6 ms: 1.31x faster
sympy_sum 258 ms 217 ms: 1.19x faster 222 ms: 1.16x faster 214 ms: 1.21x faster 220 ms: 1.17x faster 205 ms: 1.26x faster
sympy_str 484 ms 380 ms: 1.27x faster 405 ms: 1.20x faster 385 ms: 1.26x faster 408 ms: 1.19x faster 362 ms: 1.34x faster
telco 13.1 ms 11.2 ms: 1.17x faster 11.1 ms: 1.17x faster 11.3 ms: 1.16x faster 11.6 ms: 1.13x faster 10.5 ms: 1.24x faster
tomli_loads 3.84 sec 2.56 sec: 1.50x faster 2.79 sec: 1.38x faster 2.53 sec: 1.52x faster 2.71 sec: 1.42x faster 2.41 sec: 1.59x faster
typing_runtime_protocols 296 us 225 us: 1.32x faster 239 us: 1.24x faster 223 us: 1.32x faster 233 us: 1.27x faster 208 us: 1.42x faster
unpack_sequence 152 ns 54.8 ns: 2.77x faster 58.2 ns: 2.61x faster 57.0 ns: 2.66x faster 57.0 ns: 2.67x faster 56.8 ns: 2.67x faster
unpickle 26.2 us 25.2 us: 1.04x faster 24.0 us: 1.09x faster 24.4 us: 1.07x faster 23.3 us: 1.12x faster 21.9 us: 1.20x faster
unpickle_list 7.29 us 5.89 us: 1.24x faster 6.03 us: 1.21x faster 5.81 us: 1.25x faster 5.69 us: 1.28x faster 5.49 us: 1.33x faster
unpickle_pure_python 505 us 296 us: 1.70x faster 321 us: 1.57x faster 284 us: 1.78x faster 306 us: 1.65x faster 273 us: 1.85x faster
xml_etree_parse 232 ms not significant 228 ms: 1.02x faster 226 ms: 1.03x faster not significant 216 ms: 1.08x faster
xml_etree_iterparse 185 ms 162 ms: 1.14x faster 160 ms: 1.16x faster 161 ms: 1.15x faster 163 ms: 1.14x faster 156 ms: 1.18x faster
xml_etree_generate 181 ms 145 ms: 1.25x faster 148 ms: 1.22x faster 144 ms: 1.26x faster 147 ms: 1.23x faster 136 ms: 1.34x faster
xml_etree_process 128 ms 97.6 ms: 1.31x faster 100 ms: 1.28x faster 97.2 ms: 1.32x faster 99.5 ms: 1.29x faster 89.2 ms: 1.44x faster
Geometric mean (ref) 1.32x faster 1.27x faster 1.34x faster 1.27x faster 1.40x faster

Benchmark hidden because not significant (1): asyncio_tcp_ssl

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment