Skip to content

Instantly share code, notes, and snippets.

@blopker

blopker/-README.MD

Last active July 19, 2020 21:14
Show Gist options
  • Save blopker/87153749077fc2ca233310627a564e42 to your computer and use it in GitHub Desktop.
Save blopker/87153749077fc2ca233310627a564e42 to your computer and use it in GitHub Desktop.
Download ZIP
Disable semantic interposition?
Raw
-README.MD

Python disable semantic interposition benchmark

This is a test of the official Python Docker containers, with and without the --with-lto config flag and the -fno-semantic-interposition compiler flag. These flags enable faster function lookup accrding to https://fedoraproject.org/wiki/Changes/PythonNoSemanticInterpositionSpeedup

Files

runner.sh: Builds then runs the containers with by invoking test.sh

test.sh: Installs required Python packages and runs the benchmark

$1.txt: Created by running python -m perf compare_to $1.json $1-optimized.json --table

Setup

The tests were run on AWS, on a m5.large instance running AWS Linux 2.

docker -v: Docker version 19.03.12, build 48a66213fe.

uname -a: Linux 5.4.42-200.el7.x86_64 #1 SMP Fri May 22 14:46:15 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

Observations

  • On Python 3.8 Buster improvements range from -8% to +31% changes in performance, average +16.2% improvement.
  • On Python 3.8 Alpine 3.12 improvements range from -16% to +33% changes in performance, average +15.6% improvement.
  • Tests that showed negative percentages were tests that called C extensions and not using much Python, like pickling and regex. These tests also tended to be much faster, less than 1ms. It seems likely that they would be affected more by noisy neighbor issues on the VM the tests were running. For instance on 3.6-buster.txt the unpack_sequence showed +23% improvement where on 3.8-buster.txt the same test showed -8%. This test only ran for 70 ns and could be susceptible to the underlying hardware usage fluctuations.
  • Some tests consistently showed no changes, like pidigits, regex, and json. This seems to be that the benchmarks rely on C extensions more heavily than the other benchmarks that involve more Python code.
  • The tests that took more than 10ms to run seem to give back more consistent results between Python versions.
Raw
3.6-alpine3.12.txt
+-------------------------+--------------------------+-------------------------------+
| Benchmark | 3.6-alpine3.12-optimized | 3.6-alpine3.12 |
+=========================+==========================+===============================+
| 2to3 | 441 ms | 506 ms: 1.15x slower (+15%) |
+-------------------------+--------------------------+-------------------------------+
| chameleon | 14.7 ms | 16.3 ms: 1.11x slower (+11%) |
+-------------------------+--------------------------+-------------------------------+
| chaos | 152 ms | 193 ms: 1.27x slower (+27%) |
+-------------------------+--------------------------+-------------------------------+
| crypto_pyaes | 142 ms | 173 ms: 1.21x slower (+21%) |
+-------------------------+--------------------------+-------------------------------+
| deltablue | 10.3 ms | 12.8 ms: 1.24x slower (+24%) |
+-------------------------+--------------------------+-------------------------------+
| django_template | 92.8 ms | 110 ms: 1.19x slower (+19%) |
+-------------------------+--------------------------+-------------------------------+
| dulwich_log | 85.6 ms | 98.5 ms: 1.15x slower (+15%) |
+-------------------------+--------------------------+-------------------------------+
| fannkuch | 682 ms | 765 ms: 1.12x slower (+12%) |
+-------------------------+--------------------------+-------------------------------+
| float | 150 ms | 185 ms: 1.24x slower (+24%) |
+-------------------------+--------------------------+-------------------------------+
| genshi_text | 44.0 ms | 50.1 ms: 1.14x slower (+14%) |
+-------------------------+--------------------------+-------------------------------+
| genshi_xml | 92.4 ms | 104 ms: 1.13x slower (+13%) |
+-------------------------+--------------------------+-------------------------------+
| go | 336 ms | 416 ms: 1.24x slower (+24%) |
+-------------------------+--------------------------+-------------------------------+
| hexiom | 14.1 ms | 17.8 ms: 1.26x slower (+26%) |
+-------------------------+--------------------------+-------------------------------+
| json_loads | 38.5 us | 39.9 us: 1.03x slower (+3%) |
+-------------------------+--------------------------+-------------------------------+
| logging_format | 14.2 us | 19.1 us: 1.34x slower (+34%) |
+-------------------------+--------------------------+-------------------------------+
| logging_silent | 455 ns | 548 ns: 1.20x slower (+20%) |
+-------------------------+--------------------------+-------------------------------+
| logging_simple | 12.3 us | 15.4 us: 1.25x slower (+25%) |
+-------------------------+--------------------------+-------------------------------+
| mako | 28.2 ms | 32.1 ms: 1.14x slower (+14%) |
+-------------------------+--------------------------+-------------------------------+
| meteor_contest | 142 ms | 161 ms: 1.13x slower (+13%) |
+-------------------------+--------------------------+-------------------------------+
| nbody | 158 ms | 189 ms: 1.19x slower (+19%) |
+-------------------------+--------------------------+-------------------------------+
| nqueens | 140 ms | 167 ms: 1.20x slower (+20%) |
+-------------------------+--------------------------+-------------------------------+
| pathlib | 31.2 ms | 33.9 ms: 1.09x slower (+9%) |
+-------------------------+--------------------------+-------------------------------+
| pickle_dict | 47.8 us | 51.2 us: 1.07x slower (+7%) |
+-------------------------+--------------------------+-------------------------------+
| pickle_list | 5.97 us | 6.29 us: 1.05x slower (+5%) |
+-------------------------+--------------------------+-------------------------------+
| pickle_pure_python | 651 us | 802 us: 1.23x slower (+23%) |
+-------------------------+--------------------------+-------------------------------+
| pyflate | 987 ms | 1.13 sec: 1.14x slower (+14%) |
+-------------------------+--------------------------+-------------------------------+
| python_startup | 13.0 ms | 13.7 ms: 1.05x slower (+5%) |
+-------------------------+--------------------------+-------------------------------+
| python_startup_no_site | 8.00 ms | 8.46 ms: 1.06x slower (+6%) |
+-------------------------+--------------------------+-------------------------------+
| raytrace | 700 ms | 905 ms: 1.29x slower (+29%) |
+-------------------------+--------------------------+-------------------------------+
| regex_compile | 246 ms | 295 ms: 1.20x slower (+20%) |
+-------------------------+--------------------------+-------------------------------+
| regex_dna | 269 ms | 267 ms: 1.01x faster (-1%) |
+-------------------------+--------------------------+-------------------------------+
| regex_effbot | 4.14 ms | 4.32 ms: 1.04x slower (+4%) |
+-------------------------+--------------------------+-------------------------------+
| regex_v8 | 34.0 ms | 35.3 ms: 1.04x slower (+4%) |
+-------------------------+--------------------------+-------------------------------+
| richards | 102 ms | 130 ms: 1.27x slower (+27%) |
+-------------------------+--------------------------+-------------------------------+
| scimark_fft | 431 ms | 499 ms: 1.16x slower (+16%) |
+-------------------------+--------------------------+-------------------------------+
| scimark_lu | 303 ms | 390 ms: 1.29x slower (+29%) |
+-------------------------+--------------------------+-------------------------------+
| scimark_monte_carlo | 145 ms | 174 ms: 1.19x slower (+19%) |
+-------------------------+--------------------------+-------------------------------+
| scimark_sor | 296 ms | 352 ms: 1.19x slower (+19%) |
+-------------------------+--------------------------+-------------------------------+
| scimark_sparse_mat_mult | 5.39 ms | 6.19 ms: 1.15x slower (+15%) |
+-------------------------+--------------------------+-------------------------------+
| spectral_norm | 183 ms | 204 ms: 1.12x slower (+12%) |
+-------------------------+--------------------------+-------------------------------+
| sqlalchemy_declarative | 245 ms | 266 ms: 1.09x slower (+9%) |
+-------------------------+--------------------------+-------------------------------+
| sqlalchemy_imperative | 37.3 ms | 41.1 ms: 1.10x slower (+10%) |
+-------------------------+--------------------------+-------------------------------+
| sqlite_synth | 4.36 us | 4.72 us: 1.08x slower (+8%) |
+-------------------------+--------------------------+-------------------------------+
| sympy_expand | 727 ms | 850 ms: 1.17x slower (+17%) |
+-------------------------+--------------------------+-------------------------------+
| sympy_integrate | 37.7 ms | 43.3 ms: 1.15x slower (+15%) |
+-------------------------+--------------------------+-------------------------------+
| sympy_sum | 334 ms | 358 ms: 1.07x slower (+7%) |
+-------------------------+--------------------------+-------------------------------+
| sympy_str | 493 ms | 567 ms: 1.15x slower (+15%) |
+-------------------------+--------------------------+-------------------------------+
| telco | 9.32 ms | 10.6 ms: 1.13x slower (+13%) |
+-------------------------+--------------------------+-------------------------------+
| tornado_http | 203 ms | 225 ms: 1.11x slower (+11%) |
+-------------------------+--------------------------+-------------------------------+
| unpack_sequence | 67.5 ns | 71.9 ns: 1.07x slower (+7%) |
+-------------------------+--------------------------+-------------------------------+
| unpickle | 17.5 us | 20.5 us: 1.17x slower (+17%) |
+-------------------------+--------------------------+-------------------------------+
| unpickle_list | 5.97 us | 6.27 us: 1.05x slower (+5%) |
+-------------------------+--------------------------+-------------------------------+
| unpickle_pure_python | 495 us | 593 us: 1.20x slower (+20%) |
+-------------------------+--------------------------+-------------------------------+
| xml_etree_parse | 222 ms | 236 ms: 1.06x slower (+6%) |
+-------------------------+--------------------------+-------------------------------+
| xml_etree_iterparse | 155 ms | 172 ms: 1.11x slower (+11%) |
+-------------------------+--------------------------+-------------------------------+
| xml_etree_generate | 142 ms | 175 ms: 1.23x slower (+23%) |
+-------------------------+--------------------------+-------------------------------+
| xml_etree_process | 119 ms | 140 ms: 1.18x slower (+18%) |
+-------------------------+--------------------------+-------------------------------+
Raw
3.6-buster.txt
+-------------------------+----------------------+-------------------------------+
| Benchmark | 3.6-buster-optimized | 3.6-buster |
+=========================+======================+===============================+
| 2to3 | 442 ms | 504 ms: 1.14x slower (+14%) |
+-------------------------+----------------------+-------------------------------+
| chaos | 151 ms | 191 ms: 1.26x slower (+26%) |
+-------------------------+----------------------+-------------------------------+
| crypto_pyaes | 146 ms | 173 ms: 1.19x slower (+19%) |
+-------------------------+----------------------+-------------------------------+
| deltablue | 10.5 ms | 12.6 ms: 1.20x slower (+20%) |
+-------------------------+----------------------+-------------------------------+
| django_template | 91.7 ms | 106 ms: 1.15x slower (+15%) |
+-------------------------+----------------------+-------------------------------+
| dulwich_log | 87.6 ms | 101 ms: 1.15x slower (+15%) |
+-------------------------+----------------------+-------------------------------+
| fannkuch | 659 ms | 755 ms: 1.15x slower (+15%) |
+-------------------------+----------------------+-------------------------------+
| float | 152 ms | 181 ms: 1.19x slower (+19%) |
+-------------------------+----------------------+-------------------------------+
| genshi_text | 43.4 ms | 49.4 ms: 1.14x slower (+14%) |
+-------------------------+----------------------+-------------------------------+
| genshi_xml | 90.0 ms | 101 ms: 1.12x slower (+12%) |
+-------------------------+----------------------+-------------------------------+
| go | 347 ms | 418 ms: 1.20x slower (+20%) |
+-------------------------+----------------------+-------------------------------+
| hexiom | 14.4 ms | 17.7 ms: 1.22x slower (+22%) |
+-------------------------+----------------------+-------------------------------+
| json_dumps | 17.4 ms | 18.9 ms: 1.08x slower (+8%) |
+-------------------------+----------------------+-------------------------------+
| json_loads | 39.5 us | 41.0 us: 1.04x slower (+4%) |
+-------------------------+----------------------+-------------------------------+
| logging_format | 14.0 us | 17.3 us: 1.24x slower (+24%) |
+-------------------------+----------------------+-------------------------------+
| logging_silent | 465 ns | 555 ns: 1.19x slower (+19%) |
+-------------------------+----------------------+-------------------------------+
| logging_simple | 12.3 us | 14.9 us: 1.21x slower (+21%) |
+-------------------------+----------------------+-------------------------------+
| mako | 27.0 ms | 30.5 ms: 1.13x slower (+13%) |
+-------------------------+----------------------+-------------------------------+
| meteor_contest | 144 ms | 153 ms: 1.07x slower (+7%) |
+-------------------------+----------------------+-------------------------------+
| nbody | 162 ms | 197 ms: 1.22x slower (+22%) |
+-------------------------+----------------------+-------------------------------+
| nqueens | 138 ms | 169 ms: 1.22x slower (+22%) |
+-------------------------+----------------------+-------------------------------+
| pathlib | 30.7 ms | 32.9 ms: 1.07x slower (+7%) |
+-------------------------+----------------------+-------------------------------+
| pickle | 15.0 us | 16.9 us: 1.12x slower (+12%) |
+-------------------------+----------------------+-------------------------------+
| pickle_list | 5.87 us | 5.99 us: 1.02x slower (+2%) |
+-------------------------+----------------------+-------------------------------+
| pickle_pure_python | 668 us | 787 us: 1.18x slower (+18%) |
+-------------------------+----------------------+-------------------------------+
| pidigits | 225 ms | 231 ms: 1.02x slower (+2%) |
+-------------------------+----------------------+-------------------------------+
| pyflate | 949 ms | 1.09 sec: 1.15x slower (+15%) |
+-------------------------+----------------------+-------------------------------+
| python_startup | 13.3 ms | 14.2 ms: 1.06x slower (+6%) |
+-------------------------+----------------------+-------------------------------+
| python_startup_no_site | 8.56 ms | 8.91 ms: 1.04x slower (+4%) |
+-------------------------+----------------------+-------------------------------+
| raytrace | 706 ms | 900 ms: 1.27x slower (+27%) |
+-------------------------+----------------------+-------------------------------+
| regex_compile | 246 ms | 290 ms: 1.18x slower (+18%) |
+-------------------------+----------------------+-------------------------------+
| regex_dna | 252 ms | 241 ms: 1.04x faster (-4%) |
+-------------------------+----------------------+-------------------------------+
| regex_effbot | 4.16 ms | 3.95 ms: 1.05x faster (-5%) |
+-------------------------+----------------------+-------------------------------+
| regex_v8 | 31.3 ms | 33.1 ms: 1.06x slower (+6%) |
+-------------------------+----------------------+-------------------------------+
| richards | 104 ms | 127 ms: 1.22x slower (+22%) |
+-------------------------+----------------------+-------------------------------+
| scimark_fft | 429 ms | 509 ms: 1.19x slower (+19%) |
+-------------------------+----------------------+-------------------------------+
| scimark_lu | 298 ms | 361 ms: 1.21x slower (+21%) |
+-------------------------+----------------------+-------------------------------+
| scimark_monte_carlo | 142 ms | 175 ms: 1.23x slower (+23%) |
+-------------------------+----------------------+-------------------------------+
| scimark_sor | 302 ms | 344 ms: 1.14x slower (+14%) |
+-------------------------+----------------------+-------------------------------+
| scimark_sparse_mat_mult | 5.44 ms | 6.45 ms: 1.19x slower (+19%) |
+-------------------------+----------------------+-------------------------------+
| spectral_norm | 180 ms | 200 ms: 1.11x slower (+11%) |
+-------------------------+----------------------+-------------------------------+
| sqlalchemy_declarative | 228 ms | 251 ms: 1.10x slower (+10%) |
+-------------------------+----------------------+-------------------------------+
| sqlalchemy_imperative | 37.0 ms | 41.2 ms: 1.11x slower (+11%) |
+-------------------------+----------------------+-------------------------------+
| sqlite_synth | 3.84 us | 4.13 us: 1.08x slower (+8%) |
+-------------------------+----------------------+-------------------------------+
| sympy_expand | 708 ms | 833 ms: 1.18x slower (+18%) |
+-------------------------+----------------------+-------------------------------+
| sympy_integrate | 36.9 ms | 42.6 ms: 1.15x slower (+15%) |
+-------------------------+----------------------+-------------------------------+
| sympy_sum | 316 ms | 355 ms: 1.12x slower (+12%) |
+-------------------------+----------------------+-------------------------------+
| sympy_str | 480 ms | 557 ms: 1.16x slower (+16%) |
+-------------------------+----------------------+-------------------------------+
| telco | 9.06 ms | 9.98 ms: 1.10x slower (+10%) |
+-------------------------+----------------------+-------------------------------+
| tornado_http | 200 ms | 221 ms: 1.10x slower (+10%) |
+-------------------------+----------------------+-------------------------------+
| unpack_sequence | 64.6 ns | 79.3 ns: 1.23x slower (+23%) |
+-------------------------+----------------------+-------------------------------+
| unpickle | 19.9 us | 21.0 us: 1.05x slower (+5%) |
+-------------------------+----------------------+-------------------------------+
| unpickle_list | 5.49 us | 5.64 us: 1.03x slower (+3%) |
+-------------------------+----------------------+-------------------------------+
| unpickle_pure_python | 491 us | 575 us: 1.17x slower (+17%) |
+-------------------------+----------------------+-------------------------------+
| xml_etree_parse | 210 ms | 227 ms: 1.08x slower (+8%) |
+-------------------------+----------------------+-------------------------------+
| xml_etree_iterparse | 150 ms | 167 ms: 1.12x slower (+12%) |
+-------------------------+----------------------+-------------------------------+
| xml_etree_generate | 143 ms | 170 ms: 1.19x slower (+19%) |
+-------------------------+----------------------+-------------------------------+
| xml_etree_process | 116 ms | 136 ms: 1.17x slower (+17%) |
+-------------------------+----------------------+-------------------------------+
Raw
3.7-alpine3.12.txt
+-------------------------+--------------------------+-------------------------------+
| Benchmark | 3.7-alpine3.12-optimized | 3.7-alpine3.12 |
+=========================+==========================+===============================+
| 2to3 | 444 ms | 489 ms: 1.10x slower (+10%) |
+-------------------------+--------------------------+-------------------------------+
| chameleon | 14.5 ms | 15.6 ms: 1.08x slower (+8%) |
+-------------------------+--------------------------+-------------------------------+
| chaos | 145 ms | 183 ms: 1.26x slower (+26%) |
+-------------------------+--------------------------+-------------------------------+
| crypto_pyaes | 139 ms | 173 ms: 1.25x slower (+25%) |
+-------------------------+--------------------------+-------------------------------+
| deltablue | 9.59 ms | 11.8 ms: 1.23x slower (+23%) |
+-------------------------+--------------------------+-------------------------------+
| django_template | 77.4 ms | 88.3 ms: 1.14x slower (+14%) |
+-------------------------+--------------------------+-------------------------------+
| dulwich_log | 82.3 ms | 95.0 ms: 1.15x slower (+15%) |
+-------------------------+--------------------------+-------------------------------+
| fannkuch | 667 ms | 769 ms: 1.15x slower (+15%) |
+-------------------------+--------------------------+-------------------------------+
| float | 154 ms | 181 ms: 1.17x slower (+17%) |
+-------------------------+--------------------------+-------------------------------+
| genshi_text | 42.5 ms | 47.5 ms: 1.12x slower (+12%) |
+-------------------------+--------------------------+-------------------------------+
| genshi_xml | 86.3 ms | 96.7 ms: 1.12x slower (+12%) |
+-------------------------+--------------------------+-------------------------------+
| go | 325 ms | 401 ms: 1.23x slower (+23%) |
+-------------------------+--------------------------+-------------------------------+
| hexiom | 13.3 ms | 16.6 ms: 1.25x slower (+25%) |
+-------------------------+--------------------------+-------------------------------+
| json_loads | 38.1 us | 41.2 us: 1.08x slower (+8%) |
+-------------------------+--------------------------+-------------------------------+
| logging_format | 12.0 us | 14.9 us: 1.24x slower (+24%) |
+-------------------------+--------------------------+-------------------------------+
| logging_silent | 245 ns | 290 ns: 1.19x slower (+19%) |
+-------------------------+--------------------------+-------------------------------+
| logging_simple | 11.1 us | 13.6 us: 1.23x slower (+23%) |
+-------------------------+--------------------------+-------------------------------+
| mako | 26.6 ms | 29.2 ms: 1.10x slower (+10%) |
+-------------------------+--------------------------+-------------------------------+
| meteor_contest | 143 ms | 157 ms: 1.10x slower (+10%) |
+-------------------------+--------------------------+-------------------------------+
| nbody | 159 ms | 196 ms: 1.23x slower (+23%) |
+-------------------------+--------------------------+-------------------------------+
| nqueens | 130 ms | 158 ms: 1.22x slower (+22%) |
+-------------------------+--------------------------+-------------------------------+
| pathlib | 31.4 ms | 36.7 ms: 1.17x slower (+17%) |
+-------------------------+--------------------------+-------------------------------+
| pickle | 15.3 us | 16.3 us: 1.06x slower (+6%) |
+-------------------------+--------------------------+-------------------------------+
| pickle_dict | 45.8 us | 47.3 us: 1.03x slower (+3%) |
+-------------------------+--------------------------+-------------------------------+
| pickle_list | 5.83 us | 5.69 us: 1.02x faster (-2%) |
+-------------------------+--------------------------+-------------------------------+
| pickle_pure_python | 614 us | 740 us: 1.21x slower (+21%) |
+-------------------------+--------------------------+-------------------------------+
| pidigits | 234 ms | 227 ms: 1.03x faster (-3%) |
+-------------------------+--------------------------+-------------------------------+
| pyflate | 926 ms | 1.08 sec: 1.17x slower (+17%) |
+-------------------------+--------------------------+-------------------------------+
| python_startup | 10.7 ms | 11.3 ms: 1.05x slower (+5%) |
+-------------------------+--------------------------+-------------------------------+
| python_startup_no_site | 7.69 ms | 7.93 ms: 1.03x slower (+3%) |
+-------------------------+--------------------------+-------------------------------+
| raytrace | 643 ms | 825 ms: 1.28x slower (+28%) |
+-------------------------+--------------------------+-------------------------------+
| regex_compile | 243 ms | 285 ms: 1.17x slower (+17%) |
+-------------------------+--------------------------+-------------------------------+
| regex_dna | 274 ms | 255 ms: 1.07x faster (-7%) |
+-------------------------+--------------------------+-------------------------------+
| regex_effbot | 4.49 ms | 4.18 ms: 1.07x faster (-7%) |
+-------------------------+--------------------------+-------------------------------+
| regex_v8 | 32.4 ms | 34.2 ms: 1.05x slower (+5%) |
+-------------------------+--------------------------+-------------------------------+
| richards | 92.2 ms | 119 ms: 1.29x slower (+29%) |
+-------------------------+--------------------------+-------------------------------+
| scimark_fft | 459 ms | 544 ms: 1.18x slower (+18%) |
+-------------------------+--------------------------+-------------------------------+
| scimark_lu | 235 ms | 285 ms: 1.22x slower (+22%) |
+-------------------------+--------------------------+-------------------------------+
| scimark_monte_carlo | 138 ms | 169 ms: 1.23x slower (+23%) |
+-------------------------+--------------------------+-------------------------------+
| scimark_sor | 253 ms | 308 ms: 1.21x slower (+21%) |
+-------------------------+--------------------------+-------------------------------+
| scimark_sparse_mat_mult | 5.75 ms | 6.78 ms: 1.18x slower (+18%) |
+-------------------------+--------------------------+-------------------------------+
| spectral_norm | 180 ms | 207 ms: 1.15x slower (+15%) |
+-------------------------+--------------------------+-------------------------------+
| sqlalchemy_declarative | 244 ms | 275 ms: 1.13x slower (+13%) |
+-------------------------+--------------------------+-------------------------------+
| sqlalchemy_imperative | 42.1 ms | 45.6 ms: 1.08x slower (+8%) |
+-------------------------+--------------------------+-------------------------------+
| sqlite_synth | 4.32 us | 5.01 us: 1.16x slower (+16%) |
+-------------------------+--------------------------+-------------------------------+
| sympy_expand | 763 ms | 890 ms: 1.17x slower (+17%) |
+-------------------------+--------------------------+-------------------------------+
| sympy_integrate | 39.0 ms | 44.8 ms: 1.15x slower (+15%) |
+-------------------------+--------------------------+-------------------------------+
| sympy_sum | 325 ms | 362 ms: 1.11x slower (+11%) |
+-------------------------+--------------------------+-------------------------------+
| sympy_str | 498 ms | 570 ms: 1.14x slower (+14%) |
+-------------------------+--------------------------+-------------------------------+
| telco | 9.17 ms | 9.83 ms: 1.07x slower (+7%) |
+-------------------------+--------------------------+-------------------------------+
| tornado_http | 207 ms | 225 ms: 1.09x slower (+9%) |
+-------------------------+--------------------------+-------------------------------+
| unpack_sequence | 85.3 ns | 73.4 ns: 1.16x faster (-14%) |
+-------------------------+--------------------------+-------------------------------+
| unpickle | 18.1 us | 21.2 us: 1.17x slower (+17%) |
+-------------------------+--------------------------+-------------------------------+
| unpickle_list | 6.49 us | 6.20 us: 1.05x faster (-4%) |
+-------------------------+--------------------------+-------------------------------+
| unpickle_pure_python | 485 us | 575 us: 1.19x slower (+19%) |
+-------------------------+--------------------------+-------------------------------+
| xml_etree_parse | 225 ms | 234 ms: 1.04x slower (+4%) |
+-------------------------+--------------------------+-------------------------------+
| xml_etree_iterparse | 147 ms | 162 ms: 1.10x slower (+10%) |
+-------------------------+--------------------------+-------------------------------+
| xml_etree_generate | 141 ms | 167 ms: 1.18x slower (+18%) |
+-------------------------+--------------------------+-------------------------------+
| xml_etree_process | 114 ms | 134 ms: 1.17x slower (+17%) |
+-------------------------+--------------------------+-------------------------------+
Raw
3.7-buster.txt
+-------------------------+----------------------+------------------------------+
| Benchmark | 3.7-buster-optimized | 3.7-buster |
+=========================+======================+==============================+
| 2to3 | 426 ms | 473 ms: 1.11x slower (+11%) |
+-------------------------+----------------------+------------------------------+
| chameleon | 12.6 ms | 14.2 ms: 1.12x slower (+12%) |
+-------------------------+----------------------+------------------------------+
| chaos | 142 ms | 171 ms: 1.21x slower (+21%) |
+-------------------------+----------------------+------------------------------+
| crypto_pyaes | 138 ms | 167 ms: 1.21x slower (+21%) |
+-------------------------+----------------------+------------------------------+
| deltablue | 9.33 ms | 11.2 ms: 1.20x slower (+20%) |
+-------------------------+----------------------+------------------------------+
| django_template | 73.2 ms | 84.1 ms: 1.15x slower (+15%) |
+-------------------------+----------------------+------------------------------+
| dulwich_log | 81.3 ms | 94.0 ms: 1.16x slower (+16%) |
+-------------------------+----------------------+------------------------------+
| fannkuch | 627 ms | 708 ms: 1.13x slower (+13%) |
+-------------------------+----------------------+------------------------------+
| float | 152 ms | 173 ms: 1.13x slower (+13%) |
+-------------------------+----------------------+------------------------------+
| genshi_text | 41.3 ms | 45.5 ms: 1.10x slower (+10%) |
+-------------------------+----------------------+------------------------------+
| genshi_xml | 82.8 ms | 91.6 ms: 1.11x slower (+11%) |
+-------------------------+----------------------+------------------------------+
| go | 317 ms | 379 ms: 1.19x slower (+19%) |
+-------------------------+----------------------+------------------------------+
| hexiom | 12.9 ms | 15.6 ms: 1.21x slower (+21%) |
+-------------------------+----------------------+------------------------------+
| json_dumps | 17.1 ms | 18.1 ms: 1.05x slower (+5%) |
+-------------------------+----------------------+------------------------------+
| logging_format | 11.7 us | 14.3 us: 1.22x slower (+22%) |
+-------------------------+----------------------+------------------------------+
| logging_silent | 235 ns | 297 ns: 1.26x slower (+26%) |
+-------------------------+----------------------+------------------------------+
| logging_simple | 10.7 us | 13.0 us: 1.22x slower (+22%) |
+-------------------------+----------------------+------------------------------+
| mako | 23.8 ms | 26.7 ms: 1.12x slower (+12%) |
+-------------------------+----------------------+------------------------------+
| meteor_contest | 142 ms | 147 ms: 1.03x slower (+3%) |
+-------------------------+----------------------+------------------------------+
| nbody | 160 ms | 183 ms: 1.15x slower (+15%) |
+-------------------------+----------------------+------------------------------+
| nqueens | 127 ms | 151 ms: 1.19x slower (+19%) |
+-------------------------+----------------------+------------------------------+
| pathlib | 30.4 ms | 32.6 ms: 1.07x slower (+7%) |
+-------------------------+----------------------+------------------------------+
| pickle | 15.0 us | 15.8 us: 1.05x slower (+5%) |
+-------------------------+----------------------+------------------------------+
| pickle_dict | 44.3 us | 47.2 us: 1.07x slower (+7%) |
+-------------------------+----------------------+------------------------------+
| pickle_list | 5.60 us | 5.55 us: 1.01x faster (-1%) |
+-------------------------+----------------------+------------------------------+
| pickle_pure_python | 588 us | 700 us: 1.19x slower (+19%) |
+-------------------------+----------------------+------------------------------+
| pyflate | 889 ms | 995 ms: 1.12x slower (+12%) |
+-------------------------+----------------------+------------------------------+
| python_startup | 11.1 ms | 11.8 ms: 1.06x slower (+6%) |
+-------------------------+----------------------+------------------------------+
| python_startup_no_site | 7.91 ms | 8.37 ms: 1.06x slower (+6%) |
+-------------------------+----------------------+------------------------------+
| raytrace | 619 ms | 763 ms: 1.23x slower (+23%) |
+-------------------------+----------------------+------------------------------+
| regex_compile | 235 ms | 269 ms: 1.14x slower (+14%) |
+-------------------------+----------------------+------------------------------+
| regex_dna | 256 ms | 232 ms: 1.10x faster (-9%) |
+-------------------------+----------------------+------------------------------+
| regex_effbot | 4.25 ms | 4.01 ms: 1.06x faster (-6%) |
+-------------------------+----------------------+------------------------------+
| regex_v8 | 28.9 ms | 31.1 ms: 1.08x slower (+8%) |
+-------------------------+----------------------+------------------------------+
| richards | 89.2 ms | 110 ms: 1.24x slower (+24%) |
+-------------------------+----------------------+------------------------------+
| scimark_fft | 425 ms | 482 ms: 1.13x slower (+13%) |
+-------------------------+----------------------+------------------------------+
| scimark_lu | 225 ms | 264 ms: 1.17x slower (+17%) |
+-------------------------+----------------------+------------------------------+
| scimark_monte_carlo | 134 ms | 158 ms: 1.18x slower (+18%) |
+-------------------------+----------------------+------------------------------+
| scimark_sor | 237 ms | 294 ms: 1.24x slower (+24%) |
+-------------------------+----------------------+------------------------------+
| scimark_sparse_mat_mult | 5.57 ms | 6.17 ms: 1.11x slower (+11%) |
+-------------------------+----------------------+------------------------------+
| spectral_norm | 167 ms | 185 ms: 1.11x slower (+11%) |
+-------------------------+----------------------+------------------------------+
| sqlalchemy_declarative | 229 ms | 243 ms: 1.06x slower (+6%) |
+-------------------------+----------------------+------------------------------+
| sqlalchemy_imperative | 40.9 ms | 44.3 ms: 1.08x slower (+8%) |
+-------------------------+----------------------+------------------------------+
| sqlite_synth | 3.76 us | 4.29 us: 1.14x slower (+14%) |
+-------------------------+----------------------+------------------------------+
| sympy_expand | 750 ms | 850 ms: 1.13x slower (+13%) |
+-------------------------+----------------------+------------------------------+
| sympy_integrate | 37.9 ms | 42.6 ms: 1.12x slower (+12%) |
+-------------------------+----------------------+------------------------------+
| sympy_sum | 318 ms | 342 ms: 1.08x slower (+8%) |
+-------------------------+----------------------+------------------------------+
| sympy_str | 488 ms | 548 ms: 1.12x slower (+12%) |
+-------------------------+----------------------+------------------------------+
| telco | 7.75 ms | 8.76 ms: 1.13x slower (+13%) |
+-------------------------+----------------------+------------------------------+
| tornado_http | 210 ms | 227 ms: 1.08x slower (+8%) |
+-------------------------+----------------------+------------------------------+
| unpack_sequence | 65.2 ns | 64.4 ns: 1.01x faster (-1%) |
+-------------------------+----------------------+------------------------------+
| unpickle | 18.3 us | 20.8 us: 1.13x slower (+13%) |
+-------------------------+----------------------+------------------------------+
| unpickle_list | 5.25 us | 5.63 us: 1.07x slower (+7%) |
+-------------------------+----------------------+------------------------------+
| unpickle_pure_python | 456 us | 533 us: 1.17x slower (+17%) |
+-------------------------+----------------------+------------------------------+
| xml_etree_parse | 211 ms | 220 ms: 1.04x slower (+4%) |
+-------------------------+----------------------+------------------------------+
| xml_etree_iterparse | 141 ms | 154 ms: 1.09x slower (+9%) |
+-------------------------+----------------------+------------------------------+
| xml_etree_generate | 137 ms | 160 ms: 1.16x slower (+16%) |
+-------------------------+----------------------+------------------------------+
| xml_etree_process | 112 ms | 128 ms: 1.14x slower (+14%) |
+-------------------------+----------------------+------------------------------+
Raw
3.8-alpine3.12.txt
+-------------------------+--------------------------+-------------------------------+
| Benchmark | 3.8-alpine3.12-optimized | 3.8-alpine3.12 |
+=========================+==========================+===============================+
| 2to3 | 412 ms | 468 ms: 1.14x slower (+14%) |
+-------------------------+--------------------------+-------------------------------+
| chameleon | 12.4 ms | 14.2 ms: 1.14x slower (+14%) |
+-------------------------+--------------------------+-------------------------------+
| chaos | 139 ms | 175 ms: 1.26x slower (+26%) |
+-------------------------+--------------------------+-------------------------------+
| crypto_pyaes | 138 ms | 172 ms: 1.25x slower (+25%) |
+-------------------------+--------------------------+-------------------------------+
| deltablue | 9.02 ms | 11.1 ms: 1.23x slower (+23%) |
+-------------------------+--------------------------+-------------------------------+
| django_template | 60.7 ms | 74.3 ms: 1.22x slower (+22%) |
+-------------------------+--------------------------+-------------------------------+
| dulwich_log | 78.6 ms | 91.2 ms: 1.16x slower (+16%) |
+-------------------------+--------------------------+-------------------------------+
| fannkuch | 593 ms | 698 ms: 1.18x slower (+18%) |
+-------------------------+--------------------------+-------------------------------+
| float | 146 ms | 183 ms: 1.25x slower (+25%) |
+-------------------------+--------------------------+-------------------------------+
| genshi_text | 36.5 ms | 41.7 ms: 1.14x slower (+14%) |
+-------------------------+--------------------------+-------------------------------+
| genshi_xml | 76.2 ms | 87.0 ms: 1.14x slower (+14%) |
+-------------------------+--------------------------+-------------------------------+
| go | 314 ms | 383 ms: 1.22x slower (+22%) |
+-------------------------+--------------------------+-------------------------------+
| hexiom | 12.2 ms | 15.5 ms: 1.27x slower (+27%) |
+-------------------------+--------------------------+-------------------------------+
| json_dumps | 17.2 ms | 18.5 ms: 1.07x slower (+7%) |
+-------------------------+--------------------------+-------------------------------+
| json_loads | 38.8 us | 40.8 us: 1.05x slower (+5%) |
+-------------------------+--------------------------+-------------------------------+
| logging_format | 11.1 us | 14.2 us: 1.28x slower (+28%) |
+-------------------------+--------------------------+-------------------------------+
| logging_silent | 243 ns | 287 ns: 1.18x slower (+18%) |
+-------------------------+--------------------------+-------------------------------+
| logging_simple | 10.2 us | 13.0 us: 1.27x slower (+27%) |
+-------------------------+--------------------------+-------------------------------+
| mako | 21.3 ms | 24.4 ms: 1.15x slower (+15%) |
+-------------------------+--------------------------+-------------------------------+
| meteor_contest | 136 ms | 149 ms: 1.10x slower (+10%) |
+-------------------------+--------------------------+-------------------------------+
| nbody | 160 ms | 217 ms: 1.35x slower (+35%) |
+-------------------------+--------------------------+-------------------------------+
| nqueens | 124 ms | 151 ms: 1.22x slower (+22%) |
+-------------------------+--------------------------+-------------------------------+
| pathlib | 30.4 ms | 33.5 ms: 1.10x slower (+10%) |
+-------------------------+--------------------------+-------------------------------+
| pickle | 13.8 us | 14.2 us: 1.03x slower (+3%) |
+-------------------------+--------------------------+-------------------------------+
| pickle_dict | 35.4 us | 39.5 us: 1.12x slower (+12%) |
+-------------------------+--------------------------+-------------------------------+
| pickle_list | 5.83 us | 5.69 us: 1.02x faster (-2%) |
+-------------------------+--------------------------+-------------------------------+
| pickle_pure_python | 579 us | 696 us: 1.20x slower (+20%) |
+-------------------------+--------------------------+-------------------------------+
| pyflate | 908 ms | 1.11 sec: 1.22x slower (+22%) |
+-------------------------+--------------------------+-------------------------------+
| python_startup | 11.2 ms | 11.5 ms: 1.03x slower (+3%) |
+-------------------------+--------------------------+-------------------------------+
| python_startup_no_site | 7.55 ms | 8.01 ms: 1.06x slower (+6%) |
+-------------------------+--------------------------+-------------------------------+
| raytrace | 604 ms | 792 ms: 1.31x slower (+31%) |
+-------------------------+--------------------------+-------------------------------+
| regex_compile | 215 ms | 256 ms: 1.19x slower (+19%) |
+-------------------------+--------------------------+-------------------------------+
| regex_dna | 278 ms | 270 ms: 1.03x faster (-3%) |
+-------------------------+--------------------------+-------------------------------+
| regex_v8 | 29.6 ms | 31.1 ms: 1.05x slower (+5%) |
+-------------------------+--------------------------+-------------------------------+
| richards | 85.0 ms | 111 ms: 1.30x slower (+30%) |
+-------------------------+--------------------------+-------------------------------+
| scimark_fft | 440 ms | 560 ms: 1.27x slower (+27%) |
+-------------------------+--------------------------+-------------------------------+
| scimark_lu | 189 ms | 244 ms: 1.29x slower (+29%) |
+-------------------------+--------------------------+-------------------------------+
| scimark_monte_carlo | 130 ms | 160 ms: 1.23x slower (+23%) |
+-------------------------+--------------------------+-------------------------------+
| scimark_sor | 257 ms | 302 ms: 1.18x slower (+18%) |
+-------------------------+--------------------------+-------------------------------+
| scimark_sparse_mat_mult | 5.64 ms | 7.52 ms: 1.33x slower (+33%) |
+-------------------------+--------------------------+-------------------------------+
| spectral_norm | 174 ms | 208 ms: 1.20x slower (+20%) |
+-------------------------+--------------------------+-------------------------------+
| sqlalchemy_declarative | 226 ms | 246 ms: 1.09x slower (+9%) |
+-------------------------+--------------------------+-------------------------------+
| sqlalchemy_imperative | 33.8 ms | 37.3 ms: 1.10x slower (+10%) |
+-------------------------+--------------------------+-------------------------------+
| sqlite_synth | 4.21 us | 4.73 us: 1.12x slower (+12%) |
+-------------------------+--------------------------+-------------------------------+
| sympy_expand | 584 ms | 708 ms: 1.21x slower (+21%) |
+-------------------------+--------------------------+-------------------------------+
| sympy_integrate | 30.2 ms | 34.4 ms: 1.14x slower (+14%) |
+-------------------------+--------------------------+-------------------------------+
| sympy_sum | 268 ms | 302 ms: 1.13x slower (+13%) |
+-------------------------+--------------------------+-------------------------------+
| sympy_str | 396 ms | 460 ms: 1.16x slower (+16%) |
+-------------------------+--------------------------+-------------------------------+
| telco | 7.74 ms | 9.05 ms: 1.17x slower (+17%) |
+-------------------------+--------------------------+-------------------------------+
| tornado_http | 195 ms | 217 ms: 1.11x slower (+11%) |
+-------------------------+--------------------------+-------------------------------+
| unpack_sequence | 77.8 ns | 65.2 ns: 1.19x faster (-16%) |
+-------------------------+--------------------------+-------------------------------+
| unpickle | 18.2 us | 21.3 us: 1.17x slower (+17%) |
+-------------------------+--------------------------+-------------------------------+
| unpickle_list | 6.51 us | 5.63 us: 1.16x faster (-13%) |
+-------------------------+--------------------------+-------------------------------+
| unpickle_pure_python | 399 us | 506 us: 1.27x slower (+27%) |
+-------------------------+--------------------------+-------------------------------+
| xml_etree_parse | 220 ms | 217 ms: 1.02x faster (-2%) |
+-------------------------+--------------------------+-------------------------------+
| xml_etree_iterparse | 136 ms | 146 ms: 1.07x slower (+7%) |
+-------------------------+--------------------------+-------------------------------+
| xml_etree_generate | 122 ms | 143 ms: 1.17x slower (+17%) |
+-------------------------+--------------------------+-------------------------------+
| xml_etree_process | 96.2 ms | 113 ms: 1.17x slower (+17%) |
+-------------------------+--------------------------+-------------------------------+
Raw
3.8-buster.txt
+-------------------------+----------------------+-------------------------------+
| Benchmark | 3.8-buster-optimized | 3.8-buster |
+=========================+======================+===============================+
| 2to3 | 409 ms | 467 ms: 1.14x slower (+14%) |
+-------------------------+----------------------+-------------------------------+
| chameleon | 11.7 ms | 13.3 ms: 1.14x slower (+14%) |
+-------------------------+----------------------+-------------------------------+
| chaos | 150 ms | 171 ms: 1.14x slower (+14%) |
+-------------------------+----------------------+-------------------------------+
| crypto_pyaes | 136 ms | 170 ms: 1.26x slower (+26%) |
+-------------------------+----------------------+-------------------------------+
| deltablue | 8.91 ms | 11.3 ms: 1.27x slower (+27%) |
+-------------------------+----------------------+-------------------------------+
| django_template | 59.3 ms | 74.5 ms: 1.26x slower (+26%) |
+-------------------------+----------------------+-------------------------------+
| dulwich_log | 78.8 ms | 91.8 ms: 1.17x slower (+17%) |
+-------------------------+----------------------+-------------------------------+
| fannkuch | 579 ms | 671 ms: 1.16x slower (+16%) |
+-------------------------+----------------------+-------------------------------+
| float | 146 ms | 181 ms: 1.24x slower (+24%) |
+-------------------------+----------------------+-------------------------------+
| genshi_text | 36.1 ms | 42.0 ms: 1.16x slower (+16%) |
+-------------------------+----------------------+-------------------------------+
| genshi_xml | 74.3 ms | 85.7 ms: 1.15x slower (+15%) |
+-------------------------+----------------------+-------------------------------+
| go | 313 ms | 384 ms: 1.23x slower (+23%) |
+-------------------------+----------------------+-------------------------------+
| hexiom | 11.9 ms | 15.0 ms: 1.26x slower (+26%) |
+-------------------------+----------------------+-------------------------------+
| json_dumps | 16.5 ms | 17.8 ms: 1.08x slower (+8%) |
+-------------------------+----------------------+-------------------------------+
| json_loads | 36.4 us | 40.1 us: 1.10x slower (+10%) |
+-------------------------+----------------------+-------------------------------+
| logging_format | 11.1 us | 13.9 us: 1.25x slower (+25%) |
+-------------------------+----------------------+-------------------------------+
| logging_silent | 237 ns | 292 ns: 1.23x slower (+23%) |
+-------------------------+----------------------+-------------------------------+
| logging_simple | 10.1 us | 12.8 us: 1.26x slower (+26%) |
+-------------------------+----------------------+-------------------------------+
| mako | 20.5 ms | 24.5 ms: 1.20x slower (+20%) |
+-------------------------+----------------------+-------------------------------+
| meteor_contest | 138 ms | 144 ms: 1.05x slower (+5%) |
+-------------------------+----------------------+-------------------------------+
| nbody | 165 ms | 209 ms: 1.26x slower (+26%) |
+-------------------------+----------------------+-------------------------------+
| nqueens | 124 ms | 149 ms: 1.20x slower (+20%) |
+-------------------------+----------------------+-------------------------------+
| pathlib | 29.5 ms | 33.3 ms: 1.13x slower (+13%) |
+-------------------------+----------------------+-------------------------------+
| pickle | 13.5 us | 14.2 us: 1.05x slower (+5%) |
+-------------------------+----------------------+-------------------------------+
| pickle_dict | 35.1 us | 35.9 us: 1.02x slower (+2%) |
+-------------------------+----------------------+-------------------------------+
| pickle_list | 5.67 us | 5.60 us: 1.01x faster (-1%) |
+-------------------------+----------------------+-------------------------------+
| pickle_pure_python | 562 us | 693 us: 1.23x slower (+23%) |
+-------------------------+----------------------+-------------------------------+
| pyflate | 856 ms | 1.03 sec: 1.21x slower (+21%) |
+-------------------------+----------------------+-------------------------------+
| python_startup | 11.1 ms | 11.9 ms: 1.07x slower (+7%) |
+-------------------------+----------------------+-------------------------------+
| python_startup_no_site | 7.90 ms | 8.39 ms: 1.06x slower (+6%) |
+-------------------------+----------------------+-------------------------------+
| raytrace | 625 ms | 794 ms: 1.27x slower (+27%) |
+-------------------------+----------------------+-------------------------------+
| regex_compile | 215 ms | 256 ms: 1.19x slower (+19%) |
+-------------------------+----------------------+-------------------------------+
| regex_effbot | 4.20 ms | 4.31 ms: 1.03x slower (+3%) |
+-------------------------+----------------------+-------------------------------+
| regex_v8 | 29.1 ms | 32.0 ms: 1.10x slower (+10%) |
+-------------------------+----------------------+-------------------------------+
| richards | 84.2 ms | 110 ms: 1.31x slower (+31%) |
+-------------------------+----------------------+-------------------------------+
| scimark_fft | 437 ms | 541 ms: 1.24x slower (+24%) |
+-------------------------+----------------------+-------------------------------+
| scimark_lu | 188 ms | 235 ms: 1.25x slower (+25%) |
+-------------------------+----------------------+-------------------------------+
| scimark_monte_carlo | 128 ms | 160 ms: 1.25x slower (+25%) |
+-------------------------+----------------------+-------------------------------+
| scimark_sor | 244 ms | 297 ms: 1.22x slower (+22%) |
+-------------------------+----------------------+-------------------------------+
| scimark_sparse_mat_mult | 5.52 ms | 6.90 ms: 1.25x slower (+25%) |
+-------------------------+----------------------+-------------------------------+
| spectral_norm | 171 ms | 204 ms: 1.19x slower (+19%) |
+-------------------------+----------------------+-------------------------------+
| sqlalchemy_declarative | 210 ms | 229 ms: 1.09x slower (+9%) |
+-------------------------+----------------------+-------------------------------+
| sqlalchemy_imperative | 31.7 ms | 36.4 ms: 1.15x slower (+15%) |
+-------------------------+----------------------+-------------------------------+
| sqlite_synth | 3.81 us | 4.28 us: 1.12x slower (+12%) |
+-------------------------+----------------------+-------------------------------+
| sympy_expand | 571 ms | 684 ms: 1.20x slower (+20%) |
+-------------------------+----------------------+-------------------------------+
| sympy_integrate | 29.5 ms | 33.7 ms: 1.14x slower (+14%) |
+-------------------------+----------------------+-------------------------------+
| sympy_sum | 259 ms | 307 ms: 1.18x slower (+18%) |
+-------------------------+----------------------+-------------------------------+
| sympy_str | 385 ms | 456 ms: 1.18x slower (+18%) |
+-------------------------+----------------------+-------------------------------+
| telco | 7.35 ms | 8.19 ms: 1.11x slower (+11%) |
+-------------------------+----------------------+-------------------------------+
| tornado_http | 201 ms | 219 ms: 1.09x slower (+9%) |
+-------------------------+----------------------+-------------------------------+
| unpack_sequence | 76.6 ns | 70.2 ns: 1.09x faster (-8%) |
+-------------------------+----------------------+-------------------------------+
| unpickle | 18.1 us | 21.4 us: 1.18x slower (+18%) |
+-------------------------+----------------------+-------------------------------+
| unpickle_list | 5.01 us | 5.44 us: 1.09x slower (+9%) |
+-------------------------+----------------------+-------------------------------+
| unpickle_pure_python | 400 us | 479 us: 1.20x slower (+20%) |
+-------------------------+----------------------+-------------------------------+
| xml_etree_parse | 192 ms | 207 ms: 1.08x slower (+8%) |
+-------------------------+----------------------+-------------------------------+
| xml_etree_iterparse | 129 ms | 144 ms: 1.12x slower (+12%) |
+-------------------------+----------------------+-------------------------------+
| xml_etree_generate | 120 ms | 144 ms: 1.20x slower (+20%) |
+-------------------------+----------------------+-------------------------------+
| xml_etree_process | 104 ms | 114 ms: 1.10x slower (+10%) |
+-------------------------+----------------------+-------------------------------+
Raw
runner.sh
#!/usr/bin/env bash
set -eux
run_test() {
VERSION=$1
OS=$2
TEST_ID=${VERSION}-${OS}-optimized
docker build -t semantic:${TEST_ID} -f ${VERSION}/${OS}/Dockerfile .
docker run -it -e TEST_ID=${TEST_ID} -v `pwd`:/app semantic:${TEST_ID} /app/test.sh
TEST2_ID=${VERSION}-${OS}
docker run -it -e TEST_ID=${TEST2_ID} -v `pwd`:/app python:${TEST2_ID} /app/test.sh
#pyperf compare_to ${TEST2_ID}* --table > ${TEST2_ID}.txt
}
run_test 3.8 alpine3.12
run_test 3.8 buster
run_test 3.7 alpine3.12
run_test 3.7 buster
run_test 3.6 alpine3.12
run_test 3.6 buster
Raw
test.sh
#!/usr/bin/env sh
set -eux
pip install pyperformance
python3 -m pyperf system tune || true
pyperformance run -r -o /app/${TEST_ID}.json
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment