Skip to content

Instantly share code, notes, and snippets.

@gnprice
Last active April 2, 2020 04:55
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
Star You must be signed in to star a gist
Save gnprice/e218f23d97e19a9dd1a15fe27bc61b5f to your computer and use it in GitHub Desktop.
Python benchmarks for nixpkgs
These are benchmark results from the "pyperformance" benchmark suite:
https://pyperformance.readthedocs.io/
on CPython built with various options for optimization.
For context, including the specific optimizations involved, see:
https://github.com/NixOS/nixpkgs/pull/84072
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| Benchmark | py37-nix | py37-nix.pgo.58d476e6c | py37-nix.pgo-linkopt.a74fa3abc | py37-deb |
+=========================+==========+==============================+================================+==============================+
| 2to3 | 383 ms | 334 ms: 1.15x faster (-13%) | 314 ms: 1.22x faster (-18%) | 278 ms: 1.38x faster (-27%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| chameleon | 11.8 ms | 9.74 ms: 1.21x faster (-17%) | 9.28 ms: 1.27x faster (-21%) | 7.91 ms: 1.49x faster (-33%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| chaos | 149 ms | 120 ms: 1.24x faster (-19%) | 113 ms: 1.31x faster (-24%) | 93.5 ms: 1.59x faster (-37%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| crypto_pyaes | 130 ms | 113 ms: 1.15x faster (-13%) | 107 ms: 1.21x faster (-17%) | 95.5 ms: 1.36x faster (-27%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| deltablue | 10.1 ms | 7.79 ms: 1.30x faster (-23%) | 7.23 ms: 1.40x faster (-28%) | 5.95 ms: 1.70x faster (-41%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| django_template | 77.4 ms | 61.5 ms: 1.26x faster (-21%) | 57.2 ms: 1.35x faster (-26%) | 49.0 ms: 1.58x faster (-37%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| dulwich_log | 83.8 ms | 72.7 ms: 1.15x faster (-13%) | 66.4 ms: 1.26x faster (-21%) | 63.2 ms: 1.33x faster (-25%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| fannkuch | 548 ms | 503 ms: 1.09x faster (-8%) | 479 ms: 1.14x faster (-13%) | 382 ms: 1.43x faster (-30%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| float | 133 ms | 116 ms: 1.14x faster (-13%) | 113 ms: 1.18x faster (-15%) | 89.0 ms: 1.50x faster (-33%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| genshi_text | 37.2 ms | 30.8 ms: 1.21x faster (-17%) | 29.1 ms: 1.28x faster (-22%) | 25.6 ms: 1.46x faster (-31%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| genshi_xml | 79.0 ms | 64.9 ms: 1.22x faster (-18%) | 60.2 ms: 1.31x faster (-24%) | 53.2 ms: 1.48x faster (-33%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| go | 337 ms | 269 ms: 1.25x faster (-20%) | 247 ms: 1.37x faster (-27%) | 207 ms: 1.63x faster (-39%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| hexiom | 13.0 ms | 11.0 ms: 1.18x faster (-15%) | 10.0 ms: 1.30x faster (-23%) | 8.05 ms: 1.62x faster (-38%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| json_dumps | 14.4 ms | 11.8 ms: 1.22x faster (-18%) | 11.4 ms: 1.27x faster (-21%) | 10.8 ms: 1.34x faster (-25%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| json_loads | 28.5 us | 25.2 us: 1.13x faster (-12%) | 23.7 us: 1.20x faster (-17%) | 22.0 us: 1.29x faster (-23%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| logging_format | 13.7 us | 11.4 us: 1.20x faster (-17%) | 10.1 us: 1.36x faster (-26%) | 8.48 us: 1.61x faster (-38%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| logging_silent | 232 ns | 196 ns: 1.19x faster (-16%) | 187 ns: 1.24x faster (-19%) | 155 ns: 1.49x faster (-33%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| logging_simple | 12.2 us | 10.2 us: 1.20x faster (-16%) | 9.19 us: 1.33x faster (-25%) | 7.74 us: 1.58x faster (-37%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| mako | 23.3 ms | 17.9 ms: 1.30x faster (-23%) | 17.1 ms: 1.37x faster (-27%) | 14.8 ms: 1.58x faster (-37%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| meteor_contest | 113 ms | 100 ms: 1.13x faster (-11%) | 99.0 ms: 1.14x faster (-13%) | 88.4 ms: 1.28x faster (-22%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| nbody | 138 ms | 123 ms: 1.12x faster (-11%) | 117 ms: 1.18x faster (-15%) | 102 ms: 1.35x faster (-26%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| nqueens | 117 ms | 105 ms: 1.12x faster (-11%) | 97.4 ms: 1.21x faster (-17%) | 80.5 ms: 1.46x faster (-31%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| pathlib | 23.4 ms | 20.1 ms: 1.16x faster (-14%) | 18.7 ms: 1.25x faster (-20%) | 18.0 ms: 1.30x faster (-23%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| pickle | 13.2 us | 8.85 us: 1.49x faster (-33%) | 8.77 us: 1.51x faster (-34%) | 8.46 us: 1.56x faster (-36%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| pickle_dict | 39.9 us | 26.1 us: 1.53x faster (-35%) | 27.2 us: 1.46x faster (-32%) | 22.9 us: 1.74x faster (-43%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| pickle_list | 4.97 us | 3.35 us: 1.48x faster (-33%) | 3.27 us: 1.52x faster (-34%) | 2.95 us: 1.69x faster (-41%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| pickle_pure_python | 600 us | 483 us: 1.24x faster (-20%) | 455 us: 1.32x faster (-24%) | 382 us: 1.57x faster (-36%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| pidigits | 173 ms | 153 ms: 1.13x faster (-11%) | 155 ms: 1.12x faster (-10%) | 156 ms: 1.11x faster (-10%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| pyflate | 832 ms | 668 ms: 1.25x faster (-20%) | 640 ms: 1.30x faster (-23%) | 548 ms: 1.52x faster (-34%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| python_startup | 10.3 ms | 9.63 ms: 1.07x faster (-7%) | 9.21 ms: 1.12x faster (-11%) | 8.21 ms: 1.26x faster (-20%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| python_startup_no_site | 7.75 ms | 7.28 ms: 1.06x faster (-6%) | 6.76 ms: 1.15x faster (-13%) | 5.75 ms: 1.35x faster (-26%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| raytrace | 678 ms | 536 ms: 1.26x faster (-21%) | 492 ms: 1.38x faster (-27%) | 403 ms: 1.68x faster (-40%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| regex_compile | 225 ms | 194 ms: 1.16x faster (-14%) | 180 ms: 1.25x faster (-20%) | 156 ms: 1.44x faster (-31%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| regex_dna | 165 ms | 159 ms: 1.04x faster (-4%) | 161 ms: 1.02x faster (-2%) | 147 ms: 1.13x faster (-11%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| regex_effbot | 2.90 ms | 2.55 ms: 1.13x faster (-12%) | 2.56 ms: 1.13x faster (-12%) | 2.67 ms: 1.08x faster (-8%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| regex_v8 | 23.3 ms | 20.4 ms: 1.14x faster (-12%) | 20.5 ms: 1.13x faster (-12%) | 18.4 ms: 1.27x faster (-21%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| richards | 101 ms | 77.3 ms: 1.30x faster (-23%) | 72.4 ms: 1.39x faster (-28%) | 57.2 ms: 1.76x faster (-43%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| scimark_fft | 390 ms | 338 ms: 1.15x faster (-13%) | 319 ms: 1.22x faster (-18%) | 272 ms: 1.44x faster (-30%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| scimark_lu | 227 ms | 189 ms: 1.20x faster (-17%) | 178 ms: 1.28x faster (-22%) | 139 ms: 1.63x faster (-39%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| scimark_monte_carlo | 134 ms | 111 ms: 1.20x faster (-17%) | 101 ms: 1.33x faster (-25%) | 85.1 ms: 1.57x faster (-36%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| scimark_sor | 243 ms | 199 ms: 1.22x faster (-18%) | 187 ms: 1.30x faster (-23%) | 150 ms: 1.63x faster (-39%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| scimark_sparse_mat_mult | 4.52 ms | 4.27 ms: 1.06x faster (-6%) | 4.06 ms: 1.11x faster (-10%) | 3.28 ms: 1.38x faster (-27%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| spectral_norm | 146 ms | 130 ms: 1.13x faster (-11%) | 124 ms: 1.18x faster (-15%) | 107 ms: 1.37x faster (-27%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| sqlalchemy_declarative | 188 ms | 172 ms: 1.09x faster (-9%) | 159 ms: 1.18x faster (-16%) | 156 ms: 1.21x faster (-17%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| sqlalchemy_imperative | 39.6 ms | 34.9 ms: 1.13x faster (-12%) | 33.1 ms: 1.20x faster (-16%) | 29.6 ms: 1.33x faster (-25%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| sqlite_synth | 3.33 us | 3.03 us: 1.10x faster (-9%) | 2.59 us: 1.29x faster (-22%) | 2.52 us: 1.32x faster (-24%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| sympy_expand | 734 ms | 610 ms: 1.20x faster (-17%) | 570 ms: 1.29x faster (-22%) | 423 ms: 1.74x faster (-42%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| sympy_integrate | 35.2 ms | 30.3 ms: 1.16x faster (-14%) | 28.8 ms: 1.22x faster (-18%) | 23.2 ms: 1.51x faster (-34%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| sympy_sum | 282 ms | 248 ms: 1.14x faster (-12%) | 237 ms: 1.19x faster (-16%) | 200 ms: 1.41x faster (-29%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| sympy_str | 457 ms | 398 ms: 1.15x faster (-13%) | 373 ms: 1.23x faster (-18%) | 298 ms: 1.53x faster (-35%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| telco | 7.27 ms | 6.02 ms: 1.21x faster (-17%) | 5.50 ms: 1.32x faster (-24%) | 5.54 ms: 1.31x faster (-24%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| tornado_http | 184 ms | 166 ms: 1.11x faster (-10%) | 154 ms: 1.20x faster (-17%) | 147 ms: 1.26x faster (-21%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| unpack_sequence | 47.8 ns | 43.4 ns: 1.10x faster (-9%) | 42.8 ns: 1.12x faster (-11%) | 43.3 ns: 1.11x faster (-10%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| unpickle | 16.0 us | 12.9 us: 1.25x faster (-20%) | 12.6 us: 1.28x faster (-22%) | 11.2 us: 1.44x faster (-30%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| unpickle_list | 4.25 us | 4.13 us: 1.03x faster (-3%) | 4.01 us: 1.06x faster (-6%) | 3.12 us: 1.36x faster (-26%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| unpickle_pure_python | 480 us | 395 us: 1.21x faster (-18%) | 361 us: 1.33x faster (-25%) | 304 us: 1.58x faster (-37%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| xml_etree_parse | 146 ms | 130 ms: 1.12x faster (-11%) | 127 ms: 1.15x faster (-13%) | 125 ms: 1.17x faster (-14%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| xml_etree_iterparse | 114 ms | 99.6 ms: 1.14x faster (-13%) | 96.2 ms: 1.19x faster (-16%) | 87.7 ms: 1.30x faster (-23%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| xml_etree_generate | 131 ms | 108 ms: 1.21x faster (-17%) | 99.2 ms: 1.32x faster (-24%) | 84.7 ms: 1.54x faster (-35%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| xml_etree_process | 111 ms | 87.7 ms: 1.27x faster (-21%) | 81.4 ms: 1.37x faster (-27%) | 70.2 ms: 1.59x faster (-37%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
+-------------------------+----------+------------------------------+
| Benchmark | py37-nix | py37-nix.pgo.58d476e6c |
+=========================+==========+==============================+
| pickle_dict | 39.9 us | 26.1 us: 1.53x faster (-35%) |
+-------------------------+----------+------------------------------+
| pickle | 13.2 us | 8.85 us: 1.49x faster (-33%) |
+-------------------------+----------+------------------------------+
| pickle_list | 4.97 us | 3.35 us: 1.48x faster (-33%) |
+-------------------------+----------+------------------------------+
| mako | 23.3 ms | 17.9 ms: 1.30x faster (-23%) |
+-------------------------+----------+------------------------------+
| richards | 101 ms | 77.3 ms: 1.30x faster (-23%) |
+-------------------------+----------+------------------------------+
| deltablue | 10.1 ms | 7.79 ms: 1.30x faster (-23%) |
+-------------------------+----------+------------------------------+
| xml_etree_process | 111 ms | 87.7 ms: 1.27x faster (-21%) |
+-------------------------+----------+------------------------------+
| raytrace | 678 ms | 536 ms: 1.26x faster (-21%) |
+-------------------------+----------+------------------------------+
| django_template | 77.4 ms | 61.5 ms: 1.26x faster (-21%) |
+-------------------------+----------+------------------------------+
| go | 337 ms | 269 ms: 1.25x faster (-20%) |
+-------------------------+----------+------------------------------+
| unpickle | 16.0 us | 12.9 us: 1.25x faster (-20%) |
+-------------------------+----------+------------------------------+
| pyflate | 832 ms | 668 ms: 1.25x faster (-20%) |
+-------------------------+----------+------------------------------+
| pickle_pure_python | 600 us | 483 us: 1.24x faster (-20%) |
+-------------------------+----------+------------------------------+
| chaos | 149 ms | 120 ms: 1.24x faster (-19%) |
+-------------------------+----------+------------------------------+
| json_dumps | 14.4 ms | 11.8 ms: 1.22x faster (-18%) |
+-------------------------+----------+------------------------------+
| scimark_sor | 243 ms | 199 ms: 1.22x faster (-18%) |
+-------------------------+----------+------------------------------+
| genshi_xml | 79.0 ms | 64.9 ms: 1.22x faster (-18%) |
+-------------------------+----------+------------------------------+
| unpickle_pure_python | 480 us | 395 us: 1.21x faster (-18%) |
+-------------------------+----------+------------------------------+
| chameleon | 11.8 ms | 9.74 ms: 1.21x faster (-17%) |
+-------------------------+----------+------------------------------+
| genshi_text | 37.2 ms | 30.8 ms: 1.21x faster (-17%) |
+-------------------------+----------+------------------------------+
| xml_etree_generate | 131 ms | 108 ms: 1.21x faster (-17%) |
+-------------------------+----------+------------------------------+
| telco | 7.27 ms | 6.02 ms: 1.21x faster (-17%) |
+-------------------------+----------+------------------------------+
| sympy_expand | 734 ms | 610 ms: 1.20x faster (-17%) |
+-------------------------+----------+------------------------------+
| scimark_lu | 227 ms | 189 ms: 1.20x faster (-17%) |
+-------------------------+----------+------------------------------+
| scimark_monte_carlo | 134 ms | 111 ms: 1.20x faster (-17%) |
+-------------------------+----------+------------------------------+
| logging_format | 13.7 us | 11.4 us: 1.20x faster (-17%) |
+-------------------------+----------+------------------------------+
| logging_simple | 12.2 us | 10.2 us: 1.20x faster (-16%) |
+-------------------------+----------+------------------------------+
| logging_silent | 232 ns | 196 ns: 1.19x faster (-16%) |
+-------------------------+----------+------------------------------+
| hexiom | 13.0 ms | 11.0 ms: 1.18x faster (-15%) |
+-------------------------+----------+------------------------------+
| pathlib | 23.4 ms | 20.1 ms: 1.16x faster (-14%) |
+-------------------------+----------+------------------------------+
| regex_compile | 225 ms | 194 ms: 1.16x faster (-14%) |
+-------------------------+----------+------------------------------+
| sympy_integrate | 35.2 ms | 30.3 ms: 1.16x faster (-14%) |
+-------------------------+----------+------------------------------+
| scimark_fft | 390 ms | 338 ms: 1.15x faster (-13%) |
+-------------------------+----------+------------------------------+
| dulwich_log | 83.8 ms | 72.7 ms: 1.15x faster (-13%) |
+-------------------------+----------+------------------------------+
| crypto_pyaes | 130 ms | 113 ms: 1.15x faster (-13%) |
+-------------------------+----------+------------------------------+
| sympy_str | 457 ms | 398 ms: 1.15x faster (-13%) |
+-------------------------+----------+------------------------------+
| 2to3 | 383 ms | 334 ms: 1.15x faster (-13%) |
+-------------------------+----------+------------------------------+
| float | 133 ms | 116 ms: 1.14x faster (-13%) |
+-------------------------+----------+------------------------------+
| xml_etree_iterparse | 114 ms | 99.6 ms: 1.14x faster (-13%) |
+-------------------------+----------+------------------------------+
| regex_v8 | 23.3 ms | 20.4 ms: 1.14x faster (-12%) |
+-------------------------+----------+------------------------------+
| sympy_sum | 282 ms | 248 ms: 1.14x faster (-12%) |
+-------------------------+----------+------------------------------+
| regex_effbot | 2.90 ms | 2.55 ms: 1.13x faster (-12%) |
+-------------------------+----------+------------------------------+
| sqlalchemy_imperative | 39.6 ms | 34.9 ms: 1.13x faster (-12%) |
+-------------------------+----------+------------------------------+
| json_loads | 28.5 us | 25.2 us: 1.13x faster (-12%) |
+-------------------------+----------+------------------------------+
| spectral_norm | 146 ms | 130 ms: 1.13x faster (-11%) |
+-------------------------+----------+------------------------------+
| pidigits | 173 ms | 153 ms: 1.13x faster (-11%) |
+-------------------------+----------+------------------------------+
| meteor_contest | 113 ms | 100 ms: 1.13x faster (-11%) |
+-------------------------+----------+------------------------------+
| xml_etree_parse | 146 ms | 130 ms: 1.12x faster (-11%) |
+-------------------------+----------+------------------------------+
| nbody | 138 ms | 123 ms: 1.12x faster (-11%) |
+-------------------------+----------+------------------------------+
| nqueens | 117 ms | 105 ms: 1.12x faster (-11%) |
+-------------------------+----------+------------------------------+
| tornado_http | 184 ms | 166 ms: 1.11x faster (-10%) |
+-------------------------+----------+------------------------------+
| unpack_sequence | 47.8 ns | 43.4 ns: 1.10x faster (-9%) |
+-------------------------+----------+------------------------------+
| sqlite_synth | 3.33 us | 3.03 us: 1.10x faster (-9%) |
+-------------------------+----------+------------------------------+
| sqlalchemy_declarative | 188 ms | 172 ms: 1.09x faster (-9%) |
+-------------------------+----------+------------------------------+
| fannkuch | 548 ms | 503 ms: 1.09x faster (-8%) |
+-------------------------+----------+------------------------------+
| python_startup | 10.3 ms | 9.63 ms: 1.07x faster (-7%) |
+-------------------------+----------+------------------------------+
| python_startup_no_site | 7.75 ms | 7.28 ms: 1.06x faster (-6%) |
+-------------------------+----------+------------------------------+
| scimark_sparse_mat_mult | 4.52 ms | 4.27 ms: 1.06x faster (-6%) |
+-------------------------+----------+------------------------------+
| regex_dna | 165 ms | 159 ms: 1.04x faster (-4%) |
+-------------------------+----------+------------------------------+
| unpickle_list | 4.25 us | 4.13 us: 1.03x faster (-3%) |
+-------------------------+----------+------------------------------+
+-------------------------+----------+--------------------------------+
| Benchmark | py37-nix | py37-nix.pgo-linkopt.a74fa3abc |
+=========================+==========+================================+
| pickle_list | 4.97 us | 3.27 us: 1.52x faster (-34%) |
+-------------------------+----------+--------------------------------+
| pickle | 13.2 us | 8.77 us: 1.51x faster (-34%) |
+-------------------------+----------+--------------------------------+
| pickle_dict | 39.9 us | 27.2 us: 1.46x faster (-32%) |
+-------------------------+----------+--------------------------------+
| deltablue | 10.1 ms | 7.23 ms: 1.40x faster (-28%) |
+-------------------------+----------+--------------------------------+
| richards | 101 ms | 72.4 ms: 1.39x faster (-28%) |
+-------------------------+----------+--------------------------------+
| raytrace | 678 ms | 492 ms: 1.38x faster (-27%) |
+-------------------------+----------+--------------------------------+
| xml_etree_process | 111 ms | 81.4 ms: 1.37x faster (-27%) |
+-------------------------+----------+--------------------------------+
| mako | 23.3 ms | 17.1 ms: 1.37x faster (-27%) |
+-------------------------+----------+--------------------------------+
| go | 337 ms | 247 ms: 1.37x faster (-27%) |
+-------------------------+----------+--------------------------------+
| logging_format | 13.7 us | 10.1 us: 1.36x faster (-26%) |
+-------------------------+----------+--------------------------------+
| django_template | 77.4 ms | 57.2 ms: 1.35x faster (-26%) |
+-------------------------+----------+--------------------------------+
| logging_simple | 12.2 us | 9.19 us: 1.33x faster (-25%) |
+-------------------------+----------+--------------------------------+
| scimark_monte_carlo | 134 ms | 101 ms: 1.33x faster (-25%) |
+-------------------------+----------+--------------------------------+
| unpickle_pure_python | 480 us | 361 us: 1.33x faster (-25%) |
+-------------------------+----------+--------------------------------+
| telco | 7.27 ms | 5.50 ms: 1.32x faster (-24%) |
+-------------------------+----------+--------------------------------+
| pickle_pure_python | 600 us | 455 us: 1.32x faster (-24%) |
+-------------------------+----------+--------------------------------+
| xml_etree_generate | 131 ms | 99.2 ms: 1.32x faster (-24%) |
+-------------------------+----------+--------------------------------+
| chaos | 149 ms | 113 ms: 1.31x faster (-24%) |
+-------------------------+----------+--------------------------------+
| genshi_xml | 79.0 ms | 60.2 ms: 1.31x faster (-24%) |
+-------------------------+----------+--------------------------------+
| hexiom | 13.0 ms | 10.0 ms: 1.30x faster (-23%) |
+-------------------------+----------+--------------------------------+
| pyflate | 832 ms | 640 ms: 1.30x faster (-23%) |
+-------------------------+----------+--------------------------------+
| scimark_sor | 243 ms | 187 ms: 1.30x faster (-23%) |
+-------------------------+----------+--------------------------------+
| sympy_expand | 734 ms | 570 ms: 1.29x faster (-22%) |
+-------------------------+----------+--------------------------------+
| sqlite_synth | 3.33 us | 2.59 us: 1.29x faster (-22%) |
+-------------------------+----------+--------------------------------+
| genshi_text | 37.2 ms | 29.1 ms: 1.28x faster (-22%) |
+-------------------------+----------+--------------------------------+
| scimark_lu | 227 ms | 178 ms: 1.28x faster (-22%) |
+-------------------------+----------+--------------------------------+
| unpickle | 16.0 us | 12.6 us: 1.28x faster (-22%) |
+-------------------------+----------+--------------------------------+
| chameleon | 11.8 ms | 9.28 ms: 1.27x faster (-21%) |
+-------------------------+----------+--------------------------------+
| json_dumps | 14.4 ms | 11.4 ms: 1.27x faster (-21%) |
+-------------------------+----------+--------------------------------+
| dulwich_log | 83.8 ms | 66.4 ms: 1.26x faster (-21%) |
+-------------------------+----------+--------------------------------+
| pathlib | 23.4 ms | 18.7 ms: 1.25x faster (-20%) |
+-------------------------+----------+--------------------------------+
| regex_compile | 225 ms | 180 ms: 1.25x faster (-20%) |
+-------------------------+----------+--------------------------------+
| logging_silent | 232 ns | 187 ns: 1.24x faster (-19%) |
+-------------------------+----------+--------------------------------+
| sympy_str | 457 ms | 373 ms: 1.23x faster (-18%) |
+-------------------------+----------+--------------------------------+
| sympy_integrate | 35.2 ms | 28.8 ms: 1.22x faster (-18%) |
+-------------------------+----------+--------------------------------+
| 2to3 | 383 ms | 314 ms: 1.22x faster (-18%) |
+-------------------------+----------+--------------------------------+
| scimark_fft | 390 ms | 319 ms: 1.22x faster (-18%) |
+-------------------------+----------+--------------------------------+
| crypto_pyaes | 130 ms | 107 ms: 1.21x faster (-17%) |
+-------------------------+----------+--------------------------------+
| nqueens | 117 ms | 97.4 ms: 1.21x faster (-17%) |
+-------------------------+----------+--------------------------------+
| json_loads | 28.5 us | 23.7 us: 1.20x faster (-17%) |
+-------------------------+----------+--------------------------------+
| tornado_http | 184 ms | 154 ms: 1.20x faster (-17%) |
+-------------------------+----------+--------------------------------+
| sqlalchemy_imperative | 39.6 ms | 33.1 ms: 1.20x faster (-16%) |
+-------------------------+----------+--------------------------------+
| sympy_sum | 282 ms | 237 ms: 1.19x faster (-16%) |
+-------------------------+----------+--------------------------------+
| xml_etree_iterparse | 114 ms | 96.2 ms: 1.19x faster (-16%) |
+-------------------------+----------+--------------------------------+
| sqlalchemy_declarative | 188 ms | 159 ms: 1.18x faster (-16%) |
+-------------------------+----------+--------------------------------+
| nbody | 138 ms | 117 ms: 1.18x faster (-15%) |
+-------------------------+----------+--------------------------------+
| spectral_norm | 146 ms | 124 ms: 1.18x faster (-15%) |
+-------------------------+----------+--------------------------------+
| float | 133 ms | 113 ms: 1.18x faster (-15%) |
+-------------------------+----------+--------------------------------+
| xml_etree_parse | 146 ms | 127 ms: 1.15x faster (-13%) |
+-------------------------+----------+--------------------------------+
| python_startup_no_site | 7.75 ms | 6.76 ms: 1.15x faster (-13%) |
+-------------------------+----------+--------------------------------+
| fannkuch | 548 ms | 479 ms: 1.14x faster (-13%) |
+-------------------------+----------+--------------------------------+
| meteor_contest | 113 ms | 99.0 ms: 1.14x faster (-13%) |
+-------------------------+----------+--------------------------------+
| regex_v8 | 23.3 ms | 20.5 ms: 1.13x faster (-12%) |
+-------------------------+----------+--------------------------------+
| regex_effbot | 2.90 ms | 2.56 ms: 1.13x faster (-12%) |
+-------------------------+----------+--------------------------------+
| python_startup | 10.3 ms | 9.21 ms: 1.12x faster (-11%) |
+-------------------------+----------+--------------------------------+
| unpack_sequence | 47.8 ns | 42.8 ns: 1.12x faster (-11%) |
+-------------------------+----------+--------------------------------+
| pidigits | 173 ms | 155 ms: 1.12x faster (-10%) |
+-------------------------+----------+--------------------------------+
| scimark_sparse_mat_mult | 4.52 ms | 4.06 ms: 1.11x faster (-10%) |
+-------------------------+----------+--------------------------------+
| unpickle_list | 4.25 us | 4.01 us: 1.06x faster (-6%) |
+-------------------------+----------+--------------------------------+
| regex_dna | 165 ms | 161 ms: 1.02x faster (-2%) |
+-------------------------+----------+--------------------------------+
+-------------------------+--------------------------------+------------------------------+
| Benchmark | py37-nix.pgo-linkopt.a74fa3abc | py37-deb |
+=========================+================================+==============================+
| sympy_expand | 570 ms | 423 ms: 1.35x faster (-26%) |
+-------------------------+--------------------------------+------------------------------+
| unpickle_list | 4.01 us | 3.12 us: 1.28x faster (-22%) |
+-------------------------+--------------------------------+------------------------------+
| scimark_lu | 178 ms | 139 ms: 1.28x faster (-22%) |
+-------------------------+--------------------------------+------------------------------+
| float | 113 ms | 89.0 ms: 1.27x faster (-21%) |
+-------------------------+--------------------------------+------------------------------+
| richards | 72.4 ms | 57.2 ms: 1.27x faster (-21%) |
+-------------------------+--------------------------------+------------------------------+
| scimark_sor | 187 ms | 150 ms: 1.25x faster (-20%) |
+-------------------------+--------------------------------+------------------------------+
| fannkuch | 479 ms | 382 ms: 1.25x faster (-20%) |
+-------------------------+--------------------------------+------------------------------+
| sympy_str | 373 ms | 298 ms: 1.25x faster (-20%) |
+-------------------------+--------------------------------+------------------------------+
| hexiom | 10.0 ms | 8.05 ms: 1.24x faster (-20%) |
+-------------------------+--------------------------------+------------------------------+
| scimark_sparse_mat_mult | 4.06 ms | 3.28 ms: 1.24x faster (-19%) |
+-------------------------+--------------------------------+------------------------------+
| sympy_integrate | 28.8 ms | 23.2 ms: 1.24x faster (-19%) |
+-------------------------+--------------------------------+------------------------------+
| raytrace | 492 ms | 403 ms: 1.22x faster (-18%) |
+-------------------------+--------------------------------+------------------------------+
| deltablue | 7.23 ms | 5.95 ms: 1.21x faster (-18%) |
+-------------------------+--------------------------------+------------------------------+
| chaos | 113 ms | 93.5 ms: 1.21x faster (-17%) |
+-------------------------+--------------------------------+------------------------------+
| nqueens | 97.4 ms | 80.5 ms: 1.21x faster (-17%) |
+-------------------------+--------------------------------+------------------------------+
| logging_silent | 187 ns | 155 ns: 1.21x faster (-17%) |
+-------------------------+--------------------------------+------------------------------+
| go | 247 ms | 207 ms: 1.19x faster (-16%) |
+-------------------------+--------------------------------+------------------------------+
| pickle_pure_python | 455 us | 382 us: 1.19x faster (-16%) |
+-------------------------+--------------------------------+------------------------------+
| unpickle_pure_python | 361 us | 304 us: 1.19x faster (-16%) |
+-------------------------+--------------------------------+------------------------------+
| pickle_dict | 27.2 us | 22.9 us: 1.19x faster (-16%) |
+-------------------------+--------------------------------+------------------------------+
| logging_format | 10.1 us | 8.48 us: 1.19x faster (-16%) |
+-------------------------+--------------------------------+------------------------------+
| logging_simple | 9.19 us | 7.74 us: 1.19x faster (-16%) |
+-------------------------+--------------------------------+------------------------------+
| sympy_sum | 237 ms | 200 ms: 1.19x faster (-16%) |
+-------------------------+--------------------------------+------------------------------+
| scimark_monte_carlo | 101 ms | 85.1 ms: 1.18x faster (-15%) |
+-------------------------+--------------------------------+------------------------------+
| scimark_fft | 319 ms | 272 ms: 1.18x faster (-15%) |
+-------------------------+--------------------------------+------------------------------+
| python_startup_no_site | 6.76 ms | 5.75 ms: 1.18x faster (-15%) |
+-------------------------+--------------------------------+------------------------------+
| chameleon | 9.28 ms | 7.91 ms: 1.17x faster (-15%) |
+-------------------------+--------------------------------+------------------------------+
| xml_etree_generate | 99.2 ms | 84.7 ms: 1.17x faster (-15%) |
+-------------------------+--------------------------------+------------------------------+
| django_template | 57.2 ms | 49.0 ms: 1.17x faster (-14%) |
+-------------------------+--------------------------------+------------------------------+
| pyflate | 640 ms | 548 ms: 1.17x faster (-14%) |
+-------------------------+--------------------------------+------------------------------+
| xml_etree_process | 81.4 ms | 70.2 ms: 1.16x faster (-14%) |
+-------------------------+--------------------------------+------------------------------+
| spectral_norm | 124 ms | 107 ms: 1.16x faster (-14%) |
+-------------------------+--------------------------------+------------------------------+
| regex_compile | 180 ms | 156 ms: 1.16x faster (-14%) |
+-------------------------+--------------------------------+------------------------------+
| mako | 17.1 ms | 14.8 ms: 1.16x faster (-13%) |
+-------------------------+--------------------------------+------------------------------+
| nbody | 117 ms | 102 ms: 1.14x faster (-12%) |
+-------------------------+--------------------------------+------------------------------+
| genshi_text | 29.1 ms | 25.6 ms: 1.14x faster (-12%) |
+-------------------------+--------------------------------+------------------------------+
| genshi_xml | 60.2 ms | 53.2 ms: 1.13x faster (-12%) |
+-------------------------+--------------------------------+------------------------------+
| 2to3 | 314 ms | 278 ms: 1.13x faster (-11%) |
+-------------------------+--------------------------------+------------------------------+
| crypto_pyaes | 107 ms | 95.5 ms: 1.12x faster (-11%) |
+-------------------------+--------------------------------+------------------------------+
| unpickle | 12.6 us | 11.2 us: 1.12x faster (-11%) |
+-------------------------+--------------------------------+------------------------------+
| python_startup | 9.21 ms | 8.21 ms: 1.12x faster (-11%) |
+-------------------------+--------------------------------+------------------------------+
| meteor_contest | 99.0 ms | 88.4 ms: 1.12x faster (-11%) |
+-------------------------+--------------------------------+------------------------------+
| regex_v8 | 20.5 ms | 18.4 ms: 1.12x faster (-10%) |
+-------------------------+--------------------------------+------------------------------+
| sqlalchemy_imperative | 33.1 ms | 29.6 ms: 1.12x faster (-10%) |
+-------------------------+--------------------------------+------------------------------+
| pickle_list | 3.27 us | 2.95 us: 1.11x faster (-10%) |
+-------------------------+--------------------------------+------------------------------+
| regex_dna | 161 ms | 147 ms: 1.10x faster (-9%) |
+-------------------------+--------------------------------+------------------------------+
| xml_etree_iterparse | 96.2 ms | 87.7 ms: 1.10x faster (-9%) |
+-------------------------+--------------------------------+------------------------------+
| json_loads | 23.7 us | 22.0 us: 1.08x faster (-7%) |
+-------------------------+--------------------------------+------------------------------+
| json_dumps | 11.4 ms | 10.8 ms: 1.05x faster (-5%) |
+-------------------------+--------------------------------+------------------------------+
| dulwich_log | 66.4 ms | 63.2 ms: 1.05x faster (-5%) |
+-------------------------+--------------------------------+------------------------------+
| tornado_http | 154 ms | 147 ms: 1.05x faster (-5%) |
+-------------------------+--------------------------------+------------------------------+
| pathlib | 18.7 ms | 18.0 ms: 1.04x faster (-4%) |
+-------------------------+--------------------------------+------------------------------+
| pickle | 8.77 us | 8.46 us: 1.04x faster (-4%) |
+-------------------------+--------------------------------+------------------------------+
| sqlite_synth | 2.59 us | 2.52 us: 1.03x faster (-3%) |
+-------------------------+--------------------------------+------------------------------+
| sqlalchemy_declarative | 159 ms | 156 ms: 1.02x faster (-2%) |
+-------------------------+--------------------------------+------------------------------+
| xml_etree_parse | 127 ms | 125 ms: 1.02x faster (-2%) |
+-------------------------+--------------------------------+------------------------------+
| pidigits | 155 ms | 156 ms: 1.01x slower (+1%) |
+-------------------------+--------------------------------+------------------------------+
| regex_effbot | 2.56 ms | 2.67 ms: 1.04x slower (+4%) |
+-------------------------+--------------------------------+------------------------------+
Not significant (2): telco; unpack_sequence
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment