Python benchmarks for nixpkgs

# Python nixpkgs benchmarks

These are benchmark results from the "pyperformance" benchmark suite:
  https://pyperformance.readthedocs.io/
on CPython built with various options for optimization.

For context, including the specific optimizations involved, see:
  https://github.com/NixOS/nixpkgs/pull/84072

01-overall.txt

+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| Benchmark               | py37-nix | py37-nix.pgo.58d476e6c       | py37-nix.pgo-linkopt.a74fa3abc | py37-deb                     |
+=========================+==========+==============================+================================+==============================+
| 2to3                    | 383 ms   | 334 ms: 1.15x faster (-13%)  | 314 ms: 1.22x faster (-18%)    | 278 ms: 1.38x faster (-27%)  |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| chameleon               | 11.8 ms  | 9.74 ms: 1.21x faster (-17%) | 9.28 ms: 1.27x faster (-21%)   | 7.91 ms: 1.49x faster (-33%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| chaos                   | 149 ms   | 120 ms: 1.24x faster (-19%)  | 113 ms: 1.31x faster (-24%)    | 93.5 ms: 1.59x faster (-37%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| crypto_pyaes            | 130 ms   | 113 ms: 1.15x faster (-13%)  | 107 ms: 1.21x faster (-17%)    | 95.5 ms: 1.36x faster (-27%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| deltablue               | 10.1 ms  | 7.79 ms: 1.30x faster (-23%) | 7.23 ms: 1.40x faster (-28%)   | 5.95 ms: 1.70x faster (-41%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| django_template         | 77.4 ms  | 61.5 ms: 1.26x faster (-21%) | 57.2 ms: 1.35x faster (-26%)   | 49.0 ms: 1.58x faster (-37%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| dulwich_log             | 83.8 ms  | 72.7 ms: 1.15x faster (-13%) | 66.4 ms: 1.26x faster (-21%)   | 63.2 ms: 1.33x faster (-25%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| fannkuch                | 548 ms   | 503 ms: 1.09x faster (-8%)   | 479 ms: 1.14x faster (-13%)    | 382 ms: 1.43x faster (-30%)  |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| float                   | 133 ms   | 116 ms: 1.14x faster (-13%)  | 113 ms: 1.18x faster (-15%)    | 89.0 ms: 1.50x faster (-33%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| genshi_text             | 37.2 ms  | 30.8 ms: 1.21x faster (-17%) | 29.1 ms: 1.28x faster (-22%)   | 25.6 ms: 1.46x faster (-31%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| genshi_xml              | 79.0 ms  | 64.9 ms: 1.22x faster (-18%) | 60.2 ms: 1.31x faster (-24%)   | 53.2 ms: 1.48x faster (-33%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| go                      | 337 ms   | 269 ms: 1.25x faster (-20%)  | 247 ms: 1.37x faster (-27%)    | 207 ms: 1.63x faster (-39%)  |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| hexiom                  | 13.0 ms  | 11.0 ms: 1.18x faster (-15%) | 10.0 ms: 1.30x faster (-23%)   | 8.05 ms: 1.62x faster (-38%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| json_dumps              | 14.4 ms  | 11.8 ms: 1.22x faster (-18%) | 11.4 ms: 1.27x faster (-21%)   | 10.8 ms: 1.34x faster (-25%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| json_loads              | 28.5 us  | 25.2 us: 1.13x faster (-12%) | 23.7 us: 1.20x faster (-17%)   | 22.0 us: 1.29x faster (-23%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| logging_format          | 13.7 us  | 11.4 us: 1.20x faster (-17%) | 10.1 us: 1.36x faster (-26%)   | 8.48 us: 1.61x faster (-38%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| logging_silent          | 232 ns   | 196 ns: 1.19x faster (-16%)  | 187 ns: 1.24x faster (-19%)    | 155 ns: 1.49x faster (-33%)  |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| logging_simple          | 12.2 us  | 10.2 us: 1.20x faster (-16%) | 9.19 us: 1.33x faster (-25%)   | 7.74 us: 1.58x faster (-37%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| mako                    | 23.3 ms  | 17.9 ms: 1.30x faster (-23%) | 17.1 ms: 1.37x faster (-27%)   | 14.8 ms: 1.58x faster (-37%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| meteor_contest          | 113 ms   | 100 ms: 1.13x faster (-11%)  | 99.0 ms: 1.14x faster (-13%)   | 88.4 ms: 1.28x faster (-22%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| nbody                   | 138 ms   | 123 ms: 1.12x faster (-11%)  | 117 ms: 1.18x faster (-15%)    | 102 ms: 1.35x faster (-26%)  |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| nqueens                 | 117 ms   | 105 ms: 1.12x faster (-11%)  | 97.4 ms: 1.21x faster (-17%)   | 80.5 ms: 1.46x faster (-31%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| pathlib                 | 23.4 ms  | 20.1 ms: 1.16x faster (-14%) | 18.7 ms: 1.25x faster (-20%)   | 18.0 ms: 1.30x faster (-23%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| pickle                  | 13.2 us  | 8.85 us: 1.49x faster (-33%) | 8.77 us: 1.51x faster (-34%)   | 8.46 us: 1.56x faster (-36%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| pickle_dict             | 39.9 us  | 26.1 us: 1.53x faster (-35%) | 27.2 us: 1.46x faster (-32%)   | 22.9 us: 1.74x faster (-43%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| pickle_list             | 4.97 us  | 3.35 us: 1.48x faster (-33%) | 3.27 us: 1.52x faster (-34%)   | 2.95 us: 1.69x faster (-41%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| pickle_pure_python      | 600 us   | 483 us: 1.24x faster (-20%)  | 455 us: 1.32x faster (-24%)    | 382 us: 1.57x faster (-36%)  |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| pidigits                | 173 ms   | 153 ms: 1.13x faster (-11%)  | 155 ms: 1.12x faster (-10%)    | 156 ms: 1.11x faster (-10%)  |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| pyflate                 | 832 ms   | 668 ms: 1.25x faster (-20%)  | 640 ms: 1.30x faster (-23%)    | 548 ms: 1.52x faster (-34%)  |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| python_startup          | 10.3 ms  | 9.63 ms: 1.07x faster (-7%)  | 9.21 ms: 1.12x faster (-11%)   | 8.21 ms: 1.26x faster (-20%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| python_startup_no_site  | 7.75 ms  | 7.28 ms: 1.06x faster (-6%)  | 6.76 ms: 1.15x faster (-13%)   | 5.75 ms: 1.35x faster (-26%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| raytrace                | 678 ms   | 536 ms: 1.26x faster (-21%)  | 492 ms: 1.38x faster (-27%)    | 403 ms: 1.68x faster (-40%)  |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| regex_compile           | 225 ms   | 194 ms: 1.16x faster (-14%)  | 180 ms: 1.25x faster (-20%)    | 156 ms: 1.44x faster (-31%)  |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| regex_dna               | 165 ms   | 159 ms: 1.04x faster (-4%)   | 161 ms: 1.02x faster (-2%)     | 147 ms: 1.13x faster (-11%)  |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| regex_effbot            | 2.90 ms  | 2.55 ms: 1.13x faster (-12%) | 2.56 ms: 1.13x faster (-12%)   | 2.67 ms: 1.08x faster (-8%)  |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| regex_v8                | 23.3 ms  | 20.4 ms: 1.14x faster (-12%) | 20.5 ms: 1.13x faster (-12%)   | 18.4 ms: 1.27x faster (-21%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| richards                | 101 ms   | 77.3 ms: 1.30x faster (-23%) | 72.4 ms: 1.39x faster (-28%)   | 57.2 ms: 1.76x faster (-43%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| scimark_fft             | 390 ms   | 338 ms: 1.15x faster (-13%)  | 319 ms: 1.22x faster (-18%)    | 272 ms: 1.44x faster (-30%)  |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| scimark_lu              | 227 ms   | 189 ms: 1.20x faster (-17%)  | 178 ms: 1.28x faster (-22%)    | 139 ms: 1.63x faster (-39%)  |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| scimark_monte_carlo     | 134 ms   | 111 ms: 1.20x faster (-17%)  | 101 ms: 1.33x faster (-25%)    | 85.1 ms: 1.57x faster (-36%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| scimark_sor             | 243 ms   | 199 ms: 1.22x faster (-18%)  | 187 ms: 1.30x faster (-23%)    | 150 ms: 1.63x faster (-39%)  |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| scimark_sparse_mat_mult | 4.52 ms  | 4.27 ms: 1.06x faster (-6%)  | 4.06 ms: 1.11x faster (-10%)   | 3.28 ms: 1.38x faster (-27%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| spectral_norm           | 146 ms   | 130 ms: 1.13x faster (-11%)  | 124 ms: 1.18x faster (-15%)    | 107 ms: 1.37x faster (-27%)  |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| sqlalchemy_declarative  | 188 ms   | 172 ms: 1.09x faster (-9%)   | 159 ms: 1.18x faster (-16%)    | 156 ms: 1.21x faster (-17%)  |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| sqlalchemy_imperative   | 39.6 ms  | 34.9 ms: 1.13x faster (-12%) | 33.1 ms: 1.20x faster (-16%)   | 29.6 ms: 1.33x faster (-25%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| sqlite_synth            | 3.33 us  | 3.03 us: 1.10x faster (-9%)  | 2.59 us: 1.29x faster (-22%)   | 2.52 us: 1.32x faster (-24%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| sympy_expand            | 734 ms   | 610 ms: 1.20x faster (-17%)  | 570 ms: 1.29x faster (-22%)    | 423 ms: 1.74x faster (-42%)  |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| sympy_integrate         | 35.2 ms  | 30.3 ms: 1.16x faster (-14%) | 28.8 ms: 1.22x faster (-18%)   | 23.2 ms: 1.51x faster (-34%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| sympy_sum               | 282 ms   | 248 ms: 1.14x faster (-12%)  | 237 ms: 1.19x faster (-16%)    | 200 ms: 1.41x faster (-29%)  |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| sympy_str               | 457 ms   | 398 ms: 1.15x faster (-13%)  | 373 ms: 1.23x faster (-18%)    | 298 ms: 1.53x faster (-35%)  |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| telco                   | 7.27 ms  | 6.02 ms: 1.21x faster (-17%) | 5.50 ms: 1.32x faster (-24%)   | 5.54 ms: 1.31x faster (-24%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| tornado_http            | 184 ms   | 166 ms: 1.11x faster (-10%)  | 154 ms: 1.20x faster (-17%)    | 147 ms: 1.26x faster (-21%)  |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| unpack_sequence         | 47.8 ns  | 43.4 ns: 1.10x faster (-9%)  | 42.8 ns: 1.12x faster (-11%)   | 43.3 ns: 1.11x faster (-10%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| unpickle                | 16.0 us  | 12.9 us: 1.25x faster (-20%) | 12.6 us: 1.28x faster (-22%)   | 11.2 us: 1.44x faster (-30%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| unpickle_list           | 4.25 us  | 4.13 us: 1.03x faster (-3%)  | 4.01 us: 1.06x faster (-6%)    | 3.12 us: 1.36x faster (-26%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| unpickle_pure_python    | 480 us   | 395 us: 1.21x faster (-18%)  | 361 us: 1.33x faster (-25%)    | 304 us: 1.58x faster (-37%)  |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| xml_etree_parse         | 146 ms   | 130 ms: 1.12x faster (-11%)  | 127 ms: 1.15x faster (-13%)    | 125 ms: 1.17x faster (-14%)  |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| xml_etree_iterparse     | 114 ms   | 99.6 ms: 1.14x faster (-13%) | 96.2 ms: 1.19x faster (-16%)   | 87.7 ms: 1.30x faster (-23%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| xml_etree_generate      | 131 ms   | 108 ms: 1.21x faster (-17%)  | 99.2 ms: 1.32x faster (-24%)   | 84.7 ms: 1.54x faster (-35%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+
| xml_etree_process       | 111 ms   | 87.7 ms: 1.27x faster (-21%) | 81.4 ms: 1.37x faster (-27%)   | 70.2 ms: 1.59x faster (-37%) |
+-------------------------+----------+------------------------------+--------------------------------+------------------------------+

10-enable-optimizations.txt

+-------------------------+----------+------------------------------+
| Benchmark               | py37-nix | py37-nix.pgo.58d476e6c       |
+=========================+==========+==============================+
| pickle_dict             | 39.9 us  | 26.1 us: 1.53x faster (-35%) |
+-------------------------+----------+------------------------------+
| pickle                  | 13.2 us  | 8.85 us: 1.49x faster (-33%) |
+-------------------------+----------+------------------------------+
| pickle_list             | 4.97 us  | 3.35 us: 1.48x faster (-33%) |
+-------------------------+----------+------------------------------+
| mako                    | 23.3 ms  | 17.9 ms: 1.30x faster (-23%) |
+-------------------------+----------+------------------------------+
| richards                | 101 ms   | 77.3 ms: 1.30x faster (-23%) |
+-------------------------+----------+------------------------------+
| deltablue               | 10.1 ms  | 7.79 ms: 1.30x faster (-23%) |
+-------------------------+----------+------------------------------+
| xml_etree_process       | 111 ms   | 87.7 ms: 1.27x faster (-21%) |
+-------------------------+----------+------------------------------+
| raytrace                | 678 ms   | 536 ms: 1.26x faster (-21%)  |
+-------------------------+----------+------------------------------+
| django_template         | 77.4 ms  | 61.5 ms: 1.26x faster (-21%) |
+-------------------------+----------+------------------------------+
| go                      | 337 ms   | 269 ms: 1.25x faster (-20%)  |
+-------------------------+----------+------------------------------+
| unpickle                | 16.0 us  | 12.9 us: 1.25x faster (-20%) |
+-------------------------+----------+------------------------------+
| pyflate                 | 832 ms   | 668 ms: 1.25x faster (-20%)  |
+-------------------------+----------+------------------------------+
| pickle_pure_python      | 600 us   | 483 us: 1.24x faster (-20%)  |
+-------------------------+----------+------------------------------+
| chaos                   | 149 ms   | 120 ms: 1.24x faster (-19%)  |
+-------------------------+----------+------------------------------+
| json_dumps              | 14.4 ms  | 11.8 ms: 1.22x faster (-18%) |
+-------------------------+----------+------------------------------+
| scimark_sor             | 243 ms   | 199 ms: 1.22x faster (-18%)  |
+-------------------------+----------+------------------------------+
| genshi_xml              | 79.0 ms  | 64.9 ms: 1.22x faster (-18%) |
+-------------------------+----------+------------------------------+
| unpickle_pure_python    | 480 us   | 395 us: 1.21x faster (-18%)  |
+-------------------------+----------+------------------------------+
| chameleon               | 11.8 ms  | 9.74 ms: 1.21x faster (-17%) |
+-------------------------+----------+------------------------------+
| genshi_text             | 37.2 ms  | 30.8 ms: 1.21x faster (-17%) |
+-------------------------+----------+------------------------------+
| xml_etree_generate      | 131 ms   | 108 ms: 1.21x faster (-17%)  |
+-------------------------+----------+------------------------------+
| telco                   | 7.27 ms  | 6.02 ms: 1.21x faster (-17%) |
+-------------------------+----------+------------------------------+
| sympy_expand            | 734 ms   | 610 ms: 1.20x faster (-17%)  |
+-------------------------+----------+------------------------------+
| scimark_lu              | 227 ms   | 189 ms: 1.20x faster (-17%)  |
+-------------------------+----------+------------------------------+
| scimark_monte_carlo     | 134 ms   | 111 ms: 1.20x faster (-17%)  |
+-------------------------+----------+------------------------------+
| logging_format          | 13.7 us  | 11.4 us: 1.20x faster (-17%) |
+-------------------------+----------+------------------------------+
| logging_simple          | 12.2 us  | 10.2 us: 1.20x faster (-16%) |
+-------------------------+----------+------------------------------+
| logging_silent          | 232 ns   | 196 ns: 1.19x faster (-16%)  |
+-------------------------+----------+------------------------------+
| hexiom                  | 13.0 ms  | 11.0 ms: 1.18x faster (-15%) |
+-------------------------+----------+------------------------------+
| pathlib                 | 23.4 ms  | 20.1 ms: 1.16x faster (-14%) |
+-------------------------+----------+------------------------------+
| regex_compile           | 225 ms   | 194 ms: 1.16x faster (-14%)  |
+-------------------------+----------+------------------------------+
| sympy_integrate         | 35.2 ms  | 30.3 ms: 1.16x faster (-14%) |
+-------------------------+----------+------------------------------+
| scimark_fft             | 390 ms   | 338 ms: 1.15x faster (-13%)  |
+-------------------------+----------+------------------------------+
| dulwich_log             | 83.8 ms  | 72.7 ms: 1.15x faster (-13%) |
+-------------------------+----------+------------------------------+
| crypto_pyaes            | 130 ms   | 113 ms: 1.15x faster (-13%)  |
+-------------------------+----------+------------------------------+
| sympy_str               | 457 ms   | 398 ms: 1.15x faster (-13%)  |
+-------------------------+----------+------------------------------+
| 2to3                    | 383 ms   | 334 ms: 1.15x faster (-13%)  |
+-------------------------+----------+------------------------------+
| float                   | 133 ms   | 116 ms: 1.14x faster (-13%)  |
+-------------------------+----------+------------------------------+
| xml_etree_iterparse     | 114 ms   | 99.6 ms: 1.14x faster (-13%) |
+-------------------------+----------+------------------------------+
| regex_v8                | 23.3 ms  | 20.4 ms: 1.14x faster (-12%) |
+-------------------------+----------+------------------------------+
| sympy_sum               | 282 ms   | 248 ms: 1.14x faster (-12%)  |
+-------------------------+----------+------------------------------+
| regex_effbot            | 2.90 ms  | 2.55 ms: 1.13x faster (-12%) |
+-------------------------+----------+------------------------------+
| sqlalchemy_imperative   | 39.6 ms  | 34.9 ms: 1.13x faster (-12%) |
+-------------------------+----------+------------------------------+
| json_loads              | 28.5 us  | 25.2 us: 1.13x faster (-12%) |
+-------------------------+----------+------------------------------+
| spectral_norm           | 146 ms   | 130 ms: 1.13x faster (-11%)  |
+-------------------------+----------+------------------------------+
| pidigits                | 173 ms   | 153 ms: 1.13x faster (-11%)  |
+-------------------------+----------+------------------------------+
| meteor_contest          | 113 ms   | 100 ms: 1.13x faster (-11%)  |
+-------------------------+----------+------------------------------+
| xml_etree_parse         | 146 ms   | 130 ms: 1.12x faster (-11%)  |
+-------------------------+----------+------------------------------+
| nbody                   | 138 ms   | 123 ms: 1.12x faster (-11%)  |
+-------------------------+----------+------------------------------+
| nqueens                 | 117 ms   | 105 ms: 1.12x faster (-11%)  |
+-------------------------+----------+------------------------------+
| tornado_http            | 184 ms   | 166 ms: 1.11x faster (-10%)  |
+-------------------------+----------+------------------------------+
| unpack_sequence         | 47.8 ns  | 43.4 ns: 1.10x faster (-9%)  |
+-------------------------+----------+------------------------------+
| sqlite_synth            | 3.33 us  | 3.03 us: 1.10x faster (-9%)  |
+-------------------------+----------+------------------------------+
| sqlalchemy_declarative  | 188 ms   | 172 ms: 1.09x faster (-9%)   |
+-------------------------+----------+------------------------------+
| fannkuch                | 548 ms   | 503 ms: 1.09x faster (-8%)   |
+-------------------------+----------+------------------------------+
| python_startup          | 10.3 ms  | 9.63 ms: 1.07x faster (-7%)  |
+-------------------------+----------+------------------------------+
| python_startup_no_site  | 7.75 ms  | 7.28 ms: 1.06x faster (-6%)  |
+-------------------------+----------+------------------------------+
| scimark_sparse_mat_mult | 4.52 ms  | 4.27 ms: 1.06x faster (-6%)  |
+-------------------------+----------+------------------------------+
| regex_dna               | 165 ms   | 159 ms: 1.04x faster (-4%)   |
+-------------------------+----------+------------------------------+
| unpickle_list           | 4.25 us  | 4.13 us: 1.03x faster (-3%)  |
+-------------------------+----------+------------------------------+

11-link-opt.txt

+-------------------------+------------------------+--------------------------------+
| Benchmark               | py37-nix.pgo.58d476e6c | py37-nix.pgo-linkopt.a74fa3abc |
+=========================+========================+================================+
| sqlite_synth            | 3.03 us                | 2.59 us: 1.17x faster (-14%)   |
+-------------------------+------------------------+--------------------------------+
| logging_format          | 11.4 us                | 10.1 us: 1.13x faster (-12%)   |
+-------------------------+------------------------+--------------------------------+
| logging_simple          | 10.2 us                | 9.19 us: 1.11x faster (-10%)   |
+-------------------------+------------------------+--------------------------------+
| scimark_monte_carlo     | 111 ms                 | 101 ms: 1.10x faster (-9%)     |
+-------------------------+------------------------+--------------------------------+
| hexiom                  | 11.0 ms                | 10.0 ms: 1.10x faster (-9%)    |
+-------------------------+------------------------+--------------------------------+
| dulwich_log             | 72.7 ms                | 66.4 ms: 1.09x faster (-9%)    |
+-------------------------+------------------------+--------------------------------+
| telco                   | 6.02 ms                | 5.50 ms: 1.09x faster (-9%)    |
+-------------------------+------------------------+--------------------------------+
| unpickle_pure_python    | 395 us                 | 361 us: 1.09x faster (-9%)     |
+-------------------------+------------------------+--------------------------------+
| go                      | 269 ms                 | 247 ms: 1.09x faster (-8%)     |
+-------------------------+------------------------+--------------------------------+
| xml_etree_generate      | 108 ms                 | 99.2 ms: 1.09x faster (-8%)    |
+-------------------------+------------------------+--------------------------------+
| raytrace                | 536 ms                 | 492 ms: 1.09x faster (-8%)     |
+-------------------------+------------------------+--------------------------------+
| sqlalchemy_declarative  | 172 ms                 | 159 ms: 1.08x faster (-8%)     |
+-------------------------+------------------------+--------------------------------+
| genshi_xml              | 64.9 ms                | 60.2 ms: 1.08x faster (-7%)    |
+-------------------------+------------------------+--------------------------------+
| nqueens                 | 105 ms                 | 97.4 ms: 1.08x faster (-7%)    |
+-------------------------+------------------------+--------------------------------+
| deltablue               | 7.79 ms                | 7.23 ms: 1.08x faster (-7%)    |
+-------------------------+------------------------+--------------------------------+
| tornado_http            | 166 ms                 | 154 ms: 1.08x faster (-7%)     |
+-------------------------+------------------------+--------------------------------+
| xml_etree_process       | 87.7 ms                | 81.4 ms: 1.08x faster (-7%)    |
+-------------------------+------------------------+--------------------------------+
| python_startup_no_site  | 7.28 ms                | 6.76 ms: 1.08x faster (-7%)    |
+-------------------------+------------------------+--------------------------------+
| pathlib                 | 20.1 ms                | 18.7 ms: 1.08x faster (-7%)    |
+-------------------------+------------------------+--------------------------------+
| django_template         | 61.5 ms                | 57.2 ms: 1.07x faster (-7%)    |
+-------------------------+------------------------+--------------------------------+
| regex_compile           | 194 ms                 | 180 ms: 1.07x faster (-7%)     |
+-------------------------+------------------------+--------------------------------+
| sympy_expand            | 610 ms                 | 570 ms: 1.07x faster (-7%)     |
+-------------------------+------------------------+--------------------------------+
| richards                | 77.3 ms                | 72.4 ms: 1.07x faster (-6%)    |
+-------------------------+------------------------+--------------------------------+
| sympy_str               | 398 ms                 | 373 ms: 1.07x faster (-6%)     |
+-------------------------+------------------------+--------------------------------+
| 2to3                    | 334 ms                 | 314 ms: 1.06x faster (-6%)     |
+-------------------------+------------------------+--------------------------------+
| scimark_sor             | 199 ms                 | 187 ms: 1.06x faster (-6%)     |
+-------------------------+------------------------+--------------------------------+
| json_loads              | 25.2 us                | 23.7 us: 1.06x faster (-6%)    |
+-------------------------+------------------------+--------------------------------+
| scimark_lu              | 189 ms                 | 178 ms: 1.06x faster (-6%)     |
+-------------------------+------------------------+--------------------------------+
| pickle_pure_python      | 483 us                 | 455 us: 1.06x faster (-6%)     |
+-------------------------+------------------------+--------------------------------+
| chaos                   | 120 ms                 | 113 ms: 1.06x faster (-6%)     |
+-------------------------+------------------------+--------------------------------+
| scimark_fft             | 338 ms                 | 319 ms: 1.06x faster (-5%)     |
+-------------------------+------------------------+--------------------------------+
| genshi_text             | 30.8 ms                | 29.1 ms: 1.06x faster (-5%)    |
+-------------------------+------------------------+--------------------------------+
| sqlalchemy_imperative   | 34.9 ms                | 33.1 ms: 1.06x faster (-5%)    |
+-------------------------+------------------------+--------------------------------+
| sympy_integrate         | 30.3 ms                | 28.8 ms: 1.06x faster (-5%)    |
+-------------------------+------------------------+--------------------------------+
| nbody                   | 123 ms                 | 117 ms: 1.05x faster (-5%)     |
+-------------------------+------------------------+--------------------------------+
| crypto_pyaes            | 113 ms                 | 107 ms: 1.05x faster (-5%)     |
+-------------------------+------------------------+--------------------------------+
| fannkuch                | 503 ms                 | 479 ms: 1.05x faster (-5%)     |
+-------------------------+------------------------+--------------------------------+
| chameleon               | 9.74 ms                | 9.28 ms: 1.05x faster (-5%)    |
+-------------------------+------------------------+--------------------------------+
| scimark_sparse_mat_mult | 4.27 ms                | 4.06 ms: 1.05x faster (-5%)    |
+-------------------------+------------------------+--------------------------------+
| mako                    | 17.9 ms                | 17.1 ms: 1.05x faster (-5%)    |
+-------------------------+------------------------+--------------------------------+
| spectral_norm           | 130 ms                 | 124 ms: 1.05x faster (-4%)     |
+-------------------------+------------------------+--------------------------------+
| sympy_sum               | 248 ms                 | 237 ms: 1.05x faster (-4%)     |
+-------------------------+------------------------+--------------------------------+
| logging_silent          | 196 ns                 | 187 ns: 1.05x faster (-4%)     |
+-------------------------+------------------------+--------------------------------+
| python_startup          | 9.63 ms                | 9.21 ms: 1.04x faster (-4%)    |
+-------------------------+------------------------+--------------------------------+
| pyflate                 | 668 ms                 | 640 ms: 1.04x faster (-4%)     |
+-------------------------+------------------------+--------------------------------+
| json_dumps              | 11.8 ms                | 11.4 ms: 1.04x faster (-4%)    |
+-------------------------+------------------------+--------------------------------+
| xml_etree_iterparse     | 99.6 ms                | 96.2 ms: 1.04x faster (-3%)    |
+-------------------------+------------------------+--------------------------------+
| unpickle_list           | 4.13 us                | 4.01 us: 1.03x faster (-3%)    |
+-------------------------+------------------------+--------------------------------+
| float                   | 116 ms                 | 113 ms: 1.03x faster (-3%)     |
+-------------------------+------------------------+--------------------------------+
| pickle_list             | 3.35 us                | 3.27 us: 1.02x faster (-2%)    |
+-------------------------+------------------------+--------------------------------+
| unpickle                | 12.9 us                | 12.6 us: 1.02x faster (-2%)    |
+-------------------------+------------------------+--------------------------------+
| xml_etree_parse         | 130 ms                 | 127 ms: 1.02x faster (-2%)     |
+-------------------------+------------------------+--------------------------------+
| meteor_contest          | 100 ms                 | 99.0 ms: 1.01x faster (-1%)    |
+-------------------------+------------------------+--------------------------------+
| unpack_sequence         | 43.4 ns                | 42.8 ns: 1.01x faster (-1%)    |
+-------------------------+------------------------+--------------------------------+
| pickle                  | 8.85 us                | 8.77 us: 1.01x faster (-1%)    |
+-------------------------+------------------------+--------------------------------+
| pidigits                | 153 ms                 | 155 ms: 1.01x slower (+1%)     |
+-------------------------+------------------------+--------------------------------+
| regex_dna               | 159 ms                 | 161 ms: 1.02x slower (+2%)     |
+-------------------------+------------------------+--------------------------------+
| pickle_dict             | 26.1 us                | 27.2 us: 1.04x slower (+4%)    |
+-------------------------+------------------------+--------------------------------+

Not significant (2): regex_effbot; regex_v8

20-combined.txt

+-------------------------+----------+--------------------------------+
| Benchmark               | py37-nix | py37-nix.pgo-linkopt.a74fa3abc |
+=========================+==========+================================+
| pickle_list             | 4.97 us  | 3.27 us: 1.52x faster (-34%)   |
+-------------------------+----------+--------------------------------+
| pickle                  | 13.2 us  | 8.77 us: 1.51x faster (-34%)   |
+-------------------------+----------+--------------------------------+
| pickle_dict             | 39.9 us  | 27.2 us: 1.46x faster (-32%)   |
+-------------------------+----------+--------------------------------+
| deltablue               | 10.1 ms  | 7.23 ms: 1.40x faster (-28%)   |
+-------------------------+----------+--------------------------------+
| richards                | 101 ms   | 72.4 ms: 1.39x faster (-28%)   |
+-------------------------+----------+--------------------------------+
| raytrace                | 678 ms   | 492 ms: 1.38x faster (-27%)    |
+-------------------------+----------+--------------------------------+
| xml_etree_process       | 111 ms   | 81.4 ms: 1.37x faster (-27%)   |
+-------------------------+----------+--------------------------------+
| mako                    | 23.3 ms  | 17.1 ms: 1.37x faster (-27%)   |
+-------------------------+----------+--------------------------------+
| go                      | 337 ms   | 247 ms: 1.37x faster (-27%)    |
+-------------------------+----------+--------------------------------+
| logging_format          | 13.7 us  | 10.1 us: 1.36x faster (-26%)   |
+-------------------------+----------+--------------------------------+
| django_template         | 77.4 ms  | 57.2 ms: 1.35x faster (-26%)   |
+-------------------------+----------+--------------------------------+
| logging_simple          | 12.2 us  | 9.19 us: 1.33x faster (-25%)   |
+-------------------------+----------+--------------------------------+
| scimark_monte_carlo     | 134 ms   | 101 ms: 1.33x faster (-25%)    |
+-------------------------+----------+--------------------------------+
| unpickle_pure_python    | 480 us   | 361 us: 1.33x faster (-25%)    |
+-------------------------+----------+--------------------------------+
| telco                   | 7.27 ms  | 5.50 ms: 1.32x faster (-24%)   |
+-------------------------+----------+--------------------------------+
| pickle_pure_python      | 600 us   | 455 us: 1.32x faster (-24%)    |
+-------------------------+----------+--------------------------------+
| xml_etree_generate      | 131 ms   | 99.2 ms: 1.32x faster (-24%)   |
+-------------------------+----------+--------------------------------+
| chaos                   | 149 ms   | 113 ms: 1.31x faster (-24%)    |
+-------------------------+----------+--------------------------------+
| genshi_xml              | 79.0 ms  | 60.2 ms: 1.31x faster (-24%)   |
+-------------------------+----------+--------------------------------+
| hexiom                  | 13.0 ms  | 10.0 ms: 1.30x faster (-23%)   |
+-------------------------+----------+--------------------------------+
| pyflate                 | 832 ms   | 640 ms: 1.30x faster (-23%)    |
+-------------------------+----------+--------------------------------+
| scimark_sor             | 243 ms   | 187 ms: 1.30x faster (-23%)    |
+-------------------------+----------+--------------------------------+
| sympy_expand            | 734 ms   | 570 ms: 1.29x faster (-22%)    |
+-------------------------+----------+--------------------------------+
| sqlite_synth            | 3.33 us  | 2.59 us: 1.29x faster (-22%)   |
+-------------------------+----------+--------------------------------+
| genshi_text             | 37.2 ms  | 29.1 ms: 1.28x faster (-22%)   |
+-------------------------+----------+--------------------------------+
| scimark_lu              | 227 ms   | 178 ms: 1.28x faster (-22%)    |
+-------------------------+----------+--------------------------------+
| unpickle                | 16.0 us  | 12.6 us: 1.28x faster (-22%)   |
+-------------------------+----------+--------------------------------+
| chameleon               | 11.8 ms  | 9.28 ms: 1.27x faster (-21%)   |
+-------------------------+----------+--------------------------------+
| json_dumps              | 14.4 ms  | 11.4 ms: 1.27x faster (-21%)   |
+-------------------------+----------+--------------------------------+
| dulwich_log             | 83.8 ms  | 66.4 ms: 1.26x faster (-21%)   |
+-------------------------+----------+--------------------------------+
| pathlib                 | 23.4 ms  | 18.7 ms: 1.25x faster (-20%)   |
+-------------------------+----------+--------------------------------+
| regex_compile           | 225 ms   | 180 ms: 1.25x faster (-20%)    |
+-------------------------+----------+--------------------------------+
| logging_silent          | 232 ns   | 187 ns: 1.24x faster (-19%)    |
+-------------------------+----------+--------------------------------+
| sympy_str               | 457 ms   | 373 ms: 1.23x faster (-18%)    |
+-------------------------+----------+--------------------------------+
| sympy_integrate         | 35.2 ms  | 28.8 ms: 1.22x faster (-18%)   |
+-------------------------+----------+--------------------------------+
| 2to3                    | 383 ms   | 314 ms: 1.22x faster (-18%)    |
+-------------------------+----------+--------------------------------+
| scimark_fft             | 390 ms   | 319 ms: 1.22x faster (-18%)    |
+-------------------------+----------+--------------------------------+
| crypto_pyaes            | 130 ms   | 107 ms: 1.21x faster (-17%)    |
+-------------------------+----------+--------------------------------+
| nqueens                 | 117 ms   | 97.4 ms: 1.21x faster (-17%)   |
+-------------------------+----------+--------------------------------+
| json_loads              | 28.5 us  | 23.7 us: 1.20x faster (-17%)   |
+-------------------------+----------+--------------------------------+
| tornado_http            | 184 ms   | 154 ms: 1.20x faster (-17%)    |
+-------------------------+----------+--------------------------------+
| sqlalchemy_imperative   | 39.6 ms  | 33.1 ms: 1.20x faster (-16%)   |
+-------------------------+----------+--------------------------------+
| sympy_sum               | 282 ms   | 237 ms: 1.19x faster (-16%)    |
+-------------------------+----------+--------------------------------+
| xml_etree_iterparse     | 114 ms   | 96.2 ms: 1.19x faster (-16%)   |
+-------------------------+----------+--------------------------------+
| sqlalchemy_declarative  | 188 ms   | 159 ms: 1.18x faster (-16%)    |
+-------------------------+----------+--------------------------------+
| nbody                   | 138 ms   | 117 ms: 1.18x faster (-15%)    |
+-------------------------+----------+--------------------------------+
| spectral_norm           | 146 ms   | 124 ms: 1.18x faster (-15%)    |
+-------------------------+----------+--------------------------------+
| float                   | 133 ms   | 113 ms: 1.18x faster (-15%)    |
+-------------------------+----------+--------------------------------+
| xml_etree_parse         | 146 ms   | 127 ms: 1.15x faster (-13%)    |
+-------------------------+----------+--------------------------------+
| python_startup_no_site  | 7.75 ms  | 6.76 ms: 1.15x faster (-13%)   |
+-------------------------+----------+--------------------------------+
| fannkuch                | 548 ms   | 479 ms: 1.14x faster (-13%)    |
+-------------------------+----------+--------------------------------+
| meteor_contest          | 113 ms   | 99.0 ms: 1.14x faster (-13%)   |
+-------------------------+----------+--------------------------------+
| regex_v8                | 23.3 ms  | 20.5 ms: 1.13x faster (-12%)   |
+-------------------------+----------+--------------------------------+
| regex_effbot            | 2.90 ms  | 2.56 ms: 1.13x faster (-12%)   |
+-------------------------+----------+--------------------------------+
| python_startup          | 10.3 ms  | 9.21 ms: 1.12x faster (-11%)   |
+-------------------------+----------+--------------------------------+
| unpack_sequence         | 47.8 ns  | 42.8 ns: 1.12x faster (-11%)   |
+-------------------------+----------+--------------------------------+
| pidigits                | 173 ms   | 155 ms: 1.12x faster (-10%)    |
+-------------------------+----------+--------------------------------+
| scimark_sparse_mat_mult | 4.52 ms  | 4.06 ms: 1.11x faster (-10%)   |
+-------------------------+----------+--------------------------------+
| unpickle_list           | 4.25 us  | 4.01 us: 1.06x faster (-6%)    |
+-------------------------+----------+--------------------------------+
| regex_dna               | 165 ms   | 161 ms: 1.02x faster (-2%)     |
+-------------------------+----------+--------------------------------+

30-debian-remaining.txt

+-------------------------+--------------------------------+------------------------------+
| Benchmark               | py37-nix.pgo-linkopt.a74fa3abc | py37-deb                     |
+=========================+================================+==============================+
| sympy_expand            | 570 ms                         | 423 ms: 1.35x faster (-26%)  |
+-------------------------+--------------------------------+------------------------------+
| unpickle_list           | 4.01 us                        | 3.12 us: 1.28x faster (-22%) |
+-------------------------+--------------------------------+------------------------------+
| scimark_lu              | 178 ms                         | 139 ms: 1.28x faster (-22%)  |
+-------------------------+--------------------------------+------------------------------+
| float                   | 113 ms                         | 89.0 ms: 1.27x faster (-21%) |
+-------------------------+--------------------------------+------------------------------+
| richards                | 72.4 ms                        | 57.2 ms: 1.27x faster (-21%) |
+-------------------------+--------------------------------+------------------------------+
| scimark_sor             | 187 ms                         | 150 ms: 1.25x faster (-20%)  |
+-------------------------+--------------------------------+------------------------------+
| fannkuch                | 479 ms                         | 382 ms: 1.25x faster (-20%)  |
+-------------------------+--------------------------------+------------------------------+
| sympy_str               | 373 ms                         | 298 ms: 1.25x faster (-20%)  |
+-------------------------+--------------------------------+------------------------------+
| hexiom                  | 10.0 ms                        | 8.05 ms: 1.24x faster (-20%) |
+-------------------------+--------------------------------+------------------------------+
| scimark_sparse_mat_mult | 4.06 ms                        | 3.28 ms: 1.24x faster (-19%) |
+-------------------------+--------------------------------+------------------------------+
| sympy_integrate         | 28.8 ms                        | 23.2 ms: 1.24x faster (-19%) |
+-------------------------+--------------------------------+------------------------------+
| raytrace                | 492 ms                         | 403 ms: 1.22x faster (-18%)  |
+-------------------------+--------------------------------+------------------------------+
| deltablue               | 7.23 ms                        | 5.95 ms: 1.21x faster (-18%) |
+-------------------------+--------------------------------+------------------------------+
| chaos                   | 113 ms                         | 93.5 ms: 1.21x faster (-17%) |
+-------------------------+--------------------------------+------------------------------+
| nqueens                 | 97.4 ms                        | 80.5 ms: 1.21x faster (-17%) |
+-------------------------+--------------------------------+------------------------------+
| logging_silent          | 187 ns                         | 155 ns: 1.21x faster (-17%)  |
+-------------------------+--------------------------------+------------------------------+
| go                      | 247 ms                         | 207 ms: 1.19x faster (-16%)  |
+-------------------------+--------------------------------+------------------------------+
| pickle_pure_python      | 455 us                         | 382 us: 1.19x faster (-16%)  |
+-------------------------+--------------------------------+------------------------------+
| unpickle_pure_python    | 361 us                         | 304 us: 1.19x faster (-16%)  |
+-------------------------+--------------------------------+------------------------------+
| pickle_dict             | 27.2 us                        | 22.9 us: 1.19x faster (-16%) |
+-------------------------+--------------------------------+------------------------------+
| logging_format          | 10.1 us                        | 8.48 us: 1.19x faster (-16%) |
+-------------------------+--------------------------------+------------------------------+
| logging_simple          | 9.19 us                        | 7.74 us: 1.19x faster (-16%) |
+-------------------------+--------------------------------+------------------------------+
| sympy_sum               | 237 ms                         | 200 ms: 1.19x faster (-16%)  |
+-------------------------+--------------------------------+------------------------------+
| scimark_monte_carlo     | 101 ms                         | 85.1 ms: 1.18x faster (-15%) |
+-------------------------+--------------------------------+------------------------------+
| scimark_fft             | 319 ms                         | 272 ms: 1.18x faster (-15%)  |
+-------------------------+--------------------------------+------------------------------+
| python_startup_no_site  | 6.76 ms                        | 5.75 ms: 1.18x faster (-15%) |
+-------------------------+--------------------------------+------------------------------+
| chameleon               | 9.28 ms                        | 7.91 ms: 1.17x faster (-15%) |
+-------------------------+--------------------------------+------------------------------+
| xml_etree_generate      | 99.2 ms                        | 84.7 ms: 1.17x faster (-15%) |
+-------------------------+--------------------------------+------------------------------+
| django_template         | 57.2 ms                        | 49.0 ms: 1.17x faster (-14%) |
+-------------------------+--------------------------------+------------------------------+
| pyflate                 | 640 ms                         | 548 ms: 1.17x faster (-14%)  |
+-------------------------+--------------------------------+------------------------------+
| xml_etree_process       | 81.4 ms                        | 70.2 ms: 1.16x faster (-14%) |
+-------------------------+--------------------------------+------------------------------+
| spectral_norm           | 124 ms                         | 107 ms: 1.16x faster (-14%)  |
+-------------------------+--------------------------------+------------------------------+
| regex_compile           | 180 ms                         | 156 ms: 1.16x faster (-14%)  |
+-------------------------+--------------------------------+------------------------------+
| mako                    | 17.1 ms                        | 14.8 ms: 1.16x faster (-13%) |
+-------------------------+--------------------------------+------------------------------+
| nbody                   | 117 ms                         | 102 ms: 1.14x faster (-12%)  |
+-------------------------+--------------------------------+------------------------------+
| genshi_text             | 29.1 ms                        | 25.6 ms: 1.14x faster (-12%) |
+-------------------------+--------------------------------+------------------------------+
| genshi_xml              | 60.2 ms                        | 53.2 ms: 1.13x faster (-12%) |
+-------------------------+--------------------------------+------------------------------+
| 2to3                    | 314 ms                         | 278 ms: 1.13x faster (-11%)  |
+-------------------------+--------------------------------+------------------------------+
| crypto_pyaes            | 107 ms                         | 95.5 ms: 1.12x faster (-11%) |
+-------------------------+--------------------------------+------------------------------+
| unpickle                | 12.6 us                        | 11.2 us: 1.12x faster (-11%) |
+-------------------------+--------------------------------+------------------------------+
| python_startup          | 9.21 ms                        | 8.21 ms: 1.12x faster (-11%) |
+-------------------------+--------------------------------+------------------------------+
| meteor_contest          | 99.0 ms                        | 88.4 ms: 1.12x faster (-11%) |
+-------------------------+--------------------------------+------------------------------+
| regex_v8                | 20.5 ms                        | 18.4 ms: 1.12x faster (-10%) |
+-------------------------+--------------------------------+------------------------------+
| sqlalchemy_imperative   | 33.1 ms                        | 29.6 ms: 1.12x faster (-10%) |
+-------------------------+--------------------------------+------------------------------+
| pickle_list             | 3.27 us                        | 2.95 us: 1.11x faster (-10%) |
+-------------------------+--------------------------------+------------------------------+
| regex_dna               | 161 ms                         | 147 ms: 1.10x faster (-9%)   |
+-------------------------+--------------------------------+------------------------------+
| xml_etree_iterparse     | 96.2 ms                        | 87.7 ms: 1.10x faster (-9%)  |
+-------------------------+--------------------------------+------------------------------+
| json_loads              | 23.7 us                        | 22.0 us: 1.08x faster (-7%)  |
+-------------------------+--------------------------------+------------------------------+
| json_dumps              | 11.4 ms                        | 10.8 ms: 1.05x faster (-5%)  |
+-------------------------+--------------------------------+------------------------------+
| dulwich_log             | 66.4 ms                        | 63.2 ms: 1.05x faster (-5%)  |
+-------------------------+--------------------------------+------------------------------+
| tornado_http            | 154 ms                         | 147 ms: 1.05x faster (-5%)   |
+-------------------------+--------------------------------+------------------------------+
| pathlib                 | 18.7 ms                        | 18.0 ms: 1.04x faster (-4%)  |
+-------------------------+--------------------------------+------------------------------+
| pickle                  | 8.77 us                        | 8.46 us: 1.04x faster (-4%)  |
+-------------------------+--------------------------------+------------------------------+
| sqlite_synth            | 2.59 us                        | 2.52 us: 1.03x faster (-3%)  |
+-------------------------+--------------------------------+------------------------------+
| sqlalchemy_declarative  | 159 ms                         | 156 ms: 1.02x faster (-2%)   |
+-------------------------+--------------------------------+------------------------------+
| xml_etree_parse         | 127 ms                         | 125 ms: 1.02x faster (-2%)   |
+-------------------------+--------------------------------+------------------------------+
| pidigits                | 155 ms                         | 156 ms: 1.01x slower (+1%)   |
+-------------------------+--------------------------------+------------------------------+
| regex_effbot            | 2.56 ms                        | 2.67 ms: 1.04x slower (+4%)  |
+-------------------------+--------------------------------+------------------------------+

Not significant (2): telco; unpack_sequence