Skip to content

Instantly share code, notes, and snippets.

@jeethu

jeethu/comparison.txt

Created January 24, 2019 09:37
Show Gist options
  • Save jeethu/fa3ec3335ee8b55caaac875231913720 to your computer and use it in GitHub Desktop.
Save jeethu/fa3ec3335ee8b55caaac875231913720 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
comparison.txt
3.8_baseline4.json
==================
Performance version: 0.7.0
Report on Linux-4.15.0-43-generic-x86_64-with-glibc2.26
Number of logical CPUs: 4
Start date: 2019-01-23 23:27:43.675291
End date: 2019-01-24 00:00:30.138941
3.8_load_const_ref4.json
========================
Performance version: 0.7.0
Report on Linux-4.15.0-43-generic-x86_64-with-glibc2.26
Number of logical CPUs: 4
Start date: 2019-01-23 22:12:03.080526
End date: 2019-01-23 22:44:45.446660
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| Benchmark | 3.8_baseline4.json | 3.8_load_const_ref4.json | Change | Significance |
+=========================+====================+==========================+==============+========================+
| 2to3 | 306 ms | 304 ms | 1.01x faster | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| chaos | 112 ms | 112 ms | 1.00x faster | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| crypto_pyaes | 118 ms | 116 ms | 1.01x faster | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| deltablue | 7.23 ms | 7.23 ms | 1.00x faster | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| django_template | 118 ms | 123 ms | 1.04x slower | Significant (t=-7.57) |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| dulwich_log | 76.4 ms | 76.1 ms | 1.00x faster | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| fannkuch | 466 ms | 470 ms | 1.01x slower | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| float | 112 ms | 112 ms | 1.00x faster | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| go | 248 ms | 243 ms | 1.02x faster | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| hexiom | 9.99 ms | 9.99 ms | 1.00x slower | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| html5lib | 94.4 ms | 92.8 ms | 1.02x faster | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| json_dumps | 12.1 ms | 12.1 ms | 1.01x faster | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| json_loads | 26.5 us | 25.8 us | 1.03x faster | Significant (t=15.65) |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| logging_format | 10.1 us | 9.98 us | 1.01x faster | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| logging_silent | 204 ns | 204 ns | 1.00x slower | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| logging_simple | 9.06 us | 8.98 us | 1.01x faster | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| mako | 15.6 ms | 15.6 ms | 1.00x slower | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| meteor_contest | 105 ms | 106 ms | 1.01x slower | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| nbody | 130 ms | 132 ms | 1.01x slower | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| nqueens | 96.3 ms | 98.2 ms | 1.02x slower | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| pathlib | 20.6 ms | 20.6 ms | 1.00x faster | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| pickle | 8.39 us | 8.05 us | 1.04x faster | Significant (t=3.97) |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| pickle_dict | 21.2 us | 21.2 us | 1.00x faster | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| pickle_list | 2.99 us | 2.97 us | 1.00x faster | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| pickle_pure_python | 457 us | 450 us | 1.02x faster | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| pidigits | 164 ms | 163 ms | 1.00x faster | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| python_startup | 7.46 ms | 7.44 ms | 1.00x faster | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| python_startup_no_site | 5.21 ms | 5.19 ms | 1.00x faster | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| raytrace | 491 ms | 485 ms | 1.01x faster | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| regex_compile | 184 ms | 185 ms | 1.01x slower | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| regex_dna | 157 ms | 156 ms | 1.01x faster | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| regex_effbot | 2.95 ms | 2.89 ms | 1.02x faster | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| regex_v8 | 22.0 ms | 22.1 ms | 1.01x slower | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| richards | 69.4 ms | 68.3 ms | 1.02x faster | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| scimark_fft | 366 ms | 363 ms | 1.01x faster | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| scimark_lu | 173 ms | 172 ms | 1.00x faster | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| scimark_monte_carlo | 104 ms | 103 ms | 1.01x faster | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| scimark_sor | 198 ms | 198 ms | 1.00x slower | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| scimark_sparse_mat_mult | 4.51 ms | 4.54 ms | 1.01x slower | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| spectral_norm | 136 ms | 138 ms | 1.01x slower | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| sqlalchemy_declarative | 161 ms | 162 ms | 1.01x slower | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| sqlalchemy_imperative | 31.2 ms | 31.9 ms | 1.02x slower | Significant (t=-6.66) |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| sqlite_synth | 2.96 us | 2.96 us | 1.00x slower | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| sympy_expand | 415 ms | 418 ms | 1.01x slower | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| sympy_integrate | 19.0 ms | 19.0 ms | 1.00x slower | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| sympy_str | 192 ms | 193 ms | 1.00x slower | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| sympy_sum | 101 ms | 102 ms | 1.01x slower | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| telco | 6.12 ms | 6.10 ms | 1.00x faster | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| tornado_http | 186 ms | 188 ms | 1.01x slower | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| unpack_sequence | 48.8 ns | 49.5 ns | 1.01x slower | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| unpickle | 13.4 us | 13.4 us | 1.01x slower | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| unpickle_list | 3.85 us | 3.72 us | 1.04x faster | Significant (t=14.13) |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| unpickle_pure_python | 350 us | 366 us | 1.04x slower | Significant (t=-17.56) |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| xml_etree_generate | 97.5 ms | 97.1 ms | 1.00x faster | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| xml_etree_iterparse | 94.3 ms | 93.8 ms | 1.01x faster | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| xml_etree_parse | 134 ms | 134 ms | 1.00x faster | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
| xml_etree_process | 78.6 ms | 77.6 ms | 1.01x faster | Not significant |
+-------------------------+--------------------+--------------------------+--------------+------------------------+
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment