Skip to content

Instantly share code, notes, and snippets.

@carljm

carljm/gist:0ce27bcdb9e026defcba100e452a8ce2

Created February 13, 2023 16:42
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save carljm/0ce27bcdb9e026defcba100e452a8ce2 to your computer and use it in GitHub Desktop.
Save carljm/0ce27bcdb9e026defcba100e452a8ce2 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
gistfile1.txt
mainopt.json
============
Performance version: 1.0.6
Report on Linux-5.15.0-1028-aws-x86_64-with-glibc2.31
Number of logical CPUs: 72
Start date: 2023-02-13 15:59:52.702512
End date: 2023-02-13 16:37:24.927583
ic2opt.json
===========
Performance version: 1.0.6
Report on Linux-5.15.0-1028-aws-x86_64-with-glibc2.31
Number of logical CPUs: 72
Start date: 2023-02-13 15:05:58.971659
End date: 2023-02-13 15:43:16.543970
+-------------------------+--------------+-------------+--------------+------------------------+
| Benchmark | mainopt.json | ic2opt.json | Change | Significance |
+=========================+==============+=============+==============+========================+
| 2to3 | 296 ms | 296 ms | 1.00x slower | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| async_generators | 438 ms | 441 ms | 1.01x slower | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| async_tree_cpu_io_mixed | 803 ms | 816 ms | 1.02x slower | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| async_tree_io | 1.42 sec | 1.36 sec | 1.05x faster | Significant (t=29.60) |
+-------------------------+--------------+-------------+--------------+------------------------+
| async_tree_memoization | 685 ms | 656 ms | 1.04x faster | Significant (t=18.80) |
+-------------------------+--------------+-------------+--------------+------------------------+
| async_tree_none | 564 ms | 542 ms | 1.04x faster | Significant (t=9.25) |
+-------------------------+--------------+-------------+--------------+------------------------+
| bench_mp_pool | 20.3 ms | 19.7 ms | 1.03x faster | Significant (t=2.63) |
+-------------------------+--------------+-------------+--------------+------------------------+
| bench_thread_pool | 3.44 ms | 3.40 ms | 1.01x faster | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| chameleon | 6.88 ms | 6.92 ms | 1.01x slower | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| chaos | 76.9 ms | 75.6 ms | 1.02x faster | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| coroutines | 25.8 ms | 25.5 ms | 1.01x faster | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| coverage | 81.7 ms | 83.8 ms | 1.03x slower | Significant (t=-9.87) |
+-------------------------+--------------+-------------+--------------+------------------------+
| crypto_pyaes | 80.8 ms | 79.3 ms | 1.02x faster | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| deepcopy | 379 us | 369 us | 1.03x faster | Significant (t=19.68) |
+-------------------------+--------------+-------------+--------------+------------------------+
| deepcopy_memo | 37.7 us | 37.0 us | 1.02x faster | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| deepcopy_reduce | 3.42 us | 3.39 us | 1.01x faster | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| deltablue | 3.54 ms | 3.44 ms | 1.03x faster | Significant (t=12.71) |
+-------------------------+--------------+-------------+--------------+------------------------+
| docutils | 2.71 sec | 2.71 sec | 1.00x faster | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| dulwich_log | 71.4 ms | 72.2 ms | 1.01x slower | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| fannkuch | 435 ms | 440 ms | 1.01x slower | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| float | 84.5 ms | 83.7 ms | 1.01x faster | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| generators | 32.5 ms | 33.0 ms | 1.01x slower | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| genshi_text | 23.0 ms | 22.8 ms | 1.01x faster | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| genshi_xml | 52.0 ms | 52.1 ms | 1.00x slower | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| go | 146 ms | 146 ms | 1.00x slower | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| hexiom | 6.69 ms | 6.71 ms | 1.00x slower | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| html5lib | 64.9 ms | 66.4 ms | 1.02x slower | Significant (t=-2.83) |
+-------------------------+--------------+-------------+--------------+------------------------+
| json_dumps | 10.4 ms | 10.3 ms | 1.00x faster | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| json_loads | 26.5 us | 26.5 us | 1.00x slower | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| logging_format | 7.67 us | 7.86 us | 1.02x slower | Significant (t=-7.71) |
+-------------------------+--------------+-------------+--------------+------------------------+
| logging_silent | 109 ns | 105 ns | 1.04x faster | Significant (t=19.13) |
+-------------------------+--------------+-------------+--------------+------------------------+
| logging_simple | 7.01 us | 7.22 us | 1.03x slower | Significant (t=-14.73) |
+-------------------------+--------------+-------------+--------------+------------------------+
| mako | 11.4 ms | 11.4 ms | 1.01x slower | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| mdp | 2.93 sec | 2.91 sec | 1.01x faster | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| meteor_contest | 115 ms | 114 ms | 1.01x faster | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| nbody | 103 ms | 102 ms | 1.01x faster | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| nqueens | 91.3 ms | 91.6 ms | 1.00x slower | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| pathlib | 23.5 ms | 24.2 ms | 1.03x slower | Significant (t=-9.55) |
+-------------------------+--------------+-------------+--------------+------------------------+
| pickle | 10.9 us | 10.9 us | 1.00x slower | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| pickle_dict | 32.6 us | 32.3 us | 1.01x faster | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| pickle_list | 4.32 us | 4.27 us | 1.01x faster | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| pickle_pure_python | 311 us | 314 us | 1.01x slower | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| pidigits | 210 ms | 211 ms | 1.00x slower | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| pprint_pformat | 1.60 sec | 1.63 sec | 1.02x slower | Significant (t=-17.08) |
+-------------------------+--------------+-------------+--------------+------------------------+
| pprint_safe_repr | 788 ms | 798 ms | 1.01x slower | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| pyflate | 460 ms | 464 ms | 1.01x slower | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| python_startup | 23.3 ms | 23.2 ms | 1.00x faster | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| python_startup_no_site | 19.8 ms | 19.6 ms | 1.01x faster | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| raytrace | 333 ms | 328 ms | 1.02x faster | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| regex_compile | 144 ms | 145 ms | 1.01x slower | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| regex_dna | 195 ms | 198 ms | 1.01x slower | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| regex_effbot | 3.52 ms | 3.49 ms | 1.01x faster | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| regex_v8 | 23.6 ms | 23.0 ms | 1.03x faster | Significant (t=33.55) |
+-------------------------+--------------+-------------+--------------+------------------------+
| richards | 47.1 ms | 47.4 ms | 1.01x slower | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| scimark_fft | 373 ms | 378 ms | 1.01x slower | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| scimark_lu | 126 ms | 128 ms | 1.02x slower | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| scimark_monte_carlo | 73.8 ms | 73.3 ms | 1.01x faster | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| scimark_sor | 125 ms | 125 ms | 1.00x faster | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| scimark_sparse_mat_mult | 4.83 ms | 4.82 ms | 1.00x faster | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| spectral_norm | 123 ms | 122 ms | 1.01x faster | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| sqlglot_normalize | 125 ms | 122 ms | 1.03x faster | Significant (t=24.42) |
+-------------------------+--------------+-------------+--------------+------------------------+
| sqlglot_optimize | 60.4 ms | 59.9 ms | 1.01x faster | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| sqlglot_parse | 1.63 ms | 1.62 ms | 1.01x faster | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| sqlglot_transpile | 1.95 ms | 1.93 ms | 1.01x faster | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| sqlite_synth | 2.89 us | 2.84 us | 1.02x faster | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| telco | 7.08 ms | 7.02 ms | 1.01x faster | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| tornado_http | 154 ms | 153 ms | 1.01x faster | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| unpack_sequence | 45.0 ns | 45.5 ns | 1.01x slower | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| unpickle | 15.0 us | 14.6 us | 1.03x faster | Significant (t=5.84) |
+-------------------------+--------------+-------------+--------------+------------------------+
| unpickle_list | 5.53 us | 5.56 us | 1.00x slower | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| unpickle_pure_python | 234 us | 235 us | 1.00x slower | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| xml_etree_generate | 95.7 ms | 98.6 ms | 1.03x slower | Significant (t=-15.06) |
+-------------------------+--------------+-------------+--------------+------------------------+
| xml_etree_iterparse | 111 ms | 109 ms | 1.02x faster | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| xml_etree_parse | 149 ms | 149 ms | 1.00x slower | Not significant |
+-------------------------+--------------+-------------+--------------+------------------------+
| xml_etree_process | 66.4 ms | 68.1 ms | 1.03x slower | Significant (t=-12.11) |
+-------------------------+--------------+-------------+--------------+------------------------+
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment