Skip to content

Instantly share code, notes, and snippets.

@cburgdorf

cburgdorf/lahja benchmark

Created January 22, 2020 08:02
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save cburgdorf/a4b906e77717f06e8affc74e5ffecf56 to your computer and use it in GitHub Desktop.
Save cburgdorf/a4b906e77717f06e8affc74e5ffecf56 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
lahja benchmark
benchmark run-test: commands[0] | bash -c 'python /home/circleci/repo/scripts/perf_benchmark.py --num-processes 10 --num-events 10000 --backend asyncio --backend trio'
+++ASYNCIO+++
+++Globals+++
|Consumer processes | Total time | Total aggegated time | Propagated events |Received events | Propagated EPS | Received EPS |
| 10 | 1.87429 | 15.36448 | 10000 | 100000 | 5335.353 | 53353.530 |
+++Process Details+++
| Process |Processed Events| First sent | Last received | Fastest | Slowest | AVG | Total duration | Total aggregated time |
| consumer_6 | 10000 | 17:14:09.988 | 17:14:11.786 | 0.00007 | 0.00082 | 0.00008 | 1.79834 | 0.76925 |
| consumer_4 | 10000 | 17:14:09.988 | 17:14:11.786 | 0.00021 | 0.00097 | 0.00022 | 1.79848 | 2.19549 |
| consumer_3 | 10000 | 17:14:09.988 | 17:14:11.786 | 0.00019 | 0.00094 | 0.00021 | 1.79846 | 2.09478 |
| consumer_7 | 10000 | 17:14:09.988 | 17:14:11.786 | 0.00013 | 0.00090 | 0.00015 | 1.79840 | 1.51430 |
| consumer_0 | 10000 | 17:14:09.988 | 17:14:11.786 | 0.00015 | 0.00091 | 0.00017 | 1.79845 | 1.66746 |
| consumer_9 | 10000 | 17:14:09.988 | 17:14:11.786 | 0.00018 | 0.00093 | 0.00019 | 1.79849 | 1.92236 |
| consumer_8 | 10000 | 17:14:09.988 | 17:14:11.786 | 0.00012 | 0.00087 | 0.00013 | 1.79843 | 1.26846 |
| consumer_5 | 10000 | 17:14:09.988 | 17:14:11.786 | 0.00016 | 0.00093 | 0.00018 | 1.79848 | 1.80208 |
| consumer_1 | 10000 | 17:14:09.988 | 17:14:11.786 | 0.00009 | 0.00081 | 0.00010 | 1.79837 | 0.98352 |
| consumer_2 | 10000 | 17:14:09.988 | 17:14:11.786 | 0.00010 | 0.00086 | 0.00011 | 1.79841 | 1.14679 |
+++TRIO+++
+++Globals+++
|Consumer processes | Total time | Total aggegated time | Propagated events |Received events | Propagated EPS | Received EPS |
| 10 | 6.41324 | 44.62545 | 10000 | 100000 | 1559.275 | 15592.752 |
+++Process Details+++
| Process |Processed Events| First sent | Last received | Fastest | Slowest | AVG | Total duration | Total aggregated time |
| consumer_3 | 10000 | 17:14:12.251 | 17:14:18.626 | 0.00019 | 0.00122 | 0.00022 | 6.37508 | 2.20386 |
| consumer_0 | 10000 | 17:14:12.251 | 17:14:18.626 | 0.00044 | 0.00128 | 0.00046 | 6.37533 | 4.55047 |
| consumer_7 | 10000 | 17:14:12.251 | 17:14:18.626 | 0.00039 | 0.00144 | 0.00043 | 6.37527 | 4.26668 |
| consumer_6 | 10000 | 17:14:12.251 | 17:14:18.626 | 0.00025 | 0.00110 | 0.00026 | 6.37518 | 2.63172 |
| consumer_8 | 10000 | 17:14:12.251 | 17:14:18.626 | 0.00053 | 0.00163 | 0.00058 | 6.37542 | 5.75619 |
| consumer_9 | 10000 | 17:14:12.251 | 17:14:18.626 | 0.00048 | 0.00132 | 0.00051 | 6.37555 | 5.13187 |
| consumer_2 | 10000 | 17:14:12.251 | 17:14:18.626 | 0.00029 | 0.00135 | 0.00033 | 6.37518 | 3.34681 |
| consumer_5 | 10000 | 17:14:12.251 | 17:14:18.626 | 0.00034 | 0.00120 | 0.00039 | 6.37528 | 3.85777 |
| consumer_4 | 10000 | 17:14:12.251 | 17:14:18.627 | 0.00058 | 0.00144 | 0.00062 | 6.37564 | 6.19352 |
| consumer_1 | 10000 | 17:14:12.251 | 17:14:18.626 | 0.00063 | 0.00149 | 0.00067 | 6.37552 | 6.68655 |
benchmark run-test: commands[1] | bash -c 'python /home/circleci/repo/scripts/perf_benchmark.py --num-processes 10 --num-events 10000 --throttle 0.001 --backend asyncio --backend trio'
+++ASYNCIO+++
+++Globals+++
|Consumer processes | Total time | Total aggegated time | Propagated events |Received events | Propagated EPS | Received EPS |
| 10 | 13.88872 | 35.83829 | 10000 | 100000 | 720.009 | 7200.087 |
+++Process Details+++
| Process |Processed Events| First sent | Last received | Fastest | Slowest | AVG | Total duration | Total aggregated time |
| consumer_6 | 10000 | 17:14:19.258 | 17:14:33.069 | 0.00010 | 0.00099 | 0.00028 | 13.81065 | 2.75645 |
| consumer_0 | 10000 | 17:14:19.258 | 17:14:33.069 | 0.00018 | 0.00098 | 0.00039 | 13.81073 | 3.92355 |
| consumer_7 | 10000 | 17:14:19.258 | 17:14:33.069 | 0.00016 | 0.00109 | 0.00038 | 13.81072 | 3.75446 |
| consumer_2 | 10000 | 17:14:19.258 | 17:14:33.069 | 0.00013 | 0.00380 | 0.00033 | 13.81068 | 3.30450 |
| consumer_9 | 10000 | 17:14:19.258 | 17:14:33.069 | 0.00021 | 0.00116 | 0.00044 | 13.81082 | 4.37337 |
| consumer_3 | 10000 | 17:14:19.258 | 17:14:33.069 | 0.00023 | 0.00099 | 0.00045 | 13.81085 | 4.49327 |
| consumer_8 | 10000 | 17:14:19.258 | 17:14:33.069 | 0.00015 | 0.00108 | 0.00035 | 13.81069 | 3.45349 |
| consumer_5 | 10000 | 17:14:19.258 | 17:14:33.069 | 0.00019 | 0.00138 | 0.00041 | 13.81077 | 4.14074 |
| consumer_1 | 10000 | 17:14:19.258 | 17:14:33.069 | 0.00012 | 0.00104 | 0.00031 | 13.81067 | 3.09096 |
| consumer_4 | 10000 | 17:14:19.258 | 17:14:33.069 | 0.00008 | 0.00099 | 0.00025 | 13.81066 | 2.54750 |
+++TRIO+++
+++Globals+++
|Consumer processes | Total time | Total aggegated time | Propagated events |Received events | Propagated EPS | Received EPS |
| 10 | 19.20365 | 65.30475 | 10000 | 100000 | 520.734 | 5207.343 |
+++Process Details+++
| Process |Processed Events| First sent | Last received | Fastest | Slowest | AVG | Total duration | Total aggregated time |
| consumer_1 | 10000 | 17:14:33.531 | 17:14:52.668 | 0.00021 | 0.00729 | 0.00039 | 19.13730 | 3.92933 |
| consumer_3 | 10000 | 17:14:33.531 | 17:14:52.668 | 0.00036 | 0.00757 | 0.00057 | 19.13747 | 5.70091 |
| consumer_8 | 10000 | 17:14:33.531 | 17:14:52.668 | 0.00056 | 0.00767 | 0.00079 | 19.13766 | 7.91060 |
| consumer_2 | 10000 | 17:14:33.531 | 17:14:52.668 | 0.00051 | 0.00761 | 0.00074 | 19.13762 | 7.39665 |
| consumer_7 | 10000 | 17:14:33.531 | 17:14:52.668 | 0.00031 | 0.00741 | 0.00052 | 19.13745 | 5.21946 |
| consumer_4 | 10000 | 17:14:33.531 | 17:14:52.668 | 0.00026 | 0.00735 | 0.00046 | 19.13742 | 4.55356 |
| consumer_9 | 10000 | 17:14:33.531 | 17:14:52.668 | 0.00046 | 0.00758 | 0.00069 | 19.13766 | 6.87109 |
| consumer_6 | 10000 | 17:14:33.531 | 17:14:52.668 | 0.00041 | 0.00758 | 0.00064 | 19.13762 | 6.38118 |
| consumer_5 | 10000 | 17:14:33.531 | 17:14:52.668 | 0.00061 | 0.00777 | 0.00084 | 19.13783 | 8.44749 |
| consumer_0 | 10000 | 17:14:33.531 | 17:14:52.669 | 0.00066 | 0.00777 | 0.00089 | 19.13790 | 8.89447 |
benchmark run-test: commands[2] | bash -c 'python /home/circleci/repo/scripts/perf_benchmark.py --num-processes 10 --num-events 100 --backend asyncio --backend trio'
+++ASYNCIO+++
+++Globals+++
|Consumer processes | Total time | Total aggegated time | Propagated events |Received events | Propagated EPS | Received EPS |
| 10 | 0.07732 | 0.15441 | 100 | 1000 | 1293.321 | 12933.208 |
+++Process Details+++
| Process |Processed Events| First sent | Last received | Fastest | Slowest | AVG | Total duration | Total aggregated time |
| consumer_8 | 100 | 17:14:53.381 | 17:14:53.399 | 0.00007 | 0.00037 | 0.00008 | 0.01804 | 0.00821 |
| consumer_7 | 100 | 17:14:53.381 | 17:14:53.399 | 0.00009 | 0.00040 | 0.00010 | 0.01806 | 0.00987 |
| consumer_0 | 100 | 17:14:53.381 | 17:14:53.399 | 0.00012 | 0.00044 | 0.00013 | 0.01809 | 0.01323 |
| consumer_1 | 100 | 17:14:53.381 | 17:14:53.399 | 0.00013 | 0.00056 | 0.00015 | 0.01810 | 0.01458 |
| consumer_2 | 100 | 17:14:53.381 | 17:14:53.399 | 0.00015 | 0.00056 | 0.00016 | 0.01812 | 0.01610 |
| consumer_3 | 100 | 17:14:53.381 | 17:14:53.399 | 0.00017 | 0.00056 | 0.00018 | 0.01814 | 0.01820 |
| consumer_4 | 100 | 17:14:53.381 | 17:14:53.399 | 0.00018 | 0.00059 | 0.00019 | 0.01814 | 0.01946 |
| consumer_5 | 100 | 17:14:53.381 | 17:14:53.400 | 0.00020 | 0.00059 | 0.00021 | 0.01817 | 0.02125 |
| consumer_9 | 100 | 17:14:53.381 | 17:14:53.400 | 0.00021 | 0.00048 | 0.00022 | 0.01818 | 0.02235 |
| consumer_6 | 100 | 17:14:53.381 | 17:14:53.399 | 0.00010 | 0.00019 | 0.00011 | 0.01810 | 0.01116 |
+++TRIO+++
+++Globals+++
|Consumer processes | Total time | Total aggegated time | Propagated events |Received events | Propagated EPS | Received EPS |
| 10 | 0.12213 | 0.45095 | 100 | 1000 | 818.826 | 8188.258 |
+++Process Details+++
| Process |Processed Events| First sent | Last received | Fastest | Slowest | AVG | Total duration | Total aggregated time |
| consumer_7 | 100 | 17:14:53.849 | 17:14:53.913 | 0.00020 | 0.00042 | 0.00021 | 0.06405 | 0.02112 |
| consumer_8 | 100 | 17:14:53.849 | 17:14:53.913 | 0.00030 | 0.00056 | 0.00032 | 0.06416 | 0.03206 |
| consumer_6 | 100 | 17:14:53.849 | 17:14:53.913 | 0.00039 | 0.00065 | 0.00041 | 0.06425 | 0.04134 |
| consumer_1 | 100 | 17:14:53.849 | 17:14:53.913 | 0.00059 | 0.00086 | 0.00061 | 0.06444 | 0.06113 |
| consumer_2 | 100 | 17:14:53.849 | 17:14:53.913 | 0.00049 | 0.00074 | 0.00051 | 0.06435 | 0.05135 |
| consumer_9 | 100 | 17:14:53.849 | 17:14:53.913 | 0.00044 | 0.00057 | 0.00046 | 0.06430 | 0.04621 |
| consumer_4 | 100 | 17:14:53.849 | 17:14:53.913 | 0.00025 | 0.00049 | 0.00032 | 0.06420 | 0.03241 |
| consumer_0 | 100 | 17:14:53.849 | 17:14:53.913 | 0.00054 | 0.00082 | 0.00056 | 0.06441 | 0.05629 |
| consumer_3 | 100 | 17:14:53.849 | 17:14:53.913 | 0.00063 | 0.00090 | 0.00066 | 0.06449 | 0.06611 |
| consumer_5 | 100 | 17:14:53.849 | 17:14:53.913 | 0.00035 | 0.00059 | 0.00043 | 0.06434 | 0.04294 |
benchmark run-test: commands[3] | bash -c 'python /home/circleci/repo/scripts/perf_benchmark.py --num-processes 10 --num-events 10 --backend asyncio --backend trio'
+++ASYNCIO+++
+++Globals+++
|Consumer processes | Total time | Total aggegated time | Propagated events |Received events | Propagated EPS | Received EPS |
| 10 | 0.05427 | 0.01805 | 10 | 100 | 184.255 | 1842.549 |
+++Process Details+++
| Process |Processed Events| First sent | Last received | Fastest | Slowest | AVG | Total duration | Total aggregated time |
| consumer_2 | 10 | 17:14:54.530 | 17:14:54.532 | 0.00011 | 0.00022 | 0.00013 | 0.00186 | 0.00129 |
| consumer_6 | 10 | 17:14:54.530 | 17:14:54.532 | 0.00007 | 0.00030 | 0.00010 | 0.00182 | 0.00102 |
| consumer_1 | 10 | 17:14:54.530 | 17:14:54.532 | 0.00009 | 0.00035 | 0.00013 | 0.00184 | 0.00129 |
| consumer_8 | 10 | 17:14:54.530 | 17:14:54.532 | 0.00012 | 0.00040 | 0.00016 | 0.00187 | 0.00163 |
| consumer_0 | 10 | 17:14:54.530 | 17:14:54.532 | 0.00015 | 0.00043 | 0.00020 | 0.00190 | 0.00195 |
| consumer_7 | 10 | 17:14:54.530 | 17:14:54.532 | 0.00014 | 0.00042 | 0.00019 | 0.00189 | 0.00186 |
| consumer_3 | 10 | 17:14:54.530 | 17:14:54.532 | 0.00020 | 0.00035 | 0.00022 | 0.00195 | 0.00225 |
| consumer_9 | 10 | 17:14:54.530 | 17:14:54.532 | 0.00018 | 0.00046 | 0.00022 | 0.00193 | 0.00224 |
| consumer_5 | 10 | 17:14:54.530 | 17:14:54.532 | 0.00017 | 0.00045 | 0.00021 | 0.00192 | 0.00211 |
| consumer_4 | 10 | 17:14:54.530 | 17:14:54.532 | 0.00021 | 0.00041 | 0.00024 | 0.00196 | 0.00242 |
+++TRIO+++
+++Globals+++
|Consumer processes | Total time | Total aggegated time | Propagated events |Received events | Propagated EPS | Received EPS |
| 10 | 0.08892 | 0.04677 | 10 | 100 | 112.455 | 1124.551 |
+++Process Details+++
| Process |Processed Events| First sent | Last received | Fastest | Slowest | AVG | Total duration | Total aggregated time |
| consumer_3 | 10 | 17:14:55.025 | 17:14:55.031 | 0.00020 | 0.00044 | 0.00024 | 0.00605 | 0.00241 |
| consumer_2 | 10 | 17:14:55.025 | 17:14:55.031 | 0.00030 | 0.00060 | 0.00035 | 0.00619 | 0.00352 |
| consumer_9 | 10 | 17:14:55.025 | 17:14:55.031 | 0.00045 | 0.00054 | 0.00048 | 0.00633 | 0.00478 |
| consumer_5 | 10 | 17:14:55.025 | 17:14:55.031 | 0.00040 | 0.00060 | 0.00044 | 0.00629 | 0.00441 |
| consumer_8 | 10 | 17:14:55.025 | 17:14:55.031 | 0.00036 | 0.00059 | 0.00040 | 0.00627 | 0.00402 |
| consumer_6 | 10 | 17:14:55.025 | 17:14:55.031 | 0.00025 | 0.00048 | 0.00029 | 0.00612 | 0.00291 |
| consumer_4 | 10 | 17:14:55.025 | 17:14:55.032 | 0.00060 | 0.00078 | 0.00063 | 0.00648 | 0.00635 |
| consumer_7 | 10 | 17:14:55.025 | 17:14:55.031 | 0.00055 | 0.00080 | 0.00060 | 0.00643 | 0.00596 |
| consumer_0 | 10 | 17:14:55.025 | 17:14:55.031 | 0.00050 | 0.00079 | 0.00055 | 0.00636 | 0.00546 |
| consumer_1 | 10 | 17:14:55.025 | 17:14:55.032 | 0.00066 | 0.00092 | 0.00070 | 0.00652 | 0.00696 |
benchmark run-test: commands[4] | bash -c 'python /home/circleci/repo/scripts/perf_benchmark.py --num-processes 3 --num-events 10000 --backend asyncio --backend trio'
+++ASYNCIO+++
+++Globals+++
|Consumer processes | Total time | Total aggegated time | Propagated events |Received events | Propagated EPS | Received EPS |
| 3 | 0.69264 | 2.66242 | 10000 | 30000 | 14437.607 | 43312.822 |
+++Process Details+++
| Process |Processed Events| First sent | Last received | Fastest | Slowest | AVG | Total duration | Total aggregated time |
| consumer_1 | 10000 | 17:14:55.546 | 17:14:56.221 | 0.00006 | 0.00090 | 0.00007 | 0.67490 | 0.72128 |
| consumer_0 | 10000 | 17:14:55.546 | 17:14:56.221 | 0.00008 | 0.00091 | 0.00009 | 0.67491 | 0.89700 |
| consumer_2 | 10000 | 17:14:55.546 | 17:14:56.221 | 0.00009 | 0.00091 | 0.00010 | 0.67493 | 1.04413 |
+++TRIO+++
+++Globals+++
|Consumer processes | Total time | Total aggegated time | Propagated events |Received events | Propagated EPS | Received EPS |
| 3 | 2.89171 | 7.68917 | 10000 | 30000 | 3458.166 | 10374.498 |
+++Process Details+++
| Process |Processed Events| First sent | Last received | Fastest | Slowest | AVG | Total duration | Total aggregated time |
| consumer_2 | 10000 | 17:14:56.602 | 17:14:59.477 | 0.00024 | 0.00111 | 0.00026 | 2.87503 | 2.55827 |
| consumer_1 | 10000 | 17:14:56.602 | 17:14:59.478 | 0.00029 | 0.00126 | 0.00031 | 2.87508 | 3.13710 |
| consumer_0 | 10000 | 17:14:56.602 | 17:14:59.477 | 0.00019 | 0.00106 | 0.00020 | 2.87500 | 1.99380 |
benchmark run-test: commands[5] | bash -c 'python /home/circleci/repo/scripts/perf_benchmark.py --num-processes 3 --num-events 10000 --throttle 0.001 --backend asyncio --backend trio'
+++ASYNCIO+++
+++Globals+++
|Consumer processes | Total time | Total aggegated time | Propagated events |Received events | Propagated EPS | Received EPS |
| 3 | 12.05031 | 6.16624 | 10000 | 30000 | 829.854 | 2489.563 |
+++Process Details+++
| Process |Processed Events| First sent | Last received | Fastest | Slowest | AVG | Total duration | Total aggregated time |
| consumer_2 | 10000 | 17:15:00.049 | 17:15:12.035 | 0.00008 | 0.00083 | 0.00018 | 11.98631 | 1.77333 |
| consumer_1 | 10000 | 17:15:00.049 | 17:15:12.035 | 0.00009 | 0.00102 | 0.00021 | 11.98634 | 2.08674 |
| consumer_0 | 10000 | 17:15:00.049 | 17:15:12.035 | 0.00011 | 0.00105 | 0.00023 | 11.98635 | 2.30618 |
+++TRIO+++
+++Globals+++
|Consumer processes | Total time | Total aggegated time | Propagated events |Received events | Propagated EPS | Received EPS |
| 3 | 14.85292 | 12.41621 | 10000 | 30000 | 673.268 | 2019.805 |
+++Process Details+++
| Process |Processed Events| First sent | Last received | Fastest | Slowest | AVG | Total duration | Total aggregated time |
| consumer_1 | 10000 | 17:15:12.420 | 17:15:27.255 | 0.00021 | 0.00122 | 0.00035 | 14.83530 | 3.50930 |
| consumer_2 | 10000 | 17:15:12.420 | 17:15:27.255 | 0.00026 | 0.00118 | 0.00042 | 14.83537 | 4.15645 |
| consumer_0 | 10000 | 17:15:12.420 | 17:15:27.255 | 0.00031 | 0.00171 | 0.00048 | 14.83543 | 4.75046 |
benchmark run-test: commands[6] | bash -c 'python /home/circleci/repo/scripts/perf_benchmark.py --num-processes 3 --num-events 100 --backend asyncio --backend trio'
+++ASYNCIO+++
+++Globals+++
|Consumer processes | Total time | Total aggegated time | Propagated events |Received events | Propagated EPS | Received EPS |
| 3 | 0.05928 | 0.02795 | 100 | 300 | 1686.864 | 5060.593 |
+++Process Details+++
| Process |Processed Events| First sent | Last received | Fastest | Slowest | AVG | Total duration | Total aggregated time |
| consumer_0 | 100 | 17:15:27.828 | 17:15:27.835 | 0.00007 | 0.00034 | 0.00008 | 0.00671 | 0.00784 |
| consumer_1 | 100 | 17:15:27.828 | 17:15:27.835 | 0.00008 | 0.00017 | 0.00009 | 0.00673 | 0.00871 |
| consumer_2 | 100 | 17:15:27.828 | 17:15:27.835 | 0.00010 | 0.00043 | 0.00011 | 0.00676 | 0.01140 |
+++TRIO+++
+++Globals+++
|Consumer processes | Total time | Total aggegated time | Propagated events |Received events | Propagated EPS | Received EPS |
| 3 | 0.03457 | 0.07858 | 100 | 300 | 2892.304 | 8676.913 |
+++Process Details+++
| Process |Processed Events| First sent | Last received | Fastest | Slowest | AVG | Total duration | Total aggregated time |
| consumer_2 | 100 | 17:15:28.207 | 17:15:28.236 | 0.00019 | 0.00034 | 0.00021 | 0.02973 | 0.02072 |
| consumer_0 | 100 | 17:15:28.207 | 17:15:28.236 | 0.00024 | 0.00045 | 0.00026 | 0.02978 | 0.02617 |
| consumer_1 | 100 | 17:15:28.207 | 17:15:28.237 | 0.00029 | 0.00067 | 0.00032 | 0.02985 | 0.03169 |
benchmark run-test: commands[7] | bash -c 'python /home/circleci/repo/scripts/perf_benchmark.py --num-processes 3 --num-events 10 --backend asyncio --backend trio'
+++ASYNCIO+++
+++Globals+++
|Consumer processes | Total time | Total aggegated time | Propagated events |Received events | Propagated EPS | Received EPS |
| 3 | 0.05343 | 0.00445 | 10 | 30 | 187.149 | 561.446 |
+++Process Details+++
| Process |Processed Events| First sent | Last received | Fastest | Slowest | AVG | Total duration | Total aggregated time |
| consumer_0 | 10 | 17:15:28.808 | 17:15:28.809 | 0.00008 | 0.00018 | 0.00010 | 0.00075 | 0.00100 |
| consumer_1 | 10 | 17:15:28.808 | 17:15:28.809 | 0.00007 | 0.00035 | 0.00015 | 0.00074 | 0.00151 |
| consumer_2 | 10 | 17:15:28.808 | 17:15:28.809 | 0.00010 | 0.00040 | 0.00019 | 0.00077 | 0.00194 |
+++TRIO+++
+++Globals+++
|Consumer processes | Total time | Total aggegated time | Propagated events |Received events | Propagated EPS | Received EPS |
| 3 | 0.00836 | 0.00813 | 10 | 30 | 1196.253 | 3588.760 |
+++Process Details+++
| Process |Processed Events| First sent | Last received | Fastest | Slowest | AVG | Total duration | Total aggregated time |
| consumer_0 | 10 | 17:15:29.184 | 17:15:29.187 | 0.00020 | 0.00037 | 0.00023 | 0.00290 | 0.00226 |
| consumer_2 | 10 | 17:15:29.184 | 17:15:29.187 | 0.00025 | 0.00035 | 0.00027 | 0.00296 | 0.00271 |
| consumer_1 | 10 | 17:15:29.184 | 17:15:29.187 | 0.00030 | 0.00038 | 0.00032 | 0.00300 | 0.00316 |
benchmark run-test: commands[8] | bash -c 'python /home/circleci/repo/scripts/perf_benchmark.py --num-processes 3 --num-events 1000 --throttle 0.001 --payload-bytes 1000000 --backend asyncio --backend trio'
+++ASYNCIO+++
+++Globals+++
|Consumer processes | Total time | Total aggegated time | Propagated events |Received events | Propagated EPS | Received EPS |
| 3 | 6.70012 | 12.84277 | 1000 | 3000 | 149.251 | 447.753 |
+++Process Details+++
| Process |Processed Events| First sent | Last received | Fastest | Slowest | AVG | Total duration | Total aggregated time |
| consumer_0 | 1000 | 17:15:29.747 | 17:15:36.390 | 0.00171 | 0.00475 | 0.00244 | 6.64336 | 2.43814 |
| consumer_1 | 1000 | 17:15:29.747 | 17:15:36.392 | 0.00342 | 0.00718 | 0.00429 | 6.64522 | 4.29292 |
| consumer_2 | 1000 | 17:15:29.747 | 17:15:36.394 | 0.00505 | 0.00950 | 0.00611 | 6.64721 | 6.11171 |
+++TRIO+++
+++Globals+++
|Consumer processes | Total time | Total aggegated time | Propagated events |Received events | Propagated EPS | Received EPS |
| 3 | 4.59107 | 8.20258 | 1000 | 3000 | 217.814 | 653.442 |
+++Process Details+++
| Process |Processed Events| First sent | Last received | Fastest | Slowest | AVG | Total duration | Total aggregated time |
| consumer_0 | 1000 | 17:15:36.775 | 17:15:41.357 | 0.00139 | 0.00412 | 0.00166 | 4.58250 | 1.66449 |
| consumer_2 | 1000 | 17:15:36.775 | 17:15:41.358 | 0.00221 | 0.00620 | 0.00272 | 4.58355 | 2.72365 |
| consumer_1 | 1000 | 17:15:36.775 | 17:15:41.359 | 0.00313 | 0.00796 | 0.00381 | 4.58461 | 3.81444 |
benchmark run-test: commands[9] | bash -c 'python /home/circleci/repo/scripts/perf_benchmark.py --num-processes 3 --num-events 100 --payload-bytes 1000000 --backend asyncio --backend trio'
+++ASYNCIO+++
+++Globals+++
|Consumer processes | Total time | Total aggegated time | Propagated events |Received events | Propagated EPS | Received EPS |
| 3 | 0.66057 | 1.35165 | 100 | 300 | 151.384 | 454.151 |
+++Process Details+++
| Process |Processed Events| First sent | Last received | Fastest | Slowest | AVG | Total duration | Total aggregated time |
| consumer_2 | 100 | 17:15:41.943 | 17:15:42.525 | 0.00208 | 0.00418 | 0.00260 | 0.58143 | 0.25952 |
| consumer_0 | 100 | 17:15:41.943 | 17:15:42.527 | 0.00392 | 0.00654 | 0.00447 | 0.58381 | 0.44715 |
| consumer_1 | 100 | 17:15:41.943 | 17:15:42.530 | 0.00566 | 0.00899 | 0.00645 | 0.58653 | 0.64499 |
Exception ignored in: <coroutine object BaseDriverProcess.worker at 0x7f0af47e82b0>
RuntimeError: coroutine ignored GeneratorExit
+++TRIO+++
+++Globals+++
|Consumer processes | Total time | Total aggegated time | Propagated events |Received events | Propagated EPS | Received EPS |
| 3 | 0.36767 | 0.87719 | 100 | 300 | 271.981 | 815.944 |
+++Process Details+++
| Process |Processed Events| First sent | Last received | Fastest | Slowest | AVG | Total duration | Total aggregated time |
| consumer_1 | 100 | 17:15:42.919 | 17:15:43.271 | 0.00135 | 0.00394 | 0.00180 | 0.35237 | 0.18010 |
| consumer_2 | 100 | 17:15:42.919 | 17:15:43.272 | 0.00247 | 0.00629 | 0.00297 | 0.35322 | 0.29702 |
| consumer_0 | 100 | 17:15:42.919 | 17:15:43.273 | 0.00310 | 0.00808 | 0.00400 | 0.35418 | 0.40007 |
benchmark run-test: commands[10] | bash -c 'python /home/circleci/repo/scripts/perf_benchmark.py --num-processes 3 --num-events 10 --payload-bytes 1000000 --backend asyncio --backend trio'
+++ASYNCIO+++
+++Globals+++
|Consumer processes | Total time | Total aggegated time | Propagated events |Received events | Propagated EPS | Received EPS |
| 3 | 0.11880 | 0.15392 | 10 | 30 | 84.178 | 252.533 |
+++Process Details+++
| Process |Processed Events| First sent | Last received | Fastest | Slowest | AVG | Total duration | Total aggregated time |
| consumer_2 | 10 | 17:15:43.844 | 17:15:43.906 | 0.00217 | 0.00429 | 0.00295 | 0.06180 | 0.02952 |
| consumer_0 | 10 | 17:15:43.844 | 17:15:43.908 | 0.00415 | 0.00693 | 0.00513 | 0.06378 | 0.05128 |
| consumer_1 | 10 | 17:15:43.844 | 17:15:43.910 | 0.00644 | 0.00979 | 0.00731 | 0.06607 | 0.07312 |
+++TRIO+++
+++Globals+++
|Consumer processes | Total time | Total aggegated time | Propagated events |Received events | Propagated EPS | Received EPS |
| 3 | 0.04222 | 0.09697 | 10 | 30 | 236.833 | 710.498 |
+++Process Details+++
| Process |Processed Events| First sent | Last received | Fastest | Slowest | AVG | Total duration | Total aggregated time |
| consumer_1 | 10 | 17:15:44.285 | 17:15:44.321 | 0.00136 | 0.00392 | 0.00212 | 0.03571 | 0.02120 |
| consumer_2 | 10 | 17:15:44.285 | 17:15:44.322 | 0.00234 | 0.00629 | 0.00326 | 0.03668 | 0.03258 |
| consumer_0 | 10 | 17:15:44.285 | 17:15:44.323 | 0.00332 | 0.00773 | 0.00432 | 0.03766 | 0.04319 |
benchmark run-test: commands[11] | bash -c 'python /home/circleci/repo/scripts/perf_benchmark.py --num-processes 3 --num-events 1000 --mode request'
+++ASYNCIO+++
+++Globals+++
|Consumer processes | Total time | Total aggegated time | Propagated events |Received events | Propagated EPS | Received EPS |
| 3 | 0.27262 | 0.43839 | 1000 | 3000 | 3668.100 | 11004.301 |
+++Process Details+++
| Process |Processed Events| First sent | Last received | Fastest | Slowest | AVG | Total duration | Total aggregated time |
| consumer_1 | 1000 | 17:15:44.891 | 17:15:45.128 | 0.00012 | 0.00037 | 0.00013 | 0.23691 | 0.12765 |
| consumer_2 | 1000 | 17:15:44.891 | 17:15:45.128 | 0.00014 | 0.00031 | 0.00014 | 0.23692 | 0.14472 |
| consumer_0 | 1000 | 17:15:44.891 | 17:15:45.128 | 0.00016 | 0.00041 | 0.00017 | 0.23694 | 0.16603 |
benchmark run-test: commands[12] | bash -c 'python /home/circleci/repo/scripts/perf_benchmark.py --num-processes 3 --num-events 100 --mode request'
+++ASYNCIO+++
+++Globals+++
|Consumer processes | Total time | Total aggegated time | Propagated events |Received events | Propagated EPS | Received EPS |
| 3 | 0.07880 | 0.04642 | 100 | 300 | 1268.986 | 3806.959 |
+++Process Details+++
| Process |Processed Events| First sent | Last received | Fastest | Slowest | AVG | Total duration | Total aggregated time |
| consumer_1 | 100 | 17:15:45.690 | 17:15:45.713 | 0.00012 | 0.00053 | 0.00013 | 0.02358 | 0.01330 |
| consumer_0 | 100 | 17:15:45.690 | 17:15:45.713 | 0.00014 | 0.00029 | 0.00016 | 0.02360 | 0.01615 |
| consumer_2 | 100 | 17:15:45.690 | 17:15:45.713 | 0.00016 | 0.00059 | 0.00017 | 0.02361 | 0.01697 |
___________________________________ summary ____________________________________
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment