Skip to content

Instantly share code, notes, and snippets.

@nicoddemus
Created May 17, 2019 12:02
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save nicoddemus/105e7bd20b9699ac5330968fadfc5b67 to your computer and use it in GitHub Desktop.
Save nicoddemus/105e7bd20b9699ac5330968fadfc5b67 to your computer and use it in GitHub Desktop.
pluggy benchmarks v0.11.1 vs master

0.11.1

------------------------------------------------------------------------------------------------------------------ benchmark: 8 tests -----------------------------------------------------------------------------------------------------------------
Name (time in us)                                                              Min                   Max                Mean              StdDev              Median                IQR            Outliers  OPS (Kops/s)            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_hook_and_wrappers_speed[hooks=10-wrappers=10-_multicall]              34.7022 (1.0)        160.4266 (1.0)       38.0200 (1.0)       10.0398 (1.0)       35.2711 (1.0)       0.5689 (1.0)      572;1025
26.3019 (1.0)        6921           1
test_hook_and_wrappers_speed[hooks=10-wrappers=10-_legacymulticall]        43.2355 (1.25)       454.8265 (2.84)      48.3978 (1.27)      16.0063 (1.59)      45.2267 (1.28)      0.5689 (1.0)      691;2834
20.6621 (0.79)      14063           1
test_hook_and_wrappers_speed[hooks=100-wrappers=10-_multicall]            165.8311 (4.78)       566.6132 (3.53)     180.3793 (4.74)      31.7301 (3.16)     171.2355 (4.85)      2.2756 (4.00)     408;1232
 5.5439 (0.21)       5451           1
test_hook_and_wrappers_speed[hooks=100-wrappers=10-_legacymulticall]      186.3111 (5.37)     5,858.1317 (36.52)    210.6869 (5.54)      94.3215 (9.39)     193.7066 (5.49)      4.2667 (7.50)      254;925
 4.7464 (0.18)       4608           1
test_hook_and_wrappers_speed[hooks=10-wrappers=100-_multicall]            196.8355 (5.67)       690.3465 (4.30)     215.8733 (5.68)      39.7741 (3.96)     203.0933 (5.76)      4.5511 (8.00)      213;489
 4.6323 (0.18)       2561           1
test_hook_and_wrappers_speed[hooks=10-wrappers=100-_legacymulticall]      301.7955 (8.70)     8,584.8153 (53.51)    340.4747 (8.96)     231.4590 (23.05)    312.8888 (8.87)     31.7155 (55.75)      10;148
 2.9371 (0.11)       1920           1
test_hook_and_wrappers_speed[hooks=100-wrappers=100-_multicall]           327.3955 (9.43)     1,056.9953 (6.59)     360.7327 (9.49)      52.8570 (5.26)     339.3421 (9.62)     22.1867 (39.00)     309;422
 2.7721 (0.11)       2868           1
test_hook_and_wrappers_speed[hooks=100-wrappers=100-_legacymulticall]     501.1910 (14.44)    7,392.4246 (46.08)    601.5213 (15.82)    479.0509 (47.72)    513.7065 (14.56)    47.1467 (82.88)      34;207
 1.6625 (0.06)       1471           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean

master

------------------------------------------------------------------------------------------------------------------ benchmark: 8 tests -----------------------------------------------------------------------------------------------------------------
Name (time in us)                                                              Min                   Max                Mean              StdDev              Median                IQR            Outliers  OPS (Kops/s)            Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_hook_and_wrappers_speed[hooks=10-wrappers=10-_multicall]              33.5644 (1.0)        207.0755 (1.0)       36.3201 (1.0)        8.4157 (1.0)       34.7022 (1.0)       0.2844 (1.0)       356;864
27.5330 (1.0)        6393           1
test_hook_and_wrappers_speed[hooks=10-wrappers=10-_legacymulticall]        43.2355 (1.29)     4,706.7009 (22.73)     48.9025 (1.35)      46.4067 (5.51)      45.2267 (1.30)      0.5689 (2.00)     207;1655
20.4488 (0.74)      11603           1
test_hook_and_wrappers_speed[hooks=100-wrappers=10-_multicall]            165.2622 (4.92)       624.3554 (3.02)     180.6460 (4.97)      36.6861 (4.36)     170.6666 (4.92)      1.9911 (7.00)     346;1157
 5.5357 (0.20)       5511           1
test_hook_and_wrappers_speed[hooks=100-wrappers=10-_legacymulticall]      187.7333 (5.59)       789.6176 (3.81)     212.3643 (5.85)      52.2854 (6.21)     194.2755 (5.60)      4.5511 (16.00)     368;796
 4.7089 (0.17)       4166           1
test_hook_and_wrappers_speed[hooks=10-wrappers=100-_multicall]            192.8533 (5.75)     1,164.2308 (5.62)     211.6655 (5.83)      44.4742 (5.28)     198.8266 (5.73)      4.5511 (16.00)     302;727
 4.7244 (0.17)       4508           1
test_hook_and_wrappers_speed[hooks=10-wrappers=100-_legacymulticall]      307.4844 (9.16)     6,136.3183 (29.63)    340.7404 (9.38)     191.3773 (22.74)    312.6044 (9.01)     35.6978 (125.50)      16;73
 2.9348 (0.11)        984           1
test_hook_and_wrappers_speed[hooks=100-wrappers=100-_multicall]           329.6710 (9.82)     1,182.1508 (5.71)     355.3590 (9.78)      45.9539 (5.46)     340.1955 (9.80)      6.2578 (22.00)     214;561
 2.8141 (0.10)       2726           1
test_hook_and_wrappers_speed[hooks=100-wrappers=100-_legacymulticall]     493.5110 (14.70)    6,087.3938 (29.40)    575.1463 (15.84)    439.5575 (52.23)    509.1554 (14.67)    31.2889 (110.00)     13;150
 1.7387 (0.06)       1270           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment