Skip to content

Instantly share code, notes, and snippets.

@jvlmdr

jvlmdr/benchmark.txt

Created December 11, 2019 21:38
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save jvlmdr/76dd405494ac11e4e30d9feafa66219f to your computer and use it in GitHub Desktop.
Save jvlmdr/76dd405494ac11e4e30d9feafa66219f to your computer and use it in GitHub Desktop.
Download ZIP
Raw
benchmark.txt
---------------------------------------------------------------------------------- benchmark 'test_benchmark_assign_3x3': 6 tests ---------------------------------------------------------------------------------
Name (time in us) Min Max Mean StdDev Median IQR Outliers OPS (Kops/s) Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_benchmark_assign_3x3[lapsolver] 21.8828 (1.0) 382.6180 (1.0) 27.1516 (1.0) 13.0945 (1.0) 23.1010 (1.0) 1.3541 (1.0) 1014;2011 36.8302 (1.0) 11318 1
test_benchmark_assign_3x3[lap] 41.3780 (1.89) 887.3888 (2.32) 52.0903 (1.92) 23.1687 (1.77) 45.7240 (1.98) 1.9629 (1.45) 853;1701 19.1974 (0.52) 10187 1
test_benchmark_assign_3x3[lapmod] 96.4422 (4.41) 560.4799 (1.46) 122.5558 (4.51) 48.2250 (3.68) 102.6029 (4.44) 15.0070 (11.08) 196;290 8.1595 (0.22) 1659 1
test_benchmark_assign_3x3[munkres] 115.4849 (5.28) 798.0901 (2.09) 127.4963 (4.70) 28.8916 (2.21) 120.3599 (5.21) 9.4369 (6.97) 126;174 7.8434 (0.21) 2146 1
test_benchmark_assign_3x3[ortools] 132.2369 (6.04) 851.1019 (2.22) 153.4948 (5.65) 38.8722 (2.97) 146.0640 (6.32) 12.7861 (9.44) 307;431 6.5149 (0.18) 4477 1
test_benchmark_assign_3x3[scipy] 249.3691 (11.40) 971.4991 (2.54) 303.6562 (11.18) 67.8245 (5.18) 280.2070 (12.13) 26.3189 (19.44) 239;326 3.2932 (0.09) 2182 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------------- benchmark 'test_benchmark_assign_dense_distance_small': 6 tests ----------------------------------------------------------------------------------------------------
Name (time in us) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_benchmark_assign_dense_distance_small[100-lapsolver] 421.3629 (1.0) 1,346.0990 (1.12) 448.2623 (1.0) 60.9000 (1.0) 426.6221 (1.0) 30.3754 (1.0) 151;163 2,230.8366 (1.0) 2001 1
test_benchmark_assign_dense_distance_small[100-lap] 517.1080 (1.23) 1,197.3130 (1.0) 576.9607 (1.29) 89.4416 (1.47) 557.9166 (1.31) 50.5933 (1.67) 60;63 1,733.2202 (0.78) 524 1
test_benchmark_assign_dense_distance_small[100-lapmod] 7,310.2419 (17.35) 14,651.5619 (12.24) 7,995.2055 (17.84) 980.5422 (16.10) 7,722.7290 (18.10) 541.2034 (17.82) 8;8 125.0750 (0.06) 124 1
test_benchmark_assign_dense_distance_small[100-scipy] 48,121.5941 (114.20) 52,684.3779 (44.00) 50,531.5936 (112.73) 1,346.7109 (22.11) 50,676.8001 (118.79) 1,621.1362 (53.37) 8;0 19.7896 (0.01) 17 1
test_benchmark_assign_dense_distance_small[100-ortools] 68,076.3260 (161.56) 81,263.3331 (67.87) 74,388.9669 (165.95) 3,223.3313 (52.93) 73,921.5720 (173.27) 1,918.6162 (63.16) 3;3 13.4429 (0.01) 13 1
test_benchmark_assign_dense_distance_small[100-munkres] 3,381,530.2169 (>1000.0) 3,759,146.1851 (>1000.0) 3,609,895.3868 (>1000.0) 161,103.4861 (>1000.0) 3,653,919.5029 (>1000.0) 268,161.6753 (>1000.0) 1;0 0.2770 (0.00) 5 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------- benchmark 'test_benchmark_assign_dense_distance_medium': 4 tests --------------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_benchmark_assign_dense_distance_medium[1000-lapsolver] 118.1733 (1.0) 126.1987 (1.0) 121.6140 (1.0) 2.6913 (1.0) 121.8011 (1.0) 3.9605 (1.0) 2;0 8.2227 (1.0) 8 1
test_benchmark_assign_dense_distance_medium[1000-lap] 400.3283 (3.39) 445.8277 (3.53) 415.4054 (3.42) 17.6275 (6.55) 411.1275 (3.38) 14.8176 (3.74) 1;1 2.4073 (0.29) 5 1
test_benchmark_assign_dense_distance_medium[1000-lapmod] 1,611.7218 (13.64) 1,655.6633 (13.12) 1,635.9413 (13.45) 21.0498 (7.82) 1,643.4557 (13.49) 39.7568 (10.04) 1;0 0.6113 (0.07) 5 1
test_benchmark_assign_dense_distance_medium[1000-ortools] 7,062.5691 (59.76) 7,702.8498 (61.04) 7,415.7817 (60.98) 273.7331 (101.71) 7,524.7978 (61.78) 459.5983 (116.05) 2;0 0.1348 (0.02) 5 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------------- benchmark 'test_benchmark_assign_sparse_distance_medium': 4 tests -----------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_benchmark_assign_sparse_distance_medium[1000-20-lapmod] 39.9723 (1.0) 45.9103 (1.0) 43.0389 (1.0) 1.4893 (1.0) 43.0269 (1.0) 1.5657 (1.0) 6;0 23.2348 (1.0) 22 1
test_benchmark_assign_sparse_distance_medium[1000-20-lapsolver] 108.4120 (2.71) 114.8256 (2.50) 112.1680 (2.61) 2.0662 (1.39) 112.0591 (2.60) 2.8714 (1.83) 3;0 8.9152 (0.38) 9 1
test_benchmark_assign_sparse_distance_medium[1000-20-ortools] 161.4168 (4.04) 177.8935 (3.87) 170.0752 (3.95) 6.7525 (4.53) 171.3275 (3.98) 12.5032 (7.99) 3;0 5.8798 (0.25) 6 1
test_benchmark_assign_sparse_distance_medium[1000-20-lap] 415.7247 (10.40) 429.8314 (9.36) 424.2450 (9.86) 5.8559 (3.93) 427.2578 (9.93) 8.7535 (5.59) 1;0 2.3571 (0.10) 5 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------- benchmark 'test_benchmark_assign_sparse_distance_large': 2 tests -----------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_benchmark_assign_sparse_distance_large[10000-20-ortools] 1.5967 (1.0) 1.6565 (1.0) 1.6162 (1.0) 0.0237 (1.39) 1.6121 (1.0) 0.0249 (1.0) 1;0 0.6187 (1.0) 5 1
test_benchmark_assign_sparse_distance_large[10000-20-lapmod] 3.0035 (1.88) 3.0401 (1.84) 3.0206 (1.87) 0.0170 (1.0) 3.0138 (1.87) 0.0312 (1.26) 2;0 0.3311 (0.54) 5 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------- benchmark 'test_benchmark_min_weight_sparse_count_medium': 5 tests ----------------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_benchmark_min_weight_sparse_count_medium[1000-0.01-greedy] 10.0564 (1.0) 33.0605 (1.0) 11.1511 (1.0) 2.4394 (2.39) 10.8707 (1.0) 0.4722 (1.0) 1;4 89.6771 (1.0) 86 1
test_benchmark_min_weight_sparse_count_medium[1000-0.01-lapmod] 42.3099 (4.21) 46.7800 (1.41) 44.4321 (3.98) 1.0225 (1.0) 44.6657 (4.11) 1.0512 (2.23) 5;2 22.5062 (0.25) 20 1
test_benchmark_min_weight_sparse_count_medium[1000-0.01-ortools] 163.4364 (16.25) 175.6239 (5.31) 168.8881 (15.15) 4.2587 (4.17) 168.5349 (15.50) 5.4961 (11.64) 2;0 5.9211 (0.07) 6 1
test_benchmark_min_weight_sparse_count_medium[1000-0.01-lap] 837.4197 (83.27) 893.3595 (27.02) 866.3142 (77.69) 21.5572 (21.08) 866.5861 (79.72) 32.0843 (67.94) 2;0 1.1543 (0.01) 5 1
test_benchmark_min_weight_sparse_count_medium[1000-0.01-lapsolver] 2,548.0337 (253.37) 2,602.1588 (78.71) 2,573.4825 (230.78) 19.7830 (19.35) 2,570.4727 (236.46) 23.3910 (49.53) 2;0 0.3886 (0.00) 5 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------- benchmark 'test_benchmark_min_weight_sparse_count_large': 3 tests ----------------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_benchmark_min_weight_sparse_count_large[10000-0.001-greedy] 157.8610 (1.0) 187.4008 (1.0) 170.2518 (1.0) 12.1993 (1.0) 163.0511 (1.0) 20.3708 (1.0) 2;0 5.8737 (1.0) 7 1
test_benchmark_min_weight_sparse_count_large[10000-0.001-lapmod] 604.2715 (3.83) 645.3135 (3.44) 627.4771 (3.69) 16.0054 (1.31) 632.1884 (3.88) 23.0609 (1.13) 2;0 1.5937 (0.27) 5 1
test_benchmark_min_weight_sparse_count_large[10000-0.001-ortools] 1,727.6579 (10.94) 1,770.0984 (9.45) 1,752.8174 (10.30) 19.1522 (1.57) 1,758.0028 (10.78) 34.4474 (1.69) 1;0 0.5705 (0.10) 5 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
================= 199 passed, 14 warnings in 233.61s (0:03:53) =================
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment