Skip to content

Instantly share code, notes, and snippets.

@bstaletic

bstaletic/pybind11_bechmark

Created February 15, 2018 00:21
Show Gist options
  • Save bstaletic/89a50ebe3b3612b8ec5eb0de96fb80f6 to your computer and use it in GitHub Desktop.
Save bstaletic/89a50ebe3b3612b8ec5eb0de96fb80f6 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
pybind11_bechmark
=============================== Our CMake ==========================================================================
IdentifierCompleterFixture/CandidatesWithCommonPrefix/1/0 410 ns 410 ns 1713696
IdentifierCompleterFixture/CandidatesWithCommonPrefix/16/0 4273 ns 4273 ns 159890
IdentifierCompleterFixture/CandidatesWithCommonPrefix/256/0 102100 ns 102101 ns 6808
IdentifierCompleterFixture/CandidatesWithCommonPrefix/4096/0 2693267 ns 2693271 ns 224
IdentifierCompleterFixture/CandidatesWithCommonPrefix/65536/0 172801644 ns 172800973 ns 8
IdentifierCompleterFixture_BigO 0.04 N^2 0.04 N^2
IdentifierCompleterFixture_RMS 3 % 3 %
IdentifierCompleterFixture/CandidatesWithCommonPrefix/1/10 410 ns 410 ns 1702001
IdentifierCompleterFixture/CandidatesWithCommonPrefix/16/10 4241 ns 4241 ns 161692
IdentifierCompleterFixture/CandidatesWithCommonPrefix/256/10 61960 ns 61960 ns 11848
IdentifierCompleterFixture/CandidatesWithCommonPrefix/4096/10 1112132 ns 1112134 ns 682
IdentifierCompleterFixture/CandidatesWithCommonPrefix/65536/10 39249165 ns 39249279 ns 18
IdentifierCompleterFixture_BigO 37.40 NlgN 37.40 NlgN
IdentifierCompleterFixture_RMS 4 % 4 %
PythonSupportFixture/FilterAndSortUnstoredCandidatesWithCommonPrefix/1/0 4430 ns 4471 ns 155455
PythonSupportFixture/FilterAndSortUnstoredCandidatesWithCommonPrefix/16/0 47743 ns 47844 ns 14674
PythonSupportFixture/FilterAndSortUnstoredCandidatesWithCommonPrefix/256/0 705717 ns 705871 ns 994
PythonSupportFixture/FilterAndSortUnstoredCandidatesWithCommonPrefix/4096/0 13238818 ns 13239690 ns 53
PythonSupportFixture/FilterAndSortUnstoredCandidatesWithCommonPrefix/65536/0 238756326 ns 238757248 ns 3
PythonSupportFixture_BigO 3641.52 N 3641.53 N
PythonSupportFixture_RMS 1 % 1 %
PythonSupportFixture/FilterAndSortUnstoredCandidatesWithCommonPrefix/1/50 4418 ns 4454 ns 157980
PythonSupportFixture/FilterAndSortUnstoredCandidatesWithCommonPrefix/16/50 48330 ns 48424 ns 14169
PythonSupportFixture/FilterAndSortUnstoredCandidatesWithCommonPrefix/256/50 664956 ns 665057 ns 1053
PythonSupportFixture/FilterAndSortUnstoredCandidatesWithCommonPrefix/4096/50 12279024 ns 12279756 ns 57
PythonSupportFixture/FilterAndSortUnstoredCandidatesWithCommonPrefix/65536/50 209375806 ns 209376508 ns 3
PythonSupportFixture_BigO 3194.05 N 3194.06 N
PythonSupportFixture_RMS 1 % 1 %
PythonSupportFixture/FilterAndSortStoredCandidatesWithCommonPrefix/1/0 1736 ns 1736 ns 403636
PythonSupportFixture/FilterAndSortStoredCandidatesWithCommonPrefix/16/0 18512 ns 18512 ns 37898
PythonSupportFixture/FilterAndSortStoredCandidatesWithCommonPrefix/256/0 318232 ns 318233 ns 2211
PythonSupportFixture/FilterAndSortStoredCandidatesWithCommonPrefix/4096/0 5611071 ns 5610961 ns 125
PythonSupportFixture/FilterAndSortStoredCandidatesWithCommonPrefix/65536/0 132743784 ns 132742259 ns 5
PythonSupportFixture_BigO 126.57 NlgN 126.57 NlgN
PythonSupportFixture_RMS 1 % 1 %
PythonSupportFixture/FilterAndSortStoredCandidatesWithCommonPrefix/1/50 1721 ns 1721 ns 404592
PythonSupportFixture/FilterAndSortStoredCandidatesWithCommonPrefix/16/50 18504 ns 18505 ns 37868
PythonSupportFixture/FilterAndSortStoredCandidatesWithCommonPrefix/256/50 277033 ns 277034 ns 2074
PythonSupportFixture/FilterAndSortStoredCandidatesWithCommonPrefix/4096/50 4701921 ns 4701891 ns 147
PythonSupportFixture/FilterAndSortStoredCandidatesWithCommonPrefix/65536/50 109777153 ns 109776684 ns 7
=============================== Pybind11 CMake =====================================================================
IdentifierCompleterFixture/CandidatesWithCommonPrefix/1/0 402 ns 402 ns 1735249
IdentifierCompleterFixture/CandidatesWithCommonPrefix/16/0 4603 ns 4603 ns 163986
IdentifierCompleterFixture/CandidatesWithCommonPrefix/256/0 100923 ns 100922 ns 6762
IdentifierCompleterFixture/CandidatesWithCommonPrefix/4096/0 3122736 ns 3122717 ns 224
IdentifierCompleterFixture/CandidatesWithCommonPrefix/65536/0 186575863 ns 186575092 ns 9
IdentifierCompleterFixture_BigO 0.04 N^2 0.04 N^2
IdentifierCompleterFixture_RMS 3 % 3 %
IdentifierCompleterFixture/CandidatesWithCommonPrefix/1/10 419 ns 419 ns 1744808
IdentifierCompleterFixture/CandidatesWithCommonPrefix/16/10 4309 ns 4309 ns 164250
IdentifierCompleterFixture/CandidatesWithCommonPrefix/256/10 57379 ns 57379 ns 11143
IdentifierCompleterFixture/CandidatesWithCommonPrefix/4096/10 994952 ns 994954 ns 711
IdentifierCompleterFixture/CandidatesWithCommonPrefix/65536/10 38056208 ns 38055889 ns 18
IdentifierCompleterFixture_BigO 36.26 NlgN 36.26 NlgN
IdentifierCompleterFixture_RMS 5 % 5 %
PythonSupportFixture/FilterAndSortUnstoredCandidatesWithCommonPrefix/1/0 4361 ns 4432 ns 157689
PythonSupportFixture/FilterAndSortUnstoredCandidatesWithCommonPrefix/16/0 44937 ns 45075 ns 15362
PythonSupportFixture/FilterAndSortUnstoredCandidatesWithCommonPrefix/256/0 675836 ns 676045 ns 1037
PythonSupportFixture/FilterAndSortUnstoredCandidatesWithCommonPrefix/4096/0 12790461 ns 12791434 ns 54
PythonSupportFixture/FilterAndSortUnstoredCandidatesWithCommonPrefix/65536/0 233035086 ns 233036232 ns 3
PythonSupportFixture_BigO 3554.13 N 3554.15 N
PythonSupportFixture_RMS 2 % 2 %
PythonSupportFixture/FilterAndSortUnstoredCandidatesWithCommonPrefix/1/50 4203 ns 4268 ns 161303
PythonSupportFixture/FilterAndSortUnstoredCandidatesWithCommonPrefix/16/50 45312 ns 45446 ns 15387
PythonSupportFixture/FilterAndSortUnstoredCandidatesWithCommonPrefix/256/50 638303 ns 638516 ns 1103
PythonSupportFixture/FilterAndSortUnstoredCandidatesWithCommonPrefix/4096/50 11809682 ns 11810456 ns 60
PythonSupportFixture/FilterAndSortUnstoredCandidatesWithCommonPrefix/65536/50 207648894 ns 207649446 ns 4
PythonSupportFixture_BigO 3167.35 N 3167.36 N
PythonSupportFixture_RMS 1 % 1 %
PythonSupportFixture/FilterAndSortStoredCandidatesWithCommonPrefix/1/0 1803 ns 1803 ns 389642
PythonSupportFixture/FilterAndSortStoredCandidatesWithCommonPrefix/16/0 18156 ns 18156 ns 38537
PythonSupportFixture/FilterAndSortStoredCandidatesWithCommonPrefix/256/0 308087 ns 308088 ns 2280
PythonSupportFixture/FilterAndSortStoredCandidatesWithCommonPrefix/4096/0 5677869 ns 5677879 ns 119
PythonSupportFixture/FilterAndSortStoredCandidatesWithCommonPrefix/65536/0 133056607 ns 133056830 ns 5
PythonSupportFixture_BigO 126.87 NlgN 126.87 NlgN
PythonSupportFixture_RMS 1 % 1 %
PythonSupportFixture/FilterAndSortStoredCandidatesWithCommonPrefix/1/50 1785 ns 1785 ns 390097
PythonSupportFixture/FilterAndSortStoredCandidatesWithCommonPrefix/16/50 18188 ns 18189 ns 37828
PythonSupportFixture/FilterAndSortStoredCandidatesWithCommonPrefix/256/50 267408 ns 267409 ns 2578
PythonSupportFixture/FilterAndSortStoredCandidatesWithCommonPrefix/4096/50 4657789 ns 4657765 ns 137
PythonSupportFixture/FilterAndSortStoredCandidatesWithCommonPrefix/65536/50 102930895 ns 102930251 ns 7
PythonSupportFixture_BigO 98.16 NlgN 98.15 NlgN
PythonSupportFixture_RMS 0 % 0 %
============================== No Pybind11 =========================================================================
IdentifierCompleterFixture/CandidatesWithCommonPrefix/1/0 409 ns 409 ns 1720739
IdentifierCompleterFixture/CandidatesWithCommonPrefix/16/0 4299 ns 4299 ns 163998
IdentifierCompleterFixture/CandidatesWithCommonPrefix/256/0 105569 ns 105570 ns 6867
IdentifierCompleterFixture/CandidatesWithCommonPrefix/4096/0 2999744 ns 2999734 ns 264
IdentifierCompleterFixture/CandidatesWithCommonPrefix/65536/0 180153685 ns 180152192 ns 9
IdentifierCompleterFixture_BigO 0.04 N^2 0.04 N^2
IdentifierCompleterFixture_RMS 3 % 3 %
IdentifierCompleterFixture/CandidatesWithCommonPrefix/1/10 407 ns 407 ns 1713839
IdentifierCompleterFixture/CandidatesWithCommonPrefix/16/10 4105 ns 4105 ns 164782
IdentifierCompleterFixture/CandidatesWithCommonPrefix/256/10 58632 ns 58631 ns 11767
IdentifierCompleterFixture/CandidatesWithCommonPrefix/4096/10 1036475 ns 1036478 ns 686
IdentifierCompleterFixture/CandidatesWithCommonPrefix/65536/10 37788489 ns 37788234 ns 19
IdentifierCompleterFixture_BigO 36.01 NlgN 36.00 NlgN
IdentifierCompleterFixture_RMS 4 % 4 %
PythonSupportFixture/FilterAndSortUnstoredCandidatesWithCommonPrefix/1/0 3271 ns 3273 ns 213776
PythonSupportFixture/FilterAndSortUnstoredCandidatesWithCommonPrefix/16/0 37410 ns 37467 ns 18800
PythonSupportFixture/FilterAndSortUnstoredCandidatesWithCommonPrefix/256/0 561071 ns 561176 ns 1257
PythonSupportFixture/FilterAndSortUnstoredCandidatesWithCommonPrefix/4096/0 10988451 ns 10989216 ns 64
PythonSupportFixture/FilterAndSortUnstoredCandidatesWithCommonPrefix/65536/0 201685705 ns 201686459 ns 4
PythonSupportFixture_BigO 192.41 NlgN 192.41 NlgN
PythonSupportFixture_RMS 2 % 2 %
PythonSupportFixture/FilterAndSortUnstoredCandidatesWithCommonPrefix/1/50 3278 ns 3290 ns 212945
PythonSupportFixture/FilterAndSortUnstoredCandidatesWithCommonPrefix/16/50 37853 ns 37911 ns 18489
PythonSupportFixture/FilterAndSortUnstoredCandidatesWithCommonPrefix/256/50 510880 ns 510986 ns 1366
PythonSupportFixture/FilterAndSortUnstoredCandidatesWithCommonPrefix/4096/50 9889469 ns 9890177 ns 71
PythonSupportFixture/FilterAndSortUnstoredCandidatesWithCommonPrefix/65536/50 172344664 ns 172342396 ns 4
PythonSupportFixture_BigO 2628.92 N 2628.89 N
PythonSupportFixture_RMS 1 % 1 %
PythonSupportFixture/FilterAndSortStoredCandidatesWithCommonPrefix/1/0 843 ns 843 ns 848163
PythonSupportFixture/FilterAndSortStoredCandidatesWithCommonPrefix/16/0 9062 ns 9062 ns 77323
PythonSupportFixture/FilterAndSortStoredCandidatesWithCommonPrefix/256/0 169454 ns 169454 ns 4118
PythonSupportFixture/FilterAndSortStoredCandidatesWithCommonPrefix/4096/0 3391165 ns 3391145 ns 202
PythonSupportFixture/FilterAndSortStoredCandidatesWithCommonPrefix/65536/0 97567580 ns 97567802 ns 7
PythonSupportFixture_BigO 92.99 NlgN 93.00 NlgN
PythonSupportFixture_RMS 3 % 3 %
PythonSupportFixture/FilterAndSortStoredCandidatesWithCommonPrefix/1/50 807 ns 807 ns 863804
PythonSupportFixture/FilterAndSortStoredCandidatesWithCommonPrefix/16/50 9007 ns 9006 ns 77754
PythonSupportFixture/FilterAndSortStoredCandidatesWithCommonPrefix/256/50 125433 ns 125434 ns 5580
PythonSupportFixture/FilterAndSortStoredCandidatesWithCommonPrefix/4096/50 2284068 ns 2284073 ns 294
PythonSupportFixture/FilterAndSortStoredCandidatesWithCommonPrefix/65536/50 66555239 ns 66554369 ns 10
PythonSupportFixture_BigO 63.43 NlgN 63.43 NlgN
PythonSupportFixture_RMS 3 % 3 %
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment