Created
October 15, 2018 18:13
-
-
Save maysamyabandeh/bdb868091b2929a6d938615fdcf58424 to your computer and use it in GitHub Desktop.
MyRocks In-Memory Sysbench results with WritePrepared Transactions
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # Setup | |
| These are from in-memory sysbench using 8 tables and 10M rows/table. | |
| The test server has 56 HW threads with HT enabled. I look at the results for 24 concurrent clients, but I shared results for 1 to 64 clients. Numbers are QPS. | |
| # Configs | |
| cnf-1 has basic tuning | |
| cnf-2 adds to cnf-1: | |
| rocksdb_allow_concurrent_memtable_write=1 | |
| rocksdb_enable_write_thread_adaptive_yield=1 | |
| cnf-3 adds to cnf-1: | |
| rocksdb_allow_concurrent_memtable_write=1 | |
| rocksdb_enable_write_thread_adaptive_yield=1 | |
| rocksdb_write_policy=write_prepared | |
| cnf-4 adds to cnf-1: | |
| rocksdb_commit_time_batch_for_recovery=on | |
| rocksdb_write_policy=write_prepared | |
| cnf-5 adds to cnf-1: | |
| rocksdb_allow_concurrent_memtable_write=1 | |
| rocksdb_enable_write_thread_adaptive_yield=1 | |
| rocksdb_commit_time_batch_for_recovery=on | |
| rocksdb_write_policy=write_prepared | |
| # Results | |
| --- write heavy | |
| update-inlist | |
| 1 2 4 8 16 24 32 40 48 64 | |
| 1571 2833 5461 10271 17346 19235 19434 19173 18548 17467 myrocks.8may18.cnf-1 | |
| 1576 2833 5465 10298 17336 19319 19405 19116 18557 17525 myrocks.8may18.cnf-2 | |
| 1538 2773 5322 9883 16301 18863 19724 20138 19974 18724 myrocks.8may18.cnf-3 | |
| 1574 2832 5469 10275 17386 21893 24275 25618 25772 24784 myrocks.8may18.cnf-4 | |
| 1556 2843 5450 10267 17675 22715 25208 27391 27119 23485 myrocks.8may18.cnf-5 | |
| 2816 4300 6558 8091 8527 8588 8712 8653 8409 7936 inno.orig5635.noahi | |
| 3343 6152 11790 20370 26962 27982 25640 23003 22007 21019 inno.orig5717.noahi | |
| update-one | |
| 1 2 4 8 16 24 32 40 48 64 | |
| 6762 12585 23632 37820 42763 41094 38594 35204 31076 24933 myrocks.8may18.cnf-1 | |
| 6826 12850 23829 38028 43298 41497 39005 35598 31334 25393 myrocks.8may18.cnf-2 | |
| 6252 11561 21064 30062 32010 31224 30116 28714 26705 22561 myrocks.8may18.cnf-3 | |
| 6769 12899 23718 39291 49139 47747 44264 39125 33669 26404 myrocks.8may18.cnf-4 | |
| 6816 12793 23941 39325 50250 48390 44906 39573 33925 26911 myrocks.8may18.cnf-5 | |
| 9075 15504 23585 29227 30618 30389 30221 30204 30325 30354 inno.orig5635.noahi | |
| 8656 16611 30178 46934 57541 58222 57543 56813 56638 55551 inno.orig5717.noahi | |
| update-index | |
| 1 2 4 8 16 24 32 40 48 64 | |
| 5158 9767 19169 34105 44742 49167 51163 50957 50034 51160 myrocks.8may18.cnf-1 | |
| 5185 9820 19092 34231 45150 49268 51424 51127 50248 51082 myrocks.8may18.cnf-2 | |
| 4872 9156 17398 27878 35293 39033 39656 39469 39287 39762 myrocks.8may18.cnf-3 | |
| 5124 9853 19346 35228 53001 62923 68800 71793 73656 74845 myrocks.8may18.cnf-4 | |
| 5188 10002 19414 35522 54739 64187 69236 71647 72473 69097 myrocks.8may18.cnf-5 | |
| 3338 5893 8784 11245 18104 23022 25744 27092 27393 27483 inno.orig5635.noahi | |
| 4745 10143 20273 37221 66430 79996 84546 84723 84405 83889 inno.orig5717.noahi | |
| update-nonindex | |
| 1 2 4 8 16 24 32 40 48 64 | |
| 5227 10170 19494 36024 51170 56863 59657 60869 59864 60357 myrocks.8may18.cnf-1 | |
| 5205 10171 19857 36397 51626 57150 59895 60884 59767 60391 myrocks.8may18.cnf-2 | |
| 4928 9438 17976 29192 37311 41344 42648 42741 42451 43156 myrocks.8may18.cnf-3 | |
| 5244 10223 19690 36879 56648 66623 71703 74567 75797 77032 myrocks.8may18.cnf-4 | |
| 5216 10223 19851 36865 57521 67115 71590 73839 74853 72805 myrocks.8may18.cnf-5 | |
| 8069 14060 21620 25826 27423 27667 28064 28270 28358 28576 inno.orig5635.noahi | |
| 7979 15277 29395 50043 71777 83644 85420 85642 86144 86372 inno.orig5717.noahi | |
| delete | |
| 1 2 4 8 16 24 32 40 48 64 | |
| 12231 23517 45738 85164 116010 122776 127616 130017 130904 128935 myrocks.8may18.cnf-1 | |
| 12208 23565 46512 86266 116735 122790 128254 129861 131299 128962 myrocks.8may18.cnf-2 | |
| 11824 22430 42431 76415 94481 99329 99658 100285 101640 103062 myrocks.8may18.cnf-3 | |
| 12329 23596 46238 85948 136389 163443 176911 185158 191230 200512 myrocks.8may18.cnf-4 | |
| 12281 23780 46216 87460 141230 168300 182007 189917 193650 199080 myrocks.8may18.cnf-5 | |
| 1640 3610 10317 20897 40296 64431 69938 70453 70118 68959 inno.orig5635.noahi | |
| 8682 19564 35113 82394 169241 210961 183842 185541 197826 190873 inno.orig5717.noahi | |
| read-write range=100 | |
| 1 2 4 8 16 24 32 40 48 64 | |
| 3155 6630 12889 23967 44721 59444 68527 76552 83476 88103 myrocks.8may18.cnf-1 | |
| 2999 6481 12078 23784 43251 59224 69367 76098 84066 88310 myrocks.8may18.cnf-2 | |
| 3323 6674 12967 24095 44760 59131 68562 76090 83706 88562 myrocks.8may18.cnf-3 | |
| 2910 5996 12049 22678 42230 56818 66651 74276 81481 86358 myrocks.8may18.cnf-4 | |
| 2874 6001 11519 22191 41650 56820 66584 74288 80973 85852 myrocks.8may18.cnf-5 | |
| 6190 12438 23472 41826 66531 79669 97525 117497 132715 145526 inno.orig5635.noahi | |
| 5488 11086 21742 41728 75791 101966 121020 138327 153549 162720 inno.orig5717.noahi | |
| read-write range=10000 | |
| 1 2 4 8 16 24 32 40 48 64 | |
| 52 99 192 363 666 918 1064 1170 1239 1295 myrocks.8may18.cnf-1 | |
| 53 105 205 385 701 982 1119 1201 1310 1375 myrocks.8may18.cnf-2 | |
| 52 100 196 371 680 979 1192 1268 1363 1418 myrocks.8may18.cnf-3 | |
| 52 108 204 382 688 934 1072 1165 1261 1311 myrocks.8may18.cnf-4 | |
| 48 94 185 349 631 874 1015 1152 1206 1264 myrocks.8may18.cnf-5 | |
| 129 244 459 844 1479 1939 2222 2443 2662 2828 inno.orig5635.noahi | |
| 115 215 413 786 1438 1978 2290 2494 2691 2845 inno.orig5717.noahi | |
| insert | |
| 1 2 4 8 16 24 32 40 48 64 | |
| 8846 16309 30915 41140 48454 51007 51039 50384 50930 52760 myrocks.8may18.cnf-1 | |
| 9034 16316 31293 41378 48364 50703 51027 50028 50899 52847 myrocks.8may18.cnf-2 | |
| 7921 13931 25048 30585 33269 34446 33936 34935 35708 36961 myrocks.8may18.cnf-3 | |
| 8871 16947 31816 47403 65972 75920 80733 83495 86397 89069 myrocks.8may18.cnf-4 | |
| 8957 16718 31229 50313 69682 76707 80323 83691 86493 88838 myrocks.8may18.cnf-5 | |
| 10428 17633 26462 33091 34587 34410 34073 33924 33698 32931 inno.orig5635.noahi | |
| 10531 19263 36364 58961 83880 95135 102538 107424 110071 111757 inno.orig5717.noahi | |
| -- read-only | |
| read-only range=100 | |
| 1 2 4 8 16 24 32 40 48 64 | |
| 2554 4983 9679 18798 35512 49711 58558 65446 71564 77076 myrocks.8may18.cnf-1 | |
| 2714 5218 10337 19949 37517 52203 61601 69103 75904 80799 myrocks.8may18.cnf-2 | |
| 2819 5449 10878 20881 39230 54519 64392 71550 77865 82763 myrocks.8may18.cnf-3 | |
| 2642 5103 10190 19705 36857 51233 60329 67064 73880 78684 myrocks.8may18.cnf-4 | |
| 2749 5300 10428 19983 37314 51764 60343 67650 73704 78617 myrocks.8may18.cnf-5 | |
| 6215 12216 23565 44838 81860 111348 133089 149050 165322 180649 inno.orig5635.noahi | |
| 5440 10547 20621 40119 75577 104310 126223 139998 153909 167633 inno.orig5717.noahi | |
| read-only.pre range=10000 | |
| 1 2 4 8 16 24 32 40 48 64 | |
| 76 147 287 546 983 1331 1512 1604 1716 1813 myrocks.8may18.cnf-1 | |
| 75 145 286 548 993 1344 1533 1638 1755 1839 myrocks.8may18.cnf-2 | |
| 76 147 284 542 971 1312 1486 1574 1666 1762 myrocks.8may18.cnf-3 | |
| 75 143 289 549 994 1349 1540 1646 1754 1847 myrocks.8may18.cnf-4 | |
| 74 145 286 544 975 1309 1483 1573 1646 1742 myrocks.8may18.cnf-5 | |
| 130 235 433 773 1305 1669 1873 2032 2178 2295 inno.orig5635.noahi | |
| 140 250 465 841 1443 1862 2071 2200 2326 2431 inno.orig5717.noahi | |
| read-only range=10000 | |
| 1 2 4 8 16 24 32 40 48 64 | |
| 38 76 146 277 513 712 830 903 983 1031 myrocks.8may18.cnf-1 | |
| 42 79 154 296 543 753 875 950 1030 1090 myrocks.8may18.cnf-2 | |
| 44 84 164 312 572 792 918 998 1071 1120 myrocks.8may18.cnf-3 | |
| 42 77 151 287 524 725 844 913 993 1045 myrocks.8may18.cnf-4 | |
| 41 78 154 289 530 729 830 907 965 1012 myrocks.8may18.cnf-5 | |
| 104 195 366 676 1185 1557 1781 1957 2135 2262 inno.orig5635.noahi | |
| 93 172 329 630 1156 1585 1835 2005 2167 2293 inno.orig5717.noahi | |
| point-query.pre | |
| 1 2 4 8 16 24 32 40 48 64 | |
| 9264 18305 36500 72153 137293 189200 230378 262713 294712 323875 myrocks.8may18.cnf-1 | |
| 9440 18622 36724 72826 139259 191435 233528 265571 297871 326014 myrocks.8may18.cnf-2 | |
| 9180 18428 36629 72189 137210 189124 231394 263086 295213 322447 myrocks.8may18.cnf-3 | |
| 9452 18371 36840 72430 137756 189980 231890 263125 295436 322596 myrocks.8may18.cnf-4 | |
| 9226 18392 36933 72246 137959 188993 230182 263454 294724 324217 myrocks.8may18.cnf-5 | |
| 14793 29067 58165 114203 215584 293965 365541 417870 474341 519076 inno.orig5635.noahi | |
| 13000 26425 52290 103416 195664 266038 325537 380298 431924 474469 inno.orig5717.noahi | |
| point-query | |
| 1 2 4 8 16 24 32 40 48 64 | |
| 7405 14614 29098 57330 109735 152110 186405 213799 238373 264023 myrocks.8may18.cnf-1 | |
| 7791 15136 30362 60419 114911 159396 195914 223582 249953 276059 myrocks.8may18.cnf-2 | |
| 7868 15680 31326 61006 116992 162268 197352 228324 255745 280987 myrocks.8may18.cnf-3 | |
| 7952 15612 31156 61358 117350 161656 198613 227010 254507 275111 myrocks.8may18.cnf-4 | |
| 7859 15568 31198 61619 117478 162172 198729 226080 253418 275219 myrocks.8may18.cnf-5 | |
| 14791 29378 58636 114426 215827 293969 364597 420820 473147 518028 inno.orig5635.noahi | |
| 12881 25515 52564 103054 195744 265529 327987 379373 432027 477980 inno.orig5717.noahi | |
| random-points.pre | |
| 1 2 4 8 16 24 32 40 48 64 | |
| 504 974 1902 3586 6510 8556 9355 9701 9834 9868 myrocks.8may18.cnf-1 | |
| 516 982 1921 3631 6575 8618 9372 9661 9762 9821 myrocks.8may18.cnf-2 | |
| 512 986 1897 3597 6493 8503 9337 9693 9949 10101 myrocks.8may18.cnf-3 | |
| 514 983 1892 3600 6536 8622 9449 9787 10018 10067 myrocks.8may18.cnf-4 | |
| 511 962 1901 3594 6531 8559 9365 9702 9855 9885 myrocks.8may18.cnf-5 | |
| 1024 1971 3808 7262 13578 18980 22334 24929 27437 29676 inno.orig5635.noahi | |
| 955 1797 3513 6820 12943 18214 21543 24163 26401 28505 inno.orig5717.noahi | |
| random-points | |
| 1 2 4 8 16 24 32 40 48 64 | |
| 301 575 1112 2159 4035 5653 6687 7422 8106 8570 myrocks.8may18.cnf-1 | |
| 329 629 1222 2382 4464 6291 7409 8163 8988 9539 myrocks.8may18.cnf-2 | |
| 345 662 1306 2483 4684 6587 7753 8626 9521 10114 myrocks.8may18.cnf-3 | |
| 340 649 1267 2482 4649 6530 7658 8592 9413 10045 myrocks.8may18.cnf-4 | |
| 348 684 1333 2557 4816 6766 7986 8835 9661 10179 myrocks.8may18.cnf-5 | |
| 992 1928 3754 7207 13488 18929 22304 24760 27290 29388 inno.orig5635.noahi | |
| 906 1733 3400 6580 12654 18046 21378 23702 26156 28132 inno.orig5717.noahi | |
| hot-points | |
| 1 2 4 8 16 24 32 40 48 64 | |
| 514 983 1859 3475 6413 8853 9984 10643 11283 11828 myrocks.8may18.cnf-1 | |
| 563 1064 2060 3884 7193 9898 11189 11898 12597 13138 myrocks.8may18.cnf-2 | |
| 613 1184 2270 4264 7861 10887 12341 13157 14049 14741 myrocks.8may18.cnf-3 | |
| 595 1126 2183 4160 7713 10613 12002 12743 13593 14269 myrocks.8may18.cnf-4 | |
| 605 1149 2230 4222 7807 10859 12193 13174 14063 14612 myrocks.8may18.cnf-5 | |
| 1700 3088 5599 9784 16406 20803 23530 25837 27951 29623 inno.orig5635.noahi | |
| 1499 2736 5136 9464 16800 22162 25057 27339 29438 31440 inno.orig5717.noahi | |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment