Created
June 5, 2018 16:54
-
-
Save mdcallag/42abbf76e1fdc7152bcf7587e121fcaa to your computer and use it in GitHub Desktop.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| sysbench | |
| * 8 tables, 100M rows/table | |
| * more details at http://smalldatum.blogspot.com/2017/02/using-modern-sysbench-to-compare.html | |
| * server changed to have ~56gb of RAM, 56 cores with HT enabled, fast SSD | |
| * InnoDB has 35gb buffer pool, MyRocks has 30gb block cache | |
| Summary for impact of direct IO | |
| * full scan with O_DIRECT is more than 4X slower for MyRocks | |
| * read rate from storage (rMB/s) is 2X to 3X faster without O_DIRECT | |
| * many tests get 10% to 20% less QPS with O_DIRECT | |
| * QPS for tests with longer range scans is ~2X faster without O_DIRECT -- see read-write and read-only with range=10000 | |
| Summary other: | |
| * scan for myrocks.8may18 is more than 3X faster than MyRocks from last year | |
| Engines tested: | |
| * myrocks.8may18.{none,zstd}[.dio] - .dio means that O_DIRECT is used, none/zstd is compression, build is from 8 May 2018 | |
| * inno.o5717 - InnoDB from upstream 5.7.17 | |
| Results for full table scan done before (pre) and after (post) updates. | |
| scan | |
| pre post pre post pre post pre post | |
| secs secs Mrps Mrps rMB/s rMB/s Mcpu/o Mcpu/o engine | |
| 103 116 7.766 6.896 1471.9 1393.5 1.325 1.345 myrocks.8may18.none | |
| 453 483 1.766 1.656 409.9 411.7 1.827 1.870 myrocks.8may18.none.dio | |
| 115 123 6.956 6.504 669.1 660.7 1.942 1.992 myrocks.8may18.zstd | |
| 366 373 2.185 2.144 310.4 315.2 2.578 2.567 myrocks.8may18.zstd.dio | |
| 178 71 4.494 11.267 838.5 2429.7 1.002 1.085 inno.o5717 | |
| The following tables have the QPS for 1 .. 56 concurrent clients per test. | |
| update-inlist | |
| 1 2 4 8 16 24 32 40 48 56 | |
| 351 691 1347 2617 4832 6679 8285 9482 10159 11208 myrocks.8may18.none | |
| 299 574 1143 2209 4085 5696 7050 8300 9069 9714 myrocks.8may18.none.dio | |
| 389 755 1507 2909 5391 7431 8724 10374 11790 12650 myrocks.8may18.zstd | |
| 350 676 1355 2592 4783 6656 7863 9226 10509 11577 myrocks.8may18.zstd.dio | |
| 373 725 1309 2245 3683 4508 5269 5885 6292 6471 inno.o5717 | |
| update-one | |
| 1 2 4 8 16 24 32 40 48 56 | |
| 9530 17258 31324 44585 47324 45517 44215 42597 40874 39217 myrocks.8may18.none | |
| 9488 16955 31203 44025 46849 45299 43927 42250 40596 38879 myrocks.8may18.none.dio | |
| 9376 16999 31190 44267 46950 45513 43783 42309 40579 38850 myrocks.8may18.zstd | |
| 9363 17733 31279 44347 47054 45482 44002 42226 40590 38873 myrocks.8may18.zstd.dio | |
| 9726 18728 33421 50995 62472 62852 62319 61831 61501 61066 inno.o5717 | |
| update-index | |
| 1 2 4 8 16 24 32 40 48 56 | |
| 2316 4580 9198 17813 31849 40040 43809 46550 48395 49344 myrocks.8may18.none | |
| 1991 3922 7968 15529 28401 37872 42605 45978 47817 48889 myrocks.8may18.none.dio | |
| 2380 4867 9989 19135 33964 40213 43209 45747 47214 48364 myrocks.8may18.zstd | |
| 2275 4516 9209 17663 31969 39284 43131 45823 47342 48257 myrocks.8may18.zstd.dio | |
| 941 2938 6280 10744 18559 29118 34707 39064 42078 46436 inno.o5717 | |
| update-nonindex | |
| 1 2 4 8 16 24 32 40 48 56 | |
| 2300 4618 9394 18102 33292 43482 49481 52916 55446 57435 myrocks.8may18.none | |
| 1937 4104 8186 15904 29729 40066 47244 51567 55094 56781 myrocks.8may18.none.dio | |
| 2460 4965 10036 19437 35587 43916 48963 52713 54530 56225 myrocks.8may18.zstd | |
| 2236 4584 9370 18063 33352 42517 48404 52417 54778 56220 myrocks.8may18.zstd.dio | |
| 2117 4394 8443 16323 27130 34950 40882 45807 49351 52115 inno.o5717 | |
| delete | |
| 1 2 4 8 16 24 32 40 48 56 | |
| 7812 15583 31410 59550 104631 126371 135909 141393 145492 148071 myrocks.8may18.none | |
| 6828 13932 27920 53829 96567 121999 134928 142161 145895 148561 myrocks.8may18.none.dio | |
| 8283 16641 33247 63438 108937 124099 135044 140248 141885 144094 myrocks.8may18.zstd | |
| 7578 15502 31071 59841 105555 122069 133440 139721 142907 146071 myrocks.8may18.zstd.dio | |
| 6682 13880 26217 47205 79088 100728 118672 134822 146821 155736 inno.o5717 | |
| read-write range=100 | |
| 1 2 4 8 16 24 32 40 48 56 | |
| 1951 4273 9584 19060 37699 54231 70257 83939 96167 109356 myrocks.8may18.none | |
| 1536 3474 8231 16419 32560 47160 61030 74058 85097 96410 myrocks.8may18.none.dio | |
| 2320 5099 10560 21341 42065 61492 77661 92881 107355 118665 myrocks.8may18.zstd | |
| 2006 4524 9339 19464 38547 55738 71333 85793 98483 110897 myrocks.8may18.zstd.dio | |
| 1875 4315 8781 17213 33519 48210 61488 73845 85002 94535 inno.o5717 | |
| read-write range=10000 | |
| 1 2 4 8 16 24 32 40 48 56 | |
| 189 383 771 1508 2909 4039 4743 5604 6430 6880 myrocks.8may18.none | |
| 91 182 367 736 1439 2095 2709 3274 3799 4296 myrocks.8may18.none.dio | |
| 184 373 752 1493 2929 4175 5005 5677 6307 6664 myrocks.8may18.zstd | |
| 106 216 442 888 1742 2537 3208 3862 4465 5013 myrocks.8may18.zstd.dio | |
| 122 257 514 1027 1977 2892 3656 4421 5046 5722 inno.o5717 | |
| read-only range=100 | |
| 1 2 4 8 16 24 32 40 48 56 | |
| 1930 4180 8925 18006 35525 52017 67053 80923 94924 109049 myrocks.8may18.none | |
| 1633 3567 7677 15414 30490 44924 58397 70974 82535 93759 myrocks.8may18.none.dio | |
| 2228 4852 10177 20412 40577 59382 76143 91739 106751 119908 myrocks.8may18.zstd | |
| 1996 4359 9326 18735 37156 54766 70514 85537 99615 112865 myrocks.8may18.zstd.dio | |
| 2092 4310 9023 18226 36971 56984 71659 83153 97763 111674 inno.o5717 | |
| read-only.pre range=10000 | |
| 1 2 4 8 16 24 32 40 48 56 | |
| 168 342 694 1362 2615 3666 4413 5047 5634 6000 myrocks.8may18.none | |
| 77 155 316 632 1237 1800 2325 2809 3267 3677 myrocks.8may18.none.dio | |
| 163 327 660 1306 2563 3650 4334 4905 5360 5649 myrocks.8may18.zstd | |
| 91 182 372 750 1470 2135 2729 3253 3758 4226 myrocks.8may18.zstd.dio | |
| 102 224 461 939 1878 2769 3533 4183 4777 5327 inno.o5717 | |
| read-only range=10000 | |
| 1 2 4 8 16 24 32 40 48 56 | |
| 159 313 626 1233 2367 3270 3875 4629 5174 5486 myrocks.8may18.none | |
| 74 146 296 592 1157 1685 2176 2638 3058 3462 myrocks.8may18.none.dio | |
| 154 305 610 1206 2368 3378 4041 4599 5114 5422 myrocks.8may18.zstd | |
| 88 176 357 715 1404 2045 2612 3113 3595 4046 myrocks.8may18.zstd.dio | |
| 93 193 395 798 1585 2363 3129 3834 4451 5006 inno.o5717 | |
| point-query.pre | |
| 1 2 4 8 16 24 32 40 48 56 | |
| 3075 6123 12596 25330 50231 73971 95264 115186 133491 151051 myrocks.8may18.none | |
| 2662 5336 10772 21648 42942 63870 83035 100722 117390 133180 myrocks.8may18.none.dio | |
| 3415 6726 13937 28070 56210 83115 105925 129380 151710 170514 myrocks.8may18.zstd | |
| 3122 6205 12874 25845 51665 77043 99740 120608 140776 159872 myrocks.8may18.zstd.dio | |
| 3055 6149 12470 25091 49976 74237 96465 117087 136814 155186 inno.o5717 | |
| point-query | |
| 1 2 4 8 16 24 32 40 48 56 | |
| 2854 5710 11783 23613 46951 69071 88899 109427 127183 144256 myrocks.8may18.none | |
| 2471 4912 10163 20465 40515 60008 78134 94902 110693 125635 myrocks.8may18.none.dio | |
| 3094 6275 12798 26073 52430 77210 99091 120152 139944 157961 myrocks.8may18.zstd | |
| 2907 5838 12182 24468 48968 72530 94112 114159 133303 151106 myrocks.8may18.zstd.dio | |
| 2697 5232 10309 20658 41900 63365 84952 105605 124814 142335 inno.o5717 | |
| random-points.pre | |
| 1 2 4 8 16 24 32 40 48 56 | |
| 43 84 167 331 637 923 1189 1417 1627 1821 myrocks.8may18.none | |
| 34 69 138 274 534 775 1002 1210 1402 1579 myrocks.8may18.none.dio | |
| 47 95 193 389 768 1126 1463 1781 2037 2299 myrocks.8may18.zstd | |
| 43 86 173 349 685 1004 1302 1581 1848 2097 myrocks.8may18.zstd.dio | |
| 42 85 169 333 646 935 1204 1456 1687 1902 inno.o5717 | |
| random-points | |
| 1 2 4 8 16 24 32 40 48 56 | |
| 40 79 155 307 596 870 1110 1360 1563 1755 myrocks.8may18.none | |
| 32 65 130 257 502 732 943 1136 1318 1486 myrocks.8may18.none.dio | |
| 44 87 178 358 703 1025 1324 1606 1868 2114 myrocks.8may18.zstd | |
| 40 79 163 328 644 942 1222 1485 1734 1967 myrocks.8may18.zstd.dio | |
| 36 69 135 268 532 802 1068 1309 1527 1716 inno.o5717 | |
| hot-points | |
| 1 2 4 8 16 24 32 40 48 56 | |
| 1261 2458 4723 8703 15238 19382 21182 22254 23040 23439 myrocks.8may18.none | |
| 1190 2303 4417 8034 13583 16598 17668 18282 18807 19105 myrocks.8may18.none.dio | |
| 1262 2425 4664 8645 15172 19575 21594 23097 24344 25101 myrocks.8may18.zstd | |
| 1301 2516 4828 8935 15472 19386 20759 21551 22073 22314 myrocks.8may18.zstd.dio | |
| 4266 8381 16375 30674 53171 68933 78779 86784 94409 100163 inno.o5717 | |
| insert | |
| 1 2 4 8 16 24 32 40 48 56 | |
| 9198 16841 31604 44020 52590 55470 55743 55303 55570 56555 myrocks.8may18.none | |
| 8962 16781 31633 43241 51766 54789 55287 55046 55404 56047 myrocks.8may18.none.dio | |
| 9136 16808 31739 43442 52372 55382 55906 55290 55868 56792 myrocks.8may18.zstd | |
| 9120 16837 31925 43804 52651 55214 55971 55099 55775 56485 myrocks.8may18.zstd.dio | |
| 10809 20057 37317 61234 83998 94256 101157 108523 112132 113380 inno.o5717 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment