Skip to content

Instantly share code, notes, and snippets.

@mdcallag
Last active March 9, 2022 16:49
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save mdcallag/6bb93aa409812555317237969995aa4d to your computer and use it in GitHub Desktop.
Save mdcallag/6bb93aa409812555317237969995aa4d to your computer and use it in GitHub Desktop.
Block cache hit rate by block cache size in GB, database size is 574 GB
1 2 4 8 16 32 64 128 cache-size/mixgraph-config
76.1 76.7 78.2 79.8 81.9 84.6 87.1 87.3 hwperf
26.1 26.4 27.2 28.6 31.2 35.6 42.0 48.6 all_random
61.6 62.9 64.4 66.7 69.7 73.7 78.0 80.3 all_dist
26.0 26.4 27.1 28.5 31.2 35.5 41.9 48.8 prefix_random
28.4 32.6 39.7 51.5 69.4 86.5 89.4 89.7 prefix_dist
o/s by block cache size in GB
1 2 4 8 16 32 64 128 cache-size/mixgraph-config
19009 19152 19670 20112 20789 22018 23268 23252 hwperf
9170 9143 9159 9218 9276 9468 9760 10135 all_random
15726 15888 16037 16391 16899 17668 18651 19256 all_dist
9118 9164 9145 9154 9261 9419 9734 10186 prefix_random
9687 10012 10591 11797 14697 20065 21808 21870 prefix_dist
--- storage operations and throughput per RocksDB operation
r/o by block cache size in GB
1 2 4 8 16 32 64 128 cache-size/mixgraph-config
0.38 0.37 0.36 0.34 0.32 0.28 0.25 0.24 hwperf
0.94 0.94 0.94 0.93 0.91 0.89 0.85 0.79 all_random
0.43 0.42 0.41 0.39 0.37 0.34 0.30 0.27 all_dist
0.94 0.94 0.94 0.93 0.91 0.89 0.85 0.79 prefix_random
0.85 0.81 0.75 0.63 0.44 0.23 0.19 0.19 prefix_dist
rKB/o by block cache size in GB
1 2 4 8 16 32 64 128 cache-size/mixgraph-config
3.09 3.02 2.92 2.77 2.57 2.30 2.02 1.98 hwperf
10.17 10.14 10.07 9.95 9.71 9.30 8.68 7.97 all_random
4.66 4.56 4.43 4.24 3.97 3.59 3.13 2.88 all_dist
10.17 10.13 10.08 9.96 9.72 9.31 8.68 7.97 prefix_random
9.41 9.08 8.51 7.44 5.53 2.90 2.26 2.21 prefix_dist
wKB/o by block cache size in GB
1 2 4 8 16 32 64 128 cache-size/mixgraph-config
0.03 0.04 0.04 0.04 0.03 0.03 0.03 0.03 hwperf
0.07 0.07 0.07 0.07 0.07 0.06 0.06 0.06 all_random
0.04 0.04 0.04 0.04 0.04 0.03 0.04 0.04 all_dist
0.07 0.07 0.07 0.07 0.07 0.07 0.06 0.06 prefix_random
0.06 0.06 0.06 0.05 0.04 0.04 0.03 0.03 prefix_dist
--- similar to previous section but denominator is seeks+gets for reads and puts for writes, which is more accurate
r/s+g by block cache size in GB
1 2 4 8 16 32 64 128 cache-size/mixgraph-config
0.45 0.44 0.42 0.40 0.37 0.33 0.29 0.28 hwperf
1.10 1.09 1.09 1.08 1.06 1.03 0.98 0.92 all_random
0.50 0.49 0.48 0.46 0.43 0.39 0.34 0.32 all_dist
1.10 1.09 1.09 1.08 1.06 1.03 0.98 0.92 prefix_random
0.99 0.94 0.87 0.73 0.51 0.27 0.22 0.22 prefix_dist
rKB/s+g by block cache size in GB
1 2 4 8 16 32 64 128 cache-size/mixgraph-config
3.59 3.51 3.40 3.23 2.99 2.67 2.35 2.30 hwperf
11.83 11.79 11.71 11.57 11.30 10.82 10.09 9.27 all_random
5.42 5.31 5.15 4.93 4.62 4.18 3.65 3.35 all_dist
11.83 11.79 11.72 11.58 11.30 10.82 10.09 9.27 prefix_random
10.94 10.56 9.89 8.65 6.43 3.38 2.63 2.56 prefix_dist
wKB/p by block cache size in GB
1 2 4 8 16 32 64 128 cache-size/mixgraph-config
0.23 0.27 0.26 0.25 0.25 0.23 0.22 0.22 hwperf
0.48 0.48 0.48 0.48 0.47 0.46 0.45 0.43 all_random
0.28 0.28 0.27 0.27 0.26 0.25 0.27 0.27 all_dist
0.48 0.48 0.48 0.48 0.47 0.47 0.45 0.43 prefix_random
0.45 0.44 0.41 0.37 0.30 0.25 0.23 0.23 prefix_dist
--- count storage operations and throughput per second
r/s by block cache size in GB
1 2 4 8 16 32 64 128 cache-size/mixgraph-config
7278 7179 7124 6917 6613 6256 5801 5686 hwperf
8638 8589 8572 8558 8484 8411 8256 8017 all_random
6710 6673 6576 6469 6274 5971 5528 5267 all_dist
8592 8611 8559 8499 8468 8368 8235 8053 prefix_random
8216 8129 7909 7442 6458 4686 4151 4054 prefix_dist
rMB/s by block cache size in GB
1 2 4 8 16 32 64 128 cache-size/mixgraph-config
57.3 56.5 56.1 54.5 52.2 49.4 45.9 45.0 hwperf
91.1 90.5 90.1 89.6 88.0 86.0 82.7 78.9 all_random
71.6 70.8 69.4 67.9 65.5 62.0 57.1 54.2 all_dist
90.6 90.7 90.0 89.0 87.9 85.6 82.5 79.3 prefix_random
89.0 88.8 88.0 85.7 79.4 56.9 48.1 47.1 prefix_dist
wMB/s by block cache size in GB
1 2 4 8 16 32 64 128 cache-size/mixgraph-config
0.6 0.7 0.7 0.7 0.7 0.7 0.7 0.7 hwperf
0.6 0.6 0.6 0.6 0.6 0.6 0.6 0.6 all_random
0.6 0.6 0.6 0.6 0.6 0.6 0.7 0.7 all_dist
0.6 0.6 0.6 0.6 0.6 0.6 0.6 0.6 prefix_random
0.6 0.6 0.6 0.6 0.6 0.7 0.7 0.7 prefix_dist
--- these count the number of RocksDB API calls per second for Get, Put and Seek
get/s by block cache size in GB
1 2 4 8 16 32 64 128 cache-size/mixgraph-config
15777 15896 16325 16693 17254 18275 19313 19299 hwperf
7610 7588 7601 7650 7698 7858 8100 8411 all_random
13051 13187 13310 13604 14025 14664 15480 15983 all_dist
7567 7605 7589 7597 7686 7817 8079 8454 prefix_random
8039 8309 8790 9791 12198 16654 18101 18152 prefix_dist
put/s by block cache size in GB
1 2 4 8 16 32 64 128 cache-size/mixgraph-config
2663 2683 2755 2817 2912 3084 3259 3256 hwperf
1285 1281 1284 1292 1300 1327 1368 1420 all_random
2203 2226 2247 2297 2368 2475 2612 2697 all_dist
1278 1284 1282 1283 1298 1320 1364 1427 prefix_random
1358 1403 1484 1653 2060 2811 3054 3063 prefix_dist
seek/s by block cache size in GB
1 2 4 8 16 32 64 128 cache-size/mixgraph-config
570 574 590 603 623 660 698 697 hwperf
275 274 275 277 278 284 293 304 all_random
472 476 481 492 507 530 559 577 all_dist
274 275 275 275 278 283 292 306 prefix_random
291 300 318 354 441 602 654 656 prefix_dist
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment