Skip to content

Instantly share code, notes, and snippets.

@mdcallag

mdcallag/gist:e9924e9a206895a8ff370d250c392892 Secret

Created May 5, 2022 20:03
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save mdcallag/e9924e9a206895a8ff370d250c392892 to your computer and use it in GitHub Desktop.
Save mdcallag/e9924e9a206895a8ff370d250c392892 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
gistfile1.txt
Legend:
* wps = writes/second, readwhilewriting had a rate limit on the writer, thus write rates match
* ingest - GB of data written into RocksDB
* flush - GB of memtable flushes
* compact - GB of compaction
* c.wsecs - wall clock seconds of compaction, from "Comp(sec)" column in compaction IO stats
* c.csecs - CPU seconds of compaction, from "CompMergeCPU(sec)" column in compaction IO stats
* cpu/w - c.csecs / wps
* stall% - percentage of time writes are stopped or stalled
* ml2comp - level at which compression starts, levels above this are not compressed
* avg-sec-compaction-job - average time for a compaction/flush job into this level, "Avg(sec)" column from compaction IO stats
wps ingest flush compact w-amp c.wsecs c.csecs cpu/w stall% ml2comp avg-sec-compaction-job
--- readwhilewriting
220555 18.05 17.81 313 18.3 2867 2798 NA 0 3 0.05 0.53 0.17 0.86 0.86 0.87 0.58
224320 18.05 9.84 245 14.1 2737 2693 NA 0 0 0.08 1.03 0.47 0.92 0.88 0.88 0.55
--- overwrite
117383 167.25 169.42 2627 16.7 17084 16464 0.140 49.7 3 0.11 13.38 0.14 0.31 0.37 0.59 0.77
89177 127.07 71.12 1486 12.3 14554 14209 0.159 62.9 0 0.18 28.86 0.42 0.44 0.40 0.58 0.79
--- ml2comp=3, readwhilewriting
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 15.10 MB 0.2 0.0 0.0 0.0 17.8 17.8 0.0 1.0 0.0 300.8 60.63 56.05 1209 0.050 0 0 0.0 0.0
L2 6/1 91.48 MB 1.2 31.9 17.8 14.0 31.8 17.8 0.0 1.8 253.6 253.4 128.68 119.55 242 0.532 79M 2478 0.0 0.0
L3 18/2 275.65 MB 1.1 45.2 17.4 27.7 45.2 17.4 0.3 2.6 245.5 245.4 188.46 179.16 1129 0.167 112M 5085 0.0 0.0
L4 135/0 1.84 GB 1.1 96.0 17.7 78.2 88.0 9.8 0.0 5.0 99.4 91.2 988.20 971.30 1146 0.862 396M 85K 0.0 0.0
L5 1023/0 13.52 GB 1.0 53.1 9.7 43.4 53.0 9.6 0.0 5.4 90.9 90.7 598.18 588.10 694 0.862 239M 630K 0.0 0.0
L6 8035/0 108.17 GB 1.0 51.1 9.5 41.6 50.2 8.5 0.0 5.3 90.0 88.3 582.02 569.32 666 0.874 231M 4390K 0.0 0.0
L7 65643/0 859.23 GB 0.0 29.7 7.9 21.8 27.4 5.6 0.1 3.5 94.8 87.3 321.23 314.74 557 0.577 135M 9045K 0.0 0.0
Sum 74861/3 983.14 GB 0.0 307.0 80.2 226.8 313.4 86.6 0.4 17.6 109.6 111.9 2867.39 2798.20 5643 0.508 1195M 14M 0.0 0.0
Uptime(secs): 1784.3 total, 20.0 interval
Flush(GB): cumulative 17.809, interval 0.192
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 313.40 GB write, 179.85 MB/s write, 307.00 GB read, 176.18 MB/s read, 2867.4 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_com
paction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f6ef7629470#3553032 capacity: 210.00 GB collections: 2 last_copies: 1 last_secs: 15.7874 secs_since: 1166
Block cache entry stats(count,size,portion): DataBlock(25536222,196.72 GB,93.6769%) FilterBlock(82727,5.98 GB,2.84974%) IndexBlock(82740,4.99 GB,2.37807%) Misc(1,0.00 KB,0%)
** DB Stats **
Uptime(secs): 1784.3 total, 20.0 interval
Cumulative writes: 44M writes, 44M keys, 44M commit groups, 1.0 writes per commit group, ingest: 18.05 GB, 10.36 MB/s
Cumulative WAL: 44M writes, 0 syncs, 44453000.00 writes per sync, written: 18.05 GB, 10.36 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
--- ml2comp=0, readwhilewriting
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 3/0 25.02 MB 0.8 0.0 0.0 0.0 9.8 9.8 0.0 1.0 0.0 104.3 96.68 94.34 1209 0.080 0 0 0.0 0.0
L2 5/1 67.34 MB 0.8 23.6 9.9 13.7 23.6 9.9 0.0 2.4 96.8 96.9 249.42 246.37 242 1.031 106M 3691 0.0 0.0
L3 18/2 214.62 MB 0.8 28.1 9.8 18.3 28.1 9.8 0.1 2.9 92.9 93.0 309.23 302.55 656 0.471 126M 8894 0.0 0.0
L4 135/0 1.75 GB 1.0 53.5 9.9 43.6 53.4 9.8 0.0 5.4 92.6 92.6 590.98 582.25 643 0.919 240M 81K 0.0 0.0
L5 1039/0 13.78 GB 1.0 53.9 9.8 44.1 53.8 9.6 0.0 5.5 91.4 91.1 604.53 595.24 686 0.881 243M 649K 0.0 0.0
L6 8075/0 108.18 GB 1.0 51.4 9.4 41.9 50.3 8.4 0.0 5.3 90.9 89.1 578.73 572.10 661 0.876 232M 4704K 0.0 0.0
L7 65602/0 859.38 GB 0.0 28.1 7.8 20.3 25.9 5.6 0.1 3.3 93.4 86.3 307.79 300.07 558 0.552 127M 8190K 0.0 0.0
Sum 74877/3 983.40 GB 0.0 238.5 56.6 181.9 245.0 63.1 0.2 24.9 89.2 91.6 2737.37 2692.91 4655 0.588 1076M 13M 0.0 0.0
Uptime(secs): 1784.3 total, 20.0 interval
Flush(GB): cumulative 9.844, interval 0.106
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 244.99 GB write, 140.60 MB/s write, 238.49 GB read, 136.86 MB/s read, 2737.4 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_com
paction, 0 memtable_slowdown, interval 0 total count
Block cache LRUCache@0x7f4c78a29470#456077 capacity: 210.00 GB collections: 2 last_copies: 1 last_secs: 15.067 secs_since: 1166
Block cache entry stats(count,size,portion): DataBlock(25550024,196.83 GB,93.7276%) FilterBlock(81114,5.93 GB,2.82153%) IndexBlock(81115,4.95 GB,2.35606%) Misc(2,8.08 KB,3.66852e-06%)
** DB Stats **
Uptime(secs): 1784.3 total, 20.0 interval
Cumulative writes: 44M writes, 44M keys, 44M commit groups, 1.0 writes per commit group, ingest: 18.05 GB, 10.36 MB/s
Cumulative WAL: 44M writes, 0 syncs, 44453000.00 writes per sync, written: 18.05 GB, 10.36 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
--- ml2comp=3, overwriteandwait
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 0/0 0.00 KB 0.0 266.7 0.0 266.7 435.9 169.2 0.0 2.6 176.6 288.6 1546.74 1355.93 14409 0.107 665M 24K 0.0 0.0
L2 3/0 48.27 MB 0.8 709.0 169.3 539.8 708.4 168.6 0.0 4.2 321.0 320.7 2261.54 2202.69 169 13.382 1772M 1202K 0.0 0.0
L3 15/0 213.44 MB 1.0 212.9 123.4 89.4 212.6 123.1 45.2 1.7 280.2 279.8 777.87 697.64 5494 0.142 532M 665K 0.0 0.0
L4 157/0 1.69 GB 1.0 382.9 168.3 214.6 307.0 92.5 0.0 1.8 131.0 105.0 2993.85 2933.64 9697 0.309 1388M 3775K 0.0 0.0
L5 1062/0 13.58 GB 1.0 196.2 82.6 113.7 194.7 81.0 10.0 2.4 108.1 107.3 1858.85 1816.10 5074 0.366 885M 6767K 0.0 0.0
L6 8072/0 108.74 GB 1.0 375.4 90.9 284.5 364.5 80.0 0.1 4.0 108.6 105.4 3540.36 3455.72 5993 0.591 1695M 49M 0.0 0.0
L7 55561/0 869.93 GB 0.0 473.1 79.5 393.6 404.1 10.5 0.1 5.1 118.0 100.8 4105.07 4002.54 5354 0.767 2157M 292M 0.0 0.0
Sum 64870/0 994.19 GB 0.0 2616.2 714.0 1902.3 2627.2 725.0 55.4 15.5 156.8 157.5 17084.27 16464.26 46190 0.370 9096M 353M 0.0 0.0
Uptime(secs): 4068.6 total, 464.8 interval
Flush(GB): cumulative 169.418, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 2627.22 GB write, 661.23 MB/s write, 2616.23 GB read, 658.47 MB/s read, 17084.3 seconds
Stalls(count): 6619 level0_slowdown, 6496 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 15881 stop for pending_compaction_bytes, 5294 slowdown for pending_compaction_bytes, 0 memtable_compaction, 2 memtable_slowdown, interval 4459 total count
Block cache LRUCache@0x7f9998e29470#3679923 capacity: 210.00 GB collections: 7 last_copies: 0 last_secs: 0.101893 secs_since: 464
Block cache entry stats(count,size,portion): FilterBlock(147443,10.18 GB,4.84559%) IndexBlock(183189,9.90 GB,4.71653%) Misc(17,129.25 KB,5.86964e-05%)
** DB Stats **
Uptime(secs): 4068.6 total, 464.8 interval
Cumulative writes: 422M writes, 422M keys, 32M commit groups, 12.9 writes per commit group, ingest: 167.25 GB, 42.10 MB/s
Cumulative WAL: 422M writes, 0 syncs, 422630968.00 writes per sync, written: 167.25 GB, 42.10 MB/s
Cumulative stall: 00:33:42.873 H:M:S, 49.7 percent
--- ml2comp=0, overwriteandwait
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 0/0 0.00 KB 0.0 133.5 0.0 133.5 204.6 71.2 0.0 2.9 67.6 103.7 2020.76 1951.74 11102 0.182 602M 31K 0.0 0.0
L2 4/0 61.00 MB 1.0 288.0 71.2 216.8 287.8 71.0 0.0 4.0 108.7 108.6 2712.85 2693.56 94 28.860 1298M 1293K 0.0 0.0
L3 14/0 216.87 MB 1.0 90.0 53.2 36.9 89.9 53.0 17.8 1.7 104.8 104.6 880.03 864.73 2075 0.424 405M 663K 0.0 0.0
L4 113/0 1.70 GB 1.0 163.2 65.9 97.3 162.6 65.3 4.9 2.5 106.5 106.1 1568.37 1549.43 3602 0.435 735M 2567K 0.0 0.0
L5 941/0 13.60 GB 1.0 161.7 65.1 96.7 160.5 63.9 5.2 2.5 107.3 106.5 1543.24 1509.50 3901 0.396 729M 5297K 0.0 0.0
L6 8069/0 108.85 GB 1.0 272.8 69.0 203.9 265.0 61.1 0.0 3.8 107.6 104.5 2597.04 2517.05 4493 0.578 1231M 35M 0.0 0.0
L7 57253/0 870.83 GB 0.0 365.4 60.7 304.7 316.1 11.3 0.1 5.2 115.8 100.1 3232.06 3122.78 4114 0.786 1666M 207M 0.0 0.0
Sum 66394/0 995.24 GB 0.0 1474.6 385.0 1089.6 1486.4 396.8 28.0 20.9 103.8 104.6 14554.36 14208.79 29381 0.495 6670M 252M 0.0 0.0
Uptime(secs): 3948.0 total, 344.5 interval
Flush(GB): cumulative 71.120, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 1486.42 GB write, 385.53 MB/s write, 1474.65 GB read, 382.48 MB/s read, 14554.4 seconds
Stalls(count): 7019 level0_slowdown, 6811 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 10087 stop for pending_compaction_bytes, 3139 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 2196 total count
Block cache LRUCache@0x7f2c17429470#607317 capacity: 210.00 GB collections: 7 last_copies: 0 last_secs: 0.055197 secs_since: 344
Block cache entry stats(count,size,portion): FilterBlock(86716,7.61 GB,3.62184%) IndexBlock(118709,7.92 GB,3.77367%) Misc(6,40.39 KB,1.83426e-05%)
** DB Stats **
Uptime(secs): 3948.0 total, 344.5 interval
Cumulative writes: 321M writes, 321M keys, 25M commit groups, 12.6 writes per commit group, ingest: 127.07 GB, 32.96 MB/s
Cumulative WAL: 321M writes, 0 syncs, 321062968.00 writes per sync, written: 127.07 GB, 32.96 MB/s
Cumulative stall: 00:41:22.325 H:M:S, 62.9 percent
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment