Skip to content

Instantly share code, notes, and snippets.

@mdcallag
Last active July 10, 2023 18:48
Show Gist options
  • Save mdcallag/3d638978466737f22ea4df806905cff6 to your computer and use it in GitHub Desktop.
Save mdcallag/3d638978466737f22ea4df806905cff6 to your computer and use it in GitHub Desktop.
--- 4G block cache
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 9/6 1.04 GB 0.8 953.1 0.0 953.1 1507.2 554.1 0.0 2.6 30.4 48.0 32150.40 32051.33 40205 0.800 33G 0 0.0 0.0
L3 11/11 1.14 GB 0.0 1226.5 529.2 697.3 1196.1 498.7 0.0 2.3 33.7 32.8 37296.00 37198.28 800 46.620 42G 0 0.0 0.0
L4 3/1 404.54 MB 0.8 101.6 66.6 35.0 100.6 65.6 450.1 1.5 42.2 41.8 2467.55 2461.54 421 5.861 3359M 0 0.0 0.0
L5 522/9 3.35 GB 1.0 1159.4 478.5 680.8 1153.2 472.3 40.9 2.4 35.4 35.2 33527.23 33426.09 4921 6.813 45G 0 0.0 0.0
L6 632/14 34.16 GB 0.0 1865.5 510.4 1355.0 1371.9 16.8 17.3 2.7 26.4 19.4 72284.07 72171.11 12396 5.831 112G 18G 0.0 0.0
Sum 1177/41 40.09 GB 0.0 5306.1 1584.7 3721.4 5328.9 1607.5 508.3 9.1 30.6 30.7 177725.25 177308.34 58743 3.025 236G 18G 0.0 0.0
Int 0/0 0.00 KB 0.0 54.1 16.2 37.9 54.7 16.8 3.9 9.4 30.7 31.0 1807.59 1803.57 600 3.013 2517M 182M 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Low 0/0 0.00 KB 0.0 5306.1 1584.7 3721.4 4758.2 1036.8 0.0 0.0 32.4 29.0 167783.65 167411.57 26832 6.253 236G 18G 0.0 0.0
High 0/0 0.00 KB 0.0 0.0 0.0 0.0 570.7 570.7 0.0 0.0 0.0 58.8 9940.52 9896.77 31719 0.313 0 0 0.0 0.0
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 17.3 0.0 0.0 0.0 1.08 0.00 192 0.006 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0
Uptime(secs): 43019.8 total, 411.5 interval
Flush(GB): cumulative 570.746, interval 5.833
AddFile(GB): cumulative 17.307, interval 0.000
AddFile(Total Files): cumulative 192, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 1440302400, interval 0
Cumulative compaction: 5328.91 GB write, 126.84 MB/s write, 5306.13 GB read, 126.30 MB/s read, 177725.3 seconds
Interval compaction: 54.68 GB write, 136.08 MB/s write, 54.14 GB read, 134.75 MB/s read, 1807.6 seconds
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1142, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1142, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-l
imit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1142, total-stops: 0
interval: 1 total count
Block cache LRUCache@0x7f0b1d6fd8b0#1186343 capacity: 4.00 GB seed: 1203922432 usage: 3.91 GB table_size: 524288 occupancy: 222824 collections: 72 last_copies: 1 last_secs: 0.109038 secs_since: 411
Block cache entry stats(count,size,portion): DataBlock(220370,1.70 GB,42.5263%) FilterBlock(959,1.92 GB,47.9225%) IndexBlock(1497,280.84 MB,6.85641%) Misc(11,80.94 KB,0.0019297%)
--- 8G block cache
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 16/9 1.74 GB 17.5 1152.5 0.0 1152.5 1700.0 547.5 0.0 2.9 32.0 47.2 36900.09 36794.14 40984 0.900 40G 0 0.0 0.0
L3 24/24 2.58 GB 0.0 1281.1 521.9 759.1 1253.3 494.1 0.0 2.4 34.6 33.8 37965.13 37863.88 429 88.497 36G 0 0.0 0.0
L4 3/0 270.02 MB 0.8 42.6 27.4 15.1 42.5 27.3 482.6 1.5 54.7 54.6 796.39 793.72 85 9.369 984M 0 0.0 0.0
L5 228/0 2.91 GB 1.0 907.5 446.6 460.9 903.5 442.6 67.9 2.0 36.1 35.9 25741.62 25659.96 4103 6.274 35G 0 0.0 0.0
L6 662/0 33.32 GB 0.0 1635.3 508.2 1127.1 1143.1 16.0 17.3 2.2 28.0 19.5 59905.67 59812.50 10855 5.519 97G 18G 0.0 0.0
Sum 933/33 40.81 GB 0.0 5018.9 1504.1 3514.8 5042.4 1527.6 567.8 8.6 31.9 32.0 161308.90 160924.20 56456 2.857 211G 18G 0.0 0.0
Int 0/0 0.00 KB 0.0 67.7 19.5 48.2 67.5 19.3 5.1 9.1 30.2 30.0 2300.26 2294.92 740 3.108 3137M 272M 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Low 0/0 0.00 KB 0.0 5018.9 1504.1 3514.8 4471.7 956.9 0.0 0.0 34.0 30.2 151373.95 151033.69 24542 6.168 211G 18G 0.0 0.0
High 0/0 0.00 KB 0.0 0.0 0.0 0.0 570.8 570.8 0.0 0.0 0.0 58.8 9933.92 9890.51 31722 0.313 0 0 0.0 0.0
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 17.3 0.0 0.0 0.0 1.04 0.00 192 0.005 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0
Uptime(secs): 41335.5 total, 521.1 interval
Flush(GB): cumulative 570.760, interval 7.408
AddFile(GB): cumulative 17.295, interval 0.000
AddFile(Total Files): cumulative 192, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 1440302400, interval 0
Cumulative compaction: 5042.43 GB write, 124.92 MB/s write, 5018.91 GB read, 124.33 MB/s read, 161308.9 seconds
Interval compaction: 67.50 GB write, 132.63 MB/s write, 67.74 GB read, 133.10 MB/s read, 2300.3 seconds
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2944, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2944, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-l
imit-stops: 0, pending-compaction-bytes-delays: 148, pending-compaction-bytes-stops: 0, total-delays: 3092, total-stops: 0
interval: 1 total count
Block cache LRUCache@0x7f7ec38fd8b0#4006204 capacity: 8.00 GB seed: 1203922432 usage: 7.78 GB table_size: 1048576 occupancy: 478333 collections: 69 last_copies: 1 last_secs: 0.258836 secs_since: 521
Block cache entry stats(count,size,portion): DataBlock(474445,3.66 GB,45.7793%) FilterBlock(1465,3.56 GB,44.4685%) IndexBlock(2435,527.10 MB,6.43433%) Misc(39,307.56 KB,0.00366643%)
--- 12G block cache
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 20/14 3.24 GB 15.0 1151.8 0.0 1151.8 1699.4 547.6 0.0 2.9 32.0 47.2 36832.71 36724.03 40976 0.899 40G 0 0.0 0.0
L3 39/39 3.63 GB 0.0 1284.5 520.5 764.1 1256.9 492.8 0.0 2.4 34.7 33.9 37955.11 37850.65 429 88.473 35G 891K 0.0 0.0
L4 3/0 337.44 MB 1.0 51.9 28.6 23.4 51.8 28.4 478.8 1.8 54.8 54.6 970.61 967.89 105 9.244 1293M 0 0.0 0.0
L5 217/0 2.90 GB 1.0 934.4 449.4 485.0 930.3 445.4 62.5 2.1 36.0 35.9 26569.98 26487.90 4111 6.463 36G 0 0.0 0.0
L6 683/0 33.17 GB 0.0 1582.5 505.5 1077.0 1092.8 15.9 17.3 2.2 28.2 19.4 57542.90 57455.70 10559 5.450 94G 18G 0.0 0.0
Sum 962/53 43.27 GB 0.0 5005.2 1504.0 3501.2 5031.1 1530.0 558.6 8.6 32.1 32.2 159871.32 159486.17 56180 2.846 208G 18G 0.0 0.0
Int 0/0 0.00 KB 0.0 3.1 0.0 3.1 4.3 1.2 0.0 3.4 33.3 46.4 95.73 95.43 95 1.008 110M 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Low 0/0 0.00 KB 0.0 5005.2 1504.0 3501.2 4460.5 959.3 0.0 0.0 34.2 30.5 149942.45 149602.91 24272 6.178 208G 18G 0.0 0.0
High 0/0 0.00 KB 0.0 0.0 0.0 0.0 570.7 570.7 0.0 0.0 0.0 58.9 9927.82 9883.26 31716 0.313 0 0 0.0 0.0
User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 17.3 0.0 0.0 0.0 1.05 0.00 192 0.005 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0
Uptime(secs): 41521.5 total, 97.2 interval
Flush(GB): cumulative 570.678, interval 1.288
AddFile(GB): cumulative 17.291, interval 0.000
AddFile(Total Files): cumulative 192, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 1440302400, interval 0
Cumulative compaction: 5031.14 GB write, 124.08 MB/s write, 5005.16 GB read, 123.44 MB/s read, 159871.3 seconds
Interval compaction: 4.34 GB write, 45.69 MB/s write, 3.11 GB read, 32.81 MB/s read, 95.7 seconds
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3444, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3444, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-l
imit-stops: 0, pending-compaction-bytes-delays: 100, pending-compaction-bytes-stops: 0, total-delays: 3544, total-stops: 0
interval: 19 total count
Block cache LRUCache@0x7f9c986fd8b0#2469544 capacity: 12.00 GB seed: 1203922432 usage: 11.92 GB table_size: 1884160 occupancy: 679199 collections: 70 last_copies: 1 last_secs: 0.32462 secs_since: 97
Block cache entry stats(count,size,portion): DataBlock(673347,5.20 GB,43.3157%) FilterBlock(2362,5.97 GB,49.7283%) IndexBlock(3502,711.46 MB,5.78988%) Misc(22,169.97 KB,0.00135079%)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment