Skip to content

Instantly share code, notes, and snippets.

@mdcallag
Created August 15, 2023 00:33
Show Gist options
  • Save mdcallag/e0045693107b15bfc03b4ed355efcb28 to your computer and use it in GitHub Desktop.
Save mdcallag/e0045693107b15bfc03b4ed355efcb28 to your computer and use it in GitHub Desktop.
Cached, end of q1000
--- base config
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 3/0 54.81 MB 0.8 545.5 0.0 545.5 864.3 318.7 0.0 2.5 30.5 48.3 18313.14 18249.28 22870 0.801 18G 0 0.0 0.0
L3 6/2 411.40 MB 0.8 755.9 294.8 461.1 739.5 278.4 0.0 2.5 34.7 34.0 22304.30 22235.78 567 39.337 22G 0 0.0 0.0
L4 9/1 387.00 MB 0.9 76.8 49.7 27.2 76.1 49.0 247.1 1.5 44.7 44.3 1759.84 1754.37 317 5.552 2405M 0 0.0 0.0
L5 303/0 2.97 GB 1.0 659.5 271.3 388.1 656.1 267.9 28.8 2.4 36.5 36.3 18520.85 18456.86 2844 6.512 25G 0 0.0 0.0
L6 646/0 33.24 GB 0.0 964.9 294.4 670.6 686.5 15.9 17.3 2.3 27.9 19.9 35373.43 35307.39 6782 5.216 56G 10G 0.0 0.0
Sum 967/3 37.04 GB 0.0 3002.7 910.2 2092.6 3022.5 929.9 293.3 8.7 31.9 32.1 96271.56 96003.68 33380 2.884 126G 10G 0.0 0.0
Uptime(secs): 33651.6 total, 594.0 interval
Flush(GB): cumulative 328.831, interval 3.186
AddFile(GB): cumulative 17.293, interval 0.000
AddFile(Total Files): cumulative 192, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 1440302400, interval 0
Cumulative compaction: 3022.47 GB write, 91.97 MB/s write, 3002.73 GB read, 91.37 MB/s read, 96271.6 seconds
Interval compaction: 36.63 GB write, 63.14 MB/s write, 36.65 GB read, 63.18 MB/s read, 1283.8 seconds
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1503, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1503, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays
: 0, pending-compaction-bytes-stops: 0, total-delays: 1503, total-stops: 0
interval: 0 total count
Block cache LRUCache@0x7f3683df68b0#3025072 capacity: 180.00 GB seed: 363166142 usage: 179.91 GB table_size: 33554432 occupancy: 18191129 collections: 19 last_copies: 13 last_secs: 9.80199 secs_since: 4194
Block cache entry stats(count,size,portion): DataBlock(18171010,140.36 GB,77.9765%) FilterBlock(15942,34.25 GB,19.0279%) IndexBlock(21675,3.68 GB,2.04704%) Misc(2,8.09 KB,4.28822e-06%)
--- sd8k config
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 18.25 MB 0.2 549.8 0.0 549.8 868.6 318.8 0.0 2.5 30.3 47.8 18591.27 18525.30 22944 0.810 19G 0 0.0 0.0
L3 4/0 302.35 MB 11.0 765.5 294.9 470.6 748.7 278.1 0.0 2.5 34.3 33.5 22884.98 22813.27 560 40.866 23G 229K 0.0 0.0
L4 9/1 566.01 MB 12.4 62.8 40.0 22.8 62.3 39.4 256.5 1.6 46.4 46.1 1384.07 1379.65 233 5.940 1860M 0 0.0 0.0
L5 47/3 3.08 GB 0.9 742.5 274.8 467.7 738.9 271.2 25.2 2.7 35.3 35.2 21521.24 21445.98 2804 7.675 26G 0 0.0 0.0
L6 599/0 32.25 GB 0.0 1249.7 293.9 955.8 970.7 14.9 17.3 3.3 31.0 24.1 41215.86 41114.65 11987 3.438 62G 10G 0.0 0.0
Sum 660/4 36.20 GB 0.0 3370.3 903.7 2466.6 3389.2 922.6 299.0 9.8 32.7 32.9 105597.43 105278.86 38528 2.741 134G 10G 0.0 0.0
Uptime(secs): 33558.4 total, 492.4 interval
Flush(GB): cumulative 328.817, interval 2.613
AddFile(GB): cumulative 17.304, interval 0.000
AddFile(Total Files): cumulative 192, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 1440302400, interval 0
Cumulative compaction: 3389.15 GB write, 103.42 MB/s write, 3370.26 GB read, 102.84 MB/s read, 105597.4 seconds
Interval compaction: 42.76 GB write, 88.93 MB/s write, 42.98 GB read, 89.39 MB/s read, 1421.9 seconds
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1220, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1220, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays
: 0, pending-compaction-bytes-stops: 0, total-delays: 1220, total-stops: 0
interval: 0 total count
Block cache LRUCache@0x7f6c7cff68b0#842215 capacity: 180.00 GB seed: 363166142 usage: 179.99 GB table_size: 33554432 occupancy: 21911931 collections: 18 last_copies: 5 last_secs: 12.3575 secs_since: 1692
Block cache entry stats(count,size,portion): DataBlock(21900353,169.17 GB,93.9838%) FilterBlock(4706,7.78 GB,4.3229%) IndexBlock(6907,1.08 GB,0.601732%) Misc(1,0.00 KB,0%)
--- sd32k config
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 2/0 36.48 MB 0.5 552.6 0.0 552.6 871.2 318.6 0.0 2.5 30.3 47.8 18668.42 18601.60 22923 0.814 19G 0 0.0 0.0
L3 4/2 302.92 MB 0.5 754.0 294.7 459.3 737.3 278.0 0.0 2.5 34.2 33.4 22597.91 22526.84 558 40.498 23G 0 0.0 0.0
L4 6/1 416.91 MB 1.0 68.9 44.7 24.2 68.4 44.2 251.7 1.5 45.2 44.9 1560.76 1556.44 257 6.073 2082M 0 0.0 0.0
L5 54/0 3.29 GB 9.7 689.3 273.2 416.1 685.8 269.7 26.9 2.5 35.2 35.1 20028.37 19950.37 2784 7.194 26G 0 0.0 0.0
L6 598/0 32.27 GB 0.0 1207.2 293.9 913.3 928.2 15.0 17.3 3.2 30.7 23.6 40236.51 40117.98 10631 3.785 61G 10G 0.0 0.0
Sum 664/3 36.30 GB 0.0 3272.0 906.5 2365.5 3291.0 925.4 295.9 9.5 32.5 32.7 103091.97 102753.23 37153 2.775 132G 10G 0.0 0.0
Uptime(secs): 33448.9 total, 390.3 interval
Flush(GB): cumulative 328.817, interval 2.058
AddFile(GB): cumulative 17.303, interval 0.000
AddFile(Total Files): cumulative 192, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 1440302400, interval 0
Cumulative compaction: 3290.95 GB write, 100.75 MB/s write, 3271.96 GB read, 100.17 MB/s read, 103092.0 seconds
Interval compaction: 34.21 GB write, 89.76 MB/s write, 34.31 GB read, 90.03 MB/s read, 1145.6 seconds
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1269, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1269, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays
: 18, pending-compaction-bytes-stops: 0, total-delays: 1287, total-stops: 0
interval: 0 total count
Block cache LRUCache@0x7f9d04ff68b0#2866554 capacity: 180.00 GB seed: 363166142 usage: 179.88 GB table_size: 33554432 occupancy: 18585026 collections: 18 last_copies: 13 last_secs: 10.6511 secs_since: 3990
Block cache entry stats(count,size,portion): DataBlock(18557647,143.36 GB,79.6456%) FilterBlock(13473,31.44 GB,17.4688%) IndexBlock(18806,3.41 GB,1.89299%) Misc(1,0.00 KB,0%)
--- sd128k config
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 3/0 54.81 MB 0.8 513.4 0.0 513.4 833.1 319.7 0.0 2.4 29.7 48.2 17703.45 17650.03 22698 0.780 17G 0 0.0 0.0
L3 3/0 243.56 MB 1.0 720.0 295.8 424.2 703.5 279.3 0.0 2.4 34.3 33.5 21493.40 21436.86 656 32.764 21G 0 0.0 0.0
L4 5/1 418.83 MB 8.9 100.0 65.3 34.8 99.0 64.2 232.3 1.5 42.0 41.5 2440.42 2434.15 459 5.317 3322M 0 0.0 0.0
L5 78/5 3.50 GB 1.0 759.9 275.2 484.7 755.7 271.0 25.7 2.7 35.7 35.5 21791.79 21729.03 3081 7.073 29G 0 0.0 0.0
L6 589/0 32.26 GB 0.0 1144.2 293.9 850.4 865.3 15.0 17.3 2.9 29.9 22.6 39190.45 39107.61 9261 4.232 60G 10G 0.0 0.0
Sum 678/6 36.45 GB 0.0 3237.5 930.1 2307.4 3256.7 949.3 275.3 9.4 32.3 32.5 102619.51 102357.68 36155 2.838 133G 10G 0.0 0.0
Uptime(secs): 33481.9 total, 416.9 interval
Flush(GB): cumulative 328.832, interval 2.219
AddFile(GB): cumulative 17.294, interval 0.000
AddFile(Total Files): cumulative 192, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 1440302400, interval 0
Cumulative compaction: 3256.68 GB write, 99.60 MB/s write, 3237.52 GB read, 99.02 MB/s read, 102619.5 seconds
Interval compaction: 29.16 GB write, 71.62 MB/s write, 29.20 GB read, 71.73 MB/s read, 989.2 seconds
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1326, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1326, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays
: 29, pending-compaction-bytes-stops: 0, total-delays: 1355, total-stops: 0
interval: 0 total count
Block cache LRUCache@0x7f8af43f68b0#686150 capacity: 180.00 GB seed: 363166142 usage: 179.94 GB table_size: 33554432 occupancy: 21355437 collections: 19 last_copies: 9 last_secs: 13.0382 secs_since: 2816
Block cache entry stats(count,size,portion): DataBlock(21369726,165.09 GB,91.7166%) FilterBlock(6649,11.59 GB,6.43738%) IndexBlock(8850,1.34 GB,0.745627%) Misc(1,0.00 KB,0%)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment