Skip to content

Instantly share code, notes, and snippets.

@mdcallag

mdcallag/gist:36ec815545fd2b8bd5f93fb276e3c700 Secret

Created August 15, 2023 00:42
Show Gist options
  • Save mdcallag/36ec815545fd2b8bd5f93fb276e3c700 to your computer and use it in GitHub Desktop.
Save mdcallag/36ec815545fd2b8bd5f93fb276e3c700 to your computer and use it in GitHub Desktop.
Download ZIP
IO-bound
Raw
gistfile1.txt
--- base config
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 5/5 145.64 MB 0.0 1210.3 0.0 1210.3 2105.8 895.5 0.0 1.6 39.0 67.8 31799.71 31656.88 57175 0.556 30G 0 0.0 0.0
L2 5/5 331.36 MB 0.0 1018.9 453.5 565.4 1001.0 435.5 0.0 2.2 40.9 40.2 25510.15 25431.08 1305 19.548 32G 0 0.0 0.0
L3 17/0 1020.87 MB 10.2 1055.8 573.9 481.9 1052.5 570.6 258.0 1.8 55.9 55.8 19331.54 19253.76 2709 7.136 26G 0 0.0 0.0
L4 130/0 7.59 GB 1.0 1440.2 609.2 831.0 1435.3 604.3 259.1 2.4 42.2 42.1 34940.44 34818.58 8613 4.057 48G 0 0.0 0.0
L5 3838/0 68.34 GB 10.0 988.8 278.9 709.8 981.5 271.7 580.8 3.5 35.5 35.3 28496.58 28356.82 9132 3.121 39G 2690K 0.0 0.0
L6 17649/0 764.59 GB 0.0 1320.0 784.7 535.2 904.3 369.0 395.6 1.2 34.5 23.7 39138.38 38541.51 15271 2.563 36G 3734M 0.0 0.0
Sum 21644/10 841.99 GB 0.0 7033.9 2700.2 4333.7 7480.3 3146.6 1493.4 5.8 40.2 42.7 179216.81 178058.62 94205 1.902 213G 3737M 0.0 0.0
Uptime(secs): 63377.1 total, 288.3 interval
Flush(GB): cumulative 902.056, interval 1.539
AddFile(GB): cumulative 395.551, interval 0.000
AddFile(Total Files): cumulative 4200, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 36000302400, interval 0
Cumulative compaction: 7480.29 GB write, 120.86 MB/s write, 7033.85 GB read, 113.65 MB/s read, 179216.8 seconds
Interval compaction: 24.13 GB write, 85.71 MB/s write, 24.09 GB read, 85.57 MB/s read, 819.8 seconds
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 136, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 136, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays:
65, pending-compaction-bytes-stops: 0, total-delays: 201, total-stops: 0
interval: 0 total count
Block cache LRUCache@0x7f6ae6bf68b0#696924 capacity: 180.00 GB seed: 363166142 usage: 179.99 GB table_size: 33554432 occupancy: 21932772 collections: 52 last_copies: 13 last_secs: 11.579 secs_since: 3888
Block cache entry stats(count,size,portion): DataBlock(21918852,169.28 GB,94.043%) FilterBlock(3349,5.62 GB,3.12046%) IndexBlock(11545,3.13 GB,1.74071%) Misc(6,40.47 KB,2.14411e-05%)
--- sd8k config
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 3/0 108.90 MB 0.8 1214.5 0.0 1214.5 2110.0 895.5 0.0 1.6 38.6 67.1 32220.48 32069.96 57194 0.563 30G 0 0.0 0.0
L2 9/0 634.86 MB 17.4 1023.9 454.0 570.0 1006.3 436.4 0.0 2.2 40.7 40.0 25753.07 25670.48 1319 19.525 32G 0 0.0 0.0
L3 13/0 683.22 MB 0.9 1025.6 550.6 475.0 1022.2 547.1 281.9 1.9 54.9 54.7 19146.76 19067.52 2615 7.322 25G 0 0.0 0.0
L4 128/1 7.55 GB 1.0 1501.9 572.9 929.0 1497.1 568.1 295.7 2.6 40.7 40.6 37747.46 37620.77 6126 6.162 50G 0 0.0 0.0
L5 1208/23 75.74 GB 1.0 1413.4 270.6 1142.8 1406.3 263.5 589.5 5.2 35.1 35.0 41181.88 40990.66 4905 8.396 50G 66K 0.0 0.0
L6 12874/0 757.13 GB 0.0 1903.0 777.8 1125.2 1486.8 361.6 395.6 1.9 35.9 28.1 54236.54 53578.00 22099 2.454 56G 3715M 0.0 0.0
Sum 14235/24 841.81 GB 0.0 8082.4 2625.9 5456.5 8528.7 3072.1 1562.6 6.6 39.4 41.5 210286.19 208997.39 94258 2.231 245G 3715M 0.0 0.0
Uptime(secs): 63270.6 total, 184.1 interval
Flush(GB): cumulative 902.056, interval 0.948
AddFile(GB): cumulative 395.539, interval 0.000
AddFile(Total Files): cumulative 4200, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 36000302400, interval 0
Cumulative compaction: 8528.65 GB write, 138.03 MB/s write, 8082.38 GB read, 130.81 MB/s read, 210286.2 seconds
Interval compaction: 22.34 GB write, 124.23 MB/s write, 22.29 GB read, 123.98 MB/s read, 761.1 seconds
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 128, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 128, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays:
38, pending-compaction-bytes-stops: 0, total-delays: 166, total-stops: 0
interval: 0 total count
Block cache LRUCache@0x7fbe793f68b0#813018 capacity: 180.00 GB seed: 363166142 usage: 179.99 GB table_size: 33554432 occupancy: 22051807 collections: 52 last_copies: 13 last_secs: 11.5619 secs_since: 3784
Block cache entry stats(count,size,portion): DataBlock(22038204,170.19 GB,94.5478%) FilterBlock(2410,4.65 GB,2.58604%) IndexBlock(10530,3.18 GB,1.76706%) Misc(1,0.00 KB,0%)
--- sd38k config
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 4/0 73.12 MB 1.0 1254.0 0.0 1254.0 2149.1 895.1 0.0 1.7 39.0 66.8 32949.38 32797.62 57371 0.574 31G 0 0.0 0.0
L2 8/1 484.57 MB 13.5 1023.8 453.2 570.6 1006.3 435.6 0.0 2.2 40.6 39.9 25841.91 25759.58 1262 20.477 31G 0 0.0 0.0
L3 17/1 908.06 MB 8.2 1023.3 546.1 477.2 1020.1 542.9 286.4 1.9 55.3 55.2 18932.68 18852.76 2462 7.690 25G 0 0.0 0.0
L4 126/0 7.50 GB 1.0 1440.9 581.6 859.3 1436.2 576.9 285.7 2.5 40.9 40.8 36058.37 35935.00 6049 5.961 48G 0 0.0 0.0
L5 1215/0 75.91 GB 10.0 1329.6 269.4 1060.2 1322.5 262.3 590.6 4.9 35.0 34.8 38872.68 38690.45 4605 8.441 48G 40K 0.0 0.0
L6 12885/0 757.18 GB 0.0 1843.5 777.7 1065.9 1427.5 361.6 395.6 1.8 35.9 27.8 52599.67 51942.70 20792 2.530 54G 3736M 0.0 0.0
Sum 14255/2 842.02 GB 0.0 7915.2 2628.0 5287.2 8361.7 3074.4 1558.3 6.4 39.5 41.7 205254.68 203978.11 92541 2.218 240G 3736M 0.0 0.0
Uptime(secs): 63419.7 total, 334.7 interval
Flush(GB): cumulative 902.056, interval 1.754
AddFile(GB): cumulative 395.546, interval 0.000
AddFile(Total Files): cumulative 4200, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 36000302400, interval 0
Cumulative compaction: 8361.68 GB write, 135.01 MB/s write, 7915.20 GB read, 127.80 MB/s read, 205254.7 seconds
Interval compaction: 36.74 GB write, 112.41 MB/s write, 36.65 GB read, 112.14 MB/s read, 1264.7 seconds
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 350, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 350, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays:
130, pending-compaction-bytes-stops: 0, total-delays: 480, total-stops: 0
interval: 0 total count
Block cache LRUCache@0x7f8a4ddf68b0#911884 capacity: 180.00 GB seed: 363166142 usage: 180.00 GB table_size: 33554432 occupancy: 22047113 collections: 52 last_copies: 15 last_secs: 11.3558 secs_since: 4534
Block cache entry stats(count,size,portion): DataBlock(22034124,170.16 GB,94.5323%) FilterBlock(2373,4.69 GB,2.60469%) IndexBlock(10486,3.19 GB,1.77117%) Misc(1,0.00 KB,0%)
--- sd128k config
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 4/0 127.22 MB 1.0 1243.4 0.0 1243.4 2137.6 894.2 0.0 1.6 38.6 66.3 33017.70 32844.93 57281 0.576 31G 0 0.0 0.0
L2 8/0 344.01 MB 9.0 1037.7 452.3 585.3 1020.9 435.6 0.0 2.3 40.3 39.6 26369.09 26282.70 1327 19.871 30G 0 0.0 0.0
L3 15/0 926.66 MB 9.4 1027.3 550.3 477.0 1023.8 546.8 282.2 1.9 55.3 55.1 19039.91 18947.40 2687 7.086 25G 0 0.0 0.0
L4 130/1 7.59 GB 1.0 1386.1 570.3 815.8 1381.7 565.9 297.0 2.4 41.4 41.2 34320.53 34195.06 5900 5.817 46G 0 0.0 0.0
L5 1211/5 75.68 GB 1.0 1198.1 282.2 915.9 1191.2 275.3 577.7 4.2 36.0 35.8 34111.74 33940.17 5866 5.815 44G 0 0.0 0.0
L6 12885/0 757.19 GB 0.0 1563.1 777.8 785.3 1146.9 361.6 395.5 1.5 35.7 26.2 44846.46 44226.12 15644 2.867 44G 3710M 0.0 0.0
Sum 14253/6 841.83 GB 0.0 7455.8 2633.0 4822.8 7902.1 3079.3 1552.4 6.1 39.8 42.2 191705.43 190436.38 88705 2.161 223G 3710M 0.0 0.0
Uptime(secs): 63390.5 total, 304.3 interval
Flush(GB): cumulative 902.043, interval 1.593
AddFile(GB): cumulative 395.536, interval 0.000
AddFile(Total Files): cumulative 4200, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 36000302400, interval 0
Cumulative compaction: 7902.05 GB write, 127.65 MB/s write, 7455.76 GB read, 120.44 MB/s read, 191705.4 seconds
Interval compaction: 29.82 GB write, 100.36 MB/s write, 30.05 GB read, 101.10 MB/s read, 1023.4 seconds
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 881, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 881, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays:
87, pending-compaction-bytes-stops: 0, total-delays: 968, total-stops: 0
interval: 0 total count
Block cache LRUCache@0x7f22cc7f68b0#1018276 capacity: 180.00 GB seed: 363166142 usage: 180.00 GB table_size: 33554432 occupancy: 22062101 collections: 51 last_copies: 17 last_secs: 11.6152 secs_since: 5104
Block cache entry stats(count,size,portion): DataBlock(22048855,170.27 GB,94.5933%) FilterBlock(2483,4.59 GB,2.54724%) IndexBlock(10512,3.17 GB,1.76063%) Misc(1,0.00 KB,0%)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment