Skip to content

Instantly share code, notes, and snippets.

@mdcallag
Created June 22, 2023 23:38
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save mdcallag/db55ad7843193541ac27a21346760213 to your computer and use it in GitHub Desktop.
Save mdcallag/db55ad7843193541ac27a21346760213 to your computer and use it in GitHub Desktop.
lz4 with min_level_to_compress=2
--- leveled
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 3/0 160.69 MB 0.8 0.0 0.0 0.0 11.3 11.3 0.0 1.0 0.0 193.5 59.79 42.14 216 0.277 0 0 0.0 0.0
L4 4/0 214.24 MB 0.8 0.0 0.0 0.0 0.0 0.0 6.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
L5 19/0 531.74 MB 1.0 6.2 6.2 0.0 3.2 3.2 4.5 0.5 139.6 72.9 45.28 44.65 118 0.384 54M 0 0.0 0.0
L6 190/0 5.42 GB 0.0 4.3 4.3 0.0 2.2 2.2 3.2 0.5 135.8 71.0 32.33 31.84 82 0.394 37M 0 0.0 0.0
Sum 216/0 6.30 GB 0.0 10.5 10.5 0.0 16.8 16.8 14.1 1.5 78.0 124.9 137.40 118.62 416 0.330 92M 0 0.0 0.0
Int 0/0 0.00 KB 0.0 10.5 10.5 0.0 16.7 16.7 14.1 1.5 78.1 124.8 137.16 118.46 415 0.330 92M 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Low 0/0 0.00 KB 0.0 10.5 10.5 0.0 5.5 5.5 0.0 0.0 138.0 72.1 77.61 76.49 200 0.388 92M 0 0.0 0.0
High 0/0 0.00 KB 0.0 0.0 0.0 0.0 11.3 11.3 0.0 0.0 0.0 193.5 59.79 42.14 216 0.277 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0
Uptime(secs): 421.5 total, 418.5 interval
Flush(GB): cumulative 11.298, interval 11.245
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 16.76 GB write, 40.73 MB/s write, 10.46 GB read, 25.42 MB/s read, 137.4 seconds
Interval compaction: 16.71 GB write, 40.89 MB/s write, 10.46 GB read, 25.60 MB/s read, 137.2 seconds
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-sts0
Block cache LRUCache@0x7f62ea4271f0#2055150 capacity: 32.00 MB seed: 1876769373 usage: 0.09 KB table_size: 1024 occupancy: 1 collections: 1 last_copies: 1 last_secs: 0.00014 secs_since: 421
Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
** DB Stats **
Uptime(secs): 421.5 total, 418.5 interval
Cumulative writes: 100M writes, 100M keys, 100M commit groups, 1.0 writes per commit group, ingest: 12.20 GB, 29.64 MB/s
Cumulative WAL: 100M writes, 0 syncs, 100000000.00 writes per sync, written: 12.20 GB, 29.64 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 99M writes, 99M keys, 99M commit groups, 1.0 writes per commit group, ingest: 12401.66 MB, 29.64 MB/s
Interval WAL: 99M writes, 0 syncs, 99267815.00 writes per sync, written: 12.11 GB, 29.64 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
Write Stall (count): write-buffer-manager-limit-stops: 0
--- universal without trivial move
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 5/1 267.80 MB 1.8 0.0 0.0 0.0 11.3 11.3 0.0 1.0 0.0 198.1 58.39 40.44 216 0.270 0 0 0.0 0.0
L2 3/3 139.93 MB 0.0 2.8 2.8 0.0 1.5 1.5 0.0 0.5 144.1 75.3 20.07 19.86 21 0.956 24M 0 0.0 0.0
L3 13/13 783.61 MB 0.0 14.7 5.3 9.4 12.7 3.3 0.0 2.4 83.3 72.0 180.05 177.91 65 2.770 213M 0 0.0 0.0
L4 14/0 839.59 MB 0.0 4.3 3.0 1.3 3.5 2.2 0.0 1.2 89.7 72.9 48.73 48.17 16 3.045 58M 0 0.0 0.0
L5 23/0 1.39 GB 0.0 4.5 3.4 1.1 3.6 2.5 0.0 1.1 91.3 73.0 50.21 49.48 9 5.579 60M 0 0.0 0.0
L6 43/0 2.65 GB 0.0 4.7 2.9 1.9 4.5 2.7 0.0 1.6 75.3 71.7 64.42 63.23 5 12.884 76M 0 0.0 0.0
Sum 101/17 6.03 GB 0.0 31.0 17.3 13.6 37.0 23.4 0.0 3.3 75.2 89.8 421.87 399.09 332 1.271 433M 0 0.0 0.0
Int 0/0 0.00 KB 0.0 31.0 17.3 13.6 36.9 23.3 0.0 3.3 75.2 89.7 421.64 398.92 331 1.274 433M 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Low 0/0 0.00 KB 0.0 31.0 17.3 13.6 25.7 12.1 0.0 0.0 87.2 72.4 363.48 358.65 116 3.133 433M 0 0.0 0.0
High 0/0 0.00 KB 0.0 0.0 0.0 0.0 11.3 11.3 0.0 0.0 0.0 198.1 58.39 40.44 216 0.270 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0
Uptime(secs): 434.8 total, 431.8 interval
Flush(GB): cumulative 11.298, interval 11.246
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 36.99 GB write, 87.12 MB/s write, 30.96 GB read, 72.92 MB/s read, 421.9 seconds
Interval compaction: 36.94 GB write, 87.61 MB/s write, 30.96 GB read, 73.43 MB/s read, 421.6 seconds
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-sts0
interval: 4 total count
Block cache LRUCache@0x7f28eb827290#2092766 capacity: 32.00 MB seed: 151965530 usage: 0.09 KB table_size: 1024 occupancy: 1 collections: 1 last_copies: 1 last_secs: 0.000125 secs_since: 434
Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
** DB Stats **
Uptime(secs): 434.8 total, 431.8 interval
Cumulative writes: 100M writes, 100M keys, 100M commit groups, 1.0 writes per commit group, ingest: 12.20 GB, 28.73 MB/s
Cumulative WAL: 100M writes, 0 syncs, 100000000.00 writes per sync, written: 12.20 GB, 28.73 MB/s
Cumulative stall: 00:00:9.763 H:M:S, 2.2 percent
Interval writes: 99M writes, 99M keys, 99M commit groups, 1.0 writes per commit group, ingest: 12404.20 MB, 28.73 MB/s
Interval WAL: 99M writes, 0 syncs, 99288124.00 writes per sync, written: 12.11 GB, 28.73 MB/s
Interval stall: 00:00:9.763 H:M:S, 2.3 percent
Write Stall (count): write-buffer-manager-limit-stops: 0
--- universal with trivial move
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 1/0 53.56 MB 0.8 0.0 0.0 0.0 11.3 11.3 0.0 1.0 0.0 207.5 55.75 38.74 216 0.258 0 0 0.0 0.0
L4 32/0 1.67 GB 0.0 0.0 0.0 0.0 0.0 0.0 6.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
L5 63/0 3.30 GB 0.0 0.0 0.0 0.0 0.0 0.0 6.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
L6 120/0 6.28 GB 0.0 0.0 0.0 0.0 0.0 0.0 6.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0
Sum 216/0 11.30 GB 0.0 0.0 0.0 0.0 11.3 11.3 18.5 1.0 0.0 207.5 55.75 38.74 216 0.258 0 0 0.0 0.0
Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 11.2 11.2 18.5 1.0 0.0 207.5 55.50 38.57 215 0.258 0 0 0.0 0.0
** Compaction Stats [default] **
Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
High 0/0 0.00 KB 0.0 0.0 0.0 0.0 11.3 11.3 0.0 0.0 0.0 207.5 55.75 38.74 216 0.258 0 0 0.0 0.0
Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0
Uptime(secs): 415.4 total, 412.4 interval
Flush(GB): cumulative 11.298, interval 11.245
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 11.30 GB write, 27.85 MB/s write, 0.00 GB read, 0.00 MB/s read, 55.7 seconds
Interval compaction: 11.25 GB write, 27.92 MB/s write, 0.00 GB read, 0.00 MB/s read, 55.5 seconds
Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-sts0
Block cache LRUCache@0x7f408f2271f0#2123071 capacity: 32.00 MB seed: 587946774 usage: 0.09 KB table_size: 1024 occupancy: 1 collections: 1 last_copies: 1 last_secs: 0.00011 secs_since: 415
Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%)
** File Read Latency Histogram By Level [default] **
** DB Stats **
Uptime(secs): 415.4 total, 412.4 interval
Cumulative writes: 100M writes, 100M keys, 100M commit groups, 1.0 writes per commit group, ingest: 12.20 GB, 30.07 MB/s
Cumulative WAL: 100M writes, 0 syncs, 100000000.00 writes per sync, written: 12.20 GB, 30.07 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 99M writes, 99M keys, 99M commit groups, 1.0 writes per commit group, ingest: 12404.70 MB, 30.08 MB/s
Interval WAL: 99M writes, 0 syncs, 99292154.00 writes per sync, written: 12.11 GB, 30.08 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
Write Stall (count): write-buffer-manager-limit-stops: 0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment