Skip to content

Instantly share code, notes, and snippets.

@yiwu-arbug
Created December 4, 2017 18:42
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save yiwu-arbug/3b5a5727e52f1e58d1c10f2b80cec05d to your computer and use it in GitHub Desktop.
Save yiwu-arbug/3b5a5727e52f1e58d1c10f2b80cec05d to your computer and use it in GitHub Desktop.
============== Disable Pipeline Write ===============
] TEST_TMPDIR=/dev/shm/lll ./db_bench --benchmarks=fillrandom,stats --num=30000000 --threads=8 --writes=1000000 -max_background_compactions=16 -max_background_flushes=7 -subcompactions=4 --compression_type=lz4 -enable_pipelined_write=false
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
RocksDB: version 5.6
Date: Fri Jun 30 14:22:50 2017
CPU: 32 * Intel(R) Xeon(R) CPU E5-2660 0 @ 2.20GHz
CPUCache: 20480 KB
Keys: 16 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 30000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 3318.8 MB (estimated)
FileSize: 1888.3 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: LZ4
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
DB path: [/dev/shm/lll/dbbench]
fillrandom : 3.067 micros/op 326092 ops/sec; 36.1 MB/s
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
----------------------------------------------------------------------------------------------------------------------------------------------------------
L0 4/4 122.37 MB 0.0 0.0 0.0 0.0 0.5 0.5 0.0 1.0 0.0 83.4 6 16 0.366 0 0
L1 6/6 246.10 MB 0.0 0.7 0.4 0.3 0.6 0.3 0.0 1.7 145.0 133.2 5 3 1.585 10M 448K
L2 1/0 64.44 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0 0 0.000 0 0
Sum 11/10 432.91 MB 0.0 0.7 0.4 0.3 1.1 0.8 0.1 2.3 64.9 105.7 11 19 0.559 10M 448K
Int 0/0 0.00 KB 0.0 0.7 0.4 0.3 1.0 0.7 0.1 2.7 74.9 108.7 9 15 0.614 10M 448K
Uptime(secs): 24.5 total, 19.7 interval
Flush(GB): cumulative 0.478, interval 0.359
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 1.10 GB write, 45.75 MB/s write, 0.67 GB read, 28.10 MB/s read, 10.6 seconds
Interval compaction: 0.98 GB write, 50.73 MB/s write, 0.67 GB read, 34.95 MB/s read, 9.2 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
** File Read Latency Histogram By Level [default] **
** DB Stats **
Uptime(secs): 24.5 total, 19.7 interval
Cumulative writes: 8000K writes, 8000K keys, 1826K commit groups, 4.4 writes per commit group, ingest: 0.91 GB, 37.86 MB/s
Cumulative WAL: 8000K writes, 0 syncs, 8000000.00 writes per sync, written: 0.91 GB, 37.86 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 6018K writes, 6018K keys, 1379K commit groups, 4.4 writes per commit group, ingest: 698.77 MB, 35.42 MB/s
Interval WAL: 6018K writes, 0 syncs, 6018156.00 writes per sync, written: 0.68 MB, 35.42 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
============== Enable Pipeline Write ===============
] TEST_TMPDIR=/dev/shm/lll ./db_bench --benchmarks=fillrandom,stats --num=30000000 --threads=8 --writes=1000000 -max_background_compactions=16 -max_background_flushes=7 -subcompactions=4 --compression_type=lz4 -enable_pipelined_write=true
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
RocksDB: version 5.6
Date: Fri Jun 30 14:29:12 2017
CPU: 32 * Intel(R) Xeon(R) CPU E5-2660 0 @ 2.20GHz
CPUCache: 20480 KB
Keys: 16 bytes each
Values: 100 bytes each (50 bytes after compression)
Entries: 30000000
Prefix: 0 bytes
Keys per prefix: 0
RawSize: 3318.8 MB (estimated)
FileSize: 1888.3 MB (estimated)
Write rate: 0 bytes/second
Read rate: 0 ops/second
Compression: LZ4
Memtablerep: skip_list
Perf Level: 1
------------------------------------------------
Initializing RocksDB Options from the specified file
Initializing RocksDB Options from command-line flags
DB path: [/dev/shm/lll/dbbench]
fillrandom : 2.366 micros/op 422675 ops/sec; 46.8 MB/s
** Compaction Stats [default] **
Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
----------------------------------------------------------------------------------------------------------------------------------------------------------
L0 4/4 117.22 MB 0.0 0.0 0.0 0.0 0.5 0.5 0.0 1.0 0.0 85.6 6 16 0.354 0 0
L1 6/6 247.28 MB 0.0 0.7 0.4 0.3 0.6 0.3 0.0 1.7 150.1 137.8 5 3 1.540 10M 452K
L2 1/0 64.44 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0 0 0.000 0 0
Sum 11/10 428.94 MB 0.0 0.7 0.4 0.3 1.1 0.8 0.1 2.3 67.4 109.0 10 19 0.542 10M 452K
Int 0/0 0.00 KB 0.0 0.7 0.4 0.3 1.0 0.7 0.1 2.8 78.3 112.8 9 15 0.590 10M 452K
Uptime(secs): 18.9 total, 15.4 interval
Flush(GB): cumulative 0.474, interval 0.354
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 1.10 GB write, 59.28 MB/s write, 0.68 GB read, 36.61 MB/s read, 10.3 seconds
Interval compaction: 0.98 GB write, 64.77 MB/s write, 0.68 GB read, 44.93 MB/s read, 8.9 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
** File Read Latency Histogram By Level [default] **
** DB Stats **
Uptime(secs): 18.9 total, 15.4 interval
Cumulative writes: 8000K writes, 8000K keys, 2965K commit groups, 2.7 writes per commit group, ingest: 0.92 GB, 49.76 MB/s
Cumulative WAL: 8000K writes, 0 syncs, 8000000.00 writes per sync, written: 0.92 GB, 49.76 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 5952K writes, 5952K keys, 2353K commit groups, 2.5 writes per commit group, ingest: 702.45 MB, 45.54 MB/s
Interval WAL: 5952K writes, 0 syncs, 5952334.00 writes per sync, written: 0.69 MB, 45.54 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment