Skip to content

Instantly share code, notes, and snippets.

@hyc
Created June 8, 2014 20:18
Show Gist options
  • Save hyc/4592f06141f7c2fcb94c to your computer and use it in GitHub Desktop.
Save hyc/4592f06141f7c2fcb94c to your computer and use it in GitHub Desktop.
RocksDB fail
Was trying to duplicate this test: https://github.com/facebook/rocksdb/wiki/RocksDB-In-Memory-Workload-Performance-Benchmarks
using git rev 0365eaf12e9e896ea5902fb3bf3db5e6da275d2
but all I get is this:
./run ./db_bench.rocks --db=/tmp/test1 --num_levels=6 --key_size=20 --prefix_size=20 --keys_per_prefix=0 --value_size=100 --block_size=4096 --cache_size=17179869184 --cache_numshardbits=6 --compression_type=none --compression_ratio=1 --min_level_to_compress=-1 --disable_seek_compaction=1 --hard_rate_limit=2 --write_buffer_size=134217728 --max_write_buffer_number=2 --level0_file_num_compaction_trigger=8 --target_file_size_base=134217728 --max_bytes_for_level_base=1073741824 --disable_wal=0 --wal_dir=/mnt/hyc/WAL --sync=0 --disable_data_sync=1 --verify_checksum=1 --delete_obsolete_files_period_micros=314572800 --max_grandparent_overlap_factor=10 --max_background_compactions=4 --max_background_flushes=0 --level0_slowdown_writes_trigger=16 --level0_stop_writes_trigger=24 --statistics=0 --stats_per_interval=0 --stats_interval=1048576 --histogram=0 --use_plain_table=1 --open_files=-1 --mmap_read=1 --mmap_write=0 --memtablerep=prefix_hash --bloom_bits=10 --bloom_locality=1 --perf_level=0 --benchmarks=filluniquerandom --use_existing_db=0 --num=524288000 --threads=1
LevelDB: version 3.2
Date: Sun Jun 8 13:14:41 2014
CPU: 16 * Quad-Core AMD Opteron(tm) Processor 8354
CPUCache: 512 KB
Keys: 20 bytes each
Values: 100 bytes each (100 bytes after compression)
Entries: 524288000
Prefix: 20 bytes
Keys per prefix: 0
RawSize: 60000.0 MB (estimated)
FileSize: 60000.0 MB (estimated)
Write rate limit: 0
Compression: none
Memtablerep: prefix_hash
Perf Level: 0
WARNING: Assertions are enabled; benchmarks unnecessarily slow
------------------------------------------------
open error: Corruption: While creating a new Db, wal_dir contains existing log file: : 000003.log
Note that /mnt/hyc/WAL is a fresh, empty directory at the start of the run. After db_bench exits we just see that 000003.log is a zero byte file.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment