Skip to content

Instantly share code, notes, and snippets.

@abh
Created December 14, 2017 00:16
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save abh/75494d596f04148aab74b3a14abdc15c to your computer and use it in GitHub Desktop.
Save abh/75494d596f04148aab74b3a14abdc15c to your computer and use it in GitHub Desktop.
2017-12-14 00:10:52.119468 I | rook: starting Rook v0.6.0-73.g42f9e27 with arguments '/usr/local/bin/rook osd'
2017-12-14 00:10:52.119689 I | rook: flag values: --admin-secret=*****, --ceph-config-override=/etc/rook/config/override.conf, --cluster-name=rook, --config-dir=/var/lib/rook, --data-device-filter=, --data-devices=vdb, --data-directories=, --force-format=false, --fsid=, --help=false, --location=, --log-level=INFO, --metadata-device=, --mon-endpoints=rook-ceph-mon10=10.3.47.80:6790,rook-ceph-mon12=10.3.151.127:6790,rook-ceph-mon6=10.3.190.106:6790, --mon-secret=*****, --node-name=coreb6.dev, --osd-database-size=1024, --osd-journal-size=1024, --osd-store=bluestore, --osd-wal-size=576, --private-ipv4=10.2.3.186, --public-ipv4=10.2.3.186
2017-12-14 00:10:52.124518 I | cephmon: parsing mon endpoints: rook-ceph-mon10=10.3.47.80:6790,rook-ceph-mon12=10.3.151.127:6790,rook-ceph-mon6=10.3.190.106:6790
2017-12-14 00:10:52.125066 I | cephmon: writing config file /var/lib/rook/rook/rook.config
2017-12-14 00:10:52.125232 I | cephmon: generated admin config in /var/lib/rook/rook
2017-12-14 00:10:52.125244 I | cephosd: discovering hardware
2017-12-14 00:10:52.125255 I | exec: Running command: lsblk --all --noheadings --list --output KNAME
2017-12-14 00:10:52.135379 I | exec: Running command: lsblk /dev/vda --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
2017-12-14 00:10:52.154034 I | exec: Running command: sgdisk --print /dev/vda
2017-12-14 00:10:52.160188 I | exec: Running command: df --output=source,fstype
2017-12-14 00:10:52.162301 I | exec: Running command: lsblk /dev/vda1 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
2017-12-14 00:10:52.167840 I | exec: Running command: df --output=source,fstype
2017-12-14 00:10:52.172743 I | exec: Running command: lsblk /dev/vda2 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
2017-12-14 00:10:52.179721 I | exec: Running command: df --output=source,fstype
2017-12-14 00:10:52.184625 I | exec: Running command: lsblk /dev/vda3 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
2017-12-14 00:10:52.191665 I | exec: Running command: df --output=source,fstype
2017-12-14 00:10:52.196878 I | exec: Running command: lsblk /dev/vda4 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
2017-12-14 00:10:52.202012 I | exec: Running command: df --output=source,fstype
2017-12-14 00:10:52.204711 I | exec: Running command: lsblk /dev/vda6 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
2017-12-14 00:10:52.209082 I | exec: Running command: df --output=source,fstype
2017-12-14 00:10:52.211797 I | exec: Running command: lsblk /dev/vda7 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
2017-12-14 00:10:52.215364 I | exec: Running command: df --output=source,fstype
2017-12-14 00:10:52.218452 I | exec: Running command: lsblk /dev/vda9 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
2017-12-14 00:10:52.224377 I | exec: Running command: df --output=source,fstype
2017-12-14 00:10:52.228210 I | exec: Running command: lsblk /dev/vdb --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
2017-12-14 00:10:52.232253 I | exec: Running command: sgdisk --print /dev/vdb
2017-12-14 00:10:52.243702 I | exec: Running command: df --output=source,fstype
2017-12-14 00:10:52.252112 I | exec: Running command: lsblk /dev/vdb1 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
2017-12-14 00:10:52.255838 I | exec: Running command: df --output=source,fstype
2017-12-14 00:10:52.260357 I | exec: Running command: lsblk /dev/vdb2 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
2017-12-14 00:10:52.265429 I | exec: Running command: df --output=source,fstype
2017-12-14 00:10:52.269976 I | exec: Running command: lsblk /dev/vdb3 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
2017-12-14 00:10:52.273595 I | exec: Running command: df --output=source,fstype
2017-12-14 00:10:52.275611 I | exec: Running command: lsblk /dev/dm-0 --bytes --nodeps --pairs --output SIZE,ROTA,RO,TYPE,PKNAME
2017-12-14 00:10:52.278737 I | cephosd: creating and starting the osds
2017-12-14 00:10:52.278779 I | exec: Running command: lsblk /dev/vda --bytes --pairs --output NAME,SIZE,TYPE,PKNAME
2017-12-14 00:10:52.285442 I | exec: Running command: blkid /dev/vda1 -s PARTLABEL -o value
2017-12-14 00:10:52.290546 I | exec: Running command: blkid /dev/vda2 -s PARTLABEL -o value
2017-12-14 00:10:52.300795 I | exec: Running command: blkid /dev/vda3 -s PARTLABEL -o value
2017-12-14 00:10:52.313331 I | exec: Running command: blkid /dev/vda4 -s PARTLABEL -o value
2017-12-14 00:10:52.318697 I | exec: Running command: blkid /dev/vda6 -s PARTLABEL -o value
2017-12-14 00:10:52.326026 I | exec: Running command: blkid /dev/vda7 -s PARTLABEL -o value
2017-12-14 00:10:52.344074 I | exec: Running command: blkid /dev/vda9 -s PARTLABEL -o value
2017-12-14 00:10:52.349655 I | exec: Running command: df --output=source,fstype
2017-12-14 00:10:52.352547 I | cephosd: skipping device vda that is in use (not by rook). fs: ext4, ownPartitions: false
2017-12-14 00:10:52.352637 I | exec: Running command: lsblk /dev/vdb --bytes --pairs --output NAME,SIZE,TYPE,PKNAME
2017-12-14 00:10:52.357241 I | exec: Running command: blkid /dev/vdb1 -s PARTLABEL -o value
2017-12-14 00:10:52.370342 I | exec: Running command: blkid /dev/vdb2 -s PARTLABEL -o value
2017-12-14 00:10:52.382750 I | exec: Running command: blkid /dev/vdb3 -s PARTLABEL -o value
2017-12-14 00:10:52.395025 I | exec: Running command: df --output=source,fstype
2017-12-14 00:10:52.398282 I | cephosd: configuring osd devices: &{Entries:map[vdb:0xc42028e4e0]}
2017-12-14 00:10:53.146681 I | cephmon: writing config file /var/lib/rook/osd8/rook.config
2017-12-14 00:10:53.147169 I | cephosd: starting osd 8 at /var/lib/rook/osd8
2017-12-14 00:10:53.147291 I | cephosd: Config file /var/lib/rook/osd8/rook.config:
[global]
run dir = /var/lib/rook/osd8
mon initial members = rook-ceph-mon12 rook-ceph-mon6 rook-ceph-mon10
mon host = 10.3.151.127:6790,10.3.190.106:6790,10.3.47.80:6790
log file = /dev/stdout
mon cluster log file = /dev/stdout
public addr = 10.2.3.186
cluster addr = 10.2.3.186
mon keyvaluedb = rocksdb
mon_allow_pool_delete = true
mon_max_pg_per_osd = 1000
debug default = 0
debug rados = 0
debug mon = 0
debug osd = 0
debug bluestore = 0
debug filestore = 0
debug journal = 0
debug leveldb = 0
filestore_omap_backend = rocksdb
osd pg bits = 11
osd pgp bits = 11
osd pool default size = 1
osd pool default min size = 1
osd pool default pg num = 100
osd pool default pgp num = 100
osd objectstore = bluestore
crush location = root=default host=coreb6-dev
rbd_default_features = 3
fatal signal handlers = false
mon osd full ratio = 0.70
mon osd backfillfull ratio = .65
mon osd nearfull ratio = .60
[osd.8]
keyring = /var/lib/rook/osd8/keyring
bluestore block path = /dev/disk/by-partuuid/ce75dc01-7f27-4d01-a988-c46419a9fb23
bluestore block wal path = /dev/disk/by-partuuid/28a61876-c768-4972-9c21-cabeab19e6af
bluestore block db path = /dev/disk/by-partuuid/67eefb26-9b72-4559-a552-89da72bd8730
2017-12-14 00:10:53.148911 I | proc: no existing process found for binary ceph-osd and pattern '--osd-uuid=ca79db8f-8851-4be7-8e78-9bfb5b95d653'
2017-12-14 00:10:53.148944 I | proc: Starting process osd8 with args: [--foreground --id=8 --cluster=rook --osd-data=/var/lib/rook/osd8 --conf=/var/lib/rook/osd8/rook.config --keyring=/var/lib/rook/osd8/keyring --osd-uuid=ca79db8f-8851-4be7-8e78-9bfb5b95d653]
2017-12-14 00:10:53.148961 I | exec: Running command: ceph-osd --foreground --id=8 --cluster=rook --osd-data=/var/lib/rook/osd8 --conf=/var/lib/rook/osd8/rook.config --keyring=/var/lib/rook/osd8/keyring --osd-uuid=ca79db8f-8851-4be7-8e78-9bfb5b95d653
2017-12-14 00:10:53.149777 I | cephosd: 1/1 osd devices succeeded on this node
2017-12-14 00:10:53.194528 I | osd8: 2017-12-14 00:10:53.180266 7fd7d309ae00 0 ceph version b2cb7c670 (4b2cb7c67015e40d9bb7eb847564c8d247180ff0) luminous (stable), process (unknown), pid 64
2017-12-14 00:10:53.194954 I | cephosd: configuring osd dirs: map[/data/rook-data:3 /var/lib/rook:1]
2017-12-14 00:10:53.195362 I | cephosd: total bytes for /data/rook-data/osd3: 205583683584 (191.46 GiB)
2017-12-14 00:10:53.195771 I | cephmon: writing config file /data/rook-data/osd3/rook.config
2017-12-14 00:10:53.195983 I | exec: Running command: ceph auth get-or-create osd.3 -o /data/rook-data/osd3/keyring osd allow * mon allow profile osd --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format plain
2017-12-14 00:10:53.201557 I | osd8: starting osd.8 at - osd_data /var/lib/rook/osd8 /var/lib/ceph/osd/rook-8/journal
2017-12-14 00:10:53.201587 I | osd8: 2017-12-14 00:10:53.198746 7fd7d309ae00 0 pidfile_write: ignore empty --pid-file
2017-12-14 00:10:53.210396 I | osd8: 2017-12-14 00:10:53.210196 7fd7d309ae00 0 load: jerasure load: lrc load: isa
2017-12-14 00:10:53.210531 I | osd8: 2017-12-14 00:10:53.210349 7fd7d309ae00 1 bdev create path /var/lib/rook/osd8/block type kernel
2017-12-14 00:10:53.210601 I | osd8: 2017-12-14 00:10:53.210367 7fd7d309ae00 1 bdev(0x55b08c38ab40 /var/lib/rook/osd8/block) open path /var/lib/rook/osd8/block
2017-12-14 00:10:53.211420 I | osd8: 2017-12-14 00:10:53.211296 7fd7d309ae00 1 bdev(0x55b08c38ab40 /var/lib/rook/osd8/block) open size 213069574144 (0x319befb000, 198 GB) block_size 4096 (4096 B) rotational
2017-12-14 00:10:53.211997 I | osd8: 2017-12-14 00:10:53.211831 7fd7d309ae00 1 bdev(0x55b08c38ab40 /var/lib/rook/osd8/block) close
2017-12-14 00:10:53.478008 I | osd8: 2017-12-14 00:10:53.477758 7fd7d309ae00 1 bdev create path /var/lib/rook/osd8/block type kernel
2017-12-14 00:10:53.478054 I | osd8: 2017-12-14 00:10:53.477803 7fd7d309ae00 1 bdev(0x55b08c38ad80 /var/lib/rook/osd8/block) open path /var/lib/rook/osd8/block
2017-12-14 00:10:53.478452 I | osd8: 2017-12-14 00:10:53.478276 7fd7d309ae00 1 bdev(0x55b08c38ad80 /var/lib/rook/osd8/block) open size 213069574144 (0x319befb000, 198 GB) block_size 4096 (4096 B) rotational
2017-12-14 00:10:53.478863 I | osd8: 2017-12-14 00:10:53.478712 7fd7d309ae00 1 bdev create path /dev/disk/by-partuuid/67eefb26-9b72-4559-a552-89da72bd8730 type kernel
2017-12-14 00:10:53.478877 I | osd8: 2017-12-14 00:10:53.478750 7fd7d309ae00 1 bdev(0x55b08c38afc0 /dev/disk/by-partuuid/67eefb26-9b72-4559-a552-89da72bd8730) open path /dev/disk/by-partuuid/67eefb26-9b72-4559-a552-89da72bd8730
2017-12-14 00:10:53.479227 I | osd8: 2017-12-14 00:10:53.479043 7fd7d309ae00 1 bdev(0x55b08c38afc0 /dev/disk/by-partuuid/67eefb26-9b72-4559-a552-89da72bd8730) open size 1073741824 (0x40000000, 1024 MB) block_size 4096 (4096 B) rotational
2017-12-14 00:10:53.479261 I | osd8: 2017-12-14 00:10:53.479082 7fd7d309ae00 1 bluefs add_block_device bdev 1 path /dev/disk/by-partuuid/67eefb26-9b72-4559-a552-89da72bd8730 size 1024 MB
2017-12-14 00:10:53.479592 I | osd8: 2017-12-14 00:10:53.479445 7fd7d309ae00 1 bdev create path /var/lib/rook/osd8/block type kernel
2017-12-14 00:10:53.479621 I | osd8: 2017-12-14 00:10:53.479514 7fd7d309ae00 1 bdev(0x55b08c38b200 /var/lib/rook/osd8/block) open path /var/lib/rook/osd8/block
2017-12-14 00:10:53.479992 I | osd8: 2017-12-14 00:10:53.479829 7fd7d309ae00 1 bdev(0x55b08c38b200 /var/lib/rook/osd8/block) open size 213069574144 (0x319befb000, 198 GB) block_size 4096 (4096 B) rotational
2017-12-14 00:10:53.480020 I | osd8: 2017-12-14 00:10:53.479869 7fd7d309ae00 1 bluefs add_block_device bdev 2 path /var/lib/rook/osd8/block size 198 GB
2017-12-14 00:10:53.480028 I | osd8: 2017-12-14 00:10:53.479939 7fd7d309ae00 1 bdev create path /dev/disk/by-partuuid/28a61876-c768-4972-9c21-cabeab19e6af type kernel
2017-12-14 00:10:53.480074 I | osd8: 2017-12-14 00:10:53.479947 7fd7d309ae00 1 bdev(0x55b08c38b440 /dev/disk/by-partuuid/28a61876-c768-4972-9c21-cabeab19e6af) open path /dev/disk/by-partuuid/28a61876-c768-4972-9c21-cabeab19e6af
2017-12-14 00:10:53.480431 I | osd8: 2017-12-14 00:10:53.480278 7fd7d309ae00 1 bdev(0x55b08c38b440 /dev/disk/by-partuuid/28a61876-c768-4972-9c21-cabeab19e6af) open size 603979776 (0x24000000, 576 MB) block_size 4096 (4096 B) rotational
2017-12-14 00:10:53.480459 I | osd8: 2017-12-14 00:10:53.480314 7fd7d309ae00 1 bluefs add_block_device bdev 0 path /dev/disk/by-partuuid/28a61876-c768-4972-9c21-cabeab19e6af size 576 MB
2017-12-14 00:10:53.480688 I | osd8: 2017-12-14 00:10:53.480581 7fd7d309ae00 1 bluefs mount
2017-12-14 00:10:53.504357 I | osd8: 2017-12-14 00:10:53.504110 7fd7d309ae00 0 set rocksdb option compaction_readahead_size = 2097152
2017-12-14 00:10:53.504443 I | osd8: 2017-12-14 00:10:53.504217 7fd7d309ae00 0 set rocksdb option compression = kNoCompression
2017-12-14 00:10:53.504456 I | osd8: 2017-12-14 00:10:53.504226 7fd7d309ae00 0 set rocksdb option max_write_buffer_number = 4
2017-12-14 00:10:53.504621 I | osd8: 2017-12-14 00:10:53.504282 7fd7d309ae00 0 set rocksdb option min_write_buffer_number_to_merge = 1
2017-12-14 00:10:53.504637 I | osd8: 2017-12-14 00:10:53.504305 7fd7d309ae00 0 set rocksdb option recycle_log_file_num = 4
2017-12-14 00:10:53.504646 I | osd8: 2017-12-14 00:10:53.504317 7fd7d309ae00 0 set rocksdb option writable_file_max_buffer_size = 0
2017-12-14 00:10:53.504669 I | osd8: 2017-12-14 00:10:53.504324 7fd7d309ae00 0 set rocksdb option write_buffer_size = 268435456
2017-12-14 00:10:53.504678 I | osd8: 2017-12-14 00:10:53.504360 7fd7d309ae00 0 set rocksdb option compaction_readahead_size = 2097152
2017-12-14 00:10:53.504686 I | osd8: 2017-12-14 00:10:53.504367 7fd7d309ae00 0 set rocksdb option compression = kNoCompression
2017-12-14 00:10:53.504694 I | osd8: 2017-12-14 00:10:53.504375 7fd7d309ae00 0 set rocksdb option max_write_buffer_number = 4
2017-12-14 00:10:53.504703 I | osd8: 2017-12-14 00:10:53.504380 7fd7d309ae00 0 set rocksdb option min_write_buffer_number_to_merge = 1
2017-12-14 00:10:53.504711 I | osd8: 2017-12-14 00:10:53.504392 7fd7d309ae00 0 set rocksdb option recycle_log_file_num = 4
2017-12-14 00:10:53.504720 I | osd8: 2017-12-14 00:10:53.504404 7fd7d309ae00 0 set rocksdb option writable_file_max_buffer_size = 0
2017-12-14 00:10:53.504768 I | osd8: 2017-12-14 00:10:53.504421 7fd7d309ae00 0 set rocksdb option write_buffer_size = 268435456
2017-12-14 00:10:53.505058 I | osd8: 2017-12-14 00:10:53.504902 7fd7d309ae00 4 rocksdb: RocksDB version: 5.4.0
2017-12-14 00:10:53.505106 I | osd8:
2017-12-14 00:10:53.505118 I | osd8: 2017-12-14 00:10:53.504937 7fd7d309ae00 4 rocksdb: Git sha rocksdb_build_git_sha:@bac0af364a2c742ea9bb63199ddeee0edacdb2ac@
2017-12-14 00:10:53.505126 I | osd8: 2017-12-14 00:10:53.504942 7fd7d309ae00 4 rocksdb: Compile date Dec 2 2017
2017-12-14 00:10:53.505135 I | osd8: 2017-12-14 00:10:53.504945 7fd7d309ae00 4 rocksdb: DB SUMMARY
2017-12-14 00:10:53.505143 I | osd8:
2017-12-14 00:10:53.505256 I | osd8: 2017-12-14 00:10:53.505027 7fd7d309ae00 4 rocksdb: CURRENT file: CURRENT
2017-12-14 00:10:53.505317 I | osd8:
2017-12-14 00:10:53.505373 I | osd8: 2017-12-14 00:10:53.505136 7fd7d309ae00 4 rocksdb: IDENTITY file: IDENTITY
2017-12-14 00:10:53.505381 I | osd8:
2017-12-14 00:10:53.505389 I | osd8: 2017-12-14 00:10:53.505174 7fd7d309ae00 4 rocksdb: MANIFEST file: MANIFEST-000411 size: 241 Bytes
2017-12-14 00:10:53.505435 I | osd8:
2017-12-14 00:10:53.505744 I | osd8: 2017-12-14 00:10:53.505281 7fd7d309ae00 4 rocksdb: SST files in db dir, Total Num: 2, files: 000407.sst 000410.sst
2017-12-14 00:10:53.505783 I | osd8:
2017-12-14 00:10:53.505793 I | osd8: 2017-12-14 00:10:53.505317 7fd7d309ae00 4 rocksdb: SST files in db.slow dir, Total Num: 1, files: 000405.sst
2017-12-14 00:10:53.505801 I | osd8:
2017-12-14 00:10:53.505816 I | osd8: 2017-12-14 00:10:53.505326 7fd7d309ae00 4 rocksdb: Write Ahead Log file in db.wal: 000412.log size: 2812787 ;
2017-12-14 00:10:53.505842 I | osd8:
2017-12-14 00:10:53.505894 I | osd8: 2017-12-14 00:10:53.505330 7fd7d309ae00 4 rocksdb: Options.error_if_exists: 0
2017-12-14 00:10:53.505927 I | osd8: 2017-12-14 00:10:53.505332 7fd7d309ae00 4 rocksdb: Options.create_if_missing: 0
2017-12-14 00:10:53.505944 I | osd8: 2017-12-14 00:10:53.505334 7fd7d309ae00 4 rocksdb: Options.paranoid_checks: 1
2017-12-14 00:10:53.505959 I | osd8: 2017-12-14 00:10:53.505335 7fd7d309ae00 4 rocksdb: Options.env: 0x55b08c83bb00
2017-12-14 00:10:53.506014 I | osd8: 2017-12-14 00:10:53.505383 7fd7d309ae00 4 rocksdb: Options.info_log: 0x55b08c83bf80
2017-12-14 00:10:53.506035 I | osd8: 2017-12-14 00:10:53.505385 7fd7d309ae00 4 rocksdb: Options.max_open_files: -1
2017-12-14 00:10:53.506056 I | osd8: 2017-12-14 00:10:53.505387 7fd7d309ae00 4 rocksdb: Options.max_file_opening_threads: 16
2017-12-14 00:10:53.506110 I | osd8: 2017-12-14 00:10:53.505389 7fd7d309ae00 4 rocksdb: Options.use_fsync: 0
2017-12-14 00:10:53.506134 I | osd8: 2017-12-14 00:10:53.505390 7fd7d309ae00 4 rocksdb: Options.max_log_file_size: 0
2017-12-14 00:10:53.506154 I | osd8: 2017-12-14 00:10:53.505392 7fd7d309ae00 4 rocksdb: Options.max_manifest_file_size: 18446744073709551615
2017-12-14 00:10:53.506171 I | osd8: 2017-12-14 00:10:53.505395 7fd7d309ae00 4 rocksdb: Options.log_file_time_to_roll: 0
2017-12-14 00:10:53.506195 I | osd8: 2017-12-14 00:10:53.505398 7fd7d309ae00 4 rocksdb: Options.keep_log_file_num: 1000
2017-12-14 00:10:53.506249 I | osd8: 2017-12-14 00:10:53.505400 7fd7d309ae00 4 rocksdb: Options.recycle_log_file_num: 4
2017-12-14 00:10:53.506287 I | osd8: 2017-12-14 00:10:53.505401 7fd7d309ae00 4 rocksdb: Options.allow_fallocate: 1
2017-12-14 00:10:53.506338 I | osd8: 2017-12-14 00:10:53.505403 7fd7d309ae00 4 rocksdb: Options.allow_mmap_reads: 0
2017-12-14 00:10:53.506359 I | osd8: 2017-12-14 00:10:53.505405 7fd7d309ae00 4 rocksdb: Options.allow_mmap_writes: 0
2017-12-14 00:10:53.506419 I | osd8: 2017-12-14 00:10:53.505406 7fd7d309ae00 4 rocksdb: Options.use_direct_reads: 0
2017-12-14 00:10:53.506511 I | osd8: 2017-12-14 00:10:53.505407 7fd7d309ae00 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
2017-12-14 00:10:53.506551 I | osd8: 2017-12-14 00:10:53.505409 7fd7d309ae00 4 rocksdb: Options.create_missing_column_families: 0
2017-12-14 00:10:53.506610 I | osd8: 2017-12-14 00:10:53.505411 7fd7d309ae00 4 rocksdb: Options.db_log_dir:
2017-12-14 00:10:53.506632 I | osd8: 2017-12-14 00:10:53.505413 7fd7d309ae00 4 rocksdb: Options.wal_dir: db.wal
2017-12-14 00:10:53.506666 I | osd8: 2017-12-14 00:10:53.505414 7fd7d309ae00 4 rocksdb: Options.table_cache_numshardbits: 6
2017-12-14 00:10:53.506729 I | osd8: 2017-12-14 00:10:53.505416 7fd7d309ae00 4 rocksdb: Options.max_subcompactions: 1
2017-12-14 00:10:53.506763 I | osd8: 2017-12-14 00:10:53.505418 7fd7d309ae00 4 rocksdb: Options.max_background_flushes: 1
2017-12-14 00:10:53.506818 I | osd8: 2017-12-14 00:10:53.505420 7fd7d309ae00 4 rocksdb: Options.WAL_ttl_seconds: 0
2017-12-14 00:10:53.506849 I | osd8: 2017-12-14 00:10:53.505421 7fd7d309ae00 4 rocksdb: Options.WAL_size_limit_MB: 0
2017-12-14 00:10:53.506898 I | osd8: 2017-12-14 00:10:53.505423 7fd7d309ae00 4 rocksdb: Options.manifest_preallocation_size: 4194304
2017-12-14 00:10:53.506923 I | osd8: 2017-12-14 00:10:53.505573 7fd7d309ae00 4 rocksdb: Options.is_fd_close_on_exec: 1
2017-12-14 00:10:53.506944 I | osd8: 2017-12-14 00:10:53.505576 7fd7d309ae00 4 rocksdb: Options.advise_random_on_open: 1
2017-12-14 00:10:53.506982 I | osd8: 2017-12-14 00:10:53.505578 7fd7d309ae00 4 rocksdb: Options.db_write_buffer_size: 0
2017-12-14 00:10:53.507036 I | osd8: 2017-12-14 00:10:53.505580 7fd7d309ae00 4 rocksdb: Options.access_hint_on_compaction_start: 1
2017-12-14 00:10:53.507062 I | osd8: 2017-12-14 00:10:53.505581 7fd7d309ae00 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 1
2017-12-14 00:10:53.507079 I | osd8: 2017-12-14 00:10:53.505583 7fd7d309ae00 4 rocksdb: Options.compaction_readahead_size: 2097152
2017-12-14 00:10:53.507095 I | osd8: 2017-12-14 00:10:53.505584 7fd7d309ae00 4 rocksdb: Options.random_access_max_buffer_size: 1048576
2017-12-14 00:10:53.507143 I | osd8: 2017-12-14 00:10:53.505586 7fd7d309ae00 4 rocksdb: Options.writable_file_max_buffer_size: 0
2017-12-14 00:10:53.507170 I | osd8: 2017-12-14 00:10:53.505588 7fd7d309ae00 4 rocksdb: Options.use_adaptive_mutex: 0
2017-12-14 00:10:53.507230 I | osd8: 2017-12-14 00:10:53.505595 7fd7d309ae00 4 rocksdb: Options.rate_limiter: (nil)
2017-12-14 00:10:53.507258 I | osd8: 2017-12-14 00:10:53.505598 7fd7d309ae00 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
2017-12-14 00:10:53.507284 I | osd8: 2017-12-14 00:10:53.505599 7fd7d309ae00 4 rocksdb: Options.bytes_per_sync: 0
2017-12-14 00:10:53.507338 I | osd8: 2017-12-14 00:10:53.505601 7fd7d309ae00 4 rocksdb: Options.wal_bytes_per_sync: 0
2017-12-14 00:10:53.507364 I | osd8: 2017-12-14 00:10:53.505603 7fd7d309ae00 4 rocksdb: Options.wal_recovery_mode: 0
2017-12-14 00:10:53.507404 I | osd8: 2017-12-14 00:10:53.505604 7fd7d309ae00 4 rocksdb: Options.enable_thread_tracking: 0
2017-12-14 00:10:53.507439 I | osd8: 2017-12-14 00:10:53.505606 7fd7d309ae00 4 rocksdb: Options.allow_concurrent_memtable_write: 1
2017-12-14 00:10:53.507523 I | osd8: 2017-12-14 00:10:53.505607 7fd7d309ae00 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
2017-12-14 00:10:53.507554 I | osd8: 2017-12-14 00:10:53.505609 7fd7d309ae00 4 rocksdb: Options.write_thread_max_yield_usec: 100
2017-12-14 00:10:53.507575 I | osd8: 2017-12-14 00:10:53.505611 7fd7d309ae00 4 rocksdb: Options.write_thread_slow_yield_usec: 3
2017-12-14 00:10:53.507637 I | osd8: 2017-12-14 00:10:53.505612 7fd7d309ae00 4 rocksdb: Options.row_cache: None
2017-12-14 00:10:53.507666 I | osd8: 2017-12-14 00:10:53.505614 7fd7d309ae00 4 rocksdb: Options.wal_filter: None
2017-12-14 00:10:53.507685 I | osd8: 2017-12-14 00:10:53.505616 7fd7d309ae00 4 rocksdb: Options.avoid_flush_during_recovery: 0
2017-12-14 00:10:53.507744 I | osd8: 2017-12-14 00:10:53.505666 7fd7d309ae00 4 rocksdb: Options.base_background_compactions: 1
2017-12-14 00:10:53.507773 I | osd8: 2017-12-14 00:10:53.505669 7fd7d309ae00 4 rocksdb: Options.max_background_compactions: 1
2017-12-14 00:10:53.507796 I | osd8: 2017-12-14 00:10:53.505670 7fd7d309ae00 4 rocksdb: Options.avoid_flush_during_shutdown: 0
2017-12-14 00:10:53.507865 I | osd8: 2017-12-14 00:10:53.505672 7fd7d309ae00 4 rocksdb: Options.delayed_write_rate : 16777216
2017-12-14 00:10:53.507896 I | osd8: 2017-12-14 00:10:53.505675 7fd7d309ae00 4 rocksdb: Options.max_total_wal_size: 0
2017-12-14 00:10:53.507920 I | osd8: 2017-12-14 00:10:53.505677 7fd7d309ae00 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
2017-12-14 00:10:53.507975 I | osd8: 2017-12-14 00:10:53.505680 7fd7d309ae00 4 rocksdb: Options.stats_dump_period_sec: 600
2017-12-14 00:10:53.508004 I | osd8: 2017-12-14 00:10:53.505682 7fd7d309ae00 4 rocksdb: Compression algorithms supported:
2017-12-14 00:10:53.508026 I | osd8: 2017-12-14 00:10:53.505685 7fd7d309ae00 4 rocksdb: Snappy supported: 0
2017-12-14 00:10:53.508081 I | osd8: 2017-12-14 00:10:53.505687 7fd7d309ae00 4 rocksdb: Zlib supported: 0
2017-12-14 00:10:53.508152 I | osd8: 2017-12-14 00:10:53.505688 7fd7d309ae00 4 rocksdb: Bzip supported: 0
2017-12-14 00:10:53.508177 I | osd8: 2017-12-14 00:10:53.505690 7fd7d309ae00 4 rocksdb: LZ4 supported: 0
2017-12-14 00:10:53.508194 I | osd8: 2017-12-14 00:10:53.505692 7fd7d309ae00 4 rocksdb: ZSTD supported: 0
2017-12-14 00:10:53.508220 I | osd8: 2017-12-14 00:10:53.505694 7fd7d309ae00 4 rocksdb: Fast CRC32 supported: 0
2017-12-14 00:10:53.508246 I | osd8: 2017-12-14 00:10:53.506356 7fd7d309ae00 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2609] Recovering from manifest file: MANIFEST-000411
2017-12-14 00:10:53.508271 I | osd8:
2017-12-14 00:10:53.510891 I | osd8: 2017-12-14 00:10:53.506626 7fd7d309ae00 4 rocksdb: [/build/ceph/src/rocksdb/db/column_family.cc:407] --------------- Options for column family [default]:
2017-12-14 00:10:53.510963 I | osd8:
2017-12-14 00:10:53.510982 I | osd8: 2017-12-14 00:10:53.506706 7fd7d309ae00 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
2017-12-14 00:10:53.510996 I | osd8: 2017-12-14 00:10:53.506716 7fd7d309ae00 4 rocksdb: Options.merge_operator: .T:int64_array.b:bitwise_xor
2017-12-14 00:10:53.511012 I | osd8: 2017-12-14 00:10:53.506719 7fd7d309ae00 4 rocksdb: Options.compaction_filter: None
2017-12-14 00:10:53.511026 I | osd8: 2017-12-14 00:10:53.506722 7fd7d309ae00 4 rocksdb: Options.compaction_filter_factory: None
2017-12-14 00:10:53.511039 I | osd8: 2017-12-14 00:10:53.506724 7fd7d309ae00 4 rocksdb: Options.memtable_factory: SkipListFactory
2017-12-14 00:10:53.511053 I | osd8: 2017-12-14 00:10:53.506726 7fd7d309ae00 4 rocksdb: Options.table_factory: BlockBasedTable
2017-12-14 00:10:53.511068 I | osd8: 2017-12-14 00:10:53.506812 7fd7d309ae00 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55b08c3861f0)
2017-12-14 00:10:53.511083 I | osd8: cache_index_and_filter_blocks: 1
2017-12-14 00:10:53.511096 I | osd8: cache_index_and_filter_blocks_with_high_priority: 1
2017-12-14 00:10:53.511109 I | osd8: pin_l0_filter_and_index_blocks_in_cache: 1
2017-12-14 00:10:53.511137 I | osd8: index_type: 0
2017-12-14 00:10:53.511152 I | osd8: hash_index_allow_collision: 1
2017-12-14 00:10:53.511165 I | osd8: checksum: 1
2017-12-14 00:10:53.511179 I | osd8: no_block_cache: 0
2017-12-14 00:10:53.511191 I | osd8: block_cache: 0x55b08c66b5e0
2017-12-14 00:10:53.511204 I | osd8: block_cache_name: LRUCache
2017-12-14 00:10:53.511217 I | osd8: block_cache_options:
2017-12-14 00:10:53.511231 I | osd8: capacity : 536870912
2017-12-14 00:10:53.511263 I | osd8: num_shard_bits : 4
2017-12-14 00:10:53.511281 I | osd8: strict_capacity_limit : 0
2017-12-14 00:10:53.511381 I | osd8: high_pri_pool_ratio: 0.000
2017-12-14 00:10:53.511398 I | osd8: block_cache_compressed: (nil)
2017-12-14 00:10:53.511410 I | osd8: persistent_cache: (nil)
2017-12-14 00:10:53.511423 I | osd8: block_size: 4096
2017-12-14 00:10:53.511437 I | osd8: block_size_deviation: 10
2017-12-14 00:10:53.511451 I | osd8: block_restart_interval: 16
2017-12-14 00:10:53.511464 I | osd8: index_block_restart_interval: 1
2017-12-14 00:10:53.511527 I | osd8: filter_policy: rocksdb.BuiltinBloomFilter
2017-12-14 00:10:53.511553 I | osd8: whole_key_filtering: 1
2017-12-14 00:10:53.511566 I | osd8: format_version: 2
2017-12-14 00:10:53.511579 I | osd8:
2017-12-14 00:10:53.511592 I | osd8: 2017-12-14 00:10:53.506916 7fd7d309ae00 4 rocksdb: Options.write_buffer_size: 268435456
2017-12-14 00:10:53.511611 I | osd8: 2017-12-14 00:10:53.506924 7fd7d309ae00 4 rocksdb: Options.max_write_buffer_number: 4
2017-12-14 00:10:53.511625 I | osd8: 2017-12-14 00:10:53.506927 7fd7d309ae00 4 rocksdb: Options.compression: NoCompression
2017-12-14 00:10:53.511646 I | osd8: 2017-12-14 00:10:53.506929 7fd7d309ae00 4 rocksdb: Options.bottommost_compression: Disabled
2017-12-14 00:10:53.511660 I | osd8: 2017-12-14 00:10:53.506931 7fd7d309ae00 4 rocksdb: Options.prefix_extractor: nullptr
2017-12-14 00:10:53.511675 I | osd8: 2017-12-14 00:10:53.506934 7fd7d309ae00 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
2017-12-14 00:10:53.511699 I | osd8: 2017-12-14 00:10:53.506936 7fd7d309ae00 4 rocksdb: Options.num_levels: 7
2017-12-14 00:10:53.511714 I | osd8: 2017-12-14 00:10:53.506938 7fd7d309ae00 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
2017-12-14 00:10:53.511727 I | osd8: 2017-12-14 00:10:53.506939 7fd7d309ae00 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
2017-12-14 00:10:53.511741 I | osd8: 2017-12-14 00:10:53.506941 7fd7d309ae00 4 rocksdb: Options.compression_opts.window_bits: -14
2017-12-14 00:10:53.511759 I | osd8: 2017-12-14 00:10:53.506942 7fd7d309ae00 4 rocksdb: Options.compression_opts.level: -1
2017-12-14 00:10:53.511773 I | osd8: 2017-12-14 00:10:53.506944 7fd7d309ae00 4 rocksdb: Options.compression_opts.strategy: 0
2017-12-14 00:10:53.511786 I | osd8: 2017-12-14 00:10:53.506946 7fd7d309ae00 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
2017-12-14 00:10:53.511800 I | osd8: 2017-12-14 00:10:53.506947 7fd7d309ae00 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
2017-12-14 00:10:53.511814 I | osd8: 2017-12-14 00:10:53.506949 7fd7d309ae00 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
2017-12-14 00:10:53.511828 I | osd8: 2017-12-14 00:10:53.506951 7fd7d309ae00 4 rocksdb: Options.level0_stop_writes_trigger: 36
2017-12-14 00:10:53.511841 I | osd8: 2017-12-14 00:10:53.506953 7fd7d309ae00 4 rocksdb: Options.target_file_size_base: 67108864
2017-12-14 00:10:53.511855 I | osd8: 2017-12-14 00:10:53.506954 7fd7d309ae00 4 rocksdb: Options.target_file_size_multiplier: 1
2017-12-14 00:10:53.511873 I | osd8: 2017-12-14 00:10:53.506956 7fd7d309ae00 4 rocksdb: Options.max_bytes_for_level_base: 268435456
2017-12-14 00:10:53.511887 I | osd8: 2017-12-14 00:10:53.506958 7fd7d309ae00 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
2017-12-14 00:10:53.511901 I | osd8: 2017-12-14 00:10:53.506959 7fd7d309ae00 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
2017-12-14 00:10:53.511914 I | osd8: 2017-12-14 00:10:53.506964 7fd7d309ae00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
2017-12-14 00:10:53.511928 I | osd8: 2017-12-14 00:10:53.507010 7fd7d309ae00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
2017-12-14 00:10:53.511941 I | osd8: 2017-12-14 00:10:53.507015 7fd7d309ae00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
2017-12-14 00:10:53.511965 I | osd8: 2017-12-14 00:10:53.507017 7fd7d309ae00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
2017-12-14 00:10:53.511979 I | osd8: 2017-12-14 00:10:53.507019 7fd7d309ae00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
2017-12-14 00:10:53.511993 I | osd8: 2017-12-14 00:10:53.507021 7fd7d309ae00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
2017-12-14 00:10:53.512007 I | osd8: 2017-12-14 00:10:53.507023 7fd7d309ae00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
2017-12-14 00:10:53.512020 I | osd8: 2017-12-14 00:10:53.507025 7fd7d309ae00 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
2017-12-14 00:10:53.512033 I | osd8: 2017-12-14 00:10:53.507031 7fd7d309ae00 4 rocksdb: Options.max_compaction_bytes: 1677721600
2017-12-14 00:10:53.512046 I | osd8: 2017-12-14 00:10:53.507033 7fd7d309ae00 4 rocksdb: Options.arena_block_size: 33554432
2017-12-14 00:10:53.512060 I | osd8: 2017-12-14 00:10:53.507034 7fd7d309ae00 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
2017-12-14 00:10:53.512074 I | osd8: 2017-12-14 00:10:53.507036 7fd7d309ae00 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
2017-12-14 00:10:53.512087 I | osd8: 2017-12-14 00:10:53.507038 7fd7d309ae00 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
2017-12-14 00:10:53.512100 I | osd8: 2017-12-14 00:10:53.507039 7fd7d309ae00 4 rocksdb: Options.disable_auto_compactions: 0
2017-12-14 00:10:53.512132 I | osd8: 2017-12-14 00:10:53.507043 7fd7d309ae00 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
2017-12-14 00:10:53.512149 I | osd8: 2017-12-14 00:10:53.507045 7fd7d309ae00 4 rocksdb: Options.compaction_pri: kByCompensatedSize
2017-12-14 00:10:53.512162 I | osd8: 2017-12-14 00:10:53.507047 7fd7d309ae00 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
2017-12-14 00:10:53.512179 I | osd8: 2017-12-14 00:10:53.507058 7fd7d309ae00 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
2017-12-14 00:10:53.512193 I | osd8: 2017-12-14 00:10:53.507060 7fd7d309ae00 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
2017-12-14 00:10:53.512207 I | osd8: 2017-12-14 00:10:53.507062 7fd7d309ae00 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
2017-12-14 00:10:53.512221 I | osd8: 2017-12-14 00:10:53.507064 7fd7d309ae00 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
2017-12-14 00:10:53.512237 I | osd8: 2017-12-14 00:10:53.507084 7fd7d309ae00 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
2017-12-14 00:10:53.512251 I | osd8: 2017-12-14 00:10:53.507120 7fd7d309ae00 4 rocksdb: Options.table_properties_collectors:
2017-12-14 00:10:53.512264 I | osd8: 2017-12-14 00:10:53.507122 7fd7d309ae00 4 rocksdb: Options.inplace_update_support: 0
2017-12-14 00:10:53.512278 I | osd8: 2017-12-14 00:10:53.507124 7fd7d309ae00 4 rocksdb: Options.inplace_update_num_locks: 10000
2017-12-14 00:10:53.512368 I | osd8: 2017-12-14 00:10:53.507126 7fd7d309ae00 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
2017-12-14 00:10:53.512398 I | osd8: 2017-12-14 00:10:53.507130 7fd7d309ae00 4 rocksdb: Options.memtable_huge_page_size: 0
2017-12-14 00:10:53.512413 I | osd8: 2017-12-14 00:10:53.507132 7fd7d309ae00 4 rocksdb: Options.bloom_locality: 0
2017-12-14 00:10:53.512427 I | osd8: 2017-12-14 00:10:53.507133 7fd7d309ae00 4 rocksdb: Options.max_successive_merges: 0
2017-12-14 00:10:53.512444 I | osd8: 2017-12-14 00:10:53.507135 7fd7d309ae00 4 rocksdb: Options.optimize_filters_for_hits: 0
2017-12-14 00:10:53.512458 I | osd8: 2017-12-14 00:10:53.507137 7fd7d309ae00 4 rocksdb: Options.paranoid_file_checks: 0
2017-12-14 00:10:53.512472 I | osd8: 2017-12-14 00:10:53.507138 7fd7d309ae00 4 rocksdb: Options.force_consistency_checks: 0
2017-12-14 00:10:53.512527 I | osd8: 2017-12-14 00:10:53.507140 7fd7d309ae00 4 rocksdb: Options.report_bg_io_stats: 0
2017-12-14 00:10:53.519234 I | osd8: 2017-12-14 00:10:53.518961 7fd7d309ae00 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2859] Recovered from manifest file:db/MANIFEST-000411 succeeded,manifest_file_number is 411, next_file_number is 413, last_sequence is 3420297, log_number is 0,prev_log_number is 0,max_column_family is 0
2017-12-14 00:10:53.519345 I | osd8:
2017-12-14 00:10:53.519361 I | osd8: 2017-12-14 00:10:53.519013 7fd7d309ae00 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2867] Column family [default] (ID 0), log number is 410
2017-12-14 00:10:53.519371 I | osd8:
2017-12-14 00:10:53.519380 I | osd8: 2017-12-14 00:10:53.519090 7fd7d309ae00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1513210253519082, "job": 1, "event": "recovery_started", "log_files": [412]}
2017-12-14 00:10:53.519390 I | osd8: 2017-12-14 00:10:53.519096 7fd7d309ae00 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:482] Recovering log #412 mode 0
2017-12-14 00:10:53.580392 I | osd8: 2017-12-14 00:10:53.580066 7fd7d309ae00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1513210253580049, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 413, "file_size": 2053659, "table_properties": {"data_size": 1961890, "index_size": 27938, "filter_size": 62849, "raw_key_size": 1222177, "raw_average_key_size": 52, "raw_value_size": 1523845, "raw_average_value_size": 65, "num_data_blocks": 471, "num_entries": 23364, "filter_policy_name": "rocksdb.BuiltinBloomFilter", "kDeletedKeys": "15461", "kMergeOperands": "122"}}
2017-12-14 00:10:53.590605 I | osd8: 2017-12-14 00:10:53.580426 7fd7d309ae00 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2395] Creating manifest 414
2017-12-14 00:10:53.590662 I | osd8:
2017-12-14 00:10:53.590676 I | osd8: 2017-12-14 00:10:53.586281 7fd7d309ae00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1513210253586270, "job": 1, "event": "recovery_finished"}
2017-12-14 00:10:53.594226 I | osd8: 2017-12-14 00:10:53.589698 7fd7d309ae00 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:1063] DB pointer 0x55b08c84e000
2017-12-14 00:10:53.627931 I | osd8: 2017-12-14 00:10:53.627734 7fd7d309ae00 0 osd.8 2329 crush map has features 2200130813952, adjusting msgr requires for clients
2017-12-14 00:10:53.628099 I | osd8: 2017-12-14 00:10:53.627773 7fd7d309ae00 0 osd.8 2329 crush map has features 2200130813952 was 8705, adjusting msgr requires for mons
2017-12-14 00:10:53.628154 I | osd8: 2017-12-14 00:10:53.627792 7fd7d309ae00 0 osd.8 2329 crush map has features 720578140510109696, adjusting msgr requires for osds
2017-12-14 00:10:53.683768 I | cephosd: Initializing OSD 3 file system at /data/rook-data/osd3...
2017-12-14 00:10:53.684313 I | exec: Running command: ceph mon getmap --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/514905436
2017-12-14 00:10:54.026228 I | osd8: 2017-12-14 00:10:54.026024 7fd7d309ae00 0 osd.8 2329 load_pgs
2017-12-14 00:10:54.137552 I | exec: got monmap epoch 27
2017-12-14 00:10:54.138019 I | exec: Running command: ceph-osd --mkfs --id=3 --cluster=rook --conf=/data/rook-data/osd3/rook.config --osd-data=/data/rook-data/osd3 --osd-uuid=00000000-0000-0000-0000-000000000000 --monmap=/data/rook-data/osd3/tmp/activate.monmap --keyring=/data/rook-data/osd3/keyring
2017-12-14 00:10:54.164766 I | mkfs-osd3: 2017-12-14 00:10:54.164210 7fd9e8779e00 0 ceph version b2cb7c670 (4b2cb7c67015e40d9bb7eb847564c8d247180ff0) luminous (stable), process (unknown), pid 144
2017-12-14 00:10:54.170080 I | mkfs-osd3: 2017-12-14 00:10:54.169826 7fd9e8779e00 -1 bluestore(/data/rook-data/osd3/block) _read_bdev_label failed to open /data/rook-data/osd3/block: (2) No such file or directory
2017-12-14 00:10:54.170171 I | mkfs-osd3: 2017-12-14 00:10:54.169877 7fd9e8779e00 -1 bluestore(/data/rook-data/osd3/block) _read_bdev_label failed to open /data/rook-data/osd3/block: (2) No such file or directory
2017-12-14 00:10:54.170197 I | mkfs-osd3: 2017-12-14 00:10:54.169897 7fd9e8779e00 -1 bluestore(/data/rook-data/osd3/block) _read_bdev_label failed to open /data/rook-data/osd3/block: (2) No such file or directory
2017-12-14 00:10:54.173070 I | mkfs-osd3: 2017-12-14 00:10:54.172895 7fd9e8779e00 -1 bluestore(/data/rook-data/osd3) _read_fsid unparsable uuid
2017-12-14 00:10:54.173882 I | mkfs-osd3: 2017-12-14 00:10:54.173663 7fd9e8779e00 1 bdev create path /data/rook-data/osd3/block type kernel
2017-12-14 00:10:54.173979 I | mkfs-osd3: 2017-12-14 00:10:54.173711 7fd9e8779e00 1 bdev(0x55906e706b40 /data/rook-data/osd3/block) open path /data/rook-data/osd3/block
2017-12-14 00:10:54.176708 I | mkfs-osd3: 2017-12-14 00:10:54.176253 7fd9e8779e00 -1 bdev(0x55906e706b40 /data/rook-data/osd3/block) unable to get device name for /data/rook-data/osd3/block: (22) Invalid argument
2017-12-14 00:10:54.177037 I | mkfs-osd3: 2017-12-14 00:10:54.176869 7fd9e8779e00 1 bdev(0x55906e706b40 /data/rook-data/osd3/block) open size 205583683584 (0x2fddbe1000, 191 GB) block_size 4096 (4096 B) rotational
2017-12-14 00:10:54.188284 I | mkfs-osd3: 2017-12-14 00:10:54.187999 7fd9e8779e00 1 bdev create path /data/rook-data/osd3/bluestore-db type kernel
2017-12-14 00:10:54.188352 I | mkfs-osd3: 2017-12-14 00:10:54.188035 7fd9e8779e00 1 bdev(0x55906e706fc0 /data/rook-data/osd3/bluestore-db) open path /data/rook-data/osd3/bluestore-db
2017-12-14 00:10:54.189784 I | mkfs-osd3: 2017-12-14 00:10:54.189565 7fd9e8779e00 -1 bdev(0x55906e706fc0 /data/rook-data/osd3/bluestore-db) unable to get device name for /data/rook-data/osd3/bluestore-db: (22) Invalid argument
2017-12-14 00:10:54.190019 I | mkfs-osd3: 2017-12-14 00:10:54.189836 7fd9e8779e00 1 bdev(0x55906e706fc0 /data/rook-data/osd3/bluestore-db) open size 1073741824 (0x40000000, 1024 MB) block_size 4096 (4096 B) rotational
2017-12-14 00:10:54.190053 I | mkfs-osd3: 2017-12-14 00:10:54.189868 7fd9e8779e00 1 bluefs add_block_device bdev 1 path /data/rook-data/osd3/bluestore-db size 1024 MB
2017-12-14 00:10:54.191319 I | mkfs-osd3: 2017-12-14 00:10:54.191132 7fd9e8779e00 1 bluefs add_block_extent bdev 1 0x2000~3fffe000
2017-12-14 00:10:54.191356 I | mkfs-osd3: 2017-12-14 00:10:54.191242 7fd9e8779e00 1 bdev create path /data/rook-data/osd3/block type kernel
2017-12-14 00:10:54.191379 I | mkfs-osd3: 2017-12-14 00:10:54.191249 7fd9e8779e00 1 bdev(0x55906e707200 /data/rook-data/osd3/block) open path /data/rook-data/osd3/block
2017-12-14 00:10:54.192619 I | mkfs-osd3: 2017-12-14 00:10:54.192376 7fd9e8779e00 -1 bdev(0x55906e707200 /data/rook-data/osd3/block) unable to get device name for /data/rook-data/osd3/block: (22) Invalid argument
2017-12-14 00:10:54.192802 I | mkfs-osd3: 2017-12-14 00:10:54.192674 7fd9e8779e00 1 bdev(0x55906e707200 /data/rook-data/osd3/block) open size 205583683584 (0x2fddbe1000, 191 GB) block_size 4096 (4096 B) rotational
2017-12-14 00:10:54.192836 I | mkfs-osd3: 2017-12-14 00:10:54.192703 7fd9e8779e00 1 bluefs add_block_device bdev 2 path /data/rook-data/osd3/block size 191 GB
2017-12-14 00:10:54.192882 I | mkfs-osd3: 2017-12-14 00:10:54.192707 7fd9e8779e00 1 bluefs add_block_extent bdev 2 0x16f9c00000~1ea300000
2017-12-14 00:10:54.192920 I | mkfs-osd3: 2017-12-14 00:10:54.192760 7fd9e8779e00 1 bdev create path /data/rook-data/osd3/bluestore-wal type kernel
2017-12-14 00:10:54.192963 I | mkfs-osd3: 2017-12-14 00:10:54.192766 7fd9e8779e00 1 bdev(0x55906e707440 /data/rook-data/osd3/bluestore-wal) open path /data/rook-data/osd3/bluestore-wal
2017-12-14 00:10:54.194066 I | mkfs-osd3: 2017-12-14 00:10:54.193875 7fd9e8779e00 -1 bdev(0x55906e707440 /data/rook-data/osd3/bluestore-wal) unable to get device name for /data/rook-data/osd3/bluestore-wal: (22) Invalid argument
2017-12-14 00:10:54.194266 I | mkfs-osd3: 2017-12-14 00:10:54.194117 7fd9e8779e00 1 bdev(0x55906e707440 /data/rook-data/osd3/bluestore-wal) open size 603979776 (0x24000000, 576 MB) block_size 4096 (4096 B) rotational
2017-12-14 00:10:54.194320 I | mkfs-osd3: 2017-12-14 00:10:54.194145 7fd9e8779e00 1 bluefs add_block_device bdev 0 path /data/rook-data/osd3/bluestore-wal size 576 MB
2017-12-14 00:10:54.195612 I | mkfs-osd3: 2017-12-14 00:10:54.195456 7fd9e8779e00 1 bluefs add_block_extent bdev 0 0x1000~23fff000
2017-12-14 00:10:54.195649 I | mkfs-osd3: 2017-12-14 00:10:54.195547 7fd9e8779e00 1 bluefs mkfs osd_uuid d1d70cbe-67c6-4353-b8b2-9fbd5ea10eac
2017-12-14 00:10:54.195881 I | mkfs-osd3: 2017-12-14 00:10:54.195740 7fd9e8779e00 1 bluefs mkfs uuid 9cb87d0d-f237-4572-8238-2e52a13d99ee
2017-12-14 00:10:54.198913 I | mkfs-osd3: 2017-12-14 00:10:54.198643 7fd9e8779e00 1 bluefs mount
2017-12-14 00:10:54.200466 I | mkfs-osd3: 2017-12-14 00:10:54.200264 7fd9e8779e00 0 set rocksdb option compaction_readahead_size = 2097152
2017-12-14 00:10:54.200665 I | mkfs-osd3: 2017-12-14 00:10:54.200329 7fd9e8779e00 0 set rocksdb option compression = kNoCompression
2017-12-14 00:10:54.200700 I | mkfs-osd3: 2017-12-14 00:10:54.200343 7fd9e8779e00 0 set rocksdb option max_write_buffer_number = 4
2017-12-14 00:10:54.200722 I | mkfs-osd3: 2017-12-14 00:10:54.200350 7fd9e8779e00 0 set rocksdb option min_write_buffer_number_to_merge = 1
2017-12-14 00:10:54.200761 I | mkfs-osd3: 2017-12-14 00:10:54.200357 7fd9e8779e00 0 set rocksdb option recycle_log_file_num = 4
2017-12-14 00:10:54.200808 I | mkfs-osd3: 2017-12-14 00:10:54.200364 7fd9e8779e00 0 set rocksdb option writable_file_max_buffer_size = 0
2017-12-14 00:10:54.200999 I | mkfs-osd3: 2017-12-14 00:10:54.200371 7fd9e8779e00 0 set rocksdb option write_buffer_size = 268435456
2017-12-14 00:10:54.201283 I | mkfs-osd3: 2017-12-14 00:10:54.201060 7fd9e8779e00 0 set rocksdb option compaction_readahead_size = 2097152
2017-12-14 00:10:54.201353 I | mkfs-osd3: 2017-12-14 00:10:54.201087 7fd9e8779e00 0 set rocksdb option compression = kNoCompression
2017-12-14 00:10:54.201409 I | mkfs-osd3: 2017-12-14 00:10:54.201092 7fd9e8779e00 0 set rocksdb option max_write_buffer_number = 4
2017-12-14 00:10:54.201444 I | mkfs-osd3: 2017-12-14 00:10:54.201099 7fd9e8779e00 0 set rocksdb option min_write_buffer_number_to_merge = 1
2017-12-14 00:10:54.201521 I | mkfs-osd3: 2017-12-14 00:10:54.201103 7fd9e8779e00 0 set rocksdb option recycle_log_file_num = 4
2017-12-14 00:10:54.201597 I | mkfs-osd3: 2017-12-14 00:10:54.201107 7fd9e8779e00 0 set rocksdb option writable_file_max_buffer_size = 0
2017-12-14 00:10:54.201639 I | mkfs-osd3: 2017-12-14 00:10:54.201111 7fd9e8779e00 0 set rocksdb option write_buffer_size = 268435456
2017-12-14 00:10:54.201960 I | mkfs-osd3: 2017-12-14 00:10:54.201685 7fd9e8779e00 4 rocksdb: RocksDB version: 5.4.0
2017-12-14 00:10:54.201994 I | mkfs-osd3:
2017-12-14 00:10:54.202017 I | mkfs-osd3: 2017-12-14 00:10:54.201727 7fd9e8779e00 4 rocksdb: Git sha rocksdb_build_git_sha:@bac0af364a2c742ea9bb63199ddeee0edacdb2ac@
2017-12-14 00:10:54.202038 I | mkfs-osd3: 2017-12-14 00:10:54.201733 7fd9e8779e00 4 rocksdb: Compile date Dec 2 2017
2017-12-14 00:10:54.202058 I | mkfs-osd3: 2017-12-14 00:10:54.201737 7fd9e8779e00 4 rocksdb: DB SUMMARY
2017-12-14 00:10:54.202095 I | mkfs-osd3:
2017-12-14 00:10:54.202121 I | mkfs-osd3: 2017-12-14 00:10:54.201748 7fd9e8779e00 4 rocksdb: SST files in db dir, Total Num: 0, files:
2017-12-14 00:10:54.202160 I | mkfs-osd3:
2017-12-14 00:10:54.202197 I | mkfs-osd3: 2017-12-14 00:10:54.201757 7fd9e8779e00 4 rocksdb: SST files in db.slow dir, Total Num: 0, files:
2017-12-14 00:10:54.202260 I | mkfs-osd3:
2017-12-14 00:10:54.202299 I | mkfs-osd3: 2017-12-14 00:10:54.201761 7fd9e8779e00 4 rocksdb: Write Ahead Log file in db.wal:
2017-12-14 00:10:54.202344 I | mkfs-osd3:
2017-12-14 00:10:54.202386 I | mkfs-osd3: 2017-12-14 00:10:54.201763 7fd9e8779e00 4 rocksdb: Options.error_if_exists: 0
2017-12-14 00:10:54.202449 I | mkfs-osd3: 2017-12-14 00:10:54.201764 7fd9e8779e00 4 rocksdb: Options.create_if_missing: 1
2017-12-14 00:10:54.202624 I | mkfs-osd3: 2017-12-14 00:10:54.201766 7fd9e8779e00 4 rocksdb: Options.paranoid_checks: 1
2017-12-14 00:10:54.202672 I | mkfs-osd3: 2017-12-14 00:10:54.201768 7fd9e8779e00 4 rocksdb: Options.env: 0x55906e9f5b40
2017-12-14 00:10:54.202696 I | mkfs-osd3: 2017-12-14 00:10:54.201769 7fd9e8779e00 4 rocksdb: Options.info_log: 0x55906e9f5ea0
2017-12-14 00:10:54.202738 I | mkfs-osd3: 2017-12-14 00:10:54.201770 7fd9e8779e00 4 rocksdb: Options.max_open_files: -1
2017-12-14 00:10:54.202763 I | mkfs-osd3: 2017-12-14 00:10:54.201771 7fd9e8779e00 4 rocksdb: Options.max_file_opening_threads: 16
2017-12-14 00:10:54.202784 I | mkfs-osd3: 2017-12-14 00:10:54.201772 7fd9e8779e00 4 rocksdb: Options.use_fsync: 0
2017-12-14 00:10:54.202834 I | mkfs-osd3: 2017-12-14 00:10:54.201773 7fd9e8779e00 4 rocksdb: Options.max_log_file_size: 0
2017-12-14 00:10:54.202894 I | mkfs-osd3: 2017-12-14 00:10:54.201774 7fd9e8779e00 4 rocksdb: Options.max_manifest_file_size: 18446744073709551615
2017-12-14 00:10:54.202935 I | mkfs-osd3: 2017-12-14 00:10:54.201776 7fd9e8779e00 4 rocksdb: Options.log_file_time_to_roll: 0
2017-12-14 00:10:54.202979 I | mkfs-osd3: 2017-12-14 00:10:54.201777 7fd9e8779e00 4 rocksdb: Options.keep_log_file_num: 1000
2017-12-14 00:10:54.203002 I | mkfs-osd3: 2017-12-14 00:10:54.201778 7fd9e8779e00 4 rocksdb: Options.recycle_log_file_num: 4
2017-12-14 00:10:54.203042 I | mkfs-osd3: 2017-12-14 00:10:54.201779 7fd9e8779e00 4 rocksdb: Options.allow_fallocate: 1
2017-12-14 00:10:54.203090 I | mkfs-osd3: 2017-12-14 00:10:54.201780 7fd9e8779e00 4 rocksdb: Options.allow_mmap_reads: 0
2017-12-14 00:10:54.203112 I | mkfs-osd3: 2017-12-14 00:10:54.201782 7fd9e8779e00 4 rocksdb: Options.allow_mmap_writes: 0
2017-12-14 00:10:54.203133 I | mkfs-osd3: 2017-12-14 00:10:54.201783 7fd9e8779e00 4 rocksdb: Options.use_direct_reads: 0
2017-12-14 00:10:54.203158 I | mkfs-osd3: 2017-12-14 00:10:54.201784 7fd9e8779e00 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
2017-12-14 00:10:54.203180 I | mkfs-osd3: 2017-12-14 00:10:54.201785 7fd9e8779e00 4 rocksdb: Options.create_missing_column_families: 0
2017-12-14 00:10:54.203212 I | mkfs-osd3: 2017-12-14 00:10:54.201786 7fd9e8779e00 4 rocksdb: Options.db_log_dir:
2017-12-14 00:10:54.203248 I | mkfs-osd3: 2017-12-14 00:10:54.201788 7fd9e8779e00 4 rocksdb: Options.wal_dir: db.wal
2017-12-14 00:10:54.203290 I | mkfs-osd3: 2017-12-14 00:10:54.201789 7fd9e8779e00 4 rocksdb: Options.table_cache_numshardbits: 6
2017-12-14 00:10:54.203333 I | mkfs-osd3: 2017-12-14 00:10:54.201790 7fd9e8779e00 4 rocksdb: Options.max_subcompactions: 1
2017-12-14 00:10:54.203356 I | mkfs-osd3: 2017-12-14 00:10:54.201791 7fd9e8779e00 4 rocksdb: Options.max_background_flushes: 1
2017-12-14 00:10:54.203376 I | mkfs-osd3: 2017-12-14 00:10:54.201792 7fd9e8779e00 4 rocksdb: Options.WAL_ttl_seconds: 0
2017-12-14 00:10:54.203419 I | mkfs-osd3: 2017-12-14 00:10:54.201793 7fd9e8779e00 4 rocksdb: Options.WAL_size_limit_MB: 0
2017-12-14 00:10:54.203466 I | mkfs-osd3: 2017-12-14 00:10:54.201794 7fd9e8779e00 4 rocksdb: Options.manifest_preallocation_size: 4194304
2017-12-14 00:10:54.203530 I | mkfs-osd3: 2017-12-14 00:10:54.201796 7fd9e8779e00 4 rocksdb: Options.is_fd_close_on_exec: 1
2017-12-14 00:10:54.203574 I | mkfs-osd3: 2017-12-14 00:10:54.201797 7fd9e8779e00 4 rocksdb: Options.advise_random_on_open: 1
2017-12-14 00:10:54.203597 I | mkfs-osd3: 2017-12-14 00:10:54.201798 7fd9e8779e00 4 rocksdb: Options.db_write_buffer_size: 0
2017-12-14 00:10:54.203633 I | mkfs-osd3: 2017-12-14 00:10:54.201799 7fd9e8779e00 4 rocksdb: Options.access_hint_on_compaction_start: 1
2017-12-14 00:10:54.203674 I | mkfs-osd3: 2017-12-14 00:10:54.201800 7fd9e8779e00 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 1
2017-12-14 00:10:54.203698 I | mkfs-osd3: 2017-12-14 00:10:54.201802 7fd9e8779e00 4 rocksdb: Options.compaction_readahead_size: 2097152
2017-12-14 00:10:54.203736 I | mkfs-osd3: 2017-12-14 00:10:54.201803 7fd9e8779e00 4 rocksdb: Options.random_access_max_buffer_size: 1048576
2017-12-14 00:10:54.203784 I | mkfs-osd3: 2017-12-14 00:10:54.201804 7fd9e8779e00 4 rocksdb: Options.writable_file_max_buffer_size: 0
2017-12-14 00:10:54.203806 I | mkfs-osd3: 2017-12-14 00:10:54.201805 7fd9e8779e00 4 rocksdb: Options.use_adaptive_mutex: 0
2017-12-14 00:10:54.203845 I | mkfs-osd3: 2017-12-14 00:10:54.201806 7fd9e8779e00 4 rocksdb: Options.rate_limiter: (nil)
2017-12-14 00:10:54.203867 I | mkfs-osd3: 2017-12-14 00:10:54.201807 7fd9e8779e00 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
2017-12-14 00:10:54.203902 I | mkfs-osd3: 2017-12-14 00:10:54.201808 7fd9e8779e00 4 rocksdb: Options.bytes_per_sync: 0
2017-12-14 00:10:54.203972 I | mkfs-osd3: 2017-12-14 00:10:54.201809 7fd9e8779e00 4 rocksdb: Options.wal_bytes_per_sync: 0
2017-12-14 00:10:54.204006 I | mkfs-osd3: 2017-12-14 00:10:54.201810 7fd9e8779e00 4 rocksdb: Options.wal_recovery_mode: 0
2017-12-14 00:10:54.204056 I | mkfs-osd3: 2017-12-14 00:10:54.201811 7fd9e8779e00 4 rocksdb: Options.enable_thread_tracking: 0
2017-12-14 00:10:54.204096 I | mkfs-osd3: 2017-12-14 00:10:54.201817 7fd9e8779e00 4 rocksdb: Options.allow_concurrent_memtable_write: 1
2017-12-14 00:10:54.204143 I | mkfs-osd3: 2017-12-14 00:10:54.201818 7fd9e8779e00 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
2017-12-14 00:10:54.204178 I | mkfs-osd3: 2017-12-14 00:10:54.201820 7fd9e8779e00 4 rocksdb: Options.write_thread_max_yield_usec: 100
2017-12-14 00:10:54.204243 I | mkfs-osd3: 2017-12-14 00:10:54.201821 7fd9e8779e00 4 rocksdb: Options.write_thread_slow_yield_usec: 3
2017-12-14 00:10:54.204294 I | mkfs-osd3: 2017-12-14 00:10:54.201822 7fd9e8779e00 4 rocksdb: Options.row_cache: None
2017-12-14 00:10:54.204519 I | mkfs-osd3: 2017-12-14 00:10:54.201823 7fd9e8779e00 4 rocksdb: Options.wal_filter: None
2017-12-14 00:10:54.204566 I | mkfs-osd3: 2017-12-14 00:10:54.201824 7fd9e8779e00 4 rocksdb: Options.avoid_flush_during_recovery: 0
2017-12-14 00:10:54.204620 I | mkfs-osd3: 2017-12-14 00:10:54.201825 7fd9e8779e00 4 rocksdb: Options.base_background_compactions: 1
2017-12-14 00:10:54.204648 I | mkfs-osd3: 2017-12-14 00:10:54.201826 7fd9e8779e00 4 rocksdb: Options.max_background_compactions: 1
2017-12-14 00:10:54.204672 I | mkfs-osd3: 2017-12-14 00:10:54.201827 7fd9e8779e00 4 rocksdb: Options.avoid_flush_during_shutdown: 0
2017-12-14 00:10:54.204709 I | mkfs-osd3: 2017-12-14 00:10:54.201828 7fd9e8779e00 4 rocksdb: Options.delayed_write_rate : 16777216
2017-12-14 00:10:54.204750 I | mkfs-osd3: 2017-12-14 00:10:54.201829 7fd9e8779e00 4 rocksdb: Options.max_total_wal_size: 0
2017-12-14 00:10:54.204795 I | mkfs-osd3: 2017-12-14 00:10:54.201830 7fd9e8779e00 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
2017-12-14 00:10:54.204816 I | mkfs-osd3: 2017-12-14 00:10:54.201831 7fd9e8779e00 4 rocksdb: Options.stats_dump_period_sec: 600
2017-12-14 00:10:54.204854 I | mkfs-osd3: 2017-12-14 00:10:54.201833 7fd9e8779e00 4 rocksdb: Compression algorithms supported:
2017-12-14 00:10:54.204876 I | mkfs-osd3: 2017-12-14 00:10:54.201834 7fd9e8779e00 4 rocksdb: Snappy supported: 0
2017-12-14 00:10:54.204897 I | mkfs-osd3: 2017-12-14 00:10:54.201835 7fd9e8779e00 4 rocksdb: Zlib supported: 0
2017-12-14 00:10:54.204917 I | mkfs-osd3: 2017-12-14 00:10:54.201836 7fd9e8779e00 4 rocksdb: Bzip supported: 0
2017-12-14 00:10:54.204937 I | mkfs-osd3: 2017-12-14 00:10:54.201837 7fd9e8779e00 4 rocksdb: LZ4 supported: 0
2017-12-14 00:10:54.204968 I | mkfs-osd3: 2017-12-14 00:10:54.201838 7fd9e8779e00 4 rocksdb: ZSTD supported: 0
2017-12-14 00:10:54.205029 I | mkfs-osd3: 2017-12-14 00:10:54.201839 7fd9e8779e00 4 rocksdb: Fast CRC32 supported: 0
2017-12-14 00:10:54.205064 I | mkfs-osd3: 2017-12-14 00:10:54.201861 7fd9e8779e00 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:192] Creating manifest 1
2017-12-14 00:10:54.205093 I | mkfs-osd3:
2017-12-14 00:10:54.219630 I | mkfs-osd3: 2017-12-14 00:10:54.219281 7fd9e8779e00 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2609] Recovering from manifest file: MANIFEST-000001
2017-12-14 00:10:54.219853 I | mkfs-osd3:
2017-12-14 00:10:54.220244 I | mkfs-osd3: 2017-12-14 00:10:54.219989 7fd9e8779e00 4 rocksdb: [/build/ceph/src/rocksdb/db/column_family.cc:407] --------------- Options for column family [default]:
2017-12-14 00:10:54.220322 I | mkfs-osd3:
2017-12-14 00:10:54.220382 I | mkfs-osd3: 2017-12-14 00:10:54.220024 7fd9e8779e00 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
2017-12-14 00:10:54.220436 I | mkfs-osd3: 2017-12-14 00:10:54.220034 7fd9e8779e00 4 rocksdb: Options.merge_operator: .T:int64_array.b:bitwise_xor
2017-12-14 00:10:54.220527 I | mkfs-osd3: 2017-12-14 00:10:54.220036 7fd9e8779e00 4 rocksdb: Options.compaction_filter: None
2017-12-14 00:10:54.220586 I | mkfs-osd3: 2017-12-14 00:10:54.220038 7fd9e8779e00 4 rocksdb: Options.compaction_filter_factory: None
2017-12-14 00:10:54.220643 I | mkfs-osd3: 2017-12-14 00:10:54.220042 7fd9e8779e00 4 rocksdb: Options.memtable_factory: SkipListFactory
2017-12-14 00:10:54.220677 I | mkfs-osd3: 2017-12-14 00:10:54.220044 7fd9e8779e00 4 rocksdb: Options.table_factory: BlockBasedTable
2017-12-14 00:10:54.220944 I | mkfs-osd3: 2017-12-14 00:10:54.220766 7fd9e8779e00 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55906e7021c0)
2017-12-14 00:10:54.221016 I | mkfs-osd3: cache_index_and_filter_blocks: 1
2017-12-14 00:10:54.221051 I | mkfs-osd3: cache_index_and_filter_blocks_with_high_priority: 1
2017-12-14 00:10:54.221083 I | mkfs-osd3: pin_l0_filter_and_index_blocks_in_cache: 1
2017-12-14 00:10:54.221114 I | mkfs-osd3: index_type: 0
2017-12-14 00:10:54.221144 I | mkfs-osd3: hash_index_allow_collision: 1
2017-12-14 00:10:54.221196 I | mkfs-osd3: checksum: 1
2017-12-14 00:10:54.221248 I | mkfs-osd3: no_block_cache: 0
2017-12-14 00:10:54.221299 I | mkfs-osd3: block_cache: 0x55906e9e7340
2017-12-14 00:10:54.221359 I | mkfs-osd3: block_cache_name: LRUCache
2017-12-14 00:10:54.221418 I | mkfs-osd3: block_cache_options:
2017-12-14 00:10:54.221468 I | mkfs-osd3: capacity : 536870912
2017-12-14 00:10:54.221554 I | mkfs-osd3: num_shard_bits : 4
2017-12-14 00:10:54.221607 I | mkfs-osd3: strict_capacity_limit : 0
2017-12-14 00:10:54.221665 I | mkfs-osd3: high_pri_pool_ratio: 0.000
2017-12-14 00:10:54.221699 I | mkfs-osd3: block_cache_compressed: (nil)
2017-12-14 00:10:54.221732 I | mkfs-osd3: persistent_cache: (nil)
2017-12-14 00:10:54.221807 I | mkfs-osd3: block_size: 4096
2017-12-14 00:10:54.221874 I | mkfs-osd3: block_size_deviation: 10
2017-12-14 00:10:54.221927 I | mkfs-osd3: block_restart_interval: 16
2017-12-14 00:10:54.221978 I | mkfs-osd3: index_block_restart_interval: 1
2017-12-14 00:10:54.222012 I | mkfs-osd3: filter_policy: rocksdb.BuiltinBloomFilter
2017-12-14 00:10:54.222062 I | mkfs-osd3: whole_key_filtering: 1
2017-12-14 00:10:54.222113 I | mkfs-osd3: format_version: 2
2017-12-14 00:10:54.222164 I | mkfs-osd3:
2017-12-14 00:10:54.222216 I | mkfs-osd3: 2017-12-14 00:10:54.220827 7fd9e8779e00 4 rocksdb: Options.write_buffer_size: 268435456
2017-12-14 00:10:54.222276 I | mkfs-osd3: 2017-12-14 00:10:54.220837 7fd9e8779e00 4 rocksdb: Options.max_write_buffer_number: 4
2017-12-14 00:10:54.222310 I | mkfs-osd3: 2017-12-14 00:10:54.220840 7fd9e8779e00 4 rocksdb: Options.compression: NoCompression
2017-12-14 00:10:54.222354 I | mkfs-osd3: 2017-12-14 00:10:54.220842 7fd9e8779e00 4 rocksdb: Options.bottommost_compression: Disabled
2017-12-14 00:10:54.222390 I | mkfs-osd3: 2017-12-14 00:10:54.220845 7fd9e8779e00 4 rocksdb: Options.prefix_extractor: nullptr
2017-12-14 00:10:54.222449 I | mkfs-osd3: 2017-12-14 00:10:54.220847 7fd9e8779e00 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
2017-12-14 00:10:54.222525 I | mkfs-osd3: 2017-12-14 00:10:54.220850 7fd9e8779e00 4 rocksdb: Options.num_levels: 7
2017-12-14 00:10:54.222580 I | mkfs-osd3: 2017-12-14 00:10:54.220852 7fd9e8779e00 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
2017-12-14 00:10:54.222638 I | mkfs-osd3: 2017-12-14 00:10:54.220855 7fd9e8779e00 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
2017-12-14 00:10:54.222690 I | mkfs-osd3: 2017-12-14 00:10:54.220857 7fd9e8779e00 4 rocksdb: Options.compression_opts.window_bits: -14
2017-12-14 00:10:54.222741 I | mkfs-osd3: 2017-12-14 00:10:54.220859 7fd9e8779e00 4 rocksdb: Options.compression_opts.level: -1
2017-12-14 00:10:54.222851 I | mkfs-osd3: 2017-12-14 00:10:54.220861 7fd9e8779e00 4 rocksdb: Options.compression_opts.strategy: 0
2017-12-14 00:10:54.222912 I | mkfs-osd3: 2017-12-14 00:10:54.220863 7fd9e8779e00 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
2017-12-14 00:10:54.222949 I | mkfs-osd3: 2017-12-14 00:10:54.220865 7fd9e8779e00 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
2017-12-14 00:10:54.223006 I | mkfs-osd3: 2017-12-14 00:10:54.220867 7fd9e8779e00 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
2017-12-14 00:10:54.223041 I | mkfs-osd3: 2017-12-14 00:10:54.220868 7fd9e8779e00 4 rocksdb: Options.level0_stop_writes_trigger: 36
2017-12-14 00:10:54.223098 I | mkfs-osd3: 2017-12-14 00:10:54.220870 7fd9e8779e00 4 rocksdb: Options.target_file_size_base: 67108864
2017-12-14 00:10:54.223151 I | mkfs-osd3: 2017-12-14 00:10:54.220872 7fd9e8779e00 4 rocksdb: Options.target_file_size_multiplier: 1
2017-12-14 00:10:54.223184 I | mkfs-osd3: 2017-12-14 00:10:54.220874 7fd9e8779e00 4 rocksdb: Options.max_bytes_for_level_base: 268435456
2017-12-14 00:10:54.223411 I | mkfs-osd3: 2017-12-14 00:10:54.223249 7fd9e8779e00 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
2017-12-14 00:10:54.223610 I | mkfs-osd3: 2017-12-14 00:10:54.223285 7fd9e8779e00 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
2017-12-14 00:10:54.223672 I | mkfs-osd3: 2017-12-14 00:10:54.223292 7fd9e8779e00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
2017-12-14 00:10:54.223707 I | mkfs-osd3: 2017-12-14 00:10:54.223296 7fd9e8779e00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
2017-12-14 00:10:54.223763 I | mkfs-osd3: 2017-12-14 00:10:54.223298 7fd9e8779e00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
2017-12-14 00:10:54.223848 I | mkfs-osd3: 2017-12-14 00:10:54.223299 7fd9e8779e00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
2017-12-14 00:10:54.223906 I | mkfs-osd3: 2017-12-14 00:10:54.223302 7fd9e8779e00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
2017-12-14 00:10:54.223941 I | mkfs-osd3: 2017-12-14 00:10:54.223304 7fd9e8779e00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
2017-12-14 00:10:54.223999 I | mkfs-osd3: 2017-12-14 00:10:54.223306 7fd9e8779e00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
2017-12-14 00:10:54.224057 I | mkfs-osd3: 2017-12-14 00:10:54.223307 7fd9e8779e00 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
2017-12-14 00:10:54.224115 I | mkfs-osd3: 2017-12-14 00:10:54.223310 7fd9e8779e00 4 rocksdb: Options.max_compaction_bytes: 1677721600
2017-12-14 00:10:54.224168 I | mkfs-osd3: 2017-12-14 00:10:54.223312 7fd9e8779e00 4 rocksdb: Options.arena_block_size: 33554432
2017-12-14 00:10:54.224220 I | mkfs-osd3: 2017-12-14 00:10:54.223314 7fd9e8779e00 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
2017-12-14 00:10:54.224271 I | mkfs-osd3: 2017-12-14 00:10:54.223316 7fd9e8779e00 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
2017-12-14 00:10:54.224328 I | mkfs-osd3: 2017-12-14 00:10:54.223318 7fd9e8779e00 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
2017-12-14 00:10:54.224419 I | mkfs-osd3: 2017-12-14 00:10:54.223320 7fd9e8779e00 4 rocksdb: Options.disable_auto_compactions: 0
2017-12-14 00:10:54.224473 I | mkfs-osd3: 2017-12-14 00:10:54.223323 7fd9e8779e00 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
2017-12-14 00:10:54.224559 I | mkfs-osd3: 2017-12-14 00:10:54.223329 7fd9e8779e00 4 rocksdb: Options.compaction_pri: kByCompensatedSize
2017-12-14 00:10:54.224849 I | mkfs-osd3: 2017-12-14 00:10:54.223350 7fd9e8779e00 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
2017-12-14 00:10:54.224933 I | mkfs-osd3: 2017-12-14 00:10:54.224657 7fd9e8779e00 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
2017-12-14 00:10:54.224990 I | mkfs-osd3: 2017-12-14 00:10:54.224660 7fd9e8779e00 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
2017-12-14 00:10:54.225042 I | mkfs-osd3: 2017-12-14 00:10:54.224662 7fd9e8779e00 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
2017-12-14 00:10:54.225094 I | mkfs-osd3: 2017-12-14 00:10:54.224665 7fd9e8779e00 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
2017-12-14 00:10:54.225148 I | mkfs-osd3: 2017-12-14 00:10:54.224667 7fd9e8779e00 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
2017-12-14 00:10:54.225199 I | mkfs-osd3: 2017-12-14 00:10:54.224670 7fd9e8779e00 4 rocksdb: Options.table_properties_collectors:
2017-12-14 00:10:54.225234 I | mkfs-osd3: 2017-12-14 00:10:54.224672 7fd9e8779e00 4 rocksdb: Options.inplace_update_support: 0
2017-12-14 00:10:54.225294 I | mkfs-osd3: 2017-12-14 00:10:54.224674 7fd9e8779e00 4 rocksdb: Options.inplace_update_num_locks: 10000
2017-12-14 00:10:54.225365 I | mkfs-osd3: 2017-12-14 00:10:54.224676 7fd9e8779e00 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
2017-12-14 00:10:54.225401 I | mkfs-osd3: 2017-12-14 00:10:54.224680 7fd9e8779e00 4 rocksdb: Options.memtable_huge_page_size: 0
2017-12-14 00:10:54.225431 I | mkfs-osd3: 2017-12-14 00:10:54.224682 7fd9e8779e00 4 rocksdb: Options.bloom_locality: 0
2017-12-14 00:10:54.225462 I | mkfs-osd3: 2017-12-14 00:10:54.224684 7fd9e8779e00 4 rocksdb: Options.max_successive_merges: 0
2017-12-14 00:10:54.225526 I | mkfs-osd3: 2017-12-14 00:10:54.224686 7fd9e8779e00 4 rocksdb: Options.optimize_filters_for_hits: 0
2017-12-14 00:10:54.225561 I | mkfs-osd3: 2017-12-14 00:10:54.224688 7fd9e8779e00 4 rocksdb: Options.paranoid_file_checks: 0
2017-12-14 00:10:54.225593 I | mkfs-osd3: 2017-12-14 00:10:54.224690 7fd9e8779e00 4 rocksdb: Options.force_consistency_checks: 0
2017-12-14 00:10:54.225643 I | mkfs-osd3: 2017-12-14 00:10:54.224696 7fd9e8779e00 4 rocksdb: Options.report_bg_io_stats: 0
2017-12-14 00:10:54.228903 I | mkfs-osd3: 2017-12-14 00:10:54.228654 7fd9e8779e00 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2859] Recovered from manifest file:db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0
2017-12-14 00:10:54.229020 I | mkfs-osd3:
2017-12-14 00:10:54.229089 I | mkfs-osd3: 2017-12-14 00:10:54.228715 7fd9e8779e00 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2867] Column family [default] (ID 0), log number is 0
2017-12-14 00:10:54.229191 I | mkfs-osd3:
2017-12-14 00:10:54.236027 I | mkfs-osd3: 2017-12-14 00:10:54.235809 7fd9e8779e00 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:1063] DB pointer 0x55906eafc000
2017-12-14 00:10:54.253873 I | mkfs-osd3: 2017-12-14 00:10:54.253572 7fd9e8779e00 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:217] Shutdown: canceling all background work
2017-12-14 00:10:54.254383 I | mkfs-osd3: 2017-12-14 00:10:54.254168 7fd9e8779e00 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:343] Shutdown complete
2017-12-14 00:10:54.254712 I | mkfs-osd3: 2017-12-14 00:10:54.254533 7fd9e8779e00 1 bluefs umount
2017-12-14 00:10:54.254761 I | mkfs-osd3: 2017-12-14 00:10:54.254601 7fd9e8779e00 1 bdev(0x55906e707440 /data/rook-data/osd3/bluestore-wal) close
2017-12-14 00:10:54.521937 I | mkfs-osd3: 2017-12-14 00:10:54.521642 7fd9e8779e00 1 bdev(0x55906e706fc0 /data/rook-data/osd3/bluestore-db) close
2017-12-14 00:10:54.758799 I | mkfs-osd3: 2017-12-14 00:10:54.758580 7fd9e8779e00 1 bdev(0x55906e707200 /data/rook-data/osd3/block) close
2017-12-14 00:10:54.979055 I | mkfs-osd3: 2017-12-14 00:10:54.978825 7fd9e8779e00 1 bdev(0x55906e706b40 /data/rook-data/osd3/block) close
2017-12-14 00:10:55.207266 I | mkfs-osd3: 2017-12-14 00:10:55.206933 7fd9e8779e00 1 bdev create path /data/rook-data/osd3/block type kernel
2017-12-14 00:10:55.207402 I | mkfs-osd3: 2017-12-14 00:10:55.206982 7fd9e8779e00 1 bdev(0x55906e707b00 /data/rook-data/osd3/block) open path /data/rook-data/osd3/block
2017-12-14 00:10:55.214115 I | mkfs-osd3: 2017-12-14 00:10:55.213793 7fd9e8779e00 -1 bdev(0x55906e707b00 /data/rook-data/osd3/block) unable to get device name for /data/rook-data/osd3/block: (22) Invalid argument
2017-12-14 00:10:55.214302 I | mkfs-osd3: 2017-12-14 00:10:55.214206 7fd9e8779e00 1 bdev(0x55906e707b00 /data/rook-data/osd3/block) open size 205583683584 (0x2fddbe1000, 191 GB) block_size 4096 (4096 B) rotational
2017-12-14 00:10:55.214753 I | mkfs-osd3: 2017-12-14 00:10:55.214544 7fd9e8779e00 1 bdev create path /data/rook-data/osd3/bluestore-db type kernel
2017-12-14 00:10:55.214832 I | mkfs-osd3: 2017-12-14 00:10:55.214601 7fd9e8779e00 1 bdev(0x55906e7078c0 /data/rook-data/osd3/bluestore-db) open path /data/rook-data/osd3/bluestore-db
2017-12-14 00:10:55.216103 I | mkfs-osd3: 2017-12-14 00:10:55.215937 7fd9e8779e00 -1 bdev(0x55906e7078c0 /data/rook-data/osd3/bluestore-db) unable to get device name for /data/rook-data/osd3/bluestore-db: (22) Invalid argument
2017-12-14 00:10:55.216302 I | mkfs-osd3: 2017-12-14 00:10:55.216080 7fd9e8779e00 1 bdev(0x55906e7078c0 /data/rook-data/osd3/bluestore-db) open size 1073741824 (0x40000000, 1024 MB) block_size 4096 (4096 B) rotational
2017-12-14 00:10:55.216371 I | mkfs-osd3: 2017-12-14 00:10:55.216129 7fd9e8779e00 1 bluefs add_block_device bdev 1 path /data/rook-data/osd3/bluestore-db size 1024 MB
2017-12-14 00:10:55.216571 I | mkfs-osd3: 2017-12-14 00:10:55.216239 7fd9e8779e00 1 bdev create path /data/rook-data/osd3/block type kernel
2017-12-14 00:10:55.216647 I | mkfs-osd3: 2017-12-14 00:10:55.216358 7fd9e8779e00 1 bdev(0x55906e707680 /data/rook-data/osd3/block) open path /data/rook-data/osd3/block
2017-12-14 00:10:55.217916 I | mkfs-osd3: 2017-12-14 00:10:55.217777 7fd9e8779e00 -1 bdev(0x55906e707680 /data/rook-data/osd3/block) unable to get device name for /data/rook-data/osd3/block: (22) Invalid argument
2017-12-14 00:10:55.218006 I | mkfs-osd3: 2017-12-14 00:10:55.217934 7fd9e8779e00 1 bdev(0x55906e707680 /data/rook-data/osd3/block) open size 205583683584 (0x2fddbe1000, 191 GB) block_size 4096 (4096 B) rotational
2017-12-14 00:10:55.218085 I | mkfs-osd3: 2017-12-14 00:10:55.217956 7fd9e8779e00 1 bluefs add_block_device bdev 2 path /data/rook-data/osd3/block size 191 GB
2017-12-14 00:10:55.218281 I | mkfs-osd3: 2017-12-14 00:10:55.218110 7fd9e8779e00 1 bdev create path /data/rook-data/osd3/bluestore-wal type kernel
2017-12-14 00:10:55.218360 I | mkfs-osd3: 2017-12-14 00:10:55.218164 7fd9e8779e00 1 bdev(0x55906e707440 /data/rook-data/osd3/bluestore-wal) open path /data/rook-data/osd3/bluestore-wal
2017-12-14 00:10:55.219637 I | mkfs-osd3: 2017-12-14 00:10:55.219445 7fd9e8779e00 -1 bdev(0x55906e707440 /data/rook-data/osd3/bluestore-wal) unable to get device name for /data/rook-data/osd3/bluestore-wal: (22) Invalid argument
2017-12-14 00:10:55.219724 I | mkfs-osd3: 2017-12-14 00:10:55.219657 7fd9e8779e00 1 bdev(0x55906e707440 /data/rook-data/osd3/bluestore-wal) open size 603979776 (0x24000000, 576 MB) block_size 4096 (4096 B) rotational
2017-12-14 00:10:55.219771 I | mkfs-osd3: 2017-12-14 00:10:55.219678 7fd9e8779e00 1 bluefs add_block_device bdev 0 path /data/rook-data/osd3/bluestore-wal size 576 MB
2017-12-14 00:10:55.220053 I | mkfs-osd3: 2017-12-14 00:10:55.219895 7fd9e8779e00 1 bluefs mount
2017-12-14 00:10:55.221950 I | mkfs-osd3: 2017-12-14 00:10:55.221360 7fd9e8779e00 0 set rocksdb option compaction_readahead_size = 2097152
2017-12-14 00:10:55.222012 I | mkfs-osd3: 2017-12-14 00:10:55.221400 7fd9e8779e00 0 set rocksdb option compression = kNoCompression
2017-12-14 00:10:55.222036 I | mkfs-osd3: 2017-12-14 00:10:55.221416 7fd9e8779e00 0 set rocksdb option max_write_buffer_number = 4
2017-12-14 00:10:55.222057 I | mkfs-osd3: 2017-12-14 00:10:55.221427 7fd9e8779e00 0 set rocksdb option min_write_buffer_number_to_merge = 1
2017-12-14 00:10:55.222077 I | mkfs-osd3: 2017-12-14 00:10:55.221438 7fd9e8779e00 0 set rocksdb option recycle_log_file_num = 4
2017-12-14 00:10:55.222097 I | mkfs-osd3: 2017-12-14 00:10:55.221446 7fd9e8779e00 0 set rocksdb option writable_file_max_buffer_size = 0
2017-12-14 00:10:55.222116 I | mkfs-osd3: 2017-12-14 00:10:55.221456 7fd9e8779e00 0 set rocksdb option write_buffer_size = 268435456
2017-12-14 00:10:55.222149 I | mkfs-osd3: 2017-12-14 00:10:55.221571 7fd9e8779e00 0 set rocksdb option compaction_readahead_size = 2097152
2017-12-14 00:10:55.222171 I | mkfs-osd3: 2017-12-14 00:10:55.221585 7fd9e8779e00 0 set rocksdb option compression = kNoCompression
2017-12-14 00:10:55.222204 I | mkfs-osd3: 2017-12-14 00:10:55.221593 7fd9e8779e00 0 set rocksdb option max_write_buffer_number = 4
2017-12-14 00:10:55.222226 I | mkfs-osd3: 2017-12-14 00:10:55.221600 7fd9e8779e00 0 set rocksdb option min_write_buffer_number_to_merge = 1
2017-12-14 00:10:55.222246 I | mkfs-osd3: 2017-12-14 00:10:55.221607 7fd9e8779e00 0 set rocksdb option recycle_log_file_num = 4
2017-12-14 00:10:55.222278 I | mkfs-osd3: 2017-12-14 00:10:55.221613 7fd9e8779e00 0 set rocksdb option writable_file_max_buffer_size = 0
2017-12-14 00:10:55.222303 I | mkfs-osd3: 2017-12-14 00:10:55.221620 7fd9e8779e00 0 set rocksdb option write_buffer_size = 268435456
2017-12-14 00:10:55.222360 I | mkfs-osd3: 2017-12-14 00:10:55.221763 7fd9e8779e00 4 rocksdb: RocksDB version: 5.4.0
2017-12-14 00:10:55.222387 I | mkfs-osd3:
2017-12-14 00:10:55.222422 I | mkfs-osd3: 2017-12-14 00:10:55.221794 7fd9e8779e00 4 rocksdb: Git sha rocksdb_build_git_sha:@bac0af364a2c742ea9bb63199ddeee0edacdb2ac@
2017-12-14 00:10:55.222458 I | mkfs-osd3: 2017-12-14 00:10:55.221800 7fd9e8779e00 4 rocksdb: Compile date Dec 2 2017
2017-12-14 00:10:55.222502 I | mkfs-osd3: 2017-12-14 00:10:55.221806 7fd9e8779e00 4 rocksdb: DB SUMMARY
2017-12-14 00:10:55.222526 I | mkfs-osd3:
2017-12-14 00:10:55.222546 I | mkfs-osd3: 2017-12-14 00:10:55.221819 7fd9e8779e00 4 rocksdb: CURRENT file: CURRENT
2017-12-14 00:10:55.222586 I | mkfs-osd3:
2017-12-14 00:10:55.222607 I | mkfs-osd3: 2017-12-14 00:10:55.221826 7fd9e8779e00 4 rocksdb: IDENTITY file: IDENTITY
2017-12-14 00:10:55.222639 I | mkfs-osd3:
2017-12-14 00:10:55.222661 I | mkfs-osd3: 2017-12-14 00:10:55.221835 7fd9e8779e00 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes
2017-12-14 00:10:55.222680 I | mkfs-osd3:
2017-12-14 00:10:55.222700 I | mkfs-osd3: 2017-12-14 00:10:55.221840 7fd9e8779e00 4 rocksdb: SST files in db dir, Total Num: 0, files:
2017-12-14 00:10:55.222719 I | mkfs-osd3:
2017-12-14 00:10:55.222738 I | mkfs-osd3: 2017-12-14 00:10:55.221846 7fd9e8779e00 4 rocksdb: SST files in db.slow dir, Total Num: 0, files:
2017-12-14 00:10:55.222771 I | mkfs-osd3:
2017-12-14 00:10:55.222857 I | mkfs-osd3: 2017-12-14 00:10:55.221854 7fd9e8779e00 4 rocksdb: Write Ahead Log file in db.wal: 000003.log size: 383 ;
2017-12-14 00:10:55.222910 I | mkfs-osd3:
2017-12-14 00:10:55.222934 I | mkfs-osd3: 2017-12-14 00:10:55.221860 7fd9e8779e00 4 rocksdb: Options.error_if_exists: 0
2017-12-14 00:10:55.222956 I | mkfs-osd3: 2017-12-14 00:10:55.221864 7fd9e8779e00 4 rocksdb: Options.create_if_missing: 0
2017-12-14 00:10:55.223018 I | mkfs-osd3: 2017-12-14 00:10:55.221866 7fd9e8779e00 4 rocksdb: Options.paranoid_checks: 1
2017-12-14 00:10:55.223086 I | mkfs-osd3: 2017-12-14 00:10:55.221869 7fd9e8779e00 4 rocksdb: Options.env: 0x55906e9f5ac0
2017-12-14 00:10:55.223134 I | mkfs-osd3: 2017-12-14 00:10:55.221872 7fd9e8779e00 4 rocksdb: Options.info_log: 0x55906e9f5e60
2017-12-14 00:10:55.223185 I | mkfs-osd3: 2017-12-14 00:10:55.221876 7fd9e8779e00 4 rocksdb: Options.max_open_files: -1
2017-12-14 00:10:55.223208 I | mkfs-osd3: 2017-12-14 00:10:55.221878 7fd9e8779e00 4 rocksdb: Options.max_file_opening_threads: 16
2017-12-14 00:10:55.223243 I | mkfs-osd3: 2017-12-14 00:10:55.221886 7fd9e8779e00 4 rocksdb: Options.use_fsync: 0
2017-12-14 00:10:55.223266 I | mkfs-osd3: 2017-12-14 00:10:55.221889 7fd9e8779e00 4 rocksdb: Options.max_log_file_size: 0
2017-12-14 00:10:55.223306 I | mkfs-osd3: 2017-12-14 00:10:55.221895 7fd9e8779e00 4 rocksdb: Options.max_manifest_file_size: 18446744073709551615
2017-12-14 00:10:55.223367 I | mkfs-osd3: 2017-12-14 00:10:55.221898 7fd9e8779e00 4 rocksdb: Options.log_file_time_to_roll: 0
2017-12-14 00:10:55.223419 I | mkfs-osd3: 2017-12-14 00:10:55.221901 7fd9e8779e00 4 rocksdb: Options.keep_log_file_num: 1000
2017-12-14 00:10:55.223508 I | mkfs-osd3: 2017-12-14 00:10:55.221905 7fd9e8779e00 4 rocksdb: Options.recycle_log_file_num: 4
2017-12-14 00:10:55.223550 I | mkfs-osd3: 2017-12-14 00:10:55.221908 7fd9e8779e00 4 rocksdb: Options.allow_fallocate: 1
2017-12-14 00:10:55.223587 I | mkfs-osd3: 2017-12-14 00:10:55.221911 7fd9e8779e00 4 rocksdb: Options.allow_mmap_reads: 0
2017-12-14 00:10:55.223610 I | mkfs-osd3: 2017-12-14 00:10:55.221914 7fd9e8779e00 4 rocksdb: Options.allow_mmap_writes: 0
2017-12-14 00:10:55.223631 I | mkfs-osd3: 2017-12-14 00:10:55.221917 7fd9e8779e00 4 rocksdb: Options.use_direct_reads: 0
2017-12-14 00:10:55.223665 I | mkfs-osd3: 2017-12-14 00:10:55.221920 7fd9e8779e00 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
2017-12-14 00:10:55.223688 I | mkfs-osd3: 2017-12-14 00:10:55.221922 7fd9e8779e00 4 rocksdb: Options.create_missing_column_families: 0
2017-12-14 00:10:55.223709 I | mkfs-osd3: 2017-12-14 00:10:55.221924 7fd9e8779e00 4 rocksdb: Options.db_log_dir:
2017-12-14 00:10:55.223750 I | mkfs-osd3: 2017-12-14 00:10:55.221927 7fd9e8779e00 4 rocksdb: Options.wal_dir: db.wal
2017-12-14 00:10:55.223772 I | mkfs-osd3: 2017-12-14 00:10:55.221975 7fd9e8779e00 4 rocksdb: Options.table_cache_numshardbits: 6
2017-12-14 00:10:55.223821 I | mkfs-osd3: 2017-12-14 00:10:55.222310 7fd9e8779e00 4 rocksdb: Options.max_subcompactions: 1
2017-12-14 00:10:55.223937 I | mkfs-osd3: 2017-12-14 00:10:55.222618 7fd9e8779e00 4 rocksdb: Options.max_background_flushes: 1
2017-12-14 00:10:55.223965 I | mkfs-osd3: 2017-12-14 00:10:55.222795 7fd9e8779e00 4 rocksdb: Options.WAL_ttl_seconds: 0
2017-12-14 00:10:55.223986 I | mkfs-osd3: 2017-12-14 00:10:55.222803 7fd9e8779e00 4 rocksdb: Options.WAL_size_limit_MB: 0
2017-12-14 00:10:55.224013 I | mkfs-osd3: 2017-12-14 00:10:55.223222 7fd9e8779e00 4 rocksdb: Options.manifest_preallocation_size: 4194304
2017-12-14 00:10:55.224050 I | mkfs-osd3: 2017-12-14 00:10:55.223547 7fd9e8779e00 4 rocksdb: Options.is_fd_close_on_exec: 1
2017-12-14 00:10:55.224090 I | mkfs-osd3: 2017-12-14 00:10:55.223834 7fd9e8779e00 4 rocksdb: Options.advise_random_on_open: 1
2017-12-14 00:10:55.224119 I | mkfs-osd3: 2017-12-14 00:10:55.223846 7fd9e8779e00 4 rocksdb: Options.db_write_buffer_size: 0
2017-12-14 00:10:55.224155 I | mkfs-osd3: 2017-12-14 00:10:55.223850 7fd9e8779e00 4 rocksdb: Options.access_hint_on_compaction_start: 1
2017-12-14 00:10:55.224370 I | mkfs-osd3: 2017-12-14 00:10:55.223916 7fd9e8779e00 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 1
2017-12-14 00:10:55.224542 I | mkfs-osd3: 2017-12-14 00:10:55.224206 7fd9e8779e00 4 rocksdb: Options.compaction_readahead_size: 2097152
2017-12-14 00:10:55.224592 I | mkfs-osd3: 2017-12-14 00:10:55.224216 7fd9e8779e00 4 rocksdb: Options.random_access_max_buffer_size: 1048576
2017-12-14 00:10:55.224616 I | mkfs-osd3: 2017-12-14 00:10:55.224219 7fd9e8779e00 4 rocksdb: Options.writable_file_max_buffer_size: 0
2017-12-14 00:10:55.224651 I | mkfs-osd3: 2017-12-14 00:10:55.224222 7fd9e8779e00 4 rocksdb: Options.use_adaptive_mutex: 0
2017-12-14 00:10:55.224686 I | mkfs-osd3: 2017-12-14 00:10:55.224225 7fd9e8779e00 4 rocksdb: Options.rate_limiter: (nil)
2017-12-14 00:10:55.224721 I | mkfs-osd3: 2017-12-14 00:10:55.224228 7fd9e8779e00 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
2017-12-14 00:10:55.224744 I | mkfs-osd3: 2017-12-14 00:10:55.224234 7fd9e8779e00 4 rocksdb: Options.bytes_per_sync: 0
2017-12-14 00:10:55.224778 I | mkfs-osd3: 2017-12-14 00:10:55.224237 7fd9e8779e00 4 rocksdb: Options.wal_bytes_per_sync: 0
2017-12-14 00:10:55.224817 I | mkfs-osd3: 2017-12-14 00:10:55.224240 7fd9e8779e00 4 rocksdb: Options.wal_recovery_mode: 0
2017-12-14 00:10:55.224859 I | mkfs-osd3: 2017-12-14 00:10:55.224245 7fd9e8779e00 4 rocksdb: Options.enable_thread_tracking: 0
2017-12-14 00:10:55.224882 I | mkfs-osd3: 2017-12-14 00:10:55.224249 7fd9e8779e00 4 rocksdb: Options.allow_concurrent_memtable_write: 1
2017-12-14 00:10:55.224915 I | mkfs-osd3: 2017-12-14 00:10:55.224252 7fd9e8779e00 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
2017-12-14 00:10:55.224943 I | mkfs-osd3: 2017-12-14 00:10:55.224255 7fd9e8779e00 4 rocksdb: Options.write_thread_max_yield_usec: 100
2017-12-14 00:10:55.224964 I | mkfs-osd3: 2017-12-14 00:10:55.224258 7fd9e8779e00 4 rocksdb: Options.write_thread_slow_yield_usec: 3
2017-12-14 00:10:55.224999 I | mkfs-osd3: 2017-12-14 00:10:55.224262 7fd9e8779e00 4 rocksdb: Options.row_cache: None
2017-12-14 00:10:55.225038 I | mkfs-osd3: 2017-12-14 00:10:55.224273 7fd9e8779e00 4 rocksdb: Options.wal_filter: None
2017-12-14 00:10:55.225073 I | mkfs-osd3: 2017-12-14 00:10:55.224277 7fd9e8779e00 4 rocksdb: Options.avoid_flush_during_recovery: 0
2017-12-14 00:10:55.225096 I | mkfs-osd3: 2017-12-14 00:10:55.224279 7fd9e8779e00 4 rocksdb: Options.base_background_compactions: 1
2017-12-14 00:10:55.225117 I | mkfs-osd3: 2017-12-14 00:10:55.224282 7fd9e8779e00 4 rocksdb: Options.max_background_compactions: 1
2017-12-14 00:10:55.225138 I | mkfs-osd3: 2017-12-14 00:10:55.224284 7fd9e8779e00 4 rocksdb: Options.avoid_flush_during_shutdown: 0
2017-12-14 00:10:55.225173 I | mkfs-osd3: 2017-12-14 00:10:55.224287 7fd9e8779e00 4 rocksdb: Options.delayed_write_rate : 16777216
2017-12-14 00:10:55.225212 I | mkfs-osd3: 2017-12-14 00:10:55.224289 7fd9e8779e00 4 rocksdb: Options.max_total_wal_size: 0
2017-12-14 00:10:55.225247 I | mkfs-osd3: 2017-12-14 00:10:55.224292 7fd9e8779e00 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
2017-12-14 00:10:55.225270 I | mkfs-osd3: 2017-12-14 00:10:55.224295 7fd9e8779e00 4 rocksdb: Options.stats_dump_period_sec: 600
2017-12-14 00:10:55.225291 I | mkfs-osd3: 2017-12-14 00:10:55.224297 7fd9e8779e00 4 rocksdb: Compression algorithms supported:
2017-12-14 00:10:55.225342 I | mkfs-osd3: 2017-12-14 00:10:55.224300 7fd9e8779e00 4 rocksdb: Snappy supported: 0
2017-12-14 00:10:55.225391 I | mkfs-osd3: 2017-12-14 00:10:55.224303 7fd9e8779e00 4 rocksdb: Zlib supported: 0
2017-12-14 00:10:55.225428 I | mkfs-osd3: 2017-12-14 00:10:55.224305 7fd9e8779e00 4 rocksdb: Bzip supported: 0
2017-12-14 00:10:55.225463 I | mkfs-osd3: 2017-12-14 00:10:55.224308 7fd9e8779e00 4 rocksdb: LZ4 supported: 0
2017-12-14 00:10:55.225536 I | mkfs-osd3: 2017-12-14 00:10:55.224310 7fd9e8779e00 4 rocksdb: ZSTD supported: 0
2017-12-14 00:10:55.225590 I | mkfs-osd3: 2017-12-14 00:10:55.224313 7fd9e8779e00 4 rocksdb: Fast CRC32 supported: 0
2017-12-14 00:10:55.225685 I | mkfs-osd3: 2017-12-14 00:10:55.225059 7fd9e8779e00 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2609] Recovering from manifest file: MANIFEST-000001
2017-12-14 00:10:55.225742 I | mkfs-osd3:
2017-12-14 00:10:55.225770 I | mkfs-osd3: 2017-12-14 00:10:55.225574 7fd9e8779e00 4 rocksdb: [/build/ceph/src/rocksdb/db/column_family.cc:407] --------------- Options for column family [default]:
2017-12-14 00:10:55.225792 I | mkfs-osd3:
2017-12-14 00:10:55.225970 I | mkfs-osd3: 2017-12-14 00:10:55.225710 7fd9e8779e00 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
2017-12-14 00:10:55.226984 I | mkfs-osd3: 2017-12-14 00:10:55.225904 7fd9e8779e00 4 rocksdb: Options.merge_operator: .T:int64_array.b:bitwise_xor
2017-12-14 00:10:55.227046 I | mkfs-osd3: 2017-12-14 00:10:55.226586 7fd9e8779e00 4 rocksdb: Options.compaction_filter: None
2017-12-14 00:10:55.227074 I | mkfs-osd3: 2017-12-14 00:10:55.226597 7fd9e8779e00 4 rocksdb: Options.compaction_filter_factory: None
2017-12-14 00:10:55.227094 I | mkfs-osd3: 2017-12-14 00:10:55.226600 7fd9e8779e00 4 rocksdb: Options.memtable_factory: SkipListFactory
2017-12-14 00:10:55.227114 I | mkfs-osd3: 2017-12-14 00:10:55.226603 7fd9e8779e00 4 rocksdb: Options.table_factory: BlockBasedTable
2017-12-14 00:10:55.227140 I | mkfs-osd3: 2017-12-14 00:10:55.226675 7fd9e8779e00 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55906e7021e0)
2017-12-14 00:10:55.227200 I | mkfs-osd3: cache_index_and_filter_blocks: 1
2017-12-14 00:10:55.227251 I | mkfs-osd3: cache_index_and_filter_blocks_with_high_priority: 1
2017-12-14 00:10:55.227278 I | mkfs-osd3: pin_l0_filter_and_index_blocks_in_cache: 1
2017-12-14 00:10:55.227337 I | mkfs-osd3: index_type: 0
2017-12-14 00:10:55.227399 I | mkfs-osd3: hash_index_allow_collision: 1
2017-12-14 00:10:55.227438 I | mkfs-osd3: checksum: 1
2017-12-14 00:10:55.227462 I | mkfs-osd3: no_block_cache: 0
2017-12-14 00:10:55.227527 I | mkfs-osd3: block_cache: 0x55906e9e7260
2017-12-14 00:10:55.227552 I | mkfs-osd3: block_cache_name: LRUCache
2017-12-14 00:10:55.227572 I | mkfs-osd3: block_cache_options:
2017-12-14 00:10:55.229008 I | mkfs-osd3: capacity : 536870912
2017-12-14 00:10:55.229175 I | mkfs-osd3: num_shard_bits : 4
2017-12-14 00:10:55.229426 I | mkfs-osd3: strict_capacity_limit : 0
2017-12-14 00:10:55.229828 I | mkfs-osd3: high_pri_pool_ratio: 0.000
2017-12-14 00:10:55.229867 I | mkfs-osd3: block_cache_compressed: (nil)
2017-12-14 00:10:55.229921 I | mkfs-osd3: persistent_cache: (nil)
2017-12-14 00:10:55.229974 I | mkfs-osd3: block_size: 4096
2017-12-14 00:10:55.230009 I | mkfs-osd3: block_size_deviation: 10
2017-12-14 00:10:55.230059 I | mkfs-osd3: block_restart_interval: 16
2017-12-14 00:10:55.230098 I | mkfs-osd3: index_block_restart_interval: 1
2017-12-14 00:10:55.230144 I | mkfs-osd3: filter_policy: rocksdb.BuiltinBloomFilter
2017-12-14 00:10:55.230208 I | mkfs-osd3: whole_key_filtering: 1
2017-12-14 00:10:55.230261 I | mkfs-osd3: format_version: 2
2017-12-14 00:10:55.230296 I | mkfs-osd3:
2017-12-14 00:10:55.230416 I | mkfs-osd3: 2017-12-14 00:10:55.226686 7fd9e8779e00 4 rocksdb: Options.write_buffer_size: 268435456
2017-12-14 00:10:55.230453 I | mkfs-osd3: 2017-12-14 00:10:55.226691 7fd9e8779e00 4 rocksdb: Options.max_write_buffer_number: 4
2017-12-14 00:10:55.230545 I | mkfs-osd3: 2017-12-14 00:10:55.226695 7fd9e8779e00 4 rocksdb: Options.compression: NoCompression
2017-12-14 00:10:55.230722 I | mkfs-osd3: 2017-12-14 00:10:55.226698 7fd9e8779e00 4 rocksdb: Options.bottommost_compression: Disabled
2017-12-14 00:10:55.230772 I | mkfs-osd3: 2017-12-14 00:10:55.226701 7fd9e8779e00 4 rocksdb: Options.prefix_extractor: nullptr
2017-12-14 00:10:55.230826 I | mkfs-osd3: 2017-12-14 00:10:55.226704 7fd9e8779e00 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
2017-12-14 00:10:55.231010 I | mkfs-osd3: 2017-12-14 00:10:55.226707 7fd9e8779e00 4 rocksdb: Options.num_levels: 7
2017-12-14 00:10:55.231076 I | mkfs-osd3: 2017-12-14 00:10:55.226711 7fd9e8779e00 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
2017-12-14 00:10:55.231113 I | mkfs-osd3: 2017-12-14 00:10:55.226714 7fd9e8779e00 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
2017-12-14 00:10:55.231181 I | mkfs-osd3: 2017-12-14 00:10:55.226716 7fd9e8779e00 4 rocksdb: Options.compression_opts.window_bits: -14
2017-12-14 00:10:55.231235 I | mkfs-osd3: 2017-12-14 00:10:55.226719 7fd9e8779e00 4 rocksdb: Options.compression_opts.level: -1
2017-12-14 00:10:55.231270 I | mkfs-osd3: 2017-12-14 00:10:55.226727 7fd9e8779e00 4 rocksdb: Options.compression_opts.strategy: 0
2017-12-14 00:10:55.231410 I | mkfs-osd3: 2017-12-14 00:10:55.226730 7fd9e8779e00 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
2017-12-14 00:10:55.231502 I | mkfs-osd3: 2017-12-14 00:10:55.226733 7fd9e8779e00 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
2017-12-14 00:10:55.231560 I | mkfs-osd3: 2017-12-14 00:10:55.226736 7fd9e8779e00 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
2017-12-14 00:10:55.231725 I | mkfs-osd3: 2017-12-14 00:10:55.226738 7fd9e8779e00 4 rocksdb: Options.level0_stop_writes_trigger: 36
2017-12-14 00:10:55.231773 I | mkfs-osd3: 2017-12-14 00:10:55.226741 7fd9e8779e00 4 rocksdb: Options.target_file_size_base: 67108864
2017-12-14 00:10:55.231825 I | mkfs-osd3: 2017-12-14 00:10:55.226744 7fd9e8779e00 4 rocksdb: Options.target_file_size_multiplier: 1
2017-12-14 00:10:55.231976 I | mkfs-osd3: 2017-12-14 00:10:55.226747 7fd9e8779e00 4 rocksdb: Options.max_bytes_for_level_base: 268435456
2017-12-14 00:10:55.232041 I | mkfs-osd3: 2017-12-14 00:10:55.226750 7fd9e8779e00 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
2017-12-14 00:10:55.232078 I | mkfs-osd3: 2017-12-14 00:10:55.226753 7fd9e8779e00 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
2017-12-14 00:10:55.232110 I | mkfs-osd3: 2017-12-14 00:10:55.226759 7fd9e8779e00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
2017-12-14 00:10:55.232232 I | mkfs-osd3: 2017-12-14 00:10:55.226762 7fd9e8779e00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
2017-12-14 00:10:55.232291 I | mkfs-osd3: 2017-12-14 00:10:55.226765 7fd9e8779e00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
2017-12-14 00:10:55.232500 I | mkfs-osd3: 2017-12-14 00:10:55.226768 7fd9e8779e00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
2017-12-14 00:10:55.232543 I | mkfs-osd3: 2017-12-14 00:10:55.226770 7fd9e8779e00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
2017-12-14 00:10:55.232737 I | mkfs-osd3: 2017-12-14 00:10:55.226773 7fd9e8779e00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
2017-12-14 00:10:55.232777 I | mkfs-osd3: 2017-12-14 00:10:55.226776 7fd9e8779e00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
2017-12-14 00:10:55.232841 I | mkfs-osd3: 2017-12-14 00:10:55.226779 7fd9e8779e00 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
2017-12-14 00:10:55.233043 I | mkfs-osd3: 2017-12-14 00:10:55.226782 7fd9e8779e00 4 rocksdb: Options.max_compaction_bytes: 1677721600
2017-12-14 00:10:55.233080 I | mkfs-osd3: 2017-12-14 00:10:55.226784 7fd9e8779e00 4 rocksdb: Options.arena_block_size: 33554432
2017-12-14 00:10:55.233262 I | mkfs-osd3: 2017-12-14 00:10:55.226787 7fd9e8779e00 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
2017-12-14 00:10:55.233327 I | mkfs-osd3: 2017-12-14 00:10:55.226790 7fd9e8779e00 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
2017-12-14 00:10:55.233382 I | mkfs-osd3: 2017-12-14 00:10:55.226792 7fd9e8779e00 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
2017-12-14 00:10:55.233648 I | mkfs-osd3: 2017-12-14 00:10:55.226795 7fd9e8779e00 4 rocksdb: Options.disable_auto_compactions: 0
2017-12-14 00:10:55.233883 I | mkfs-osd3: 2017-12-14 00:10:55.226799 7fd9e8779e00 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
2017-12-14 00:10:55.234432 I | mkfs-osd3: 2017-12-14 00:10:55.226807 7fd9e8779e00 4 rocksdb: Options.compaction_pri: kByCompensatedSize
2017-12-14 00:10:55.234624 I | mkfs-osd3: 2017-12-14 00:10:55.226810 7fd9e8779e00 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
2017-12-14 00:10:55.234857 I | mkfs-osd3: 2017-12-14 00:10:55.226814 7fd9e8779e00 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
2017-12-14 00:10:55.235158 I | mkfs-osd3: 2017-12-14 00:10:55.226817 7fd9e8779e00 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
2017-12-14 00:10:55.235391 I | mkfs-osd3: 2017-12-14 00:10:55.226820 7fd9e8779e00 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
2017-12-14 00:10:55.235558 I | mkfs-osd3: 2017-12-14 00:10:55.226822 7fd9e8779e00 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
2017-12-14 00:10:55.235759 I | mkfs-osd3: 2017-12-14 00:10:55.226825 7fd9e8779e00 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
2017-12-14 00:10:55.235827 I | mkfs-osd3: 2017-12-14 00:10:55.226828 7fd9e8779e00 4 rocksdb: Options.table_properties_collectors:
2017-12-14 00:10:55.235854 I | mkfs-osd3: 2017-12-14 00:10:55.226831 7fd9e8779e00 4 rocksdb: Options.inplace_update_support: 0
2017-12-14 00:10:55.235880 I | mkfs-osd3: 2017-12-14 00:10:55.226832 7fd9e8779e00 4 rocksdb: Options.inplace_update_num_locks: 10000
2017-12-14 00:10:55.235939 I | mkfs-osd3: 2017-12-14 00:10:55.226834 7fd9e8779e00 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
2017-12-14 00:10:55.235981 I | mkfs-osd3: 2017-12-14 00:10:55.226837 7fd9e8779e00 4 rocksdb: Options.memtable_huge_page_size: 0
2017-12-14 00:10:55.236021 I | mkfs-osd3: 2017-12-14 00:10:55.226838 7fd9e8779e00 4 rocksdb: Options.bloom_locality: 0
2017-12-14 00:10:55.236088 I | mkfs-osd3: 2017-12-14 00:10:55.226840 7fd9e8779e00 4 rocksdb: Options.max_successive_merges: 0
2017-12-14 00:10:55.236160 I | mkfs-osd3: 2017-12-14 00:10:55.226841 7fd9e8779e00 4 rocksdb: Options.optimize_filters_for_hits: 0
2017-12-14 00:10:55.236209 I | mkfs-osd3: 2017-12-14 00:10:55.226842 7fd9e8779e00 4 rocksdb: Options.paranoid_file_checks: 0
2017-12-14 00:10:55.236265 I | mkfs-osd3: 2017-12-14 00:10:55.226844 7fd9e8779e00 4 rocksdb: Options.force_consistency_checks: 0
2017-12-14 00:10:55.236300 I | mkfs-osd3: 2017-12-14 00:10:55.226845 7fd9e8779e00 4 rocksdb: Options.report_bg_io_stats: 0
2017-12-14 00:10:55.236395 I | mkfs-osd3: 2017-12-14 00:10:55.233915 7fd9e8779e00 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2859] Recovered from manifest file:db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0
2017-12-14 00:10:55.236464 I | mkfs-osd3:
2017-12-14 00:10:55.236531 I | mkfs-osd3: 2017-12-14 00:10:55.234011 7fd9e8779e00 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2867] Column family [default] (ID 0), log number is 0
2017-12-14 00:10:55.236571 I | mkfs-osd3:
2017-12-14 00:10:55.236596 I | mkfs-osd3: 2017-12-14 00:10:55.234279 7fd9e8779e00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1513210255234266, "job": 1, "event": "recovery_started", "log_files": [3]}
2017-12-14 00:10:55.236650 I | mkfs-osd3: 2017-12-14 00:10:55.234290 7fd9e8779e00 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:482] Recovering log #3 mode 0
2017-12-14 00:10:55.241347 I | mkfs-osd3: 2017-12-14 00:10:55.241173 7fd9e8779e00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1513210255241161, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1455, "table_properties": {"data_size": 418, "index_size": 28, "filter_size": 43, "raw_key_size": 280, "raw_average_key_size": 21, "raw_value_size": 122, "raw_average_value_size": 9, "num_data_blocks": 1, "num_entries": 13, "filter_policy_name": "rocksdb.BuiltinBloomFilter", "kDeletedKeys": "0", "kMergeOperands": "2"}}
2017-12-14 00:10:55.241408 I | mkfs-osd3: 2017-12-14 00:10:55.241259 7fd9e8779e00 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2395] Creating manifest 5
2017-12-14 00:10:55.241427 I | mkfs-osd3:
2017-12-14 00:10:55.249532 I | mkfs-osd3: 2017-12-14 00:10:55.248993 7fd9e8779e00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1513210255248982, "job": 1, "event": "recovery_finished"}
2017-12-14 00:10:55.256468 I | mkfs-osd3: 2017-12-14 00:10:55.255995 7fd9e8779e00 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:1063] DB pointer 0x55906eb0e000
2017-12-14 00:10:55.260592 I | mkfs-osd3: 2017-12-14 00:10:55.260240 7fd9e8779e00 1 bluefs fsck
2017-12-14 00:10:55.320460 I | mkfs-osd3: 2017-12-14 00:10:55.320140 7fd9e8779e00 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:217] Shutdown: canceling all background work
2017-12-14 00:10:55.320546 I | mkfs-osd3: 2017-12-14 00:10:55.320398 7fd9e8779e00 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:343] Shutdown complete
2017-12-14 00:10:55.320825 I | mkfs-osd3: 2017-12-14 00:10:55.320540 7fd9e8779e00 1 bluefs umount
2017-12-14 00:10:55.322125 I | mkfs-osd3: 2017-12-14 00:10:55.321950 7fd9e8779e00 1 bdev(0x55906e707440 /data/rook-data/osd3/bluestore-wal) close
2017-12-14 00:10:55.593643 I | mkfs-osd3: 2017-12-14 00:10:55.591753 7fd9e8779e00 1 bdev(0x55906e7078c0 /data/rook-data/osd3/bluestore-db) close
2017-12-14 00:10:55.769926 I | mkfs-osd3: 2017-12-14 00:10:55.769602 7fd9e8779e00 1 bdev(0x55906e707680 /data/rook-data/osd3/block) close
2017-12-14 00:10:55.992917 I | mkfs-osd3: 2017-12-14 00:10:55.992625 7fd9e8779e00 1 bdev(0x55906e707b00 /data/rook-data/osd3/block) close
2017-12-14 00:10:56.272937 I | mkfs-osd3: 2017-12-14 00:10:56.272675 7fd9e8779e00 0 bluestore(/data/rook-data/osd3) mkfs success
2017-12-14 00:10:56.273026 I | mkfs-osd3: 2017-12-14 00:10:56.272829 7fd9e8779e00 1 bdev create path /data/rook-data/osd3/block type kernel
2017-12-14 00:10:56.273322 I | mkfs-osd3: 2017-12-14 00:10:56.272858 7fd9e8779e00 1 bdev(0x55906e707b00 /data/rook-data/osd3/block) open path /data/rook-data/osd3/block
2017-12-14 00:10:56.274964 I | mkfs-osd3: 2017-12-14 00:10:56.274795 7fd9e8779e00 -1 bdev(0x55906e707b00 /data/rook-data/osd3/block) unable to get device name for /data/rook-data/osd3/block: (22) Invalid argument
2017-12-14 00:10:56.275398 I | mkfs-osd3: 2017-12-14 00:10:56.275222 7fd9e8779e00 1 bdev(0x55906e707b00 /data/rook-data/osd3/block) open size 205583683584 (0x2fddbe1000, 191 GB) block_size 4096 (4096 B) rotational
2017-12-14 00:10:56.275673 I | mkfs-osd3: 2017-12-14 00:10:56.275433 7fd9e8779e00 1 bdev create path /data/rook-data/osd3/bluestore-db type kernel
2017-12-14 00:10:56.275818 I | mkfs-osd3: 2017-12-14 00:10:56.275467 7fd9e8779e00 1 bdev(0x55906e707680 /data/rook-data/osd3/bluestore-db) open path /data/rook-data/osd3/bluestore-db
2017-12-14 00:10:56.277450 I | mkfs-osd3: 2017-12-14 00:10:56.277217 7fd9e8779e00 -1 bdev(0x55906e707680 /data/rook-data/osd3/bluestore-db) unable to get device name for /data/rook-data/osd3/bluestore-db: (22) Invalid argument
2017-12-14 00:10:56.277691 I | mkfs-osd3: 2017-12-14 00:10:56.277527 7fd9e8779e00 1 bdev(0x55906e707680 /data/rook-data/osd3/bluestore-db) open size 1073741824 (0x40000000, 1024 MB) block_size 4096 (4096 B) rotational
2017-12-14 00:10:56.277853 I | mkfs-osd3: 2017-12-14 00:10:56.277575 7fd9e8779e00 1 bluefs add_block_device bdev 1 path /data/rook-data/osd3/bluestore-db size 1024 MB
2017-12-14 00:10:56.278088 I | mkfs-osd3: 2017-12-14 00:10:56.277867 7fd9e8779e00 1 bdev create path /data/rook-data/osd3/block type kernel
2017-12-14 00:10:56.278196 I | mkfs-osd3: 2017-12-14 00:10:56.277884 7fd9e8779e00 1 bdev(0x55906e7078c0 /data/rook-data/osd3/block) open path /data/rook-data/osd3/block
2017-12-14 00:10:56.280130 I | mkfs-osd3: 2017-12-14 00:10:56.279923 7fd9e8779e00 -1 bdev(0x55906e7078c0 /data/rook-data/osd3/block) unable to get device name for /data/rook-data/osd3/block: (22) Invalid argument
2017-12-14 00:10:56.280400 I | mkfs-osd3: 2017-12-14 00:10:56.280136 7fd9e8779e00 1 bdev(0x55906e7078c0 /data/rook-data/osd3/block) open size 205583683584 (0x2fddbe1000, 191 GB) block_size 4096 (4096 B) rotational
2017-12-14 00:10:56.280433 I | mkfs-osd3: 2017-12-14 00:10:56.280152 7fd9e8779e00 1 bluefs add_block_device bdev 2 path /data/rook-data/osd3/block size 191 GB
2017-12-14 00:10:56.280662 I | mkfs-osd3: 2017-12-14 00:10:56.280387 7fd9e8779e00 1 bdev create path /data/rook-data/osd3/bluestore-wal type kernel
2017-12-14 00:10:56.280705 I | mkfs-osd3: 2017-12-14 00:10:56.280423 7fd9e8779e00 1 bdev(0x55906e707440 /data/rook-data/osd3/bluestore-wal) open path /data/rook-data/osd3/bluestore-wal
2017-12-14 00:10:56.282400 I | mkfs-osd3: 2017-12-14 00:10:56.282227 7fd9e8779e00 -1 bdev(0x55906e707440 /data/rook-data/osd3/bluestore-wal) unable to get device name for /data/rook-data/osd3/bluestore-wal: (22) Invalid argument
2017-12-14 00:10:56.282689 I | mkfs-osd3: 2017-12-14 00:10:56.282466 7fd9e8779e00 1 bdev(0x55906e707440 /data/rook-data/osd3/bluestore-wal) open size 603979776 (0x24000000, 576 MB) block_size 4096 (4096 B) rotational
2017-12-14 00:10:56.282733 I | mkfs-osd3: 2017-12-14 00:10:56.282538 7fd9e8779e00 1 bluefs add_block_device bdev 0 path /data/rook-data/osd3/bluestore-wal size 576 MB
2017-12-14 00:10:56.282749 I | mkfs-osd3: 2017-12-14 00:10:56.282645 7fd9e8779e00 1 bluefs mount
2017-12-14 00:10:56.286678 I | mkfs-osd3: 2017-12-14 00:10:56.286400 7fd9e8779e00 0 set rocksdb option compaction_readahead_size = 2097152
2017-12-14 00:10:56.286723 I | mkfs-osd3: 2017-12-14 00:10:56.286439 7fd9e8779e00 0 set rocksdb option compression = kNoCompression
2017-12-14 00:10:56.286741 I | mkfs-osd3: 2017-12-14 00:10:56.286446 7fd9e8779e00 0 set rocksdb option max_write_buffer_number = 4
2017-12-14 00:10:56.286752 I | mkfs-osd3: 2017-12-14 00:10:56.286451 7fd9e8779e00 0 set rocksdb option min_write_buffer_number_to_merge = 1
2017-12-14 00:10:56.286774 I | mkfs-osd3: 2017-12-14 00:10:56.286456 7fd9e8779e00 0 set rocksdb option recycle_log_file_num = 4
2017-12-14 00:10:56.286790 I | mkfs-osd3: 2017-12-14 00:10:56.286532 7fd9e8779e00 0 set rocksdb option writable_file_max_buffer_size = 0
2017-12-14 00:10:56.286826 I | mkfs-osd3: 2017-12-14 00:10:56.286541 7fd9e8779e00 0 set rocksdb option write_buffer_size = 268435456
2017-12-14 00:10:56.286838 I | mkfs-osd3: 2017-12-14 00:10:56.286567 7fd9e8779e00 0 set rocksdb option compaction_readahead_size = 2097152
2017-12-14 00:10:56.286935 I | mkfs-osd3: 2017-12-14 00:10:56.286629 7fd9e8779e00 0 set rocksdb option compression = kNoCompression
2017-12-14 00:10:56.286954 I | mkfs-osd3: 2017-12-14 00:10:56.286638 7fd9e8779e00 0 set rocksdb option max_write_buffer_number = 4
2017-12-14 00:10:56.286965 I | mkfs-osd3: 2017-12-14 00:10:56.286642 7fd9e8779e00 0 set rocksdb option min_write_buffer_number_to_merge = 1
2017-12-14 00:10:56.286986 I | mkfs-osd3: 2017-12-14 00:10:56.286647 7fd9e8779e00 0 set rocksdb option recycle_log_file_num = 4
2017-12-14 00:10:56.287021 I | mkfs-osd3: 2017-12-14 00:10:56.286650 7fd9e8779e00 0 set rocksdb option writable_file_max_buffer_size = 0
2017-12-14 00:10:56.287033 I | mkfs-osd3: 2017-12-14 00:10:56.286654 7fd9e8779e00 0 set rocksdb option write_buffer_size = 268435456
2017-12-14 00:10:56.287046 I | mkfs-osd3: 2017-12-14 00:10:56.286787 7fd9e8779e00 4 rocksdb: RocksDB version: 5.4.0
2017-12-14 00:10:56.287070 I | mkfs-osd3:
2017-12-14 00:10:56.287081 I | mkfs-osd3: 2017-12-14 00:10:56.286809 7fd9e8779e00 4 rocksdb: Git sha rocksdb_build_git_sha:@bac0af364a2c742ea9bb63199ddeee0edacdb2ac@
2017-12-14 00:10:56.287091 I | mkfs-osd3: 2017-12-14 00:10:56.286812 7fd9e8779e00 4 rocksdb: Compile date Dec 2 2017
2017-12-14 00:10:56.287101 I | mkfs-osd3: 2017-12-14 00:10:56.286814 7fd9e8779e00 4 rocksdb: DB SUMMARY
2017-12-14 00:10:56.287111 I | mkfs-osd3:
2017-12-14 00:10:56.287121 I | mkfs-osd3: 2017-12-14 00:10:56.286825 7fd9e8779e00 4 rocksdb: CURRENT file: CURRENT
2017-12-14 00:10:56.287132 I | mkfs-osd3:
2017-12-14 00:10:56.287142 I | mkfs-osd3: 2017-12-14 00:10:56.286827 7fd9e8779e00 4 rocksdb: IDENTITY file: IDENTITY
2017-12-14 00:10:56.287152 I | mkfs-osd3:
2017-12-14 00:10:56.287163 I | mkfs-osd3: 2017-12-14 00:10:56.286831 7fd9e8779e00 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 102 Bytes
2017-12-14 00:10:56.287203 I | mkfs-osd3:
2017-12-14 00:10:56.287217 I | mkfs-osd3: 2017-12-14 00:10:56.286834 7fd9e8779e00 4 rocksdb: SST files in db dir, Total Num: 1, files: 000004.sst
2017-12-14 00:10:56.287226 I | mkfs-osd3:
2017-12-14 00:10:56.287243 I | mkfs-osd3: 2017-12-14 00:10:56.286838 7fd9e8779e00 4 rocksdb: SST files in db.slow dir, Total Num: 0, files:
2017-12-14 00:10:56.287254 I | mkfs-osd3:
2017-12-14 00:10:56.287293 I | mkfs-osd3: 2017-12-14 00:10:56.286843 7fd9e8779e00 4 rocksdb: Write Ahead Log file in db.wal: 000006.log size: 0 ;
2017-12-14 00:10:56.287376 I | mkfs-osd3:
2017-12-14 00:10:56.287422 I | mkfs-osd3: 2017-12-14 00:10:56.286845 7fd9e8779e00 4 rocksdb: Options.error_if_exists: 0
2017-12-14 00:10:56.287438 I | mkfs-osd3: 2017-12-14 00:10:56.286847 7fd9e8779e00 4 rocksdb: Options.create_if_missing: 0
2017-12-14 00:10:56.287448 I | mkfs-osd3: 2017-12-14 00:10:56.286848 7fd9e8779e00 4 rocksdb: Options.paranoid_checks: 1
2017-12-14 00:10:56.287471 I | mkfs-osd3: 2017-12-14 00:10:56.286850 7fd9e8779e00 4 rocksdb: Options.env: 0x55906e9f5b80
2017-12-14 00:10:56.287575 I | mkfs-osd3: 2017-12-14 00:10:56.286852 7fd9e8779e00 4 rocksdb: Options.info_log: 0x55906e9f5f60
2017-12-14 00:10:56.287708 I | mkfs-osd3: 2017-12-14 00:10:56.286853 7fd9e8779e00 4 rocksdb: Options.max_open_files: -1
2017-12-14 00:10:56.287732 I | mkfs-osd3: 2017-12-14 00:10:56.286854 7fd9e8779e00 4 rocksdb: Options.max_file_opening_threads: 16
2017-12-14 00:10:56.287746 I | mkfs-osd3: 2017-12-14 00:10:56.286855 7fd9e8779e00 4 rocksdb: Options.use_fsync: 0
2017-12-14 00:10:56.287756 I | mkfs-osd3: 2017-12-14 00:10:56.286857 7fd9e8779e00 4 rocksdb: Options.max_log_file_size: 0
2017-12-14 00:10:56.287766 I | mkfs-osd3: 2017-12-14 00:10:56.286859 7fd9e8779e00 4 rocksdb: Options.max_manifest_file_size: 18446744073709551615
2017-12-14 00:10:56.287793 I | mkfs-osd3: 2017-12-14 00:10:56.286860 7fd9e8779e00 4 rocksdb: Options.log_file_time_to_roll: 0
2017-12-14 00:10:56.287835 I | mkfs-osd3: 2017-12-14 00:10:56.286862 7fd9e8779e00 4 rocksdb: Options.keep_log_file_num: 1000
2017-12-14 00:10:56.287851 I | mkfs-osd3: 2017-12-14 00:10:56.286863 7fd9e8779e00 4 rocksdb: Options.recycle_log_file_num: 4
2017-12-14 00:10:56.287996 I | mkfs-osd3: 2017-12-14 00:10:56.286864 7fd9e8779e00 4 rocksdb: Options.allow_fallocate: 1
2017-12-14 00:10:56.288037 I | mkfs-osd3: 2017-12-14 00:10:56.286866 7fd9e8779e00 4 rocksdb: Options.allow_mmap_reads: 0
2017-12-14 00:10:56.288050 I | mkfs-osd3: 2017-12-14 00:10:56.286875 7fd9e8779e00 4 rocksdb: Options.allow_mmap_writes: 0
2017-12-14 00:10:56.288062 I | mkfs-osd3: 2017-12-14 00:10:56.286878 7fd9e8779e00 4 rocksdb: Options.use_direct_reads: 0
2017-12-14 00:10:56.288119 I | mkfs-osd3: 2017-12-14 00:10:56.286879 7fd9e8779e00 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0
2017-12-14 00:10:56.288134 I | mkfs-osd3: 2017-12-14 00:10:56.286880 7fd9e8779e00 4 rocksdb: Options.create_missing_column_families: 0
2017-12-14 00:10:56.288144 I | mkfs-osd3: 2017-12-14 00:10:56.286882 7fd9e8779e00 4 rocksdb: Options.db_log_dir:
2017-12-14 00:10:56.288154 I | mkfs-osd3: 2017-12-14 00:10:56.286883 7fd9e8779e00 4 rocksdb: Options.wal_dir: db.wal
2017-12-14 00:10:56.288164 I | mkfs-osd3: 2017-12-14 00:10:56.286884 7fd9e8779e00 4 rocksdb: Options.table_cache_numshardbits: 6
2017-12-14 00:10:56.288198 I | mkfs-osd3: 2017-12-14 00:10:56.286885 7fd9e8779e00 4 rocksdb: Options.max_subcompactions: 1
2017-12-14 00:10:56.288213 I | mkfs-osd3: 2017-12-14 00:10:56.286886 7fd9e8779e00 4 rocksdb: Options.max_background_flushes: 1
2017-12-14 00:10:56.288232 I | mkfs-osd3: 2017-12-14 00:10:56.286888 7fd9e8779e00 4 rocksdb: Options.WAL_ttl_seconds: 0
2017-12-14 00:10:56.288252 I | mkfs-osd3: 2017-12-14 00:10:56.286889 7fd9e8779e00 4 rocksdb: Options.WAL_size_limit_MB: 0
2017-12-14 00:10:56.288274 I | mkfs-osd3: 2017-12-14 00:10:56.286891 7fd9e8779e00 4 rocksdb: Options.manifest_preallocation_size: 4194304
2017-12-14 00:10:56.288389 I | mkfs-osd3: 2017-12-14 00:10:56.286892 7fd9e8779e00 4 rocksdb: Options.is_fd_close_on_exec: 1
2017-12-14 00:10:56.288423 I | mkfs-osd3: 2017-12-14 00:10:56.286894 7fd9e8779e00 4 rocksdb: Options.advise_random_on_open: 1
2017-12-14 00:10:56.288435 I | mkfs-osd3: 2017-12-14 00:10:56.286895 7fd9e8779e00 4 rocksdb: Options.db_write_buffer_size: 0
2017-12-14 00:10:56.288445 I | mkfs-osd3: 2017-12-14 00:10:56.286900 7fd9e8779e00 4 rocksdb: Options.access_hint_on_compaction_start: 1
2017-12-14 00:10:56.288455 I | mkfs-osd3: 2017-12-14 00:10:56.286901 7fd9e8779e00 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 1
2017-12-14 00:10:56.288473 I | mkfs-osd3: 2017-12-14 00:10:56.286902 7fd9e8779e00 4 rocksdb: Options.compaction_readahead_size: 2097152
2017-12-14 00:10:56.288554 I | mkfs-osd3: 2017-12-14 00:10:56.286911 7fd9e8779e00 4 rocksdb: Options.random_access_max_buffer_size: 1048576
2017-12-14 00:10:56.288567 I | mkfs-osd3: 2017-12-14 00:10:56.286914 7fd9e8779e00 4 rocksdb: Options.writable_file_max_buffer_size: 0
2017-12-14 00:10:56.288577 I | mkfs-osd3: 2017-12-14 00:10:56.286916 7fd9e8779e00 4 rocksdb: Options.use_adaptive_mutex: 0
2017-12-14 00:10:56.288679 I | mkfs-osd3: 2017-12-14 00:10:56.286917 7fd9e8779e00 4 rocksdb: Options.rate_limiter: (nil)
2017-12-14 00:10:56.288696 I | mkfs-osd3: 2017-12-14 00:10:56.286919 7fd9e8779e00 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0
2017-12-14 00:10:56.288705 I | mkfs-osd3: 2017-12-14 00:10:56.286920 7fd9e8779e00 4 rocksdb: Options.bytes_per_sync: 0
2017-12-14 00:10:56.288729 I | mkfs-osd3: 2017-12-14 00:10:56.286921 7fd9e8779e00 4 rocksdb: Options.wal_bytes_per_sync: 0
2017-12-14 00:10:56.288775 I | mkfs-osd3: 2017-12-14 00:10:56.286923 7fd9e8779e00 4 rocksdb: Options.wal_recovery_mode: 0
2017-12-14 00:10:56.288801 I | mkfs-osd3: 2017-12-14 00:10:56.286924 7fd9e8779e00 4 rocksdb: Options.enable_thread_tracking: 0
2017-12-14 00:10:56.288819 I | mkfs-osd3: 2017-12-14 00:10:56.286925 7fd9e8779e00 4 rocksdb: Options.allow_concurrent_memtable_write: 1
2017-12-14 00:10:56.288831 I | mkfs-osd3: 2017-12-14 00:10:56.286926 7fd9e8779e00 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1
2017-12-14 00:10:56.288864 I | mkfs-osd3: 2017-12-14 00:10:56.286927 7fd9e8779e00 4 rocksdb: Options.write_thread_max_yield_usec: 100
2017-12-14 00:10:56.288944 I | mkfs-osd3: 2017-12-14 00:10:56.286928 7fd9e8779e00 4 rocksdb: Options.write_thread_slow_yield_usec: 3
2017-12-14 00:10:56.288958 I | mkfs-osd3: 2017-12-14 00:10:56.286929 7fd9e8779e00 4 rocksdb: Options.row_cache: None
2017-12-14 00:10:56.288968 I | mkfs-osd3: 2017-12-14 00:10:56.286934 7fd9e8779e00 4 rocksdb: Options.wal_filter: None
2017-12-14 00:10:56.288979 I | mkfs-osd3: 2017-12-14 00:10:56.286935 7fd9e8779e00 4 rocksdb: Options.avoid_flush_during_recovery: 0
2017-12-14 00:10:56.289005 I | mkfs-osd3: 2017-12-14 00:10:56.286937 7fd9e8779e00 4 rocksdb: Options.base_background_compactions: 1
2017-12-14 00:10:56.289049 I | mkfs-osd3: 2017-12-14 00:10:56.286938 7fd9e8779e00 4 rocksdb: Options.max_background_compactions: 1
2017-12-14 00:10:56.289064 I | mkfs-osd3: 2017-12-14 00:10:56.286939 7fd9e8779e00 4 rocksdb: Options.avoid_flush_during_shutdown: 0
2017-12-14 00:10:56.289074 I | mkfs-osd3: 2017-12-14 00:10:56.286940 7fd9e8779e00 4 rocksdb: Options.delayed_write_rate : 16777216
2017-12-14 00:10:56.289093 I | mkfs-osd3: 2017-12-14 00:10:56.286941 7fd9e8779e00 4 rocksdb: Options.max_total_wal_size: 0
2017-12-14 00:10:56.289155 I | mkfs-osd3: 2017-12-14 00:10:56.286942 7fd9e8779e00 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000
2017-12-14 00:10:56.289171 I | mkfs-osd3: 2017-12-14 00:10:56.286944 7fd9e8779e00 4 rocksdb: Options.stats_dump_period_sec: 600
2017-12-14 00:10:56.289181 I | mkfs-osd3: 2017-12-14 00:10:56.286945 7fd9e8779e00 4 rocksdb: Compression algorithms supported:
2017-12-14 00:10:56.289192 I | mkfs-osd3: 2017-12-14 00:10:56.286946 7fd9e8779e00 4 rocksdb: Snappy supported: 0
2017-12-14 00:10:56.289227 I | mkfs-osd3: 2017-12-14 00:10:56.286947 7fd9e8779e00 4 rocksdb: Zlib supported: 0
2017-12-14 00:10:56.289248 I | mkfs-osd3: 2017-12-14 00:10:56.286948 7fd9e8779e00 4 rocksdb: Bzip supported: 0
2017-12-14 00:10:56.289259 I | mkfs-osd3: 2017-12-14 00:10:56.286949 7fd9e8779e00 4 rocksdb: LZ4 supported: 0
2017-12-14 00:10:56.289270 I | mkfs-osd3: 2017-12-14 00:10:56.286950 7fd9e8779e00 4 rocksdb: ZSTD supported: 0
2017-12-14 00:10:56.289371 I | mkfs-osd3: 2017-12-14 00:10:56.286951 7fd9e8779e00 4 rocksdb: Fast CRC32 supported: 0
2017-12-14 00:10:56.289430 I | mkfs-osd3: 2017-12-14 00:10:56.287199 7fd9e8779e00 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2609] Recovering from manifest file: MANIFEST-000005
2017-12-14 00:10:56.289459 I | mkfs-osd3:
2017-12-14 00:10:56.289685 I | mkfs-osd3: 2017-12-14 00:10:56.287243 7fd9e8779e00 4 rocksdb: [/build/ceph/src/rocksdb/db/column_family.cc:407] --------------- Options for column family [default]:
2017-12-14 00:10:56.289742 I | mkfs-osd3:
2017-12-14 00:10:56.289761 I | mkfs-osd3: 2017-12-14 00:10:56.287248 7fd9e8779e00 4 rocksdb: Options.comparator: leveldb.BytewiseComparator
2017-12-14 00:10:56.289777 I | mkfs-osd3: 2017-12-14 00:10:56.287257 7fd9e8779e00 4 rocksdb: Options.merge_operator: .T:int64_array.b:bitwise_xor
2017-12-14 00:10:56.289792 I | mkfs-osd3: 2017-12-14 00:10:56.287260 7fd9e8779e00 4 rocksdb: Options.compaction_filter: None
2017-12-14 00:10:56.289850 I | mkfs-osd3: 2017-12-14 00:10:56.287262 7fd9e8779e00 4 rocksdb: Options.compaction_filter_factory: None
2017-12-14 00:10:56.289868 I | mkfs-osd3: 2017-12-14 00:10:56.287268 7fd9e8779e00 4 rocksdb: Options.memtable_factory: SkipListFactory
2017-12-14 00:10:56.289933 I | mkfs-osd3: 2017-12-14 00:10:56.287271 7fd9e8779e00 4 rocksdb: Options.table_factory: BlockBasedTable
2017-12-14 00:10:56.289974 I | mkfs-osd3: 2017-12-14 00:10:56.287361 7fd9e8779e00 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55906e7021f0)
2017-12-14 00:10:56.289989 I | mkfs-osd3: cache_index_and_filter_blocks: 1
2017-12-14 00:10:56.290001 I | mkfs-osd3: cache_index_and_filter_blocks_with_high_priority: 1
2017-12-14 00:10:56.290011 I | mkfs-osd3: pin_l0_filter_and_index_blocks_in_cache: 1
2017-12-14 00:10:56.290021 I | mkfs-osd3: index_type: 0
2017-12-14 00:10:56.290032 I | mkfs-osd3: hash_index_allow_collision: 1
2017-12-14 00:10:56.290071 I | mkfs-osd3: checksum: 1
2017-12-14 00:10:56.290083 I | mkfs-osd3: no_block_cache: 0
2017-12-14 00:10:56.290093 I | mkfs-osd3: block_cache: 0x55906e9e7340
2017-12-14 00:10:56.290106 I | mkfs-osd3: block_cache_name: LRUCache
2017-12-14 00:10:56.290116 I | mkfs-osd3: block_cache_options:
2017-12-14 00:10:56.290126 I | mkfs-osd3: capacity : 536870912
2017-12-14 00:10:56.290136 I | mkfs-osd3: num_shard_bits : 4
2017-12-14 00:10:56.290147 I | mkfs-osd3: strict_capacity_limit : 0
2017-12-14 00:10:56.290166 I | mkfs-osd3: high_pri_pool_ratio: 0.000
2017-12-14 00:10:56.290176 I | mkfs-osd3: block_cache_compressed: (nil)
2017-12-14 00:10:56.290185 I | mkfs-osd3: persistent_cache: (nil)
2017-12-14 00:10:56.290195 I | mkfs-osd3: block_size: 4096
2017-12-14 00:10:56.290204 I | mkfs-osd3: block_size_deviation: 10
2017-12-14 00:10:56.290248 I | mkfs-osd3: block_restart_interval: 16
2017-12-14 00:10:56.290262 I | mkfs-osd3: index_block_restart_interval: 1
2017-12-14 00:10:56.290273 I | mkfs-osd3: filter_policy: rocksdb.BuiltinBloomFilter
2017-12-14 00:10:56.290283 I | mkfs-osd3: whole_key_filtering: 1
2017-12-14 00:10:56.290293 I | mkfs-osd3: format_version: 2
2017-12-14 00:10:56.290395 I | mkfs-osd3:
2017-12-14 00:10:56.290410 I | mkfs-osd3: 2017-12-14 00:10:56.287384 7fd9e8779e00 4 rocksdb: Options.write_buffer_size: 268435456
2017-12-14 00:10:56.290421 I | mkfs-osd3: 2017-12-14 00:10:56.287387 7fd9e8779e00 4 rocksdb: Options.max_write_buffer_number: 4
2017-12-14 00:10:56.290435 I | mkfs-osd3: 2017-12-14 00:10:56.287390 7fd9e8779e00 4 rocksdb: Options.compression: NoCompression
2017-12-14 00:10:56.290445 I | mkfs-osd3: 2017-12-14 00:10:56.287398 7fd9e8779e00 4 rocksdb: Options.bottommost_compression: Disabled
2017-12-14 00:10:56.290541 I | mkfs-osd3: 2017-12-14 00:10:56.287401 7fd9e8779e00 4 rocksdb: Options.prefix_extractor: nullptr
2017-12-14 00:10:56.290558 I | mkfs-osd3: 2017-12-14 00:10:56.287414 7fd9e8779e00 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr
2017-12-14 00:10:56.290570 I | mkfs-osd3: 2017-12-14 00:10:56.287421 7fd9e8779e00 4 rocksdb: Options.num_levels: 7
2017-12-14 00:10:56.290685 I | mkfs-osd3: 2017-12-14 00:10:56.287462 7fd9e8779e00 4 rocksdb: Options.min_write_buffer_number_to_merge: 1
2017-12-14 00:10:56.290700 I | mkfs-osd3: 2017-12-14 00:10:56.287532 7fd9e8779e00 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0
2017-12-14 00:10:56.290711 I | mkfs-osd3: 2017-12-14 00:10:56.287546 7fd9e8779e00 4 rocksdb: Options.compression_opts.window_bits: -14
2017-12-14 00:10:56.290811 I | mkfs-osd3: 2017-12-14 00:10:56.287549 7fd9e8779e00 4 rocksdb: Options.compression_opts.level: -1
2017-12-14 00:10:56.290854 I | mkfs-osd3: 2017-12-14 00:10:56.287552 7fd9e8779e00 4 rocksdb: Options.compression_opts.strategy: 0
2017-12-14 00:10:56.290971 I | mkfs-osd3: 2017-12-14 00:10:56.287555 7fd9e8779e00 4 rocksdb: Options.compression_opts.max_dict_bytes: 0
2017-12-14 00:10:56.290992 I | mkfs-osd3: 2017-12-14 00:10:56.287557 7fd9e8779e00 4 rocksdb: Options.level0_file_num_compaction_trigger: 4
2017-12-14 00:10:56.291009 I | mkfs-osd3: 2017-12-14 00:10:56.287560 7fd9e8779e00 4 rocksdb: Options.level0_slowdown_writes_trigger: 20
2017-12-14 00:10:56.291067 I | mkfs-osd3: 2017-12-14 00:10:56.287563 7fd9e8779e00 4 rocksdb: Options.level0_stop_writes_trigger: 36
2017-12-14 00:10:56.291080 I | mkfs-osd3: 2017-12-14 00:10:56.287566 7fd9e8779e00 4 rocksdb: Options.target_file_size_base: 67108864
2017-12-14 00:10:56.291089 I | mkfs-osd3: 2017-12-14 00:10:56.287569 7fd9e8779e00 4 rocksdb: Options.target_file_size_multiplier: 1
2017-12-14 00:10:56.291099 I | mkfs-osd3: 2017-12-14 00:10:56.287571 7fd9e8779e00 4 rocksdb: Options.max_bytes_for_level_base: 268435456
2017-12-14 00:10:56.291107 I | mkfs-osd3: 2017-12-14 00:10:56.287574 7fd9e8779e00 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0
2017-12-14 00:10:56.291135 I | mkfs-osd3: 2017-12-14 00:10:56.287576 7fd9e8779e00 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000
2017-12-14 00:10:56.291190 I | mkfs-osd3: 2017-12-14 00:10:56.287583 7fd9e8779e00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1
2017-12-14 00:10:56.291229 I | mkfs-osd3: 2017-12-14 00:10:56.287586 7fd9e8779e00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1
2017-12-14 00:10:56.291240 I | mkfs-osd3: 2017-12-14 00:10:56.287589 7fd9e8779e00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1
2017-12-14 00:10:56.291250 I | mkfs-osd3: 2017-12-14 00:10:56.287592 7fd9e8779e00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1
2017-12-14 00:10:56.291260 I | mkfs-osd3: 2017-12-14 00:10:56.287594 7fd9e8779e00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1
2017-12-14 00:10:56.291272 I | mkfs-osd3: 2017-12-14 00:10:56.287597 7fd9e8779e00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1
2017-12-14 00:10:56.291284 I | mkfs-osd3: 2017-12-14 00:10:56.287599 7fd9e8779e00 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1
2017-12-14 00:10:56.291302 I | mkfs-osd3: 2017-12-14 00:10:56.287603 7fd9e8779e00 4 rocksdb: Options.max_sequential_skip_in_iterations: 8
2017-12-14 00:10:56.291314 I | mkfs-osd3: 2017-12-14 00:10:56.287606 7fd9e8779e00 4 rocksdb: Options.max_compaction_bytes: 1677721600
2017-12-14 00:10:56.291330 I | mkfs-osd3: 2017-12-14 00:10:56.287609 7fd9e8779e00 4 rocksdb: Options.arena_block_size: 33554432
2017-12-14 00:10:56.291340 I | mkfs-osd3: 2017-12-14 00:10:56.287616 7fd9e8779e00 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736
2017-12-14 00:10:56.291398 I | mkfs-osd3: 2017-12-14 00:10:56.287625 7fd9e8779e00 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944
2017-12-14 00:10:56.291413 I | mkfs-osd3: 2017-12-14 00:10:56.287635 7fd9e8779e00 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100
2017-12-14 00:10:56.291563 I | mkfs-osd3: 2017-12-14 00:10:56.287638 7fd9e8779e00 4 rocksdb: Options.disable_auto_compactions: 0
2017-12-14 00:10:56.291611 I | mkfs-osd3: 2017-12-14 00:10:56.287642 7fd9e8779e00 4 rocksdb: Options.compaction_style: kCompactionStyleLevel
2017-12-14 00:10:56.291652 I | mkfs-osd3: 2017-12-14 00:10:56.287645 7fd9e8779e00 4 rocksdb: Options.compaction_pri: kByCompensatedSize
2017-12-14 00:10:56.291756 I | mkfs-osd3: 2017-12-14 00:10:56.287648 7fd9e8779e00 4 rocksdb: Options.compaction_options_universal.size_ratio: 1
2017-12-14 00:10:56.291813 I | mkfs-osd3: 2017-12-14 00:10:56.287656 7fd9e8779e00 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2
2017-12-14 00:10:56.291834 I | mkfs-osd3: 2017-12-14 00:10:56.287659 7fd9e8779e00 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295
2017-12-14 00:10:56.291845 I | mkfs-osd3: 2017-12-14 00:10:56.287661 7fd9e8779e00 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200
2017-12-14 00:10:56.291865 I | mkfs-osd3: 2017-12-14 00:10:56.287664 7fd9e8779e00 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1
2017-12-14 00:10:56.291920 I | mkfs-osd3: 2017-12-14 00:10:56.287666 7fd9e8779e00 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824
2017-12-14 00:10:56.291937 I | mkfs-osd3: 2017-12-14 00:10:56.287669 7fd9e8779e00 4 rocksdb: Options.table_properties_collectors:
2017-12-14 00:10:56.291947 I | mkfs-osd3: 2017-12-14 00:10:56.287672 7fd9e8779e00 4 rocksdb: Options.inplace_update_support: 0
2017-12-14 00:10:56.291964 I | mkfs-osd3: 2017-12-14 00:10:56.287674 7fd9e8779e00 4 rocksdb: Options.inplace_update_num_locks: 10000
2017-12-14 00:10:56.292070 I | mkfs-osd3: 2017-12-14 00:10:56.287682 7fd9e8779e00 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000
2017-12-14 00:10:56.292087 I | mkfs-osd3: 2017-12-14 00:10:56.287686 7fd9e8779e00 4 rocksdb: Options.memtable_huge_page_size: 0
2017-12-14 00:10:56.292098 I | mkfs-osd3: 2017-12-14 00:10:56.287689 7fd9e8779e00 4 rocksdb: Options.bloom_locality: 0
2017-12-14 00:10:56.292109 I | mkfs-osd3: 2017-12-14 00:10:56.287691 7fd9e8779e00 4 rocksdb: Options.max_successive_merges: 0
2017-12-14 00:10:56.292121 I | mkfs-osd3: 2017-12-14 00:10:56.287694 7fd9e8779e00 4 rocksdb: Options.optimize_filters_for_hits: 0
2017-12-14 00:10:56.292131 I | mkfs-osd3: 2017-12-14 00:10:56.287697 7fd9e8779e00 4 rocksdb: Options.paranoid_file_checks: 0
2017-12-14 00:10:56.292143 I | mkfs-osd3: 2017-12-14 00:10:56.287699 7fd9e8779e00 4 rocksdb: Options.force_consistency_checks: 0
2017-12-14 00:10:56.292200 I | mkfs-osd3: 2017-12-14 00:10:56.287701 7fd9e8779e00 4 rocksdb: Options.report_bg_io_stats: 0
2017-12-14 00:10:56.295819 I | mkfs-osd3: 2017-12-14 00:10:56.295614 7fd9e8779e00 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2859] Recovered from manifest file:db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 13, log_number is 0,prev_log_number is 0,max_column_family is 0
2017-12-14 00:10:56.295867 I | mkfs-osd3:
2017-12-14 00:10:56.295877 I | mkfs-osd3: 2017-12-14 00:10:56.295667 7fd9e8779e00 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2867] Column family [default] (ID 0), log number is 4
2017-12-14 00:10:56.295883 I | mkfs-osd3:
2017-12-14 00:10:56.295889 I | mkfs-osd3: 2017-12-14 00:10:56.295727 7fd9e8779e00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1513210256295717, "job": 1, "event": "recovery_started", "log_files": [6]}
2017-12-14 00:10:56.295894 I | mkfs-osd3: 2017-12-14 00:10:56.295734 7fd9e8779e00 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:482] Recovering log #6 mode 0
2017-12-14 00:10:56.295900 I | mkfs-osd3: 2017-12-14 00:10:56.295758 7fd9e8779e00 4 rocksdb: [/build/ceph/src/rocksdb/db/version_set.cc:2395] Creating manifest 8
2017-12-14 00:10:56.295904 I | mkfs-osd3:
2017-12-14 00:10:56.299528 I | mkfs-osd3: 2017-12-14 00:10:56.299334 7fd9e8779e00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1513210256299325, "job": 1, "event": "recovery_finished"}
2017-12-14 00:10:56.304472 I | mkfs-osd3: 2017-12-14 00:10:56.304133 7fd9e8779e00 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl_open.cc:1063] DB pointer 0x55906eb0e000
2017-12-14 00:10:56.317940 I | mkfs-osd3: 2017-12-14 00:10:56.317530 7fd9e8779e00 -1 key
2017-12-14 00:10:56.326975 I | mkfs-osd3: 2017-12-14 00:10:56.326729 7fd9e8779e00 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:217] Shutdown: canceling all background work
2017-12-14 00:10:56.327151 I | mkfs-osd3: 2017-12-14 00:10:56.326990 7fd9e8779e00 4 rocksdb: [/build/ceph/src/rocksdb/db/db_impl.cc:343] Shutdown complete
2017-12-14 00:10:56.327253 I | mkfs-osd3: 2017-12-14 00:10:56.327032 7fd9e8779e00 1 bluefs umount
2017-12-14 00:10:56.327314 I | mkfs-osd3: 2017-12-14 00:10:56.327080 7fd9e8779e00 1 bdev(0x55906e707440 /data/rook-data/osd3/bluestore-wal) close
2017-12-14 00:10:56.593950 I | mkfs-osd3: 2017-12-14 00:10:56.593740 7fd9e8779e00 1 bdev(0x55906e707680 /data/rook-data/osd3/bluestore-db) close
2017-12-14 00:10:56.828865 I | mkfs-osd3: 2017-12-14 00:10:56.828613 7fd9e8779e00 1 bdev(0x55906e7078c0 /data/rook-data/osd3/block) close
2017-12-14 00:10:57.049863 I | mkfs-osd3: 2017-12-14 00:10:57.049646 7fd9e8779e00 1 bdev(0x55906e707b00 /data/rook-data/osd3/block) close
2017-12-14 00:10:57.091113 I | mkfs-osd3: 2017-12-14 00:10:57.090821 7fd9e8779e00 -1 created object store /data/rook-data/osd3 for osd.3 fsid bba5700b-b931-48c8-b668-a1020eab58d7
2017-12-14 00:10:57.098232 I | mkfs-osd3: 2017-12-14 00:10:54.169826 7fd9e8779e00 -1 bluestore(/data/rook-data/osd3/block) _read_bdev_label failed to open /data/rook-data/osd3/block: (2) No such file or directory
2017-12-14 00:10:57.098445 I | mkfs-osd3: 2017-12-14 00:10:54.169877 7fd9e8779e00 -1 bluestore(/data/rook-data/osd3/block) _read_bdev_label failed to open /data/rook-data/osd3/block: (2) No such file or directory
2017-12-14 00:10:57.098592 I | mkfs-osd3: 2017-12-14 00:10:54.169897 7fd9e8779e00 -1 bluestore(/data/rook-data/osd3/block) _read_bdev_label failed to open /data/rook-data/osd3/block: (2) No such file or directory
2017-12-14 00:10:57.098721 I | mkfs-osd3: 2017-12-14 00:10:54.172895 7fd9e8779e00 -1 bluestore(/data/rook-data/osd3) _read_fsid unparsable uuid
2017-12-14 00:10:57.098817 I | mkfs-osd3: 2017-12-14 00:10:54.176253 7fd9e8779e00 -1 bdev(0x55906e706b40 /data/rook-data/osd3/block) unable to get device name for /data/rook-data/osd3/block: (22) Invalid argument
2017-12-14 00:10:57.098919 I | mkfs-osd3: 2017-12-14 00:10:54.189565 7fd9e8779e00 -1 bdev(0x55906e706fc0 /data/rook-data/osd3/bluestore-db) unable to get device name for /data/rook-data/osd3/bluestore-db: (22) Invalid argument
2017-12-14 00:10:57.099012 I | mkfs-osd3: 2017-12-14 00:10:54.192376 7fd9e8779e00 -1 bdev(0x55906e707200 /data/rook-data/osd3/block) unable to get device name for /data/rook-data/osd3/block: (22) Invalid argument
2017-12-14 00:10:57.099088 I | mkfs-osd3: 2017-12-14 00:10:54.193875 7fd9e8779e00 -1 bdev(0x55906e707440 /data/rook-data/osd3/bluestore-wal) unable to get device name for /data/rook-data/osd3/bluestore-wal: (22) Invalid argument
2017-12-14 00:10:57.099211 I | mkfs-osd3: 2017-12-14 00:10:55.213793 7fd9e8779e00 -1 bdev(0x55906e707b00 /data/rook-data/osd3/block) unable to get device name for /data/rook-data/osd3/block: (22) Invalid argument
2017-12-14 00:10:57.099304 I | mkfs-osd3: 2017-12-14 00:10:55.215937 7fd9e8779e00 -1 bdev(0x55906e7078c0 /data/rook-data/osd3/bluestore-db) unable to get device name for /data/rook-data/osd3/bluestore-db: (22) Invalid argument
2017-12-14 00:10:57.099526 I | mkfs-osd3: 2017-12-14 00:10:55.217777 7fd9e8779e00 -1 bdev(0x55906e707680 /data/rook-data/osd3/block) unable to get device name for /data/rook-data/osd3/block: (22) Invalid argument
2017-12-14 00:10:57.099591 I | mkfs-osd3: 2017-12-14 00:10:55.219445 7fd9e8779e00 -1 bdev(0x55906e707440 /data/rook-data/osd3/bluestore-wal) unable to get device name for /data/rook-data/osd3/bluestore-wal: (22) Invalid argument
2017-12-14 00:10:57.099674 I | mkfs-osd3: 2017-12-14 00:10:56.274795 7fd9e8779e00 -1 bdev(0x55906e707b00 /data/rook-data/osd3/block) unable to get device name for /data/rook-data/osd3/block: (22) Invalid argument
2017-12-14 00:10:57.099767 I | mkfs-osd3: 2017-12-14 00:10:56.277217 7fd9e8779e00 -1 bdev(0x55906e707680 /data/rook-data/osd3/bluestore-db) unable to get device name for /data/rook-data/osd3/bluestore-db: (22) Invalid argument
2017-12-14 00:10:57.099878 I | mkfs-osd3: 2017-12-14 00:10:56.279923 7fd9e8779e00 -1 bdev(0x55906e7078c0 /data/rook-data/osd3/block) unable to get device name for /data/rook-data/osd3/block: (22) Invalid argument
2017-12-14 00:10:57.100042 I | mkfs-osd3: 2017-12-14 00:10:56.282227 7fd9e8779e00 -1 bdev(0x55906e707440 /data/rook-data/osd3/bluestore-wal) unable to get device name for /data/rook-data/osd3/bluestore-wal: (22) Invalid argument
2017-12-14 00:10:57.100138 I | mkfs-osd3: 2017-12-14 00:10:56.317530 7fd9e8779e00 -1 key
2017-12-14 00:10:57.100249 I | mkfs-osd3: 2017-12-14 00:10:57.090821 7fd9e8779e00 -1 created object store /data/rook-data/osd3 for osd.3 fsid bba5700b-b931-48c8-b668-a1020eab58d7
2017-12-14 00:10:57.100541 I | cephosd: Backing up OSD 3 file system from /data/rook-data/osd3
2017-12-14 00:10:57.327633 W | cephosd: skipping backup of file bluestore-block with size 205583683584 exceeding the maximum of 1048576
2017-12-14 00:10:57.327779 W | cephosd: skipping backup of file bluestore-db with size 1073741824 exceeding the maximum of 1048576
2017-12-14 00:10:57.327830 W | cephosd: skipping backup of file bluestore-wal with size 603979776 exceeding the maximum of 1048576
2017-12-14 00:10:57.643189 I | cephosd: skipping backup of file keyring that is in the filter list
2017-12-14 00:10:58.772283 I | cephosd: skipping backup of file rook.config that is in the filter list
2017-12-14 00:10:59.408599 I | osd8: 2017-12-14 00:10:59.408077 7fd7d309ae00 0 osd.8 2329 load_pgs opened 65 pgs
2017-12-14 00:10:59.408646 I | osd8: 2017-12-14 00:10:59.408210 7fd7d309ae00 0 osd.8 2329 using weightedpriority op queue with priority op cut off at 64.
2017-12-14 00:10:59.413560 I | osd8: 2017-12-14 00:10:59.413003 7fd7d309ae00 -1 osd.8 2329 log_to_monitors {default=true}
2017-12-14 00:10:59.441915 I | osd8: 2017-12-14 00:10:59.441694 7fd7d309ae00 0 osd.8 2329 done with init, starting boot process
2017-12-14 00:10:59.580908 I | cephosd: Completed backing up OSD 3 file system from /data/rook-data/osd3
2017-12-14 00:10:59.580999 I | cephosd: adding osd.3 (/data/rook-data/osd3), bytes: 205583683584, weight: 0.1870, to crush map at 'root=default host=coreb6-dev'
2017-12-14 00:10:59.581196 I | exec: Running command: ceph osd crush create-or-move 3 0.1870 root=default host=coreb6-dev --cluster=rook --conf=/var/lib/rook/rook/rook.config --keyring=/var/lib/rook/rook/client.admin.keyring --format json --out-file /tmp/210444043
2017-12-14 00:11:00.322556 I | exec: Error ENOENT: osd.3 does not exist. create it before updating the crush map
2017-12-14 00:11:00.322803 E | cephosd: failed to config osd in path /data/rook-data. failed to initialize OSD at /data/rook-data/osd3: failed adding osd.3 to crush map: exit status 2
2017-12-14 00:11:00.322995 I | cephosd: total bytes for /var/lib/rook/osd1: 205583683584 (191.46 GiB)
2017-12-14 00:11:00.323445 I | cephmon: writing config file /var/lib/rook/osd1/rook.config
2017-12-14 00:11:00.323945 I | cephosd: starting osd 1 at /var/lib/rook/osd1
2017-12-14 00:11:00.324032 I | cephosd: Config file /var/lib/rook/osd1/rook.config:
[global]
run dir = /var/lib/rook/osd1
mon initial members = rook-ceph-mon10 rook-ceph-mon12 rook-ceph-mon6
mon host = 10.3.47.80:6790,10.3.151.127:6790,10.3.190.106:6790
log file = /dev/stdout
mon cluster log file = /dev/stdout
public addr = 10.2.3.186
cluster addr = 10.2.3.186
mon keyvaluedb = rocksdb
mon_allow_pool_delete = true
mon_max_pg_per_osd = 1000
debug default = 0
debug rados = 0
debug mon = 0
debug osd = 0
debug bluestore = 0
debug filestore = 0
debug journal = 0
debug leveldb = 0
filestore_omap_backend = rocksdb
osd pg bits = 11
osd pgp bits = 11
osd pool default size = 1
osd pool default min size = 1
osd pool default pg num = 100
osd pool default pgp num = 100
osd max object name len = 256
osd max object namespace len = 64
osd objectstore = bluestore
crush location = root=default host=coreb6-dev
rbd_default_features = 3
fatal signal handlers = false
mon osd full ratio = 0.70
mon osd backfillfull ratio = .65
mon osd nearfull ratio = .60
[osd.1]
keyring = /var/lib/rook/osd1/keyring
bluestore block wal create = true
bluestore block create = true
bluestore block db size = 1073741824
bluestore block wal path = /var/lib/rook/osd1/bluestore-wal
bluestore block db create = true
bluestore block wal size = 603979776
bluestore block size = 205583683584
bluestore block db path = /var/lib/rook/osd1/bluestore-db
bluestore block path = /var/lib/rook/osd1/bluestore-block
2017-12-14 00:11:00.325723 I | proc: no existing process found for binary ceph-osd and pattern '--osd-uuid=dde28073-e215-436d-a41c-02101df277ec'
2017-12-14 00:11:00.325783 I | proc: Starting process osd1 with args: [--foreground --id=1 --cluster=rook --osd-data=/var/lib/rook/osd1 --conf=/var/lib/rook/osd1/rook.config --keyring=/var/lib/rook/osd1/keyring --osd-uuid=dde28073-e215-436d-a41c-02101df277ec]
2017-12-14 00:11:00.325803 I | exec: Running command: ceph-osd --foreground --id=1 --cluster=rook --osd-data=/var/lib/rook/osd1 --conf=/var/lib/rook/osd1/rook.config --keyring=/var/lib/rook/osd1/keyring --osd-uuid=dde28073-e215-436d-a41c-02101df277ec
2017-12-14 00:11:00.326856 I | cephosd: 1/2 osd dirs succeeded on this node
failed to configure dirs map[/data/rook-data:3 /var/lib/rook:1]. failed to initialize OSD at /data/rook-data/osd3: failed adding osd.3 to crush map: exit status 2
apiVersion: v1
kind: Pod
metadata:
annotations:
kubernetes.io/created-by: |
{"kind":"SerializedReference","apiVersion":"v1","reference":{"kind":"ReplicaSet","namespace":"rook","name":"rook-ceph-osd-coreb6.dev","uid":"0719181c-e023-11e7-849d-525400cdeea3","apiVersion":"extensions","resourceVersion":"48891259"}}
creationTimestamp: 2017-12-13T16:31:10Z
generateName: rook-ceph-osd-coreb6.dev-
labels:
app: rook-ceph-osd
rook_cluster: rook
name: rook-ceph-osd-coreb6.dev-m6tdq
namespace: rook
ownerReferences:
- apiVersion: extensions/v1beta1
blockOwnerDeletion: true
controller: true
kind: ReplicaSet
name: rook-ceph-osd-coreb6.dev
uid: 0719181c-e023-11e7-849d-525400cdeea3
resourceVersion: "49052488"
selfLink: /api/v1/namespaces/rook/pods/rook-ceph-osd-coreb6.dev-m6tdq
uid: 072ae1ed-e023-11e7-ad28-525400f93bbc
spec:
affinity: {}
containers:
- args:
- osd
env:
- name: ROOK_NODE_NAME
valueFrom:
fieldRef:
apiVersion: v1
fieldPath: spec.nodeName
- name: ROOK_PRIVATE_IPV4
valueFrom:
fieldRef:
apiVersion: v1
fieldPath: status.podIP
- name: ROOK_PUBLIC_IPV4
valueFrom:
fieldRef:
apiVersion: v1
fieldPath: status.podIP
- name: ROOK_CLUSTER_NAME
value: rook
- name: ROOK_MON_ENDPOINTS
valueFrom:
configMapKeyRef:
key: data
name: rook-ceph-mon-endpoints
- name: ROOK_MON_SECRET
valueFrom:
secretKeyRef:
key: mon-secret
name: rook-ceph-mon
- name: ROOK_ADMIN_SECRET
valueFrom:
secretKeyRef:
key: admin-secret
name: rook-ceph-mon
- name: ROOK_CONFIG_DIR
value: /var/lib/rook
- name: ROOK_CEPH_CONFIG_OVERRIDE
value: /etc/rook/config/override.conf
- name: ROOK_DATA_DEVICES
value: vdb
- name: ROOK_OSD_STORE
value: bluestore
- name: ROOK_OSD_DATABASE_SIZE
value: "1024"
- name: ROOK_OSD_JOURNAL_SIZE
value: "1024"
image: rook/rook:master
imagePullPolicy: IfNotPresent
name: rook-ceph-osd
resources:
limits:
cpu: "0"
memory: "0"
requests:
cpu: "0"
memory: "0"
securityContext:
privileged: true
readOnlyRootFilesystem: false
runAsUser: 0
terminationMessagePath: /dev/termination-log
terminationMessagePolicy: File
volumeMounts:
- mountPath: /var/lib/rook
name: rook-data
- mountPath: /etc/rook/config
name: rook-config-override
- mountPath: /dev
name: devices
- mountPath: /var/run/secrets/kubernetes.io/serviceaccount
name: rook-ceph-osd-token-6gvz2
readOnly: true
dnsPolicy: ClusterFirst
nodeName: coreb6.dev
nodeSelector:
kubernetes.io/hostname: coreb6.dev
restartPolicy: Always
schedulerName: default-scheduler
securityContext: {}
serviceAccount: rook-ceph-osd
serviceAccountName: rook-ceph-osd
terminationGracePeriodSeconds: 30
volumes:
- hostPath:
path: /data/rook-data
name: rook-data
- configMap:
defaultMode: 420
items:
- key: config
path: override.conf
name: rook-config-override
name: rook-config-override
- hostPath:
path: /dev
name: devices
- name: rook-ceph-osd-token-6gvz2
secret:
defaultMode: 420
secretName: rook-ceph-osd-token-6gvz2
status:
conditions:
- lastProbeTime: null
lastTransitionTime: 2017-12-13T16:31:11Z
status: "True"
type: Initialized
- lastProbeTime: null
lastTransitionTime: 2017-12-14T00:11:00Z
message: 'containers with unready status: [rook-ceph-osd]'
reason: ContainersNotReady
status: "False"
type: Ready
- lastProbeTime: null
lastTransitionTime: 2017-12-13T16:31:10Z
status: "True"
type: PodScheduled
containerStatuses:
- containerID: docker://caffda457bddab5bb373cdbf86e8de6247235cf33ba4fd65f1e9a166e4751547
image: rook/rook:master
imageID: docker-pullable://rook/rook@sha256:a9e07a8328aa61e0efa962f04805cd6668ba908674037527912565a00e56140f
lastState:
terminated:
containerID: docker://caffda457bddab5bb373cdbf86e8de6247235cf33ba4fd65f1e9a166e4751547
exitCode: 1
finishedAt: 2017-12-14T00:11:00Z
message: 'failed to configure dirs map[/data/rook-data:3 /var/lib/rook:1].
failed to initialize OSD at /data/rook-data/osd3: failed adding osd.3 to
crush map: exit status 2'
reason: Error
startedAt: 2017-12-14T00:10:51Z
name: rook-ceph-osd
ready: false
restartCount: 92
state:
waiting:
message: Back-off 5m0s restarting failed container=rook-ceph-osd pod=rook-ceph-osd-coreb6.dev-m6tdq_rook(072ae1ed-e023-11e7-ad28-525400f93bbc)
reason: CrashLoopBackOff
hostIP: 10.0.100.76
phase: Running
podIP: 10.2.3.186
qosClass: BestEffort
startTime: 2017-12-13T16:31:11Z
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment