Created
May 25, 2019 01:13
-
-
Save sfxworks/be5a417296a5c6814b9d76ad1e816a06 to your computer and use it in GitHub Desktop.
wew
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 2019-05-25 01:06:06.872 7fb939a4a1c0 0 ceph version 13.2.4 (b10be4d44915a4d78a8e06aa31919e74927b142e) mimic (stable), process ceph-osd, pid 21305 | |
| 2019-05-25 01:06:06.872 7fb939a4a1c0 0 pidfile_write: ignore empty --pid-file | |
| starting osd.1 at - osd_data /var/lib/rook/osd1 /var/lib/rook/osd1/journal | |
| 2019-05-25 01:06:06.888 7fb939a4a1c0 0 load: jerasure load: lrc load: isa | |
| 2019-05-25 01:06:06.888 7fb939a4a1c0 0 filestore(/var/lib/rook/osd1) backend generic (magic 0xef53) | |
| 2019-05-25 01:06:06.888 7fb939a4a1c0 0 filestore(/var/lib/rook/osd1) backend generic (magic 0xef53) | |
| 2019-05-25 01:06:06.888 7fb939a4a1c0 0 genericfilestorebackend(/var/lib/rook/osd1) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option | |
| 2019-05-25 01:06:06.888 7fb939a4a1c0 0 genericfilestorebackend(/var/lib/rook/osd1) detect_features: SEEK_DATA/SEEK_HOLE is disabled via 'filestore seek data hole' config option | |
| 2019-05-25 01:06:06.888 7fb939a4a1c0 0 genericfilestorebackend(/var/lib/rook/osd1) detect_features: splice() is disabled via 'filestore splice' config option | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 0 genericfilestorebackend(/var/lib/rook/osd1) detect_features: syncfs(2) syscall fully supported (by glibc and kernel) | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 0 filestore(/var/lib/rook/osd1) limited size xattrs | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 0 filestore(/var/lib/rook/osd1) start omap initiation | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 0 set rocksdb option compaction_readahead_size = 2097152 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 0 set rocksdb option compression = kNoCompression | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 0 set rocksdb option max_background_jobs = 10 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 0 set rocksdb option compaction_readahead_size = 2097152 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 0 set rocksdb option compression = kNoCompression | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 0 set rocksdb option max_background_jobs = 10 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: RocksDB version: 5.13.0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Compile date Jan 4 2019 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: DB SUMMARY | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: CURRENT file: CURRENT | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: IDENTITY file: IDENTITY | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: MANIFEST file: MANIFEST-006994 size: 4010 Bytes | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: SST files in /var/lib/rook/osd1/current/omap dir, Total Num: 38, files: 002404.sst 002406.sst 002408.sst 002410.sst 002412.sst 002414.sst 002418.sst 002422.sst 002426.sst | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Write Ahead Log file in /var/lib/rook/osd1/current/omap: 006995.log size: 0 ; | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.error_if_exists: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.create_if_missing: 1 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.paranoid_checks: 1 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.env: 0x55b7318001e0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.info_log: 0x55b732a55a20 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_file_opening_threads: 16 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.statistics: (nil) | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.use_fsync: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_log_file_size: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_manifest_file_size: 18446744073709551615 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.log_file_time_to_roll: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.keep_log_file_num: 1000 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.recycle_log_file_num: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.allow_fallocate: 1 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.allow_mmap_reads: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.allow_mmap_writes: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.use_direct_reads: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.create_missing_column_families: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.db_log_dir: | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.wal_dir: /var/lib/rook/osd1/current/omap | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.table_cache_numshardbits: 6 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_subcompactions: 1 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_background_flushes: -1 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.WAL_ttl_seconds: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.WAL_size_limit_MB: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.is_fd_close_on_exec: 1 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.advise_random_on_open: 1 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.db_write_buffer_size: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.write_buffer_manager: 0x55b732c0ad50 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 1 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.use_adaptive_mutex: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.rate_limiter: (nil) | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.wal_recovery_mode: 2 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.enable_thread_tracking: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.enable_pipelined_write: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.row_cache: None | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.wal_filter: None | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.allow_ingest_behind: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.preserve_deletes: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.two_write_queues: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.manual_wal_flush: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_background_jobs: 10 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_background_compactions: -1 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.delayed_write_rate : 16777216 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_total_wal_size: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.stats_dump_period_sec: 600 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_open_files: -1 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.bytes_per_sync: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.wal_bytes_per_sync: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compaction_readahead_size: 2097152 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Compression algorithms supported: | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: kZSTD supported: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: kXpressCompression supported: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: kLZ4HCCompression supported: 1 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: kLZ4Compression supported: 1 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: kBZip2Compression supported: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: kZlibCompression supported: 1 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: kSnappyCompression supported: 1 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Fast CRC32 supported: Supported on x86 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/rocksdb/db/version_set.cc:3088] Recovering from manifest file: MANIFEST-006994 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/rocksdb/db/column_family.cc:474] --------------- Options for column family [default]: | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.merge_operator: | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compaction_filter: None | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compaction_filter_factory: None | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.memtable_factory: SkipListFactory | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.table_factory: BlockBasedTable | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55b7326fd500) | |
| cache_index_and_filter_blocks: 1 | |
| cache_index_and_filter_blocks_with_high_priority: 1 | |
| pin_l0_filter_and_index_blocks_in_cache: 1 | |
| index_type: 0 | |
| hash_index_allow_collision: 1 | |
| checksum: 1 | |
| no_block_cache: 0 | |
| block_cache: 0x55b732c00b00 | |
| block_cache_name: BinnedLRUCache | |
| block_cache_options: | |
| capacity : 536870912 | |
| num_shard_bits : 4 | |
| strict_capacity_limit : 0 | |
| high_pri_pool_ratio: 0.000 | |
| block_cache_compressed: (nil) | |
| persistent_cache: (nil) | |
| block_size: 4096 | |
| block_size_deviation: 10 | |
| block_restart_interval: 16 | |
| index_block_restart_interval: 1 | |
| metadata_block_size: 4096 | |
| partition_filters: 0 | |
| use_delta_encoding: 1 | |
| filter_policy: rocksdb.BuiltinBloomFilter | |
| whole_key_filtering: 1 | |
| verify_compression: 0 | |
| read_amp_bytes_per_bit: 0 | |
| format_version: 2 | |
| enable_index_compression: 1 | |
| block_align: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.write_buffer_size: 67108864 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_write_buffer_number: 2 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compression: NoCompression | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.bottommost_compression: Disabled | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.prefix_extractor: nullptr | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.num_levels: 7 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compression_opts.window_bits: -14 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compression_opts.level: -1 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compression_opts.strategy: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.target_file_size_base: 67108864 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.target_file_size_multiplier: 1 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.arena_block_size: 8388608 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.disable_auto_compactions: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compaction_pri: kByCompensatedSize | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compaction_options_fifo.ttl: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.table_properties_collectors: | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.inplace_update_support: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.inplace_update_num_locks: 10000 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.memtable_huge_page_size: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.bloom_locality: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_successive_merges: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.optimize_filters_for_hits: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.paranoid_file_checks: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.force_consistency_checks: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.report_bg_io_stats: 0 | |
| 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.ttl: 0 | |
| 2019-05-25 01:06:06.920 7fb939a4a1c0 4 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/rocksdb/db/version_set.cc:3362] Recovered from manifest file:/var/lib/rook/osd1/current/omap/MANIFEST-006994 succeeded,manifest_file_number is 6994, next_file_number is 6997, last_sequence is 302676171, log_number is 0,prev_log_number is 0,max_column_family is 0,deleted_log_number is 6992 | |
| 2019-05-25 01:06:06.920 7fb939a4a1c0 4 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/rocksdb/db/version_set.cc:3370] Column family [default] (ID 0), log number is 6993 | |
| 2019-05-25 01:06:06.920 7fb939a4a1c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1558746366920893, "job": 1, "event": "recovery_started", "log_files": [6995]} | |
| 2019-05-25 01:06:06.920 7fb939a4a1c0 4 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/rocksdb/db/db_impl_open.cc:551] Recovering log #6995 mode 2 | |
| 2019-05-25 01:06:06.920 7fb939a4a1c0 4 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/rocksdb/db/version_set.cc:2863] Creating manifest 6997 | |
| 2019-05-25 01:06:06.920 7fb939a4a1c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1558746366921352, "job": 1, "event": "recovery_finished"} | |
| 2019-05-25 01:06:06.920 7fb939a4a1c0 3 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/rocksdb/db/column_family.cc:751] [default] Stopping writes because we have 36 level-0 files | |
| 2019-05-25 01:06:06.924 7fb939a4a1c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1558746366926593, "job": 2, "event": "table_file_deletion", "file_number": 6998} | |
| 2019-05-25 01:06:06.924 7fb939a4a1c0 4 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/rocksdb/db/db_impl_open.cc:1218] DB pointer 0x55b732c1e000 | |
| 2019-05-25 01:06:06.924 7fb923359700 3 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/rocksdb/db/db_impl.cc:490] ------- DUMPING STATS ------- | |
| 2019-05-25 01:06:06.924 7fb923359700 3 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/rocksdb/db/db_impl.cc:491] | |
| ** DB Stats ** | |
| Uptime(secs): 0.0 total, 0.0 interval | |
| Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s | |
| Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s | |
| Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent | |
| Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s | |
| Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s | |
| Interval stall: 00:00:0.000 H:M:S, 0.0 percent | |
| ** Compaction Stats [default] ** | |
| Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop | |
| ---------------------------------------------------------------------------------------------------------------------------------------------------------- | |
| L0 36/0 84.47 MB 9.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0 | |
| L1 1/0 59.88 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0 | |
| Sum 37/0 144.35 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0 | |
| Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0 | |
| Uptime(secs): 0.0 total, 0.0 interval | |
| Flush(GB): cumulative 0.000, interval 0.000 | |
| AddFile(GB): cumulative 0.000, interval 0.000 | |
| AddFile(Total Files): cumulative 0, interval 0 | |
| AddFile(L0 Files): cumulative 0, interval 0 | |
| AddFile(Keys): cumulative 0, interval 0 | |
| Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds | |
| Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds | |
| Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 1 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 1 total count | |
| ** File Read Latency Histogram By Level [default] ** | |
| ** Compaction Stats [default] ** | |
| Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop | |
| ---------------------------------------------------------------------------------------------------------------------------------------------------------- | |
| L0 36/0 84.47 MB 9.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0 | |
| L1 1/0 59.88 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0 | |
| Sum 37/0 144.35 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0 | |
| Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0 | |
| Uptime(secs): 0.0 total, 0.0 interval | |
| Flush(GB): cumulative 0.000, interval 0.000 | |
| AddFile(GB): cumulative 0.000, interval 0.000 | |
| AddFile(Total Files): cumulative 0, interval 0 | |
| AddFile(L0 Files): cumulative 0, interval 0 | |
| AddFile(Keys): cumulative 0, interval 0 | |
| Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds | |
| Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds | |
| Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 1 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count | |
| ** File Read Latency Histogram By Level [default] ** | |
| 2019-05-25 01:06:06.924 7fb923359700 4 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/rocksdb/db/compaction_job.cc:1494] [default] [JOB 3] Compacting 36@0 + 1@1 files to L1, score 9.00 | |
| 2019-05-25 01:06:06.924 7fb923359700 4 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/rocksdb/db/compaction_job.cc:1498] [default] Compaction start summary: Base version 3 Base level 0, inputs: [2538(160KB) 2534(160KB) 2530(160KB) 2526(160KB) 2522(160KB) 2518(160KB) 2514(160KB) 2510(159KB) 2506(159KB) 2502(158KB) 2498(158KB) 2494(158KB) 2490(158KB) 2486(158KB) 2482(158KB) 2478(158KB) 2474(158KB) 2470(158KB) 2466(158KB) 2462(158KB) 2458(157KB) 2454(157KB) 2450(157KB) 2446(157KB) 2442(157KB) 2438(157KB) 2434(157KB) 2430(157KB) 2426(157KB) 2422(108KB) 2418(57KB) 2414(17KB) 2412(20MB) 2410(20MB) 2408(20MB) 2406(19MB)], [2404(59MB)] | |
| 2019-05-25 01:06:06.924 7fb923359700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1558746366927694, "job": 3, "event": "compaction_started", "files_L0": [2538, 2534, 2530, 2526, 2522, 2518, 2514, 2510, 2506, 2502, 2498, 2494, 2490, 2486, 2482, 2478, 2474, 2470, 2466, 2462, 2458, 2454, 2450, 2446, 2442, 2438, 2434, 2430, 2426, 2422, 2418, 2414, 2412, 2410, 2408, 2406], "files_L1": [2404], "score": 9, "input_data_size": 151363041} | |
| 2019-05-25 01:06:06.928 7fb939a4a1c0 0 filestore(/var/lib/rook/osd1) mount(1808): enabling WRITEAHEAD journal mode: checkpoint is not enabled | |
| 2019-05-25 01:06:06.928 7fb939a4a1c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway | |
| 2019-05-25 01:06:06.928 7fb939a4a1c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway | |
| 2019-05-25 01:06:07.192 7fb923359700 3 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/rocksdb/db/db_impl_compaction_flush.cc:1929] Compaction error: Corruption: block checksum mismatch: expected 862584094, got 1969278739 in /var/lib/rook/osd1/current/omap/002408.sst offset 15647059 size 3855 | |
| 2019-05-25 01:06:07.192 7fb923359700 4 rocksdb: (Original Log Time 2019/05/25-01:06:07.195357) [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/rocksdb/db/compaction_job.cc:642] [default] compacted to: base level 1 max bytes base 268435456 files[36 1 0 0 0 0 0] max score 0.00, MB/sec: 565.6 rd, 0.0 wr, level 1, files in(36, 1) out(1) MB in(84.5, 59.9) out(0.0), read-write-amplify(1.7) write-amplify(0.0) Corruption: block checksum mismatch: expected 8625 | |
| 2019-05-25 01:06:07.192 7fb923359700 4 rocksdb: (Original Log Time 2019/05/25-01:06:07.195374) EVENT_LOG_v1 {"time_micros": 1558746367195368, "job": 3, "event": "compaction_finished", "compaction_time_micros": 267619, "output_level": 1, "num_output_files": 1, "total_output_size": 62850129, "num_input_records": 1024106, "num_output_records": 310683, "num_subcompactions": 1, "output_compression": "NoCompression", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [36, 1, 0, 0, 0, 0, 0]} | |
| 2019-05-25 01:06:07.192 7fb923359700 2 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/rocksdb/db/db_impl_compaction_flush.cc:1517] Waiting after background compaction error: Corruption: block checksum mismatch: expected 862584094, got 1969278739 in /var/lib/rook/osd1/current/omap/002408.sst offset 15647059 size 3855, Accumulated background error counts: 1 | |
| 2019-05-25 01:06:07.192 7fb939a4a1c0 -1 rocksdb: submit_common error: Corruption: block checksum mismatch: expected 862584094, got 1969278739 in /var/lib/rook/osd1/current/omap/002408.sst offset 15647059 size 3855 code = 2 Rocksdb transaction: | |
| Put( Prefix = _ key = 'SER_0000000000000044_USER_'0x00303030'0000031.00000000000002570200' Value size = 182) | |
| Put( Prefix = _ key = 'SER_0000000000000044_USER_'0x005f6661'stinfo' Value size = 186) | |
| 2019-05-25 01:06:07.192 7fb939a4a1c0 -1 rocksdb: submit_common error: Corruption: block checksum mismatch: expected 862584094, got 1969278739 in /var/lib/rook/osd1/current/omap/002408.sst offset 15647059 size 3855 code = 2 Rocksdb transaction: | |
| Put( Prefix = _ key = 'SER_0000000000000044_USER_'0x00303030'0000031.00000000000002570200' Value size = 182) | |
| Put( Prefix = _ key = 'SER_0000000000000044_USER_'0x005f6661'stinfo' Value size = 186) | |
| 2019-05-25 01:06:07.192 7fb939a4a1c0 -1 filestore(/var/lib/rook/osd1) error (1) Operation not permitted not handled on operation 0x55b7329febfa (100728244.0.3, or op 3, counting from 0) | |
| 2019-05-25 01:06:07.192 7fb939a4a1c0 -1 filestore(/var/lib/rook/osd1) error (1) Operation not permitted not handled on operation 0x55b7329febfa (100728244.0.3, or op 3, counting from 0) | |
| 2019-05-25 01:06:07.192 7fb939a4a1c0 0 filestore(/var/lib/rook/osd1) EPERM suggests file(s) in osd data dir not owned by ceph user, or leveldb corruption | |
| 2019-05-25 01:06:07.192 7fb939a4a1c0 0 filestore(/var/lib/rook/osd1) transaction dump: | |
| { | |
| "ops": [ | |
| { | |
| "op_num": 0, | |
| "op_name": "setattrs", | |
| "collection": "1.55_head", | |
| "oid": "#1:ab34d26c:::rbd_data.68856b8b4567.0000000000000021:head#", | |
| "attr_lens": { | |
| "_": 293, | |
| "snapset": 35 | |
| } | |
| }, | |
| { | |
| "op_num": 1, | |
| "op_name": "op_setallochint", | |
| "collection": "1.55_head", | |
| "oid": "#1:ab34d26c:::rbd_data.68856b8b4567.0000000000000021:head#", | |
| "expected_object_size": "4194304", | |
| "expected_write_size": "4194304" | |
| }, | |
| { | |
| "op_num": 2, | |
| "op_name": "write", | |
| "collection": "1.55_head", | |
| "oid": "#1:ab34d26c:::rbd_data.68856b8b4567.0000000000000021:head#", | |
| "length": 8192, | |
| "offset": 401408, | |
| "bufferlist length": 8192 | |
| }, | |
| { | |
| "op_num": 3, | |
| "op_name": "omap_setkeys", | |
| "collection": "1.55_head", | |
| "oid": "#1:aa000000::::head#", | |
| "attr_lens": { | |
| "0000000031.00000000000002570200": 182, | |
| "_fastinfo": 186 | |
| } | |
| } | |
| ] | |
| } | |
| /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/os/filestore/FileStore.cc: In function 'void FileStore::_do_transaction(ObjectStore::Transaction&, uint64_t, int, ThreadPool::TPHandle*, const char*)' thread 7fb939a4a1c0 time 2019-05-25 01:06:07.195503 | |
| /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/os/filestore/FileStore.cc: 3236: FAILED assert(0 == "unexpected error") | |
| ceph version 13.2.4 (b10be4d44915a4d78a8e06aa31919e74927b142e) mimic (stable) | |
| 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0xff) [0x7fb930e8316f] | |
| 2: (()+0x25a337) [0x7fb930e83337] | |
| 3: (FileStore::_do_transaction(ObjectStore::Transaction&, unsigned long, int, ThreadPool::TPHandle*, char const*)+0xbaf) [0x55b730f07d6f] | |
| 4: (FileStore::_do_transactions(std::vector<ObjectStore::Transaction, std::allocator<ObjectStore::Transaction> >&, unsigned long, ThreadPool::TPHandle*, char const*)+0x48) [0x55b730f0e278] | |
| 5: (JournalingObjectStore::journal_replay(unsigned long)+0x807) [0x55b730f267a7] | |
| 6: (FileStore::mount()+0x4a48) [0x55b730efb918] | |
| 7: (OSD::init()+0x28f) [0x55b730bae41f] | |
| 8: (main()+0x23a0) [0x55b730a8c670] | |
| 9: (__libc_start_main()+0xf5) [0x7fb92ca193d5] | |
| 10: (()+0x384db0) [0x55b730b64db0] | |
| NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. | |
| 2019-05-25 01:06:07.196 7fb939a4a1c0 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/os/filestore/FileStore.cc: In function 'void FileStore::_do_transaction(ObjectStore::Transaction&, uint64_t, int, | |
| ThreadPool::TPHandle*, const char*)' thread 7fb939a4a1c0 time 2019-05-25 01:06:07.195503 | |
| /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/os/filestore/FileStore.cc: 3236: FAILED assert(0 == "unexpected error") | |
| ceph version 13.2.4 (b10be4d44915a4d78a8e06aa31919e74927b142e) mimic (stable) | |
| 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0xff) [0x7fb930e8316f] | |
| 2: (()+0x25a337) [0x7fb930e83337] | |
| 3: (FileStore::_do_transaction(ObjectStore::Transaction&, unsigned long, int, ThreadPool::TPHandle*, char const*)+0xbaf) [0x55b730f07d6f] | |
| 4: (FileStore::_do_transactions(std::vector<ObjectStore::Transaction, std::allocator<ObjectStore::Transaction> >&, unsigned long, ThreadPool::TPHandle*, char const*)+0x48) [0x55b730f0e278] | |
| 5: (JournalingObjectStore::journal_replay(unsigned long)+0x807) [0x55b730f267a7] | |
| 6: (FileStore::mount()+0x4a48) [0x55b730efb918] | |
| 7: (OSD::init()+0x28f) [0x55b730bae41f] | |
| 8: (main()+0x23a0) [0x55b730a8c670] | |
| 9: (__libc_start_main()+0xf5) [0x7fb92ca193d5] | |
| 10: (()+0x384db0) [0x55b730b64db0] | |
| NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. | |
| 2019-05-25 01:06:07.196 7fb939a4a1c0 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/os/filestore/FileStore.cc: In function 'void FileStore::_do_transaction(ObjectStore::Transaction&, uint64_t, int, | |
| ThreadPool::TPHandle*, const char*)' thread 7fb939a4a1c0 time 2019-05-25 01:06:07.195503 | |
| /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/os/filestore/FileStore.cc: 3236: FAILED assert(0 == "unexpected error") | |
| ceph version 13.2.4 (b10be4d44915a4d78a8e06aa31919e74927b142e) mimic (stable) | |
| 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0xff) [0x7fb930e8316f] | |
| 2: (()+0x25a337) [0x7fb930e83337] | |
| 3: (FileStore::_do_transaction(ObjectStore::Transaction&, unsigned long, int, ThreadPool::TPHandle*, char const*)+0xbaf) [0x55b730f07d6f] | |
| 4: (FileStore::_do_transactions(std::vector<ObjectStore::Transaction, std::allocator<ObjectStore::Transaction> >&, unsigned long, ThreadPool::TPHandle*, char const*)+0x48) [0x55b730f0e278] | |
| 5: (JournalingObjectStore::journal_replay(unsigned long)+0x807) [0x55b730f267a7] | |
| 6: (FileStore::mount()+0x4a48) [0x55b730efb918] | |
| 7: (OSD::init()+0x28f) [0x55b730bae41f] | |
| 8: (main()+0x23a0) [0x55b730a8c670] | |
| 9: (__libc_start_main()+0xf5) [0x7fb92ca193d5] | |
| 10: (()+0x384db0) [0x55b730b64db0] | |
| NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. | |
| --- begin dump of recent events --- | |
| -302> 2019-05-25 01:06:06.852 7fb939a4a1c0 5 asok(0x55b73272a5a0) register_command perfcounters_dump hook 0x55b7326fe0d0 | |
| -301> 2019-05-25 01:06:06.852 7fb939a4a1c0 5 asok(0x55b73272a5a0) register_command 1 hook 0x55b7326fe0d0 | |
| -300> 2019-05-25 01:06:06.852 7fb939a4a1c0 5 asok(0x55b73272a5a0) register_command perf dump hook 0x55b7326fe0d0 | |
| -299> 2019-05-25 01:06:06.852 7fb939a4a1c0 5 asok(0x55b73272a5a0) register_command perfcounters_schema hook 0x55b7326fe0d0 | |
| -298> 2019-05-25 01:06:06.852 7fb939a4a1c0 5 asok(0x55b73272a5a0) register_command perf histogram dump hook 0x55b7326fe0d0 | |
| -297> 2019-05-25 01:06:06.852 7fb939a4a1c0 5 asok(0x55b73272a5a0) register_command 2 hook 0x55b7326fe0d0 | |
| -296> 2019-05-25 01:06:06.852 7fb939a4a1c0 5 asok(0x55b73272a5a0) register_command perf schema hook 0x55b7326fe0d0 | |
| -295> 2019-05-25 01:06:06.852 7fb939a4a1c0 5 asok(0x55b73272a5a0) register_command perf histogram schema hook 0x55b7326fe0d0 | |
| -294> 2019-05-25 01:06:06.852 7fb939a4a1c0 5 asok(0x55b73272a5a0) register_command perf reset hook 0x55b7326fe0d0 | |
| -293> 2019-05-25 01:06:06.852 7fb939a4a1c0 5 asok(0x55b73272a5a0) register_command config show hook 0x55b7326fe0d0 | |
| -292> 2019-05-25 01:06:06.852 7fb939a4a1c0 5 asok(0x55b73272a5a0) register_command config help hook 0x55b7326fe0d0 | |
| -291> 2019-05-25 01:06:06.852 7fb939a4a1c0 5 asok(0x55b73272a5a0) register_command config set hook 0x55b7326fe0d0 | |
| -290> 2019-05-25 01:06:06.852 7fb939a4a1c0 5 asok(0x55b73272a5a0) register_command config unset hook 0x55b7326fe0d0 | |
| -289> 2019-05-25 01:06:06.852 7fb939a4a1c0 5 asok(0x55b73272a5a0) register_command config get hook 0x55b7326fe0d0 | |
| -288> 2019-05-25 01:06:06.852 7fb939a4a1c0 5 asok(0x55b73272a5a0) register_command config diff hook 0x55b7326fe0d0 | |
| -287> 2019-05-25 01:06:06.852 7fb939a4a1c0 5 asok(0x55b73272a5a0) register_command config diff get hook 0x55b7326fe0d0 | |
| -286> 2019-05-25 01:06:06.852 7fb939a4a1c0 5 asok(0x55b73272a5a0) register_command log flush hook 0x55b7326fe0d0 | |
| -285> 2019-05-25 01:06:06.852 7fb939a4a1c0 5 asok(0x55b73272a5a0) register_command log dump hook 0x55b7326fe0d0 | |
| -284> 2019-05-25 01:06:06.852 7fb939a4a1c0 5 asok(0x55b73272a5a0) register_command log reopen hook 0x55b7326fe0d0 | |
| -283> 2019-05-25 01:06:06.852 7fb939a4a1c0 5 asok(0x55b73272a5a0) register_command dump_mempools hook 0x55b732702548 | |
| -282> 2019-05-25 01:06:06.856 7fb939a4a1c0 10 monclient: get_monmap_and_config | |
| -281> 2019-05-25 01:06:06.868 7fb939a4a1c0 10 monclient: build_initial_monmap | |
| -280> 2019-05-25 01:06:06.868 7fb929bce700 2 Event(0x55b732a5ac80 nevent=5000 time_id=1).set_owner idx=0 owner=140433245923072 | |
| -279> 2019-05-25 01:06:06.868 7fb9293cd700 2 Event(0x55b732a5b480 nevent=5000 time_id=1).set_owner idx=1 owner=140433237530368 | |
| -278> 2019-05-25 01:06:06.868 7fb928bcc700 2 Event(0x55b732a5b880 nevent=5000 time_id=1).set_owner idx=2 owner=140433229137664 | |
| -277> 2019-05-25 01:06:06.868 7fb939a4a1c0 1 Processor -- start | |
| -276> 2019-05-25 01:06:06.868 7fb939a4a1c0 1 -- - start start | |
| -275> 2019-05-25 01:06:06.868 7fb939a4a1c0 10 monclient: init | |
| -274> 2019-05-25 01:06:06.868 7fb939a4a1c0 5 adding auth protocol: cephx | |
| -273> 2019-05-25 01:06:06.868 7fb939a4a1c0 10 monclient: auth_supported 2 method cephx | |
| -272> 2019-05-25 01:06:06.868 7fb939a4a1c0 2 auth: KeyRing::load: loaded key file /var/lib/rook/osd1/keyring | |
| -271> 2019-05-25 01:06:06.868 7fb939a4a1c0 10 monclient: _reopen_session rank -1 | |
| -270> 2019-05-25 01:06:06.868 7fb939a4a1c0 10 monclient(hunting): picked mon.noname-c con 0x55b732b2a600 addr 10.96.141.250:6790/0 | |
| -269> 2019-05-25 01:06:06.868 7fb939a4a1c0 10 monclient(hunting): picked mon.noname-b con 0x55b732b2ac00 addr 10.97.187.117:6790/0 | |
| -268> 2019-05-25 01:06:06.868 7fb939a4a1c0 1 -- - --> 10.96.141.250:6790/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b732701200 con 0 | |
| -267> 2019-05-25 01:06:06.868 7fb939a4a1c0 1 -- - --> 10.97.187.117:6790/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b732701440 con 0 | |
| -266> 2019-05-25 01:06:06.868 7fb939a4a1c0 10 monclient(hunting): _renew_subs | |
| -265> 2019-05-25 01:06:06.868 7fb939a4a1c0 10 monclient(hunting): authenticate will time out at 2019-05-25 01:11:06.871859 | |
| -264> 2019-05-25 01:06:06.868 7fb928bcc700 1 -- 10.244.1.168:0/75788629 learned_addr learned my addr 10.244.1.168:0/75788629 | |
| -263> 2019-05-25 01:06:06.868 7fb928bcc700 2 -- 10.244.1.168:0/75788629 >> 10.97.187.117:6790/0 conn(0x55b732b2ac00 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=0)._process_connection got newly_acked_seq 0 vs out_seq 0 | |
| -262> 2019-05-25 01:06:06.868 7fb928bcc700 5 -- 10.244.1.168:0/75788629 >> 10.97.187.117:6790/0 conn(0x55b732b2ac00 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=21211 cs=1 l=1). rx mon.2 seq 1 0x55b732701440 mon_map magic: 0 v1 | |
| -261> 2019-05-25 01:06:06.868 7fb928bcc700 5 -- 10.244.1.168:0/75788629 >> 10.97.187.117:6790/0 conn(0x55b732b2ac00 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=21211 cs=1 l=1). rx mon.2 seq 2 0x55b732701b00 auth_reply(proto 2 0 (0) Success) v1 | |
| -260> 2019-05-25 01:06:06.868 7fb9283cb700 1 -- 10.244.1.168:0/75788629 <== mon.2 10.97.187.117:6790/0 1 ==== mon_map magic: 0 v1 ==== 361+0+0 (1628175805 0 0) 0x55b732701440 con 0x55b732b2ac00 | |
| -259> 2019-05-25 01:06:06.868 7fb9283cb700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1 | |
| -258> 2019-05-25 01:06:06.868 7fb9283cb700 10 monclient(hunting): got monmap 7, mon.noname-b is now rank -1 | |
| -257> 2019-05-25 01:06:06.868 7fb9283cb700 10 monclient(hunting): dump: | |
| epoch 7 | |
| fsid e5a100b0-6abd-4968-8895-300501aa9200 | |
| last_changed 2019-05-20 06:34:30.914877 | |
| created 2019-04-06 22:32:42.983393 | |
| 0: 10.96.141.250:6790/0 mon.c | |
| 1: 10.96.237.13:6790/0 mon.a | |
| 2: 10.97.187.117:6790/0 mon.e | |
| -256> 2019-05-25 01:06:06.868 7fb9283cb700 1 -- 10.244.1.168:0/75788629 <== mon.2 10.97.187.117:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3540665034 0 0) 0x55b732701b00 con 0x55b732b2ac00 | |
| -255> 2019-05-25 01:06:06.868 7fb9283cb700 10 monclient(hunting): my global_id is 677543 | |
| -254> 2019-05-25 01:06:06.868 7fb9283cb700 1 -- 10.244.1.168:0/75788629 --> 10.97.187.117:6790/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x55b732701440 con 0 | |
| -253> 2019-05-25 01:06:06.868 7fb928bcc700 5 -- 10.244.1.168:0/75788629 >> 10.97.187.117:6790/0 conn(0x55b732b2ac00 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=21211 cs=1 l=1). rx mon.2 seq 3 0x55b732701440 auth_reply(proto 2 0 (0) Success) v1 | |
| -252> 2019-05-25 01:06:06.868 7fb9283cb700 1 -- 10.244.1.168:0/75788629 <== mon.2 10.97.187.117:6790/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1442135311 0 0) 0x55b732701440 con 0x55b732b2ac00 | |
| -251> 2019-05-25 01:06:06.868 7fb9283cb700 1 -- 10.244.1.168:0/75788629 >> 10.96.141.250:6790/0 conn(0x55b732b2a600 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=0).mark_down | |
| -250> 2019-05-25 01:06:06.868 7fb9283cb700 2 -- 10.244.1.168:0/75788629 >> 10.96.141.250:6790/0 conn(0x55b732b2a600 :-1 s=STATE_CONNECTING_RE pgs=0 cs=0 l=0)._stop | |
| -249> 2019-05-25 01:06:06.868 7fb9283cb700 1 monclient: found mon.e | |
| -248> 2019-05-25 01:06:06.868 7fb9283cb700 10 monclient: _send_mon_message to mon.e at 10.97.187.117:6790/0 | |
| -247> 2019-05-25 01:06:06.868 7fb9283cb700 1 -- 10.244.1.168:0/75788629 --> 10.97.187.117:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b732a5bc00 con 0 | |
| -246> 2019-05-25 01:06:06.868 7fb9283cb700 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2019-05-25 01:05:36.872426) | |
| -245> 2019-05-25 01:06:06.868 7fb9283cb700 10 monclient: _send_mon_message to mon.e at 10.97.187.117:6790/0 | |
| -244> 2019-05-25 01:06:06.868 7fb9283cb700 1 -- 10.244.1.168:0/75788629 --> 10.97.187.117:6790/0 -- auth(proto 2 2 bytes epoch 0) v1 -- 0x55b732701b00 con 0 | |
| -243> 2019-05-25 01:06:06.868 7fb939a4a1c0 5 monclient: authenticate success, global_id 677543 | |
| -242> 2019-05-25 01:06:06.872 7fb928bcc700 5 -- 10.244.1.168:0/75788629 >> 10.97.187.117:6790/0 conn(0x55b732b2ac00 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=21211 cs=1 l=1). rx mon.2 seq 4 0x55b732b38200 config(0 keys) v1 | |
| -241> 2019-05-25 01:06:06.872 7fb9283cb700 1 -- 10.244.1.168:0/75788629 <== mon.2 10.97.187.117:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (0 0 0) 0x55b732b38200 con 0x55b732b2ac00 | |
| -240> 2019-05-25 01:06:06.872 7fb9283cb700 10 monclient: handle_config config(0 keys) v1 | |
| -239> 2019-05-25 01:06:06.872 7fb928bcc700 5 -- 10.244.1.168:0/75788629 >> 10.97.187.117:6790/0 conn(0x55b732b2ac00 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=21211 cs=1 l=1). rx mon.2 seq 5 0x55b732701b00 mon_map magic: 0 v1 | |
| -238> 2019-05-25 01:06:06.872 7fb939a4a1c0 10 monclient: get_monmap_and_config success | |
| -237> 2019-05-25 01:06:06.872 7fb939a4a1c0 10 monclient: shutdown | |
| -236> 2019-05-25 01:06:06.872 7fb9283cb700 1 -- 10.244.1.168:0/75788629 <== mon.2 10.97.187.117:6790/0 5 ==== mon_map magic: 0 v1 ==== 361+0+0 (1628175805 0 0) 0x55b732701b00 con 0x55b732b2ac00 | |
| -235> 2019-05-25 01:06:06.872 7fb926bc8700 4 set_mon_vals no callback set | |
| -234> 2019-05-25 01:06:06.872 7fb939a4a1c0 1 -- 10.244.1.168:0/75788629 >> 10.97.187.117:6790/0 conn(0x55b732b2ac00 :-1 s=STATE_OPEN pgs=21211 cs=1 l=1).mark_down | |
| -233> 2019-05-25 01:06:06.872 7fb928bcc700 5 -- 10.244.1.168:0/75788629 >> 10.97.187.117:6790/0 conn(0x55b732b2ac00 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=21211 cs=1 l=1). rx mon.2 seq 6 0x55b732701d40 auth_reply(proto 2 0 (0) Success) v1 | |
| -232> 2019-05-25 01:06:06.872 7fb939a4a1c0 2 -- 10.244.1.168:0/75788629 >> 10.97.187.117:6790/0 conn(0x55b732b2ac00 :-1 s=STATE_OPEN pgs=21211 cs=1 l=1)._stop | |
| -231> 2019-05-25 01:06:06.872 7fb9283cb700 10 monclient: discarding stray monitor message mon_map magic: 0 v1 | |
| -230> 2019-05-25 01:06:06.872 7fb939a4a1c0 1 -- 10.244.1.168:0/75788629 shutdown_connections | |
| -229> 2019-05-25 01:06:06.872 7fb939a4a1c0 5 -- 10.244.1.168:0/75788629 shutdown_connections mark down 10.97.187.117:6790/0 0x55b732b2ac00 | |
| -228> 2019-05-25 01:06:06.872 7fb939a4a1c0 5 -- 10.244.1.168:0/75788629 shutdown_connections mark down 10.96.141.250:6790/0 0x55b732b2a600 | |
| -227> 2019-05-25 01:06:06.872 7fb939a4a1c0 5 -- 10.244.1.168:0/75788629 shutdown_connections delete 0x55b732b2a600 | |
| -226> 2019-05-25 01:06:06.872 7fb939a4a1c0 5 -- 10.244.1.168:0/75788629 shutdown_connections delete 0x55b732b2ac00 | |
| -225> 2019-05-25 01:06:06.872 7fb939a4a1c0 1 -- 10.244.1.168:0/75788629 shutdown_connections | |
| -224> 2019-05-25 01:06:06.872 7fb939a4a1c0 1 -- 10.244.1.168:0/75788629 wait complete. | |
| -223> 2019-05-25 01:06:06.872 7fb939a4a1c0 1 -- 10.244.1.168:0/75788629 >> 10.244.1.168:0/75788629 conn(0x55b732b2a000 :-1 s=STATE_NONE pgs=0 cs=0 l=0).mark_down | |
| -222> 2019-05-25 01:06:06.872 7fb939a4a1c0 2 -- 10.244.1.168:0/75788629 >> 10.244.1.168:0/75788629 conn(0x55b732b2a000 :-1 s=STATE_NONE pgs=0 cs=0 l=0)._stop | |
| -221> 2019-05-25 01:06:06.872 7fb939a4a1c0 0 ceph version 13.2.4 (b10be4d44915a4d78a8e06aa31919e74927b142e) mimic (stable), process ceph-osd, pid 21305 | |
| -220> 2019-05-25 01:06:06.872 7fb939a4a1c0 0 pidfile_write: ignore empty --pid-file | |
| -219> 2019-05-25 01:06:06.884 7fb939a4a1c0 5 asok(0x55b73272a5a0) init /var/lib/rook/osd1/rook-ceph-osd.1.asok | |
| -218> 2019-05-25 01:06:06.884 7fb939a4a1c0 5 asok(0x55b73272a5a0) bind_and_listen /var/lib/rook/osd1/rook-ceph-osd.1.asok | |
| -217> 2019-05-25 01:06:06.884 7fb939a4a1c0 5 asok(0x55b73272a5a0) register_command 0 hook 0x55b7326fd4b0 | |
| -216> 2019-05-25 01:06:06.884 7fb939a4a1c0 5 asok(0x55b73272a5a0) register_command version hook 0x55b7326fd4b0 | |
| -215> 2019-05-25 01:06:06.884 7fb939a4a1c0 5 asok(0x55b73272a5a0) register_command git_version hook 0x55b7326fd4b0 | |
| -214> 2019-05-25 01:06:06.884 7fb939a4a1c0 5 asok(0x55b73272a5a0) register_command help hook 0x55b7326fe540 | |
| -213> 2019-05-25 01:06:06.884 7fb939a4a1c0 5 asok(0x55b73272a5a0) register_command get_command_descriptions hook 0x55b7326fe550 | |
| -212> 2019-05-25 01:06:06.884 7fb927bca700 5 asok(0x55b73272a5a0) entry start | |
| -211> 2019-05-25 01:06:06.884 7fb939a4a1c0 1 -- 10.244.1.168:0/0 learned_addr learned my addr 10.244.1.168:0/0 | |
| -210> 2019-05-25 01:06:06.884 7fb939a4a1c0 1 -- 10.244.1.168:6800/21305 _finish_bind bind my_inst.addr is 10.244.1.168:6800/21305 | |
| -209> 2019-05-25 01:06:06.884 7fb939a4a1c0 1 -- 10.244.1.168:0/0 learned_addr learned my addr 10.244.1.168:0/0 | |
| -208> 2019-05-25 01:06:06.884 7fb939a4a1c0 1 -- 10.244.1.168:6801/21305 _finish_bind bind my_inst.addr is 10.244.1.168:6801/21305 | |
| -207> 2019-05-25 01:06:06.884 7fb939a4a1c0 1 -- 10.244.1.168:0/0 learned_addr learned my addr 10.244.1.168:0/0 | |
| -206> 2019-05-25 01:06:06.884 7fb939a4a1c0 1 -- 10.244.1.168:6802/21305 _finish_bind bind my_inst.addr is 10.244.1.168:6802/21305 | |
| -205> 2019-05-25 01:06:06.884 7fb939a4a1c0 1 -- 10.244.1.168:0/0 learned_addr learned my addr 10.244.1.168:0/0 | |
| -204> 2019-05-25 01:06:06.884 7fb939a4a1c0 1 -- 10.244.1.168:6803/21305 _finish_bind bind my_inst.addr is 10.244.1.168:6803/21305 | |
| -203> 2019-05-25 01:06:06.884 7fb939a4a1c0 10 monclient: build_initial_monmap | |
| -202> 2019-05-25 01:06:06.888 7fb939a4a1c0 0 load: jerasure load: lrc load: isa | |
| -201> 2019-05-25 01:06:06.888 7fb939a4a1c0 5 adding auth protocol: cephx | |
| -200> 2019-05-25 01:06:06.888 7fb939a4a1c0 5 adding auth protocol: cephx | |
| -199> 2019-05-25 01:06:06.888 7fb939a4a1c0 0 filestore(/var/lib/rook/osd1) backend generic (magic 0xef53) | |
| -198> 2019-05-25 01:06:06.888 7fb939a4a1c0 5 asok(0x55b73272a5a0) register_command objecter_requests hook 0x55b7326fe6e0 | |
| -197> 2019-05-25 01:06:06.888 7fb939a4a1c0 1 -- 10.244.1.168:6800/21305 start start | |
| -196> 2019-05-25 01:06:06.888 7fb939a4a1c0 1 -- - start start | |
| -195> 2019-05-25 01:06:06.888 7fb939a4a1c0 1 -- - start start | |
| -194> 2019-05-25 01:06:06.888 7fb939a4a1c0 1 -- 10.244.1.168:6803/21305 start start | |
| -193> 2019-05-25 01:06:06.888 7fb939a4a1c0 1 -- 10.244.1.168:6802/21305 start start | |
| -192> 2019-05-25 01:06:06.888 7fb939a4a1c0 1 -- 10.244.1.168:6801/21305 start start | |
| -191> 2019-05-25 01:06:06.888 7fb939a4a1c0 1 -- - start start | |
| -190> 2019-05-25 01:06:06.888 7fb939a4a1c0 0 filestore(/var/lib/rook/osd1) backend generic (magic 0xef53) | |
| -189> 2019-05-25 01:06:06.888 7fb939a4a1c0 0 genericfilestorebackend(/var/lib/rook/osd1) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option | |
| -188> 2019-05-25 01:06:06.888 7fb939a4a1c0 0 genericfilestorebackend(/var/lib/rook/osd1) detect_features: SEEK_DATA/SEEK_HOLE is disabled via 'filestore seek data hole' config option | |
| -187> 2019-05-25 01:06:06.888 7fb939a4a1c0 0 genericfilestorebackend(/var/lib/rook/osd1) detect_features: splice() is disabled via 'filestore splice' config option | |
| -186> 2019-05-25 01:06:06.892 7fb939a4a1c0 0 genericfilestorebackend(/var/lib/rook/osd1) detect_features: syncfs(2) syscall fully supported (by glibc and kernel) | |
| -185> 2019-05-25 01:06:06.892 7fb939a4a1c0 0 filestore(/var/lib/rook/osd1) limited size xattrs | |
| -184> 2019-05-25 01:06:06.892 7fb939a4a1c0 0 filestore(/var/lib/rook/osd1) start omap initiation | |
| -183> 2019-05-25 01:06:06.892 7fb939a4a1c0 0 set rocksdb option compaction_readahead_size = 2097152 | |
| -182> 2019-05-25 01:06:06.892 7fb939a4a1c0 0 set rocksdb option compression = kNoCompression | |
| -181> 2019-05-25 01:06:06.892 7fb939a4a1c0 0 set rocksdb option max_background_jobs = 10 | |
| -180> 2019-05-25 01:06:06.892 7fb939a4a1c0 0 set rocksdb option compaction_readahead_size = 2097152 | |
| -179> 2019-05-25 01:06:06.892 7fb939a4a1c0 0 set rocksdb option compression = kNoCompression | |
| -178> 2019-05-25 01:06:06.892 7fb939a4a1c0 0 set rocksdb option max_background_jobs = 10 | |
| -177> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: RocksDB version: 5.13.0 | |
| -176> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ | |
| -175> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Compile date Jan 4 2019 | |
| -174> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: DB SUMMARY | |
| -173> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: CURRENT file: CURRENT | |
| -172> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: IDENTITY file: IDENTITY | |
| -171> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: MANIFEST file: MANIFEST-006994 size: 4010 Bytes | |
| -170> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: SST files in /var/lib/rook/osd1/current/omap dir, Total Num: 38, files: 002404.sst 002406.sst 002408.sst 002410.sst 002412.sst 002414.sst 002418.sst 002422.sst 002426.sst | |
| -169> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Write Ahead Log file in /var/lib/rook/osd1/current/omap: 006995.log size: 0 ; | |
| -168> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.error_if_exists: 0 | |
| -167> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.create_if_missing: 1 | |
| -166> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.paranoid_checks: 1 | |
| -165> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.env: 0x55b7318001e0 | |
| -164> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.info_log: 0x55b732a55a20 | |
| -163> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_file_opening_threads: 16 | |
| -162> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.statistics: (nil) | |
| -161> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.use_fsync: 0 | |
| -160> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_log_file_size: 0 | |
| -159> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_manifest_file_size: 18446744073709551615 | |
| -158> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.log_file_time_to_roll: 0 | |
| -157> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.keep_log_file_num: 1000 | |
| -156> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.recycle_log_file_num: 0 | |
| -155> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.allow_fallocate: 1 | |
| -154> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.allow_mmap_reads: 0 | |
| -153> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.allow_mmap_writes: 0 | |
| -152> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.use_direct_reads: 0 | |
| -151> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 | |
| -150> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.create_missing_column_families: 0 | |
| -149> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.db_log_dir: | |
| -148> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.wal_dir: /var/lib/rook/osd1/current/omap | |
| -147> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.table_cache_numshardbits: 6 | |
| -146> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_subcompactions: 1 | |
| -145> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_background_flushes: -1 | |
| -144> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.WAL_ttl_seconds: 0 | |
| -143> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.WAL_size_limit_MB: 0 | |
| -142> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 | |
| -141> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.is_fd_close_on_exec: 1 | |
| -140> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.advise_random_on_open: 1 | |
| -139> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.db_write_buffer_size: 0 | |
| -138> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.write_buffer_manager: 0x55b732c0ad50 | |
| -137> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 | |
| -136> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 1 | |
| -135> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 | |
| -134> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.use_adaptive_mutex: 0 | |
| -133> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.rate_limiter: (nil) | |
| -132> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 | |
| -131> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.wal_recovery_mode: 2 | |
| -130> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.enable_thread_tracking: 0 | |
| -129> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.enable_pipelined_write: 0 | |
| -128> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 | |
| -127> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 | |
| -126> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 | |
| -125> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 | |
| -124> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.row_cache: None | |
| -123> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.wal_filter: None | |
| -122> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 | |
| -121> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.allow_ingest_behind: 0 | |
| -120> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.preserve_deletes: 0 | |
| -119> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.two_write_queues: 0 | |
| -118> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.manual_wal_flush: 0 | |
| -117> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_background_jobs: 10 | |
| -116> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_background_compactions: -1 | |
| -115> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 | |
| -114> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 | |
| -113> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.delayed_write_rate : 16777216 | |
| -112> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_total_wal_size: 0 | |
| -111> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 | |
| -110> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.stats_dump_period_sec: 600 | |
| -109> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_open_files: -1 | |
| -108> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.bytes_per_sync: 0 | |
| -107> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.wal_bytes_per_sync: 0 | |
| -106> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compaction_readahead_size: 2097152 | |
| -105> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Compression algorithms supported: | |
| -104> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 | |
| -103> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: kZSTD supported: 0 | |
| -102> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: kXpressCompression supported: 0 | |
| -101> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: kLZ4HCCompression supported: 1 | |
| -100> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: kLZ4Compression supported: 1 | |
| -99> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: kBZip2Compression supported: 0 | |
| -98> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: kZlibCompression supported: 1 | |
| -97> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: kSnappyCompression supported: 1 | |
| -96> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Fast CRC32 supported: Supported on x86 | |
| -95> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/rocksdb/db/version_set.cc:3088] Recovering from manifest file: MANIFEST-006994 | |
| -94> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/rocksdb/db/column_family.cc:474] --------------- Options for column family [default]: | |
| -93> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator | |
| -92> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.merge_operator: | |
| -91> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compaction_filter: None | |
| -90> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compaction_filter_factory: None | |
| -89> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.memtable_factory: SkipListFactory | |
| -88> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.table_factory: BlockBasedTable | |
| -87> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55b7326fd500) | |
| cache_index_and_filter_blocks: 1 | |
| cache_index_and_filter_blocks_with_high_priority: 1 | |
| pin_l0_filter_and_index_blocks_in_cache: 1 | |
| index_type: 0 | |
| hash_index_allow_collision: 1 | |
| checksum: 1 | |
| no_block_cache: 0 | |
| block_cache: 0x55b732c00b00 | |
| block_cache_name: BinnedLRUCache | |
| block_cache_options: | |
| capacity : 536870912 | |
| num_shard_bits : 4 | |
| strict_capacity_limit : 0 | |
| high_pri_pool_ratio: 0.000 | |
| block_cache_compressed: (nil) | |
| persistent_cache: (nil) | |
| block_size: 4096 | |
| block_size_deviation: 10 | |
| block_restart_interval: 16 | |
| index_block_restart_interval: 1 | |
| metadata_block_size: 4096 | |
| partition_filters: 0 | |
| use_delta_encoding: 1 | |
| filter_policy: rocksdb.BuiltinBloomFilter | |
| whole_key_filtering: 1 | |
| verify_compression: 0 | |
| read_amp_bytes_per_bit: 0 | |
| format_version: 2 | |
| enable_index_compression: 1 | |
| block_align: 0 | |
| -86> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.write_buffer_size: 67108864 | |
| -85> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_write_buffer_number: 2 | |
| -84> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compression: NoCompression | |
| -83> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.bottommost_compression: Disabled | |
| -82> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.prefix_extractor: nullptr | |
| -81> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr | |
| -80> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.num_levels: 7 | |
| -79> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 | |
| -78> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 | |
| -77> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compression_opts.window_bits: -14 | |
| -76> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compression_opts.level: -1 | |
| -75> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compression_opts.strategy: 0 | |
| -74> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 | |
| -73> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 | |
| -72> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 | |
| -71> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 | |
| -70> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 | |
| -69> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.target_file_size_base: 67108864 | |
| -68> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.target_file_size_multiplier: 1 | |
| -67> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 | |
| -66> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 0 | |
| -65> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 | |
| -64> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 | |
| -63> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 | |
| -62> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 | |
| -61> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 | |
| -60> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 | |
| -59> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 | |
| -58> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 | |
| -57> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 | |
| -56> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 | |
| -55> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.arena_block_size: 8388608 | |
| -54> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 | |
| -53> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 | |
| -52> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 | |
| -51> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.disable_auto_compactions: 0 | |
| -50> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel | |
| -49> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compaction_pri: kByCompensatedSize | |
| -48> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 | |
| -47> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 | |
| -46> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 | |
| -45> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 | |
| -44> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 | |
| -43> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize | |
| -42> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 | |
| -41> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 | |
| -40> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.compaction_options_fifo.ttl: 0 | |
| -39> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.table_properties_collectors: | |
| -38> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.inplace_update_support: 0 | |
| -37> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.inplace_update_num_locks: 10000 | |
| -36> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 | |
| -35> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.memtable_huge_page_size: 0 | |
| -34> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.bloom_locality: 0 | |
| -33> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.max_successive_merges: 0 | |
| -32> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.optimize_filters_for_hits: 0 | |
| -31> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.paranoid_file_checks: 0 | |
| -30> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.force_consistency_checks: 0 | |
| -29> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.report_bg_io_stats: 0 | |
| -28> 2019-05-25 01:06:06.892 7fb939a4a1c0 4 rocksdb: Options.ttl: 0 | |
| -27> 2019-05-25 01:06:06.920 7fb939a4a1c0 4 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/rocksdb/db/version_set.cc:3362] Recovered from manifest file:/var/lib/rook/osd1/current/omap/MANIFEST-006994 succeeded,manifest_file_number is 6994, next_file_number is 6997, last_sequence is 302676171, log_number is 0,prev_log_number is 0,max_column_family is 0,deleted_log_number is 6992 | |
| -26> 2019-05-25 01:06:06.920 7fb939a4a1c0 4 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/rocksdb/db/version_set.cc:3370] Column family [default] (ID 0), log number is 6993 | |
| -25> 2019-05-25 01:06:06.920 7fb939a4a1c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1558746366920893, "job": 1, "event": "recovery_started", "log_files": [6995]} | |
| -24> 2019-05-25 01:06:06.920 7fb939a4a1c0 4 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/rocksdb/db/db_impl_open.cc:551] Recovering log #6995 mode 2 | |
| -23> 2019-05-25 01:06:06.920 7fb939a4a1c0 4 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/rocksdb/db/version_set.cc:2863] Creating manifest 6997 | |
| -22> 2019-05-25 01:06:06.920 7fb939a4a1c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1558746366921352, "job": 1, "event": "recovery_finished"} | |
| -21> 2019-05-25 01:06:06.920 7fb939a4a1c0 3 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/rocksdb/db/column_family.cc:751] [default] Stopping writes because we have 36 level-0 files | |
| -20> 2019-05-25 01:06:06.920 7fb939a4a1c0 5 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/rocksdb/db/db_impl_files.cc:380] [JOB 2] Delete /var/lib/rook/osd1/current/omap//MANIFEST-006994 type=3 #6994 -- OK | |
| -19> 2019-05-25 01:06:06.924 7fb939a4a1c0 5 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/rocksdb/db/db_impl_files.cc:380] [JOB 2] Delete /var/lib/rook/osd1/current/omap/006998.sst type=2 #6998 -- OK | |
| -18> 2019-05-25 01:06:06.924 7fb939a4a1c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1558746366926593, "job": 2, "event": "table_file_deletion", "file_number": 6998} | |
| -17> 2019-05-25 01:06:06.924 7fb939a4a1c0 5 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/rocksdb/db/db_impl_files.cc:380] [JOB 2] Delete /var/lib/rook/osd1/current/omap//006995.log type=0 #6995 -- OK | |
| -16> 2019-05-25 01:06:06.924 7fb939a4a1c0 4 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/rocksdb/db/db_impl_open.cc:1218] DB pointer 0x55b732c1e000 | |
| -15> 2019-05-25 01:06:06.924 7fb923359700 3 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/rocksdb/db/db_impl.cc:490] ------- DUMPING STATS ------- | |
| -14> 2019-05-25 01:06:06.924 7fb923359700 3 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/rocksdb/db/db_impl.cc:491] | |
| ** DB Stats ** | |
| Uptime(secs): 0.0 total, 0.0 interval | |
| Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s | |
| Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s | |
| Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent | |
| Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s | |
| Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s | |
| Interval stall: 00:00:0.000 H:M:S, 0.0 percent | |
| ** Compaction Stats [default] ** | |
| Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop | |
| ---------------------------------------------------------------------------------------------------------------------------------------------------------- | |
| L0 36/0 84.47 MB 9.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0 | |
| L1 1/0 59.88 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0 | |
| Sum 37/0 144.35 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0 | |
| Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0 | |
| Uptime(secs): 0.0 total, 0.0 interval | |
| Flush(GB): cumulative 0.000, interval 0.000 | |
| AddFile(GB): cumulative 0.000, interval 0.000 | |
| AddFile(Total Files): cumulative 0, interval 0 | |
| AddFile(L0 Files): cumulative 0, interval 0 | |
| AddFile(Keys): cumulative 0, interval 0 | |
| Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds | |
| Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds | |
| Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 1 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 1 total count | |
| ** File Read Latency Histogram By Level [default] ** | |
| ** Compaction Stats [default] ** | |
| Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop | |
| ---------------------------------------------------------------------------------------------------------------------------------------------------------- | |
| L0 36/0 84.47 MB 9.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0 | |
| L1 1/0 59.88 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0 | |
| Sum 37/0 144.35 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0 | |
| Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0 | |
| Uptime(secs): 0.0 total, 0.0 interval | |
| Flush(GB): cumulative 0.000, interval 0.000 | |
| AddFile(GB): cumulative 0.000, interval 0.000 | |
| AddFile(Total Files): cumulative 0, interval 0 | |
| AddFile(L0 Files): cumulative 0, interval 0 | |
| AddFile(Keys): cumulative 0, interval 0 | |
| Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds | |
| Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds | |
| Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 1 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count | |
| ** File Read Latency Histogram By Level [default] ** | |
| -13> 2019-05-25 01:06:06.924 7fb923359700 4 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/rocksdb/db/compaction_job.cc:1494] [default] [JOB 3] Compacting 36@0 + 1@1 files to L1, score 9.00 | |
| -12> 2019-05-25 01:06:06.924 7fb923359700 4 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/rocksdb/db/compaction_job.cc:1498] [default] Compaction start summary: Base version 3 Base level 0, inputs: [2538(160KB) 2534(160KB) 2530(160KB) 2526(160KB) 2522(160KB) 2518(160KB) 2514(160KB) 2510(159KB) 2506(159KB) 2502(158KB) 2498(158KB) 2494(158KB) 2490(158KB) 2486(158KB) 2482(158KB) 2478(158KB) 2474(158KB) 2470(158KB) 2466(158KB) 2462(158KB) 2458(157KB) 2454(157KB) 2450(157KB) 2446(157KB) 2442(157KB) 2438(157KB) 2434(157KB) 2430(157KB) 2426(157KB) 2422(108KB) 2418(57KB) 2414(17KB) 2412(20MB) 2410(20MB) 2408(20MB) 2406(19MB)], [2404(59MB)] | |
| -11> 2019-05-25 01:06:06.924 7fb923359700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1558746366927694, "job": 3, "event": "compaction_started", "files_L0": [2538, 2534, 2530, 2526, 2522, 2518, 2514, 2510, 2506, 2502, 2498, 2494, 2490, 2486, 2482, 2478, 2474, 2470, 2466, 2462, 2458, 2454, 2450, 2446, 2442, 2438, 2434, 2430, 2426, 2422, 2418, 2414, 2412, 2410, 2408, 2406], "files_L1": [2404], "score": 9, "input_data_size": 151363041} | |
| -10> 2019-05-25 01:06:06.928 7fb939a4a1c0 0 filestore(/var/lib/rook/osd1) mount(1808): enabling WRITEAHEAD journal mode: checkpoint is not enabled | |
| -9> 2019-05-25 01:06:06.928 7fb939a4a1c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway | |
| -9> 2019-05-25 01:06:06.928 7fb939a4a1c0 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway | |
| -8> 2019-05-25 01:06:07.192 7fb923359700 3 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/rocksdb/db/db_impl_compaction_flush.cc:1929] Compaction error: Corruption: block checksum mismatch: expected 862584094, got 1969278739 in /var/lib/rook/osd1/current/omap/002408.sst offset 15647059 size 3855 | |
| -7> 2019-05-25 01:06:07.192 7fb923359700 4 rocksdb: (Original Log Time 2019/05/25-01:06:07.195357) [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/rocksdb/db/compaction_job.cc:642] [default] compacted to: base level 1 max bytes base 268435456 files[36 1 0 0 0 0 0] max score 0.00, MB/sec: 565.6 rd, 0.0 wr, level 1, files in(36, 1) out(1) MB in(84.5, 59.9) out(0.0), read-write-amplify(1.7) write-amplify(0.0) Corruption: block checksum mismatch: expected 8625 | |
| -6> 2019-05-25 01:06:07.192 7fb923359700 4 rocksdb: (Original Log Time 2019/05/25-01:06:07.195374) EVENT_LOG_v1 {"time_micros": 1558746367195368, "job": 3, "event": "compaction_finished", "compaction_time_micros": 267619, "output_level": 1, "num_output_files": 1, "total_output_size": 62850129, "num_input_records": 1024106, "num_output_records": 310683, "num_subcompactions": 1, "output_compression": "NoCompression", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [36, 1, 0, 0, 0, 0, 0]} | |
| -5> 2019-05-25 01:06:07.192 7fb923359700 2 rocksdb: [/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/rocksdb/db/db_impl_compaction_flush.cc:1517] Waiting after background compaction error: Corruption: block checksum mismatch: expected 862584094, got 1969278739 in /var/lib/rook/osd1/current/omap/002408.sst offset 15647059 size 3855, Accumulated background error counts: 1 | |
| -4> 2019-05-25 01:06:07.192 7fb939a4a1c0 -1 rocksdb: submit_common error: Corruption: block checksum mismatch: expected 862584094, got 1969278739 in /var/lib/rook/osd1/current/omap/002408.sst offset 15647059 size 3855 code = 2 Rocksdb transaction: | |
| Put( Prefix = _ key = 'SER_0000000000000044_USER_'0x00303030'0000031.00000000000002570200' Value size = 182) | |
| Put( Prefix = _ key = 'SER_0000000000000044_USER_'0x005f6661'stinfo' Value size = 186) | |
| -4> 2019-05-25 01:06:07.192 7fb939a4a1c0 -1 rocksdb: submit_common error: Corruption: block checksum mismatch: expected 862584094, got 1969278739 in /var/lib/rook/osd1/current/omap/002408.sst offset 15647059 size 3855 code = 2 Rocksdb transaction: | |
| Put( Prefix = _ key = 'SER_0000000000000044_USER_'0x00303030'0000031.00000000000002570200' Value size = 182) | |
| Put( Prefix = _ key = 'SER_0000000000000044_USER_'0x005f6661'stinfo' Value size = 186) | |
| -3> 2019-05-25 01:06:07.192 7fb939a4a1c0 -1 filestore(/var/lib/rook/osd1) error (1) Operation not permitted not handled on operation 0x55b7329febfa (100728244.0.3, or op 3, counting from 0) | |
| -3> 2019-05-25 01:06:07.192 7fb939a4a1c0 -1 filestore(/var/lib/rook/osd1) error (1) Operation not permitted not handled on operation 0x55b7329febfa (100728244.0.3, or op 3, counting from 0) | |
| -2> 2019-05-25 01:06:07.192 7fb939a4a1c0 0 filestore(/var/lib/rook/osd1) EPERM suggests file(s) in osd data dir not owned by ceph user, or leveldb corruption | |
| -1> 2019-05-25 01:06:07.192 7fb939a4a1c0 0 filestore(/var/lib/rook/osd1) transaction dump: | |
| { | |
| "ops": [ | |
| { | |
| "op_num": 0, | |
| "op_name": "setattrs", | |
| "collection": "1.55_head", | |
| "oid": "#1:ab34d26c:::rbd_data.68856b8b4567.0000000000000021:head#", | |
| "attr_lens": { | |
| "_": 293, | |
| "snapset": 35 | |
| } | |
| }, | |
| { | |
| "op_num": 1, | |
| "op_name": "op_setallochint", | |
| "collection": "1.55_head", | |
| "oid": "#1:ab34d26c:::rbd_data.68856b8b4567.0000000000000021:head#", | |
| "expected_object_size": "4194304", | |
| "expected_write_size": "4194304" | |
| }, | |
| { | |
| "op_num": 2, | |
| "op_name": "write", | |
| "collection": "1.55_head", | |
| "oid": "#1:ab34d26c:::rbd_data.68856b8b4567.0000000000000021:head#", | |
| "length": 8192, | |
| "offset": 401408, | |
| "bufferlist length": 8192 | |
| }, | |
| { | |
| "op_num": 3, | |
| "op_name": "omap_setkeys", | |
| "collection": "1.55_head", | |
| "oid": "#1:aa000000::::head#", | |
| "attr_lens": { | |
| "0000000031.00000000000002570200": 182, | |
| "_fastinfo": 186 | |
| } | |
| } | |
| ] | |
| } | |
| 0> 2019-05-25 01:06:07.196 7fb939a4a1c0 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/os/filestore/FileStore.cc: In function 'void FileStore::_do_transaction(ObjectStore::Transaction&, uint64_t, int, ThreadPool::TPHandle*, const char*)' thread 7fb939a4a1c0 time 2019-05-25 01:06:07.195503 | |
| /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/os/filestore/FileStore.cc: 3236: FAILED assert(0 == "unexpected error") | |
| ceph version 13.2.4 (b10be4d44915a4d78a8e06aa31919e74927b142e) mimic (stable) | |
| 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0xff) [0x7fb930e8316f] | |
| 2: (()+0x25a337) [0x7fb930e83337] | |
| 3: (FileStore::_do_transaction(ObjectStore::Transaction&, unsigned long, int, ThreadPool::TPHandle*, char const*)+0xbaf) [0x55b730f07d6f] | |
| 4: (FileStore::_do_transactions(std::vector<ObjectStore::Transaction, std::allocator<ObjectStore::Transaction> >&, unsigned long, ThreadPool::TPHandle*, char const*)+0x48) [0x55b730f0e278] | |
| 5: (JournalingObjectStore::journal_replay(unsigned long)+0x807) [0x55b730f267a7] | |
| 6: (FileStore::mount()+0x4a48) [0x55b730efb918] | |
| 7: (OSD::init()+0x28f) [0x55b730bae41f] | |
| 8: (main()+0x23a0) [0x55b730a8c670] | |
| 9: (__libc_start_main()+0xf5) [0x7fb92ca193d5] | |
| 10: (()+0x384db0) [0x55b730b64db0] | |
| NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. | |
| 0> 2019-05-25 01:06:07.196 7fb939a4a1c0 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/os/filestore/FileStore.cc: In function 'void FileStore::_do_transaction(ObjectStore::Transaction&, uint64_t, int, ThreadPool::TPHandle*, const char*)' thread 7fb939a4a1c0 time 2019-05-25 01:06:07.195503 | |
| /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/13.2.4/rpm/el7/BUILD/ceph-13.2.4/src/os/filestore/FileStore.cc: 3236: FAILED assert(0 == "unexpected error") | |
| ceph version 13.2.4 (b10be4d44915a4d78a8e06aa31919e74927b142e) mimic (stable) | |
| 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0xff) [0x7fb930e8316f] | |
| 2: (()+0x25a337) [0x7fb930e83337] | |
| 3: (FileStore::_do_transaction(ObjectStore::Transaction&, unsigned long, int, ThreadPool::TPHandle*, char const*)+0xbaf) [0x55b730f07d6f] | |
| 4: (FileStore::_do_transactions(std::vector<ObjectStore::Transaction, std::allocator<ObjectStore::Transaction> >&, unsigned long, ThreadPool::TPHandle*, char const*)+0x48) [0x55b730f0e278] | |
| 5: (JournalingObjectStore::journal_replay(unsigned long)+0x807) [0x55b730f267a7] | |
| 6: (FileStore::mount()+0x4a48) [0x55b730efb918] | |
| 7: (OSD::init()+0x28f) [0x55b730bae41f] | |
| 8: (main()+0x23a0) [0x55b730a8c670] | |
| 9: (__libc_start_main()+0xf5) [0x7fb92ca193d5] | |
| 10: (()+0x384db0) [0x55b730b64db0] | |
| NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. | |
| --- logging levels --- | |
| 0/ 5 none | |
| 0/ 1 lockdep | |
| 0/ 1 context | |
| 1/ 1 crush | |
| 1/ 5 mds | |
| 1/ 5 mds_balancer | |
| 1/ 5 mds_locker | |
| 1/ 5 mds_log | |
| 1/ 5 mds_log_expire | |
| 1/ 5 mds_migrator | |
| 0/ 1 buffer | |
| 0/ 1 timer | |
| 0/ 1 filer | |
| 0/ 1 striper | |
| 0/ 1 objecter | |
| 0/ 0 rados | |
| 0/ 5 rbd | |
| 0/ 5 rbd_mirror | |
| 0/ 5 rbd_replay | |
| 0/ 5 journaler | |
| 0/ 5 objectcacher | |
| 0/ 5 client | |
| 0/ 0 osd | |
| 0/ 5 optracker | |
| 0/ 5 objclass | |
| 0/ 0 filestore | |
| 0/ 0 journal | |
| 0/ 5 ms | |
| 0/ 0 mon | |
| 0/10 monc | |
| 1/ 5 paxos | |
| 0/ 5 tp | |
| 1/ 5 auth | |
| 1/ 5 crypto | |
| 1/ 1 finisher | |
| 1/ 1 reserver | |
| 1/ 5 heartbeatmap | |
| 1/ 5 perfcounter | |
| 1/ 5 rgw | |
| 1/ 5 rgw_sync | |
| 1/10 civetweb | |
| 1/ 5 javaclient | |
| 1/ 5 asok | |
| 1/ 1 throttle | |
| 0/ 0 refs | |
| 1/ 5 xio | |
| 1/ 5 compressor | |
| 0/ 0 bluestore | |
| 1/ 5 bluefs | |
| 1/ 3 bdev | |
| 1/ 5 kstore | |
| 4/ 5 rocksdb | |
| 0/ 0 leveldb | |
| 4/ 5 memdb | |
| 1/ 5 kinetic | |
| 1/ 5 fuse | |
| 1/ 5 mgr | |
| 1/ 5 mgrc | |
| 1/ 5 dpdk | |
| 1/ 5 eventtrace | |
| -2/-2 (syslog threshold) | |
| -1/-1 (stderr threshold) | |
| max_recent 10000 | |
| max_new 1000 | |
| log_file /dev/stderr | |
| --- end dump of recent events --- |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment