Skip to content

Instantly share code, notes, and snippets.

@nicksavers

nicksavers/LOG

Created July 26, 2016 21:12
Show Gist options
  • Save nicksavers/7cc8609e9f921c24a1c6bf00ffd24b18 to your computer and use it in GitHub Desktop.
Save nicksavers/7cc8609e9f921c24a1c6bf00ffd24b18 to your computer and use it in GitHub Desktop.
Download ZIP
Parity Corrupt DB
Raw
LOG
2016/07/25-13:12:30.215868 7f4553450b80 RocksDB version: 4.5.1
2016/07/25-13:12:30.215898 7f4553450b80 Git sha rocksdb_build_git_sha:dab9465c40b0a8fb7a59b461e516f27ff074274b
2016/07/25-13:12:30.215901 7f4553450b80 Compile date Jul 25 2016
2016/07/25-13:12:30.215903 7f4553450b80 DB SUMMARY
2016/07/25-13:12:30.215988 7f4553450b80 CURRENT file: CURRENT
2016/07/25-13:12:30.215992 7f4553450b80 IDENTITY file: IDENTITY
2016/07/25-13:12:30.216010 7f4553450b80 MANIFEST file: MANIFEST-001641 size: 640 Bytes
2016/07/25-13:12:30.216015 7f4553450b80 SST files in /home/ethdev/.parity/906a34e69aec8c0d/v5.3-sec-overlayrecent/blocks dir, Total Num: 6, files: 000930.sst 001560.sst 001561.sst 001625.sst 001626.sst 001627.sst
2016/07/25-13:12:30.216017 7f4553450b80 Write Ahead Log file in /home/ethdev/.parity/906a34e69aec8c0d/v5.3-sec-overlayrecent/blocks: 001642.log size: 0 ;
2016/07/25-13:12:30.216020 7f4553450b80 Options.error_if_exists: 0
2016/07/25-13:12:30.216021 7f4553450b80 Options.create_if_missing: 1
2016/07/25-13:12:30.216022 7f4553450b80 Options.paranoid_checks: 1
2016/07/25-13:12:30.216024 7f4553450b80 Options.env: 0x56228f78f760
2016/07/25-13:12:30.216025 7f4553450b80 Options.info_log: 0x7f454c75c440
2016/07/25-13:12:30.216026 7f4553450b80 Options.max_open_files: 256
2016/07/25-13:12:30.216028 7f4553450b80 Options.max_file_opening_threads: 1
2016/07/25-13:12:30.216029 7f4553450b80 Options.max_total_wal_size: 0
2016/07/25-13:12:30.216030 7f4553450b80 Options.disableDataSync: 0
2016/07/25-13:12:30.216031 7f4553450b80 Options.use_fsync: 0
2016/07/25-13:12:30.216032 7f4553450b80 Options.max_log_file_size: 0
2016/07/25-13:12:30.216033 7f4553450b80 Options.max_manifest_file_size: 18446744073709551615
2016/07/25-13:12:30.216035 7f4553450b80 Options.log_file_time_to_roll: 0
2016/07/25-13:12:30.216036 7f4553450b80 Options.keep_log_file_num: 1000
2016/07/25-13:12:30.216037 7f4553450b80 Options.recycle_log_file_num: 0
2016/07/25-13:12:30.216038 7f4553450b80 Options.allow_os_buffer: 1
2016/07/25-13:12:30.216039 7f4553450b80 Options.allow_mmap_reads: 0
2016/07/25-13:12:30.216040 7f4553450b80 Options.allow_fallocate: 1
2016/07/25-13:12:30.216042 7f4553450b80 Options.allow_mmap_writes: 0
2016/07/25-13:12:30.216043 7f4553450b80 Options.create_missing_column_families: 0
2016/07/25-13:12:30.216044 7f4553450b80 Options.db_log_dir:
2016/07/25-13:12:30.216045 7f4553450b80 Options.wal_dir: /home/ethdev/.parity/906a34e69aec8c0d/v5.3-sec-overlayrecent/blocks
2016/07/25-13:12:30.216046 7f4553450b80 Options.table_cache_numshardbits: 4
2016/07/25-13:12:30.216047 7f4553450b80 Options.delete_obsolete_files_period_micros: 21600000000
2016/07/25-13:12:30.216049 7f4553450b80 Options.base_background_compactions: 2
2016/07/25-13:12:30.216050 7f4553450b80 Options.max_background_compactions: 2
2016/07/25-13:12:30.216051 7f4553450b80 Options.max_subcompactions: 1
2016/07/25-13:12:30.216052 7f4553450b80 Options.max_background_flushes: 2
2016/07/25-13:12:30.216053 7f4553450b80 Options.WAL_ttl_seconds: 0
2016/07/25-13:12:30.216054 7f4553450b80 Options.WAL_size_limit_MB: 0
2016/07/25-13:12:30.216055 7f4553450b80 Options.manifest_preallocation_size: 4194304
2016/07/25-13:12:30.216056 7f4553450b80 Options.allow_os_buffer: 1
2016/07/25-13:12:30.216057 7f4553450b80 Options.allow_mmap_reads: 0
2016/07/25-13:12:30.216058 7f4553450b80 Options.allow_mmap_writes: 0
2016/07/25-13:12:30.216059 7f4553450b80 Options.is_fd_close_on_exec: 1
2016/07/25-13:12:30.216060 7f4553450b80 Options.stats_dump_period_sec: 600
2016/07/25-13:12:30.216061 7f4553450b80 Options.advise_random_on_open: 1
2016/07/25-13:12:30.216063 7f4553450b80 Options.db_write_buffer_size: 0d
2016/07/25-13:12:30.216082 7f4553450b80 Options.access_hint_on_compaction_start: NORMAL
2016/07/25-13:12:30.216085 7f4553450b80 Options.new_table_reader_for_compaction_inputs: 0
2016/07/25-13:12:30.216086 7f4553450b80 Options.compaction_readahead_size: 0d
2016/07/25-13:12:30.216087 7f4553450b80 Options.random_access_max_buffer_size: 1048576d
2016/07/25-13:12:30.216088 7f4553450b80 Options.writable_file_max_buffer_size: 1048576d
2016/07/25-13:12:30.216089 7f4553450b80 Options.use_adaptive_mutex: 0
2016/07/25-13:12:30.216090 7f4553450b80 Options.rate_limiter: (nil)
2016/07/25-13:12:30.216091 7f4553450b80 Options.sst_file_manager.rate_bytes_per_sec: 0
2016/07/25-13:12:30.216092 7f4553450b80 Options.bytes_per_sync: 0
2016/07/25-13:12:30.216094 7f4553450b80 Options.wal_bytes_per_sync: 0
2016/07/25-13:12:30.216095 7f4553450b80 Options.wal_recovery_mode: 0
2016/07/25-13:12:30.216096 7f4553450b80 Options.enable_thread_tracking: 0
2016/07/25-13:12:30.216097 7f4553450b80 Options.allow_concurrent_memtable_write: 0
2016/07/25-13:12:30.216098 7f4553450b80 Options.enable_write_thread_adaptive_yield: 0
2016/07/25-13:12:30.216099 7f4553450b80 Options.write_thread_max_yield_usec: 100
2016/07/25-13:12:30.216100 7f4553450b80 Options.write_thread_slow_yield_usec: 3
2016/07/25-13:12:30.216101 7f4553450b80 Options.row_cache: None
2016/07/25-13:12:30.216102 7f4553450b80 Options.wal_filter: None
2016/07/25-13:12:30.216103 7f4553450b80 Compression algorithms supported:
2016/07/25-13:12:30.216105 7f4553450b80 Snappy supported: 1
2016/07/25-13:12:30.216106 7f4553450b80 Zlib supported: 0
2016/07/25-13:12:30.216107 7f4553450b80 Bzip supported: 0
2016/07/25-13:12:30.216108 7f4553450b80 LZ4 supported: 0
2016/07/25-13:12:30.216109 7f4553450b80 Fast CRC32 supported: 0
2016/07/25-13:12:30.216354 7f4553450b80 Recovering from manifest file: MANIFEST-001641
2016/07/25-13:12:30.216425 7f4553450b80 --------------- Options for column family [default]:
2016/07/25-13:12:30.216429 7f4553450b80 Options.comparator: rocksdb.InternalKeyComparator:leveldb.BytewiseComparator
2016/07/25-13:12:30.216431 7f4553450b80 Options.merge_operator: None
2016/07/25-13:12:30.216432 7f4553450b80 Options.compaction_filter: None
2016/07/25-13:12:30.216433 7f4553450b80 Options.compaction_filter_factory: None
2016/07/25-13:12:30.216434 7f4553450b80 Options.memtable_factory: SkipListFactory
2016/07/25-13:12:30.216436 7f4553450b80 Options.table_factory: BlockBasedTable
2016/07/25-13:12:30.216446 7f4553450b80 table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x7f45518e2148)
cache_index_and_filter_blocks: 0
index_type: 0
hash_index_allow_collision: 1
checksum: 1
no_block_cache: 0
block_cache: 0x7f454b709290
block_cache_size: 8388608
block_cache_compressed: (nil)
block_size: 4096
block_size_deviation: 10
block_restart_interval: 16
index_block_restart_interval: 1
filter_policy: nullptr
whole_key_filtering: 1
skip_table_builder_flush: 0
format_version: 0
2016/07/25-13:12:30.216449 7f4553450b80 Options.write_buffer_size: 4194304
2016/07/25-13:12:30.216450 7f4553450b80 Options.max_write_buffer_number: 2
2016/07/25-13:12:30.216452 7f4553450b80 Options.compression: Snappy
2016/07/25-13:12:30.216453 7f4553450b80 Options.prefix_extractor: nullptr
2016/07/25-13:12:30.216454 7f4553450b80 Options.num_levels: 7
2016/07/25-13:12:30.216455 7f4553450b80 Options.min_write_buffer_number_to_merge: 1
2016/07/25-13:12:30.216456 7f4553450b80 Options.max_write_buffer_number_to_maintain: 0
2016/07/25-13:12:30.216458 7f4553450b80 Options.compression_opts.window_bits: -14
2016/07/25-13:12:30.216459 7f4553450b80 Options.compression_opts.level: -1
2016/07/25-13:12:30.216479 7f4553450b80 Options.compression_opts.strategy: 0
2016/07/25-13:12:30.216481 7f4553450b80 Options.level0_file_num_compaction_trigger: 4
2016/07/25-13:12:30.216482 7f4553450b80 Options.level0_slowdown_writes_trigger: 20
2016/07/25-13:12:30.216484 7f4553450b80 Options.level0_stop_writes_trigger: 24
2016/07/25-13:12:30.216485 7f4553450b80 Options.target_file_size_base: 33554432
2016/07/25-13:12:30.216486 7f4553450b80 Options.target_file_size_multiplier: 2
2016/07/25-13:12:30.216487 7f4553450b80 Options.max_bytes_for_level_base: 10485760
2016/07/25-13:12:30.216488 7f4553450b80 Options.level_compaction_dynamic_level_bytes: 0
2016/07/25-13:12:30.216489 7f4553450b80 Options.max_bytes_for_level_multiplier: 10
2016/07/25-13:12:30.216491 7f4553450b80 Options.max_bytes_for_level_multiplier_addtl[0]: 1
2016/07/25-13:12:30.216492 7f4553450b80 Options.max_bytes_for_level_multiplier_addtl[1]: 1
2016/07/25-13:12:30.216493 7f4553450b80 Options.max_bytes_for_level_multiplier_addtl[2]: 1
2016/07/25-13:12:30.216494 7f4553450b80 Options.max_bytes_for_level_multiplier_addtl[3]: 1
2016/07/25-13:12:30.216495 7f4553450b80 Options.max_bytes_for_level_multiplier_addtl[4]: 1
2016/07/25-13:12:30.216496 7f4553450b80 Options.max_bytes_for_level_multiplier_addtl[5]: 1
2016/07/25-13:12:30.216497 7f4553450b80 Options.max_bytes_for_level_multiplier_addtl[6]: 1
2016/07/25-13:12:30.216498 7f4553450b80 Options.max_sequential_skip_in_iterations: 8
2016/07/25-13:12:30.216500 7f4553450b80 Options.expanded_compaction_factor: 25
2016/07/25-13:12:30.216501 7f4553450b80 Options.source_compaction_factor: 1
2016/07/25-13:12:30.216502 7f4553450b80 Options.max_grandparent_overlap_factor: 10
2016/07/25-13:12:30.216503 7f4553450b80 Options.arena_block_size: 524288
2016/07/25-13:12:30.216504 7f4553450b80 Options.soft_pending_compaction_bytes_limit: 0
2016/07/25-13:12:30.216505 7f4553450b80 Options.hard_pending_compaction_bytes_limit: 0
2016/07/25-13:12:30.216506 7f4553450b80 Options.rate_limit_delay_max_milliseconds: 1000
2016/07/25-13:12:30.216507 7f4553450b80 Options.disable_auto_compactions: 0
2016/07/25-13:12:30.216508 7f4553450b80 Options.filter_deletes: 0
2016/07/25-13:12:30.216510 7f4553450b80 Options.verify_checksums_in_compaction: 1
2016/07/25-13:12:30.216511 7f4553450b80 Options.compaction_style: 1
2016/07/25-13:12:30.216512 7f4553450b80 Options.compaction_pri: 0
2016/07/25-13:12:30.216513 7f4553450b80 Options.compaction_options_universal.size_ratio: 1
2016/07/25-13:12:30.216514 7f4553450b80 Options.compaction_options_universal.min_merge_width: 2
2016/07/25-13:12:30.216515 7f4553450b80 Options.compaction_options_universal.max_merge_width: 4294967295
2016/07/25-13:12:30.216516 7f4553450b80 Options.compaction_options_universal.max_size_amplification_percent: 200
2016/07/25-13:12:30.216518 7f4553450b80 Options.compaction_options_universal.compression_size_percent: -1
2016/07/25-13:12:30.216519 7f4553450b80 Options.compaction_options_fifo.max_table_files_size: 1073741824
2016/07/25-13:12:30.216520 7f4553450b80 Options.table_properties_collectors:
2016/07/25-13:12:30.216521 7f4553450b80 Options.inplace_update_support: 0
2016/07/25-13:12:30.216523 7f4553450b80 Options.inplace_update_num_locks: 10000
2016/07/25-13:12:30.216524 7f4553450b80 Options.min_partial_merge_operands: 2
2016/07/25-13:12:30.216525 7f4553450b80 Options.memtable_prefix_bloom_bits: 0
2016/07/25-13:12:30.216526 7f4553450b80 Options.memtable_prefix_bloom_probes: 6
2016/07/25-13:12:30.216527 7f4553450b80 Options.memtable_prefix_bloom_huge_page_tlb_size: 0
2016/07/25-13:12:30.216528 7f4553450b80 Options.bloom_locality: 0
2016/07/25-13:12:30.216529 7f4553450b80 Options.max_successive_merges: 0
2016/07/25-13:12:30.216542 7f4553450b80 Options.optimize_fllters_for_hits: 0
2016/07/25-13:12:30.216544 7f4553450b80 Options.paranoid_file_checks: 0
2016/07/25-13:12:30.216545 7f4553450b80 Options.compaction_measure_io_stats: 0
2016/07/25-13:12:30.221238 7f4553450b80 Recovered from manifest file:/home/ethdev/.parity/906a34e69aec8c0d/v5.3-sec-overlayrecent/blocks/MANIFEST-001641 succeeded,manifest_file_number is 1641, next_file_number is 1643, last_sequence is 1922219, log_number is 0,prev_log_number is 0,max_column_family is 0
2016/07/25-13:12:30.221248 7f4553450b80 Column family [default] (ID 0), log number is 1640
2016/07/25-13:12:30.221409 7f4553450b80 EVENT_LOG_v1 {"time_micros": 1469466750221399, "job": 1, "event": "recovery_started", "log_files": [1642]}
2016/07/25-13:12:30.221442 7f4553450b80 Recovering log #1642 mode 0 skip-recovery 0
2016/07/25-13:12:30.221490 7f4553450b80 Creating manifest 1644
2016/07/25-13:12:30.223321 7f4553450b80 Deleting manifest 1641 current manifest 1644
2016/07/25-13:12:30.223386 7f4553450b80 EVENT_LOG_v1 {"time_micros": 1469466750223381, "job": 1, "event": "recovery_finished"}
2016/07/25-13:12:30.226110 7f4550dff700 [WARN] ------- DUMPING STATS -------
2016/07/25-13:12:30.226129 7f4550dff700 [WARN]
** Compaction Stats [default] **
Level Files Size(MB) Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
---------------------------------------------------------------------------------------------------------------------------------------------------------------------
L0 2/0 7.79 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
L4 1/0 64.15 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
L5 2/0 611.38 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
L6 1/0 765.87 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
Sum 6/0 1449.19 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
Int 0/0 0.00 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 0.000 0 0
Flush(GB): cumulative 0.000, interval 0.000
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count
** DB Stats **
Uptime(secs): 0.0 total, 0.0 interval
Cumulative writes: 0 writes, 0 keys, 0 batches, 0.0 writes per batch, ingest: 0.00 GB, 0.00 MB/s
Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s
Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 0 writes, 0 keys, 0 batches, 0.0 writes per batch, ingest: 0.00 MB, 0.00 MB/s
Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Interval stall: 00:00:0.000 H:M:S, 0.0 percent
2016/07/25-13:12:30.226226 7f4550dff700 (Original Log Time 2016/07/25-13:12:30.226174) [default] Universal: sorted runs files(5): files[2 0 0 0 1 2 1] max score 1.25
2016/07/25-13:12:30.226229 7f4550dff700 (Original Log Time 2016/07/25-13:12:30.226177) [default] Universal: First candidate file 1627[0] to reduce size amp.
2016/07/25-13:12:30.226231 7f4550dff700 (Original Log Time 2016/07/25-13:12:30.226178) [default] Universal: size amp not needed. newer-files-total-size 716509817earliest-file-size 803076000
2016/07/25-13:12:30.226233 7f4550dff700 (Original Log Time 2016/07/25-13:12:30.226180) [default] Universal: Possible candidate file 1627[0].
2016/07/25-13:12:30.226235 7f4550dff700 (Original Log Time 2016/07/25-13:12:30.226182) [default] Universal: Skipping file 1627[0] with size 2894806 (compensated size 2894806)
2016/07/25-13:12:30.226237 7f4550dff700 (Original Log Time 2016/07/25-13:12:30.226186) [default] Universal: Possible candidate file 1625[1].
2016/07/25-13:12:30.226238 7f4550dff700 (Original Log Time 2016/07/25-13:12:30.226188) [default] Universal: Skipping file 1625[1] with size 5269930 (compensated size 5269930)
2016/07/25-13:12:30.226240 7f4550dff700 (Original Log Time 2016/07/25-13:12:30.226188) [default] Universal: Possible candidate level 4[2].
2016/07/25-13:12:30.226242 7f4550dff700 (Original Log Time 2016/07/25-13:12:30.226190) [default] Universal: Skipping level 4[2] with size 67265116 (compensated size 67265116)
2016/07/25-13:12:30.226244 7f4550dff700 (Original Log Time 2016/07/25-13:12:30.226192) [default] Universal: Possible candidate level 5[3].
2016/07/25-13:12:30.226246 7f4550dff700 (Original Log Time 2016/07/25-13:12:30.226194) [default] Universal: Skipping level 5[3] with size 641079965 (compensated size 641079965)
2016/07/25-13:12:30.226271 7f4550dff700 (Original Log Time 2016/07/25-13:12:30.226195) [default] Universal: Possible candidate level 6[4].
2016/07/25-13:12:30.226274 7f4550dff700 (Original Log Time 2016/07/25-13:12:30.226196) [default] Universal: Skipping level 6[4] with size 803076000 (compensated size 803076000)
2016/07/25-13:12:30.226275 7f4550dff700 (Original Log Time 2016/07/25-13:12:30.226200) [default] Universal: Possible candidate file 1627[0].
2016/07/25-13:12:30.226277 7f4550dff700 (Original Log Time 2016/07/25-13:12:30.226201) [default] Universal: Skipping file 1627[0] with size 2894806 (compensated size 2894806)
2016/07/25-13:12:30.226279 7f4550dff700 (Original Log Time 2016/07/25-13:12:30.226202) [default] Universal: Possible candidate file 1625[1].
2016/07/25-13:12:30.226281 7f4550dff700 (Original Log Time 2016/07/25-13:12:30.226203) [default] Universal: Skipping file 1625[1] with size 5269930 (compensated size 5269930)
2016/07/25-13:12:30.226282 7f4550dff700 (Original Log Time 2016/07/25-13:12:30.226207) [default] Universal: Possible candidate level 4[2].
2016/07/25-13:12:30.226284 7f4550dff700 (Original Log Time 2016/07/25-13:12:30.226208) [default] Universal: Skipping level 4[2] with size 67265116 (compensated size 67265116)
2016/07/25-13:12:30.226286 7f4550dff700 (Original Log Time 2016/07/25-13:12:30.226209) [default] Universal: Possible candidate level 5[3].
2016/07/25-13:12:30.226287 7f4550dff700 (Original Log Time 2016/07/25-13:12:30.226210) [default] Universal: Skipping level 5[3] with size 641079965 (compensated size 641079965)
2016/07/25-13:12:30.226289 7f4550dff700 (Original Log Time 2016/07/25-13:12:30.226213) [default] Universal: Possible candidate level 6[4].
2016/07/25-13:12:30.226291 7f4550dff700 (Original Log Time 2016/07/25-13:12:30.226214) [default] Universal: Skipping level 6[4] with size 803076000 (compensated size 803076000)
2016/07/25-13:12:30.226293 7f4550dff700 (Original Log Time 2016/07/25-13:12:30.226216) Compaction nothing to do
2016/07/25-13:12:30.226330 7f4553450b80 DB pointer 0x7f4549655400
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment