Ceph i/o wait problem rocksb compact

ceph-osd.3.log

2020-07-29 00:00:00.601 7f0775160700 -1 received  signal: Hangup from  (PID: 3427325) UID: 0
2020-07-29 00:01:41.664 7f076d723700  4 rocksdb: [db/db_impl_write.cc:1436] reusing log 163416 from recycle list

2020-07-29 00:01:41.664 7f076d723700  4 rocksdb: [db/db_impl_write.cc:1470] [default] New memtable created with log file: #163420. Immutable memtables: 0.

2020-07-29 00:01:41.664 7f076e725700  4 rocksdb: (Original Log Time 2020/07/29-00:01:41.668850) [db/db_impl_compaction_flush.cc:2073] Calling FlushMemTableToOutputFile with column family [default], flush slots available 1, compaction slots available 1, flush slots scheduled 1, compaction slots scheduled 0
2020-07-29 00:01:41.664 7f076e725700  4 rocksdb: [db/flush_job.cc:322] [default] [JOB 139] Flushing memtable with next log file: 163420

2020-07-29 00:01:41.664 7f076e725700  4 rocksdb: EVENT_LOG_v1 {"time_micros": 1595973701668878, "job": 139, "event": "flush_started", "num_memtables": 1, "num_entries": 405150, "num_deletes": 39109, "total_data_size": 252598043, "memory_usage": 260050824, "flush_reason": "Write Buffer Full"}
2020-07-29 00:01:41.664 7f076e725700  4 rocksdb: [db/flush_job.cc:351] [default] [JOB 139] Level-0 flush table #163421: started
2020-07-29 00:01:50.192 7f076d723700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency slow operation observed for kv_commit, latency = 8.32748s
2020-07-29 00:01:50.192 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 8.34135s, txc = 0x55d128a4f800
2020-07-29 00:01:50.192 7f076d723700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency slow operation observed for kv_sync, latency = 8.32748s
2020-07-29 00:01:50.192 7f076e725700  4 rocksdb: EVENT_LOG_v1 {"time_micros": 1595973710195027, "cf_name": "default", "job": 139, "event": "table_file_creation", "file_number": 163421, "file_size": 31526434, "table_properties": {"data_size": 30522685, "index_size": 628414, "filter_size": 374469, "raw_key_size": 7727209, "raw_average_key_size": 51, "raw_value_size": 27464684, "raw_average_value_size": 183, "num_data_blocks": 7641, "num_entries": 149750, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
2020-07-29 00:01:50.192 7f076e725700  4 rocksdb: [db/flush_job.cc:392] [default] [JOB 139] Level-0 flush table #163421: 31526434 bytes OK
2020-07-29 00:01:50.192 7f076e725700  4 rocksdb: [db/db_impl_files.cc:194] adding log 163418 to recycle list

2020-07-29 00:01:50.192 7f076e725700  4 rocksdb: (Original Log Time 2020/07/29-00:01:50.195066) [db/memtable_list.cc:380] [default] Level-0 commit table #163421 started
2020-07-29 00:01:50.192 7f076e725700  4 rocksdb: (Original Log Time 2020/07/29-00:01:50.195266) [db/memtable_list.cc:428] [default] Level-0 commit table #163421: memtable #1 done
2020-07-29 00:01:50.192 7f076e725700  4 rocksdb: (Original Log Time 2020/07/29-00:01:50.195275) EVENT_LOG_v1 {"time_micros": 1595973710195271, "job": 139, "event": "flush_finished", "output_compression": "NoCompression", "lsm_state": [4, 5, 37, 0, 0, 0, 0], "immutable_memtables": 0}
2020-07-29 00:01:50.192 7f076e725700  4 rocksdb: (Original Log Time 2020/07/29-00:01:50.195304) [db/db_impl_compaction_flush.cc:201] [default] Level summary: files[4 5 37 0 0 0 0] max score 1.00

2020-07-29 00:01:50.192 7f076ef26700  4 rocksdb: [db/compaction_job.cc:1645] [default] [JOB 140] Compacting 4@0 + 5@1 files to L1, score 1.00
2020-07-29 00:01:50.192 7f076ef26700  4 rocksdb: [db/compaction_job.cc:1649] [default] Compaction start summary: Base version 139 Base level 0, inputs: [163421(30MB) 163419(16MB) 163417(13MB) 163415(13MB)], [163409(66MB) 163410(65MB) 163411(21MB) 163412(66MB) 163413(1848KB)]

2020-07-29 00:01:50.192 7f076ef26700  4 rocksdb: EVENT_LOG_v1 {"time_micros": 1595973710195423, "job": 140, "event": "compaction_started", "compaction_reason": "LevelL0FilesNum", "files_L0": [163421, 163419, 163417, 163415], "files_L1": [163409, 163410, 163411, 163412, 163413], "score": 1, "input_data_size": 311223896}
2020-07-29 00:01:50.364 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 8.41437s, txc = 0x55d13427ac00
2020-07-29 00:01:50.364 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 8.38355s, txc = 0x55d0b56a2300
2020-07-29 00:01:50.364 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 8.38342s, txc = 0x55d129935800
2020-07-29 00:01:50.364 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 8.38294s, txc = 0x55d0ba3adb00
2020-07-29 00:01:50.364 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 8.11478s, txc = 0x55d0f2c77800
2020-07-29 00:01:50.364 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.32537s, txc = 0x55d123caa300
2020-07-29 00:01:50.364 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.04459s, txc = 0x55d1296df800
2020-07-29 00:01:50.364 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.78875s, txc = 0x55d0f36c9b00
2020-07-29 00:01:50.364 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.74136s, txc = 0x55d0b74f7b00
2020-07-29 00:01:50.364 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73839s, txc = 0x55d18ef9f500
2020-07-29 00:01:50.364 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.7383s, txc = 0x55d1a6d18600
2020-07-29 00:01:50.364 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.74136s, txc = 0x55d175a0bb00
2020-07-29 00:01:50.364 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.67406s, txc = 0x55d0e406c000
2020-07-29 00:01:50.364 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.59212s, txc = 0x55d10ff8c600
2020-07-29 00:01:50.364 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.59194s, txc = 0x55d0beafcf00
2020-07-29 00:01:50.364 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.59183s, txc = 0x55d0b74f6f00
2020-07-29 00:01:50.364 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.59177s, txc = 0x55d1b66c5b00
2020-07-29 00:01:50.364 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 5.31143s, txc = 0x55d0be09c300
2020-07-29 00:01:50.364 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 5.31142s, txc = 0x55d14ed93b00
2020-07-29 00:01:50.364 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 5.31132s, txc = 0x55d16b542300
2020-07-29 00:01:50.364 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 5.31107s, txc = 0x55d13c9c8000
2020-07-29 00:01:50.364 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 5.31069s, txc = 0x55d0e268d500
2020-07-29 00:01:50.364 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 5.31048s, txc = 0x55d14ba18900
2020-07-29 00:01:50.364 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 5.31024s, txc = 0x55d0ef45f200
2020-07-29 00:02:08.572 7f076ef26700  4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 140] Generated table #163422: 717832 keys, 69969835 bytes
2020-07-29 00:02:08.572 7f076ef26700  4 rocksdb: EVENT_LOG_v1 {"time_micros": 1595973728574970, "cf_name": "default", "job": 140, "event": "table_file_creation", "file_number": 163422, "file_size": 69969835, "table_properties": {"data_size": 67112917, "index_size": 1061427, "filter_size": 1794629, "raw_key_size": 36333697, "raw_average_key_size": 50, "raw_value_size": 55186639, "raw_average_value_size": 76, "num_data_blocks": 16639, "num_entries": 717832, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
2020-07-29 00:02:08.572 7f076d723700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency slow operation observed for kv_commit, latency = 17.3723s
2020-07-29 00:02:08.572 7f076d723700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency slow operation observed for kv_sync, latency = 17.3723s
2020-07-29 00:02:08.572 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.3724s, txc = 0x55d14064e300
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.7156s, txc = 0x55d197169200
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.5693s, txc = 0x55d17e9d5200
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.304s, txc = 0x55d194614f00
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.3027s, txc = 0x55d17f99af00
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.9608s, txc = 0x55d13427a900
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.9607s, txc = 0x55d132da4f00
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.9606s, txc = 0x55d19f8e4600
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.9601s, txc = 0x55d11b1dcf00
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.5267s, txc = 0x55d14ba18600
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.5267s, txc = 0x55d13b2d2c00
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.5266s, txc = 0x55d13e747b00
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.5265s, txc = 0x55d1561abb00
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.5264s, txc = 0x55d180c2d200
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.5259s, txc = 0x55d150452300
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.5257s, txc = 0x55d0c53d0900
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.5256s, txc = 0x55d0fcd7ac00
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.4498s, txc = 0x55d18ef9e900
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.4379s, txc = 0x55d19c9f0c00
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.365s, txc = 0x55d0deea4000
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 15.3041s, txc = 0x55d0edd18c00
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 14.9968s, txc = 0x55d158972300
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 14.8521s, txc = 0x55d128c27800
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 14.5979s, txc = 0x55d183ebd800
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.752s, txc = 0x55d0e1e8d800
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.752s, txc = 0x55d160eb1200
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.7517s, txc = 0x55d0e20e5b00
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.7517s, txc = 0x55d0fdce2900
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.7516s, txc = 0x55d15bc18000
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.7515s, txc = 0x55d19839b500
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.7514s, txc = 0x55d183ebd200
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.7512s, txc = 0x55d14b58a000
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.6339s, txc = 0x55d0fe8e6c00
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.538s, txc = 0x55d0e1e8cc00
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.4599s, txc = 0x55d175235500
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.3779s, txc = 0x55d1252d8300
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.378s, txc = 0x55d192d56f00
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.3779s, txc = 0x55d17237ef00
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.3779s, txc = 0x55d12d1e8300
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.3778s, txc = 0x55d15a079200
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.3779s, txc = 0x55d13c9c8f00
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.3779s, txc = 0x55d1b418c600
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.3779s, txc = 0x55d153e55500
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.3779s, txc = 0x55d14b58b200
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.3779s, txc = 0x55d1a192ef00
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.3778s, txc = 0x55d14bec1500
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.3778s, txc = 0x55d153e54c00
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.3778s, txc = 0x55d1252d8900
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.3778s, txc = 0x55d135531b00
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.3778s, txc = 0x55d0ffe40f00
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.3778s, txc = 0x55d10f328300
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.3777s, txc = 0x55d14ba19800
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.3775s, txc = 0x55d0c0c30f00
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.3774s, txc = 0x55d1561aa000
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.3773s, txc = 0x55d1a1b7f500
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.3771s, txc = 0x55d137690300
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.377s, txc = 0x55d14b712600
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.3769s, txc = 0x55d1077cf800
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.3769s, txc = 0x55d1a192e000
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.3769s, txc = 0x55d0e65aec00
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.3191s, txc = 0x55d179db6c00
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.3169s, txc = 0x55d175234900
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.3167s, txc = 0x55d0b75cdb00
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.3052s, txc = 0x55d0fccf9b00
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.2706s, txc = 0x55d175234000
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.2703s, txc = 0x55d0b56a3b00
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.2704s, txc = 0x55d1252d9800
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.2703s, txc = 0x55d0bf3f2300
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.9986s, txc = 0x55d0fdf5c000
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.9984s, txc = 0x55d1850f0300
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.9982s, txc = 0x55d122dcc000
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.9975s, txc = 0x55d1a2d57b00
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.9974s, txc = 0x55d1820cc900
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.9972s, txc = 0x55d19c9f1500
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.9971s, txc = 0x55d134297200
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.4729s, txc = 0x55d0de818900
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.3212s, txc = 0x55d142ceb500
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 10.8855s, txc = 0x55d162aa7500
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 8.25488s, txc = 0x55d0fccf9500
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 8.17008s, txc = 0x55d12ef78c00
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87863s, txc = 0x55d1a7160300
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87836s, txc = 0x55d158973800
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87817s, txc = 0x55d1208c0900
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87795s, txc = 0x55d15a079500
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87781s, txc = 0x55d1820cd200
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87763s, txc = 0x55d0c0c30600
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87747s, txc = 0x55d0bf3f2f00
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87726s, txc = 0x55d0fccf8300
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.8771s, txc = 0x55d13e746f00
2020-07-29 00:02:08.924 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87696s, txc = 0x55d142ceac00
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87749s, txc = 0x55d12ef78000
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87739s, txc = 0x55d123392000
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.8774s, txc = 0x55d0c0c30300
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87728s, txc = 0x55d0d97c3500
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87727s, txc = 0x55d128c27500
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87716s, txc = 0x55d156579800
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87715s, txc = 0x55d175234300
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87706s, txc = 0x55d1a98bfb00
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87702s, txc = 0x55d0b74f6900
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87694s, txc = 0x55d0fdf5bb00
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87684s, txc = 0x55d13c942600
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87686s, txc = 0x55d17df97200
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87674s, txc = 0x55d14b712900
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87672s, txc = 0x55d0deea5b00
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87667s, txc = 0x55d10891d500
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87659s, txc = 0x55d0dd63af00
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87652s, txc = 0x55d12ef79500
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87647s, txc = 0x55d0ef45f500
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87639s, txc = 0x55d11b1dc900
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87636s, txc = 0x55d1b0936f00
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87628s, txc = 0x55d14d9e2300
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87624s, txc = 0x55d153e54600
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87617s, txc = 0x55d0df52c900
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.8761s, txc = 0x55d0b75cc900
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87605s, txc = 0x55d14bec1800
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87597s, txc = 0x55d0fcd7b800
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87594s, txc = 0x55d175a0a300
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87586s, txc = 0x55d0f36c8f00
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87583s, txc = 0x55d0de561800
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87574s, txc = 0x55d1820cdb00
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87574s, txc = 0x55d13c942900
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87563s, txc = 0x55d133f25b00
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87564s, txc = 0x55d0fdf5d200
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87553s, txc = 0x55d12bf55800
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87549s, txc = 0x55d0f27d0900
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87543s, txc = 0x55d153e55800
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87537s, txc = 0x55d0ffe40000
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87532s, txc = 0x55d0b3239b00
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87526s, txc = 0x55d15920c300
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87515s, txc = 0x55d1a7161800
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87503s, txc = 0x55d0fdf5a300
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87491s, txc = 0x55d115deaf00
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87482s, txc = 0x55d111239200
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87473s, txc = 0x55d122dcd200
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87465s, txc = 0x55d0d97c2c00
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.87449s, txc = 0x55d12ef78300
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.86534s, txc = 0x55d0b75ccf00
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.73448s, txc = 0x55d16b542900
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.73436s, txc = 0x55d13e746300
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.73426s, txc = 0x55d194420000
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.73417s, txc = 0x55d1a0762300
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.73408s, txc = 0x55d0b56a2600
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.73398s, txc = 0x55d120466900
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.7339s, txc = 0x55d0be09c300
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.73377s, txc = 0x55d197378000
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.73365s, txc = 0x55d17237f200
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.68571s, txc = 0x55d0e8890900
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.68555s, txc = 0x55d1b66c5b00
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.68543s, txc = 0x55d0b74f6f00
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.68533s, txc = 0x55d0beafcf00
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.68524s, txc = 0x55d175a0bb00
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.68516s, txc = 0x55d0b74f7b00
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.68508s, txc = 0x55d0b75ccc00
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.68494s, txc = 0x55d1397d5200
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.68483s, txc = 0x55d123caa300
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.68475s, txc = 0x55d129935800
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.68467s, txc = 0x55d128a4f800
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.68459s, txc = 0x55d0e2df2900
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.68452s, txc = 0x55d156578900
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.68445s, txc = 0x55d0de560600
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.68437s, txc = 0x55d0f5898600
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.6843s, txc = 0x55d0b75cc000
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.68423s, txc = 0x55d0b60d2000
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.68416s, txc = 0x55d0b3239500
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.68429s, txc = 0x55d134292000
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.68424s, txc = 0x55d158972f00
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.68417s, txc = 0x55d115404c00
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.6841s, txc = 0x55d0f42e0600
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.684s, txc = 0x55d15a078600
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.68385s, txc = 0x55d0e0929200
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.68374s, txc = 0x55d1a0762900
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.68362s, txc = 0x55d132da5500
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.68351s, txc = 0x55d0de561200
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.6834s, txc = 0x55d0f3aa3500
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.49444s, txc = 0x55d1a6d19800
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.4934s, txc = 0x55d183ebd500
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.49327s, txc = 0x55d0b74c8600
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.49309s, txc = 0x55d16b542000
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.49296s, txc = 0x55d0f27d0300
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.49282s, txc = 0x55d13416e900
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.4927s, txc = 0x55d151dadb00
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.49265s, txc = 0x55d0dd63a600
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.49251s, txc = 0x55d17e16db00
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.49241s, txc = 0x55d183ebcc00
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.49229s, txc = 0x55d183ebc300
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.49217s, txc = 0x55d1820cc000
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.49208s, txc = 0x55d0de818c00
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.49189s, txc = 0x55d1820cc300
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.4918s, txc = 0x55d0b3238900
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.49174s, txc = 0x55d15a078900
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 5.78288s, txc = 0x55d0f5899800
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 5.78291s, txc = 0x55d162aa6000
2020-07-29 00:02:08.928 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 5.78293s, txc = 0x55d0e1e8d500
2020-07-29 00:02:26.492 7f076ef26700  4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 140] Generated table #163423: 210439 keys, 69182917 bytes
2020-07-29 00:02:26.492 7f076ef26700  4 rocksdb: EVENT_LOG_v1 {"time_micros": 1595973746496601, "cf_name": "default", "job": 140, "event": "table_file_creation", "file_number": 163423, "file_size": 69182917, "table_properties": {"data_size": 67110842, "index_size": 1545064, "filter_size": 526149, "raw_key_size": 18405290, "raw_average_key_size": 87, "raw_value_size": 60932055, "raw_average_value_size": 289, "num_data_blocks": 16872, "num_entries": 210439, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
2020-07-29 00:02:26.492 7f076d723700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency slow operation observed for kv_commit, latency = 17.5676s
2020-07-29 00:02:26.492 7f076d723700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency slow operation observed for kv_sync, latency = 17.5676s
2020-07-29 00:02:26.492 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.5678s, txc = 0x55d132da4600
2020-07-29 00:02:26.548 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.6222s, txc = 0x55d1b98ad500
2020-07-29 00:02:26.548 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.622s, txc = 0x55d199095800
2020-07-29 00:02:26.548 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.6217s, txc = 0x55d0de561b00
2020-07-29 00:02:26.548 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.6212s, txc = 0x55d118688000
2020-07-29 00:02:26.548 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.6211s, txc = 0x55d0b4c2bb00
2020-07-29 00:02:26.548 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.621s, txc = 0x55d113fed800
2020-07-29 00:02:26.548 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.6208s, txc = 0x55d120466f00
2020-07-29 00:02:26.548 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.6208s, txc = 0x55d0d84e2000
2020-07-29 00:02:26.548 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.6207s, txc = 0x55d11aec0c00
2020-07-29 00:02:26.548 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.6201s, txc = 0x55d1b0937200
2020-07-29 00:02:26.548 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.6202s, txc = 0x55d1296de600
2020-07-29 00:02:26.548 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.62s, txc = 0x55d1077cf200
2020-07-29 00:02:26.548 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.6198s, txc = 0x55d0b56a3200
2020-07-29 00:02:26.548 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.6197s, txc = 0x55d10891cc00
2020-07-29 00:02:26.548 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.6196s, txc = 0x55d115deb200
2020-07-29 00:02:26.548 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.6196s, txc = 0x55d0b74f6c00
2020-07-29 00:02:26.548 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.6192s, txc = 0x55d0e20e2c00
2020-07-29 00:02:26.548 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.619s, txc = 0x55d0e1b23b00
2020-07-29 00:02:26.548 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.6176s, txc = 0x55d0e1e8c600
2020-07-29 00:02:26.548 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.5829s, txc = 0x55d115404f00
2020-07-29 00:02:26.548 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 15.3849s, txc = 0x55d1986e6c00
2020-07-29 00:02:26.548 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.5933s, txc = 0x55d128c26c00
2020-07-29 00:02:26.548 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.5693s, txc = 0x55d134629b00
2020-07-29 00:02:26.548 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.5097s, txc = 0x55d183ebcf00
2020-07-29 00:02:26.548 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.3467s, txc = 0x55d1751d7b00
2020-07-29 00:02:38.176 7f076ef26700  4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 140] Generated table #163424: 151736 keys, 49352461 bytes
2020-07-29 00:02:38.176 7f076ef26700  4 rocksdb: EVENT_LOG_v1 {"time_micros": 1595973758178525, "cf_name": "default", "job": 140, "event": "table_file_creation", "file_number": 163424, "file_size": 49352461, "table_properties": {"data_size": 47876588, "index_size": 1095551, "filter_size": 379461, "raw_key_size": 13253167, "raw_average_key_size": 87, "raw_value_size": 43373173, "raw_average_value_size": 285, "num_data_blocks": 12029, "num_entries": 151736, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
2020-07-29 00:02:38.180 7f076d723700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency slow operation observed for kv_commit, latency = 11.4725s
2020-07-29 00:02:38.180 7f076d723700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency slow operation observed for kv_sync, latency = 11.4725s
2020-07-29 00:02:38.180 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 11.4728s, txc = 0x55d17df96600
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 11.6722s, txc = 0x55d194420f00
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 10.7731s, txc = 0x55d0e268c600
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 10.8136s, txc = 0x55d0deea5200
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 10.0619s, txc = 0x55d0f27d0f00
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 9.75961s, txc = 0x55d155188900
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 9.74554s, txc = 0x55d14064fb00
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 9.29797s, txc = 0x55d0fac8c900
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 8.98354s, txc = 0x55d18175b800
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.75986s, txc = 0x55d19f8e4000
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.75793s, txc = 0x55d0beafd200
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.99019s, txc = 0x55d0bf3f2900
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.98996s, txc = 0x55d0fac8cf00
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.98995s, txc = 0x55d0b74c8900
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.98984s, txc = 0x55d0fac8d200
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.98976s, txc = 0x55d0e2df2300
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.98967s, txc = 0x55d1296de000
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.98968s, txc = 0x55d0df52d800
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.98961s, txc = 0x55d1561aaf00
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.98957s, txc = 0x55d1101cd800
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.98956s, txc = 0x55d175a0a900
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.98946s, txc = 0x55d123ca9800
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.88663s, txc = 0x55d175a0b800
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.88635s, txc = 0x55d1077cec00
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.82053s, txc = 0x55d17237e000
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73842s, txc = 0x55d1983adb00
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73826s, txc = 0x55d0b4c2a900
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73828s, txc = 0x55d0e2df2000
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73862s, txc = 0x55d105cf4300
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73817s, txc = 0x55d1021d6300
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73812s, txc = 0x55d158972900
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.7381s, txc = 0x55d180c2c300
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73805s, txc = 0x55d0b2b07200
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73796s, txc = 0x55d0df52db00
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73795s, txc = 0x55d156578300
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.7378s, txc = 0x55d19839a300
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73769s, txc = 0x55d179db6900
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73765s, txc = 0x55d0fccf8f00
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73756s, txc = 0x55d162aa6300
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73753s, txc = 0x55d1208c0000
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.7374s, txc = 0x55d0b74f7800
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73735s, txc = 0x55d0fad15500
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73729s, txc = 0x55d129934000
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73726s, txc = 0x55d0f7bbcf00
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.7372s, txc = 0x55d17237e900
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73719s, txc = 0x55d171575800
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.7371s, txc = 0x55d13bb56900
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73696s, txc = 0x55d0b2b07500
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73475s, txc = 0x55d0e7fb4600
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.67956s, txc = 0x55d150452000
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.67711s, txc = 0x55d1b0937800
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.67699s, txc = 0x55d119024600
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.67696s, txc = 0x55d0b60d3200
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73726s, txc = 0x55d0b2b06900
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73708s, txc = 0x55d10f328900
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73696s, txc = 0x55d150452c00
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73688s, txc = 0x55d123392900
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73681s, txc = 0x55d1a2d56000
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73674s, txc = 0x55d15a078000
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73665s, txc = 0x55d0f2316300
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73657s, txc = 0x55d197379500
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.7365s, txc = 0x55d199095500
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73643s, txc = 0x55d1b418d800
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73635s, txc = 0x55d1397d4f00
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73628s, txc = 0x55d15920d200
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73621s, txc = 0x55d0e00e9b00
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73614s, txc = 0x55d0fcd7a300
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73604s, txc = 0x55d1397d4000
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73597s, txc = 0x55d0f3aa2300
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.7359s, txc = 0x55d1a7160900
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73583s, txc = 0x55d132da4300
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73576s, txc = 0x55d0beafc300
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73568s, txc = 0x55d0c53d1800
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73561s, txc = 0x55d17e16c600
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73554s, txc = 0x55d14064ef00
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73547s, txc = 0x55d11b1dd200
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.7354s, txc = 0x55d0f2316c00
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73533s, txc = 0x55d0f1b7c000
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73524s, txc = 0x55d0d6c05b00
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73517s, txc = 0x55d0dd63b500
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.7351s, txc = 0x55d0b4c2af00
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73503s, txc = 0x55d105cf4000
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73495s, txc = 0x55d192d57500
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73483s, txc = 0x55d19c9f0600
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73471s, txc = 0x55d105cf4900
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73459s, txc = 0x55d17f99b200
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73451s, txc = 0x55d15920cf00
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73443s, txc = 0x55d0e00e8600
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73433s, txc = 0x55d0f2c77200
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.73424s, txc = 0x55d0b56a3800
2020-07-29 00:02:38.380 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 5.83267s, txc = 0x55d15e065800
2020-07-29 00:02:56.580 7f076ef26700  4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 140] Generated table #163425: 422765 keys, 69599614 bytes
2020-07-29 00:02:56.580 7f076ef26700  4 rocksdb: EVENT_LOG_v1 {"time_micros": 1595973776584996, "cf_name": "default", "job": 140, "event": "table_file_creation", "file_number": 163425, "file_size": 69599614, "table_properties": {"data_size": 67111103, "index_size": 1430684, "filter_size": 1056965, "raw_key_size": 21284271, "raw_average_key_size": 50, "raw_value_size": 58132284, "raw_average_value_size": 137, "num_data_blocks": 16851, "num_entries": 422765, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
2020-07-29 00:02:56.648 7f076d723700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency slow operation observed for kv_commit, latency = 17.8632s
2020-07-29 00:02:56.648 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.0689s, txc = 0x55d0de819b00
2020-07-29 00:02:56.648 7f076d723700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency slow operation observed for kv_sync, latency = 17.8632s
2020-07-29 00:02:56.648 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.0688s, txc = 0x55d1b418d200
2020-07-29 00:02:56.648 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.0503s, txc = 0x55d0e406db00
2020-07-29 00:02:56.648 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.0501s, txc = 0x55d115deb500
2020-07-29 00:02:56.648 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.0499s, txc = 0x55d1a98be600
2020-07-29 00:02:56.648 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.0499s, txc = 0x55d1a9c26000
2020-07-29 00:02:56.648 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.0498s, txc = 0x55d13ba30000
2020-07-29 00:02:56.648 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.0497s, txc = 0x55d0b56a2000
2020-07-29 00:02:56.648 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.0496s, txc = 0x55d0fac8d800
2020-07-29 00:02:56.648 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.0495s, txc = 0x55d0b75cd800
2020-07-29 00:02:56.648 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.0494s, txc = 0x55d122dcc300
2020-07-29 00:02:56.648 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.0492s, txc = 0x55d17df96300
2020-07-29 00:02:56.648 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.0492s, txc = 0x55d17f9f2000
2020-07-29 00:02:56.648 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.0491s, txc = 0x55d137f4e900
2020-07-29 00:02:56.648 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.0501s, txc = 0x55d1a192e000
2020-07-29 00:02:56.648 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.0501s, txc = 0x55d1b418c300
2020-07-29 00:02:56.648 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.0491s, txc = 0x55d1a192e300
2020-07-29 00:02:56.648 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.049s, txc = 0x55d0c53d0000
2020-07-29 00:02:56.648 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.0488s, txc = 0x55d1a36bc600
2020-07-29 00:02:56.652 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.0485s, txc = 0x55d134293200
2020-07-29 00:02:56.652 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.0485s, txc = 0x55d129934f00
2020-07-29 00:02:56.652 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.0484s, txc = 0x55d0ffe41200
2020-07-29 00:02:56.652 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.0483s, txc = 0x55d1a36bcc00
2020-07-29 00:02:56.652 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.0482s, txc = 0x55d135530300
2020-07-29 00:02:56.652 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.0481s, txc = 0x55d160eb0f00
2020-07-29 00:02:56.652 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.048s, txc = 0x55d162aa6000
2020-07-29 00:02:56.652 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.9874s, txc = 0x55d13427bb00
2020-07-29 00:02:56.652 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.9873s, txc = 0x55d1a6d19800
2020-07-29 00:02:56.652 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.9872s, txc = 0x55d129935500
2020-07-29 00:02:56.652 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.9871s, txc = 0x55d1a36bd800
2020-07-29 00:02:56.652 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.9871s, txc = 0x55d0e268c300
2020-07-29 00:02:56.652 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.9871s, txc = 0x55d113fed200
2020-07-29 00:02:56.652 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.987s, txc = 0x55d0e268d200
2020-07-29 00:02:56.652 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.9869s, txc = 0x55d0df52c300
2020-07-29 00:03:00.564 7f076ef26700  4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 140] Generated table #163426: 403181 keys, 13203246 bytes
2020-07-29 00:03:00.564 7f076ef26700  4 rocksdb: EVENT_LOG_v1 {"time_micros": 1595973780566832, "cf_name": "default", "job": 140, "event": "table_file_creation", "file_number": 163426, "file_size": 13203246, "table_properties": {"data_size": 12107510, "index_size": 86806, "filter_size": 1008069, "raw_key_size": 7257258, "raw_average_key_size": 18, "raw_value_size": 6313075, "raw_average_value_size": 15, "num_data_blocks": 2969, "num_entries": 403181, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7947s, txc = 0x55d1a189c600
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7947s, txc = 0x55d134629b00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7367s, txc = 0x55d123392300
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7366s, txc = 0x55d180c2d500
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7365s, txc = 0x55d1252d8000
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7365s, txc = 0x55d0fdce3500
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7364s, txc = 0x55d11b1dd800
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7364s, txc = 0x55d135531200
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7363s, txc = 0x55d199095b00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7363s, txc = 0x55d13ba30f00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7363s, txc = 0x55d19cf10f00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7362s, txc = 0x55d15a078900
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7362s, txc = 0x55d0fc87cc00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7361s, txc = 0x55d183ebdb00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7361s, txc = 0x55d0e0929200
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7361s, txc = 0x55d0f42e0600
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.736s, txc = 0x55d158972f00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.736s, txc = 0x55d0b3239500
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.736s, txc = 0x55d0b75cc000
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7359s, txc = 0x55d0de560600
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7359s, txc = 0x55d0e2df2900
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7359s, txc = 0x55d129935800
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7358s, txc = 0x55d1397d5200
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7358s, txc = 0x55d1820cc300
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7358s, txc = 0x55d0b74f7b00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7357s, txc = 0x55d0beafcf00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7356s, txc = 0x55d0df52d200
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7356s, txc = 0x55d1b66c5b00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7355s, txc = 0x55d1a6d19200
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7354s, txc = 0x55d17237f200
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7353s, txc = 0x55d113fed500
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7352s, txc = 0x55d0be09c300
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7351s, txc = 0x55d17df96600
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7351s, txc = 0x55d0b56a2600
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.735s, txc = 0x55d0f27d0f00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7349s, txc = 0x55d194420000
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7348s, txc = 0x55d0fac8c900
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7347s, txc = 0x55d16b542900
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7346s, txc = 0x55d1252d8f00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7346s, txc = 0x55d0b3239b00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7345s, txc = 0x55d158972900
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7344s, txc = 0x55d12bf55800
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7343s, txc = 0x55d0fac8cf00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7343s, txc = 0x55d13c942900
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7342s, txc = 0x55d0fccf8900
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7341s, txc = 0x55d175a0a300
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.734s, txc = 0x55d15e064c00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.734s, txc = 0x55d0df52c900
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7339s, txc = 0x55d1a0763800
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7338s, txc = 0x55d11b1dc900
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7337s, txc = 0x55d0fdf5b500
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7337s, txc = 0x55d10891d500
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7336s, txc = 0x55d175a0b800
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.733s, txc = 0x55d13c942600
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7329s, txc = 0x55d119024600
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7328s, txc = 0x55d1983adb00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7327s, txc = 0x55d1a98bfb00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7326s, txc = 0x55d180c2c300
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7325s, txc = 0x55d0d97c3500
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7324s, txc = 0x55d0de818000
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7323s, txc = 0x55d12ef78000
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7323s, txc = 0x55d0e7fb4600
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7322s, txc = 0x55d1a192ef00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7322s, txc = 0x55d0b60d3200
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7321s, txc = 0x55d13c9c8f00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.732s, txc = 0x55d0b2b07200
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7319s, txc = 0x55d1b418c600
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 21.7318s, txc = 0x55d19839a300
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9663s, txc = 0x55d0b60d3500
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9663s, txc = 0x55d0e20e4c00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9663s, txc = 0x55d10f329500
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9268s, txc = 0x55d0b74f6900
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9266s, txc = 0x55d175234300
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9264s, txc = 0x55d128c27500
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9262s, txc = 0x55d17df96900
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.926s, txc = 0x55d1a192f500
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9259s, txc = 0x55d1b98ac000
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9257s, txc = 0x55d123392000
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9255s, txc = 0x55d142ceac00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9253s, txc = 0x55d13e746f00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9252s, txc = 0x55d0fccf8300
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.925s, txc = 0x55d0bf3f2f00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9248s, txc = 0x55d1a6d19b00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9247s, txc = 0x55d17df96f00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9245s, txc = 0x55d0c0c30600
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9244s, txc = 0x55d1820cd200
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9242s, txc = 0x55d15a079500
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9241s, txc = 0x55d1208c0900
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.924s, txc = 0x55d158973800
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9239s, txc = 0x55d1a7160300
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9238s, txc = 0x55d160eb1200
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9236s, txc = 0x55d0ef45e300
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9235s, txc = 0x55d0fdf5cc00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9234s, txc = 0x55d17e16d800
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9232s, txc = 0x55d13c9c9200
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9231s, txc = 0x55d0d6c04900
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.923s, txc = 0x55d13427a900
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9229s, txc = 0x55d0fcd7ac00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9228s, txc = 0x55d0b4c2bb00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9221s, txc = 0x55d1561abb00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.922s, txc = 0x55d1b0937500
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9219s, txc = 0x55d1b98ad200
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9217s, txc = 0x55d0fdf5af00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9216s, txc = 0x55d17237fb00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9215s, txc = 0x55d0e0929800
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9214s, txc = 0x55d0ff68e000
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9214s, txc = 0x55d0fdf5b800
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9213s, txc = 0x55d197168000
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9211s, txc = 0x55d1050b4300
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.921s, txc = 0x55d14b713800
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9209s, txc = 0x55d0fc87c600
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9208s, txc = 0x55d19839a900
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9207s, txc = 0x55d17e9d4c00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9206s, txc = 0x55d0be09c900
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9205s, txc = 0x55d0edd19800
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9204s, txc = 0x55d120466c00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9203s, txc = 0x55d0f28b0900
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9202s, txc = 0x55d0ff1e6600
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9201s, txc = 0x55d14b713500
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.92s, txc = 0x55d0ef0c1500
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9199s, txc = 0x55d0e1e8cf00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9197s, txc = 0x55d0e268c900
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9196s, txc = 0x55d0f36c8000
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9195s, txc = 0x55d0fe8e6300
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9194s, txc = 0x55d1a0763500
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9193s, txc = 0x55d0c53d0900
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9192s, txc = 0x55d150452300
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9191s, txc = 0x55d180c2d200
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9191s, txc = 0x55d13e747b00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.919s, txc = 0x55d13b2d2c00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9189s, txc = 0x55d14ba18600
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9188s, txc = 0x55d17f99af00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9187s, txc = 0x55d194614f00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9186s, txc = 0x55d192d56f00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9186s, txc = 0x55d197169200
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9185s, txc = 0x55d15a079b00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9184s, txc = 0x55d128a4fb00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9183s, txc = 0x55d1208c0600
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9182s, txc = 0x55d128a4ef00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.918s, txc = 0x55d144df5b00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9179s, txc = 0x55d118688600
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9178s, txc = 0x55d14ed92600
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9177s, txc = 0x55d1b418d500
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9177s, txc = 0x55d1850f1200
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9176s, txc = 0x55d0c0c30900
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9174s, txc = 0x55d12ef79b00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9173s, txc = 0x55d123ca8f00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9172s, txc = 0x55d0d97c3800
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9171s, txc = 0x55d1397d5b00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9169s, txc = 0x55d0fe8e7200
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9168s, txc = 0x55d197168c00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9168s, txc = 0x55d0fc87d200
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9167s, txc = 0x55d197379800
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9166s, txc = 0x55d1a2d57800
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9165s, txc = 0x55d13427af00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9165s, txc = 0x55d0b56a2900
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9164s, txc = 0x55d0ef45e900
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9163s, txc = 0x55d151dacf00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9162s, txc = 0x55d1b66c4600
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9162s, txc = 0x55d120467200
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9161s, txc = 0x55d0de819500
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9159s, txc = 0x55d15bc18f00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9158s, txc = 0x55d1296df500
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9158s, txc = 0x55d0f27d0c00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9157s, txc = 0x55d0b4c2ac00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9156s, txc = 0x55d1751d6f00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9155s, txc = 0x55d1252d9b00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9154s, txc = 0x55d123ca8000
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9153s, txc = 0x55d0f7bbdb00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9152s, txc = 0x55d119024c00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.915s, txc = 0x55d1986e6300
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9149s, txc = 0x55d19c9f1800
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9148s, txc = 0x55d11aec1500
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9147s, txc = 0x55d12d1e9b00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9147s, txc = 0x55d17137d500
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9146s, txc = 0x55d17137c600
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9145s, txc = 0x55d115405b00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9144s, txc = 0x55d13b2d3b00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9143s, txc = 0x55d15a078300
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.9142s, txc = 0x55d1050b5200
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.5713s, txc = 0x55d111239500
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.5712s, txc = 0x55d111238c00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.5711s, txc = 0x55d111239b00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.5711s, txc = 0x55d111238900
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.5709s, txc = 0x55d0f27d0600
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.5709s, txc = 0x55d0f27d1200
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.5708s, txc = 0x55d0f27d0000
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.5707s, txc = 0x55d1296def00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.5705s, txc = 0x55d0f27d1b00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.5705s, txc = 0x55d0e7fb5800
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.5704s, txc = 0x55d0e268cf00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.5703s, txc = 0x55d122dccf00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.5702s, txc = 0x55d0e20e4f00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.5631s, txc = 0x55d120467b00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.563s, txc = 0x55d13ba30c00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.5629s, txc = 0x55d0fac8cc00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.5628s, txc = 0x55d11b1dcc00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.5334s, txc = 0x55d1a36bd200
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 20.5332s, txc = 0x55d18c384900
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.9678s, txc = 0x55d1a1b7e600
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.5621s, txc = 0x55d1252d8300
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.1695s, txc = 0x55d1a1b7fb00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.1695s, txc = 0x55d14b712600
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.1694s, txc = 0x55d12a05c900
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.1693s, txc = 0x55d0e20e2c00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.1693s, txc = 0x55d0e20e3500
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.1693s, txc = 0x55d11b1dc600
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.1689s, txc = 0x55d1296de900
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.1689s, txc = 0x55d0b56a3200
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.1689s, txc = 0x55d0de819200
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.1111s, txc = 0x55d128a4e000
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.9965s, txc = 0x55d0b4c2b200
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.1694s, txc = 0x55d19ad7a900
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.1691s, txc = 0x55d1b418c000
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.855s, txc = 0x55d13ba30900
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.8549s, txc = 0x55d0bdb3cc00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.8549s, txc = 0x55d0b4c2a600
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.8547s, txc = 0x55d0e406c900
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.8547s, txc = 0x55d135531800
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.8546s, txc = 0x55d1a98be900
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.8546s, txc = 0x55d1a192f800
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.8544s, txc = 0x55d1751d6900
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.8544s, txc = 0x55d0ef45e000
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.8543s, txc = 0x55d18bf58f00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.8541s, txc = 0x55d120467800
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.7511s, txc = 0x55d157936900
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.1697s, txc = 0x55d135531b00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.1692s, txc = 0x55d0df52d500
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 17.1004s, txc = 0x55d179db6f00
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.0082s, txc = 0x55d0ff746900
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 15.8313s, txc = 0x55d197168300
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.4708s, txc = 0x55d0fcd7a600
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 10.4553s, txc = 0x55d0e7fb4900
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 8.72283s, txc = 0x55d1a192e900
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.65694s, txc = 0x55d10891c000
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 5.59148s, txc = 0x55d0e20e2000
2020-07-29 00:03:00.588 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 5.59129s, txc = 0x55d0beafc000
2020-07-29 00:03:00.788 7f076ef26700  4 rocksdb: [db/compaction_job.cc:1395] [default] [JOB 140] Compacted 4@0 + 5@1 files to L1 => 271308073 bytes
2020-07-29 00:03:00.792 7f076ef26700  4 rocksdb: (Original Log Time 2020/07/29-00:03:00.794039) [db/compaction_job.cc:768] [default] compacted to: files[0 5 37 0 0 0 0] max score 1.24, MB/sec: 4.4 rd, 3.9 wr, level 1, files in(4, 5) out(5) MB in(74.2, 222.6) out(258.7), read-write-amplify(7.5) write-amplify(3.5) OK, records in: 2055225, records dropped: 109913 output_compression: NoCompression

2020-07-29 00:03:00.792 7f076ef26700  4 rocksdb: (Original Log Time 2020/07/29-00:03:00.794068) EVENT_LOG_v1 {"time_micros": 1595973780794057, "job": 140, "event": "compaction_finished", "compaction_time_micros": 70371689, "compaction_time_cpu_micros": 2405364, "output_level": 1, "num_output_files": 5, "total_output_size": 271308073, "num_input_records": 2015866, "num_output_records": 1905953, "num_subcompactions": 1, "output_compression": "NoCompression", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 5, 37, 0, 0, 0, 0]}
2020-07-29 00:03:00.792 7f076ef26700  4 rocksdb: EVENT_LOG_v1 {"time_micros": 1595973780794196, "job": 140, "event": "table_file_deletion", "file_number": 163421}
2020-07-29 00:03:00.792 7f076ef26700  4 rocksdb: EVENT_LOG_v1 {"time_micros": 1595973780794226, "job": 140, "event": "table_file_deletion", "file_number": 163419}
2020-07-29 00:03:00.792 7f076ef26700  4 rocksdb: EVENT_LOG_v1 {"time_micros": 1595973780794256, "job": 140, "event": "table_file_deletion", "file_number": 163417}
2020-07-29 00:03:00.792 7f076ef26700  4 rocksdb: EVENT_LOG_v1 {"time_micros": 1595973780794306, "job": 140, "event": "table_file_deletion", "file_number": 163415}
2020-07-29 00:03:00.792 7f076ef26700  4 rocksdb: EVENT_LOG_v1 {"time_micros": 1595973780794348, "job": 140, "event": "table_file_deletion", "file_number": 163413}
2020-07-29 00:03:00.792 7f076ef26700  4 rocksdb: EVENT_LOG_v1 {"time_micros": 1595973780794392, "job": 140, "event": "table_file_deletion", "file_number": 163412}
2020-07-29 00:03:00.792 7f076ef26700  4 rocksdb: EVENT_LOG_v1 {"time_micros": 1595973780794438, "job": 140, "event": "table_file_deletion", "file_number": 163411}
2020-07-29 00:03:00.792 7f076ef26700  4 rocksdb: EVENT_LOG_v1 {"time_micros": 1595973780794522, "job": 140, "event": "table_file_deletion", "file_number": 163410}
2020-07-29 00:03:00.792 7f076ef26700  4 rocksdb: EVENT_LOG_v1 {"time_micros": 1595973780794569, "job": 140, "event": "table_file_deletion", "file_number": 163409}
2020-07-29 00:03:00.792 7f076ef26700  4 rocksdb: [db/compaction_job.cc:1645] [default] [JOB 141] Compacting 1@1 + 2@2 files to L2, score 1.24
2020-07-29 00:03:00.792 7f076ef26700  4 rocksdb: [db/compaction_job.cc:1649] [default] Compaction start summary: Base version 140 Base level 1, inputs: [163422(66MB)], [163377(65MB) 163378(65MB)]

2020-07-29 00:03:00.792 7f076ef26700  4 rocksdb: EVENT_LOG_v1 {"time_micros": 1595973780794643, "job": 141, "event": "compaction_started", "compaction_reason": "LevelMaxLevelSize", "files_L1": [163422], "files_L2": [163377, 163378], "score": 1.23943, "input_data_size": 207934169}
2020-07-29 00:03:17.700 7f076ef26700  4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 141] Generated table #163427: 339083 keys, 69009377 bytes
2020-07-29 00:03:17.700 7f076ef26700  4 rocksdb: EVENT_LOG_v1 {"time_micros": 1595973797705574, "cf_name": "default", "job": 141, "event": "table_file_creation", "file_number": 163427, "file_size": 69009377, "table_properties": {"data_size": 67111784, "index_size": 1048920, "filter_size": 847813, "raw_key_size": 18792390, "raw_average_key_size": 55, "raw_value_size": 59267636, "raw_average_value_size": 174, "num_data_blocks": 16654, "num_entries": 339083, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
2020-07-29 00:03:17.836 7f076d723700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency slow operation observed for kv_commit, latency = 16.5666s
2020-07-29 00:03:17.836 7f076d723700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency slow operation observed for kv_sync, latency = 16.5666s
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.617s, txc = 0x55d13e747800
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6169s, txc = 0x55d122dcd500
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6169s, txc = 0x55d179db7200
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6169s, txc = 0x55d129934c00
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6168s, txc = 0x55d123854300
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6168s, txc = 0x55d0fdf5bb00
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6167s, txc = 0x55d194420600
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6166s, txc = 0x55d13c943b00
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6166s, txc = 0x55d1b418cc00
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6166s, txc = 0x55d14b712900
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6165s, txc = 0x55d12ef79500
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6165s, txc = 0x55d14d9e2300
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6164s, txc = 0x55d14bec1800
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6164s, txc = 0x55d0de561800
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6164s, txc = 0x55d133f25b00
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6163s, txc = 0x55d0fdce3b00
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6158s, txc = 0x55d153e55800
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6158s, txc = 0x55d0b75ccf00
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6157s, txc = 0x55d13e746300
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6157s, txc = 0x55d1a0762300
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6157s, txc = 0x55d120466900
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6156s, txc = 0x55d197378000
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6156s, txc = 0x55d0e8890900
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6156s, txc = 0x55d0b74f6f00
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6155s, txc = 0x55d175a0bb00
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6155s, txc = 0x55d15e064900
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6155s, txc = 0x55d128a4f800
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6155s, txc = 0x55d0f5898600
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6153s, txc = 0x55d134292000
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6152s, txc = 0x55d15a078600
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6152s, txc = 0x55d1a98bec00
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6151s, txc = 0x55d1a7160600
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6151s, txc = 0x55d15e065200
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.615s, txc = 0x55d0f2316f00
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.615s, txc = 0x55d0c53d0f00
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6149s, txc = 0x55d0fac8c300
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6148s, txc = 0x55d132da4900
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6147s, txc = 0x55d118688000
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6147s, txc = 0x55d105cf4900
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6146s, txc = 0x55d1101ccc00
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6145s, txc = 0x55d192d57500
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6145s, txc = 0x55d0f5898300
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6144s, txc = 0x55d183ebd500
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6143s, txc = 0x55d10f328f00
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6142s, txc = 0x55d0bf3f3500
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6142s, txc = 0x55d0b74c8600
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6141s, txc = 0x55d0f5898c00
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.614s, txc = 0x55d105cf5b00
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6139s, txc = 0x55d119025500
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6138s, txc = 0x55d0ffe41500
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6137s, txc = 0x55d156578f00
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6137s, txc = 0x55d0ffe40300
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6136s, txc = 0x55d0b74c8f00
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6135s, txc = 0x55d0c53d0300
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6134s, txc = 0x55d1a189d200
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6134s, txc = 0x55d0e7fb5200
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6133s, txc = 0x55d199037b00
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6132s, txc = 0x55d0f3aa2300
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6131s, txc = 0x55d132da5500
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.613s, txc = 0x55d0fcd7a300
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6129s, txc = 0x55d0e1e8cc00
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6129s, txc = 0x55d15920d200
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6128s, txc = 0x55d14bec1500
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6127s, txc = 0x55d1b418d800
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6126s, txc = 0x55d11b1dc600
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6125s, txc = 0x55d197379500
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6125s, txc = 0x55d0e20e3500
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6124s, txc = 0x55d15a078000
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6123s, txc = 0x55d0b4c2a600
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6117s, txc = 0x55d123392900
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6116s, txc = 0x55d199095800
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6114s, txc = 0x55d1208c0000
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6114s, txc = 0x55d0e1e8c600
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6113s, txc = 0x55d129934000
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6112s, txc = 0x55d0de561b00
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6111s, txc = 0x55d10f328900
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6111s, txc = 0x55d1986e6c00
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.611s, txc = 0x55d14bec0c00
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6109s, txc = 0x55d197168600
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6108s, txc = 0x55d141f41800
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6107s, txc = 0x55d0ef0c0c00
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6106s, txc = 0x55d14d9e2c00
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6105s, txc = 0x55d134293b00
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6105s, txc = 0x55d162aa6300
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6104s, txc = 0x55d0df52c600
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6104s, txc = 0x55d13bb56900
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6101s, txc = 0x55d115deb800
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.61s, txc = 0x55d1b0936000
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6099s, txc = 0x55d1b98adb00
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6099s, txc = 0x55d12ef79800
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6097s, txc = 0x55d0f42e0f00
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6077s, txc = 0x55d1a95d4c00
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6061s, txc = 0x55d120467500
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.606s, txc = 0x55d14b712300
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.5954s, txc = 0x55d0be5bb200
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.5952s, txc = 0x55d0e1b23800
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.5687s, txc = 0x55d1050b5200
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.5686s, txc = 0x55d0ef0c0300
2020-07-29 00:03:17.836 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.5684s, txc = 0x55d13b2d3b00
2020-07-29 00:03:18.084 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.8153s, txc = 0x55d17137c600
2020-07-29 00:03:18.084 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.8153s, txc = 0x55d1a189c900
2020-07-29 00:03:18.084 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.7768s, txc = 0x55d12d1e9b00
2020-07-29 00:03:18.084 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.7766s, txc = 0x55d12a05d200
2020-07-29 00:03:18.084 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.7766s, txc = 0x55d19839ac00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.7765s, txc = 0x55d0fdf5d500
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.7765s, txc = 0x55d19c9f1800
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.7764s, txc = 0x55d131a1e000
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.7764s, txc = 0x55d1296dfb00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.7763s, txc = 0x55d119024c00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.7763s, txc = 0x55d169473b00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.7762s, txc = 0x55d123ca8000
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.7761s, txc = 0x55d0e0929500
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.7761s, txc = 0x55d1751d6f00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.776s, txc = 0x55d19f8e4300
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.776s, txc = 0x55d0f27d0c00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.7759s, txc = 0x55d1a36bc000
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.7758s, txc = 0x55d15bc18f00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.7757s, txc = 0x55d157936c00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.7756s, txc = 0x55d120467200
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.7755s, txc = 0x55d151dacf00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.7755s, txc = 0x55d115404300
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.7754s, txc = 0x55d0b56a2900
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.7753s, txc = 0x55d194615b00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.7753s, txc = 0x55d1a2d57800
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.7751s, txc = 0x55d1a1b7f800
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.7416s, txc = 0x55d0fc87d200
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.7414s, txc = 0x55d17e16c000
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.7413s, txc = 0x55d0fe8e7200
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.4869s, txc = 0x55d0f2c76600
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 15.969s, txc = 0x55d1b98ac900
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 15.9689s, txc = 0x55d0be09d500
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 15.9689s, txc = 0x55d1b66c5200
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 15.4643s, txc = 0x55d0ef0c1200
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 15.4622s, txc = 0x55d155189800
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 15.4643s, txc = 0x55d1a36bdb00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 14.9553s, txc = 0x55d19ad7b800
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 14.6034s, txc = 0x55d0d6c05800
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.6758s, txc = 0x55d156578300
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.6758s, txc = 0x55d115405200
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 13.4645s, txc = 0x55d111239b00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.4739s, txc = 0x55d0e268c600
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.3958s, txc = 0x55d1296def00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.3956s, txc = 0x55d15bc18900
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.3956s, txc = 0x55d1a0762900
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.3956s, txc = 0x55d1397d5b00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.3956s, txc = 0x55d14ba18300
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.3955s, txc = 0x55d122dccf00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.3369s, txc = 0x55d1a9c26600
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.3343s, txc = 0x55d1b0936c00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.3343s, txc = 0x55d19ad7a600
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.3341s, txc = 0x55d1850f0600
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1861s, txc = 0x55d14bec0f00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1859s, txc = 0x55d0fdf5cf00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1857s, txc = 0x55d12d1e9800
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1857s, txc = 0x55d10ff8c000
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1856s, txc = 0x55d12d1e8000
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1856s, txc = 0x55d14064fb00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1855s, txc = 0x55d12d1e9200
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1855s, txc = 0x55d199036300
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1853s, txc = 0x55d18175b800
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1853s, txc = 0x55d0f28b0c00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1852s, txc = 0x55d1a189c000
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1851s, txc = 0x55d1a189d800
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1851s, txc = 0x55d0f28b0f00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.185s, txc = 0x55d199037800
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.185s, txc = 0x55d0f28b0600
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1849s, txc = 0x55d199037500
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1849s, txc = 0x55d17e9d5800
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1848s, txc = 0x55d19ad7a900
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1847s, txc = 0x55d17e9d5b00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1847s, txc = 0x55d150452c00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1846s, txc = 0x55d0e7fb5500
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1846s, txc = 0x55d17e9d4000
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1845s, txc = 0x55d17e9d4300
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1844s, txc = 0x55d1a2d56000
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1844s, txc = 0x55d17e9d4900
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1843s, txc = 0x55d18175a600
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1842s, txc = 0x55d0f2316300
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1842s, txc = 0x55d19f8e5500
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1841s, txc = 0x55d151dac900
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1841s, txc = 0x55d19f8e5800
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.184s, txc = 0x55d199095500
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.184s, txc = 0x55d19f8e4900
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1839s, txc = 0x55d0ef0c1800
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1838s, txc = 0x55d12a05c000
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1838s, txc = 0x55d1397d4f00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1837s, txc = 0x55d1a1b7e900
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1837s, txc = 0x55d0f42e1200
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1836s, txc = 0x55d0e00e9b00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1835s, txc = 0x55d133f24f00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1834s, txc = 0x55d1397d4000
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1833s, txc = 0x55d0f175b200
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1832s, txc = 0x55d1a7160900
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1831s, txc = 0x55d0c0c30600
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.183s, txc = 0x55d17df96f00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1829s, txc = 0x55d1a6d19b00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1827s, txc = 0x55d0bf3f2f00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1826s, txc = 0x55d0fccf8300
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1825s, txc = 0x55d13e746f00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1824s, txc = 0x55d142ceac00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1823s, txc = 0x55d123392000
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.1821s, txc = 0x55d17237ec00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.0337s, txc = 0x55d155188000
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.0335s, txc = 0x55d0de561200
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.032s, txc = 0x55d155189b00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.0319s, txc = 0x55d12d1e8300
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 12.0318s, txc = 0x55d0bdb3c300
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 11.946s, txc = 0x55d0ffe40f00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 11.9463s, txc = 0x55d1a192f200
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 11.9463s, txc = 0x55d1a1b7f500
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 11.9461s, txc = 0x55d17137db00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 11.946s, txc = 0x55d179db6c00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 11.9459s, txc = 0x55d0f5898000
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 11.9458s, txc = 0x55d15bc18300
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 11.9457s, txc = 0x55d1077cf200
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 11.9457s, txc = 0x55d0e5e27800
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 11.9455s, txc = 0x55d0e1b23b00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 11.9454s, txc = 0x55d0e5e27b00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 11.8847s, txc = 0x55d14b58a300
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 11.8846s, txc = 0x55d0fac8cc00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 11.8846s, txc = 0x55d133f25200
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 11.4909s, txc = 0x55d179db6000
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 11.117s, txc = 0x55d0ff746600
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 9.06928s, txc = 0x55d135530f00
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.79544s, txc = 0x55d175234600
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.78941s, txc = 0x55d0b3238000
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.35696s, txc = 0x55d171574600
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.35693s, txc = 0x55d0b75cc000
2020-07-29 00:03:18.088 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 6.76052s, txc = 0x55d199036600
2020-07-29 00:03:36.152 7f076ef26700  4 rocksdb: [db/compaction_job.cc:1332] [default] [JOB 141] Generated table #163428: 154841 keys, 68843856 bytes
2020-07-29 00:03:36.152 7f076ef26700  4 rocksdb: EVENT_LOG_v1 {"time_micros": 1595973816154700, "cf_name": "default", "job": 141, "event": "table_file_creation", "file_number": 163428, "file_size": 68843856, "table_properties": {"data_size": 66996336, "index_size": 1459519, "filter_size": 387141, "raw_key_size": 11269966, "raw_average_key_size": 72, "raw_value_size": 62657611, "raw_average_value_size": 404, "num_data_blocks": 16907, "num_entries": 154841, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}}
2020-07-29 00:03:36.152 7f076ef26700  4 rocksdb: [db/compaction_job.cc:1395] [default] [JOB 141] Compacted 1@1 + 2@2 files to L2 => 137853233 bytes
2020-07-29 00:03:36.288 7f076ef26700  4 rocksdb: (Original Log Time 2020/07/29-00:03:36.293779) [db/compaction_job.cc:768] [default] compacted to: files[0 4 37 0 0 0 0] max score 0.85, MB/sec: 5.9 rd, 3.9 wr, level 2, files in(1, 2) out(2) MB in(66.7, 131.6) out(131.5), read-write-amplify(4.9) write-amplify(2.0) OK, records in: 1209301, records dropped: 715353 output_compression: NoCompression

2020-07-29 00:03:36.288 7f076ef26700  4 rocksdb: (Original Log Time 2020/07/29-00:03:36.293813) EVENT_LOG_v1 {"time_micros": 1595973816293795, "job": 141, "event": "compaction_finished", "compaction_time_micros": 35360143, "compaction_time_cpu_micros": 1072108, "output_level": 2, "num_output_files": 2, "total_output_size": 137853233, "num_input_records": 1209277, "num_output_records": 493924, "num_subcompactions": 1, "output_compression": "NoCompression", "num_single_delete_mismatches": 0, "num_single_delete_fallthrough": 0, "lsm_state": [0, 4, 37, 0, 0, 0, 0]}
2020-07-29 00:03:36.292 7f076ef26700  4 rocksdb: EVENT_LOG_v1 {"time_micros": 1595973816293948, "job": 141, "event": "table_file_deletion", "file_number": 163422}
2020-07-29 00:03:36.304 7f076ef26700  4 rocksdb: EVENT_LOG_v1 {"time_micros": 1595973816306178, "job": 141, "event": "table_file_deletion", "file_number": 163378}
2020-07-29 00:03:36.304 7f076ef26700  4 rocksdb: EVENT_LOG_v1 {"time_micros": 1595973816306304, "job": 141, "event": "table_file_deletion", "file_number": 163377}
2020-07-29 00:03:36.304 7f076d723700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency slow operation observed for kv_commit, latency = 18.217s
2020-07-29 00:03:36.304 7f076d723700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency slow operation observed for kv_sync, latency = 18.217s
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4639s, txc = 0x55d158972f00
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4638s, txc = 0x55d17137d800
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4632s, txc = 0x55d0e0929200
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4631s, txc = 0x55d0fc87cc00
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4631s, txc = 0x55d19cf10f00
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.463s, txc = 0x55d199095b00
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.463s, txc = 0x55d11b1dd800
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4629s, txc = 0x55d1252d8000
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4629s, txc = 0x55d123392300
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4629s, txc = 0x55d18bf58f00
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4628s, txc = 0x55d1a98be900
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4628s, txc = 0x55d0bdb3cc00
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4628s, txc = 0x55d0e7fb4900
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.463s, txc = 0x55d123ca8f00
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4628s, txc = 0x55d128a4e000
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4627s, txc = 0x55d1a1b7e600
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4627s, txc = 0x55d11aec0900
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4626s, txc = 0x55d0ff746900
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4626s, txc = 0x55d175a0ac00
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4625s, txc = 0x55d0df52c300
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4624s, txc = 0x55d0d6c04f00
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4623s, txc = 0x55d113fed200
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4623s, txc = 0x55d16b543200
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4622s, txc = 0x55d1a36bd800
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4621s, txc = 0x55d17237e900
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.462s, txc = 0x55d1a6d19800
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.462s, txc = 0x55d0f7bbcf00
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4619s, txc = 0x55d162aa6000
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4618s, txc = 0x55d1021d6300
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4618s, txc = 0x55d135530300
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4617s, txc = 0x55d0f2c77200
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4616s, txc = 0x55d0ffe41200
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4615s, txc = 0x55d15920cf00
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4614s, txc = 0x55d134293200
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4613s, txc = 0x55d11939e900
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4613s, txc = 0x55d0c53d0000
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4612s, txc = 0x55d0e00e8900
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4611s, txc = 0x55d137f4e900
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.461s, txc = 0x55d175a0b200
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4609s, txc = 0x55d17df96300
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4609s, txc = 0x55d14b58ac00
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4608s, txc = 0x55d0b75cd800
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4607s, txc = 0x55d15920db00
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4601s, txc = 0x55d0b56a2000
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.46s, txc = 0x55d19ad7bb00
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4599s, txc = 0x55d1a9c26000
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4598s, txc = 0x55d0e8890c00
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4598s, txc = 0x55d115deb500
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4597s, txc = 0x55d194c8e600
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4596s, txc = 0x55d1b418d200
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4596s, txc = 0x55d13e746900
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4595s, txc = 0x55d194421800
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4595s, txc = 0x55d0f80f4f00
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4594s, txc = 0x55d0e1e8d200
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4592s, txc = 0x55d0e00e8f00
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4592s, txc = 0x55d18ef9f200
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4591s, txc = 0x55d132da4300
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.459s, txc = 0x55d1a2d57200
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4589s, txc = 0x55d0c53d1800
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4588s, txc = 0x55d11aec1800
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4588s, txc = 0x55d0ff747800
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4587s, txc = 0x55d14064ef00
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4587s, txc = 0x55d12d1e9500
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4586s, txc = 0x55d0f2316c00
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4586s, txc = 0x55d13c942f00
2020-07-29 00:03:36.304 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.4585s, txc = 0x55d0d6c05b00
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.3287s, txc = 0x55d0f42e1800
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.3282s, txc = 0x55d1b0937800
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.3279s, txc = 0x55d12a05c600
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.3279s, txc = 0x55d120467b00
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.3279s, txc = 0x55d19ad7a300
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.3279s, txc = 0x55d137690300
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.3277s, txc = 0x55d0c0c30900
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.3277s, txc = 0x55d10891c000
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.3274s, txc = 0x55d0e1b23200
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.3275s, txc = 0x55d0e7fb5800
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.3272s, txc = 0x55d0beafd800
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.3272s, txc = 0x55d0e00e8300
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.3271s, txc = 0x55d0f3aa2c00
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.3271s, txc = 0x55d0f42e0300
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.3269s, txc = 0x55d0de819500
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.3268s, txc = 0x55d1296df500
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.3268s, txc = 0x55d12a05d800
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.3268s, txc = 0x55d115404f00
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.3268s, txc = 0x55d0b4c2ac00
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.3267s, txc = 0x55d1252d9b00
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.3266s, txc = 0x55d18252f200
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.3265s, txc = 0x55d1561aa000
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.3265s, txc = 0x55d134628f00
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.3264s, txc = 0x55d14064f500
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.2848s, txc = 0x55d0d84e2000
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.2227s, txc = 0x55d162aa6f00
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.221s, txc = 0x55d1b418d500
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 18.221s, txc = 0x55d13e746c00
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.8971s, txc = 0x55d114151800
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.6464s, txc = 0x55d14ed92600
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.5801s, txc = 0x55d0b2b07500
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 16.5796s, txc = 0x55d197378600
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 15.3069s, txc = 0x55d0fad15500
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 14.8545s, txc = 0x55d1b98ac000
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 14.8536s, txc = 0x55d144df5b00
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 14.3427s, txc = 0x55d115deb200
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 10.6987s, txc = 0x55d0f5899200
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 10.6985s, txc = 0x55d0b2b07800
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 8.96655s, txc = 0x55d0beafc000
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 8.73707s, txc = 0x55d1101cd500
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 8.7369s, txc = 0x55d111238c00
2020-07-29 00:03:36.416 7f076cf22700  0 bluestore(/var/lib/ceph/osd/ceph-3) log_latency_fn slow operation observed for _txc_committed_kv, latency = 7.88094s, txc = 0x55d1a192f500
2020-07-29 00:08:52.519 7f0766f16700  4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS -------
2020-07-29 00:08:52.519 7f0766f16700  4 rocksdb: [db/db_impl.cc:778] 
** DB Stats **
Uptime(secs): 170401.6 total, 600.0 interval
Cumulative writes: 5825K writes, 29M keys, 5825K commit groups, 1.0 writes per commit group, ingest: 24.57 GB, 0.15 MB/s
Cumulative WAL: 5825K writes, 2151K syncs, 2.71 writes per sync, written: 24.57 GB, 0.15 MB/s
Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent
Interval writes: 15K writes, 75K keys, 15K commit groups, 1.0 writes per commit group, ingest: 71.30 MB, 0.12 MB/s
Interval WAL: 15K writes, 4742 syncs, 3.18 writes per sync, written: 0.07 MB, 0.12 MB/s
Interval stall: 00:00:0.000 H:M:S, 0.0 percent

** Compaction Stats [default] **
Level    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  L0      0/0    0.00 KB   0.0      0.0     0.0      0.0       1.1      1.1       0.0   1.0      0.0      3.4    323.15             13.28       105    3.078       0      0
  L1      4/0   192.01 MB   0.8      3.8     1.1      2.7       3.3      0.6       0.0   2.9      4.1      3.6    942.87             35.80        27   34.921     32M  1954K
  L2     37/0    2.12 GB   0.8      4.4     0.5      3.9       3.9     -0.0       0.0   7.4      4.1      3.7   1080.87             22.60         8  135.109     15M  6598K
 Sum     41/0    2.31 GB   0.0      8.2     1.6      6.5       8.2      1.7       0.0   7.6      3.6      3.6   2346.90             71.68       140   16.764     48M  8553K
 Int      0/0    0.00 KB   0.0      0.5     0.1      0.3       0.4      0.1       0.0  14.0      4.3      3.7    114.26              3.72         3   38.086   3264K   825K

** Compaction Stats [default] **
Priority    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
 Low      0/0    0.00 KB   0.0      8.2     1.6      6.5       7.1      0.6       0.0   0.0      4.1      3.6   2023.74             58.40        35   57.821     48M  8553K
High      0/0    0.00 KB   0.0      0.0     0.0      0.0       1.1      1.1       0.0   0.0      0.0      3.4    322.15             13.28       104    3.098       0      0
User      0/0    0.00 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      2.9      1.00              0.00         1    1.002       0      0
Uptime(secs): 170401.6 total, 600.0 interval
Flush(GB): cumulative 1.082, interval 0.029
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 8.21 GB write, 0.05 MB/s write, 8.16 GB read, 0.05 MB/s read, 2346.9 seconds
Interval compaction: 0.41 GB write, 0.70 MB/s write, 0.48 GB read, 0.83 MB/s read, 114.3 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count

** File Read Latency Histogram By Level [default] **

** Compaction Stats [default] **
Level    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
  L0      0/0    0.00 KB   0.0      0.0     0.0      0.0       1.1      1.1       0.0   1.0      0.0      3.4    323.15             13.28       105    3.078       0      0
  L1      4/0   192.01 MB   0.8      3.8     1.1      2.7       3.3      0.6       0.0   2.9      4.1      3.6    942.87             35.80        27   34.921     32M  1954K
  L2     37/0    2.12 GB   0.8      4.4     0.5      3.9       3.9     -0.0       0.0   7.4      4.1      3.7   1080.87             22.60         8  135.109     15M  6598K
 Sum     41/0    2.31 GB   0.0      8.2     1.6      6.5       8.2      1.7       0.0   7.6      3.6      3.6   2346.90             71.68       140   16.764     48M  8553K
 Int      0/0    0.00 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      0.0      0.00              0.00         0    0.000       0      0

** Compaction Stats [default] **
Priority    Files   Size     Score Read(GB)  Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
 Low      0/0    0.00 KB   0.0      8.2     1.6      6.5       7.1      0.6       0.0   0.0      4.1      3.6   2023.74             58.40        35   57.821     48M  8553K
High      0/0    0.00 KB   0.0      0.0     0.0      0.0       1.1      1.1       0.0   0.0      0.0      3.4    322.15             13.28       104    3.098       0      0
User      0/0    0.00 KB   0.0      0.0     0.0      0.0       0.0      0.0       0.0   0.0      0.0      2.9      1.00              0.00         1    1.002       0      0
Uptime(secs): 170401.6 total, 0.0 interval
Flush(GB): cumulative 1.082, interval 0.000
AddFile(GB): cumulative 0.000, interval 0.000
AddFile(Total Files): cumulative 0, interval 0
AddFile(L0 Files): cumulative 0, interval 0
AddFile(Keys): cumulative 0, interval 0
Cumulative compaction: 8.21 GB write, 0.05 MB/s write, 8.16 GB read, 0.05 MB/s read, 2346.9 seconds
Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds
Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count

** File Read Latency Histogram By Level [default] **

iostat -x

Device            r/s     w/s     rkB/s     wkB/s   rrqm/s   wrqm/s  %rrqm  %wrqm r_await w_await aqu-sz rareq-sz wareq-sz  svctm  %util
nvme0n1          0.00    2.00      0.00     24.00     0.00    46.00   0.00  95.83    0.00    0.00   0.00     0.00    12.00   2.00   0.40
nvme1n1          0.00 1495.00      0.00   3924.00     0.00  6099.00   0.00  80.31    0.00  352.39 523.78     0.00     2.62   0.67 100.00

iotop

Total DISK READ:         0.00 B/s | Total DISK WRITE:      1573.47 K/s
Current DISK READ:       0.00 B/s | Current DISK WRITE:       3.43 M/s
    TID  PRIO  USER     DISK READ  DISK WRITE  SWAPIN     IO>    COMMAND                                                                                                                                                                                                    
   2306 be/4 ceph        0.00 B/s 1533.22 K/s  0.00 % 99.99 % ceph-osd -f --cluster ceph --id 3 --setuser ceph --setgroup ceph [rocksdb:low1]