Skip to content

Instantly share code, notes, and snippets.

@telmich
Created August 31, 2017 18:27
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save telmich/00d7a0a97fb0590359be700928429b92 to your computer and use it in GitHub Desktop.
Save telmich/00d7a0a97fb0590359be700928429b92 to your computer and use it in GitHub Desktop.
2017-08-31 19:49:59.798709 7fa8c2ca0480 0 ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc), process (unknown), pid 64162
2017-08-31 19:49:59.803636 7fa8c2ca0480 0 pidfile_write: ignore empty --pid-file
2017-08-31 19:49:59.813487 7fa8c2ca0480 1 mgr send_beacon standby
2017-08-31 19:50:00.046694 7fa8b9fae700 1 mgr handle_mgr_map Activating!
2017-08-31 19:50:00.047046 7fa8b9fae700 1 mgr handle_mgr_map I am now activating
/build/ceph-12.2.0/src/mgr/Mgr.cc: In function 'void Mgr::load_config()' thread 7fa8b5fa6700 time 2017-08-31 19:50:00.068610
/build/ceph-12.2.0/src/mgr/Mgr.cc: 340: FAILED assert(cmd.r == 0)
ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc)
1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x102) [0x5610f70dfc02]
2: (Mgr::load_config()+0x854) [0x5610f6fb1484]
3: (Mgr::init()+0x6b2) [0x5610f6fb31e2]
4: (()+0x2e49bc) [0x5610f6fb39bc]
5: (FunctionContext::finish(int)+0x2c) [0x5610f6f7a27c]
6: (Context::complete(int)+0x9) [0x5610f6f756c9]
7: (Finisher::finisher_thread_entry()+0x198) [0x5610f70debc8]
8: (()+0x8064) [0x7fa8c078c064]
9: (clone()+0x6d) [0x7fa8bf87762d]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
2017-08-31 19:50:00.070448 7fa8b5fa6700 -1 /build/ceph-12.2.0/src/mgr/Mgr.cc: In function 'void Mgr::load_config()' thread 7fa8b5fa6700 time 2017-08-31 19:50:00.068610
/build/ceph-12.2.0/src/mgr/Mgr.cc: 340: FAILED assert(cmd.r == 0)
ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc)
1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x102) [0x5610f70dfc02]
2: (Mgr::load_config()+0x854) [0x5610f6fb1484]
3: (Mgr::init()+0x6b2) [0x5610f6fb31e2]
4: (()+0x2e49bc) [0x5610f6fb39bc]
5: (FunctionContext::finish(int)+0x2c) [0x5610f6f7a27c]
6: (Context::complete(int)+0x9) [0x5610f6f756c9]
7: (Finisher::finisher_thread_entry()+0x198) [0x5610f70debc8]
8: (()+0x8064) [0x7fa8c078c064]
9: (clone()+0x6d) [0x7fa8bf87762d]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
--- begin dump of recent events ---
-275> 2017-08-31 19:49:59.790891 7fa8c2ca0480 5 asok(0x5611015e21c0) register_command perfcounters_dump hook 0x5611015a2040
-274> 2017-08-31 19:49:59.790909 7fa8c2ca0480 5 asok(0x5611015e21c0) register_command 1 hook 0x5611015a2040
-273> 2017-08-31 19:49:59.790914 7fa8c2ca0480 5 asok(0x5611015e21c0) register_command perf dump hook 0x5611015a2040
-272> 2017-08-31 19:49:59.790918 7fa8c2ca0480 5 asok(0x5611015e21c0) register_command perfcounters_schema hook 0x5611015a2040
-271> 2017-08-31 19:49:59.790922 7fa8c2ca0480 5 asok(0x5611015e21c0) register_command perf histogram dump hook 0x5611015a2040
-270> 2017-08-31 19:49:59.790925 7fa8c2ca0480 5 asok(0x5611015e21c0) register_command 2 hook 0x5611015a2040
-269> 2017-08-31 19:49:59.790929 7fa8c2ca0480 5 asok(0x5611015e21c0) register_command perf schema hook 0x5611015a2040
-268> 2017-08-31 19:49:59.790933 7fa8c2ca0480 5 asok(0x5611015e21c0) register_command perf histogram schema hook 0x5611015a2040
-267> 2017-08-31 19:49:59.791015 7fa8c2ca0480 5 asok(0x5611015e21c0) register_command perf reset hook 0x5611015a2040
-266> 2017-08-31 19:49:59.791035 7fa8c2ca0480 5 asok(0x5611015e21c0) register_command config show hook 0x5611015a2040
-265> 2017-08-31 19:49:59.791049 7fa8c2ca0480 5 asok(0x5611015e21c0) register_command config help hook 0x5611015a2040
-264> 2017-08-31 19:49:59.791054 7fa8c2ca0480 5 asok(0x5611015e21c0) register_command config set hook 0x5611015a2040
-263> 2017-08-31 19:49:59.791068 7fa8c2ca0480 5 asok(0x5611015e21c0) register_command config get hook 0x5611015a2040
-262> 2017-08-31 19:49:59.791073 7fa8c2ca0480 5 asok(0x5611015e21c0) register_command config diff hook 0x5611015a2040
-261> 2017-08-31 19:49:59.791087 7fa8c2ca0480 5 asok(0x5611015e21c0) register_command config diff get hook 0x5611015a2040
-260> 2017-08-31 19:49:59.791103 7fa8c2ca0480 5 asok(0x5611015e21c0) register_command log flush hook 0x5611015a2040
-259> 2017-08-31 19:49:59.791110 7fa8c2ca0480 5 asok(0x5611015e21c0) register_command log dump hook 0x5611015a2040
-258> 2017-08-31 19:49:59.791115 7fa8c2ca0480 5 asok(0x5611015e21c0) register_command log reopen hook 0x5611015a2040
-257> 2017-08-31 19:49:59.791135 7fa8c2ca0480 5 asok(0x5611015e21c0) register_command dump_mempools hook 0x561101614ae8
-256> 2017-08-31 19:49:59.798709 7fa8c2ca0480 0 ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc), process (unknown), pid 64162
-255> 2017-08-31 19:49:59.803636 7fa8c2ca0480 0 pidfile_write: ignore empty --pid-file
-254> 2017-08-31 19:49:59.806909 7fa8c2ca0480 5 asok(0x5611015e21c0) init /var/lib/ceph/run/ceph-mgr.0.asok
-253> 2017-08-31 19:49:59.806934 7fa8c2ca0480 5 asok(0x5611015e21c0) bind_and_listen /var/lib/ceph/run/ceph-mgr.0.asok
-252> 2017-08-31 19:49:59.807103 7fa8c2ca0480 5 asok(0x5611015e21c0) register_command 0 hook 0x56110159e0c0
-251> 2017-08-31 19:49:59.807113 7fa8c2ca0480 5 asok(0x5611015e21c0) register_command version hook 0x56110159e0c0
-250> 2017-08-31 19:49:59.807130 7fa8c2ca0480 5 asok(0x5611015e21c0) register_command git_version hook 0x56110159e0c0
-249> 2017-08-31 19:49:59.807148 7fa8c2ca0480 5 asok(0x5611015e21c0) register_command help hook 0x5611015a2110
-248> 2017-08-31 19:49:59.807163 7fa8c2ca0480 5 asok(0x5611015e21c0) register_command get_command_descriptions hook 0x5611015a2120
-247> 2017-08-31 19:49:59.807236 7fa8bd7b5700 5 asok(0x5611015e21c0) entry start
-246> 2017-08-31 19:49:59.807988 7fa8bcfb4700 2 Event(0x5611015df280 nevent=5000 time_id=1).set_owner idx=0 owner=140362701817600
-245> 2017-08-31 19:49:59.808055 7fa8bc7b3700 2 Event(0x5611015df680 nevent=5000 time_id=1).set_owner idx=1 owner=140362693424896
-244> 2017-08-31 19:49:59.808090 7fa8bbfb2700 2 Event(0x5611015dfa80 nevent=5000 time_id=1).set_owner idx=2 owner=140362685032192
-243> 2017-08-31 19:49:59.808492 7fa8c2ca0480 1 Processor -- start
-242> 2017-08-31 19:49:59.808582 7fa8c2ca0480 1 -- - start start
-241> 2017-08-31 19:49:59.808589 7fa8c2ca0480 10 monclient: build_initial_monmap
-240> 2017-08-31 19:49:59.808641 7fa8c2ca0480 10 monclient: init
-239> 2017-08-31 19:49:59.808650 7fa8c2ca0480 5 adding auth protocol: cephx
-238> 2017-08-31 19:49:59.808655 7fa8c2ca0480 10 monclient: auth_supported 2 method cephx
-237> 2017-08-31 19:49:59.808862 7fa8c2ca0480 2 auth: KeyRing::load: loaded key file /var/lib/ceph/mgr/ceph-0/keyring
-236> 2017-08-31 19:49:59.808953 7fa8c2ca0480 10 monclient: _reopen_session rank -1
-235> 2017-08-31 19:49:59.809030 7fa8c2ca0480 10 monclient(hunting): picked mon.noname-a con 0x561101833000 addr [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0
-234> 2017-08-31 19:49:59.809068 7fa8c2ca0480 10 monclient(hunting): picked mon.noname-b con 0x561101834800 addr [2a0a:e5c0::21b:21ff:fe85:a42a]:6789/0
-233> 2017-08-31 19:49:59.809092 7fa8c2ca0480 1 -- - --> [2a0a:e5c0::21b:21ff:fe85:a42a]:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5611015fef00 con 0
-232> 2017-08-31 19:49:59.809118 7fa8c2ca0480 1 -- - --> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5611015ff180 con 0
-231> 2017-08-31 19:49:59.809127 7fa8c2ca0480 10 monclient(hunting): _renew_subs
-230> 2017-08-31 19:49:59.809490 7fa8bc7b3700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 learned_addr learned my addr [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067
-229> 2017-08-31 19:49:59.809599 7fa8bc7b3700 2 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 conn(0x561101833000 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=0)._process_connection got newly_acked_seq 0 vs out_seq 0
-228> 2017-08-31 19:49:59.809688 7fa8bbfb2700 2 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::21b:21ff:fe85:a42a]:6789/0 conn(0x561101834800 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=0)._process_connection got newly_acked_seq 0 vs out_seq 0
-227> 2017-08-31 19:49:59.810143 7fa8bc7b3700 5 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 conn(0x561101833000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=46652 cs=1 l=1). rx mon.2 seq 1 0x561101666b40 mon_map magic: 0 v1
-226> 2017-08-31 19:49:59.810240 7fa8bc7b3700 5 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 conn(0x561101833000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=46652 cs=1 l=1). rx mon.2 seq 2 0x5611015ff180 auth_reply(proto 2 0 (0) Success) v1
-225> 2017-08-31 19:49:59.810284 7fa8bbfb2700 5 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::21b:21ff:fe85:a42a]:6789/0 conn(0x561101834800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=189676 cs=1 l=1). rx mon.1 seq 1 0x561101667200 mon_map magic: 0 v1
-224> 2017-08-31 19:49:59.810267 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 <== mon.2 [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 1 ==== mon_map magic: 0 v1 ==== 487+0+0 (1053987658 0 0) 0x561101666b40 con 0x561101833000
-223> 2017-08-31 19:49:59.810329 7fa8b9fae700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1
-222> 2017-08-31 19:49:59.810328 7fa8bbfb2700 5 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::21b:21ff:fe85:a42a]:6789/0 conn(0x561101834800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=189676 cs=1 l=1). rx mon.1 seq 2 0x5611015fef00 auth_reply(proto 2 0 (0) Success) v1
-221> 2017-08-31 19:49:59.810384 7fa8b9fae700 10 monclient(hunting): got monmap 4, mon.noname-a is now rank -1
-220> 2017-08-31 19:49:59.810392 7fa8b9fae700 10 monclient(hunting): dump:
epoch 4
fsid 26c0c5a8-d7ce-49ac-b5a7-bfd9d0ba81ab
last_changed 2017-08-02 09:51:13.003912
created 2017-05-16 22:33:04.500528
0: [2a0a:e5c0::21b:21ff:fe85:a3a2]:6789/0 mon.server5
1: [2a0a:e5c0::21b:21ff:fe85:a42a]:6789/0 mon.server3
2: [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 mon.server1
-219> 2017-08-31 19:49:59.810442 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 <== mon.2 [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (456771106 0 0) 0x5611015ff180 con 0x561101833000
-218> 2017-08-31 19:49:59.810499 7fa8b9fae700 10 monclient(hunting): my global_id is 944123
-217> 2017-08-31 19:49:59.810650 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 --> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x5611015ff900 con 0
-216> 2017-08-31 19:49:59.810688 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 <== mon.1 [2a0a:e5c0::21b:21ff:fe85:a42a]:6789/0 1 ==== mon_map magic: 0 v1 ==== 487+0+0 (1053987658 0 0) 0x561101667200 con 0x561101834800
-215> 2017-08-31 19:49:59.810703 7fa8b9fae700 10 monclient(hunting): handle_monmap mon_map magic: 0 v1
-214> 2017-08-31 19:49:59.810727 7fa8b9fae700 10 monclient(hunting): got monmap 4, mon.server3 is now rank 1
-213> 2017-08-31 19:49:59.810733 7fa8b9fae700 10 monclient(hunting): dump:
epoch 4
fsid 26c0c5a8-d7ce-49ac-b5a7-bfd9d0ba81ab
last_changed 2017-08-02 09:51:13.003912
created 2017-05-16 22:33:04.500528
0: [2a0a:e5c0::21b:21ff:fe85:a3a2]:6789/0 mon.server5
1: [2a0a:e5c0::21b:21ff:fe85:a42a]:6789/0 mon.server3
2: [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 mon.server1
-212> 2017-08-31 19:49:59.810782 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 <== mon.1 [2a0a:e5c0::21b:21ff:fe85:a42a]:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (3259137127 0 0) 0x5611015fef00 con 0x561101834800
-211> 2017-08-31 19:49:59.810802 7fa8b9fae700 10 monclient(hunting): my global_id is 930217
-210> 2017-08-31 19:49:59.810847 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 --> [2a0a:e5c0::21b:21ff:fe85:a42a]:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x5611015ff180 con 0
-209> 2017-08-31 19:49:59.811387 7fa8bc7b3700 5 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 conn(0x561101833000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=46652 cs=1 l=1). rx mon.2 seq 3 0x5611015ff900 auth_reply(proto 2 0 (0) Success) v1
-208> 2017-08-31 19:49:59.811455 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 <== mon.2 [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (29180872 0 0) 0x5611015ff900 con 0x561101833000
-207> 2017-08-31 19:49:59.811554 7fa8bbfb2700 5 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::21b:21ff:fe85:a42a]:6789/0 conn(0x561101834800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=189676 cs=1 l=1). rx mon.1 seq 3 0x5611015ff180 auth_reply(proto 2 0 (0) Success) v1
-206> 2017-08-31 19:49:59.811650 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 --> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x5611015fef00 con 0
-205> 2017-08-31 19:49:59.811686 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 <== mon.1 [2a0a:e5c0::21b:21ff:fe85:a42a]:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (3853452336 0 0) 0x5611015ff180 con 0x561101834800
-204> 2017-08-31 19:49:59.811768 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 --> [2a0a:e5c0::21b:21ff:fe85:a42a]:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x5611015ff900 con 0
-203> 2017-08-31 19:49:59.812423 7fa8bc7b3700 5 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 conn(0x561101833000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=46652 cs=1 l=1). rx mon.2 seq 4 0x5611015fef00 auth_reply(proto 2 0 (0) Success) v1
-202> 2017-08-31 19:49:59.812491 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 <== mon.2 [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 751+0+0 (2435135688 0 0) 0x5611015fef00 con 0x561101833000
-201> 2017-08-31 19:49:59.812500 7fa8bbfb2700 5 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::21b:21ff:fe85:a42a]:6789/0 conn(0x561101834800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=189676 cs=1 l=1). rx mon.1 seq 4 0x5611015ff900 auth_reply(proto 2 0 (0) Success) v1
-200> 2017-08-31 19:49:59.812710 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::21b:21ff:fe85:a42a]:6789/0 conn(0x561101834800 :-1 s=STATE_OPEN pgs=189676 cs=1 l=1).mark_down
-199> 2017-08-31 19:49:59.812728 7fa8b9fae700 2 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::21b:21ff:fe85:a42a]:6789/0 conn(0x561101834800 :-1 s=STATE_OPEN pgs=189676 cs=1 l=1)._stop
-198> 2017-08-31 19:49:59.812789 7fa8b9fae700 1 monclient: found mon.server1
-197> 2017-08-31 19:49:59.812819 7fa8b9fae700 10 monclient: _send_mon_message to mon.server1 at [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0
-196> 2017-08-31 19:49:59.812829 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 --> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 -- mon_subscribe({mgrmap=0+,monmap=0+}) v2 -- 0x561101666480 con 0
-195> 2017-08-31 19:49:59.812863 7fa8b9fae700 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2017-08-31 19:49:29.812861)
-194> 2017-08-31 19:49:59.812877 7fa8b9fae700 10 monclient: _send_mon_message to mon.server1 at [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0
-193> 2017-08-31 19:49:59.812890 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 --> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 -- auth(proto 2 2 bytes epoch 0) v1 -- 0x5611015ff900 con 0
-192> 2017-08-31 19:49:59.812941 7fa8c2ca0480 5 monclient: authenticate success, global_id 944123
-191> 2017-08-31 19:49:59.813001 7fa8c2ca0480 10 log_channel(cluster) update_config to_monitors: true to_syslog: false syslog_facility: daemon prio: info to_graylog: false graylog_host: 127.0.0.1 graylog_port: 12201)
-190> 2017-08-31 19:49:59.813015 7fa8c2ca0480 10 log_channel(audit) update_config to_monitors: true to_syslog: false syslog_facility: local0 prio: info to_graylog: false graylog_host: 127.0.0.1 graylog_port: 12201)
-189> 2017-08-31 19:49:59.813152 7fa8c2ca0480 5 asok(0x5611015e21c0) register_command objecter_requests hook 0x5611015a2210
-188> 2017-08-31 19:49:59.813187 7fa8c2ca0480 10 monclient: _renew_subs
-187> 2017-08-31 19:49:59.813196 7fa8c2ca0480 10 monclient: _send_mon_message to mon.server1 at [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0
-186> 2017-08-31 19:49:59.813205 7fa8bc7b3700 5 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 conn(0x561101833000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=46652 cs=1 l=1). rx mon.2 seq 5 0x56110178e840 mgrmap(e 508038) v1
-185> 2017-08-31 19:49:59.813208 7fa8c2ca0480 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 --> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 -- mon_subscribe({osdmap=0}) v2 -- 0x561101667680 con 0
-184> 2017-08-31 19:49:59.813263 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 <== mon.2 [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 5 ==== mgrmap(e 508038) v1 ==== 141+0+0 (364485480 0 0) 0x56110178e840 con 0x561101833000
-183> 2017-08-31 19:49:59.813271 7fa8bc7b3700 5 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 conn(0x561101833000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=46652 cs=1 l=1). rx mon.2 seq 6 0x561101666d80 mon_map magic: 0 v1
-182> 2017-08-31 19:49:59.813343 7fa8bc7b3700 5 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 conn(0x561101833000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=46652 cs=1 l=1). rx mon.2 seq 7 0x5611015ff900 auth_reply(proto 2 0 (0) Success) v1
-181> 2017-08-31 19:49:59.813396 7fa8c2ca0480 5 asok(0x5611015e21c0) register_command mds_requests hook 0x7ffcaeb4b4b0
-180> 2017-08-31 19:49:59.813407 7fa8c2ca0480 5 asok(0x5611015e21c0) register_command mds_sessions hook 0x7ffcaeb4b4b0
-179> 2017-08-31 19:49:59.813415 7fa8c2ca0480 5 asok(0x5611015e21c0) register_command dump_cache hook 0x7ffcaeb4b4b0
-178> 2017-08-31 19:49:59.813425 7fa8c2ca0480 5 asok(0x5611015e21c0) register_command kick_stale_sessions hook 0x7ffcaeb4b4b0
-177> 2017-08-31 19:49:59.813433 7fa8c2ca0480 5 asok(0x5611015e21c0) register_command status hook 0x7ffcaeb4b4b0
-176> 2017-08-31 19:49:59.813487 7fa8c2ca0480 1 mgr send_beacon standby
-175> 2017-08-31 19:49:59.813559 7fa8bc7b3700 5 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 conn(0x561101833000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=46652 cs=1 l=1). rx mon.2 seq 8 0x5611015ffb80 osd_map(4464..4464 src has 3914..4464) v3
-174> 2017-08-31 19:49:59.814996 7fa8c2ca0480 10 monclient: _send_mon_message to mon.server1 at [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0
-173> 2017-08-31 19:49:59.815012 7fa8c2ca0480 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 --> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 -- mgrbeacon mgr.0(26c0c5a8-d7ce-49ac-b5a7-bfd9d0ba81ab,944123, -, 0) v5 -- 0x56110178eb00 con 0
-172> 2017-08-31 19:49:59.815044 7fa8c2ca0480 4 mgr init Complete.
-171> 2017-08-31 19:49:59.815067 7fa8b9fae700 4 mgr ms_dispatch standby mgrmap(e 508038) v1
-170> 2017-08-31 19:49:59.815087 7fa8b9fae700 4 mgr handle_mgr_map received map epoch 508038
-169> 2017-08-31 19:49:59.815094 7fa8b9fae700 4 mgr handle_mgr_map active in map: 0 active is 930214
-168> 2017-08-31 19:49:59.815133 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 <== mon.2 [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 6 ==== mon_map magic: 0 v1 ==== 487+0+0 (1053987658 0 0) 0x561101666d80 con 0x561101833000
-167> 2017-08-31 19:49:59.815151 7fa8b9fae700 10 monclient: handle_monmap mon_map magic: 0 v1
-166> 2017-08-31 19:49:59.815180 7fa8b9fae700 10 monclient: got monmap 4, mon.server1 is now rank 2
-165> 2017-08-31 19:49:59.815187 7fa8b9fae700 10 monclient: dump:
epoch 4
fsid 26c0c5a8-d7ce-49ac-b5a7-bfd9d0ba81ab
last_changed 2017-08-02 09:51:13.003912
created 2017-05-16 22:33:04.500528
0: [2a0a:e5c0::21b:21ff:fe85:a3a2]:6789/0 mon.server5
1: [2a0a:e5c0::21b:21ff:fe85:a42a]:6789/0 mon.server3
2: [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 mon.server1
-164> 2017-08-31 19:49:59.815224 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 <== mon.2 [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 7 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (3413411855 0 0) 0x5611015ff900 con 0x561101833000
-163> 2017-08-31 19:49:59.815350 7fa8b9fae700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2017-08-31 19:49:29.815350)
-162> 2017-08-31 19:49:59.815367 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 <== mon.2 [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 8 ==== osd_map(4464..4464 src has 3914..4464) v3 ==== 19280+0+0 (1035726252 0 0) 0x5611015ffb80 con 0x561101833000
-161> 2017-08-31 19:49:59.815787 7fa8b9fae700 4 mgr ms_dispatch standby osd_map(4464..4464 src has 3914..4464) v3
-160> 2017-08-31 19:50:00.046543 7fa8bc7b3700 5 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 conn(0x561101833000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=46652 cs=1 l=1). rx mon.2 seq 9 0x56110178eb00 mgrmap(e 508039) v1
-159> 2017-08-31 19:50:00.046633 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 <== mon.2 [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 9 ==== mgrmap(e 508039) v1 ==== 141+0+0 (329521616 0 0) 0x56110178eb00 con 0x561101833000
-158> 2017-08-31 19:50:00.046658 7fa8b9fae700 4 mgr ms_dispatch standby mgrmap(e 508039) v1
-157> 2017-08-31 19:50:00.046674 7fa8b9fae700 4 mgr handle_mgr_map received map epoch 508039
-156> 2017-08-31 19:50:00.046681 7fa8b9fae700 4 mgr handle_mgr_map active in map: 1 active is 944123
-155> 2017-08-31 19:50:00.046694 7fa8b9fae700 1 mgr handle_mgr_map Activating!
-154> 2017-08-31 19:50:00.046951 7fa8b9fae700 5 adding auth protocol: cephx
-153> 2017-08-31 19:50:00.047046 7fa8b9fae700 1 mgr handle_mgr_map I am now activating
-152> 2017-08-31 19:50:00.049069 7fa8b5fa6700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/0 learned_addr learned my addr [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/0
-151> 2017-08-31 19:50:00.049090 7fa8b5fa6700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:6848/64162 _finish_bind bind my_inst.addr is [2a0a:e5c0::92e2:baff:fe8a:2e78]:6848/64162
-150> 2017-08-31 19:50:00.049100 7fa8b5fa6700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:6848/64162 start start
-149> 2017-08-31 19:50:00.049106 7fa8b5fa6700 1 Processor -- start
-148> 2017-08-31 19:50:00.049299 7fa8b5fa6700 4 mgr init Initialized server at [2a0a:e5c0::92e2:baff:fe8a:2e78]:6848/64162
-147> 2017-08-31 19:50:00.049309 7fa8b5fa6700 4 mgr init Loading daemon metadata...
-146> 2017-08-31 19:50:00.049322 7fa8b5fa6700 10 monclient: _send_command 1 [{"prefix": "mds metadata"}]
-145> 2017-08-31 19:50:00.049334 7fa8b5fa6700 10 monclient: _send_mon_message to mon.server1 at [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0
-144> 2017-08-31 19:50:00.049349 7fa8b5fa6700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 --> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 -- mon_command({"prefix": "mds metadata"} v 0) v1 -- 0x561101667d40 con 0
-143> 2017-08-31 19:50:00.049382 7fa8b5fa6700 10 monclient: _send_command 2 [{"prefix": "osd metadata"}]
-142> 2017-08-31 19:50:00.049389 7fa8b5fa6700 10 monclient: _send_mon_message to mon.server1 at [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0
-141> 2017-08-31 19:50:00.049397 7fa8b5fa6700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 --> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 -- mon_command({"prefix": "osd metadata"} v 0) v1 -- 0x561101667f80 con 0
-140> 2017-08-31 19:50:00.049430 7fa8b5fa6700 10 monclient: _send_command 3 [{"prefix": "mon metadata"}]
-139> 2017-08-31 19:50:00.049437 7fa8b5fa6700 10 monclient: _send_mon_message to mon.server1 at [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0
-138> 2017-08-31 19:50:00.049443 7fa8b5fa6700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 --> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 -- mon_command({"prefix": "mon metadata"} v 0) v1 -- 0x5611016681c0 con 0
-137> 2017-08-31 19:50:00.050077 7fa8bc7b3700 5 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 conn(0x561101833000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=46652 cs=1 l=1). rx mon.2 seq 10 0x561101667680 mon_command_ack([{"prefix": "mds metadata"}]=0 v1) v1
-136> 2017-08-31 19:50:00.050139 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 <== mon.2 [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 10 ==== mon_command_ack([{"prefix": "mds metadata"}]=0 v1) v1 ==== 60+0+3 (3901577703 0 246687307) 0x561101667680 con 0x561101833000
-135> 2017-08-31 19:50:00.050170 7fa8b9fae700 10 monclient: handle_mon_command_ack 1 [{"prefix": "mds metadata"}]
-134> 2017-08-31 19:50:00.050179 7fa8b9fae700 10 monclient: _finish_command 1 = 0
-133> 2017-08-31 19:50:00.054272 7fa8bc7b3700 5 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 conn(0x561101833000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=46652 cs=1 l=1). rx mon.2 seq 11 0x561101667d40 mon_command_ack([{"prefix": "osd metadata"}]=0 v4464) v1
-132> 2017-08-31 19:50:00.054341 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 <== mon.2 [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 11 ==== mon_command_ack([{"prefix": "osd metadata"}]=0 v4464) v1 ==== 60+0+69777 (2656155368 0 3988500870) 0x561101667d40 con 0x561101833000
-131> 2017-08-31 19:50:00.054369 7fa8b9fae700 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd metadata"}]
-130> 2017-08-31 19:50:00.054368 7fa8bc7b3700 5 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 conn(0x561101833000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=46652 cs=1 l=1). rx mon.2 seq 12 0x561101667f80 mon_command_ack([{"prefix": "mon metadata"}]=0 v0) v1
-129> 2017-08-31 19:50:00.054388 7fa8b9fae700 10 monclient: _finish_command 2 = 0
-128> 2017-08-31 19:50:00.054436 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 <== mon.2 [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 12 ==== mon_command_ack([{"prefix": "mon metadata"}]=0 v0) v1 ==== 60+0+1912 (750816088 0 3132647005) 0x561101667f80 con 0x561101833000
-127> 2017-08-31 19:50:00.054452 7fa8b9fae700 10 monclient: handle_mon_command_ack 3 [{"prefix": "mon metadata"}]
-126> 2017-08-31 19:50:00.054459 7fa8b9fae700 10 monclient: _finish_command 3 = 0
-125> 2017-08-31 19:50:00.059476 7fa8b5fa6700 4 mgr load_all_metadata server2
-124> 2017-08-31 19:50:00.059532 7fa8b5fa6700 4 mgr load_all_metadata server3
-123> 2017-08-31 19:50:00.059582 7fa8b5fa6700 4 mgr load_all_metadata server5
-122> 2017-08-31 19:50:00.059614 7fa8b5fa6700 4 mgr load_all_metadata server4
-121> 2017-08-31 19:50:00.059644 7fa8b5fa6700 4 mgr load_all_metadata server2
-120> 2017-08-31 19:50:00.059675 7fa8b5fa6700 4 mgr load_all_metadata server5
-119> 2017-08-31 19:50:00.059704 7fa8b5fa6700 4 mgr load_all_metadata server2
-118> 2017-08-31 19:50:00.059734 7fa8b5fa6700 4 mgr load_all_metadata server3
-117> 2017-08-31 19:50:00.059764 7fa8b5fa6700 4 mgr load_all_metadata server4
-116> 2017-08-31 19:50:00.059793 7fa8b5fa6700 4 mgr load_all_metadata server5
-115> 2017-08-31 19:50:00.059835 7fa8b5fa6700 4 mgr load_all_metadata server2
-114> 2017-08-31 19:50:00.059873 7fa8b5fa6700 4 mgr load_all_metadata server4
-113> 2017-08-31 19:50:00.059907 7fa8b5fa6700 4 mgr load_all_metadata server3
-112> 2017-08-31 19:50:00.059938 7fa8b5fa6700 4 mgr load_all_metadata server2
-111> 2017-08-31 19:50:00.059968 7fa8b5fa6700 4 mgr load_all_metadata server5
-110> 2017-08-31 19:50:00.059999 7fa8b5fa6700 4 mgr load_all_metadata server3
-109> 2017-08-31 19:50:00.060030 7fa8b5fa6700 4 mgr load_all_metadata server4
-108> 2017-08-31 19:50:00.060079 7fa8b5fa6700 4 mgr load_all_metadata server2
-107> 2017-08-31 19:50:00.060109 7fa8b5fa6700 4 mgr load_all_metadata server5
-106> 2017-08-31 19:50:00.060139 7fa8b5fa6700 4 mgr load_all_metadata server4
-105> 2017-08-31 19:50:00.060169 7fa8b5fa6700 4 mgr load_all_metadata server3
-104> 2017-08-31 19:50:00.060200 7fa8b5fa6700 4 mgr load_all_metadata server2
-103> 2017-08-31 19:50:00.060230 7fa8b5fa6700 4 mgr load_all_metadata server5
-102> 2017-08-31 19:50:00.060261 7fa8b5fa6700 4 mgr load_all_metadata server3
-101> 2017-08-31 19:50:00.060291 7fa8b5fa6700 4 mgr load_all_metadata server4
-100> 2017-08-31 19:50:00.060321 7fa8b5fa6700 4 mgr load_all_metadata server2
-99> 2017-08-31 19:50:00.060359 7fa8b5fa6700 4 mgr load_all_metadata server5
-98> 2017-08-31 19:50:00.060390 7fa8b5fa6700 4 mgr load_all_metadata server3
-97> 2017-08-31 19:50:00.060420 7fa8b5fa6700 4 mgr load_all_metadata server4
-96> 2017-08-31 19:50:00.060451 7fa8b5fa6700 4 mgr load_all_metadata server3
-95> 2017-08-31 19:50:00.060485 7fa8b5fa6700 4 mgr load_all_metadata server5
-94> 2017-08-31 19:50:00.060517 7fa8b5fa6700 4 mgr load_all_metadata server2
-93> 2017-08-31 19:50:00.060566 7fa8b5fa6700 4 mgr load_all_metadata server4
-92> 2017-08-31 19:50:00.060597 7fa8b5fa6700 4 mgr load_all_metadata server3
-91> 2017-08-31 19:50:00.060627 7fa8b5fa6700 4 mgr load_all_metadata server2
-90> 2017-08-31 19:50:00.060659 7fa8b5fa6700 4 mgr load_all_metadata server3
-89> 2017-08-31 19:50:00.060689 7fa8b5fa6700 4 mgr load_all_metadata server5
-88> 2017-08-31 19:50:00.060734 7fa8b5fa6700 4 mgr load_all_metadata server4
-87> 2017-08-31 19:50:00.060765 7fa8b5fa6700 4 mgr load_all_metadata server2
-86> 2017-08-31 19:50:00.060796 7fa8b5fa6700 4 mgr load_all_metadata server3
-85> 2017-08-31 19:50:00.060835 7fa8b5fa6700 4 mgr load_all_metadata server5
-84> 2017-08-31 19:50:00.060875 7fa8b5fa6700 4 mgr load_all_metadata server4
-83> 2017-08-31 19:50:00.060916 7fa8b5fa6700 4 mgr load_all_metadata server3
-82> 2017-08-31 19:50:00.060955 7fa8b5fa6700 4 mgr load_all_metadata server4
-81> 2017-08-31 19:50:00.060995 7fa8b5fa6700 4 mgr load_all_metadata server2
-80> 2017-08-31 19:50:00.061026 7fa8b5fa6700 4 mgr load_all_metadata server5
-79> 2017-08-31 19:50:00.061055 7fa8b5fa6700 4 mgr load_all_metadata server4
-78> 2017-08-31 19:50:00.061100 7fa8b5fa6700 4 mgr load_all_metadata server5
-77> 2017-08-31 19:50:00.061131 7fa8b5fa6700 4 mgr load_all_metadata server1
-76> 2017-08-31 19:50:00.061161 7fa8b5fa6700 4 mgr load_all_metadata server1
-75> 2017-08-31 19:50:00.061192 7fa8b5fa6700 4 mgr load_all_metadata server1
-74> 2017-08-31 19:50:00.061222 7fa8b5fa6700 4 mgr load_all_metadata server1
-73> 2017-08-31 19:50:00.061253 7fa8b5fa6700 4 mgr load_all_metadata server1
-72> 2017-08-31 19:50:00.061283 7fa8b5fa6700 4 mgr load_all_metadata server1
-71> 2017-08-31 19:50:00.061313 7fa8b5fa6700 4 mgr load_all_metadata server1
-70> 2017-08-31 19:50:00.061344 7fa8b5fa6700 4 mgr load_all_metadata server1
-69> 2017-08-31 19:50:00.061374 7fa8b5fa6700 4 mgr load_all_metadata server1
-68> 2017-08-31 19:50:00.061404 7fa8b5fa6700 4 mgr load_all_metadata server1
-67> 2017-08-31 19:50:00.061438 7fa8b5fa6700 4 mgr load_all_metadata server1
-66> 2017-08-31 19:50:00.061467 7fa8b5fa6700 4 mgr load_all_metadata server1
-65> 2017-08-31 19:50:00.061980 7fa8b5fa6700 4 mgr init waiting for OSDMap...
-64> 2017-08-31 19:50:00.061994 7fa8b5fa6700 10 monclient: _renew_subs
-63> 2017-08-31 19:50:00.062000 7fa8b5fa6700 10 monclient: _send_mon_message to mon.server1 at [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0
-62> 2017-08-31 19:50:00.062011 7fa8b5fa6700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 --> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 -- mon_subscribe({fsmap=0+,log-info=0+,mgrdigest=0+,osdmap=4465,servicemap=0+}) v2 -- 0x561101666480 con 0
-61> 2017-08-31 19:50:00.062045 7fa8b5fa6700 10 monclient: _reopen_session rank -1
-60> 2017-08-31 19:50:00.062053 7fa8b5fa6700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 conn(0x561101833000 :-1 s=STATE_OPEN pgs=46652 cs=1 l=1).mark_down
-59> 2017-08-31 19:50:00.062067 7fa8b5fa6700 2 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 conn(0x561101833000 :-1 s=STATE_OPEN pgs=46652 cs=1 l=1)._stop
-58> 2017-08-31 19:50:00.062167 7fa8b5fa6700 10 monclient(hunting): picked mon.server1 con 0x56110187b800 addr [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0
-57> 2017-08-31 19:50:00.062199 7fa8b5fa6700 10 monclient(hunting): picked mon.server5 con 0x56110187d000 addr [2a0a:e5c0::21b:21ff:fe85:a3a2]:6789/0
-56> 2017-08-31 19:50:00.062228 7fa8b5fa6700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 --> [2a0a:e5c0::21b:21ff:fe85:a3a2]:6789/0 -- auth(proto 0 26 bytes epoch 4) v1 -- 0x5611015ffe00 con 0
-55> 2017-08-31 19:50:00.062266 7fa8b5fa6700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 --> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 -- auth(proto 0 26 bytes epoch 4) v1 -- 0x561101600080 con 0
-54> 2017-08-31 19:50:00.062293 7fa8b5fa6700 10 monclient(hunting): _renew_subs
-53> 2017-08-31 19:50:00.062791 7fa8bc7b3700 2 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 conn(0x56110187b800 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=0)._process_connection got newly_acked_seq 0 vs out_seq 0
-52> 2017-08-31 19:50:00.062792 7fa8bcfb4700 2 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::21b:21ff:fe85:a3a2]:6789/0 conn(0x56110187d000 :-1 s=STATE_CONNECTING_WAIT_ACK_SEQ pgs=0 cs=0 l=0)._process_connection got newly_acked_seq 0 vs out_seq 0
-51> 2017-08-31 19:50:00.063209 7fa8bc7b3700 5 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 conn(0x56110187b800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=46653 cs=1 l=1). rx mon.2 seq 1 0x561101600080 auth_reply(proto 2 0 (0) Success) v1
-50> 2017-08-31 19:50:00.063236 7fa8bcfb4700 5 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::21b:21ff:fe85:a3a2]:6789/0 conn(0x56110187d000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=184442 cs=1 l=1). rx mon.0 seq 1 0x5611015ffe00 auth_reply(proto 2 0 (0) Success) v1
-49> 2017-08-31 19:50:00.065345 7fa8b5fa6700 4 mgr init waiting for FSMap...
-48> 2017-08-31 19:50:00.065389 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 <== mon.2 [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (2746328977 0 0) 0x561101600080 con 0x56110187b800
-47> 2017-08-31 19:50:00.065505 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 --> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x5611015ffb80 con 0
-46> 2017-08-31 19:50:00.065542 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 <== mon.0 [2a0a:e5c0::21b:21ff:fe85:a3a2]:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (311274268 0 0) 0x5611015ffe00 con 0x56110187d000
-45> 2017-08-31 19:50:00.065593 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 --> [2a0a:e5c0::21b:21ff:fe85:a3a2]:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- 0x561101600080 con 0
-44> 2017-08-31 19:50:00.066256 7fa8bc7b3700 5 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 conn(0x56110187b800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=46653 cs=1 l=1). rx mon.2 seq 2 0x5611015ffb80 auth_reply(proto 2 0 (0) Success) v1
-43> 2017-08-31 19:50:00.066268 7fa8bcfb4700 5 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::21b:21ff:fe85:a3a2]:6789/0 conn(0x56110187d000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=184442 cs=1 l=1). rx mon.0 seq 2 0x561101600080 auth_reply(proto 2 0 (0) Success) v1
-42> 2017-08-31 19:50:00.066344 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 <== mon.2 [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (1954549610 0 0) 0x5611015ffb80 con 0x56110187b800
-41> 2017-08-31 19:50:00.066466 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 --> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x5611015ffe00 con 0
-40> 2017-08-31 19:50:00.066495 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 <== mon.0 [2a0a:e5c0::21b:21ff:fe85:a3a2]:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (2414500090 0 0) 0x561101600080 con 0x56110187d000
-39> 2017-08-31 19:50:00.066573 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 --> [2a0a:e5c0::21b:21ff:fe85:a3a2]:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x5611015ffb80 con 0
-38> 2017-08-31 19:50:00.067159 7fa8bc7b3700 5 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 conn(0x56110187b800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=46653 cs=1 l=1). rx mon.2 seq 3 0x5611015ffe00 auth_reply(proto 2 0 (0) Success) v1
-37> 2017-08-31 19:50:00.067214 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 <== mon.2 [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 751+0+0 (1854809051 0 0) 0x5611015ffe00 con 0x56110187b800
-36> 2017-08-31 19:50:00.067363 7fa8bcfb4700 5 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::21b:21ff:fe85:a3a2]:6789/0 conn(0x56110187d000 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=184442 cs=1 l=1). rx mon.0 seq 3 0x5611015ffb80 auth_reply(proto 2 0 (0) Success) v1
-35> 2017-08-31 19:50:00.067449 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::21b:21ff:fe85:a3a2]:6789/0 conn(0x56110187d000 :-1 s=STATE_OPEN pgs=184442 cs=1 l=1).mark_down
-34> 2017-08-31 19:50:00.067463 7fa8b9fae700 2 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::21b:21ff:fe85:a3a2]:6789/0 conn(0x56110187d000 :-1 s=STATE_OPEN pgs=184442 cs=1 l=1)._stop
-33> 2017-08-31 19:50:00.067506 7fa8b9fae700 1 monclient: found mon.server1
-32> 2017-08-31 19:50:00.067526 7fa8b9fae700 10 monclient: _send_mon_message to mon.server1 at [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0
-31> 2017-08-31 19:50:00.067536 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 --> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 -- mon_subscribe({fsmap=0+,log-info=0+,mgrdigest=0+,mgrmap=0+,monmap=5+,osdmap=4465,servicemap=0+}) v2 -- 0x561101666b40 con 0
-30> 2017-08-31 19:50:00.067567 7fa8b9fae700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2017-08-31 19:49:30.067565)
-29> 2017-08-31 19:50:00.067943 7fa8bc7b3700 5 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 conn(0x56110187b800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=46653 cs=1 l=1). rx mon.2 seq 4 0x561101797a40 fsmap(e 1) v1
-28> 2017-08-31 19:50:00.067982 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 <== mon.2 [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 4 ==== fsmap(e 1) v1 ==== 319+0+0 (74130721 0 0) 0x561101797a40 con 0x56110187b800
-27> 2017-08-31 19:50:00.067997 7fa8b9fae700 4 mgr ms_dispatch active fsmap(e 1) v1
-26> 2017-08-31 19:50:00.068007 7fa8b9fae700 4 mgr ms_dispatch fsmap(e 1) v1
-25> 2017-08-31 19:50:00.068000 7fa8bc7b3700 5 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 conn(0x56110187b800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=46653 cs=1 l=1). rx mon.2 seq 5 0x561101842000 log(1 entries from seq 3104386 at 2017-08-31 19:49:59.815850) v1
-24> 2017-08-31 19:50:00.068071 7fa8b5fa6700 4 mgr init waiting for config-keys...
-23> 2017-08-31 19:50:00.068095 7fa8b5fa6700 10 monclient: _send_command 4 [{"prefix": "config-key ls"}]
-22> 2017-08-31 19:50:00.068091 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 <== mon.2 [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 5 ==== log(1 entries from seq 3104386 at 2017-08-31 19:49:59.815850) v1 ==== 175+0+0 (3456429656 0 0) 0x561101842000 con 0x56110187b800
-21> 2017-08-31 19:50:00.068104 7fa8b9fae700 4 mgr ms_dispatch active log(1 entries from seq 3104386 at 2017-08-31 19:49:59.815850) v1
-20> 2017-08-31 19:50:00.068106 7fa8b5fa6700 10 monclient: _send_mon_message to mon.server1 at [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0
-19> 2017-08-31 19:50:00.068113 7fa8b9fae700 4 mgr ms_dispatch log(1 entries from seq 3104386 at 2017-08-31 19:49:59.815850) v1
-18> 2017-08-31 19:50:00.068115 7fa8b5fa6700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 --> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 -- mon_command({"prefix": "config-key ls"} v 0) v1 -- 0x561101666fc0 con 0
-17> 2017-08-31 19:50:00.068365 7fa8bc7b3700 5 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 conn(0x56110187b800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=46653 cs=1 l=1). rx mon.2 seq 6 0x5611018d7c80 mgrdigest v1
-16> 2017-08-31 19:50:00.068399 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 <== mon.2 [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 6 ==== mgrdigest v1 ==== 11456+0+0 (1741311813 0 0) 0x5611018d7c80 con 0x56110187b800
-15> 2017-08-31 19:50:00.068404 7fa8bc7b3700 5 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 conn(0x56110187b800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=46653 cs=1 l=1). rx mon.2 seq 7 0x5611018d79c0 mgrmap(e 508039) v1
-14> 2017-08-31 19:50:00.068413 7fa8b9fae700 4 mgr ms_dispatch active mgrdigest v1
-13> 2017-08-31 19:50:00.068432 7fa8b9fae700 4 mgr ms_dispatch mgrdigest v1
-12> 2017-08-31 19:50:00.068432 7fa8bc7b3700 5 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 conn(0x56110187b800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=46653 cs=1 l=1). rx mon.2 seq 8 0x561101666fc0 service_map(e0 0 svc) v1
-11> 2017-08-31 19:50:00.068459 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 <== mon.2 [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 7 ==== mgrmap(e 508039) v1 ==== 141+0+0 (329521616 0 0) 0x5611018d79c0 con 0x56110187b800
-10> 2017-08-31 19:50:00.068471 7fa8b9fae700 4 mgr ms_dispatch active mgrmap(e 508039) v1
-9> 2017-08-31 19:50:00.068476 7fa8b9fae700 4 mgr handle_mgr_map received map epoch 508039
-8> 2017-08-31 19:50:00.068481 7fa8b9fae700 4 mgr handle_mgr_map active in map: 1 active is 944123
-7> 2017-08-31 19:50:00.068483 7fa8bc7b3700 5 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 >> [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 conn(0x56110187b800 :-1 s=STATE_OPEN_MESSAGE_READ_FOOTER_AND_DISPATCH pgs=46653 cs=1 l=1). rx mon.2 seq 9 0x561101666b40 mon_command_ack([{"prefix": "config-key ls"}]=-22 command not known v0) v1
-6> 2017-08-31 19:50:00.068505 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 <== mon.2 [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 8 ==== service_map(e0 0 svc) v1 ==== 22+0+0 (722760602 0 0) 0x561101666fc0 con 0x56110187b800
-5> 2017-08-31 19:50:00.068518 7fa8b9fae700 4 mgr ms_dispatch active service_map(e0 0 svc) v1
-4> 2017-08-31 19:50:00.068526 7fa8b9fae700 4 mgr ms_dispatch service_map(e0 0 svc) v1
-3> 2017-08-31 19:50:00.068540 7fa8b9fae700 1 -- [2a0a:e5c0::92e2:baff:fe8a:2e78]:0/1812917067 <== mon.2 [2a0a:e5c0::92e2:baff:fe8a:2e78]:6789/0 9 ==== mon_command_ack([{"prefix": "config-key ls"}]=-22 command not known v0) v1 ==== 78+0+0 (2759445592 0 0) 0x561101666b40 con 0x56110187b800
-2> 2017-08-31 19:50:00.068555 7fa8b9fae700 10 monclient: handle_mon_command_ack 4 [{"prefix": "config-key ls"}]
-1> 2017-08-31 19:50:00.068563 7fa8b9fae700 10 monclient: _finish_command 4 = -22 command not known
0> 2017-08-31 19:50:00.070448 7fa8b5fa6700 -1 /build/ceph-12.2.0/src/mgr/Mgr.cc: In function 'void Mgr::load_config()' thread 7fa8b5fa6700 time 2017-08-31 19:50:00.068610
/build/ceph-12.2.0/src/mgr/Mgr.cc: 340: FAILED assert(cmd.r == 0)
ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc)
1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x102) [0x5610f70dfc02]
2: (Mgr::load_config()+0x854) [0x5610f6fb1484]
3: (Mgr::init()+0x6b2) [0x5610f6fb31e2]
4: (()+0x2e49bc) [0x5610f6fb39bc]
5: (FunctionContext::finish(int)+0x2c) [0x5610f6f7a27c]
6: (Context::complete(int)+0x9) [0x5610f6f756c9]
7: (Finisher::finisher_thread_entry()+0x198) [0x5610f70debc8]
8: (()+0x8064) [0x7fa8c078c064]
9: (clone()+0x6d) [0x7fa8bf87762d]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
--- logging levels ---
0/ 5 none
0/ 1 lockdep
0/ 1 context
1/ 1 crush
1/ 5 mds
1/ 5 mds_balancer
1/ 5 mds_locker
1/ 5 mds_log
1/ 5 mds_log_expire
1/ 5 mds_migrator
0/ 1 buffer
0/ 1 timer
0/ 1 filer
0/ 1 striper
0/ 1 objecter
0/ 5 rados
0/ 5 rbd
0/ 5 rbd_mirror
0/ 5 rbd_replay
0/ 5 journaler
0/ 5 objectcacher
0/ 5 client
1/ 5 osd
0/ 5 optracker
0/ 5 objclass
1/ 3 filestore
1/ 3 journal
0/ 5 ms
1/ 5 mon
0/10 monc
1/ 5 paxos
0/ 5 tp
1/ 5 auth
1/ 5 crypto
1/ 1 finisher
1/ 5 heartbeatmap
1/ 5 perfcounter
1/ 5 rgw
1/10 civetweb
1/ 5 javaclient
1/ 5 asok
1/ 1 throttle
0/ 0 refs
1/ 5 xio
1/ 5 compressor
1/ 5 bluestore
1/ 5 bluefs
1/ 3 bdev
1/ 5 kstore
4/ 5 rocksdb
4/ 5 leveldb
4/ 5 memdb
1/ 5 kinetic
1/ 5 fuse
1/ 5 mgr
1/ 5 mgrc
1/ 5 dpdk
1/ 5 eventtrace
-2/-2 (syslog threshold)
99/99 (stderr threshold)
max_recent 10000
max_new 1000
log_file
--- end dump of recent events ---
*** Caught signal (Aborted) **
in thread 7fa8b5fa6700 thread_name:mgr-fin
ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc)
1: (()+0x3cf9bc) [0x5610f709e9bc]
2: (()+0xf890) [0x7fa8c0793890]
3: (gsignal()+0x37) [0x7fa8bf7c4067]
4: (abort()+0x148) [0x7fa8bf7c5448]
5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x27f) [0x5610f70dfd7f]
6: (Mgr::load_config()+0x854) [0x5610f6fb1484]
7: (Mgr::init()+0x6b2) [0x5610f6fb31e2]
8: (()+0x2e49bc) [0x5610f6fb39bc]
9: (FunctionContext::finish(int)+0x2c) [0x5610f6f7a27c]
10: (Context::complete(int)+0x9) [0x5610f6f756c9]
11: (Finisher::finisher_thread_entry()+0x198) [0x5610f70debc8]
12: (()+0x8064) [0x7fa8c078c064]
13: (clone()+0x6d) [0x7fa8bf87762d]
2017-08-31 19:50:00.074826 7fa8b5fa6700 -1 *** Caught signal (Aborted) **
in thread 7fa8b5fa6700 thread_name:mgr-fin
ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc)
1: (()+0x3cf9bc) [0x5610f709e9bc]
2: (()+0xf890) [0x7fa8c0793890]
3: (gsignal()+0x37) [0x7fa8bf7c4067]
4: (abort()+0x148) [0x7fa8bf7c5448]
5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x27f) [0x5610f70dfd7f]
6: (Mgr::load_config()+0x854) [0x5610f6fb1484]
7: (Mgr::init()+0x6b2) [0x5610f6fb31e2]
8: (()+0x2e49bc) [0x5610f6fb39bc]
9: (FunctionContext::finish(int)+0x2c) [0x5610f6f7a27c]
10: (Context::complete(int)+0x9) [0x5610f6f756c9]
11: (Finisher::finisher_thread_entry()+0x198) [0x5610f70debc8]
12: (()+0x8064) [0x7fa8c078c064]
13: (clone()+0x6d) [0x7fa8bf87762d]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
--- begin dump of recent events ---
0> 2017-08-31 19:50:00.074826 7fa8b5fa6700 -1 *** Caught signal (Aborted) **
in thread 7fa8b5fa6700 thread_name:mgr-fin
ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc)
1: (()+0x3cf9bc) [0x5610f709e9bc]
2: (()+0xf890) [0x7fa8c0793890]
3: (gsignal()+0x37) [0x7fa8bf7c4067]
4: (abort()+0x148) [0x7fa8bf7c5448]
5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x27f) [0x5610f70dfd7f]
6: (Mgr::load_config()+0x854) [0x5610f6fb1484]
7: (Mgr::init()+0x6b2) [0x5610f6fb31e2]
8: (()+0x2e49bc) [0x5610f6fb39bc]
9: (FunctionContext::finish(int)+0x2c) [0x5610f6f7a27c]
10: (Context::complete(int)+0x9) [0x5610f6f756c9]
11: (Finisher::finisher_thread_entry()+0x198) [0x5610f70debc8]
12: (()+0x8064) [0x7fa8c078c064]
13: (clone()+0x6d) [0x7fa8bf87762d]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
--- logging levels ---
0/ 5 none
0/ 1 lockdep
0/ 1 context
1/ 1 crush
1/ 5 mds
1/ 5 mds_balancer
1/ 5 mds_locker
1/ 5 mds_log
1/ 5 mds_log_expire
1/ 5 mds_migrator
0/ 1 buffer
0/ 1 timer
0/ 1 filer
0/ 1 striper
0/ 1 objecter
0/ 5 rados
0/ 5 rbd
0/ 5 rbd_mirror
0/ 5 rbd_replay
0/ 5 journaler
0/ 5 objectcacher
0/ 5 client
1/ 5 osd
0/ 5 optracker
0/ 5 objclass
1/ 3 filestore
1/ 3 journal
0/ 5 ms
1/ 5 mon
0/10 monc
1/ 5 paxos
0/ 5 tp
1/ 5 auth
1/ 5 crypto
1/ 1 finisher
1/ 5 heartbeatmap
1/ 5 perfcounter
1/ 5 rgw
1/10 civetweb
1/ 5 javaclient
1/ 5 asok
1/ 1 throttle
0/ 0 refs
1/ 5 xio
1/ 5 compressor
1/ 5 bluestore
1/ 5 bluefs
1/ 3 bdev
1/ 5 kstore
4/ 5 rocksdb
4/ 5 leveldb
4/ 5 memdb
1/ 5 kinetic
1/ 5 fuse
1/ 5 mgr
1/ 5 mgrc
1/ 5 dpdk
1/ 5 eventtrace
-2/-2 (syslog threshold)
99/99 (stderr threshold)
max_recent 10000
max_new 1000
log_file
--- end dump of recent events ---
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment