ceph-mon.60zxl02.log

2016-07-26 10:34:27.698464 7fc4a286d7a0  0 ceph version 0.94.6 (e832001feaf8c176593e0325c8298e3f16dfb403), process ceph-mon, pid 33053
2016-07-26 10:34:27.710268 7fc4a286d7a0 10 load: jerasure load: lrc load: isa 
2016-07-26 10:34:27.797926 7fc4a286d7a0 10 obtain_monmap
2016-07-26 10:34:27.797978 7fc4a286d7a0 10 obtain_monmap read last committed monmap ver 5
2016-07-26 10:34:27.798043 7fc4a286d7a0  0 starting mon.60zxl02 rank 1 at 10.98.2.167:6789/0 mon_data /var/lib/ceph/mon/ceph-60zxl02 fsid 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af
2016-07-26 10:34:27.798098 7fc4a286d7a0  1 -- 10.98.2.167:6789/0 learned my addr 10.98.2.167:6789/0
2016-07-26 10:34:27.798106 7fc4a286d7a0  1 accepter.accepter.bind my_inst.addr is 10.98.2.167:6789/0 need_addr=0
2016-07-26 10:34:27.798260 7fc4a286d7a0  1 mon.60zxl02@-1(probing) e5 preinit fsid 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af
2016-07-26 10:34:27.798307 7fc4a286d7a0 10 mon.60zxl02@-1(probing) e5 check_fsid cluster_uuid contains '2f51a247-3155-4bcf-9aee-c6f6b2c5e2af'
2016-07-26 10:34:27.798333 7fc4a286d7a0 10 mon.60zxl02@-1(probing) e5 features compat={},rocompat={},incompat={1=initial feature set (~v.18),3=single paxos with k/v store (v0.?),4=support erasure code pools,5=new-style osdmap encoding,6=support isa/lrc erasure code}
2016-07-26 10:34:27.798340 7fc4a286d7a0 10 mon.60zxl02@-1(probing) e5 apply_compatset_features_to_quorum_requirements required_features 18416819765248
2016-07-26 10:34:27.798343 7fc4a286d7a0 10 mon.60zxl02@-1(probing) e5 required_features 18416819765248
2016-07-26 10:34:27.798357 7fc4a286d7a0 10 mon.60zxl02@-1(probing) e5 has_ever_joined = 1
2016-07-26 10:34:27.798387 7fc4a286d7a0 10 mon.60zxl02@-1(probing) e5 sync_last_committed_floor 0
2016-07-26 10:34:27.798392 7fc4a286d7a0 10 mon.60zxl02@-1(probing) e5 init_paxos
2016-07-26 10:34:27.798481 7fc4a286d7a0 10 mon.60zxl02@-1(probing).paxos(paxos recovering c 1318755..1319324) init last_pn: 470301 accepted_pn: 470100 last_committed: 1319324 first_committed: 1318755
2016-07-26 10:34:27.798490 7fc4a286d7a0 10 mon.60zxl02@-1(probing).paxos(paxos recovering c 1318755..1319324) init
2016-07-26 10:34:27.798512 7fc4a286d7a0 10 mon.60zxl02@-1(probing) e5 refresh_from_paxos
2016-07-26 10:34:27.798564 7fc4a286d7a0  1 mon.60zxl02@-1(probing).paxosservice(pgmap 538057..538795) refresh upgraded, format 0 -> 1
2016-07-26 10:34:27.798572 7fc4a286d7a0  1 mon.60zxl02@-1(probing).pg v0 on_upgrade discarding in-core PGMap
2016-07-26 10:34:27.798591 7fc4a286d7a0 10 mon.60zxl02@-1(probing).paxosservice(pgmap 538057..538795) refresh
2016-07-26 10:34:27.798597 7fc4a286d7a0 10 mon.60zxl02@-1(probing).pg v0 update_from_paxos v0, read_full
2016-07-26 10:34:27.798600 7fc4a286d7a0 10 mon.60zxl02@-1(probing).pg v0 read_pgmap_meta
2016-07-26 10:34:27.810105 7fc4a286d7a0 10 mon.60zxl02@-1(probing).pg v538795 update_logger
2016-07-26 10:34:27.810141 7fc4a286d7a0 10 mon.60zxl02@-1(probing).paxosservice(mdsmap 1..1) refresh
2016-07-26 10:34:27.810145 7fc4a286d7a0 10 mon.60zxl02@-1(probing).mds e0 update_from_paxos version 1, my e 0
2016-07-26 10:34:27.810169 7fc4a286d7a0 10 mon.60zxl02@-1(probing).mds e0 update_from_paxos got 1
2016-07-26 10:34:27.810176 7fc4a286d7a0  4 mon.60zxl02@-1(probing).mds e1 new map
2016-07-26 10:34:27.810178 7fc4a286d7a0  0 mon.60zxl02@-1(probing).mds e1 print_map
epoch	1
flags	0
created	0.000000
modified	2016-04-25 21:12:07.303333
tableserver	0
root	0
session_timeout	0
session_autoclose	0
max_file_size	0
last_failure	0
last_failure_osd_epoch	0
compat	compat={},rocompat={},incompat={}
max_mds	0
in	
up	{}
failed	
stopped	
data_pools	
metadata_pool	0
inline_data	disabled

2016-07-26 10:34:27.810195 7fc4a286d7a0 10 mon.60zxl02@-1(probing).mds e1 update_logger
2016-07-26 10:34:27.810278 7fc4a286d7a0 10 mon.60zxl02@-1(probing).paxosservice(osdmap 1769..2433) refresh
2016-07-26 10:34:27.810362 7fc4a286d7a0  7 mon.60zxl02@-1(probing).osd e0 update_from_paxos loading latest full map e2433
2016-07-26 10:34:27.810526 7fc4a286d7a0 10 mon.60zxl02@-1(probing).osd e2433  adding osd.48 to down_pending_out map
2016-07-26 10:34:27.810530 7fc4a286d7a0 10 mon.60zxl02@-1(probing).osd e2433  adding osd.49 to down_pending_out map
2016-07-26 10:34:27.810533 7fc4a286d7a0 10 mon.60zxl02@-1(probing).osd e2433 check_subs
2016-07-26 10:34:27.810535 7fc4a286d7a0 10 mon.60zxl02@-1(probing).osd e2433 share_map_with_random_osd no up osd on our session map
2016-07-26 10:34:27.810538 7fc4a286d7a0 10 mon.60zxl02@-1(probing).osd e2433 update_logger
2016-07-26 10:34:27.810545 7fc4a286d7a0  0 mon.60zxl02@-1(probing).osd e2433 crush map has features 1107558400, adjusting msgr requires
2016-07-26 10:34:27.810548 7fc4a286d7a0  0 mon.60zxl02@-1(probing).osd e2433 crush map has features 1107558400, adjusting msgr requires
2016-07-26 10:34:27.810550 7fc4a286d7a0  0 mon.60zxl02@-1(probing).osd e2433 crush map has features 1107558400, adjusting msgr requires
2016-07-26 10:34:27.810551 7fc4a286d7a0  0 mon.60zxl02@-1(probing).osd e2433 crush map has features 1107558400, adjusting msgr requires
2016-07-26 10:34:27.810621 7fc4a286d7a0 10 mon.60zxl02@-1(probing).paxosservice(logm 765975..766716) refresh
2016-07-26 10:34:27.810625 7fc4a286d7a0 10 mon.60zxl02@-1(probing).log v766716 update_from_paxos
2016-07-26 10:34:27.810628 7fc4a286d7a0 10 mon.60zxl02@-1(probing).log v766716 update_from_paxos version 766716 summary v 0
2016-07-26 10:34:27.810639 7fc4a286d7a0 10 mon.60zxl02@-1(probing).log v766716 update_from_paxos latest full 766715
2016-07-26 10:34:27.810662 7fc4a286d7a0  7 mon.60zxl02@-1(probing).log v766716 update_from_paxos loading summary e766715
2016-07-26 10:34:27.810704 7fc4a286d7a0  7 mon.60zxl02@-1(probing).log v766716 update_from_paxos loaded summary e766715
2016-07-26 10:34:27.810725 7fc4a286d7a0  7 mon.60zxl02@-1(probing).log v766716 update_from_paxos applying incremental log 766716 2016-07-25 12:36:56.473836 mon.4 10.98.2.216:6789/0 1 : audit [DBG] from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch
2016-07-26 10:34:27.810745 7fc4a286d7a0  7 mon.60zxl02@-1(probing).log v766716 update_from_paxos applying incremental log 766716 2016-07-25 12:36:56.473912 mon.4 10.98.2.216:6789/0 2 : audit [DBG] from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished
2016-07-26 10:34:27.810752 7fc4a286d7a0  7 mon.60zxl02@-1(probing).log v766716 update_from_paxos applying incremental log 766716 2016-07-25 12:36:56.474080 mon.4 10.98.2.216:6789/0 3 : cluster [INF] mon.615yl02 calling new monitor election
2016-07-26 10:34:27.810766 7fc4a286d7a0  7 mon.60zxl02@-1(probing).log v766716 update_from_paxos applying incremental log 766716 2016-07-25 12:37:24.253944 mon.4 10.98.2.216:6789/0 4 : audit [DBG] from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch
2016-07-26 10:34:27.810772 7fc4a286d7a0  7 mon.60zxl02@-1(probing).log v766716 update_from_paxos applying incremental log 766716 2016-07-25 12:37:24.254011 mon.4 10.98.2.216:6789/0 5 : audit [DBG] from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished
2016-07-26 10:34:27.810782 7fc4a286d7a0  7 mon.60zxl02@-1(probing).log v766716 update_from_paxos applying incremental log 766716 2016-07-25 12:37:24.254115 mon.1 10.98.2.167:6789/0 289 : cluster [INF] mon.60zxl02 calling new monitor election
2016-07-26 10:34:27.810792 7fc4a286d7a0  7 mon.60zxl02@-1(probing).log v766716 update_from_paxos applying incremental log 766716 2016-07-25 12:37:24.254224 mon.2 10.98.2.173:6789/0 316 : cluster [INF] mon.610wl02 calling new monitor election
2016-07-26 10:34:27.810804 7fc4a286d7a0  7 mon.60zxl02@-1(probing).log v766716 update_from_paxos applying incremental log 766716 2016-07-25 12:37:24.265758 mon.4 10.98.2.216:6789/0 6 : audit [DBG] from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch
2016-07-26 10:34:27.810810 7fc4a286d7a0  7 mon.60zxl02@-1(probing).log v766716 update_from_paxos applying incremental log 766716 2016-07-25 12:37:24.265820 mon.4 10.98.2.216:6789/0 7 : audit [DBG] from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished
2016-07-26 10:34:27.810815 7fc4a286d7a0  7 mon.60zxl02@-1(probing).log v766716 update_from_paxos applying incremental log 766716 2016-07-25 12:37:25.333663 mon.4 10.98.2.216:6789/0 8 : audit [DBG] from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch
2016-07-26 10:34:27.810820 7fc4a286d7a0  7 mon.60zxl02@-1(probing).log v766716 update_from_paxos applying incremental log 766716 2016-07-25 12:37:25.333722 mon.4 10.98.2.216:6789/0 9 : audit [DBG] from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished
2016-07-26 10:34:27.810826 7fc4a286d7a0  7 mon.60zxl02@-1(probing).log v766716 update_from_paxos applying incremental log 766716 2016-07-25 12:37:26.412490 mon.4 10.98.2.216:6789/0 10 : audit [DBG] from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch
2016-07-26 10:34:27.810831 7fc4a286d7a0  7 mon.60zxl02@-1(probing).log v766716 update_from_paxos applying incremental log 766716 2016-07-25 12:37:26.412555 mon.4 10.98.2.216:6789/0 11 : audit [DBG] from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished
2016-07-26 10:34:27.810837 7fc4a286d7a0  7 mon.60zxl02@-1(probing).log v766716 update_from_paxos applying incremental log 766716 2016-07-25 12:37:27.490889 mon.4 10.98.2.216:6789/0 12 : audit [DBG] from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch
2016-07-26 10:34:27.810842 7fc4a286d7a0  7 mon.60zxl02@-1(probing).log v766716 update_from_paxos applying incremental log 766716 2016-07-25 12:37:27.490944 mon.4 10.98.2.216:6789/0 13 : audit [DBG] from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished
2016-07-26 10:34:27.810848 7fc4a286d7a0  7 mon.60zxl02@-1(probing).log v766716 update_from_paxos applying incremental log 766716 2016-07-25 12:37:28.569356 mon.4 10.98.2.216:6789/0 14 : audit [DBG] from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch
2016-07-26 10:34:27.810853 7fc4a286d7a0  7 mon.60zxl02@-1(probing).log v766716 update_from_paxos applying incremental log 766716 2016-07-25 12:37:28.569415 mon.4 10.98.2.216:6789/0 15 : audit [DBG] from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished
2016-07-26 10:34:27.810859 7fc4a286d7a0  7 mon.60zxl02@-1(probing).log v766716 update_from_paxos applying incremental log 766716 2016-07-25 12:37:29.647699 mon.4 10.98.2.216:6789/0 16 : audit [DBG] from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch
2016-07-26 10:34:27.810864 7fc4a286d7a0  7 mon.60zxl02@-1(probing).log v766716 update_from_paxos applying incremental log 766716 2016-07-25 12:37:29.647758 mon.4 10.98.2.216:6789/0 17 : audit [DBG] from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished
2016-07-26 10:34:27.810869 7fc4a286d7a0  7 mon.60zxl02@-1(probing).log v766716 update_from_paxos applying incremental log 766716 2016-07-25 12:37:39.348432 mon.1 10.98.2.167:6789/0 290 : cluster [INF] mon.60zxl02 calling new monitor election
2016-07-26 10:34:27.810878 7fc4a286d7a0  7 mon.60zxl02@-1(probing).log v766716 update_from_paxos applying incremental log 766716 2016-07-25 12:37:39.348552 mon.2 10.98.2.173:6789/0 317 : cluster [INF] mon.610wl02 calling new monitor election
2016-07-26 10:34:27.810890 7fc4a286d7a0  7 mon.60zxl02@-1(probing).log v766716 update_from_paxos applying incremental log 766716 2016-07-25 12:37:44.395483 mon.1 10.98.2.167:6789/0 291 : cluster [INF] mon.60zxl02@1 won leader election with quorum 1,2,4
2016-07-26 10:34:27.810899 7fc4a286d7a0  7 mon.60zxl02@-1(probing).log v766716 update_from_paxos applying incremental log 766716 2016-07-25 12:37:44.402186 mon.1 10.98.2.167:6789/0 292 : cluster [INF] HEALTH_WARN; 17 pgs degraded; 4 pgs down; 883 pgs peering; 1516 pgs stale; 17 pgs stuck degraded; 900 pgs stuck inactive; 1516 pgs stuck stale; 900 pgs stuck unclean; 17 pgs stuck undersized; 17 pgs undersized; recovery 14/2367 objects degraded (0.591%); too many PGs per OSD (316 > max 300); 2/19 in osds are down; 2 mons down, quorum 1,2,4 60zxl02,610wl02,615yl02
2016-07-26 10:34:27.810909 7fc4a286d7a0  7 mon.60zxl02@-1(probing).log v766716 update_from_paxos applying incremental log 766716 2016-07-25 12:37:44.435794 mon.1 10.98.2.167:6789/0 293 : cluster [INF] monmap e5: 5 mons at {60z0m02=10.98.2.166:6789/0,60zxl02=10.98.2.167:6789/0,610wl02=10.98.2.173:6789/0,615yl02=10.98.2.216:6789/0,618yl02=10.98.2.214:6789/0}
2016-07-26 10:34:27.810919 7fc4a286d7a0  7 mon.60zxl02@-1(probing).log v766716 update_from_paxos applying incremental log 766716 2016-07-25 12:37:44.435879 mon.1 10.98.2.167:6789/0 294 : cluster [INF] pgmap v538795: 2120 pgs: 296 stale+peering, 1220 stale+active+clean, 583 peering, 17 undersized+degraded+peered, 4 down+peering; 4715 MB data, 6612 MB used, 50009 GB / 50015 GB avail; 14/2367 objects degraded (0.591%)
2016-07-26 10:34:27.810928 7fc4a286d7a0  7 mon.60zxl02@-1(probing).log v766716 update_from_paxos applying incremental log 766716 2016-07-25 12:37:44.435935 mon.1 10.98.2.167:6789/0 295 : cluster [INF] mdsmap e1: 0/0/0 up
2016-07-26 10:34:27.810937 7fc4a286d7a0  7 mon.60zxl02@-1(probing).log v766716 update_from_paxos applying incremental log 766716 2016-07-25 12:37:44.436630 mon.1 10.98.2.167:6789/0 296 : cluster [INF] osdmap e2433: 65 osds: 17 up, 19 in
2016-07-26 10:34:27.810971 7fc4a286d7a0 10 mon.60zxl02@-1(probing).log v766716 check_subs
2016-07-26 10:34:27.811015 7fc4a286d7a0 10 mon.60zxl02@-1(probing).paxosservice(monmap 1..5) refresh
2016-07-26 10:34:27.811088 7fc4a286d7a0  1 mon.60zxl02@-1(probing).paxosservice(auth 2251..2418) refresh upgraded, format 0 -> 1
2016-07-26 10:34:27.811091 7fc4a286d7a0 10 mon.60zxl02@-1(probing).paxosservice(auth 2251..2418) refresh
2016-07-26 10:34:27.811104 7fc4a286d7a0 10 mon.60zxl02@-1(probing).auth v2418 update_from_paxos
2016-07-26 10:34:27.811120 7fc4a286d7a0 10 mon.60zxl02@-1(probing).auth v2418 update_from_paxos version 2418 keys ver 0 latest 2401
2016-07-26 10:34:27.811136 7fc4a286d7a0  7 mon.60zxl02@-1(probing).auth v2418 update_from_paxos loading summary e 2401
2016-07-26 10:34:27.811138 7fc4a286d7a0  7 mon.60zxl02@-1(probing).auth v2418 update_from_paxos latest length 8187
2016-07-26 10:34:27.811338 7fc4a286d7a0 10 mon.60zxl02@-1(probing).auth v2418 update_from_paxos key server version 2401
2016-07-26 10:34:27.811622 7fc4a286d7a0 10 mon.60zxl02@-1(probing).auth v2418 update_from_paxos() last_allocated_id=544096 max_global_id=544096 format_version 1
2016-07-26 10:34:27.811626 7fc4a286d7a0 10 mon.60zxl02@-1(probing).paxosservice(pgmap 538057..538795) post_refresh
2016-07-26 10:34:27.811630 7fc4a286d7a0 10 mon.60zxl02@-1(probing).pg v538795 map_pg_creates to 0 pgs osdmap epoch 2433
2016-07-26 10:34:27.811632 7fc4a286d7a0 10 mon.60zxl02@-1(probing).pg v538795 send_pg_creates to 0 pgs
2016-07-26 10:34:27.811633 7fc4a286d7a0 10 mon.60zxl02@-1(probing).paxosservice(mdsmap 1..1) post_refresh
2016-07-26 10:34:27.811634 7fc4a286d7a0 10 mon.60zxl02@-1(probing).paxosservice(osdmap 1769..2433) post_refresh
2016-07-26 10:34:27.811635 7fc4a286d7a0 10 mon.60zxl02@-1(probing).paxosservice(logm 765975..766716) post_refresh
2016-07-26 10:34:27.811636 7fc4a286d7a0 10 mon.60zxl02@-1(probing).paxosservice(monmap 1..5) post_refresh
2016-07-26 10:34:27.811637 7fc4a286d7a0 10 mon.60zxl02@-1(probing).paxosservice(auth 2251..2418) post_refresh
2016-07-26 10:34:27.811639 7fc4a286d7a0 10 mon.60zxl02@-1(probing).health(0) init
2016-07-26 10:37:25.708504 7fc4a286d7a0  1 -- 10.98.2.167:6789/0 messenger.start
2016-07-26 10:37:25.708537 7fc4a286d7a0  2 mon.60zxl02@-1(probing) e5 init
2016-07-26 10:37:25.708599 7fc4a286d7a0  1 accepter.accepter.start
2016-07-26 10:37:25.708620 7fc4a286d7a0 10 mon.60zxl02@-1(probing) e5 bootstrap
2016-07-26 10:37:25.708626 7fc4a286d7a0 10 mon.60zxl02@-1(probing) e5 sync_reset_requester
2016-07-26 10:37:25.708627 7fc4a286d7a0 10 mon.60zxl02@-1(probing) e5 unregister_cluster_logger - not registered
2016-07-26 10:37:25.708629 7fc4a286d7a0 10 mon.60zxl02@-1(probing) e5 cancel_probe_timeout (none scheduled)
2016-07-26 10:37:25.708630 7fc4a286d7a0  0 mon.60zxl02@-1(probing) e5  my rank is now 1 (was -1)
2016-07-26 10:37:25.708632 7fc4a286d7a0  1 -- 10.98.2.167:6789/0 mark_down_all
2016-07-26 10:37:25.708719 7fc4a286d7a0 10 mon.60zxl02@1(probing) e5 _reset
2016-07-26 10:37:25.708724 7fc4a286d7a0 10 mon.60zxl02@1(probing) e5 cancel_probe_timeout (none scheduled)
2016-07-26 10:37:25.708725 7fc4a286d7a0 10 mon.60zxl02@1(probing) e5 timecheck_finish
2016-07-26 10:37:25.708728 7fc4a286d7a0 10 mon.60zxl02@1(probing) e5 scrub_reset
2016-07-26 10:37:25.708732 7fc4a286d7a0 10 mon.60zxl02@1(probing).paxos(paxos recovering c 1318755..1319324) restart -- canceling timeouts
2016-07-26 10:37:25.708725 7fc499a9c700 10 mon.60zxl02@1(probing) e5 ms_handle_reset 0x33f2520 :/0
2016-07-26 10:37:25.708738 7fc4a286d7a0 10 mon.60zxl02@1(probing).paxosservice(pgmap 538057..538795) restart
2016-07-26 10:37:25.708742 7fc4a286d7a0 10 mon.60zxl02@1(probing).paxosservice(mdsmap 1..1) restart
2016-07-26 10:37:25.708744 7fc4a286d7a0 10 mon.60zxl02@1(probing).paxosservice(osdmap 1769..2433) restart
2016-07-26 10:37:25.708746 7fc4a286d7a0 10 mon.60zxl02@1(probing).paxosservice(logm 765975..766716) restart
2016-07-26 10:37:25.708747 7fc4a286d7a0 10 mon.60zxl02@1(probing).paxosservice(monmap 1..5) restart
2016-07-26 10:37:25.708748 7fc4a286d7a0 10 mon.60zxl02@1(probing).paxosservice(auth 2251..2418) restart
2016-07-26 10:37:25.708751 7fc4a286d7a0 10 mon.60zxl02@1(probing) e5 cancel_probe_timeout (none scheduled)
2016-07-26 10:37:25.708753 7fc4a286d7a0 10 mon.60zxl02@1(probing) e5 reset_probe_timeout 0x371e9d0 after 2 seconds
2016-07-26 10:37:25.708770 7fc4a286d7a0 10 mon.60zxl02@1(probing) e5 probing other monitors
2016-07-26 10:37:25.708774 7fc4a286d7a0  1 -- 10.98.2.167:6789/0 --> mon.0 10.98.2.166:6789/0 -- mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02) v6 -- ?+0 0x34f8280
2016-07-26 10:37:25.708805 7fc497c99700  1 -- 10.98.2.167:6789/0 >> :/0 pipe(0x3629000 sd=15 :6789 s=0 pgs=0 cs=0 l=0 c=0x33f2680).accept sd=15 10.98.2.166:51844/0
2016-07-26 10:37:25.708839 7fc497b98700  1 -- 10.98.2.167:6789/0 >> :/0 pipe(0x3624800 sd=14 :6789 s=0 pgs=0 cs=0 l=0 c=0x33f2aa0).accept sd=14 10.98.3.15:44432/0
2016-07-26 10:37:25.708848 7fc4a286d7a0  1 -- 10.98.2.167:6789/0 --> mon.2 10.98.2.173:6789/0 -- mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02) v6 -- ?+0 0x34f9680
2016-07-26 10:37:25.708883 7fc499a9c700 10 mon.60zxl02@1(probing) e5 ms_handle_reset 0x33f2aa0 :/0
2016-07-26 10:37:25.708903 7fc497996700  1 -- 10.98.2.167:6789/0 >> :/0 pipe(0x3632000 sd=16 :6789 s=0 pgs=0 cs=0 l=0 c=0x33f2520).accept sd=16 10.98.3.15:44435/0
2016-07-26 10:37:25.708923 7fc4a286d7a0  1 -- 10.98.2.167:6789/0 --> mon.3 10.98.2.214:6789/0 -- mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02) v6 -- ?+0 0x34f9400
2016-07-26 10:37:25.708931 7fc499a9c700 10 mon.60zxl02@1(probing) e5 ms_handle_reset 0x33f2520 :/0
2016-07-26 10:37:25.708951 7fc4a286d7a0  1 -- 10.98.2.167:6789/0 --> mon.4 10.98.2.216:6789/0 -- mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02) v6 -- ?+0 0x34f9180
2016-07-26 10:37:25.709002 7fc497794700  1 -- 10.98.2.167:6789/0 >> :/0 pipe(0x362d800 sd=18 :6789 s=0 pgs=0 cs=0 l=0 c=0x33f2ec0).accept sd=18 10.98.3.23:59344/0
2016-07-26 10:37:25.709029 7fc499a9c700 10 mon.60zxl02@1(probing) e5 ms_handle_reset 0x33f2ec0 :/0
2016-07-26 10:37:25.709048 7fc497996700  1 -- 10.98.2.167:6789/0 >> :/0 pipe(0x37b1000 sd=21 :6789 s=0 pgs=0 cs=0 l=0 c=0x33f2c00).accept sd=21 10.98.3.15:44439/0
2016-07-26 10:37:25.709064 7fc497a97700 10 mon.60zxl02@1(probing) e5 ms_get_authorizer for mon
2016-07-26 10:37:25.709071 7fc499a9c700 10 mon.60zxl02@1(probing) e5 ms_handle_reset 0x33f2c00 :/0
2016-07-26 10:37:25.709107 7fc497592700  1 -- 10.98.2.167:6789/0 >> :/0 pipe(0x3624800 sd=14 :6789 s=0 pgs=0 cs=0 l=0 c=0x33f3f40).accept sd=14 10.98.3.15:44446/0
2016-07-26 10:37:25.709138 7fc499a9c700 10 mon.60zxl02@1(probing) e5 ms_handle_reset 0x33f3f40 :/0
2016-07-26 10:37:25.709155 7fc497491700  1 -- 10.98.2.167:6789/0 >> :/0 pipe(0x3632000 sd=22 :6789 s=0 pgs=0 cs=0 l=0 c=0x33f3c80).accept sd=22 10.98.3.15:44456/0
2016-07-26 10:37:25.709174 7fc49a49d700 10 mon.60zxl02@1(probing).data_health(0) service_tick
2016-07-26 10:37:25.709180 7fc499a9c700 10 mon.60zxl02@1(probing) e5 ms_handle_reset 0x33f3c80 :/0
2016-07-26 10:37:25.709186 7fc497794700  1 -- 10.98.2.167:6789/0 >> :/0 pipe(0x3829000 sd=24 :6789 s=0 pgs=0 cs=0 l=0 c=0x33f39c0).accept sd=24 10.98.3.18:56993/0
2016-07-26 10:37:25.709190 7fc49a49d700  0 mon.60zxl02@1(probing).data_health(0) update_stats avail 94% total 825 GB, used 3538 MB, avail 779 GB
2016-07-26 10:37:25.709205 7fc499a9c700 10 mon.60zxl02@1(probing) e5 ms_handle_reset 0x33f39c0 :/0
2016-07-26 10:37:25.709230 7fc497996700  1 -- 10.98.2.167:6789/0 >> :/0 pipe(0x3824800 sd=18 :6789 s=0 pgs=0 cs=0 l=0 c=0x33f44c0).accept sd=18 10.98.3.15:44496/0
2016-07-26 10:37:25.709244 7fc499a9c700 10 mon.60zxl02@1(probing) e5 ms_handle_reset 0x33f44c0 :/0
2016-07-26 10:37:25.709291 7fc49698f700  1 -- 10.98.2.167:6789/0 >> :/0 pipe(0x3820000 sd=28 :6789 s=0 pgs=0 cs=0 l=0 c=0x33f4360).accept sd=28 10.98.3.15:44503/0
2016-07-26 10:37:25.709318 7fc499a9c700 10 mon.60zxl02@1(probing) e5 ms_handle_reset 0x33f4360 :/0
2016-07-26 10:37:25.709346 7fc497996700  1 -- 10.98.2.167:6789/0 >> :/0 pipe(0x3632000 sd=22 :6789 s=0 pgs=0 cs=0 l=0 c=0x33f40a0).accept sd=22 10.98.3.15:44597/0
2016-07-26 10:37:25.709361 7fc499a9c700 10 mon.60zxl02@1(probing) e5 ms_handle_reset 0x33f40a0 :/0
2016-07-26 10:37:25.709378 7fc497794700  1 -- 10.98.2.167:6789/0 >> :/0 pipe(0x3624800 sd=14 :6789 s=0 pgs=0 cs=0 l=0 c=0x33f2ec0).accept sd=14 10.98.3.18:57023/0
2016-07-26 10:37:25.709406 7fc49698f700  1 -- 10.98.2.167:6789/0 >> :/0 pipe(0x37b1000 sd=18 :6789 s=0 pgs=0 cs=0 l=0 c=0x33f2c00).accept sd=18 10.98.3.15:44624/0
2016-07-26 10:37:25.709422 7fc499a9c700 10 mon.60zxl02@1(probing) e5 ms_handle_reset 0x33f2c00 :/0
2016-07-26 10:37:25.709456 7fc497592700  1 -- 10.98.2.167:6789/0 >> :/0 pipe(0x3632000 sd=22 :6789 s=0 pgs=0 cs=0 l=0 c=0x33f3c80).accept sd=22 10.98.3.15:44634/0
2016-07-26 10:37:25.709441 7fc497996700  1 -- 10.98.2.167:6789/0 >> :/0 pipe(0x362d800 sd=21 :6789 s=0 pgs=0 cs=0 l=0 c=0x33f4620).accept sd=21 10.98.3.15:44626/0
2016-07-26 10:37:25.709473 7fc499a9c700 10 mon.60zxl02@1(probing) e5 ms_handle_reset 0x33f3c80 :/0
2016-07-26 10:37:25.709476 7fc499a9c700 10 mon.60zxl02@1(probing) e5 ms_handle_reset 0x33f4620 :/0
2016-07-26 10:37:25.709482 7fc49698f700  1 -- 10.98.2.167:6789/0 >> :/0 pipe(0x3879000 sd=24 :6789 s=0 pgs=0 cs=0 l=0 c=0x33f3f40).accept sd=24 10.98.3.15:44636/0
2016-07-26 10:37:25.709512 7fc497794700 10 mon.60zxl02@1(probing) e5 ms_verify_authorizer 10.98.3.18:0/1012640 client protocol 0
2016-07-26 10:37:25.709602 7fc49698f700 10 mon.60zxl02@1(probing) e5 ms_verify_authorizer 10.98.3.15:0/4187059021 client protocol 0
2016-07-26 10:37:25.709742 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== client.216235 10.98.3.18:0/1012640 1 ==== auth(proto 0 35 bytes epoch 5) v1 ==== 65+0+0 (234851919 0 0) 0x3888000 con 0x33f2ec0
2016-07-26 10:37:25.709763 7fc499a9c700  5 mon.60zxl02@1(probing) e5 waitlisting message auth(proto 0 35 bytes epoch 5) v1
2016-07-26 10:37:25.709769 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== client.? 10.98.3.15:0/4187059021 1 ==== auth(proto 0 31 bytes epoch 0) v1 ==== 61+0+0 (535495083 0 0) 0x3888240 con 0x33f3f40
2016-07-26 10:37:25.709774 7fc499a9c700  5 mon.60zxl02@1(probing) e5 waitlisting message auth(proto 0 31 bytes epoch 0) v1
2016-07-26 10:37:25.813978 7fc49e10f700  0 log_channel(audit) log [DBG] : from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch
2016-07-26 10:37:25.813981 7fc49e10f700  0 log_channel(audit) do_log log to syslog
2016-07-26 10:37:25.814004 7fc49e10f700  1 -- 10.98.2.167:6789/0 --> 10.98.2.167:6789/0 -- log(1 entries) v1 -- ?+0 0x3888480 con 0x33f11e0
2016-07-26 10:37:25.814034 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.1 10.98.2.167:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x3888480 con 0x33f11e0
2016-07-26 10:37:25.814053 7fc49e10f700  0 log_channel(audit) log [DBG] : from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished
2016-07-26 10:37:25.814055 7fc49e10f700  0 log_channel(audit) do_log log to syslog
2016-07-26 10:37:25.814065 7fc49e10f700  1 -- 10.98.2.167:6789/0 --> 10.98.2.167:6789/0 -- log(1 entries) v1 -- ?+0 0x3888fc0 con 0x33f11e0
2016-07-26 10:37:25.814075 7fc499a9c700 10 mon.60zxl02@1(probing) e5 do not have session, making new one
2016-07-26 10:37:25.814079 7fc499a9c700 10 mon.60zxl02@1(probing) e5 ms_dispatch new session MonSession: mon.1 10.98.2.167:6789/0 is open for mon.1 10.98.2.167:6789/0
2016-07-26 10:37:25.814085 7fc499a9c700  5 mon.60zxl02@1(probing) e5 setting monitor caps on this connection
2016-07-26 10:37:25.814092 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(logm 765975..766716) dispatch log(1 entries) v1 from mon.1 10.98.2.167:6789/0
2016-07-26 10:37:25.814103 7fc499a9c700  5 mon.60zxl02@1(probing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:37:25.814103 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:37:25.814109 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(logm 765975..766716)  waiting for paxos -> readable (v0)
2016-07-26 10:37:25.814111 7fc499a9c700  5 mon.60zxl02@1(probing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:37:25.814111 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:37:25.814116 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.1 10.98.2.167:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x3888fc0 con 0x33f11e0
2016-07-26 10:37:25.814120 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(logm 765975..766716) dispatch log(1 entries) v1 from mon.1 10.98.2.167:6789/0
2016-07-26 10:37:25.814124 7fc499a9c700  5 mon.60zxl02@1(probing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:37:25.814125 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:37:25.814128 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(logm 765975..766716)  waiting for paxos -> readable (v0)
2016-07-26 10:37:25.814129 7fc499a9c700  5 mon.60zxl02@1(probing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:37:25.814130 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:37:26.803833 7fc499a9c700 10 mon.60zxl02@1(probing) e5 ms_handle_reset 0x33f3f40 10.98.3.15:0/4187059021
2016-07-26 10:37:26.892754 7fc49e10f700  0 log_channel(audit) log [DBG] : from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch
2016-07-26 10:37:26.892757 7fc49e10f700  0 log_channel(audit) do_log log to syslog
2016-07-26 10:37:26.892775 7fc49e10f700  1 -- 10.98.2.167:6789/0 --> 10.98.2.167:6789/0 -- log(1 entries) v1 -- ?+0 0x38886c0 con 0x33f11e0
2016-07-26 10:37:26.892799 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.1 10.98.2.167:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x38886c0 con 0x33f11e0
2016-07-26 10:37:26.892819 7fc49e10f700  0 log_channel(audit) log [DBG] : from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished
2016-07-26 10:37:26.892821 7fc49e10f700  0 log_channel(audit) do_log log to syslog
2016-07-26 10:37:26.892831 7fc49e10f700  1 -- 10.98.2.167:6789/0 --> 10.98.2.167:6789/0 -- log(1 entries) v1 -- ?+0 0x3888b40 con 0x33f11e0
2016-07-26 10:37:26.892841 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(logm 765975..766716) dispatch log(1 entries) v1 from mon.1 10.98.2.167:6789/0
2016-07-26 10:37:26.892845 7fc499a9c700  5 mon.60zxl02@1(probing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:37:26.892846 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:37:26.892849 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(logm 765975..766716)  waiting for paxos -> readable (v0)
2016-07-26 10:37:26.892850 7fc499a9c700  5 mon.60zxl02@1(probing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:37:26.892852 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:37:26.892856 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.1 10.98.2.167:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x3888b40 con 0x33f11e0
2016-07-26 10:37:26.892861 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(logm 765975..766716) dispatch log(1 entries) v1 from mon.1 10.98.2.167:6789/0
2016-07-26 10:37:26.892868 7fc499a9c700  5 mon.60zxl02@1(probing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:37:26.892869 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:37:26.892871 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(logm 765975..766716)  waiting for paxos -> readable (v0)
2016-07-26 10:37:26.892873 7fc499a9c700  5 mon.60zxl02@1(probing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:37:26.892874 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:37:27.708872 7fc49a49d700  4 mon.60zxl02@1(probing) e5 probe_timeout 0x371e9d0
2016-07-26 10:37:27.708877 7fc49a49d700 10 mon.60zxl02@1(probing) e5 bootstrap
2016-07-26 10:37:27.708882 7fc49a49d700 10 mon.60zxl02@1(probing) e5 sync_reset_requester
2016-07-26 10:37:27.708883 7fc49a49d700 10 mon.60zxl02@1(probing) e5 unregister_cluster_logger - not registered
2016-07-26 10:37:27.708885 7fc49a49d700 10 mon.60zxl02@1(probing) e5 cancel_probe_timeout (none scheduled)
2016-07-26 10:37:27.708886 7fc49a49d700 10 mon.60zxl02@1(probing) e5 _reset
2016-07-26 10:37:27.708887 7fc49a49d700 10 mon.60zxl02@1(probing) e5 cancel_probe_timeout (none scheduled)
2016-07-26 10:37:27.708888 7fc49a49d700 10 mon.60zxl02@1(probing) e5 timecheck_finish
2016-07-26 10:37:27.708891 7fc49a49d700 10 mon.60zxl02@1(probing) e5 scrub_reset
2016-07-26 10:37:27.708893 7fc49a49d700 10 mon.60zxl02@1(probing).paxos(paxos recovering c 1318755..1319324) restart -- canceling timeouts
2016-07-26 10:37:27.708897 7fc49a49d700 10 mon.60zxl02@1(probing).paxosservice(pgmap 538057..538795) restart
2016-07-26 10:37:27.708900 7fc49a49d700 10 mon.60zxl02@1(probing).paxosservice(mdsmap 1..1) restart
2016-07-26 10:37:27.708902 7fc49a49d700 10 mon.60zxl02@1(probing).paxosservice(osdmap 1769..2433) restart
2016-07-26 10:37:27.708903 7fc49a49d700 10 mon.60zxl02@1(probing).paxosservice(logm 765975..766716) restart
2016-07-26 10:37:27.708904 7fc49a49d700 10 mon.60zxl02@1(probing).paxosservice(monmap 1..5) restart
2016-07-26 10:37:27.708906 7fc49a49d700 10 mon.60zxl02@1(probing).paxosservice(auth 2251..2418) restart
2016-07-26 10:37:27.708908 7fc49a49d700 10 mon.60zxl02@1(probing) e5 cancel_probe_timeout (none scheduled)
2016-07-26 10:37:27.708910 7fc49a49d700 10 mon.60zxl02@1(probing) e5 reset_probe_timeout 0x33a0240 after 2 seconds
2016-07-26 10:37:27.708918 7fc49a49d700 10 mon.60zxl02@1(probing) e5 probing other monitors
2016-07-26 10:37:27.708921 7fc49a49d700  1 -- 10.98.2.167:6789/0 --> mon.0 10.98.2.166:6789/0 -- mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02) v6 -- ?+0 0x34f9900
2016-07-26 10:37:27.708931 7fc49a49d700  1 -- 10.98.2.167:6789/0 --> mon.2 10.98.2.173:6789/0 -- mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02) v6 -- ?+0 0x34f9e00
2016-07-26 10:37:27.708937 7fc49a49d700  1 -- 10.98.2.167:6789/0 --> mon.3 10.98.2.214:6789/0 -- mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02) v6 -- ?+0 0x34f9b80
2016-07-26 10:37:27.708943 7fc49a49d700  1 -- 10.98.2.167:6789/0 --> mon.4 10.98.2.216:6789/0 -- mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02) v6 -- ?+0 0x34fa580
2016-07-26 10:37:27.971415 7fc49e10f700  0 log_channel(audit) log [DBG] : from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch
2016-07-26 10:37:27.971418 7fc49e10f700  0 log_channel(audit) do_log log to syslog
2016-07-26 10:37:27.971432 7fc49e10f700  1 -- 10.98.2.167:6789/0 --> 10.98.2.167:6789/0 -- log(1 entries) v1 -- ?+0 0x3888d80 con 0x33f11e0
2016-07-26 10:37:27.971463 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.1 10.98.2.167:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x3888d80 con 0x33f11e0
2016-07-26 10:37:27.971482 7fc49e10f700  0 log_channel(audit) log [DBG] : from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished
2016-07-26 10:37:27.971483 7fc49e10f700  0 log_channel(audit) do_log log to syslog
2016-07-26 10:37:27.971493 7fc49e10f700  1 -- 10.98.2.167:6789/0 --> 10.98.2.167:6789/0 -- log(1 entries) v1 -- ?+0 0x3889680 con 0x33f11e0
2016-07-26 10:37:27.971503 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(logm 765975..766716) dispatch log(1 entries) v1 from mon.1 10.98.2.167:6789/0
2016-07-26 10:37:27.971507 7fc499a9c700  5 mon.60zxl02@1(probing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:37:27.971508 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:37:27.971511 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(logm 765975..766716)  waiting for paxos -> readable (v0)
2016-07-26 10:37:27.971514 7fc499a9c700  5 mon.60zxl02@1(probing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:37:27.971514 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:37:27.971520 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.1 10.98.2.167:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x3889680 con 0x33f11e0
2016-07-26 10:37:27.971525 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(logm 765975..766716) dispatch log(1 entries) v1 from mon.1 10.98.2.167:6789/0
2016-07-26 10:37:27.971528 7fc499a9c700  5 mon.60zxl02@1(probing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:37:27.971528 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:37:27.971531 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(logm 765975..766716)  waiting for paxos -> readable (v0)
2016-07-26 10:37:27.971532 7fc499a9c700  5 mon.60zxl02@1(probing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:37:27.971532 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:37:28.524834 7fc49698f700  1 -- 10.98.2.167:6789/0 >> :/0 pipe(0x3874800 sd=18 :6789 s=0 pgs=0 cs=0 l=0 c=0x33f39c0).accept sd=18 10.98.2.173:34182/0
2016-07-26 10:37:28.525049 7fc49698f700 10 mon.60zxl02@1(probing) e5 ms_verify_authorizer 10.98.2.173:6789/0 mon protocol 2
2016-07-26 10:37:28.525142 7fc49698f700  0 -- 10.98.2.167:6789/0 >> 10.98.2.173:6789/0 pipe(0x3874800 sd=18 :6789 s=0 pgs=0 cs=0 l=0 c=0x33f39c0).accept connect_seq 0 vs existing 0 state connecting
2016-07-26 10:37:28.525519 7fc497895700 10 mon.60zxl02@1(probing) e5 ms_get_authorizer for mon
2016-07-26 10:37:28.525747 7fc499a9c700 10 mon.60zxl02@1(probing) e5 ms_handle_reset 0x33f39c0 10.98.2.173:6789/0
2016-07-26 10:37:28.525973 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.2 10.98.2.173:6789/0 1 ==== mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 610wl02) v6 ==== 64+0+0 (3448912970 0 0) 0x34fa800 con 0x33f1fa0
2016-07-26 10:37:28.525981 7fc499a9c700 10 mon.60zxl02@1(probing) e5 do not have session, making new one
2016-07-26 10:37:28.525983 7fc499a9c700 10 mon.60zxl02@1(probing) e5 ms_dispatch new session MonSession: mon.2 10.98.2.173:6789/0 is open for mon.2 10.98.2.173:6789/0
2016-07-26 10:37:28.525987 7fc499a9c700  5 mon.60zxl02@1(probing) e5 setting monitor caps on this connection
2016-07-26 10:37:28.525992 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 610wl02) v6
2016-07-26 10:37:28.525995 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe_probe mon.2 10.98.2.173:6789/0mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 610wl02) v6 features 37154696925806591
2016-07-26 10:37:28.526006 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> 10.98.2.173:6789/0 -- mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02 paxos( fc 1318755 lc 1319324 )) v6 -- ?+0 0x34faa80 con 0x33f1fa0
2016-07-26 10:37:28.526128 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.2 10.98.2.173:6789/0 2 ==== mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 610wl02 paxos( fc 1318755 lc 1319324 )) v6 ==== 845+0+0 (3613516349 0 0) 0x34f9e00 con 0x33f1fa0
2016-07-26 10:37:28.526136 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 610wl02 paxos( fc 1318755 lc 1319324 )) v6
2016-07-26 10:37:28.526139 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe_reply mon.2 10.98.2.173:6789/0mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 610wl02 paxos( fc 1318755 lc 1319324 )) v6
2016-07-26 10:37:28.526144 7fc499a9c700 10 mon.60zxl02@1(probing) e5  monmap is e5: 5 mons at {60z0m02=10.98.2.166:6789/0,60zxl02=10.98.2.167:6789/0,610wl02=10.98.2.173:6789/0,615yl02=10.98.2.216:6789/0,618yl02=10.98.2.214:6789/0}
2016-07-26 10:37:28.526157 7fc499a9c700 10 mon.60zxl02@1(probing) e5  peer name is 610wl02
2016-07-26 10:37:28.526159 7fc499a9c700 10 mon.60zxl02@1(probing) e5  mon.610wl02 is outside the quorum
2016-07-26 10:37:28.526161 7fc499a9c700 10 mon.60zxl02@1(probing) e5  outside_quorum now 60zxl02,610wl02, need 3
2016-07-26 10:37:28.526163 7fc499a9c700 10 mon.60zxl02@1(probing) e5  that's not yet enough for a new quorum, waiting
2016-07-26 10:37:28.526167 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.2 10.98.2.173:6789/0 3 ==== mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 610wl02 paxos( fc 1318755 lc 1319324 )) v6 ==== 845+0+0 (3613516349 0 0) 0x34f9680 con 0x33f1fa0
2016-07-26 10:37:28.526174 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 610wl02 paxos( fc 1318755 lc 1319324 )) v6
2016-07-26 10:37:28.526177 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe_reply mon.2 10.98.2.173:6789/0mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 610wl02 paxos( fc 1318755 lc 1319324 )) v6
2016-07-26 10:37:28.526180 7fc499a9c700 10 mon.60zxl02@1(probing) e5  monmap is e5: 5 mons at {60z0m02=10.98.2.166:6789/0,60zxl02=10.98.2.167:6789/0,610wl02=10.98.2.173:6789/0,615yl02=10.98.2.216:6789/0,618yl02=10.98.2.214:6789/0}
2016-07-26 10:37:28.526189 7fc499a9c700 10 mon.60zxl02@1(probing) e5  peer name is 610wl02
2016-07-26 10:37:28.526190 7fc499a9c700 10 mon.60zxl02@1(probing) e5  mon.610wl02 is outside the quorum
2016-07-26 10:37:28.526191 7fc499a9c700 10 mon.60zxl02@1(probing) e5  outside_quorum now 60zxl02,610wl02, need 3
2016-07-26 10:37:28.526192 7fc499a9c700 10 mon.60zxl02@1(probing) e5  that's not yet enough for a new quorum, waiting
2016-07-26 10:37:29.049902 7fc49e10f700  0 log_channel(audit) log [DBG] : from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch
2016-07-26 10:37:29.049905 7fc49e10f700  0 log_channel(audit) do_log log to syslog
2016-07-26 10:37:29.049921 7fc49e10f700  1 -- 10.98.2.167:6789/0 --> 10.98.2.167:6789/0 -- log(1 entries) v1 -- ?+0 0x38898c0 con 0x33f11e0
2016-07-26 10:37:29.049938 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.1 10.98.2.167:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x38898c0 con 0x33f11e0
2016-07-26 10:37:29.049959 7fc49e10f700  0 log_channel(audit) log [DBG] : from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished
2016-07-26 10:37:29.049961 7fc49e10f700  0 log_channel(audit) do_log log to syslog
2016-07-26 10:37:29.049969 7fc49e10f700  1 -- 10.98.2.167:6789/0 --> 10.98.2.167:6789/0 -- log(1 entries) v1 -- ?+0 0x3889200 con 0x33f11e0
2016-07-26 10:37:29.049977 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(logm 765975..766716) dispatch log(1 entries) v1 from mon.1 10.98.2.167:6789/0
2016-07-26 10:37:29.049981 7fc499a9c700  5 mon.60zxl02@1(probing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:37:29.049983 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:37:29.049986 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(logm 765975..766716)  waiting for paxos -> readable (v0)
2016-07-26 10:37:29.049988 7fc499a9c700  5 mon.60zxl02@1(probing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:37:29.049988 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:37:29.049992 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.1 10.98.2.167:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x3889200 con 0x33f11e0
2016-07-26 10:37:29.049997 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(logm 765975..766716) dispatch log(1 entries) v1 from mon.1 10.98.2.167:6789/0
2016-07-26 10:37:29.050004 7fc499a9c700  5 mon.60zxl02@1(probing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:37:29.050005 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:37:29.050008 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(logm 765975..766716)  waiting for paxos -> readable (v0)
2016-07-26 10:37:29.050009 7fc499a9c700  5 mon.60zxl02@1(probing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:37:29.050010 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:37:29.709028 7fc49a49d700  4 mon.60zxl02@1(probing) e5 probe_timeout 0x33a0240
2016-07-26 10:37:29.709031 7fc49a49d700 10 mon.60zxl02@1(probing) e5 bootstrap
2016-07-26 10:37:29.709033 7fc49a49d700 10 mon.60zxl02@1(probing) e5 sync_reset_requester
2016-07-26 10:37:29.709034 7fc49a49d700 10 mon.60zxl02@1(probing) e5 unregister_cluster_logger - not registered
2016-07-26 10:37:29.709035 7fc49a49d700 10 mon.60zxl02@1(probing) e5 cancel_probe_timeout (none scheduled)
2016-07-26 10:37:29.709036 7fc49a49d700 10 mon.60zxl02@1(probing) e5 _reset
2016-07-26 10:37:29.709037 7fc49a49d700 10 mon.60zxl02@1(probing) e5 cancel_probe_timeout (none scheduled)
2016-07-26 10:37:29.709038 7fc49a49d700 10 mon.60zxl02@1(probing) e5 timecheck_finish
2016-07-26 10:37:29.709039 7fc49a49d700 10 mon.60zxl02@1(probing) e5 scrub_reset
2016-07-26 10:37:29.709040 7fc49a49d700 10 mon.60zxl02@1(probing).paxos(paxos recovering c 1318755..1319324) restart -- canceling timeouts
2016-07-26 10:37:29.709043 7fc49a49d700 10 mon.60zxl02@1(probing).paxosservice(pgmap 538057..538795) restart
2016-07-26 10:37:29.709045 7fc49a49d700 10 mon.60zxl02@1(probing).paxosservice(mdsmap 1..1) restart
2016-07-26 10:37:29.709047 7fc49a49d700 10 mon.60zxl02@1(probing).paxosservice(osdmap 1769..2433) restart
2016-07-26 10:37:29.709048 7fc49a49d700 10 mon.60zxl02@1(probing).paxosservice(logm 765975..766716) restart
2016-07-26 10:37:29.709050 7fc49a49d700 10 mon.60zxl02@1(probing).paxosservice(monmap 1..5) restart
2016-07-26 10:37:29.709051 7fc49a49d700 10 mon.60zxl02@1(probing).paxosservice(auth 2251..2418) restart
2016-07-26 10:37:29.709053 7fc49a49d700 10 mon.60zxl02@1(probing) e5 cancel_probe_timeout (none scheduled)
2016-07-26 10:37:29.709054 7fc49a49d700 10 mon.60zxl02@1(probing) e5 reset_probe_timeout 0x371e9d0 after 2 seconds
2016-07-26 10:37:29.709059 7fc49a49d700 10 mon.60zxl02@1(probing) e5 probing other monitors
2016-07-26 10:37:29.709061 7fc49a49d700  1 -- 10.98.2.167:6789/0 --> mon.0 10.98.2.166:6789/0 -- mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02) v6 -- ?+0 0x34fa300
2016-07-26 10:37:29.709068 7fc49a49d700  1 -- 10.98.2.167:6789/0 --> mon.2 10.98.2.173:6789/0 -- mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02) v6 -- ?+0 0x34fa080
2016-07-26 10:37:29.709077 7fc49a49d700  1 -- 10.98.2.167:6789/0 --> mon.3 10.98.2.214:6789/0 -- mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02) v6 -- ?+0 0x34fad00
2016-07-26 10:37:29.709082 7fc49a49d700  1 -- 10.98.2.167:6789/0 --> mon.4 10.98.2.216:6789/0 -- mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02) v6 -- ?+0 0x34f9680
2016-07-26 10:37:29.709353 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.2 10.98.2.173:6789/0 4 ==== mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 610wl02 paxos( fc 1318755 lc 1319324 )) v6 ==== 845+0+0 (3613516349 0 0) 0x34fa080 con 0x33f1fa0
2016-07-26 10:37:29.709362 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 610wl02 paxos( fc 1318755 lc 1319324 )) v6
2016-07-26 10:37:29.709365 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe_reply mon.2 10.98.2.173:6789/0mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 610wl02 paxos( fc 1318755 lc 1319324 )) v6
2016-07-26 10:37:29.709372 7fc499a9c700 10 mon.60zxl02@1(probing) e5  monmap is e5: 5 mons at {60z0m02=10.98.2.166:6789/0,60zxl02=10.98.2.167:6789/0,610wl02=10.98.2.173:6789/0,615yl02=10.98.2.216:6789/0,618yl02=10.98.2.214:6789/0}
2016-07-26 10:37:29.709382 7fc499a9c700 10 mon.60zxl02@1(probing) e5  peer name is 610wl02
2016-07-26 10:37:29.709384 7fc499a9c700 10 mon.60zxl02@1(probing) e5  mon.610wl02 is outside the quorum
2016-07-26 10:37:29.709386 7fc499a9c700 10 mon.60zxl02@1(probing) e5  outside_quorum now 60zxl02,610wl02, need 3
2016-07-26 10:37:29.709387 7fc499a9c700 10 mon.60zxl02@1(probing) e5  that's not yet enough for a new quorum, waiting
2016-07-26 10:37:30.128282 7fc49e10f700  0 log_channel(audit) log [DBG] : from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch
2016-07-26 10:37:30.128285 7fc49e10f700  0 log_channel(audit) do_log log to syslog
2016-07-26 10:37:30.128300 7fc49e10f700  1 -- 10.98.2.167:6789/0 --> 10.98.2.167:6789/0 -- log(1 entries) v1 -- ?+0 0x3889440 con 0x33f11e0
2016-07-26 10:37:30.128321 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.1 10.98.2.167:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x3889440 con 0x33f11e0
2016-07-26 10:37:30.128339 7fc49e10f700  0 log_channel(audit) log [DBG] : from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished
2016-07-26 10:37:30.128341 7fc49e10f700  0 log_channel(audit) do_log log to syslog
2016-07-26 10:37:30.128352 7fc49e10f700  1 -- 10.98.2.167:6789/0 --> 10.98.2.167:6789/0 -- log(1 entries) v1 -- ?+0 0x388a640 con 0x33f11e0
2016-07-26 10:37:30.128361 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(logm 765975..766716) dispatch log(1 entries) v1 from mon.1 10.98.2.167:6789/0
2016-07-26 10:37:30.128366 7fc499a9c700  5 mon.60zxl02@1(probing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:37:30.128366 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:37:30.128369 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(logm 765975..766716)  waiting for paxos -> readable (v0)
2016-07-26 10:37:30.128371 7fc499a9c700  5 mon.60zxl02@1(probing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:37:30.128371 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:37:30.128375 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.1 10.98.2.167:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x388a640 con 0x33f11e0
2016-07-26 10:37:30.128380 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(logm 765975..766716) dispatch log(1 entries) v1 from mon.1 10.98.2.167:6789/0
2016-07-26 10:37:30.128383 7fc499a9c700  5 mon.60zxl02@1(probing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:37:30.128384 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:37:30.128390 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(logm 765975..766716)  waiting for paxos -> readable (v0)
2016-07-26 10:37:30.128392 7fc499a9c700  5 mon.60zxl02@1(probing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:37:30.128392 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:37:30.524743 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.2 10.98.2.173:6789/0 5 ==== mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 610wl02) v6 ==== 64+0+0 (3448912970 0 0) 0x34faa80 con 0x33f1fa0
2016-07-26 10:37:30.524749 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 610wl02) v6
2016-07-26 10:37:30.524817 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe_probe mon.2 10.98.2.173:6789/0mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 610wl02) v6 features 37154696925806591
2016-07-26 10:37:30.524824 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> 10.98.2.173:6789/0 -- mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02 paxos( fc 1318755 lc 1319324 )) v6 -- ?+0 0x34fa080 con 0x33f1fa0
2016-07-26 10:37:30.708801 7fc49a49d700  5 mon.60zxl02@1(probing) e5 waitlisting message auth(proto 0 35 bytes epoch 5) v1
2016-07-26 10:37:30.708806 7fc49a49d700  5 mon.60zxl02@1(probing) e5 discarding message auth(proto 0 31 bytes epoch 0) v1 and sending client elsewhere
2016-07-26 10:37:30.708810 7fc49a49d700  1 -- 10.98.2.167:6789/0 mark_down 0x33f3f40 -- pipe dne
2016-07-26 10:37:30.747564 7fc497592700  1 -- 10.98.2.167:6789/0 >> :/0 pipe(0x3870000 sd=18 :6789 s=0 pgs=0 cs=0 l=0 c=0x33f44c0).accept sd=18 10.98.2.216:58811/0
2016-07-26 10:37:30.747864 7fc497592700 10 mon.60zxl02@1(probing) e5 ms_verify_authorizer 10.98.2.216:6789/0 mon protocol 2
2016-07-26 10:37:30.747891 7fc497693700 10 mon.60zxl02@1(probing) e5 ms_get_authorizer for mon
2016-07-26 10:37:30.747964 7fc497592700  0 -- 10.98.2.167:6789/0 >> 10.98.2.216:6789/0 pipe(0x3870000 sd=18 :6789 s=0 pgs=0 cs=0 l=0 c=0x33f44c0).accept connect_seq 0 vs existing 0 state connecting
2016-07-26 10:37:30.748120 7fc499a9c700 10 mon.60zxl02@1(probing) e5 ms_handle_reset 0x33f44c0 10.98.2.216:6789/0
2016-07-26 10:37:30.787637 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.4 10.98.2.216:6789/0 1 ==== mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 ==== 64+0+0 (1877372914 0 0) 0x34faf80 con 0x33f1b80
2016-07-26 10:37:30.787645 7fc499a9c700 10 mon.60zxl02@1(probing) e5 do not have session, making new one
2016-07-26 10:37:30.787647 7fc499a9c700 10 mon.60zxl02@1(probing) e5 ms_dispatch new session MonSession: mon.4 10.98.2.216:6789/0 is open for mon.4 10.98.2.216:6789/0
2016-07-26 10:37:30.787650 7fc499a9c700  5 mon.60zxl02@1(probing) e5 setting monitor caps on this connection
2016-07-26 10:37:30.787652 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6
2016-07-26 10:37:30.787655 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe_probe mon.4 10.98.2.216:6789/0mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 features 37154696925806591
2016-07-26 10:37:30.787662 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> 10.98.2.216:6789/0 -- mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02 paxos( fc 1318755 lc 1319324 )) v6 -- ?+0 0x34faa80 con 0x33f1b80
2016-07-26 10:37:30.787824 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.4 10.98.2.216:6789/0 2 ==== mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02 paxos( fc 1318755 lc 1319323 )) v6 ==== 845+0+0 (1132774637 0 0) 0x34fa580 con 0x33f1b80
2016-07-26 10:37:30.787831 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02 paxos( fc 1318755 lc 1319323 )) v6
2016-07-26 10:37:30.787835 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe_reply mon.4 10.98.2.216:6789/0mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02 paxos( fc 1318755 lc 1319323 )) v6
2016-07-26 10:37:30.787838 7fc499a9c700 10 mon.60zxl02@1(probing) e5  monmap is e5: 5 mons at {60z0m02=10.98.2.166:6789/0,60zxl02=10.98.2.167:6789/0,610wl02=10.98.2.173:6789/0,615yl02=10.98.2.216:6789/0,618yl02=10.98.2.214:6789/0}
2016-07-26 10:37:30.787860 7fc499a9c700 10 mon.60zxl02@1(probing) e5  peer name is 615yl02
2016-07-26 10:37:30.787863 7fc499a9c700 10 mon.60zxl02@1(probing) e5  mon.615yl02 is outside the quorum
2016-07-26 10:37:30.787865 7fc499a9c700 10 mon.60zxl02@1(probing) e5  outside_quorum now 60zxl02,610wl02,615yl02, need 3
2016-07-26 10:37:30.787866 7fc499a9c700 10 mon.60zxl02@1(probing) e5  that's enough to form a new quorum, calling election
2016-07-26 10:37:30.787867 7fc499a9c700 10 mon.60zxl02@1(probing) e5 start_election
2016-07-26 10:37:30.787868 7fc499a9c700 10 mon.60zxl02@1(probing) e5 _reset
2016-07-26 10:37:30.787869 7fc499a9c700 10 mon.60zxl02@1(probing) e5 cancel_probe_timeout 0x371e9d0
2016-07-26 10:37:30.787871 7fc499a9c700 10 mon.60zxl02@1(probing) e5 timecheck_finish
2016-07-26 10:37:30.787873 7fc499a9c700 10 mon.60zxl02@1(probing) e5 scrub_reset
2016-07-26 10:37:30.787874 7fc499a9c700 10 mon.60zxl02@1(probing).paxos(paxos recovering c 1318755..1319324) restart -- canceling timeouts
2016-07-26 10:37:30.787876 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(pgmap 538057..538795) restart
2016-07-26 10:37:30.787878 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(mdsmap 1..1) restart
2016-07-26 10:37:30.787879 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(osdmap 1769..2433) restart
2016-07-26 10:37:30.787880 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(logm 765975..766716) restart
2016-07-26 10:37:30.787881 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(monmap 1..5) restart
2016-07-26 10:37:30.787883 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(auth 2251..2418) restart
2016-07-26 10:37:30.787884 7fc499a9c700 10 mon.60zxl02@1(electing) e5 cancel_probe_timeout (none scheduled)
2016-07-26 10:37:30.787889 7fc499a9c700  0 log_channel(cluster) log [INF] : mon.60zxl02 calling new monitor election
2016-07-26 10:37:30.787890 7fc499a9c700  0 log_channel(cluster) do_log log to syslog
2016-07-26 10:37:41.805386 7fc497794700  1 -- 10.98.2.167:6789/0 >> :/0 pipe(0x3632000 sd=14 :6789 s=0 pgs=0 cs=0 l=0 c=0x33f4360).accept sd=14 10.98.3.15:44675/0
2016-07-26 10:37:41.805489 7fc497794700 10 mon.60zxl02@1(electing) e5 ms_verify_authorizer 10.98.3.15:0/4187059021 client protocol 0
2016-07-26 10:38:01.710240 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> 10.98.2.167:6789/0 -- log(1 entries) v1 -- ?+0 0x388b3c0 con 0x33f11e0
2016-07-26 10:38:01.710251 7fc499a9c700  5 mon.60zxl02@1(electing).elector(0) start -- can i be leader?
2016-07-26 10:38:01.710315 7fc499a9c700  1 mon.60zxl02@1(electing).elector(11770) init, last seen epoch 11770
2016-07-26 10:38:01.710319 7fc499a9c700 10 mon.60zxl02@1(electing).elector(11770) bump_epoch 11770 to 11771
2016-07-26 10:38:01.738743 7fc499a9c700 10 mon.60zxl02@1(electing) e5 join_election
2016-07-26 10:38:01.738748 7fc499a9c700 10 mon.60zxl02@1(electing) e5 _reset
2016-07-26 10:38:01.738749 7fc499a9c700 10 mon.60zxl02@1(electing) e5 cancel_probe_timeout (none scheduled)
2016-07-26 10:38:01.738750 7fc499a9c700 10 mon.60zxl02@1(electing) e5 timecheck_finish
2016-07-26 10:38:01.738753 7fc499a9c700 10 mon.60zxl02@1(electing) e5 scrub_reset
2016-07-26 10:38:01.738754 7fc499a9c700 10 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) restart -- canceling timeouts
2016-07-26 10:38:01.738757 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(pgmap 538057..538795) restart
2016-07-26 10:38:01.738759 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(mdsmap 1..1) restart
2016-07-26 10:38:01.738760 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(osdmap 1769..2433) restart
2016-07-26 10:38:01.738762 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716) restart
2016-07-26 10:38:01.738763 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(monmap 1..5) restart
2016-07-26 10:38:01.738764 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(auth 2251..2418) restart
2016-07-26 10:38:01.738776 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> mon.0 10.98.2.166:6789/0 -- election(2f51a247-3155-4bcf-9aee-c6f6b2c5e2af propose 11771) v5 -- ?+0 0x34e18c0
2016-07-26 10:38:01.738791 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> mon.2 10.98.2.173:6789/0 -- election(2f51a247-3155-4bcf-9aee-c6f6b2c5e2af propose 11771) v5 -- ?+0 0x34e1e40
2016-07-26 10:38:01.738802 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> mon.3 10.98.2.214:6789/0 -- election(2f51a247-3155-4bcf-9aee-c6f6b2c5e2af propose 11771) v5 -- ?+0 0x34e1b80
2016-07-26 10:38:01.738811 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> mon.4 10.98.2.216:6789/0 -- election(2f51a247-3155-4bcf-9aee-c6f6b2c5e2af propose 11771) v5 -- ?+0 0x34e2680
2016-07-26 10:38:01.738825 7fc499a9c700 10 mon.60zxl02@1(electing) e5 ms_handle_reset 0x33f2ec0 10.98.3.18:0/1012640
2016-07-26 10:38:01.738830 7fc499a9c700 10 mon.60zxl02@1(electing) e5 ms_handle_reset 0x33f4360 10.98.3.15:0/4187059021
2016-07-26 10:38:01.738833 7fc49e10f700  0 log_channel(audit) log [DBG] : from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch
2016-07-26 10:38:01.738835 7fc49e10f700  0 log_channel(audit) do_log log to syslog
2016-07-26 10:38:01.738833 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.4 10.98.2.216:6789/0 3 ==== mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02 paxos( fc 1318755 lc 1319323 )) v6 ==== 845+0+0 (1132774637 0 0) 0x34f9680 con 0x33f1b80
2016-07-26 10:38:01.738853 7fc49e10f700  1 -- 10.98.2.167:6789/0 --> 10.98.2.167:6789/0 -- log(1 entries) v1 -- ?+0 0x388a880 con 0x33f11e0
2016-07-26 10:38:01.738890 7fc49e10f700  0 log_channel(audit) log [DBG] : from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished
2016-07-26 10:38:01.738892 7fc49e10f700  0 log_channel(audit) do_log log to syslog
2016-07-26 10:38:01.738901 7fc49e10f700  1 -- 10.98.2.167:6789/0 --> 10.98.2.167:6789/0 -- log(1 entries) v1 -- ?+0 0x388a1c0 con 0x33f11e0
2016-07-26 10:38:01.738915 7fc49a49d700  5 mon.60zxl02@1(electing) e5 discarding message auth(proto 0 35 bytes epoch 5) v1 and sending client elsewhere
2016-07-26 10:38:01.738922 7fc49a49d700  1 -- 10.98.2.167:6789/0 mark_down 0x33f2ec0 -- pipe dne
2016-07-26 10:38:01.738939 7fc499a9c700 10 mon.60zxl02@1(electing) e5 handle_probe mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02 paxos( fc 1318755 lc 1319323 )) v6
2016-07-26 10:38:01.738948 7fc499a9c700 10 mon.60zxl02@1(electing) e5 handle_probe_reply mon.4 10.98.2.216:6789/0mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02 paxos( fc 1318755 lc 1319323 )) v6
2016-07-26 10:38:01.738954 7fc499a9c700 10 mon.60zxl02@1(electing) e5  monmap is e5: 5 mons at {60z0m02=10.98.2.166:6789/0,60zxl02=10.98.2.167:6789/0,610wl02=10.98.2.173:6789/0,615yl02=10.98.2.216:6789/0,618yl02=10.98.2.214:6789/0}
2016-07-26 10:38:01.738966 7fc499a9c700 10 mon.60zxl02@1(electing) e5  peer name is 615yl02
2016-07-26 10:38:01.738972 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.1 10.98.2.167:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x388b3c0 con 0x33f11e0
2016-07-26 10:38:01.738977 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716) dispatch log(1 entries) v1 from mon.1 10.98.2.167:6789/0
2016-07-26 10:38:01.738982 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:01.738982 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:01.738987 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716)  waiting for paxos -> readable (v0)
2016-07-26 10:38:01.738988 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:01.738989 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:01.738993 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.4 10.98.2.216:6789/0 4 ==== mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02 paxos( fc 1318755 lc 1319323 )) v6 ==== 845+0+0 (1132774637 0 0) 0x34f9180 con 0x33f1b80
2016-07-26 10:38:01.738999 7fc499a9c700 10 mon.60zxl02@1(electing) e5 handle_probe mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02 paxos( fc 1318755 lc 1319323 )) v6
2016-07-26 10:38:01.739002 7fc499a9c700 10 mon.60zxl02@1(electing) e5 handle_probe_reply mon.4 10.98.2.216:6789/0mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02 paxos( fc 1318755 lc 1319323 )) v6
2016-07-26 10:38:01.739007 7fc499a9c700 10 mon.60zxl02@1(electing) e5  monmap is e5: 5 mons at {60z0m02=10.98.2.166:6789/0,60zxl02=10.98.2.167:6789/0,610wl02=10.98.2.173:6789/0,615yl02=10.98.2.216:6789/0,618yl02=10.98.2.214:6789/0}
2016-07-26 10:38:01.739015 7fc499a9c700 10 mon.60zxl02@1(electing) e5  peer name is 615yl02
2016-07-26 10:38:01.739020 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.1 10.98.2.167:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x388a880 con 0x33f11e0
2016-07-26 10:38:01.739024 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716) dispatch log(1 entries) v1 from mon.1 10.98.2.167:6789/0
2016-07-26 10:38:01.739027 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:01.739028 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:01.739034 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716)  waiting for paxos -> readable (v0)
2016-07-26 10:38:01.739035 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:01.739036 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:01.739039 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.1 10.98.2.167:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x388a1c0 con 0x33f11e0
2016-07-26 10:38:01.739043 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716) dispatch log(1 entries) v1 from mon.1 10.98.2.167:6789/0
2016-07-26 10:38:01.739046 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:01.739047 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:01.739050 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716)  waiting for paxos -> readable (v0)
2016-07-26 10:38:01.739051 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:01.739051 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:02.817824 7fc49e10f700  0 log_channel(audit) log [DBG] : from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch
2016-07-26 10:38:02.817826 7fc49e10f700  0 log_channel(audit) do_log log to syslog
2016-07-26 10:38:02.817840 7fc49e10f700  1 -- 10.98.2.167:6789/0 --> 10.98.2.167:6789/0 -- log(1 entries) v1 -- ?+0 0x388a400 con 0x33f11e0
2016-07-26 10:38:02.817859 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.1 10.98.2.167:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x388a400 con 0x33f11e0
2016-07-26 10:38:02.817876 7fc49e10f700  0 log_channel(audit) log [DBG] : from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished
2016-07-26 10:38:02.817879 7fc49e10f700  0 log_channel(audit) do_log log to syslog
2016-07-26 10:38:02.817888 7fc49e10f700  1 -- 10.98.2.167:6789/0 --> 10.98.2.167:6789/0 -- log(1 entries) v1 -- ?+0 0x388ba80 con 0x33f11e0
2016-07-26 10:38:02.817897 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716) dispatch log(1 entries) v1 from mon.1 10.98.2.167:6789/0
2016-07-26 10:38:02.817902 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:02.817903 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:02.817907 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716)  waiting for paxos -> readable (v0)
2016-07-26 10:38:02.817909 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:02.817909 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:02.817913 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.1 10.98.2.167:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x388ba80 con 0x33f11e0
2016-07-26 10:38:02.817918 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716) dispatch log(1 entries) v1 from mon.1 10.98.2.167:6789/0
2016-07-26 10:38:02.817921 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:02.817921 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:02.817924 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716)  waiting for paxos -> readable (v0)
2016-07-26 10:38:02.817926 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:02.817926 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:03.896706 7fc49e10f700  0 log_channel(audit) log [DBG] : from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch
2016-07-26 10:38:03.896708 7fc49e10f700  0 log_channel(audit) do_log log to syslog
2016-07-26 10:38:03.896722 7fc49e10f700  1 -- 10.98.2.167:6789/0 --> 10.98.2.167:6789/0 -- log(1 entries) v1 -- ?+0 0x3889f80 con 0x33f11e0
2016-07-26 10:38:03.896740 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.1 10.98.2.167:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x3889f80 con 0x33f11e0
2016-07-26 10:38:03.896757 7fc49e10f700  0 log_channel(audit) log [DBG] : from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished
2016-07-26 10:38:03.896759 7fc49e10f700  0 log_channel(audit) do_log log to syslog
2016-07-26 10:38:03.896768 7fc49e10f700  1 -- 10.98.2.167:6789/0 --> 10.98.2.167:6789/0 -- log(1 entries) v1 -- ?+0 0x388b600 con 0x33f11e0
2016-07-26 10:38:03.896776 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716) dispatch log(1 entries) v1 from mon.1 10.98.2.167:6789/0
2016-07-26 10:38:03.896781 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:03.896782 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:03.896787 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716)  waiting for paxos -> readable (v0)
2016-07-26 10:38:03.896788 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:03.896789 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:03.896793 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.1 10.98.2.167:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x388b600 con 0x33f11e0
2016-07-26 10:38:03.896798 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716) dispatch log(1 entries) v1 from mon.1 10.98.2.167:6789/0
2016-07-26 10:38:03.896801 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:03.896802 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:03.896805 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716)  waiting for paxos -> readable (v0)
2016-07-26 10:38:03.896806 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:03.896806 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:04.563217 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.2 10.98.2.173:6789/0 6 ==== election(2f51a247-3155-4bcf-9aee-c6f6b2c5e2af propose 11771) v5 ==== 841+0+0 (3418337519 0 0) 0x34e1e40 con 0x33f1fa0
2016-07-26 10:38:04.563244 7fc499a9c700  5 mon.60zxl02@1(electing).elector(11771) handle_propose from mon.2
2016-07-26 10:38:04.563246 7fc499a9c700 10 mon.60zxl02@1(electing).elector(11771) handle_propose required features 18416819765248, peer features 37154696925806591
2016-07-26 10:38:04.563538 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.2 10.98.2.173:6789/0 7 ==== election(2f51a247-3155-4bcf-9aee-c6f6b2c5e2af ack 11771) v5 ==== 26475+0+0 (515543919 0 0) 0x34e2940 con 0x33f1fa0
2016-07-26 10:38:04.563551 7fc499a9c700  5 mon.60zxl02@1(electing).elector(11771) handle_ack from mon.2
2016-07-26 10:38:04.563554 7fc499a9c700  5 mon.60zxl02@1(electing).elector(11771)  so far i have {1=37154696925806591,2=37154696925806591}
2016-07-26 10:38:04.974213 7fc49e10f700  0 log_channel(audit) log [DBG] : from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch
2016-07-26 10:38:04.974215 7fc49e10f700  0 log_channel(audit) do_log log to syslog
2016-07-26 10:38:04.974233 7fc49e10f700  1 -- 10.98.2.167:6789/0 --> 10.98.2.167:6789/0 -- log(1 entries) v1 -- ?+0 0x388b840 con 0x33f11e0
2016-07-26 10:38:04.974256 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.1 10.98.2.167:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x388b840 con 0x33f11e0
2016-07-26 10:38:04.974274 7fc49e10f700  0 log_channel(audit) log [DBG] : from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished
2016-07-26 10:38:04.974276 7fc49e10f700  0 log_channel(audit) do_log log to syslog
2016-07-26 10:38:04.974284 7fc49e10f700  1 -- 10.98.2.167:6789/0 --> 10.98.2.167:6789/0 -- log(1 entries) v1 -- ?+0 0x3888000 con 0x33f11e0
2016-07-26 10:38:04.974295 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716) dispatch log(1 entries) v1 from mon.1 10.98.2.167:6789/0
2016-07-26 10:38:04.974300 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:04.974300 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:04.974305 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716)  waiting for paxos -> readable (v0)
2016-07-26 10:38:04.974308 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:04.974308 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:04.974313 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.1 10.98.2.167:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x3888000 con 0x33f11e0
2016-07-26 10:38:04.974317 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716) dispatch log(1 entries) v1 from mon.1 10.98.2.167:6789/0
2016-07-26 10:38:04.974321 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:04.974321 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:04.974323 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716)  waiting for paxos -> readable (v0)
2016-07-26 10:38:04.974325 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:04.974325 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:06.052985 7fc49e10f700  0 log_channel(audit) log [DBG] : from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch
2016-07-26 10:38:06.052988 7fc49e10f700  0 log_channel(audit) do_log log to syslog
2016-07-26 10:38:06.053005 7fc49e10f700  1 -- 10.98.2.167:6789/0 --> 10.98.2.167:6789/0 -- log(1 entries) v1 -- ?+0 0x388af40 con 0x33f11e0
2016-07-26 10:38:06.053024 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.1 10.98.2.167:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x388af40 con 0x33f11e0
2016-07-26 10:38:06.053044 7fc49e10f700  0 log_channel(audit) log [DBG] : from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished
2016-07-26 10:38:06.053045 7fc49e10f700  0 log_channel(audit) do_log log to syslog
2016-07-26 10:38:06.053055 7fc49e10f700  1 -- 10.98.2.167:6789/0 --> 10.98.2.167:6789/0 -- log(1 entries) v1 -- ?+0 0x388ca40 con 0x33f11e0
2016-07-26 10:38:06.053064 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716) dispatch log(1 entries) v1 from mon.1 10.98.2.167:6789/0
2016-07-26 10:38:06.053069 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:06.053069 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:06.053074 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716)  waiting for paxos -> readable (v0)
2016-07-26 10:38:06.053077 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:06.053077 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:06.053082 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.1 10.98.2.167:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x388ca40 con 0x33f11e0
2016-07-26 10:38:06.053086 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716) dispatch log(1 entries) v1 from mon.1 10.98.2.167:6789/0
2016-07-26 10:38:06.053089 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:06.053090 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:06.053092 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716)  waiting for paxos -> readable (v0)
2016-07-26 10:38:06.053094 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:06.053094 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:06.738876 7fc49a49d700  5 mon.60zxl02@1(electing).elector(11771) election timer expired
2016-07-26 10:38:06.738882 7fc49a49d700  5 mon.60zxl02@1(electing).elector(11771) start -- can i be leader?
2016-07-26 10:38:06.738949 7fc49a49d700  1 mon.60zxl02@1(electing).elector(11771) init, last seen epoch 11771
2016-07-26 10:38:06.779070 7fc49a49d700  1 -- 10.98.2.167:6789/0 --> mon.0 10.98.2.166:6789/0 -- election(2f51a247-3155-4bcf-9aee-c6f6b2c5e2af propose 11771) v5 -- ?+0 0x34e2c00
2016-07-26 10:38:06.779086 7fc49a49d700  1 -- 10.98.2.167:6789/0 --> mon.2 10.98.2.173:6789/0 -- election(2f51a247-3155-4bcf-9aee-c6f6b2c5e2af propose 11771) v5 -- ?+0 0x34e3180
2016-07-26 10:38:06.779097 7fc49a49d700  1 -- 10.98.2.167:6789/0 --> mon.3 10.98.2.214:6789/0 -- election(2f51a247-3155-4bcf-9aee-c6f6b2c5e2af propose 11771) v5 -- ?+0 0x34e2ec0
2016-07-26 10:38:06.779106 7fc49a49d700  1 -- 10.98.2.167:6789/0 --> mon.4 10.98.2.216:6789/0 -- election(2f51a247-3155-4bcf-9aee-c6f6b2c5e2af propose 11771) v5 -- ?+0 0x34e39c0
2016-07-26 10:38:06.779501 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.2 10.98.2.173:6789/0 8 ==== election(2f51a247-3155-4bcf-9aee-c6f6b2c5e2af ack 11771) v5 ==== 26475+0+0 (515543919 0 0) 0x34e3180 con 0x33f1fa0
2016-07-26 10:38:06.779523 7fc499a9c700  5 mon.60zxl02@1(electing).elector(11771) handle_ack from mon.2
2016-07-26 10:38:06.779526 7fc499a9c700  5 mon.60zxl02@1(electing).elector(11771)  so far i have {1=37154696925806591,2=37154696925806591}
2016-07-26 10:38:06.813933 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.4 10.98.2.216:6789/0 5 ==== election(2f51a247-3155-4bcf-9aee-c6f6b2c5e2af propose 11769) v5 ==== 841+0+0 (136491532 0 0) 0x34e39c0 con 0x33f1b80
2016-07-26 10:38:06.813956 7fc499a9c700  5 mon.60zxl02@1(electing).elector(11771) handle_propose from mon.4
2016-07-26 10:38:06.813958 7fc499a9c700 10 mon.60zxl02@1(electing).elector(11771) handle_propose required features 18416819765248, peer features 37154696925806591
2016-07-26 10:38:06.813960 7fc499a9c700  5 mon.60zxl02@1(electing).elector(11771)  ignoring old propose
2016-07-26 10:38:06.826886 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.4 10.98.2.216:6789/0 6 ==== election(2f51a247-3155-4bcf-9aee-c6f6b2c5e2af ack 11771) v5 ==== 26475+0+0 (515543919 0 0) 0x34e2680 con 0x33f1b80
2016-07-26 10:38:06.826900 7fc499a9c700  5 mon.60zxl02@1(electing).elector(11771) handle_ack from mon.4
2016-07-26 10:38:06.826902 7fc499a9c700  5 mon.60zxl02@1(electing).elector(11771)  so far i have {1=37154696925806591,2=37154696925806591,4=37154696925806591}
2016-07-26 10:38:06.827027 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.4 10.98.2.216:6789/0 7 ==== election(2f51a247-3155-4bcf-9aee-c6f6b2c5e2af ack 11771) v5 ==== 26475+0+0 (515543919 0 0) 0x34e1e40 con 0x33f1b80
2016-07-26 10:38:06.827039 7fc499a9c700  5 mon.60zxl02@1(electing).elector(11771) handle_ack from mon.4
2016-07-26 10:38:06.827041 7fc499a9c700  5 mon.60zxl02@1(electing).elector(11771)  so far i have {1=37154696925806591,2=37154696925806591,4=37154696925806591}
2016-07-26 10:38:07.131228 7fc49e10f700  0 log_channel(audit) log [DBG] : from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch
2016-07-26 10:38:07.131231 7fc49e10f700  0 log_channel(audit) do_log log to syslog
2016-07-26 10:38:07.131247 7fc49e10f700  1 -- 10.98.2.167:6789/0 --> 10.98.2.167:6789/0 -- log(1 entries) v1 -- ?+0 0x3888240 con 0x33f11e0
2016-07-26 10:38:07.131268 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.1 10.98.2.167:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x3888240 con 0x33f11e0
2016-07-26 10:38:07.131285 7fc49e10f700  0 log_channel(audit) log [DBG] : from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished
2016-07-26 10:38:07.131287 7fc49e10f700  0 log_channel(audit) do_log log to syslog
2016-07-26 10:38:07.131300 7fc49e10f700  1 -- 10.98.2.167:6789/0 --> 10.98.2.167:6789/0 -- log(1 entries) v1 -- ?+0 0x388c5c0 con 0x33f11e0
2016-07-26 10:38:07.131311 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716) dispatch log(1 entries) v1 from mon.1 10.98.2.167:6789/0
2016-07-26 10:38:07.131317 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:07.131318 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:07.131323 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716)  waiting for paxos -> readable (v0)
2016-07-26 10:38:07.131324 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:07.131325 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:07.131331 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.1 10.98.2.167:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x388c5c0 con 0x33f11e0
2016-07-26 10:38:07.131336 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716) dispatch log(1 entries) v1 from mon.1 10.98.2.167:6789/0
2016-07-26 10:38:07.131339 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:07.131340 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:07.131342 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716)  waiting for paxos -> readable (v0)
2016-07-26 10:38:07.131343 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:07.131344 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:08.209734 7fc49e10f700  0 log_channel(audit) log [DBG] : from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch
2016-07-26 10:38:08.209737 7fc49e10f700  0 log_channel(audit) do_log log to syslog
2016-07-26 10:38:08.209754 7fc49e10f700  1 -- 10.98.2.167:6789/0 --> 10.98.2.167:6789/0 -- log(1 entries) v1 -- ?+0 0x388c800 con 0x33f11e0
2016-07-26 10:38:08.209773 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.1 10.98.2.167:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x388c800 con 0x33f11e0
2016-07-26 10:38:08.209791 7fc49e10f700  0 log_channel(audit) log [DBG] : from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished
2016-07-26 10:38:08.209792 7fc49e10f700  0 log_channel(audit) do_log log to syslog
2016-07-26 10:38:08.209804 7fc49e10f700  1 -- 10.98.2.167:6789/0 --> 10.98.2.167:6789/0 -- log(1 entries) v1 -- ?+0 0x388c140 con 0x33f11e0
2016-07-26 10:38:08.209812 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716) dispatch log(1 entries) v1 from mon.1 10.98.2.167:6789/0
2016-07-26 10:38:08.209817 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:08.209820 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:08.209825 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716)  waiting for paxos -> readable (v0)
2016-07-26 10:38:08.209827 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:08.209827 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:08.209831 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.1 10.98.2.167:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x388c140 con 0x33f11e0
2016-07-26 10:38:08.209836 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716) dispatch log(1 entries) v1 from mon.1 10.98.2.167:6789/0
2016-07-26 10:38:08.209839 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:08.209839 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:08.209842 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716)  waiting for paxos -> readable (v0)
2016-07-26 10:38:08.209843 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:08.209844 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:09.288152 7fc49e10f700  0 log_channel(audit) log [DBG] : from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch
2016-07-26 10:38:09.288154 7fc49e10f700  0 log_channel(audit) do_log log to syslog
2016-07-26 10:38:09.288169 7fc49e10f700  1 -- 10.98.2.167:6789/0 --> 10.98.2.167:6789/0 -- log(1 entries) v1 -- ?+0 0x388c380 con 0x33f11e0
2016-07-26 10:38:09.288191 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.1 10.98.2.167:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x388c380 con 0x33f11e0
2016-07-26 10:38:09.288207 7fc49e10f700  0 log_channel(audit) log [DBG] : from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished
2016-07-26 10:38:09.288209 7fc49e10f700  0 log_channel(audit) do_log log to syslog
2016-07-26 10:38:09.288218 7fc49e10f700  1 -- 10.98.2.167:6789/0 --> 10.98.2.167:6789/0 -- log(1 entries) v1 -- ?+0 0x388bcc0 con 0x33f11e0
2016-07-26 10:38:09.288228 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716) dispatch log(1 entries) v1 from mon.1 10.98.2.167:6789/0
2016-07-26 10:38:09.288233 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:09.288234 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:09.288239 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716)  waiting for paxos -> readable (v0)
2016-07-26 10:38:09.288241 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:09.288241 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:09.288247 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.1 10.98.2.167:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x388bcc0 con 0x33f11e0
2016-07-26 10:38:09.288252 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716) dispatch log(1 entries) v1 from mon.1 10.98.2.167:6789/0
2016-07-26 10:38:09.288255 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:09.288255 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:09.288258 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716)  waiting for paxos -> readable (v0)
2016-07-26 10:38:09.288259 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:09.288259 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:10.366249 7fc49e10f700  0 log_channel(audit) log [DBG] : from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch
2016-07-26 10:38:10.366251 7fc49e10f700  0 log_channel(audit) do_log log to syslog
2016-07-26 10:38:10.366265 7fc49e10f700  1 -- 10.98.2.167:6789/0 --> 10.98.2.167:6789/0 -- log(1 entries) v1 -- ?+0 0x388bf00 con 0x33f11e0
2016-07-26 10:38:10.366286 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.1 10.98.2.167:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x388bf00 con 0x33f11e0
2016-07-26 10:38:10.366303 7fc49e10f700  0 log_channel(audit) log [DBG] : from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished
2016-07-26 10:38:10.366304 7fc49e10f700  0 log_channel(audit) do_log log to syslog
2016-07-26 10:38:10.366313 7fc49e10f700  1 -- 10.98.2.167:6789/0 --> 10.98.2.167:6789/0 -- log(1 entries) v1 -- ?+0 0x388da00 con 0x33f11e0
2016-07-26 10:38:10.366334 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716) dispatch log(1 entries) v1 from mon.1 10.98.2.167:6789/0
2016-07-26 10:38:10.366339 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:10.366340 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:10.366344 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716)  waiting for paxos -> readable (v0)
2016-07-26 10:38:10.366346 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:10.366346 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:10.366351 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.1 10.98.2.167:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x388da00 con 0x33f11e0
2016-07-26 10:38:10.366355 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716) dispatch log(1 entries) v1 from mon.1 10.98.2.167:6789/0
2016-07-26 10:38:10.366359 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:10.366359 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:10.366362 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716)  waiting for paxos -> readable (v0)
2016-07-26 10:38:10.366363 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:10.366363 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:11.444456 7fc49e10f700  0 log_channel(audit) log [DBG] : from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch
2016-07-26 10:38:11.444458 7fc49e10f700  0 log_channel(audit) do_log log to syslog
2016-07-26 10:38:11.444471 7fc49e10f700  1 -- 10.98.2.167:6789/0 --> 10.98.2.167:6789/0 -- log(1 entries) v1 -- ?+0 0x388dc40 con 0x33f11e0
2016-07-26 10:38:11.444489 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.1 10.98.2.167:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x388dc40 con 0x33f11e0
2016-07-26 10:38:11.444507 7fc49e10f700  0 log_channel(audit) log [DBG] : from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished
2016-07-26 10:38:11.444510 7fc49e10f700  0 log_channel(audit) do_log log to syslog
2016-07-26 10:38:11.444520 7fc49e10f700  1 -- 10.98.2.167:6789/0 --> 10.98.2.167:6789/0 -- log(1 entries) v1 -- ?+0 0x388d580 con 0x33f11e0
2016-07-26 10:38:11.444528 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716) dispatch log(1 entries) v1 from mon.1 10.98.2.167:6789/0
2016-07-26 10:38:11.444533 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:11.444534 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:11.444538 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716)  waiting for paxos -> readable (v0)
2016-07-26 10:38:11.444540 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:11.444541 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:11.444547 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.1 10.98.2.167:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x388d580 con 0x33f11e0
2016-07-26 10:38:11.444551 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716) dispatch log(1 entries) v1 from mon.1 10.98.2.167:6789/0
2016-07-26 10:38:11.444555 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:11.444556 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:11.444558 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716)  waiting for paxos -> readable (v0)
2016-07-26 10:38:11.444559 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:38:11.444560 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:38:11.779245 7fc49a49d700  5 mon.60zxl02@1(electing).elector(11771) election timer expired
2016-07-26 10:38:11.779252 7fc49a49d700 10 mon.60zxl02@1(electing).elector(11771) bump_epoch 11771 to 11772
2016-07-26 10:38:11.802015 7fc49a49d700 10 mon.60zxl02@1(electing) e5 join_election
2016-07-26 10:38:11.802021 7fc49a49d700 10 mon.60zxl02@1(electing) e5 _reset
2016-07-26 10:38:11.802022 7fc49a49d700 10 mon.60zxl02@1(electing) e5 cancel_probe_timeout (none scheduled)
2016-07-26 10:38:11.802023 7fc49a49d700 10 mon.60zxl02@1(electing) e5 timecheck_finish
2016-07-26 10:38:11.802026 7fc49a49d700 10 mon.60zxl02@1(electing) e5 scrub_reset
2016-07-26 10:38:11.802027 7fc49a49d700 10 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) restart -- canceling timeouts
2016-07-26 10:38:11.802031 7fc49a49d700 10 mon.60zxl02@1(electing).paxosservice(pgmap 538057..538795) restart
2016-07-26 10:38:11.802034 7fc49a49d700 10 mon.60zxl02@1(electing).paxosservice(mdsmap 1..1) restart
2016-07-26 10:38:11.802035 7fc49a49d700 10 mon.60zxl02@1(electing).paxosservice(osdmap 1769..2433) restart
2016-07-26 10:38:11.802037 7fc49a49d700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716) restart
2016-07-26 10:38:11.802038 7fc49a49d700 10 mon.60zxl02@1(electing).paxosservice(monmap 1..5) restart
2016-07-26 10:38:11.802040 7fc49a49d700 10 mon.60zxl02@1(electing).paxosservice(auth 2251..2418) restart
2016-07-26 10:38:11.802053 7fc49a49d700  1 -- 10.98.2.167:6789/0 --> mon.2 10.98.2.173:6789/0 -- election(2f51a247-3155-4bcf-9aee-c6f6b2c5e2af victory 11772) v5 -- ?+0 0x34e3700
2016-07-26 10:38:11.802069 7fc49a49d700  1 -- 10.98.2.167:6789/0 --> mon.4 10.98.2.216:6789/0 -- election(2f51a247-3155-4bcf-9aee-c6f6b2c5e2af victory 11772) v5 -- ?+0 0x34e3440
2016-07-26 10:38:11.802079 7fc49a49d700 10 mon.60zxl02@1(electing) e5 win_election epoch 11772 quorum 1,2,4 features 37154696925806591
2016-07-26 10:38:11.802086 7fc49a49d700  0 log_channel(cluster) log [INF] : mon.60zxl02@1 won leader election with quorum 1,2,4
2016-07-26 10:38:11.802087 7fc49a49d700  0 log_channel(cluster) do_log log to syslog
2016-07-26 10:38:11.808072 7fc497794700  1 -- 10.98.2.167:6789/0 >> :/0 pipe(0x362d800 sd=14 :6789 s=0 pgs=0 cs=0 l=0 c=0x33f40a0).accept sd=14 10.98.3.15:44730/0
2016-07-26 10:38:11.808210 7fc497794700 10 mon.60zxl02@1(leader) e5 ms_verify_authorizer 10.98.3.15:0/4187059021 client protocol 0
2016-07-26 10:38:11.808417 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== client.? 10.98.3.15:0/4187059021 1 ==== auth(proto 0 31 bytes epoch 0) v1 ==== 61+0+0 (535495083 0 0) 0x388e300 con 0x33f40a0
2016-07-26 10:38:28.708416 7fc497b98700  0 -- 10.98.2.167:6789/0 >> 10.98.2.214:6789/0 pipe(0x37a8000 sd=20 :0 s=1 pgs=0 cs=0 l=0 c=0x33f1ce0).fault
2016-07-26 10:38:32.810085 7fc497794700  1 -- 10.98.2.167:6789/0 >> :/0 pipe(0x3624800 sd=20 :6789 s=0 pgs=0 cs=0 l=0 c=0x33f4780).accept sd=20 10.98.3.15:44824/0
2016-07-26 10:38:32.810163 7fc497794700 10 mon.60zxl02@1(leader) e5 ms_verify_authorizer 10.98.3.15:0/4187059021 client protocol 0
2016-07-26 10:38:37.711864 7fc49a49d700  1 -- 10.98.2.167:6789/0 --> 10.98.2.167:6789/0 -- log(1 entries) v1 -- ?+0 0x388de80 con 0x33f11e0
2016-07-26 10:38:37.711876 7fc49a49d700 10 mon.60zxl02@1(leader).paxos(paxos recovering c 1318755..1319324) leader_init -- starting paxos recovery
2016-07-26 10:38:37.739541 7fc49a49d700 10 mon.60zxl02@1(leader).paxos(paxos recovering c 1318755..1319324) get_new_proposal_number = 470401
2016-07-26 10:38:37.739548 7fc49a49d700 10 mon.60zxl02@1(leader).paxos(paxos recovering c 1318755..1319324) collect with pn 470401
2016-07-26 10:38:37.739554 7fc49a49d700  1 -- 10.98.2.167:6789/0 --> mon.2 10.98.2.173:6789/0 -- paxos(collect lc 1319324 fc 1318755 pn 470401 opn 0) v3 -- ?+0 0x34fa800
2016-07-26 10:38:37.739566 7fc49a49d700  1 -- 10.98.2.167:6789/0 --> mon.4 10.98.2.216:6789/0 -- paxos(collect lc 1319324 fc 1318755 pn 470401 opn 0) v3 -- ?+0 0x34fcd80
2016-07-26 10:38:37.739573 7fc49a49d700 10 mon.60zxl02@1(leader).paxosservice(monmap 1..5) election_finished
2016-07-26 10:38:37.739576 7fc49a49d700 10 mon.60zxl02@1(leader).paxosservice(monmap 1..5) _active - not active
2016-07-26 10:38:37.739577 7fc49a49d700 10 mon.60zxl02@1(leader).paxosservice(pgmap 538057..538795) election_finished
2016-07-26 10:38:37.739578 7fc49a49d700 10 mon.60zxl02@1(leader).paxosservice(pgmap 538057..538795) _active - not active
2016-07-26 10:38:37.739579 7fc49a49d700 10 mon.60zxl02@1(leader).paxosservice(mdsmap 1..1) election_finished
2016-07-26 10:38:37.739580 7fc49a49d700 10 mon.60zxl02@1(leader).paxosservice(mdsmap 1..1) _active - not active
2016-07-26 10:38:37.739582 7fc49a49d700 10 mon.60zxl02@1(leader).paxosservice(osdmap 1769..2433) election_finished
2016-07-26 10:38:37.739583 7fc49a49d700 10 mon.60zxl02@1(leader).paxosservice(osdmap 1769..2433) _active - not active
2016-07-26 10:38:37.739584 7fc49a49d700 10 mon.60zxl02@1(leader).paxosservice(logm 765975..766716) election_finished
2016-07-26 10:38:37.739585 7fc49a49d700 10 mon.60zxl02@1(leader).paxosservice(logm 765975..766716) _active - not active
2016-07-26 10:38:37.739586 7fc49a49d700 10 mon.60zxl02@1(leader).paxosservice(auth 2251..2418) election_finished
2016-07-26 10:38:37.739587 7fc49a49d700 10 mon.60zxl02@1(leader).paxosservice(auth 2251..2418) _active - not active
2016-07-26 10:38:37.739588 7fc49a49d700 10 mon.60zxl02@1(leader).data_health(11772) start_epoch epoch 11772
2016-07-26 10:38:37.739599 7fc49a49d700 10 mon.60zxl02@1(leader) e5 timecheck_finish
2016-07-26 10:38:37.739602 7fc49a49d700 10 mon.60zxl02@1(leader) e5 resend_routed_requests
2016-07-26 10:38:37.739604 7fc49a49d700 10 mon.60zxl02@1(leader) e5 register_cluster_logger
2016-07-26 10:38:37.739608 7fc49a49d700 10 mon.60zxl02@1(leader) e5 timecheck_start
2016-07-26 10:38:37.739610 7fc49a49d700 10 mon.60zxl02@1(leader) e5 timecheck_start_round curr 0
2016-07-26 10:38:37.739611 7fc49a49d700 10 mon.60zxl02@1(leader) e5 timecheck_start_round new 1
2016-07-26 10:38:37.739612 7fc49a49d700 10 mon.60zxl02@1(leader) e5 timecheck
2016-07-26 10:38:37.739613 7fc49a49d700 10 mon.60zxl02@1(leader) e5 timecheck start timecheck epoch 11772 round 1
2016-07-26 10:38:37.739617 7fc49a49d700 10 mon.60zxl02@1(leader) e5 timecheck send time_check( ping e 11772 r 1 ) v1 to mon.2 10.98.2.173:6789/0
2016-07-26 10:38:37.739621 7fc49a49d700  1 -- 10.98.2.167:6789/0 --> mon.2 10.98.2.173:6789/0 -- time_check( ping e 11772 r 1 ) v1 -- ?+0 0x388e0c0
2016-07-26 10:38:37.739629 7fc49a49d700 10 mon.60zxl02@1(leader) e5 timecheck send time_check( ping e 11772 r 1 ) v1 to mon.4 10.98.2.216:6789/0
2016-07-26 10:38:37.739632 7fc49a49d700  1 -- 10.98.2.167:6789/0 --> mon.4 10.98.2.216:6789/0 -- time_check( ping e 11772 r 1 ) v1 -- ?+0 0x388e9c0
2016-07-26 10:38:37.739637 7fc49a49d700 10 mon.60zxl02@1(leader) e5 timecheck_start_round setting up next event
2016-07-26 10:38:37.739640 7fc49a49d700 10 mon.60zxl02@1(leader) e5 do_health_to_clog_interval
2016-07-26 10:38:37.739642 7fc49a49d700 10 mon.60zxl02@1(leader) e5 do_health_to_clog (force)
2016-07-26 10:38:37.742176 7fc49a49d700 10 mon.60zxl02@1(leader).data_health(11772) get_health
2016-07-26 10:38:37.742190 7fc49a49d700  0 log_channel(cluster) log [INF] : HEALTH_WARN; 17 pgs degraded; 4 pgs down; 883 pgs peering; 1516 pgs stale; 17 pgs stuck degraded; 900 pgs stuck inactive; 1516 pgs stuck stale; 900 pgs stuck unclean; 17 pgs stuck undersized; 17 pgs undersized; recovery 14/2367 objects degraded (0.591%); too many PGs per OSD (316 > max 300); 2/19 in osds are down; 2 mons down, quorum 1,2,4 60zxl02,610wl02,615yl02
2016-07-26 10:38:37.742193 7fc49a49d700  0 log_channel(cluster) do_log log to syslog
2016-07-26 10:38:41.810862 7fc497794700  1 -- 10.98.2.167:6789/0 >> :/0 pipe(0x3632000 sd=20 :6789 s=0 pgs=0 cs=0 l=0 c=0x33f2c00).accept sd=20 10.98.3.15:44841/0
2016-07-26 10:38:41.810954 7fc497794700 10 mon.60zxl02@1(leader) e5 ms_verify_authorizer 10.98.3.15:0/4187059021 client protocol 0
2016-07-26 10:38:50.684225 7fc497794700  1 -- 10.98.2.167:6789/0 >> :/0 pipe(0x362d800 sd=20 :6789 s=0 pgs=0 cs=0 l=0 c=0x33f3c80).accept sd=20 10.98.3.15:44857/0
2016-07-26 10:38:50.684346 7fc497794700 10 mon.60zxl02@1(leader) e5 ms_verify_authorizer 10.98.3.15:0/1020545 client protocol 0
2016-07-26 10:38:56.684810 7fc497794700  1 -- 10.98.2.167:6789/0 >> :/0 pipe(0x3624800 sd=20 :6789 s=0 pgs=0 cs=0 l=0 c=0x33f4620).accept sd=20 10.98.3.15:44863/0
2016-07-26 10:38:56.684930 7fc497794700 10 mon.60zxl02@1(leader) e5 ms_verify_authorizer 10.98.3.15:0/1020545 client protocol 0
2016-07-26 10:38:59.812419 7fc497794700  1 -- 10.98.2.167:6789/0 >> :/0 pipe(0x3632000 sd=20 :6789 s=0 pgs=0 cs=0 l=0 c=0x33f39c0).accept sd=20 10.98.3.15:44866/0
2016-07-26 10:38:59.812534 7fc497794700 10 mon.60zxl02@1(leader) e5 ms_verify_authorizer 10.98.3.15:0/4187059021 client protocol 0
2016-07-26 10:39:02.685329 7fc497491700  1 -- 10.98.2.167:6789/0 >> :/0 pipe(0x362d800 sd=21 :6789 s=0 pgs=0 cs=0 l=0 c=0x33f44c0).accept sd=21 10.98.3.15:44869/0
2016-07-26 10:39:02.685430 7fc497491700 10 mon.60zxl02@1(leader) e5 ms_verify_authorizer 10.98.3.15:0/1020545 client protocol 0
2016-07-26 10:39:04.857076 7fc497794700  1 -- 10.98.2.167:6789/0 >> :/0 pipe(0x3624800 sd=20 :6789 s=0 pgs=0 cs=0 l=0 c=0x33f2ec0).accept sd=20 10.98.3.18:57079/0
2016-07-26 10:39:04.857187 7fc497794700 10 mon.60zxl02@1(leader) e5 ms_verify_authorizer 10.98.3.18:0/1012640 client protocol 0
2016-07-26 10:39:05.812970 7fc497491700  1 -- 10.98.2.167:6789/0 >> :/0 pipe(0x37b1000 sd=21 :6789 s=0 pgs=0 cs=0 l=0 c=0x33f3f40).accept sd=21 10.98.3.15:44873/0
2016-07-26 10:39:05.813071 7fc497491700 10 mon.60zxl02@1(leader) e5 ms_verify_authorizer 10.98.3.15:0/4187059021 client protocol 0
2016-07-26 10:39:07.713576 7fc49a49d700  1 -- 10.98.2.167:6789/0 --> 10.98.2.167:6789/0 -- log(1 entries) v1 -- ?+0 0x39786c0 con 0x33f11e0
2016-07-26 10:39:07.713599 7fc499a9c700 10 mon.60zxl02@1(leader) e5 do not have session, making new one
2016-07-26 10:39:07.713611 7fc499a9c700 10 mon.60zxl02@1(leader) e5 ms_dispatch new session MonSession: client.? 10.98.3.15:0/4187059021 is open for client.? 10.98.3.15:0/4187059021
2016-07-26 10:39:07.713619 7fc499a9c700 10 mon.60zxl02@1(leader) e5 setting timeout on session
2016-07-26 10:39:07.713622 7fc499a9c700 10 mon.60zxl02@1(leader).paxosservice(auth 2251..2418) dispatch auth(proto 0 31 bytes epoch 0) v1 from client.? 10.98.3.15:0/4187059021
2016-07-26 10:39:07.713626 7fc499a9c700 10 mon.60zxl02@1(leader).paxosservice(auth 2251..2418)  discarding message from disconnected client client.? 10.98.3.15:0/4187059021 auth(proto 0 31 bytes epoch 0) v1
2016-07-26 10:39:07.713635 7fc499a9c700 10 mon.60zxl02@1(leader) e5 ms_handle_reset 0x33f40a0 10.98.3.15:0/4187059021
2016-07-26 10:39:07.713647 7fc49e10f700  0 log_channel(audit) log [DBG] : from='admin socket' entity='admin socket' cmd='mon_status' args=[]: dispatch
2016-07-26 10:39:07.713650 7fc49e10f700  0 log_channel(audit) do_log log to syslog
2016-07-26 10:39:07.713668 7fc49e10f700  1 -- 10.98.2.167:6789/0 --> 10.98.2.167:6789/0 -- log(1 entries) v1 -- ?+0 0x388d7c0 con 0x33f11e0
2016-07-26 10:39:07.713711 7fc49e10f700  0 log_channel(audit) log [DBG] : from='admin socket' entity='admin socket' cmd=mon_status args=[]: finished
2016-07-26 10:39:07.713712 7fc49e10f700  0 log_channel(audit) do_log log to syslog
2016-07-26 10:39:07.713721 7fc49e10f700  1 -- 10.98.2.167:6789/0 --> 10.98.2.167:6789/0 -- log(1 entries) v1 -- ?+0 0x388d100 con 0x33f11e0
2016-07-26 10:39:07.713734 7fc49a49d700 10 mon.60zxl02@1(leader).data_health(11772) service_tick
2016-07-26 10:39:07.713746 7fc49a49d700  0 mon.60zxl02@1(leader).data_health(11772) update_stats avail 94% total 825 GB, used 3538 MB, avail 779 GB
2016-07-26 10:39:07.713873 7fc49a49d700 10 mon.60zxl02@1(leader).data_health(11772) share_stats
2016-07-26 10:39:07.713878 7fc49a49d700  1 -- 10.98.2.167:6789/0 --> mon.2 10.98.2.173:6789/0 -- mon_health( service 1 op tell e 0 r 0 ) v1 -- ?+0 0x3978900
2016-07-26 10:39:07.713889 7fc49a49d700  1 -- 10.98.2.167:6789/0 --> mon.4 10.98.2.216:6789/0 -- mon_health( service 1 op tell e 0 r 0 ) v1 -- ?+0 0x3978b40
2016-07-26 10:39:07.713897 7fc49a49d700  1 mon.60zxl02@1(leader).paxos(paxos recovering c 1318755..1319324) collect timeout, calling fresh election
2016-07-26 10:39:07.713900 7fc49a49d700 10 mon.60zxl02@1(leader) e5 bootstrap
2016-07-26 10:39:07.713901 7fc49a49d700 10 mon.60zxl02@1(leader) e5 sync_reset_requester
2016-07-26 10:39:07.713903 7fc49a49d700 10 mon.60zxl02@1(leader) e5 unregister_cluster_logger
2016-07-26 10:39:07.713904 7fc49a49d700 10 mon.60zxl02@1(leader) e5 cancel_probe_timeout (none scheduled)
2016-07-26 10:39:07.713906 7fc49a49d700 10 mon.60zxl02@1(probing) e5 _reset
2016-07-26 10:39:07.713907 7fc49a49d700 10 mon.60zxl02@1(probing) e5 cancel_probe_timeout (none scheduled)
2016-07-26 10:39:07.713908 7fc49a49d700 10 mon.60zxl02@1(probing) e5 timecheck_finish
2016-07-26 10:39:07.713911 7fc49a49d700 10 mon.60zxl02@1(probing) e5 scrub_reset
2016-07-26 10:39:07.713913 7fc49a49d700 10 mon.60zxl02@1(probing).paxos(paxos recovering c 1318755..1319324) restart -- canceling timeouts
2016-07-26 10:39:07.713921 7fc49a49d700 10 mon.60zxl02@1(probing).paxosservice(pgmap 538057..538795) restart
2016-07-26 10:39:07.713923 7fc49a49d700 10 mon.60zxl02@1(probing).paxosservice(mdsmap 1..1) restart
2016-07-26 10:39:07.713924 7fc49a49d700 10 mon.60zxl02@1(probing).paxosservice(osdmap 1769..2433) restart
2016-07-26 10:39:07.713926 7fc49a49d700 10 mon.60zxl02@1(probing).paxosservice(logm 765975..766716) restart
2016-07-26 10:39:07.713927 7fc49a49d700 10 mon.60zxl02@1(probing).paxosservice(monmap 1..5) restart
2016-07-26 10:39:07.713928 7fc49a49d700 10 mon.60zxl02@1(probing).paxosservice(auth 2251..2418) restart
2016-07-26 10:39:07.713929 7fc49a49d700 10 mon.60zxl02@1(probing) e5 cancel_probe_timeout (none scheduled)
2016-07-26 10:39:07.713931 7fc49a49d700 10 mon.60zxl02@1(probing) e5 reset_probe_timeout 0x371f320 after 2 seconds
2016-07-26 10:39:07.713936 7fc49a49d700 10 mon.60zxl02@1(probing) e5 probing other monitors
2016-07-26 10:39:07.713938 7fc49a49d700  1 -- 10.98.2.167:6789/0 --> mon.0 10.98.2.166:6789/0 -- mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02) v6 -- ?+0 0x34fc380
2016-07-26 10:39:07.713946 7fc49a49d700  1 -- 10.98.2.167:6789/0 --> mon.2 10.98.2.173:6789/0 -- mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02) v6 -- ?+0 0x34ffd00
2016-07-26 10:39:07.713954 7fc49a49d700  1 -- 10.98.2.167:6789/0 --> mon.3 10.98.2.214:6789/0 -- mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02) v6 -- ?+0 0x34ffa80
2016-07-26 10:39:07.713959 7fc49a49d700  1 -- 10.98.2.167:6789/0 --> mon.4 10.98.2.216:6789/0 -- mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02) v6 -- ?+0 0x34ff800
2016-07-26 10:39:07.713970 7fc499a9c700 10 mon.60zxl02@1(probing) e5 reset/close on session client.? 10.98.3.15:0/4187059021
2016-07-26 10:39:07.713980 7fc499a9c700 10 mon.60zxl02@1(probing) e5 remove_session MonSession: client.? 10.98.3.15:0/4187059021 is open client.? 10.98.3.15:0/4187059021
2016-07-26 10:39:07.713989 7fc499a9c700 10 mon.60zxl02@1(probing) e5 ms_handle_reset 0x33f4780 10.98.3.15:0/4187059021
2016-07-26 10:39:07.713992 7fc499a9c700 10 mon.60zxl02@1(probing) e5 ms_handle_reset 0x33f2c00 10.98.3.15:0/4187059021
2016-07-26 10:39:07.713995 7fc499a9c700 10 mon.60zxl02@1(probing) e5 ms_handle_reset 0x33f3c80 10.98.3.15:0/1020545
2016-07-26 10:39:07.714000 7fc499a9c700 10 mon.60zxl02@1(probing) e5 ms_handle_reset 0x33f4620 10.98.3.15:0/1020545
2016-07-26 10:39:07.714002 7fc499a9c700 10 mon.60zxl02@1(probing) e5 ms_handle_reset 0x33f39c0 10.98.3.15:0/4187059021
2016-07-26 10:39:07.714005 7fc499a9c700 10 mon.60zxl02@1(probing) e5 ms_handle_reset 0x33f44c0 10.98.3.15:0/1020545
2016-07-26 10:39:07.714009 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.2 10.98.2.173:6789/0 9 ==== mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 610wl02) v6 ==== 64+0+0 (3448912970 0 0) 0x34fa080 con 0x33f1fa0
2016-07-26 10:39:07.714019 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 610wl02) v6
2016-07-26 10:39:07.714022 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe_probe mon.2 10.98.2.173:6789/0mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 610wl02) v6 features 37154696925806591
2016-07-26 10:39:07.714033 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> 10.98.2.173:6789/0 -- mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02 paxos( fc 1318755 lc 1319324 )) v6 -- ?+0 0x34f9180 con 0x33f1fa0
2016-07-26 10:39:07.714044 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.4 10.98.2.216:6789/0 8 ==== mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 ==== 64+0+0 (1877372914 0 0) 0x34faa80 con 0x33f1b80
2016-07-26 10:39:07.714051 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6
2016-07-26 10:39:07.714054 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe_probe mon.4 10.98.2.216:6789/0mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 features 37154696925806591
2016-07-26 10:39:07.714060 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> 10.98.2.216:6789/0 -- mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02 paxos( fc 1318755 lc 1319324 )) v6 -- ?+0 0x34fa080 con 0x33f1b80
2016-07-26 10:39:07.714068 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.1 10.98.2.167:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x388de80 con 0x33f11e0
2016-07-26 10:39:07.714073 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(logm 765975..766716) dispatch log(1 entries) v1 from mon.1 10.98.2.167:6789/0
2016-07-26 10:39:07.714077 7fc499a9c700  5 mon.60zxl02@1(probing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:39:07.714077 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:39:07.714082 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(logm 765975..766716)  waiting for paxos -> readable (v0)
2016-07-26 10:39:07.714083 7fc499a9c700  5 mon.60zxl02@1(probing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:39:07.714084 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:39:07.714087 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.2 10.98.2.173:6789/0 10 ==== election(2f51a247-3155-4bcf-9aee-c6f6b2c5e2af propose 11773) v5 ==== 841+0+0 (2331296059 0 0) 0x34e3700 con 0x33f1fa0
2016-07-26 10:39:07.714096 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.4 10.98.2.216:6789/0 9 ==== mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 ==== 64+0+0 (1877372914 0 0) 0x34faf80 con 0x33f1b80
2016-07-26 10:39:07.714101 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6
2016-07-26 10:39:07.714104 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe_probe mon.4 10.98.2.216:6789/0mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 features 37154696925806591
2016-07-26 10:39:07.714119 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> 10.98.2.216:6789/0 -- mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02 paxos( fc 1318755 lc 1319324 )) v6 -- ?+0 0x34faa80 con 0x33f1b80
2016-07-26 10:39:07.714129 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.1 10.98.2.167:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x39786c0 con 0x33f11e0
2016-07-26 10:39:07.714134 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(logm 765975..766716) dispatch log(1 entries) v1 from mon.1 10.98.2.167:6789/0
2016-07-26 10:39:07.714137 7fc499a9c700  5 mon.60zxl02@1(probing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:39:07.714138 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:39:07.714140 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(logm 765975..766716)  waiting for paxos -> readable (v0)
2016-07-26 10:39:07.714142 7fc499a9c700  5 mon.60zxl02@1(probing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:39:07.714143 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:39:07.714147 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.2 10.98.2.173:6789/0 11 ==== election(2f51a247-3155-4bcf-9aee-c6f6b2c5e2af propose 11773) v5 ==== 841+0+0 (2331296059 0 0) 0x34e4780 con 0x33f1fa0
2016-07-26 10:39:07.714155 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.4 10.98.2.216:6789/0 10 ==== mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 ==== 64+0+0 (1877372914 0 0) 0x34f9e00 con 0x33f1b80
2016-07-26 10:39:07.714165 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6
2016-07-26 10:39:07.714168 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe_probe mon.4 10.98.2.216:6789/0mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 features 37154696925806591
2016-07-26 10:39:07.714174 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> 10.98.2.216:6789/0 -- mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02 paxos( fc 1318755 lc 1319324 )) v6 -- ?+0 0x34faf80 con 0x33f1b80
2016-07-26 10:39:07.714188 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.1 10.98.2.167:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x388d7c0 con 0x33f11e0
2016-07-26 10:39:07.714194 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(logm 765975..766716) dispatch log(1 entries) v1 from mon.1 10.98.2.167:6789/0
2016-07-26 10:39:07.714197 7fc499a9c700  5 mon.60zxl02@1(probing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:39:07.714197 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:39:07.714200 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(logm 765975..766716)  waiting for paxos -> readable (v0)
2016-07-26 10:39:07.714201 7fc499a9c700  5 mon.60zxl02@1(probing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:39:07.714202 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:39:07.714204 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.2 10.98.2.173:6789/0 12 ==== election(2f51a247-3155-4bcf-9aee-c6f6b2c5e2af propose 11773) v5 ==== 841+0+0 (2331296059 0 0) 0x34e44c0 con 0x33f1fa0
2016-07-26 10:39:07.714212 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.4 10.98.2.216:6789/0 11 ==== mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 ==== 64+0+0 (1877372914 0 0) 0x34fb700 con 0x33f1b80
2016-07-26 10:39:07.714217 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6
2016-07-26 10:39:07.714220 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe_probe mon.4 10.98.2.216:6789/0mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 features 37154696925806591
2016-07-26 10:39:07.714226 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> 10.98.2.216:6789/0 -- mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02 paxos( fc 1318755 lc 1319324 )) v6 -- ?+0 0x34f9e00 con 0x33f1b80
2016-07-26 10:39:07.714234 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.1 10.98.2.167:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x388d100 con 0x33f11e0
2016-07-26 10:39:07.714239 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(logm 765975..766716) dispatch log(1 entries) v1 from mon.1 10.98.2.167:6789/0
2016-07-26 10:39:07.714242 7fc499a9c700  5 mon.60zxl02@1(probing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:39:07.714242 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:39:07.714245 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(logm 765975..766716)  waiting for paxos -> readable (v0)
2016-07-26 10:39:07.714246 7fc499a9c700  5 mon.60zxl02@1(probing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:39:07.714246 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:39:07.714249 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.2 10.98.2.173:6789/0 13 ==== election(2f51a247-3155-4bcf-9aee-c6f6b2c5e2af propose 11773) v5 ==== 841+0+0 (2331296059 0 0) 0x34e4fc0 con 0x33f1fa0
2016-07-26 10:39:07.714256 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.4 10.98.2.216:6789/0 12 ==== mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 ==== 64+0+0 (1877372914 0 0) 0x34fb480 con 0x33f1b80
2016-07-26 10:39:07.714262 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6
2016-07-26 10:39:07.714264 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe_probe mon.4 10.98.2.216:6789/0mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 features 37154696925806591
2016-07-26 10:39:07.714269 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> 10.98.2.216:6789/0 -- mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02 paxos( fc 1318755 lc 1319324 )) v6 -- ?+0 0x34fb700 con 0x33f1b80
2016-07-26 10:39:07.714279 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.2 10.98.2.173:6789/0 14 ==== election(2f51a247-3155-4bcf-9aee-c6f6b2c5e2af propose 11773) v5 ==== 841+0+0 (2331296059 0 0) 0x34e4d00 con 0x33f1fa0
2016-07-26 10:39:07.714287 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.4 10.98.2.216:6789/0 13 ==== mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 ==== 64+0+0 (1877372914 0 0) 0x34fb200 con 0x33f1b80
2016-07-26 10:39:07.714293 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6
2016-07-26 10:39:07.714295 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe_probe mon.4 10.98.2.216:6789/0mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 features 37154696925806591
2016-07-26 10:39:07.714301 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> 10.98.2.216:6789/0 -- mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02 paxos( fc 1318755 lc 1319324 )) v6 -- ?+0 0x34fb480 con 0x33f1b80
2016-07-26 10:39:07.714309 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.2 10.98.2.173:6789/0 15 ==== election(2f51a247-3155-4bcf-9aee-c6f6b2c5e2af propose 11773) v5 ==== 841+0+0 (2331296059 0 0) 0x34e4a40 con 0x33f1fa0
2016-07-26 10:39:07.714318 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.4 10.98.2.216:6789/0 14 ==== mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 ==== 64+0+0 (1877372914 0 0) 0x34fc100 con 0x33f1b80
2016-07-26 10:39:07.714323 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6
2016-07-26 10:39:07.714326 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe_probe mon.4 10.98.2.216:6789/0mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 features 37154696925806591
2016-07-26 10:39:07.714332 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> 10.98.2.216:6789/0 -- mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02 paxos( fc 1318755 lc 1319324 )) v6 -- ?+0 0x34fb200 con 0x33f1b80
2016-07-26 10:39:07.714341 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.2 10.98.2.173:6789/0 16 ==== mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 610wl02 paxos( fc 1318755 lc 1319324 )) v6 ==== 845+0+0 (3613516349 0 0) 0x34ffd00 con 0x33f1fa0
2016-07-26 10:39:07.714348 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 610wl02 paxos( fc 1318755 lc 1319324 )) v6
2016-07-26 10:39:07.714351 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe_reply mon.2 10.98.2.173:6789/0mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 610wl02 paxos( fc 1318755 lc 1319324 )) v6
2016-07-26 10:39:07.714355 7fc499a9c700 10 mon.60zxl02@1(probing) e5  monmap is e5: 5 mons at {60z0m02=10.98.2.166:6789/0,60zxl02=10.98.2.167:6789/0,610wl02=10.98.2.173:6789/0,615yl02=10.98.2.216:6789/0,618yl02=10.98.2.214:6789/0}
2016-07-26 10:39:07.714369 7fc499a9c700 10 mon.60zxl02@1(probing) e5  peer name is 610wl02
2016-07-26 10:39:07.714371 7fc499a9c700 10 mon.60zxl02@1(probing) e5  mon.610wl02 is outside the quorum
2016-07-26 10:39:07.714373 7fc499a9c700 10 mon.60zxl02@1(probing) e5  outside_quorum now 60zxl02,610wl02, need 3
2016-07-26 10:39:07.714375 7fc499a9c700 10 mon.60zxl02@1(probing) e5  that's not yet enough for a new quorum, waiting
2016-07-26 10:39:07.714378 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.4 10.98.2.216:6789/0 15 ==== mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 ==== 64+0+0 (1877372914 0 0) 0x34fbe80 con 0x33f1b80
2016-07-26 10:39:07.714385 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6
2016-07-26 10:39:07.714387 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe_probe mon.4 10.98.2.216:6789/0mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 features 37154696925806591
2016-07-26 10:39:07.714393 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> 10.98.2.216:6789/0 -- mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02 paxos( fc 1318755 lc 1319324 )) v6 -- ?+0 0x34ffd00 con 0x33f1b80
2016-07-26 10:39:07.714401 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.4 10.98.2.216:6789/0 16 ==== mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 ==== 64+0+0 (1877372914 0 0) 0x34fcd80 con 0x33f1b80
2016-07-26 10:39:07.714408 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6
2016-07-26 10:39:07.714410 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe_probe mon.4 10.98.2.216:6789/0mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 features 37154696925806591
2016-07-26 10:39:07.714417 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> 10.98.2.216:6789/0 -- mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02 paxos( fc 1318755 lc 1319324 )) v6 -- ?+0 0x34fbe80 con 0x33f1b80
2016-07-26 10:39:07.714424 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.4 10.98.2.216:6789/0 17 ==== mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 ==== 64+0+0 (1877372914 0 0) 0x34fbc00 con 0x33f1b80
2016-07-26 10:39:07.714429 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6
2016-07-26 10:39:07.714432 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe_probe mon.4 10.98.2.216:6789/0mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 features 37154696925806591
2016-07-26 10:39:07.714437 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> 10.98.2.216:6789/0 -- mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02 paxos( fc 1318755 lc 1319324 )) v6 -- ?+0 0x34fcd80 con 0x33f1b80
2016-07-26 10:39:07.714452 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.4 10.98.2.216:6789/0 18 ==== mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 ==== 64+0+0 (1877372914 0 0) 0x34fb980 con 0x33f1b80
2016-07-26 10:39:07.714458 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6
2016-07-26 10:39:07.714461 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe_probe mon.4 10.98.2.216:6789/0mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 features 37154696925806591
2016-07-26 10:39:07.714473 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> 10.98.2.216:6789/0 -- mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02 paxos( fc 1318755 lc 1319324 )) v6 -- ?+0 0x34fbc00 con 0x33f1b80
2016-07-26 10:39:07.714483 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.4 10.98.2.216:6789/0 19 ==== mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 ==== 64+0+0 (1877372914 0 0) 0x34fd280 con 0x33f1b80
2016-07-26 10:39:07.714489 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6
2016-07-26 10:39:07.714492 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe_probe mon.4 10.98.2.216:6789/0mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 features 37154696925806591
2016-07-26 10:39:07.714497 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> 10.98.2.216:6789/0 -- mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02 paxos( fc 1318755 lc 1319324 )) v6 -- ?+0 0x34fb980 con 0x33f1b80
2016-07-26 10:39:07.714509 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.4 10.98.2.216:6789/0 20 ==== mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 ==== 64+0+0 (1877372914 0 0) 0x34fd000 con 0x33f1b80
2016-07-26 10:39:07.714515 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6
2016-07-26 10:39:07.714518 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe_probe mon.4 10.98.2.216:6789/0mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 features 37154696925806591
2016-07-26 10:39:07.714539 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> 10.98.2.216:6789/0 -- mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02 paxos( fc 1318755 lc 1319324 )) v6 -- ?+0 0x34fd280 con 0x33f1b80
2016-07-26 10:39:07.714547 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.4 10.98.2.216:6789/0 21 ==== mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 ==== 64+0+0 (1877372914 0 0) 0x34fcb00 con 0x33f1b80
2016-07-26 10:39:07.714554 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6
2016-07-26 10:39:07.714556 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe_probe mon.4 10.98.2.216:6789/0mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 features 37154696925806591
2016-07-26 10:39:07.714562 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> 10.98.2.216:6789/0 -- mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02 paxos( fc 1318755 lc 1319324 )) v6 -- ?+0 0x34fd000 con 0x33f1b80
2016-07-26 10:39:07.714568 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.4 10.98.2.216:6789/0 22 ==== mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 ==== 64+0+0 (1877372914 0 0) 0x34fc880 con 0x33f1b80
2016-07-26 10:39:07.714574 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6
2016-07-26 10:39:07.714576 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe_probe mon.4 10.98.2.216:6789/0mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 features 37154696925806591
2016-07-26 10:39:07.714594 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> 10.98.2.216:6789/0 -- mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02 paxos( fc 1318755 lc 1319324 )) v6 -- ?+0 0x34fcb00 con 0x33f1b80
2016-07-26 10:39:07.714602 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.4 10.98.2.216:6789/0 23 ==== mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 ==== 64+0+0 (1877372914 0 0) 0x34fc600 con 0x33f1b80
2016-07-26 10:39:07.714608 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6
2016-07-26 10:39:07.714611 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe_probe mon.4 10.98.2.216:6789/0mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 features 37154696925806591
2016-07-26 10:39:07.714616 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> 10.98.2.216:6789/0 -- mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02 paxos( fc 1318755 lc 1319324 )) v6 -- ?+0 0x34fc880 con 0x33f1b80
2016-07-26 10:39:07.714622 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.4 10.98.2.216:6789/0 24 ==== mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 ==== 64+0+0 (1877372914 0 0) 0x34fe180 con 0x33f1b80
2016-07-26 10:39:07.714627 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6
2016-07-26 10:39:07.714630 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe_probe mon.4 10.98.2.216:6789/0mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 features 37154696925806591
2016-07-26 10:39:07.714635 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> 10.98.2.216:6789/0 -- mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02 paxos( fc 1318755 lc 1319324 )) v6 -- ?+0 0x34fc600 con 0x33f1b80
2016-07-26 10:39:07.714641 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.4 10.98.2.216:6789/0 25 ==== mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 ==== 64+0+0 (1877372914 0 0) 0x34fdf00 con 0x33f1b80
2016-07-26 10:39:07.714647 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6
2016-07-26 10:39:07.714650 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe_probe mon.4 10.98.2.216:6789/0mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 features 37154696925806591
2016-07-26 10:39:07.714655 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> 10.98.2.216:6789/0 -- mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02 paxos( fc 1318755 lc 1319324 )) v6 -- ?+0 0x34fe180 con 0x33f1b80
2016-07-26 10:39:07.714680 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.4 10.98.2.216:6789/0 26 ==== mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 ==== 64+0+0 (1877372914 0 0) 0x34fdc80 con 0x33f1b80
2016-07-26 10:39:07.714686 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6
2016-07-26 10:39:07.714688 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe_probe mon.4 10.98.2.216:6789/0mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 features 37154696925806591
2016-07-26 10:39:07.714705 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> 10.98.2.216:6789/0 -- mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02 paxos( fc 1318755 lc 1319324 )) v6 -- ?+0 0x34fdf00 con 0x33f1b80
2016-07-26 10:39:07.714714 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.4 10.98.2.216:6789/0 27 ==== mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 ==== 64+0+0 (1877372914 0 0) 0x34fda00 con 0x33f1b80
2016-07-26 10:39:07.714720 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6
2016-07-26 10:39:07.714723 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe_probe mon.4 10.98.2.216:6789/0mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 features 37154696925806591
2016-07-26 10:39:07.714741 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> 10.98.2.216:6789/0 -- mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02 paxos( fc 1318755 lc 1319324 )) v6 -- ?+0 0x34fdc80 con 0x33f1b80
2016-07-26 10:39:07.714749 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.4 10.98.2.216:6789/0 28 ==== mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 ==== 64+0+0 (1877372914 0 0) 0x34fd780 con 0x33f1b80
2016-07-26 10:39:07.714755 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6
2016-07-26 10:39:07.714757 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe_probe mon.4 10.98.2.216:6789/0mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 features 37154696925806591
2016-07-26 10:39:07.714762 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> 10.98.2.216:6789/0 -- mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02 paxos( fc 1318755 lc 1319324 )) v6 -- ?+0 0x34fda00 con 0x33f1b80
2016-07-26 10:39:07.714769 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.4 10.98.2.216:6789/0 29 ==== mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 ==== 64+0+0 (1877372914 0 0) 0x34fd500 con 0x33f1b80
2016-07-26 10:39:07.714775 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6
2016-07-26 10:39:07.714777 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe_probe mon.4 10.98.2.216:6789/0mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 features 37154696925806591
2016-07-26 10:39:07.714783 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> 10.98.2.216:6789/0 -- mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02 paxos( fc 1318755 lc 1319324 )) v6 -- ?+0 0x34fd780 con 0x33f1b80
2016-07-26 10:39:07.714791 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.4 10.98.2.216:6789/0 30 ==== mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 ==== 64+0+0 (1877372914 0 0) 0x34ff300 con 0x33f1b80
2016-07-26 10:39:07.714797 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6
2016-07-26 10:39:07.714799 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe_probe mon.4 10.98.2.216:6789/0mon_probe(probe 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02) v6 features 37154696925806591
2016-07-26 10:39:07.714804 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> 10.98.2.216:6789/0 -- mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 60zxl02 paxos( fc 1318755 lc 1319324 )) v6 -- ?+0 0x34fd500 con 0x33f1b80
2016-07-26 10:39:07.714811 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.4 10.98.2.216:6789/0 31 ==== mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02 paxos( fc 1318755 lc 1319323 )) v6 ==== 845+0+0 (1132774637 0 0) 0x34ff800 con 0x33f1b80
2016-07-26 10:39:07.714817 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02 paxos( fc 1318755 lc 1319323 )) v6
2016-07-26 10:39:07.714820 7fc499a9c700 10 mon.60zxl02@1(probing) e5 handle_probe_reply mon.4 10.98.2.216:6789/0mon_probe(reply 2f51a247-3155-4bcf-9aee-c6f6b2c5e2af name 615yl02 paxos( fc 1318755 lc 1319323 )) v6
2016-07-26 10:39:07.714823 7fc499a9c700 10 mon.60zxl02@1(probing) e5  monmap is e5: 5 mons at {60z0m02=10.98.2.166:6789/0,60zxl02=10.98.2.167:6789/0,610wl02=10.98.2.173:6789/0,615yl02=10.98.2.216:6789/0,618yl02=10.98.2.214:6789/0}
2016-07-26 10:39:07.714832 7fc499a9c700 10 mon.60zxl02@1(probing) e5  peer name is 615yl02
2016-07-26 10:39:07.714833 7fc499a9c700 10 mon.60zxl02@1(probing) e5  mon.615yl02 is outside the quorum
2016-07-26 10:39:07.714854 7fc499a9c700 10 mon.60zxl02@1(probing) e5  outside_quorum now 60zxl02,610wl02,615yl02, need 3
2016-07-26 10:39:07.714855 7fc499a9c700 10 mon.60zxl02@1(probing) e5  that's enough to form a new quorum, calling election
2016-07-26 10:39:07.714856 7fc499a9c700 10 mon.60zxl02@1(probing) e5 start_election
2016-07-26 10:39:07.714857 7fc499a9c700 10 mon.60zxl02@1(probing) e5 _reset
2016-07-26 10:39:07.714858 7fc499a9c700 10 mon.60zxl02@1(probing) e5 cancel_probe_timeout 0x371f320
2016-07-26 10:39:07.714860 7fc499a9c700 10 mon.60zxl02@1(probing) e5 timecheck_finish
2016-07-26 10:39:07.714861 7fc499a9c700 10 mon.60zxl02@1(probing) e5 scrub_reset
2016-07-26 10:39:07.714862 7fc499a9c700 10 mon.60zxl02@1(probing).paxos(paxos recovering c 1318755..1319324) restart -- canceling timeouts
2016-07-26 10:39:07.714864 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(pgmap 538057..538795) restart
2016-07-26 10:39:07.714866 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(mdsmap 1..1) restart
2016-07-26 10:39:07.714867 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(osdmap 1769..2433) restart
2016-07-26 10:39:07.714868 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(logm 765975..766716) restart
2016-07-26 10:39:07.714869 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(monmap 1..5) restart
2016-07-26 10:39:07.714870 7fc499a9c700 10 mon.60zxl02@1(probing).paxosservice(auth 2251..2418) restart
2016-07-26 10:39:07.714872 7fc499a9c700 10 mon.60zxl02@1(electing) e5 cancel_probe_timeout (none scheduled)
2016-07-26 10:39:07.714875 7fc499a9c700  0 log_channel(cluster) log [INF] : mon.60zxl02 calling new monitor election
2016-07-26 10:39:07.714877 7fc499a9c700  0 log_channel(cluster) do_log log to syslog
2016-07-26 10:39:14.813662 7fc497491700  1 -- 10.98.2.167:6789/0 >> :/0 pipe(0x3632000 sd=18 :6789 s=0 pgs=0 cs=0 l=0 c=0x33f5120).accept sd=18 10.98.3.15:44879/0
2016-07-26 10:39:14.813764 7fc497491700 10 mon.60zxl02@1(electing) e5 ms_verify_authorizer 10.98.3.15:0/4187059021 client protocol 0
2016-07-26 10:39:20.686966 7fc497491700  1 -- 10.98.2.167:6789/0 >> :/0 pipe(0x362d800 sd=18 :6789 s=0 pgs=0 cs=0 l=0 c=0x33f4fc0).accept sd=18 10.98.3.15:44888/0
2016-07-26 10:39:20.687065 7fc497491700 10 mon.60zxl02@1(electing) e5 ms_verify_authorizer 10.98.3.15:0/1020545 client protocol 0
2016-07-26 10:39:43.715602 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> 10.98.2.167:6789/0 -- log(1 entries) v1 -- ?+0 0x388b180 con 0x33f11e0
2016-07-26 10:39:43.715610 7fc499a9c700  5 mon.60zxl02@1(electing).elector(11772) start -- can i be leader?
2016-07-26 10:39:43.715660 7fc499a9c700  1 mon.60zxl02@1(electing).elector(11772) init, last seen epoch 11772
2016-07-26 10:39:43.715662 7fc499a9c700 10 mon.60zxl02@1(electing).elector(11772) bump_epoch 11772 to 11773
2016-07-26 10:39:43.746288 7fc499a9c700 10 mon.60zxl02@1(electing) e5 join_election
2016-07-26 10:39:43.746293 7fc499a9c700 10 mon.60zxl02@1(electing) e5 _reset
2016-07-26 10:39:43.746294 7fc499a9c700 10 mon.60zxl02@1(electing) e5 cancel_probe_timeout (none scheduled)
2016-07-26 10:39:43.746295 7fc499a9c700 10 mon.60zxl02@1(electing) e5 timecheck_finish
2016-07-26 10:39:43.746298 7fc499a9c700 10 mon.60zxl02@1(electing) e5 scrub_reset
2016-07-26 10:39:43.746299 7fc499a9c700 10 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) restart -- canceling timeouts
2016-07-26 10:39:43.746302 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(pgmap 538057..538795) restart
2016-07-26 10:39:43.746304 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(mdsmap 1..1) restart
2016-07-26 10:39:43.746305 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(osdmap 1769..2433) restart
2016-07-26 10:39:43.746306 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716) restart
2016-07-26 10:39:43.746307 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(monmap 1..5) restart
2016-07-26 10:39:43.746308 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(auth 2251..2418) restart
2016-07-26 10:39:43.746315 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> mon.0 10.98.2.166:6789/0 -- election(2f51a247-3155-4bcf-9aee-c6f6b2c5e2af propose 11773) v5 -- ?+0 0x34e4fc0
2016-07-26 10:39:43.746326 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> mon.2 10.98.2.173:6789/0 -- election(2f51a247-3155-4bcf-9aee-c6f6b2c5e2af propose 11773) v5 -- ?+0 0x34e44c0
2016-07-26 10:39:43.746336 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> mon.3 10.98.2.214:6789/0 -- election(2f51a247-3155-4bcf-9aee-c6f6b2c5e2af propose 11773) v5 -- ?+0 0x34e4780
2016-07-26 10:39:43.746345 7fc499a9c700  1 -- 10.98.2.167:6789/0 --> mon.4 10.98.2.216:6789/0 -- election(2f51a247-3155-4bcf-9aee-c6f6b2c5e2af propose 11773) v5 -- ?+0 0x34e6e00
2016-07-26 10:39:43.746356 7fc499a9c700 10 mon.60zxl02@1(electing) e5 ms_handle_reset 0x33f3f40 10.98.3.15:0/4187059021
2016-07-26 10:39:43.746362 7fc499a9c700 10 mon.60zxl02@1(electing) e5 ms_handle_reset 0x33f5120 10.98.3.15:0/4187059021
2016-07-26 10:39:43.746364 7fc499a9c700 10 mon.60zxl02@1(electing) e5 ms_handle_reset 0x33f4fc0 10.98.3.15:0/1020545
2016-07-26 10:39:43.746367 7fc499a9c700 10 mon.60zxl02@1(electing) e5 ms_handle_reset 0x33f2ec0 10.98.3.18:0/1012640
2016-07-26 10:39:43.746370 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.2 10.98.2.173:6789/0 17 ==== election(2f51a247-3155-4bcf-9aee-c6f6b2c5e2af propose 11773) v5 ==== 841+0+0 (2331296059 0 0) 0x34e2680 con 0x33f1fa0
2016-07-26 10:39:43.746388 7fc499a9c700  5 mon.60zxl02@1(electing).elector(11773) handle_propose from mon.2
2016-07-26 10:39:43.746390 7fc499a9c700 10 mon.60zxl02@1(electing).elector(11773) handle_propose required features 18416819765248, peer features 37154696925806591
2016-07-26 10:39:43.746393 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.1 10.98.2.167:6789/0 0 ==== log(1 entries) v1 ==== 0+0+0 (0 0 0) 0x388b180 con 0x33f11e0
2016-07-26 10:39:43.746398 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716) dispatch log(1 entries) v1 from mon.1 10.98.2.167:6789/0
2016-07-26 10:39:43.746401 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:39:43.746402 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:39:43.746406 7fc499a9c700 10 mon.60zxl02@1(electing).paxosservice(logm 765975..766716)  waiting for paxos -> readable (v0)
2016-07-26 10:39:43.746408 7fc499a9c700  5 mon.60zxl02@1(electing).paxos(paxos recovering c 1318755..1319324) is_readable = 0 - now=2016-07-26 10:39:43.746408 lease_expire=0.000000 has v0 lc 1319324
2016-07-26 10:39:43.746411 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.2 10.98.2.173:6789/0 18 ==== election(2f51a247-3155-4bcf-9aee-c6f6b2c5e2af propose 11773) v5 ==== 841+0+0 (2331296059 0 0) 0x34e39c0 con 0x33f1fa0
2016-07-26 10:39:43.746426 7fc499a9c700  5 mon.60zxl02@1(electing).elector(11773) handle_propose from mon.2
2016-07-26 10:39:43.746428 7fc499a9c700 10 mon.60zxl02@1(electing).elector(11773) handle_propose required features 18416819765248, peer features 37154696925806591
2016-07-26 10:39:43.746431 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.2 10.98.2.173:6789/0 19 ==== election(2f51a247-3155-4bcf-9aee-c6f6b2c5e2af propose 11773) v5 ==== 841+0+0 (2331296059 0 0) 0x34e3180 con 0x33f1fa0
2016-07-26 10:39:43.746443 7fc499a9c700  5 mon.60zxl02@1(electing).elector(11773) handle_propose from mon.2
2016-07-26 10:39:43.746444 7fc499a9c700 10 mon.60zxl02@1(electing).elector(11773) handle_propose required features 18416819765248, peer features 37154696925806591
2016-07-26 10:39:43.746447 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.2 10.98.2.173:6789/0 20 ==== election(2f51a247-3155-4bcf-9aee-c6f6b2c5e2af propose 11773) v5 ==== 841+0+0 (2331296059 0 0) 0x34e2940 con 0x33f1fa0
2016-07-26 10:39:43.746457 7fc499a9c700  5 mon.60zxl02@1(electing).elector(11773) handle_propose from mon.2
2016-07-26 10:39:43.746459 7fc499a9c700 10 mon.60zxl02@1(electing).elector(11773) handle_propose required features 18416819765248, peer features 37154696925806591
2016-07-26 10:39:43.746462 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.2 10.98.2.173:6789/0 21 ==== election(2f51a247-3155-4bcf-9aee-c6f6b2c5e2af propose 11773) v5 ==== 841+0+0 (2331296059 0 0) 0x34e3700 con 0x33f1fa0
2016-07-26 10:39:43.746472 7fc499a9c700  5 mon.60zxl02@1(electing).elector(11773) handle_propose from mon.2
2016-07-26 10:39:43.746474 7fc499a9c700 10 mon.60zxl02@1(electing).elector(11773) handle_propose required features 18416819765248, peer features 37154696925806591
2016-07-26 10:39:43.746476 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.2 10.98.2.173:6789/0 22 ==== election(2f51a247-3155-4bcf-9aee-c6f6b2c5e2af propose 11773) v5 ==== 841+0+0 (2331296059 0 0) 0x34e1e40 con 0x33f1fa0
2016-07-26 10:39:43.746486 7fc499a9c700  5 mon.60zxl02@1(electing).elector(11773) handle_propose from mon.2
2016-07-26 10:39:43.746488 7fc499a9c700 10 mon.60zxl02@1(electing).elector(11773) handle_propose required features 18416819765248, peer features 37154696925806591
2016-07-26 10:39:43.746490 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.2 10.98.2.173:6789/0 23 ==== election(2f51a247-3155-4bcf-9aee-c6f6b2c5e2af propose 11773) v5 ==== 841+0+0 (2331296059 0 0) 0x34e4200 con 0x33f1fa0
2016-07-26 10:39:43.746500 7fc499a9c700  5 mon.60zxl02@1(electing).elector(11773) handle_propose from mon.2
2016-07-26 10:39:43.746502 7fc499a9c700 10 mon.60zxl02@1(electing).elector(11773) handle_propose required features 18416819765248, peer features 37154696925806591
2016-07-26 10:39:43.746662 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== mon.2 10.98.2.173:6789/0 24 ==== election(2f51a247-3155-4bcf-9aee-c6f6b2c5e2af ack 11773) v5 ==== 26475+0+0 (1442290643 0 0) 0x34e44c0 con 0x33f1fa0
2016-07-26 10:39:43.746675 7fc499a9c700  5 mon.60zxl02@1(electing).elector(11773) handle_ack from mon.2
2016-07-26 10:39:43.746677 7fc499a9c700  5 mon.60zxl02@1(electing).elector(11773)  so far i have {1=37154696925806591,2=37154696925806591}
2016-07-26 10:39:45.385295 7fc497794700  1 -- 10.98.2.167:6789/0 >> :/0 pipe(0x37b1000 sd=18 :6789 s=0 pgs=0 cs=0 l=0 c=0x33f4e60).accept sd=18 10.98.3.23:59744/0
2016-07-26 10:39:45.385455 7fc497794700 10 mon.60zxl02@1(electing) e5 ms_verify_authorizer 10.98.3.23:0/1011397 client protocol 0
2016-07-26 10:39:45.385625 7fc499a9c700  1 -- 10.98.2.167:6789/0 <== client.69334 10.98.3.23:0/1011397 1 ==== auth(proto 0 35 bytes epoch 5) v1 ==== 65+0+0 (4078390826 0 0) 0x388e300 con 0x33f4e60