rook operator logs

gistfile1.txt

2018-06-07 14:13:41.821903 I | rook: starting Rook v0.7.1 with arguments '/usr/local/bin/rook operator'
2018-06-07 14:13:41.822114 I | rook: flag values: --help=false, --log-level=INFO, --mon-healthcheck-interval=45s, --mon-out-timeout=5m0s
2018-06-07 14:13:41.824143 I | rook: starting operator
2018-06-07 14:13:46.222157 I | op-k8sutil: cluster role rook-agent already exists. Updating if needed.
2018-06-07 14:13:46.271198 I | op-agent: getting flexvolume dir path from FLEXVOLUME_DIR_PATH env var
2018-06-07 14:13:46.271230 I | op-agent: flexvolume dir path env var FLEXVOLUME_DIR_PATH is not provided. Defaulting to: /usr/libexec/kubernetes/kubelet-plugins/volume/exec/
2018-06-07 14:13:46.271246 I | op-agent: discovered flexvolume dir path from source default. value: /usr/libexec/kubernetes/kubelet-plugins/volume/exec/
2018-06-07 14:13:46.288149 I | op-agent: rook-agent daemonset already exists
2018-06-07 14:13:46.323970 I | operator: rook-provisioner started
2018-06-07 14:13:46.324000 I | op-cluster: start watching clusters in all namespaces
2018-06-07 14:25:53.324841 I | op-cluster: starting cluster in namespace rook-ceph-system
2018-06-07 14:25:59.562077 I | op-mon: start running mons
2018-06-07 14:25:59.591850 I | exec: Running command: ceph-authtool --create-keyring /var/lib/rook/rook-ceph-system/mon.keyring --gen-key -n mon. --cap mon 'allow *'
2018-06-07 14:26:00.261125 I | exec: Running command: ceph-authtool --create-keyring /var/lib/rook/rook-ceph-system/client.admin.keyring --gen-key -n client.admin --set-uid=0 --cap mon 'allow *' --cap osd 'allow *' --cap mgr 'allow *' --cap mds 'allow'
2018-06-07 14:26:00.822953 I | op-mon: creating mon secrets for a new cluster
2018-06-07 14:26:00.958996 I | op-mon: saved mon endpoints to config map map[data: maxMonId:-1 mapping:{"node":{},"port":{}}]
2018-06-07 14:26:00.959751 I | cephmon: writing config file /var/lib/rook/rook-ceph-system/rook-ceph-system.config
2018-06-07 14:26:00.960060 I | cephmon: generated admin config in /var/lib/rook/rook-ceph-system
2018-06-07 14:26:01.221486 I | op-mon: Found 3 running nodes without mons
2018-06-07 14:26:01.221554 I | op-mon: setting mon endpoints for hostnetwork mode
2018-06-07 14:26:01.347107 I | op-mon: saved mon endpoints to config map map[mapping:{"node":{"rook-ceph-mon0":{"Name":"node1","Hostname":"node1","Address":"10.10.73.40"}},"port":{"node1":6790}} data:rook-ceph-mon0=10.10.73.40:6790 maxMonId:0]
2018-06-07 14:26:01.347763 I | cephmon: writing config file /var/lib/rook/rook-ceph-system/rook-ceph-system.config
2018-06-07 14:26:01.348039 I | cephmon: generated admin config in /var/lib/rook/rook-ceph-system
2018-06-07 14:26:01.363466 I | cephmon: writing config file /var/lib/rook/rook-ceph-system/rook-ceph-system.config
2018-06-07 14:26:01.420868 I | cephmon: generated admin config in /var/lib/rook/rook-ceph-system
2018-06-07 14:26:01.462949 I | op-mon: mons created: 1
2018-06-07 14:26:01.462981 I | op-mon: waiting for mon quorum
2018-06-07 14:26:01.463265 I | exec: Running command: ceph mon_status --cluster=rook-ceph-system --conf=/var/lib/rook/rook-ceph-system/rook-ceph-system.config --keyring=/var/lib/rook/rook-ceph-system/client.admin.keyring --format json --out-file /tmp/514540639
2018-06-07 14:31:03.233372 I | exec: 2018-06-07 14:31:03.065551 7f966e2fd700  0 monclient(hunting): authenticate timed out after 300
2018-06-07 14:31:03.065551 7f966e2fd700  0 monclient(hunting): authenticate timed out after 300
2018-06-07 14:31:03.065591 7f966e2fd700  0 librados: client.admin authentication error (110) Connection timed out
2018-06-07 14:31:03.065591 7f966e2fd700  0 librados: client.admin authentication error (110) Connection timed out
[errno 110] error connecting to the cluster
2018-06-07 14:31:08.233945 I | exec: Running command: ceph mon_status --cluster=rook-ceph-system --conf=/var/lib/rook/rook-ceph-system/rook-ceph-system.config --keyring=/var/lib/rook/rook-ceph-system/client.admin.keyring --format json --out-file /tmp/047573042
2018-06-07 14:36:09.927155 I | exec: 2018-06-07 14:36:09.724553 7f191ec61700  0 monclient(hunting): authenticate timed out after 300
2018-06-07 14:36:09.724553 7f191ec61700  0 monclient(hunting): authenticate timed out after 300
2018-06-07 14:36:09.724612 7f191ec61700  0 librados: client.admin authentication error (110) Connection timed out
2018-06-07 14:36:09.724612 7f191ec61700  0 librados: client.admin authentication error (110) Connection timed out
[errno 110] error connecting to the cluster
2018-06-07 14:36:14.928371 I | exec: Running command: ceph mon_status --cluster=rook-ceph-system --conf=/var/lib/rook/rook-ceph-system/rook-ceph-system.config --keyring=/var/lib/rook/rook-ceph-system/client.admin.keyring --format json --out-file /tmp/428137449
2018-06-07 14:41:16.726407 I | exec: 2018-06-07 14:41:16.521303 7fb788173700  0 monclient(hunting): authenticate timed out after 300
2018-06-07 14:41:16.521303 7fb788173700  0 monclient(hunting): authenticate timed out after 300
2018-06-07 14:41:16.521339 7fb788173700  0 librados: client.admin authentication error (110) Connection timed out
2018-06-07 14:41:16.521339 7fb788173700  0 librados: client.admin authentication error (110) Connection timed out
[errno 110] error connecting to the cluster
2018-06-07 14:41:21.726981 I | exec: Running command: ceph mon_status --cluster=rook-ceph-system --conf=/var/lib/rook/rook-ceph-system/rook-ceph-system.config --keyring=/var/lib/rook/rook-ceph-system/client.admin.keyring --format json --out-file /tmp/426646068