operator-2

gistfile1.txt

2019-08-06 13:48:46.580321 I | rookcmd: starting Rook v1.0.4 with arguments '/usr/local/bin/rook ceph operator'
2019-08-06 13:48:46.580426 I | rookcmd: flag values: --alsologtostderr=false, --csi-attacher-image=quay.io/k8scsi/csi-attacher:v1.0.1, --csi-cephfs-image=quay.io/cephcsi/cephfsplugin:v1.0.0, --csi-cephfs-plugin-template-path=/etc/ceph-csi/cephfs/csi-cephfsplugin.yaml, --csi-cephfs-provisioner-template-path=/etc/ceph-csi/cephfs/csi-cephfsplugin-provisioner.yaml, --csi-enable-cephfs=false, --csi-enable-rbd=false, --csi-provisioner-image=quay.io/k8scsi/csi-provisioner:v1.0.1, --csi-rbd-image=quay.io/cephcsi/rbdplugin:v1.0.0, --csi-rbd-plugin-template-path=/etc/ceph-csi/rbd/csi-rbdplugin.yaml, --csi-rbd-provisioner-template-path=/etc/ceph-csi/rbd/csi-rbdplugin-provisioner.yaml, --csi-registrar-image=quay.io/k8scsi/csi-node-driver-registrar:v1.0.2, --csi-snapshotter-image=quay.io/k8scsi/csi-snapshotter:v1.0.1, --help=false, --log-flush-frequency=5s, --log-level=DEBUG, --log_backtrace_at=:0, --log_dir=, --log_file=, --logtostderr=true, --mon-healthcheck-interval=45s, --mon-out-timeout=10m0s, --skip_headers=false, --stderrthreshold=2, --v=0, --vmodule=
2019-08-06 13:48:46.582088 I | cephcmd: starting operator
2019-08-06 13:48:49.885433 I | op-agent: getting flexvolume dir path from FLEXVOLUME_DIR_PATH env var
2019-08-06 13:48:49.885448 I | op-agent: discovered flexvolume dir path from source env var. value: /var/lib/kubelet/volumeplugins
2019-08-06 13:48:49.885454 W | op-agent: Invalid ROOK_ENABLE_FSGROUP value "". Defaulting to "true".
2019-08-06 13:48:49.893314 I | op-agent: rook-ceph-agent daemonset already exists, updating ...
2019-08-06 13:48:49.906097 I | op-discover: rook-discover daemonset already exists, updating ...
2019-08-06 13:48:49.915340 I | operator: rook-provisioner ceph.rook.io/block started using ceph.rook.io flex vendor dir
I0806 13:48:49.915810       8 leaderelection.go:217] attempting to acquire leader lease  rook-ceph-stage-primary/ceph.rook.io-block...
2019-08-06 13:48:49.917908 I | operator: rook-provisioner rook.io/block started using rook.io flex vendor dir
2019-08-06 13:48:49.917920 I | operator: Watching the current namespace for a cluster CRD
2019-08-06 13:48:49.917924 I | op-cluster: start watching clusters in all namespaces
2019-08-06 13:48:49.917943 I | op-cluster: Enabling hotplug orchestration: ROOK_DISABLE_DEVICE_HOTPLUG=
I0806 13:48:49.918305       8 leaderelection.go:217] attempting to acquire leader lease  rook-ceph-stage-primary/rook.io-block...
2019-08-06 13:48:49.983198 I | op-cluster: start watching legacy rook clusters in all namespaces
2019-08-06 13:48:49.983504 I | op-cluster: starting cluster in namespace rook-ceph-stage-primary
2019-08-06 13:48:50.081371 D | op-cluster: Skipping -> Do not use all Nodes in cluster rook-ceph-stage-primary
2019-08-06 13:48:50.081389 D | op-cluster: Skipping -> Do not use all Nodes in cluster rook-ceph-stage-primary
2019-08-06 13:48:50.081399 D | op-cluster: Skipping -> Do not use all Nodes in cluster rook-ceph-stage-primary
2019-08-06 13:48:50.081407 D | op-cluster: Skipping -> Do not use all Nodes in cluster rook-ceph-stage-primary
2019-08-06 13:48:50.081416 D | op-cluster: Skipping -> Node is not tolerable for cluster rook-ceph-stage-primary
2019-08-06 13:48:50.081424 D | op-cluster: Skipping -> Do not use all Nodes in cluster rook-ceph-stage-primary
2019-08-06 13:48:50.081433 D | op-cluster: Skipping -> Do not use all Nodes in cluster rook-ceph-stage-primary
2019-08-06 13:48:50.081448 D | op-cluster: Skipping -> Do not use all Nodes in cluster rook-ceph-stage-primary
2019-08-06 13:48:50.081461 D | op-cluster: Skipping -> Do not use all Nodes in cluster rook-ceph-stage-primary
2019-08-06 13:48:50.081470 D | op-cluster: Skipping -> Do not use all Nodes in cluster rook-ceph-stage-primary
2019-08-06 13:48:50.081480 D | op-cluster: Skipping -> Node is not tolerable for cluster rook-ceph-stage-primary
2019-08-06 13:48:50.081489 D | op-cluster: Skipping -> Do not use all Nodes in cluster rook-ceph-stage-primary
2019-08-06 13:48:50.081500 D | op-cluster: Skipping -> Do not use all Nodes in cluster rook-ceph-stage-primary
2019-08-06 13:48:50.081622 D | op-cluster: Skipping -> Do not use all Nodes in cluster rook-ceph-stage-primary
2019-08-06 13:48:50.081633 D | op-cluster: Skipping -> Do not use all Nodes in cluster rook-ceph-stage-primary
2019-08-06 13:48:50.081643 D | op-cluster: Skipping -> Do not use all Nodes in cluster rook-ceph-stage-primary
2019-08-06 13:48:50.081653 D | op-cluster: Skipping -> Do not use all Nodes in cluster rook-ceph-stage-primary
2019-08-06 13:48:50.081665 D | op-cluster: Skipping -> Do not use all Nodes in cluster rook-ceph-stage-primary
2019-08-06 13:48:50.081674 D | op-cluster: Skipping -> Do not use all Nodes in cluster rook-ceph-stage-primary
2019-08-06 13:48:50.081684 D | op-cluster: Skipping -> Do not use all Nodes in cluster rook-ceph-stage-primary
2019-08-06 13:48:50.081693 D | op-cluster: Skipping -> Do not use all Nodes in cluster rook-ceph-stage-primary
2019-08-06 13:48:50.081703 D | op-cluster: Skipping -> Node is not tolerable for cluster rook-ceph-stage-primary
2019-08-06 13:48:50.493305 D | op-cluster: Skipping cluster update. Updated node k8s-master-01.lxstage.domain.com was and it is still schedulable
2019-08-06 13:48:50.589800 D | op-cluster: Skipping cluster update. Updated node k8s-worker-33.lxstage.domain.com was and it is still schedulable
2019-08-06 13:48:51.120492 D | op-cluster: Skipping cluster update. Updated node k8s-worker-102.lxstage.domain.com was and it is still schedulable
2019-08-06 13:48:51.658317 D | op-cluster: Skipping cluster update. Updated node k8s-worker-03.lxstage.domain.com was and it is still schedulable
2019-08-06 13:48:51.906710 D | op-cluster: Skipping cluster update. Updated node k8s-worker-04.lxstage.domain.com was and it is still schedulable
2019-08-06 13:48:51.958749 D | op-cluster: Skipping cluster update. Updated node k8s-worker-21.lxstage.domain.com was and it is still schedulable
2019-08-06 13:48:52.893228 D | op-cluster: Skipping cluster update. Updated node k8s-worker-31.lxstage.domain.com was and it is still schedulable
2019-08-06 13:48:53.076758 D | op-cluster: Skipping cluster update. Updated node k8s-worker-01.lxstage.domain.com was and it is still schedulable
2019-08-06 13:48:53.159129 D | op-cluster: Skipping cluster update. Updated node k8s-worker-34.lxstage.domain.com was and it is still schedulable
2019-08-06 13:48:53.355964 D | op-cluster: Skipping cluster update. Updated node k8s-worker-101.lxstage.domain.com was and it is still schedulable
2019-08-06 13:48:53.865653 D | op-cluster: Skipping cluster update. Updated node k8s-worker-29.lxstage.domain.com was and it is still schedulable
2019-08-06 13:48:54.115804 D | op-cluster: Skipping cluster update. Updated node k8s-worker-20.lxstage.domain.com was and it is still schedulable
2019-08-06 13:48:54.842306 D | op-cluster: Skipping cluster update. Updated node k8s-worker-24.lxstage.domain.com was and it is still schedulable
2019-08-06 13:48:55.997600 I | op-k8sutil: waiting for job rook-ceph-detect-version to complete...
2019-08-06 13:48:56.051814 D | op-cluster: Skipping cluster update. Updated node k8s-worker-02.lxstage.domain.com was and it is still schedulable
2019-08-06 13:48:56.186011 D | op-cluster: Skipping cluster update. Updated node k8s-worker-22.lxstage.domain.com was and it is still schedulable
2019-08-06 13:48:56.213191 D | op-cluster: Skipping cluster update. Updated node k8s-worker-104.lxstage.domain.com was and it is still schedulable
2019-08-06 13:48:56.299340 D | op-cluster: Skipping cluster update. Updated node k8s-master-02.lxstage.domain.com was and it is still schedulable
2019-08-06 13:48:57.516907 D | op-cluster: Skipping cluster update. Updated node k8s-worker-103.lxstage.domain.com was and it is still schedulable
2019-08-06 13:48:57.931815 D | op-cluster: Skipping cluster update. Updated node k8s-worker-23.lxstage.domain.com was and it is still schedulable
2019-08-06 13:48:57.989634 D | op-cluster: Skipping cluster update. Updated node k8s-worker-30.lxstage.domain.com was and it is still schedulable
2019-08-06 13:48:59.093343 D | op-cluster: Skipping cluster update. Updated node k8s-worker-32.lxstage.domain.com was and it is still schedulable
2019-08-06 13:48:59.761240 D | op-cluster: Skipping cluster update. Updated node k8s-worker-00.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:00.504447 D | op-cluster: Skipping cluster update. Updated node k8s-master-01.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:00.614314 D | op-cluster: Skipping cluster update. Updated node k8s-worker-33.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:01.000997 E | op-cluster: unknown ceph major version. failed to complete version job. failed to detect job . jobs.batch "rook-ceph-detect-version" not found
2019-08-06 13:49:01.136544 D | op-cluster: Skipping cluster update. Updated node k8s-worker-102.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:01.679001 D | op-cluster: Skipping cluster update. Updated node k8s-worker-03.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:01.937097 D | op-cluster: Skipping cluster update. Updated node k8s-worker-04.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:01.977217 D | op-cluster: Skipping cluster update. Updated node k8s-worker-21.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:01.991029 I | op-k8sutil: waiting for job rook-ceph-detect-version to complete...
2019-08-06 13:49:02.911061 D | op-cluster: Skipping cluster update. Updated node k8s-worker-31.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:03.104001 D | op-cluster: Skipping cluster update. Updated node k8s-worker-01.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:03.181288 D | op-cluster: Skipping cluster update. Updated node k8s-worker-34.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:03.394828 D | op-cluster: Skipping cluster update. Updated node k8s-worker-101.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:03.884822 D | op-cluster: Skipping cluster update. Updated node k8s-worker-29.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:04.135034 D | op-cluster: Skipping cluster update. Updated node k8s-worker-20.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:04.860631 D | op-cluster: Skipping cluster update. Updated node k8s-worker-24.lxstage.domain.com was and it is still schedulable
I0806 13:49:04.991641       8 leaderelection.go:227] successfully acquired lease rook-ceph-stage-primary/ceph.rook.io-block
I0806 13:49:04.991781       8 controller.go:769] Starting provisioner controller ceph.rook.io/block_rook-ceph-operator-6b8b758497-trj9b_eb7b85f7-b850-11e9-ac15-22e0d9842c83!
I0806 13:49:04.991803       8 event.go:209] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"rook-ceph-stage-primary", Name:"ceph.rook.io-block", UID:"782fe0db-b792-11e9-9b32-0050568460f6", APIVersion:"v1", ResourceVersion:"308282514", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' rook-ceph-operator-6b8b758497-trj9b_eb7b85f7-b850-11e9-ac15-22e0d9842c83 became leader
I0806 13:49:05.092006       8 controller.go:818] Started provisioner controller ceph.rook.io/block_rook-ceph-operator-6b8b758497-trj9b_eb7b85f7-b850-11e9-ac15-22e0d9842c83!
I0806 13:49:05.092197       8 controller.go:1196] provision "admin-d0277887/datadir-zk-1" class "default": started
I0806 13:49:05.098216       8 controller.go:1205] provision "admin-d0277887/datadir-zk-1" class "default": persistentvolume "pvc-95509a25-9be6-11e9-9a2e-0050568460f6" already exists, skipping
2019-08-06 13:49:06.072706 D | op-cluster: Skipping cluster update. Updated node k8s-worker-02.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:06.205380 D | op-cluster: Skipping cluster update. Updated node k8s-worker-22.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:06.232694 D | op-cluster: Skipping cluster update. Updated node k8s-worker-104.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:06.321428 D | op-cluster: Skipping cluster update. Updated node k8s-master-02.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:06.995485 E | op-cluster: unknown ceph major version. failed to complete version job. failed to detect job . jobs.batch "rook-ceph-detect-version" not found
I0806 13:49:07.046022       8 leaderelection.go:227] successfully acquired lease rook-ceph-stage-primary/rook.io-block
I0806 13:49:07.046154       8 event.go:209] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"rook-ceph-stage-primary", Name:"rook.io-block", UID:"782fdbfc-b792-11e9-9b32-0050568460f6", APIVersion:"v1", ResourceVersion:"308282580", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' rook-ceph-operator-6b8b758497-trj9b_eb7ba276-b850-11e9-ac15-22e0d9842c83 became leader
I0806 13:49:07.046185       8 controller.go:769] Starting provisioner controller rook.io/block_rook-ceph-operator-6b8b758497-trj9b_eb7ba276-b850-11e9-ac15-22e0d9842c83!
I0806 13:49:07.146420       8 controller.go:818] Started provisioner controller rook.io/block_rook-ceph-operator-6b8b758497-trj9b_eb7ba276-b850-11e9-ac15-22e0d9842c83!
2019-08-06 13:49:07.537504 D | op-cluster: Skipping cluster update. Updated node k8s-worker-103.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:07.958435 D | op-cluster: Skipping cluster update. Updated node k8s-worker-23.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:07.990737 I | op-k8sutil: waiting for job rook-ceph-detect-version to complete...
2019-08-06 13:49:08.007496 D | op-cluster: Skipping cluster update. Updated node k8s-worker-30.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:09.120947 D | op-cluster: Skipping cluster update. Updated node k8s-worker-32.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:09.781012 D | op-cluster: Skipping cluster update. Updated node k8s-worker-00.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:10.518515 D | op-cluster: Skipping cluster update. Updated node k8s-master-01.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:10.629186 D | op-cluster: Skipping cluster update. Updated node k8s-worker-33.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:11.153524 D | op-cluster: Skipping cluster update. Updated node k8s-worker-102.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:11.695390 D | op-cluster: Skipping cluster update. Updated node k8s-worker-03.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:11.954464 D | op-cluster: Skipping cluster update. Updated node k8s-worker-04.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:11.997470 D | op-cluster: Skipping cluster update. Updated node k8s-worker-21.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:12.925374 D | op-cluster: Skipping cluster update. Updated node k8s-worker-31.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:12.994066 E | op-cluster: unknown ceph major version. failed to complete version job. failed to detect job . jobs.batch "rook-ceph-detect-version" not found
2019-08-06 13:49:13.127866 D | op-cluster: Skipping cluster update. Updated node k8s-worker-01.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:13.204772 D | op-cluster: Skipping cluster update. Updated node k8s-worker-34.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:13.412753 D | op-cluster: Skipping cluster update. Updated node k8s-worker-101.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:13.902716 D | op-cluster: Skipping cluster update. Updated node k8s-worker-29.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:13.991009 I | op-k8sutil: waiting for job rook-ceph-detect-version to complete...
2019-08-06 13:49:14.156877 D | op-cluster: Skipping cluster update. Updated node k8s-worker-20.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:14.881937 D | op-cluster: Skipping cluster update. Updated node k8s-worker-24.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:16.090832 D | op-cluster: Skipping cluster update. Updated node k8s-worker-02.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:16.225454 D | op-cluster: Skipping cluster update. Updated node k8s-worker-22.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:16.254993 D | op-cluster: Skipping cluster update. Updated node k8s-worker-104.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:16.336819 D | op-cluster: Skipping cluster update. Updated node k8s-master-02.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:17.558193 D | op-cluster: Skipping cluster update. Updated node k8s-worker-103.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:17.973791 D | op-cluster: Skipping cluster update. Updated node k8s-worker-23.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:18.035279 D | op-cluster: Skipping cluster update. Updated node k8s-worker-30.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:18.994112 E | op-cluster: unknown ceph major version. failed to complete version job. failed to detect job . jobs.batch "rook-ceph-detect-version" not found
2019-08-06 13:49:19.141988 D | op-cluster: Skipping cluster update. Updated node k8s-worker-32.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:19.798155 D | op-cluster: Skipping cluster update. Updated node k8s-worker-00.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:19.994082 I | op-k8sutil: waiting for job rook-ceph-detect-version to complete...
2019-08-06 13:49:20.533763 D | op-cluster: Skipping cluster update. Updated node k8s-master-01.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:20.647870 D | op-cluster: Skipping cluster update. Updated node k8s-worker-33.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:21.173687 D | op-cluster: Skipping cluster update. Updated node k8s-worker-102.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:21.713189 D | op-cluster: Skipping cluster update. Updated node k8s-worker-03.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:21.974473 D | op-cluster: Skipping cluster update. Updated node k8s-worker-04.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:22.017458 D | op-cluster: Skipping cluster update. Updated node k8s-worker-21.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:22.946804 D | op-cluster: Skipping cluster update. Updated node k8s-worker-31.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:23.147981 D | op-cluster: Skipping cluster update. Updated node k8s-worker-01.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:23.224241 D | op-cluster: Skipping cluster update. Updated node k8s-worker-34.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:23.431752 D | op-cluster: Skipping cluster update. Updated node k8s-worker-101.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:23.929201 D | op-cluster: Skipping cluster update. Updated node k8s-worker-29.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:24.175387 D | op-cluster: Skipping cluster update. Updated node k8s-worker-20.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:24.901940 D | op-cluster: Skipping cluster update. Updated node k8s-worker-24.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:24.997921 E | op-cluster: unknown ceph major version. failed to complete version job. failed to detect job . jobs.batch "rook-ceph-detect-version" not found
2019-08-06 13:49:25.992339 I | op-k8sutil: waiting for job rook-ceph-detect-version to complete...
2019-08-06 13:49:26.107329 D | op-cluster: Skipping cluster update. Updated node k8s-worker-02.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:26.242929 D | op-cluster: Skipping cluster update. Updated node k8s-worker-22.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:26.274559 D | op-cluster: Skipping cluster update. Updated node k8s-worker-104.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:26.353601 D | op-cluster: Skipping cluster update. Updated node k8s-master-02.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:27.583536 D | op-cluster: Skipping cluster update. Updated node k8s-worker-103.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:27.995369 D | op-cluster: Skipping cluster update. Updated node k8s-worker-23.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:28.063093 D | op-cluster: Skipping cluster update. Updated node k8s-worker-30.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:29.165747 D | op-cluster: Skipping cluster update. Updated node k8s-worker-32.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:29.815705 D | op-cluster: Skipping cluster update. Updated node k8s-worker-00.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:30.548878 D | op-cluster: Skipping cluster update. Updated node k8s-master-01.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:30.664212 D | op-cluster: Skipping cluster update. Updated node k8s-worker-33.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:30.995544 E | op-cluster: unknown ceph major version. failed to complete version job. failed to detect job . jobs.batch "rook-ceph-detect-version" not found
2019-08-06 13:49:31.191561 D | op-cluster: Skipping cluster update. Updated node k8s-worker-102.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:31.736349 D | op-cluster: Skipping cluster update. Updated node k8s-worker-03.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:31.993689 D | op-cluster: Skipping cluster update. Updated node k8s-worker-04.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:31.998834 I | op-k8sutil: waiting for job rook-ceph-detect-version to complete...
2019-08-06 13:49:32.034261 D | op-cluster: Skipping cluster update. Updated node k8s-worker-21.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:32.968383 D | op-cluster: Skipping cluster update. Updated node k8s-worker-31.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:33.164861 D | op-cluster: Skipping cluster update. Updated node k8s-worker-01.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:33.245468 D | op-cluster: Skipping cluster update. Updated node k8s-worker-34.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:33.453294 D | op-cluster: Skipping cluster update. Updated node k8s-worker-101.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:33.950374 D | op-cluster: Skipping cluster update. Updated node k8s-worker-29.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:34.195875 D | op-cluster: Skipping cluster update. Updated node k8s-worker-20.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:34.932711 D | op-cluster: Skipping cluster update. Updated node k8s-worker-24.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:36.126300 D | op-cluster: Skipping cluster update. Updated node k8s-worker-02.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:36.263358 D | op-cluster: Skipping cluster update. Updated node k8s-worker-22.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:36.296427 D | op-cluster: Skipping cluster update. Updated node k8s-worker-104.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:36.372313 D | op-cluster: Skipping cluster update. Updated node k8s-master-02.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:37.002308 E | op-cluster: unknown ceph major version. failed to complete version job. failed to detect job . jobs.batch "rook-ceph-detect-version" not found
2019-08-06 13:49:37.605347 D | op-cluster: Skipping cluster update. Updated node k8s-worker-103.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:37.991815 I | op-k8sutil: waiting for job rook-ceph-detect-version to complete...
2019-08-06 13:49:38.019247 D | op-cluster: Skipping cluster update. Updated node k8s-worker-23.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:38.087105 D | op-cluster: Skipping cluster update. Updated node k8s-worker-30.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:39.196225 D | op-cluster: Skipping cluster update. Updated node k8s-worker-32.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:39.832387 D | op-cluster: Skipping cluster update. Updated node k8s-worker-00.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:40.567652 D | op-cluster: Skipping cluster update. Updated node k8s-master-01.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:40.696478 D | op-cluster: Skipping cluster update. Updated node k8s-worker-33.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:41.213859 D | op-cluster: Skipping cluster update. Updated node k8s-worker-102.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:41.755564 D | op-cluster: Skipping cluster update. Updated node k8s-worker-03.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:42.012490 D | op-cluster: Skipping cluster update. Updated node k8s-worker-04.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:42.080938 D | op-cluster: Skipping cluster update. Updated node k8s-worker-21.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:42.984949 D | op-cluster: Skipping cluster update. Updated node k8s-worker-31.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:42.995202 E | op-cluster: unknown ceph major version. failed to complete version job. failed to detect job . jobs.batch "rook-ceph-detect-version" not found
2019-08-06 13:49:43.182441 D | op-cluster: Skipping cluster update. Updated node k8s-worker-01.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:43.268286 D | op-cluster: Skipping cluster update. Updated node k8s-worker-34.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:43.473077 D | op-cluster: Skipping cluster update. Updated node k8s-worker-101.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:43.976231 D | op-cluster: Skipping cluster update. Updated node k8s-worker-29.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:43.998878 I | op-k8sutil: waiting for job rook-ceph-detect-version to complete...
2019-08-06 13:49:44.231994 D | op-cluster: Skipping cluster update. Updated node k8s-worker-20.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:44.983846 D | op-cluster: Skipping cluster update. Updated node k8s-worker-24.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:46.147447 D | op-cluster: Skipping cluster update. Updated node k8s-worker-02.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:46.286157 D | op-cluster: Skipping cluster update. Updated node k8s-worker-22.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:46.327984 D | op-cluster: Skipping cluster update. Updated node k8s-worker-104.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:46.390366 D | op-cluster: Skipping cluster update. Updated node k8s-master-02.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:47.630765 D | op-cluster: Skipping cluster update. Updated node k8s-worker-103.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:48.052543 D | op-cluster: Skipping cluster update. Updated node k8s-worker-23.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:48.113098 D | op-cluster: Skipping cluster update. Updated node k8s-worker-30.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:49.002386 E | op-cluster: unknown ceph major version. failed to complete version job. failed to detect job . jobs.batch "rook-ceph-detect-version" not found
2019-08-06 13:49:49.221635 D | op-cluster: Skipping cluster update. Updated node k8s-worker-32.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:49.852024 D | op-cluster: Skipping cluster update. Updated node k8s-worker-00.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:49.991758 I | op-k8sutil: waiting for job rook-ceph-detect-version to complete...
2019-08-06 13:49:50.579366 D | op-cluster: Skipping cluster update. Updated node k8s-master-01.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:50.712952 D | op-cluster: Skipping cluster update. Updated node k8s-worker-33.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:51.227439 D | op-cluster: Skipping cluster update. Updated node k8s-worker-102.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:51.775949 D | op-cluster: Skipping cluster update. Updated node k8s-worker-03.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:52.033685 D | op-cluster: Skipping cluster update. Updated node k8s-worker-04.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:52.097721 D | op-cluster: Skipping cluster update. Updated node k8s-worker-21.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:53.001291 D | op-cluster: Skipping cluster update. Updated node k8s-worker-31.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:53.200246 D | op-cluster: Skipping cluster update. Updated node k8s-worker-01.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:53.290704 D | op-cluster: Skipping cluster update. Updated node k8s-worker-34.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:53.491496 D | op-cluster: Skipping cluster update. Updated node k8s-worker-101.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:53.995307 D | op-cluster: Skipping cluster update. Updated node k8s-worker-29.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:54.248956 D | op-cluster: Skipping cluster update. Updated node k8s-worker-20.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:54.999799 D | op-cluster: Skipping cluster update. Updated node k8s-worker-24.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:55.006931 E | op-cluster: unknown ceph major version. failed to complete version job. failed to detect job . jobs.batch "rook-ceph-detect-version" not found
2019-08-06 13:49:55.991155 I | op-k8sutil: waiting for job rook-ceph-detect-version to complete...
2019-08-06 13:49:56.167545 D | op-cluster: Skipping cluster update. Updated node k8s-worker-02.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:56.304921 D | op-cluster: Skipping cluster update. Updated node k8s-worker-22.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:56.351785 D | op-cluster: Skipping cluster update. Updated node k8s-worker-104.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:56.409254 D | op-cluster: Skipping cluster update. Updated node k8s-master-02.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:57.649993 D | op-cluster: Skipping cluster update. Updated node k8s-worker-103.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:58.070047 D | op-cluster: Skipping cluster update. Updated node k8s-worker-23.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:58.132424 D | op-cluster: Skipping cluster update. Updated node k8s-worker-30.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:59.253790 D | op-cluster: Skipping cluster update. Updated node k8s-worker-32.lxstage.domain.com was and it is still schedulable
2019-08-06 13:49:59.877054 D | op-cluster: Skipping cluster update. Updated node k8s-worker-00.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:00.592717 D | op-cluster: Skipping cluster update. Updated node k8s-master-01.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:00.726855 D | op-cluster: Skipping cluster update. Updated node k8s-worker-33.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:00.995232 E | op-cluster: unknown ceph major version. failed to complete version job. failed to detect job . jobs.batch "rook-ceph-detect-version" not found
2019-08-06 13:50:01.244487 D | op-cluster: Skipping cluster update. Updated node k8s-worker-102.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:01.795066 D | op-cluster: Skipping cluster update. Updated node k8s-worker-03.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:01.991506 I | op-k8sutil: waiting for job rook-ceph-detect-version to complete...
2019-08-06 13:50:02.052775 D | op-cluster: Skipping cluster update. Updated node k8s-worker-04.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:02.122750 D | op-cluster: Skipping cluster update. Updated node k8s-worker-21.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:03.029995 D | op-cluster: Skipping cluster update. Updated node k8s-worker-31.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:03.225146 D | op-cluster: Skipping cluster update. Updated node k8s-worker-01.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:03.320376 D | op-cluster: Skipping cluster update. Updated node k8s-worker-34.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:03.522882 D | op-cluster: Skipping cluster update. Updated node k8s-worker-101.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:04.029044 D | op-cluster: Skipping cluster update. Updated node k8s-worker-29.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:04.276413 D | op-cluster: Skipping cluster update. Updated node k8s-worker-20.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:05.014638 D | op-cluster: Skipping cluster update. Updated node k8s-worker-24.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:06.190866 D | op-cluster: Skipping cluster update. Updated node k8s-worker-02.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:06.329095 D | op-cluster: Skipping cluster update. Updated node k8s-worker-22.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:06.373707 D | op-cluster: Skipping cluster update. Updated node k8s-worker-104.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:06.427552 D | op-cluster: Skipping cluster update. Updated node k8s-master-02.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:06.995143 E | op-cluster: unknown ceph major version. failed to complete version job. failed to detect job . jobs.batch "rook-ceph-detect-version" not found
2019-08-06 13:50:07.670406 D | op-cluster: Skipping cluster update. Updated node k8s-worker-103.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:07.991662 I | op-k8sutil: waiting for job rook-ceph-detect-version to complete...
2019-08-06 13:50:08.084630 D | op-cluster: Skipping cluster update. Updated node k8s-worker-23.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:08.155291 D | op-cluster: Skipping cluster update. Updated node k8s-worker-30.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:09.279598 D | op-cluster: Skipping cluster update. Updated node k8s-worker-32.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:09.898399 D | op-cluster: Skipping cluster update. Updated node k8s-worker-00.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:10.608132 D | op-cluster: Skipping cluster update. Updated node k8s-master-01.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:10.747394 D | op-cluster: Skipping cluster update. Updated node k8s-worker-33.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:11.267155 D | op-cluster: Skipping cluster update. Updated node k8s-worker-102.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:11.815559 D | op-cluster: Skipping cluster update. Updated node k8s-worker-03.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:12.073694 D | op-cluster: Skipping cluster update. Updated node k8s-worker-04.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:12.139084 D | op-cluster: Skipping cluster update. Updated node k8s-worker-21.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:12.995960 E | op-cluster: unknown ceph major version. failed to complete version job. failed to detect job . jobs.batch "rook-ceph-detect-version" not found
2019-08-06 13:50:13.051181 D | op-cluster: Skipping cluster update. Updated node k8s-worker-31.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:13.242286 D | op-cluster: Skipping cluster update. Updated node k8s-worker-01.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:13.340504 D | op-cluster: Skipping cluster update. Updated node k8s-worker-34.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:13.543783 D | op-cluster: Skipping cluster update. Updated node k8s-worker-101.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:13.992160 I | op-k8sutil: waiting for job rook-ceph-detect-version to complete...
2019-08-06 13:50:14.048899 D | op-cluster: Skipping cluster update. Updated node k8s-worker-29.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:14.299997 D | op-cluster: Skipping cluster update. Updated node k8s-worker-20.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:15.034773 D | op-cluster: Skipping cluster update. Updated node k8s-worker-24.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:16.208362 D | op-cluster: Skipping cluster update. Updated node k8s-worker-02.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:16.345683 D | op-cluster: Skipping cluster update. Updated node k8s-worker-22.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:16.395983 D | op-cluster: Skipping cluster update. Updated node k8s-worker-104.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:16.444576 D | op-cluster: Skipping cluster update. Updated node k8s-master-02.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:17.694329 D | op-cluster: Skipping cluster update. Updated node k8s-worker-103.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:18.107971 D | op-cluster: Skipping cluster update. Updated node k8s-worker-23.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:18.174180 D | op-cluster: Skipping cluster update. Updated node k8s-worker-30.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:18.995344 E | op-cluster: unknown ceph major version. failed to complete version job. failed to detect job . jobs.batch "rook-ceph-detect-version" not found
2019-08-06 13:50:19.305777 D | op-cluster: Skipping cluster update. Updated node k8s-worker-32.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:19.976121 D | op-cluster: Skipping cluster update. Updated node k8s-worker-00.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:19.991544 I | op-k8sutil: waiting for job rook-ceph-detect-version to complete...
2019-08-06 13:50:20.621675 D | op-cluster: Skipping cluster update. Updated node k8s-master-01.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:20.767897 D | op-cluster: Skipping cluster update. Updated node k8s-worker-33.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:21.289688 D | op-cluster: Skipping cluster update. Updated node k8s-worker-102.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:21.834913 D | op-cluster: Skipping cluster update. Updated node k8s-worker-03.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:22.088802 D | op-cluster: Skipping cluster update. Updated node k8s-worker-04.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:22.161459 D | op-cluster: Skipping cluster update. Updated node k8s-worker-21.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:23.067619 D | op-cluster: Skipping cluster update. Updated node k8s-worker-31.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:23.259987 D | op-cluster: Skipping cluster update. Updated node k8s-worker-01.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:23.358502 D | op-cluster: Skipping cluster update. Updated node k8s-worker-34.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:23.560029 D | op-cluster: Skipping cluster update. Updated node k8s-worker-101.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:24.076071 D | op-cluster: Skipping cluster update. Updated node k8s-worker-29.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:24.316888 D | op-cluster: Skipping cluster update. Updated node k8s-worker-20.lxstage.domain.com was and it is still schedulable
2019-08-06 13:50:24.995308 E | op-cluster: unknown ceph major version. failed to complete version job. failed to detect job . jobs.batch "rook-ceph-detect-version" not found
2019-08-06 13:50:25.054238 D | op-cluster: Skipping cluster update. Updated node k8s-worker-24.lxstage.domain.com was and it is still schedulable