k8s-bug-41762-controller-manager.md

CI script:

service "harry" configured
configmap "harry" configured
service "db" configured
deployment "harry" configured
+ set +o xtrace
20:45:44 desired:  2; present:  4; available:  2; updated:  2; unavailable:  2
20:45:46 desired:  2; present:  4; available:  2; updated:  2; unavailable:  2
20:45:47 desired:  2; present:  4; available:  2; updated:  2; unavailable:  2
20:45:48 desired:  2; present:  4; available:  2; updated:  2; unavailable:  2
20:45:49 desired:  2; present:  4; available:  2; updated:  2; unavailable:  2
20:45:50 desired:  2; present:  4; available:  2; updated:  2; unavailable:  2
20:45:51 desired:  2; present:  4; available:  2; updated:  2; unavailable:  2
20:45:52 desired:  2; present:  4; available:  2; updated:  2; unavailable:  2
20:45:53 desired:  2; present:  4; available:  2; updated:  2; unavailable:  2
20:45:54 desired:  2; present:  4; available:  2; updated:  2; unavailable:  2
20:45:55 desired:  2; present:  4; available:  2; updated:  2; unavailable:  2
20:45:57 desired:  2; present:  4; available:  2; updated:  2; unavailable:  2
20:45:58 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:45:59 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:00 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:01 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:02 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:03 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:04 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:05 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:06 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:08 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:09 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:10 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:11 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:12 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:13 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:14 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:15 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:16 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:18 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:19 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:20 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:21 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:22 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:23 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:24 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:25 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:26 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:27 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:29 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:30 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:31 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:32 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:33 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:34 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:35 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:36 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:37 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:38 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:40 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:41 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:42 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:43 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:44 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:45 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:46 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:47 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:48 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:49 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:51 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:52 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:53 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:54 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:55 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:56 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:57 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:58 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:46:59 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:01 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:02 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:03 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:04 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:05 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:06 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:07 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:08 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:09 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:10 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:12 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:13 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:14 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:15 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:16 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:17 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:18 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:19 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:20 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:21 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:23 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:24 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:25 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:26 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:27 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:28 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:29 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:30 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:31 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:32 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:34 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:35 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:36 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:37 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:38 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:39 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:40 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:41 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:42 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:43 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:45 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:46 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:47 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:48 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:49 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:50 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:51 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:52 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:53 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:54 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:56 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:57 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:58 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:47:59 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:48:00 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:48:01 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:48:02 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:48:03 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:48:04 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:48:05 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:48:07 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1
20:48:08 desired:  2; present:  3; available:  2; updated:  2; unavailable:  1

controller-manager logs (--v=2):

kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:39:41.322596       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:39:42.438405       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:39:43.712734       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:39:44.896245       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:39:46.668440       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:39:47.852955       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:39:49.142312       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:39:50.327730       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:39:51.362979       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:39:52.407810       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:39:53.594063       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:39:54.557194       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:39:55.743967       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:39:57.145568       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:39:58.332330       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:40:01.226761       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:40:01.405313       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:40:02.412957       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:40:04.104727       1 pet_set.go:324] Syncing StatefulSet customer-facing-dev/api-oldnode with 1 pods
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:40:04.107506       1 pet_set.go:324] Syncing StatefulSet customer-facing-prod/api-oldnode with 3 pods
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:40:05.564616       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:40:06.751197       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:40:08.072269       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:40:09.259531       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:40:10.199423       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:40:11.386894       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:40:11.446728       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:40:12.889642       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:40:14.077253       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:40:16.779555       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:40:17.967416       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:40:19.351756       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:40:20.540089       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:40:21.488982       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:40:21.709623       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:40:22.898639       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:40:26.111311       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:40:27.300599       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:40:29.332483       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:40:30.524380       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:40:31.530921       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:40:33.537198       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:40:34.104863       1 pet_set.go:324] Syncing StatefulSet customer-facing-dev/api-oldnode with 1 pods
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:40:34.107985       1 pet_set.go:324] Syncing StatefulSet customer-facing-prod/api-oldnode with 3 pods
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:40:34.728073       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:40:35.609732       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:40:36.800865       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:40:38.793028       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:40:39.985684       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:40:41.573792       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:40:41.687214       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:40:42.880805       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:40:43.827670       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:40:45.022594       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:40:46.048484       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:40:47.245090       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:40:50.397332       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:40:51.594088       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:40:51.615534       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:40:54.412490       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:40:55.609792       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:40:58.773500       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:40:59.971668       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:41:01.657658       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:41:02.998958       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:41:04.105061       1 pet_set.go:324] Syncing StatefulSet customer-facing-dev/api-oldnode with 1 pods
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:41:04.107927       1 pet_set.go:324] Syncing StatefulSet customer-facing-prod/api-oldnode with 3 pods
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:41:04.198027       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:41:06.818325       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:41:08.017177       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:41:10.138740       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:41:11.337722       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:41:11.698235       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:41:12.174245       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:41:13.373210       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:41:15.680313       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:41:16.879673       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:41:17.843039       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:41:19.042425       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:41:20.027659       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:41:21.227684       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:41:21.739882       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:41:23.559448       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:41:24.760614       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:41:26.473307       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager W0221 20:41:27.197005       1 reflector.go:319] pkg/controller/garbagecollector/garbagecollector.go:768: watch of <nil> ended with: 401: The event in requested index is outdated and cleared (the requested history has been cleared [26088686/26087951]) [26089685]
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:41:27.675095       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:41:29.179889       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:41:30.382080       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:41:31.781265       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:41:32.541816       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:41:33.745036       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:41:34.105156       1 pet_set.go:324] Syncing StatefulSet customer-facing-dev/api-oldnode with 1 pods
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:41:34.109294       1 pet_set.go:324] Syncing StatefulSet customer-facing-prod/api-oldnode with 3 pods
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:41:35.630198       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:41:36.834200       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:41:38.810014       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:41:40.014159       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:41:41.822081       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:41:41.893293       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:41:43.098387       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:41:45.876450       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:41:46.161478       1 event.go:217] Event(api.ObjectReference{Kind:"Deployment", Namespace:"harry-prod", Name:"harry", UID:"2675ef38-f7ae-11e6-8942-06d4a1d2d964", APIVersion:"extensions", ResourceVersion:"26089755", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set harry-797938840 to 2
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:41:46.161680       1 replica_set.go:479] Too few "harry-prod"/"harry-797938840" replicas, need 2, creating 2
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:41:46.169523       1 event.go:217] Event(api.ObjectReference{Kind:"ReplicaSet", Namespace:"harry-prod", Name:"harry-797938840", UID:"29262756-f876-11e6-8942-06d4a1d2d964", APIVersion:"extensions", ResourceVersion:"26089756", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: harry-797938840-9tpq4
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:41:46.171898       1 event.go:217] Event(api.ObjectReference{Kind:"ReplicaSet", Namespace:"harry-prod", Name:"harry-797938840", UID:"29262756-f876-11e6-8942-06d4a1d2d964", APIVersion:"extensions", ResourceVersion:"26089756", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: harry-797938840-5m3rq
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:41:46.175547       1 deployment_controller.go:298] Error syncing deployment harry-prod/harry: Operation cannot be fulfilled on deployments.extensions "harry": the object has been modified; please apply your changes to the latest version and try again
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:41:46.196958       1 deployment_controller.go:298] Error syncing deployment harry-prod/harry: Operation cannot be fulfilled on deployments.extensions "harry": the object has been modified; please apply your changes to the latest version and try again
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:41:46.216390       1 deployment_controller.go:298] Error syncing deployment harry-prod/harry: Operation cannot be fulfilled on deployments.extensions "harry": the object has been modified; please apply your changes to the latest version and try again
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:41:47.081946       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:41:49.905982       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:41:51.111833       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:41:51.869087       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:41:53.578886       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:41:54.786657       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:41:57.172651       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:41:58.381986       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:42:01.073660       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:42:01.912796       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:42:02.283844       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:42:02.838439       1 event.go:217] Event(api.ObjectReference{Kind:"Deployment", Namespace:"harry-prod", Name:"harry", UID:"2675ef38-f7ae-11e6-8942-06d4a1d2d964", APIVersion:"extensions", ResourceVersion:"26089772", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled down replica set harry-803443864 to 0
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:42:02.838509       1 replica_set.go:512] Too many "harry-prod"/"harry-803443864" replicas, need 0, deleting 2
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:42:02.838553       1 controller_utils.go:523] Controller harry-803443864 deleting pod harry-prod/harry-803443864-1nv2c
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:42:02.838557       1 controller_utils.go:523] Controller harry-803443864 deleting pod harry-prod/harry-803443864-8cbbw
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:42:02.847289       1 event.go:217] Event(api.ObjectReference{Kind:"ReplicaSet", Namespace:"harry-prod", Name:"harry-803443864", UID:"638d6ba5-f867-11e6-8942-06d4a1d2d964", APIVersion:"extensions", ResourceVersion:"26089881", FieldPath:""}): type: 'Normal' reason: 'SuccessfulDelete' Deleted pod: harry-803443864-1nv2c
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:42:02.848475       1 event.go:217] Event(api.ObjectReference{Kind:"ReplicaSet", Namespace:"harry-prod", Name:"harry-803443864", UID:"638d6ba5-f867-11e6-8942-06d4a1d2d964", APIVersion:"extensions", ResourceVersion:"26089881", FieldPath:""}): type: 'Normal' reason: 'SuccessfulDelete' Deleted pod: harry-803443864-8cbbw
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:42:02.855688       1 deployment_controller.go:298] Error syncing deployment harry-prod/harry: Operation cannot be fulfilled on deployments.extensions "harry": the object has been modified; please apply your changes to the latest version and try again
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:42:02.864310       1 deployment_controller.go:298] Error syncing deployment harry-prod/harry: Deployment.extensions "harry" is invalid: status.unavailableReplicas: Invalid value: -2: must be greater than or equal to 0
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:42:02.871039       1 deployment_controller.go:298] Error syncing deployment harry-prod/harry: Deployment.extensions "harry" is invalid: status.unavailableReplicas: Invalid value: -2: must be greater than or equal to 0
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:42:02.893025       1 deployment_controller.go:298] Error syncing deployment harry-prod/harry: Operation cannot be fulfilled on deployments.extensions "harry": the object has been modified; please apply your changes to the latest version and try again
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:42:04.105253       1 pet_set.go:324] Syncing StatefulSet customer-facing-dev/api-oldnode with 1 pods
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:42:04.107963       1 pet_set.go:324] Syncing StatefulSet customer-facing-prod/api-oldnode with 3 pods
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:42:04.702201       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:42:05.913704       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:42:07.201673       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:42:08.414393       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:42:11.467464       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:42:11.954659       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:42:12.681193       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:42:14.319089       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:42:15.533614       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:42:17.436439       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:42:18.651244       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:42:20.724194       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:42:21.939234       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:42:21.996372       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:42:23.085297       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:42:24.300975       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:42:25.526265       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:42:26.742581       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:42:28.634386       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:42:29.851691       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:42:31.665526       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:42:32.040068       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:42:32.883437       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:42:34.105290       1 pet_set.go:324] Syncing StatefulSet customer-facing-dev/api-oldnode with 1 pods
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:42:34.108054       1 pet_set.go:324] Syncing StatefulSet customer-facing-prod/api-oldnode with 3 pods
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:42:34.115985       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:42:35.334281       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:42:36.811424       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:42:38.030004       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:42:41.185381       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:42:42.085284       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:42:42.403686       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:42:43.733444       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:42:44.952242       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:42:45.798339       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:42:47.017622       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:42:48.594600       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:42:49.814479       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:42:51.938177       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:42:52.127888       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:42:53.158719       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:42:53.959384       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:42:55.180006       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:42:56.121785       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:42:57.342781       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:43:00.177616       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:43:01.399244       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:43:02.167010       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:43:03.075918       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:43:04.105457       1 pet_set.go:324] Syncing StatefulSet customer-facing-dev/api-oldnode with 1 pods
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:43:04.108243       1 pet_set.go:324] Syncing StatefulSet customer-facing-prod/api-oldnode with 3 pods
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:43:04.298065       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:43:05.717738       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:43:06.940945       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:43:08.120556       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:43:09.342720       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:43:10.506343       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:43:11.728824       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:43:12.207612       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:43:13.499696       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:43:14.722816       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:43:17.645740       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:43:18.869013       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:43:21.465839       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:43:22.256845       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:43:22.689681       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:43:24.465198       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:43:25.690545       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:43:26.967594       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:43:28.193111       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:43:30.124377       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:43:31.350037       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:43:32.303656       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:43:33.467332       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:43:34.105541       1 pet_set.go:324] Syncing StatefulSet customer-facing-dev/api-oldnode with 1 pods
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:43:34.108537       1 pet_set.go:324] Syncing StatefulSet customer-facing-prod/api-oldnode with 3 pods
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:43:34.693918       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:43:37.175096       1 replica_set.go:479] Too few "harry-prod"/"harry-3463157296" replicas, need 2, creating 2
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:43:37.175126       1 event.go:217] Event(api.ObjectReference{Kind:"Deployment", Namespace:"harry-prod", Name:"harry", UID:"2675ef38-f7ae-11e6-8942-06d4a1d2d964", APIVersion:"extensions", ResourceVersion:"26090270", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set harry-3463157296 to 2
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:43:37.181844       1 event.go:217] Event(api.ObjectReference{Kind:"ReplicaSet", Namespace:"harry-prod", Name:"harry-3463157296", UID:"6b517d69-f876-11e6-8942-06d4a1d2d964", APIVersion:"extensions", ResourceVersion:"26090271", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: harry-3463157296-871sc
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:43:37.182632       1 event.go:217] Event(api.ObjectReference{Kind:"ReplicaSet", Namespace:"harry-prod", Name:"harry-3463157296", UID:"6b517d69-f876-11e6-8942-06d4a1d2d964", APIVersion:"extensions", ResourceVersion:"26090271", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: harry-3463157296-jr2fm
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:43:37.187731       1 deployment_controller.go:298] Error syncing deployment harry-prod/harry: Operation cannot be fulfilled on deployments.extensions "harry": the object has been modified; please apply your changes to the latest version and try again
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:43:37.215740       1 deployment_controller.go:298] Error syncing deployment harry-prod/harry: Operation cannot be fulfilled on deployments.extensions "harry": the object has been modified; please apply your changes to the latest version and try again
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:43:37.236378       1 deployment_controller.go:298] Error syncing deployment harry-prod/harry: Operation cannot be fulfilled on deployments.extensions "harry": the object has been modified; please apply your changes to the latest version and try again
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:43:37.512639       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:43:38.739381       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:43:41.370576       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:43:42.346471       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:43:42.597822       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:43:45.173108       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:43:46.400686       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:43:47.809913       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:43:49.038210       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:43:50.537121       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:43:51.766236       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:43:52.388686       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:43:53.306056       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:43:53.541661       1 event.go:217] Event(api.ObjectReference{Kind:"Deployment", Namespace:"harry-prod", Name:"harry", UID:"2675ef38-f7ae-11e6-8942-06d4a1d2d964", APIVersion:"extensions", ResourceVersion:"26090287", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled down replica set harry-797938840 to 0
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:43:53.542067       1 replica_set.go:512] Too many "harry-prod"/"harry-797938840" replicas, need 0, deleting 2
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:43:53.542101       1 controller_utils.go:523] Controller harry-797938840 deleting pod harry-prod/harry-797938840-5m3rq
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:43:53.542126       1 controller_utils.go:523] Controller harry-797938840 deleting pod harry-prod/harry-797938840-9tpq4
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:43:53.551239       1 event.go:217] Event(api.ObjectReference{Kind:"ReplicaSet", Namespace:"harry-prod", Name:"harry-797938840", UID:"29262756-f876-11e6-8942-06d4a1d2d964", APIVersion:"extensions", ResourceVersion:"26090390", FieldPath:""}): type: 'Normal' reason: 'SuccessfulDelete' Deleted pod: harry-797938840-5m3rq
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:43:53.552097       1 event.go:217] Event(api.ObjectReference{Kind:"ReplicaSet", Namespace:"harry-prod", Name:"harry-797938840", UID:"29262756-f876-11e6-8942-06d4a1d2d964", APIVersion:"extensions", ResourceVersion:"26090390", FieldPath:""}): type: 'Normal' reason: 'SuccessfulDelete' Deleted pod: harry-797938840-9tpq4
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:43:53.559553       1 deployment_controller.go:298] Error syncing deployment harry-prod/harry: Operation cannot be fulfilled on deployments.extensions "harry": the object has been modified; please apply your changes to the latest version and try again
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:43:53.567944       1 deployment_controller.go:298] Error syncing deployment harry-prod/harry: Deployment.extensions "harry" is invalid: status.unavailableReplicas: Invalid value: -2: must be greater than or equal to 0
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:43:53.574670       1 deployment_controller.go:298] Error syncing deployment harry-prod/harry: Deployment.extensions "harry" is invalid: status.unavailableReplicas: Invalid value: -2: must be greater than or equal to 0
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:43:53.595636       1 deployment_controller.go:298] Error syncing deployment harry-prod/harry: Operation cannot be fulfilled on deployments.extensions "harry": the object has been modified; please apply your changes to the latest version and try again
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:43:54.536469       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:43:56.508822       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:43:57.738565       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:43:59.192945       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:44:00.423430       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:44:01.209419       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:44:02.432224       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:44:02.439669       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:44:04.105773       1 pet_set.go:324] Syncing StatefulSet customer-facing-dev/api-oldnode with 1 pods
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:44:04.109025       1 pet_set.go:324] Syncing StatefulSet customer-facing-prod/api-oldnode with 3 pods
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:44:05.565393       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:44:06.795648       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:44:08.896372       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:44:10.126758       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:44:12.135369       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:44:12.474270       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:44:13.366664       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:44:14.449499       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:44:15.681935       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:44:16.723109       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:44:17.955401       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:44:20.677384       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:44:21.907470       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:44:22.518936       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:44:24.379752       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:44:25.610063       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:44:28.419616       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:44:29.650290       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:44:32.384698       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:44:32.559901       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:44:33.615522       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:44:34.058508       1 replication_controller.go:322] Observed updated replication controller kube-dns-v20. Desired pod count change: 3->3
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:44:34.058530       1 replication_controller.go:322] Observed updated replication controller default-http-backend. Desired pod count change: 1->1
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:44:34.105934       1 pet_set.go:324] Syncing StatefulSet customer-facing-dev/api-oldnode with 1 pods
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:44:34.108640       1 pet_set.go:324] Syncing StatefulSet customer-facing-prod/api-oldnode with 3 pods
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:44:34.774766       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:44:36.006113       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:44:38.489265       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:44:39.721479       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:44:41.173994       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:44:42.406020       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:44:42.602281       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:44:44.368941       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:44:45.596252       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:44:47.494381       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:44:48.721554       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:44:49.932776       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:44:51.160726       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:44:52.057600       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:44:52.646785       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:44:53.285965       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:44:54.440508       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:44:55.669637       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:44:58.471892       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:44:59.701531       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:45:00.875577       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:45:02.105191       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:45:02.690310       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:45:03.121200       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:45:04.106075       1 pet_set.go:324] Syncing StatefulSet customer-facing-dev/api-oldnode with 1 pods
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:45:04.109254       1 pet_set.go:324] Syncing StatefulSet customer-facing-prod/api-oldnode with 3 pods
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:45:04.352097       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:45:06.110529       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:45:07.341869       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:45:09.423116       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:45:10.655465       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:45:12.530123       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:45:12.733715       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:45:13.762763       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:45:15.784486       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:45:17.017698       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:45:19.583541       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:45:20.816978       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:45:22.239795       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:45:22.777318       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:45:23.473612       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:45:25.384800       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:45:26.619040       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:45:28.190486       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:45:29.424943       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:45:30.863193       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:45:32.096887       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:45:32.819752       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:45:33.961206       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:45:34.106305       1 pet_set.go:324] Syncing StatefulSet customer-facing-dev/api-oldnode with 1 pods
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:45:34.109045       1 pet_set.go:324] Syncing StatefulSet customer-facing-prod/api-oldnode with 3 pods
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:45:35.195549       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:45:36.503837       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:45:37.738783       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:45:40.222654       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:45:41.458358       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:45:42.861877       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:45:43.252104       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:45:44.488194       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:45:44.863820       1 event.go:217] Event(api.ObjectReference{Kind:"Deployment", Namespace:"harry-prod", Name:"harry", UID:"2675ef38-f7ae-11e6-8942-06d4a1d2d964", APIVersion:"extensions", ResourceVersion:"26090842", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set harry-34641236 to 2
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:45:44.864266       1 replica_set.go:479] Too few "harry-prod"/"harry-34641236" replicas, need 2, creating 2
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:45:44.872417       1 event.go:217] Event(api.ObjectReference{Kind:"ReplicaSet", Namespace:"harry-prod", Name:"harry-34641236", UID:"b76d4818-f876-11e6-8942-06d4a1d2d964", APIVersion:"extensions", ResourceVersion:"26090843", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: harry-34641236-z9s22
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:45:44.889875       1 event.go:217] Event(api.ObjectReference{Kind:"ReplicaSet", Namespace:"harry-prod", Name:"harry-34641236", UID:"b76d4818-f876-11e6-8942-06d4a1d2d964", APIVersion:"extensions", ResourceVersion:"26090843", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: harry-34641236-f2w4b
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:45:44.894905       1 deployment_controller.go:298] Error syncing deployment harry-prod/harry: Operation cannot be fulfilled on deployments.extensions "harry": the object has been modified; please apply your changes to the latest version and try again
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:45:44.917187       1 deployment_controller.go:298] Error syncing deployment harry-prod/harry: Operation cannot be fulfilled on deployments.extensions "harry": the object has been modified; please apply your changes to the latest version and try again
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:45:44.936211       1 deployment_controller.go:298] Error syncing deployment harry-prod/harry: Operation cannot be fulfilled on deployments.extensions "harry": the object has been modified; please apply your changes to the latest version and try again
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:45:46.534270       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:45:47.770962       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:45:50.473184       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:45:51.710323       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:45:52.597476       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:45:52.910558       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:45:53.834471       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:45:56.932783       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:45:57.440180       1 event.go:217] Event(api.ObjectReference{Kind:"Deployment", Namespace:"harry-prod", Name:"harry", UID:"2675ef38-f7ae-11e6-8942-06d4a1d2d964", APIVersion:"extensions", ResourceVersion:"26090859", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled down replica set harry-3463157296 to 1
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:45:57.440358       1 replica_set.go:512] Too many "harry-prod"/"harry-3463157296" replicas, need 1, deleting 1
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:45:57.440453       1 controller_utils.go:523] Controller harry-3463157296 deleting pod harry-prod/harry-3463157296-871sc
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:45:57.450748       1 event.go:217] Event(api.ObjectReference{Kind:"ReplicaSet", Namespace:"harry-prod", Name:"harry-3463157296", UID:"6b517d69-f876-11e6-8942-06d4a1d2d964", APIVersion:"extensions", ResourceVersion:"26090952", FieldPath:""}): type: 'Normal' reason: 'SuccessfulDelete' Deleted pod: harry-3463157296-871sc
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:45:57.460537       1 deployment_controller.go:298] Error syncing deployment harry-prod/harry: Operation cannot be fulfilled on deployments.extensions "harry": the object has been modified; please apply your changes to the latest version and try again
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:45:57.479551       1 deployment_controller.go:298] Error syncing deployment harry-prod/harry: Operation cannot be fulfilled on deployments.extensions "harry": the object has been modified; please apply your changes to the latest version and try again
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:45:57.501142       1 deployment_controller.go:298] Error syncing deployment harry-prod/harry: Operation cannot be fulfilled on deployments.extensions "harry": the object has been modified; please apply your changes to the latest version and try again
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:45:58.170302       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:46:00.006755       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:46:01.244846       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:46:02.806318       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:46:02.951761       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:46:04.044440       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:46:04.106427       1 pet_set.go:324] Syncing StatefulSet customer-facing-dev/api-oldnode with 1 pods
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:46:04.109428       1 pet_set.go:324] Syncing StatefulSet customer-facing-prod/api-oldnode with 3 pods
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:46:06.677162       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:46:07.915224       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:46:10.131121       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:46:11.369311       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:46:12.994801       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:46:13.781856       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:46:15.020642       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:46:17.579682       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:46:18.819029       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:46:20.749214       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:46:21.986462       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:46:23.037866       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:46:24.938181       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:46:26.176073       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:46:27.742857       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:46:28.981176       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:46:31.576532       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:46:32.814577       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:46:33.080190       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:46:34.106679       1 pet_set.go:324] Syncing StatefulSet customer-facing-prod/api-oldnode with 3 pods
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:46:34.114663       1 pet_set.go:324] Syncing StatefulSet customer-facing-dev/api-oldnode with 1 pods
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:46:35.252406       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:46:36.491696       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:46:38.473636       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:46:39.712964       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:46:41.819451       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:46:43.059820       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:46:43.121681       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:46:45.182778       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:46:46.423547       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:46:47.530910       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:46:48.771035       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:46:51.409670       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:46:52.651008       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:46:53.163114       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:46:55.603688       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:46:56.852194       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:46:58.367119       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:46:59.609842       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:47:01.632031       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:47:02.875870       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node3.k1.company kube-controller-manager E0221 20:47:03.204177       1 utils.go:91] Unable to get uid from job racingpost in namespace colin
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:47:04.106730       1 pet_set.go:324] Syncing StatefulSet customer-facing-dev/api-oldnode with 1 pods
kube-controller-manager-node3.k1.company kube-controller-manager I0221 20:47:04.109883       1 pet_set.go:324] Syncing StatefulSet customer-facing-prod/api-oldnode with 3 pods
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:47:04.800890       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:47:06.044955       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node1.k1.company kube-controller-manager I0221 20:47:07.699508       1 leaderelection.go:247] lock is held by node3 and has not yet expired
kube-controller-manager-node2.k1.company kube-controller-manager I0221 20:47:08.944208       1 leaderelection.go:247] lock is held by node3 and has not yet expired