Skip to content

Instantly share code, notes, and snippets.

@enisoc
Created December 2, 2016 20:33
Show Gist options
  • Save enisoc/4dae9db18dbe6b563c88f13193debcd9 to your computer and use it in GitHub Desktop.
Save enisoc/4dae9db18dbe6b563c88f13193debcd9 to your computer and use it in GitHub Desktop.
kubernetes-minion-group-yl0d kubelet.log
I1202 19:58:17.117332 2841 plugins.go:71] No cloud provider specified.
I1202 19:58:17.118875 2841 manager.go:133] cAdvisor running in container: "/"
W1202 19:58:17.179346 2841 manager.go:141] unable to connect to Rkt api service: rkt: cannot tcp Dial rkt api service: dial tcp 127.0.0.1:15441: getsockopt: connection refused
I1202 19:58:17.179762 2841 fs.go:116] Filesystem partitions: map[/dev/sda1:{mountpoint:/var/lib/docker/aufs major:8 minor:1 fsType:ext4 blockSize:0}]
I1202 19:58:17.188702 2841 machine.go:50] Couldn't collect info from any of the files in "/etc/machine-id,/var/lib/dbus/machine-id"
I1202 19:58:17.188755 2841 manager.go:182] Machine: {NumCores:4 CpuFrequency:2300000 MemoryCapacity:15807909888 MachineID: SystemUUID:851B5450-D8D9-804A-48F3-7659F0E53A76 BootID:c00b5c61-1e49-41bb-a1f1-5e7ad507a4c5 Filesystems:[{Device:/dev/sda1 Capacity:105553100800 Type:vfs Inodes:6553600}] DiskMap:map[8:0:{Name:sda Major:8 Minor:0 Size:107374182400 Scheduler:cfq} 8:16:{Name:sdb Major:8 Minor:16 Size:1073741824 Scheduler:cfq}] NetworkDevices:[{Name:eth0 MacAddress:42:01:0a:80:00:05 Speed:0 Mtu:1460}] Topology:[{Id:0 Memory:15807909888 Cores:[{Id:0 Threads:[0 1] Caches:[{Size:32768 Type:Data Level:1} {Size:32768 Type:Instruction Level:1} {Size:262144 Type:Unified Level:2}]} {Id:1 Threads:[2 3] Caches:[{Size:32768 Type:Data Level:1} {Size:32768 Type:Instruction Level:1} {Size:262144 Type:Unified Level:2}]}] Caches:[{Size:47185920 Type:Unified Level:3}]}] CloudProvider:GCE InstanceType:n1-standard-4 InstanceID:6866432937855577298}
I1202 19:58:17.189324 2841 manager.go:188] Version: {KernelVersion:3.16.0-4-amd64 ContainerOsVersion:Debian GNU/Linux 7 (wheezy) DockerVersion:1.11.2 CadvisorVersion: CadvisorRevision:}
W1202 19:58:17.190994 2841 server.go:632] No api server defined - no events will be sent to API server.
I1202 19:58:17.191026 2841 server.go:694] Adding manifest file: /etc/kubernetes/manifests
I1202 19:58:17.192875 2841 server.go:700] Adding manifest url "http://metadata.google.internal/computeMetadata/v1/instance/attributes/google-container-manifest" with HTTP header map[Metadata-Flavor:[Google]]
W1202 19:58:17.194473 2841 http.go:64] Failed to read pods from URL: http://metadata.google.internal/computeMetadata/v1/instance/attributes/google-container-manifest: 404 Not Found
W1202 19:58:17.202025 2841 kubelet.go:527] Hairpin mode set to "promiscuous-bridge" but configureCBR0 is false, falling back to "hairpin-veth"
I1202 19:58:17.202046 2841 kubelet.go:371] Hairpin mode set to "hairpin-veth"
I1202 19:58:17.208733 2841 manager.go:228] Setting dockerRoot to /var/lib/docker
I1202 19:58:17.221448 2841 server.go:666] Started kubelet v1.3.0-alpha.3.951+835a2577f8d0e4
E1202 19:58:17.221512 2841 kubelet.go:885] Image garbage collection failed: unable to find data for container /
W1202 19:58:17.221572 2841 kubelet.go:942] No api server defined - no node status update will be sent.
I1202 19:58:17.221703 2841 server.go:117] Starting to listen on 0.0.0.0:10250
I1202 19:58:17.222136 2841 fs_resource_analyzer.go:66] Starting FS ResourceAnalyzer
I1202 19:58:17.222149 2841 manager.go:119] Kubernetes client is nil, not starting status manager.
I1202 19:58:17.222159 2841 kubelet.go:2462] Starting kubelet main sync loop.
I1202 19:58:17.222177 2841 kubelet.go:2471] skipping pod synchronization - [network state unknown container runtime is down]
I1202 19:58:17.237520 2841 factory.go:208] Registering Docker factory
E1202 19:58:17.237548 2841 manager.go:229] Registration of the rkt container factory failed: unable to communicate with Rkt api service: rkt: cannot tcp Dial rkt api service: dial tcp 127.0.0.1:15441: getsockopt: connection refused
I1202 19:58:17.237554 2841 factory.go:53] Registering systemd factory
I1202 19:58:17.237833 2841 factory.go:85] Registering Raw factory
I1202 19:58:17.239958 2841 manager.go:1024] Started watching for new ooms in manager
I1202 19:58:17.239974 2841 oomparser.go:198] OOM parser using kernel log file: "/var/log/kern.log"
I1202 19:58:17.240406 2841 manager.go:277] Starting recovery of all containers
I1202 19:58:17.241788 2841 manager.go:282] Recovery completed
W1202 19:58:36.715253 2841 http.go:64] Failed to read pods from URL: http://metadata.google.internal/computeMetadata/v1/instance/attributes/google-container-manifest: 404 Not Found
W1202 19:58:56.716325 2841 http.go:64] Failed to read pods from URL: http://metadata.google.internal/computeMetadata/v1/instance/attributes/google-container-manifest: 404 Not Found
Flag --api-servers has been deprecated, Use --kubeconfig instead. Will be removed in a future version.
Flag --config has been deprecated, Use --pod-manifest-path instead. Will be removed in a future version.
Flag --babysit-daemons has been deprecated, Will be removed in a future version.
I1202 19:59:08.726872 3560 feature_gate.go:181] feature gates: map[]
I1202 19:59:08.728899 3560 gce.go:331] Using existing Token Source &oauth2.reuseTokenSource{new:google.computeSource{account:""}, mu:sync.Mutex{state:0, sema:0x0}, t:(*oauth2.Token)(nil)}
I1202 19:59:08.730282 3560 server.go:370] Successfully initialized cloud provider: "gce" from the config file: ""
I1202 19:59:08.734915 3560 docker.go:356] Connecting to docker on unix:///var/run/docker.sock
I1202 19:59:08.734935 3560 docker.go:376] Start docker client with request timeout=2m0s
E1202 19:59:08.737569 3560 cni.go:163] error updating cni config: No networks found in /etc/cni/net.d
I1202 19:59:08.742554 3560 iptables.go:176] Could not connect to D-Bus system bus: dial unix /var/run/dbus/system_bus_socket: connect: no such file or directory
I1202 19:59:08.743808 3560 iptables.go:176] Could not connect to D-Bus system bus: dial unix /var/run/dbus/system_bus_socket: connect: no such file or directory
I1202 19:59:08.743871 3560 server.go:512] cloud provider determined current node name to be kubernetes-minion-group-yl0d
I1202 19:59:08.743958 3560 manager.go:143] cAdvisor running in container: "/"
W1202 19:59:08.791590 3560 manager.go:151] unable to connect to Rkt api service: rkt: cannot tcp Dial rkt api service: dial tcp 127.0.0.1:15441: getsockopt: connection refused
I1202 19:59:08.794177 3560 fs.go:117] Filesystem partitions: map[/dev/sda1:{mountpoint:/var/lib/docker/aufs major:8 minor:1 fsType:ext4 blockSize:0}]
I1202 19:59:08.796497 3560 info.go:47] Couldn't collect info from any of the files in "/etc/machine-id,/var/lib/dbus/machine-id"
I1202 19:59:08.796541 3560 manager.go:198] Machine: {NumCores:4 CpuFrequency:2300000 MemoryCapacity:15807909888 MachineID: SystemUUID:851B5450-D8D9-804A-48F3-7659F0E53A76 BootID:c00b5c61-1e49-41bb-a1f1-5e7ad507a4c5 Filesystems:[{Device:/dev/sda1 Capacity:105553100800 Type:vfs Inodes:6553600 HasInodes:true}] DiskMap:map[8:0:{Name:sda Major:8 Minor:0 Size:107374182400 Scheduler:cfq} 8:16:{Name:sdb Major:8 Minor:16 Size:1073741824 Scheduler:cfq}] NetworkDevices:[{Name:eth0 MacAddress:42:01:0a:80:00:05 Speed:0 Mtu:1460}] Topology:[{Id:0 Memory:15807909888 Cores:[{Id:0 Threads:[0 1] Caches:[{Size:32768 Type:Data Level:1} {Size:32768 Type:Instruction Level:1} {Size:262144 Type:Unified Level:2}]} {Id:1 Threads:[2 3] Caches:[{Size:32768 Type:Data Level:1} {Size:32768 Type:Instruction Level:1} {Size:262144 Type:Unified Level:2}]}] Caches:[{Size:47185920 Type:Unified Level:3}]}] CloudProvider:GCE InstanceType:n1-standard-4 InstanceID:6866432937855577298}
I1202 19:59:08.797059 3560 manager.go:204] Version: {KernelVersion:3.16.0-4-amd64 ContainerOsVersion:Debian GNU/Linux 7 (wheezy) DockerVersion:1.11.2 CadvisorVersion: CadvisorRevision:}
I1202 19:59:08.799653 3560 server.go:512] cloud provider determined current node name to be kubernetes-minion-group-yl0d
I1202 19:59:08.799813 3560 server.go:706] Using root directory: /var/lib/kubelet
I1202 19:59:08.799925 3560 kubelet.go:308] cloud provider determined current node name to be kubernetes-minion-group-yl0d
I1202 19:59:08.799949 3560 kubelet.go:243] Adding manifest file: /etc/kubernetes/manifests
I1202 19:59:08.799974 3560 file.go:48] Watching path "/etc/kubernetes/manifests"
I1202 19:59:08.799999 3560 kubelet.go:253] Watching apiserver
I1202 19:59:08.804017 3560 iptables.go:176] Could not connect to D-Bus system bus: dial unix /var/run/dbus/system_bus_socket: connect: no such file or directory
I1202 19:59:08.804053 3560 kubelet.go:477] Hairpin mode set to "promiscuous-bridge"
I1202 19:59:08.815947 3560 plugins.go:181] Loaded network plugin "kubenet"
I1202 19:59:08.818160 3560 docker_manager.go:259] Setting dockerRoot to /var/lib/docker
I1202 19:59:08.818176 3560 docker_manager.go:262] Setting cgroupDriver to cgroupfs
I1202 19:59:08.821761 3560 plugins.go:344] Loaded volume plugin "kubernetes.io/aws-ebs"
I1202 19:59:08.821783 3560 plugins.go:344] Loaded volume plugin "kubernetes.io/empty-dir"
I1202 19:59:08.821795 3560 plugins.go:344] Loaded volume plugin "kubernetes.io/gce-pd"
I1202 19:59:08.821807 3560 plugins.go:344] Loaded volume plugin "kubernetes.io/git-repo"
I1202 19:59:08.821819 3560 plugins.go:344] Loaded volume plugin "kubernetes.io/host-path"
I1202 19:59:08.821830 3560 plugins.go:344] Loaded volume plugin "kubernetes.io/nfs"
I1202 19:59:08.821841 3560 plugins.go:344] Loaded volume plugin "kubernetes.io/secret"
I1202 19:59:08.821852 3560 plugins.go:344] Loaded volume plugin "kubernetes.io/iscsi"
I1202 19:59:08.821868 3560 plugins.go:344] Loaded volume plugin "kubernetes.io/glusterfs"
I1202 19:59:08.821880 3560 plugins.go:344] Loaded volume plugin "kubernetes.io/rbd"
I1202 19:59:08.821892 3560 plugins.go:344] Loaded volume plugin "kubernetes.io/cinder"
I1202 19:59:08.821902 3560 plugins.go:344] Loaded volume plugin "kubernetes.io/quobyte"
I1202 19:59:08.821914 3560 plugins.go:344] Loaded volume plugin "kubernetes.io/cephfs"
I1202 19:59:08.821940 3560 plugins.go:344] Loaded volume plugin "kubernetes.io/downward-api"
I1202 19:59:08.821955 3560 plugins.go:344] Loaded volume plugin "kubernetes.io/fc"
I1202 19:59:08.821966 3560 plugins.go:344] Loaded volume plugin "kubernetes.io/flocker"
I1202 19:59:08.821978 3560 plugins.go:344] Loaded volume plugin "kubernetes.io/azure-file"
I1202 19:59:08.821990 3560 plugins.go:344] Loaded volume plugin "kubernetes.io/configmap"
I1202 19:59:08.822002 3560 plugins.go:344] Loaded volume plugin "kubernetes.io/vsphere-volume"
I1202 19:59:08.822014 3560 plugins.go:344] Loaded volume plugin "kubernetes.io/azure-disk"
I1202 19:59:08.822026 3560 plugins.go:344] Loaded volume plugin "kubernetes.io/photon-pd"
I1202 19:59:08.822837 3560 server.go:741] Setting keys quota in /proc/sys/kernel/keys/root_maxkeys to 1000000
I1202 19:59:08.822878 3560 server.go:757] Setting keys bytes in /proc/sys/kernel/keys/root_maxbytes to 25000000
I1202 19:59:08.822903 3560 server.go:776] Started kubelet v1.6.0-alpha.0.1228+2212c421f6e10e
E1202 19:59:08.823500 3560 kubelet.go:1145] Image garbage collection failed: unable to find data for container /
I1202 19:59:08.823517 3560 server.go:141] Starting to listen read-only on 0.0.0.0:10255
I1202 19:59:08.823850 3560 kubelet_node_status.go:204] Setting node annotation to enable volume controller attach/detach
I1202 19:59:08.829414 3560 server.go:124] Starting to listen on 0.0.0.0:10250
I1202 19:59:08.855155 3560 kubelet_node_status.go:246] Adding node label from cloud provider: beta.kubernetes.io/instance-type=n1-standard-4
I1202 19:59:08.855179 3560 kubelet_node_status.go:257] Adding node label from cloud provider: failure-domain.beta.kubernetes.io/zone=us-central1-b
I1202 19:59:08.855188 3560 kubelet_node_status.go:261] Adding node label from cloud provider: failure-domain.beta.kubernetes.io/region=us-central1
E1202 19:59:08.860519 3560 kubelet.go:1634] Failed to check if disk space is available for the runtime: failed to get fs info for "runtime": unable to find data for container /
E1202 19:59:08.860552 3560 kubelet.go:1642] Failed to check if disk space is available on the root partition: failed to get fs info for "root": unable to find data for container /
I1202 19:59:08.860561 3560 kubelet_node_status.go:358] Recording NodeHasSufficientDisk event message for node kubernetes-minion-group-yl0d
I1202 19:59:08.860594 3560 kubelet_node_status.go:358] Recording NodeHasSufficientMemory event message for node kubernetes-minion-group-yl0d
I1202 19:59:08.860606 3560 kubelet_node_status.go:358] Recording NodeHasNoDiskPressure event message for node kubernetes-minion-group-yl0d
I1202 19:59:08.861470 3560 container_manager_linux.go:405] Configure resource-only container /docker-daemon with memory limit: 11065536921
I1202 19:59:08.861513 3560 fs_resource_analyzer.go:66] Starting FS ResourceAnalyzer
I1202 19:59:08.861537 3560 status_manager.go:131] Starting to sync pod status with apiserver
I1202 19:59:08.861550 3560 kubelet.go:1714] Starting kubelet main sync loop.
I1202 19:59:08.861567 3560 kubelet.go:1725] skipping pod synchronization - [container runtime is down]
I1202 19:59:08.868203 3560 container_manager_linux.go:769] Found 103 PIDs in root, 69 of them are not to be moved
I1202 19:59:08.868219 3560 container_manager_linux.go:776] Moving non-kernel processes: [428 563 565 1784 1865 1898 1912 1992 1993 2080 2089 2191 2273 2277 2311 2346 2356 2528 2694 2730 2745 2759 2859 2871 2895 2899 2905 2906 3127 3492 3494 3496 3515 3560]
I1202 19:59:08.871646 3560 volume_manager.go:240] The desired_state_of_world populator starts
I1202 19:59:08.871669 3560 volume_manager.go:242] Starting Kubelet Volume Manager
I1202 19:59:08.900533 3560 factory.go:295] Registering Docker factory
W1202 19:59:08.900565 3560 manager.go:247] Registration of the rkt container factory failed: unable to communicate with Rkt api service: rkt: cannot tcp Dial rkt api service: dial tcp 127.0.0.1:15441: getsockopt: connection refused
I1202 19:59:08.900577 3560 factory.go:54] Registering systemd factory
I1202 19:59:08.900691 3560 factory.go:86] Registering Raw factory
I1202 19:59:08.900806 3560 manager.go:1106] Started watching for new ooms in manager
I1202 19:59:08.900862 3560 oomparser.go:200] OOM parser using kernel log file: "/var/log/kern.log"
I1202 19:59:08.901413 3560 manager.go:288] Starting recovery of all containers
I1202 19:59:08.903546 3560 manager.go:293] Recovery completed
I1202 19:59:08.971906 3560 kubelet_node_status.go:204] Setting node annotation to enable volume controller attach/detach
I1202 19:59:08.974280 3560 kubelet_node_status.go:246] Adding node label from cloud provider: beta.kubernetes.io/instance-type=n1-standard-4
I1202 19:59:08.974311 3560 kubelet_node_status.go:257] Adding node label from cloud provider: failure-domain.beta.kubernetes.io/zone=us-central1-b
I1202 19:59:08.974321 3560 kubelet_node_status.go:261] Adding node label from cloud provider: failure-domain.beta.kubernetes.io/region=us-central1
I1202 19:59:08.976894 3560 kubelet_node_status.go:358] Recording NodeHasSufficientDisk event message for node kubernetes-minion-group-yl0d
I1202 19:59:08.976931 3560 kubelet_node_status.go:358] Recording NodeHasSufficientMemory event message for node kubernetes-minion-group-yl0d
I1202 19:59:08.976947 3560 kubelet_node_status.go:358] Recording NodeHasNoDiskPressure event message for node kubernetes-minion-group-yl0d
I1202 19:59:08.976974 3560 kubelet_node_status.go:74] Attempting to register node kubernetes-minion-group-yl0d
I1202 19:59:08.977217 3560 container_manager_linux.go:769] Found 69 PIDs in root, 69 of them are not to be moved
E1202 19:59:08.985894 3560 kubelet_node_status.go:132] Previously node "kubernetes-minion-group-yl0d" had externalID "6866432937855577298"; now it is "8324196566704093032"; will delete and recreate.
I1202 19:59:08.998340 3560 kubelet_node_status.go:136] Deleted old node object %qkubernetes-minion-group-yl0d
I1202 19:59:09.198541 3560 kubelet_node_status.go:204] Setting node annotation to enable volume controller attach/detach
I1202 19:59:09.201107 3560 kubelet_node_status.go:246] Adding node label from cloud provider: beta.kubernetes.io/instance-type=n1-standard-4
I1202 19:59:09.201126 3560 kubelet_node_status.go:257] Adding node label from cloud provider: failure-domain.beta.kubernetes.io/zone=us-central1-b
I1202 19:59:09.201143 3560 kubelet_node_status.go:261] Adding node label from cloud provider: failure-domain.beta.kubernetes.io/region=us-central1
I1202 19:59:09.205166 3560 kubelet_node_status.go:358] Recording NodeHasSufficientDisk event message for node kubernetes-minion-group-yl0d
I1202 19:59:09.205206 3560 kubelet_node_status.go:358] Recording NodeHasSufficientMemory event message for node kubernetes-minion-group-yl0d
I1202 19:59:09.205222 3560 kubelet_node_status.go:358] Recording NodeHasNoDiskPressure event message for node kubernetes-minion-group-yl0d
I1202 19:59:09.205245 3560 kubelet_node_status.go:74] Attempting to register node kubernetes-minion-group-yl0d
I1202 19:59:09.235437 3560 kubelet_node_status.go:77] Successfully registered node kubernetes-minion-group-yl0d
E1202 19:59:09.257867 3560 kubelet_node_status.go:302] Error updating node status, will retry: Operation cannot be fulfilled on nodes "kubernetes-minion-group-yl0d": the object has been modified; please apply your changes to the latest version and try again
I1202 19:59:09.262965 3560 kubenet_linux.go:262] CNI network config set to {
"cniVersion": "0.1.0",
"name": "kubenet",
"type": "bridge",
"bridge": "cbr0",
"mtu": 1460,
"addIf": "eth0",
"isGateway": true,
"ipMasq": false,
"hairpinMode": false,
"ipam": {
"type": "host-local",
"subnet": "10.244.8.0/24",
"gateway": "10.244.8.1",
"routes": [
{ "dst": "0.0.0.0/0" }
]
}
}
I1202 19:59:09.263117 3560 kubelet_network.go:211] Setting Pod CIDR: -> 10.244.8.0/24
I1202 19:59:13.861770 3560 kubelet.go:1781] SyncLoop (ADD, "file"): "fluentd-cloud-logging-kubernetes-minion-group-yl0d_kube-system(1ece262b44e6d33656e56a138518be7b), kube-proxy-kubernetes-minion-group-yl0d_kube-system(2432565ca3c5351a67f0203bb8f07fa3)"
I1202 19:59:13.861917 3560 kubelet.go:1781] SyncLoop (ADD, "api"): "web-0_default(60fb870e-b8c7-11e6-bee7-42010a800002), web-2_default(10863ca9-b8c9-11e6-aa17-42010a800002), l7-default-backend-1869959889-n53x9_kube-system(70c91ccd-b8c8-11e6-aa17-42010a800002), kube-proxy-kubernetes-minion-group-yl0d_kube-system(b83a7d0a-b8c4-11e6-bee7-42010a800002), fluentd-cloud-logging-kubernetes-minion-group-yl0d_kube-system(b83a347c-b8c4-11e6-bee7-42010a800002), node-problem-detector-v0.1-jh0rp_kube-system(a1ad83ee-b8c4-11e6-bee7-42010a800002)"
E1202 19:59:13.862270 3560 pod_workers.go:184] Error syncing pod 70c91ccd-b8c8-11e6-aa17-42010a800002, skipping: network is not ready: [Kubenet does not have netConfig. This is most likely due to lack of PodCIDR]
E1202 19:59:13.862348 3560 pod_workers.go:184] Error syncing pod 10863ca9-b8c9-11e6-aa17-42010a800002, skipping: network is not ready: [Kubenet does not have netConfig. This is most likely due to lack of PodCIDR]
E1202 19:59:13.862459 3560 pod_workers.go:184] Error syncing pod 1ece262b44e6d33656e56a138518be7b, skipping: network is not ready: [Kubenet does not have netConfig. This is most likely due to lack of PodCIDR]
E1202 19:59:13.862662 3560 pod_workers.go:184] Error syncing pod 60fb870e-b8c7-11e6-bee7-42010a800002, skipping: network is not ready: [Kubenet does not have netConfig. This is most likely due to lack of PodCIDR]
E1202 19:59:13.875617 3560 pod_workers.go:184] Error syncing pod 1ece262b44e6d33656e56a138518be7b, skipping: network is not ready: [Kubenet does not have netConfig. This is most likely due to lack of PodCIDR]
E1202 19:59:13.887905 3560 kubelet.go:1508] Failed creating a mirror pod for "kube-proxy-kubernetes-minion-group-yl0d_kube-system(2432565ca3c5351a67f0203bb8f07fa3)": pods "kube-proxy-kubernetes-minion-group-yl0d" already exists
I1202 19:59:13.982766 3560 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/host-path/1ece262b44e6d33656e56a138518be7b-varlog" (spec.Name: "varlog") pod "1ece262b44e6d33656e56a138518be7b" (UID: "1ece262b44e6d33656e56a138518be7b")
I1202 19:59:13.982872 3560 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-60f59472-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-60f59472-b8c7-11e6-bee7-42010a800002") pod "60fb870e-b8c7-11e6-bee7-42010a800002" (UID: "60fb870e-b8c7-11e6-bee7-42010a800002")
I1202 19:59:13.982906 3560 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-61045ddc-b8c7-11e6-bee7-42010a800002") pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002")
I1202 19:59:13.982924 3560 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/secret/10863ca9-b8c9-11e6-aa17-42010a800002-default-token-nmzqy" (spec.Name: "default-token-nmzqy") pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002")
I1202 19:59:13.982942 3560 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/host-path/1ece262b44e6d33656e56a138518be7b-varlibdockercontainers" (spec.Name: "varlibdockercontainers") pod "1ece262b44e6d33656e56a138518be7b" (UID: "1ece262b44e6d33656e56a138518be7b")
I1202 19:59:13.982974 3560 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/host-path/2432565ca3c5351a67f0203bb8f07fa3-ssl-certs-host" (spec.Name: "ssl-certs-host") pod "2432565ca3c5351a67f0203bb8f07fa3" (UID: "2432565ca3c5351a67f0203bb8f07fa3")
I1202 19:59:13.982999 3560 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/host-path/2432565ca3c5351a67f0203bb8f07fa3-kubeconfig" (spec.Name: "kubeconfig") pod "2432565ca3c5351a67f0203bb8f07fa3" (UID: "2432565ca3c5351a67f0203bb8f07fa3")
E1202 19:59:13.983043 3560 nestedpendingoperations.go:262] Operation for "\"kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002\"" failed. No retries permitted until 2016-12-02 19:59:14.482999551 +0000 UTC (durationBeforeRetry 500ms). Error: Volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-61045ddc-b8c7-11e6-bee7-42010a800002") pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002") has not yet been added to the list of VolumesInUse in the node's volume status.
E1202 19:59:13.983084 3560 nestedpendingoperations.go:262] Operation for "\"kubernetes.io/gce-pd/kubernetes-dynamic-pvc-60f59472-b8c7-11e6-bee7-42010a800002\"" failed. No retries permitted until 2016-12-02 19:59:14.483067407 +0000 UTC (durationBeforeRetry 500ms). Error: Volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-60f59472-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-60f59472-b8c7-11e6-bee7-42010a800002") pod "60fb870e-b8c7-11e6-bee7-42010a800002" (UID: "60fb870e-b8c7-11e6-bee7-42010a800002") has not yet been added to the list of VolumesInUse in the node's volume status.
I1202 19:59:13.983107 3560 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/host-path/2432565ca3c5351a67f0203bb8f07fa3-varlog" (spec.Name: "varlog") pod "2432565ca3c5351a67f0203bb8f07fa3" (UID: "2432565ca3c5351a67f0203bb8f07fa3")
I1202 19:59:13.983136 3560 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/host-path/a1ad83ee-b8c4-11e6-bee7-42010a800002-log" (spec.Name: "log") pod "a1ad83ee-b8c4-11e6-bee7-42010a800002" (UID: "a1ad83ee-b8c4-11e6-bee7-42010a800002")
I1202 19:59:13.983158 3560 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/secret/a1ad83ee-b8c4-11e6-bee7-42010a800002-default-token-et92n" (spec.Name: "default-token-et92n") pod "a1ad83ee-b8c4-11e6-bee7-42010a800002" (UID: "a1ad83ee-b8c4-11e6-bee7-42010a800002")
I1202 19:59:13.983213 3560 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/secret/60fb870e-b8c7-11e6-bee7-42010a800002-default-token-nmzqy" (spec.Name: "default-token-nmzqy") pod "60fb870e-b8c7-11e6-bee7-42010a800002" (UID: "60fb870e-b8c7-11e6-bee7-42010a800002")
I1202 19:59:13.983279 3560 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/secret/70c91ccd-b8c8-11e6-aa17-42010a800002-default-token-et92n" (spec.Name: "default-token-et92n") pod "70c91ccd-b8c8-11e6-aa17-42010a800002" (UID: "70c91ccd-b8c8-11e6-aa17-42010a800002")
I1202 19:59:14.083669 3560 reconciler.go:306] MountVolume operation started for volume "kubernetes.io/secret/10863ca9-b8c9-11e6-aa17-42010a800002-default-token-nmzqy" (spec.Name: "default-token-nmzqy") to pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002").
I1202 19:59:14.083736 3560 reconciler.go:306] MountVolume operation started for volume "kubernetes.io/host-path/1ece262b44e6d33656e56a138518be7b-varlog" (spec.Name: "varlog") to pod "1ece262b44e6d33656e56a138518be7b" (UID: "1ece262b44e6d33656e56a138518be7b").
I1202 19:59:14.083840 3560 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/host-path/1ece262b44e6d33656e56a138518be7b-varlog" (spec.Name: "varlog") pod "1ece262b44e6d33656e56a138518be7b" (UID: "1ece262b44e6d33656e56a138518be7b").
I1202 19:59:14.083939 3560 reconciler.go:306] MountVolume operation started for volume "kubernetes.io/host-path/2432565ca3c5351a67f0203bb8f07fa3-varlog" (spec.Name: "varlog") to pod "2432565ca3c5351a67f0203bb8f07fa3" (UID: "2432565ca3c5351a67f0203bb8f07fa3").
I1202 19:59:14.084002 3560 reconciler.go:306] MountVolume operation started for volume "kubernetes.io/host-path/a1ad83ee-b8c4-11e6-bee7-42010a800002-log" (spec.Name: "log") to pod "a1ad83ee-b8c4-11e6-bee7-42010a800002" (UID: "a1ad83ee-b8c4-11e6-bee7-42010a800002").
I1202 19:59:14.084064 3560 reconciler.go:306] MountVolume operation started for volume "kubernetes.io/secret/a1ad83ee-b8c4-11e6-bee7-42010a800002-default-token-et92n" (spec.Name: "default-token-et92n") to pod "a1ad83ee-b8c4-11e6-bee7-42010a800002" (UID: "a1ad83ee-b8c4-11e6-bee7-42010a800002").
I1202 19:59:14.084050 3560 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/host-path/2432565ca3c5351a67f0203bb8f07fa3-varlog" (spec.Name: "varlog") pod "2432565ca3c5351a67f0203bb8f07fa3" (UID: "2432565ca3c5351a67f0203bb8f07fa3").
I1202 19:59:14.084112 3560 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/host-path/a1ad83ee-b8c4-11e6-bee7-42010a800002-log" (spec.Name: "log") pod "a1ad83ee-b8c4-11e6-bee7-42010a800002" (UID: "a1ad83ee-b8c4-11e6-bee7-42010a800002").
I1202 19:59:14.084136 3560 reconciler.go:306] MountVolume operation started for volume "kubernetes.io/secret/60fb870e-b8c7-11e6-bee7-42010a800002-default-token-nmzqy" (spec.Name: "default-token-nmzqy") to pod "60fb870e-b8c7-11e6-bee7-42010a800002" (UID: "60fb870e-b8c7-11e6-bee7-42010a800002").
I1202 19:59:14.085199 3560 reconciler.go:306] MountVolume operation started for volume "kubernetes.io/secret/70c91ccd-b8c8-11e6-aa17-42010a800002-default-token-et92n" (spec.Name: "default-token-et92n") to pod "70c91ccd-b8c8-11e6-aa17-42010a800002" (UID: "70c91ccd-b8c8-11e6-aa17-42010a800002").
I1202 19:59:14.085251 3560 reconciler.go:306] MountVolume operation started for volume "kubernetes.io/host-path/1ece262b44e6d33656e56a138518be7b-varlibdockercontainers" (spec.Name: "varlibdockercontainers") to pod "1ece262b44e6d33656e56a138518be7b" (UID: "1ece262b44e6d33656e56a138518be7b").
I1202 19:59:14.085298 3560 reconciler.go:306] MountVolume operation started for volume "kubernetes.io/host-path/2432565ca3c5351a67f0203bb8f07fa3-ssl-certs-host" (spec.Name: "ssl-certs-host") to pod "2432565ca3c5351a67f0203bb8f07fa3" (UID: "2432565ca3c5351a67f0203bb8f07fa3").
I1202 19:59:14.085347 3560 reconciler.go:306] MountVolume operation started for volume "kubernetes.io/host-path/2432565ca3c5351a67f0203bb8f07fa3-kubeconfig" (spec.Name: "kubeconfig") to pod "2432565ca3c5351a67f0203bb8f07fa3" (UID: "2432565ca3c5351a67f0203bb8f07fa3").
I1202 19:59:14.086103 3560 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/host-path/2432565ca3c5351a67f0203bb8f07fa3-kubeconfig" (spec.Name: "kubeconfig") pod "2432565ca3c5351a67f0203bb8f07fa3" (UID: "2432565ca3c5351a67f0203bb8f07fa3").
I1202 19:59:14.086230 3560 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/host-path/1ece262b44e6d33656e56a138518be7b-varlibdockercontainers" (spec.Name: "varlibdockercontainers") pod "1ece262b44e6d33656e56a138518be7b" (UID: "1ece262b44e6d33656e56a138518be7b").
I1202 19:59:14.086530 3560 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/host-path/2432565ca3c5351a67f0203bb8f07fa3-ssl-certs-host" (spec.Name: "ssl-certs-host") pod "2432565ca3c5351a67f0203bb8f07fa3" (UID: "2432565ca3c5351a67f0203bb8f07fa3").
I1202 19:59:14.188211 3560 docker_manager.go:1977] Need to restart pod infra container for "kube-proxy-kubernetes-minion-group-yl0d_kube-system(2432565ca3c5351a67f0203bb8f07fa3)" because it is not found
I1202 19:59:14.290806 3560 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/secret/10863ca9-b8c9-11e6-aa17-42010a800002-default-token-nmzqy" (spec.Name: "default-token-nmzqy") pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002").
I1202 19:59:14.487605 3560 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-60f59472-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-60f59472-b8c7-11e6-bee7-42010a800002") pod "60fb870e-b8c7-11e6-bee7-42010a800002" (UID: "60fb870e-b8c7-11e6-bee7-42010a800002")
I1202 19:59:14.487678 3560 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-61045ddc-b8c7-11e6-bee7-42010a800002") pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002")
E1202 19:59:14.487786 3560 nestedpendingoperations.go:262] Operation for "\"kubernetes.io/gce-pd/kubernetes-dynamic-pvc-60f59472-b8c7-11e6-bee7-42010a800002\"" failed. No retries permitted until 2016-12-02 19:59:15.487719771 +0000 UTC (durationBeforeRetry 1s). Error: Volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-60f59472-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-60f59472-b8c7-11e6-bee7-42010a800002") pod "60fb870e-b8c7-11e6-bee7-42010a800002" (UID: "60fb870e-b8c7-11e6-bee7-42010a800002") has not yet been added to the list of VolumesInUse in the node's volume status.
E1202 19:59:14.487871 3560 nestedpendingoperations.go:262] Operation for "\"kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002\"" failed. No retries permitted until 2016-12-02 19:59:15.487849552 +0000 UTC (durationBeforeRetry 1s). Error: Volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-61045ddc-b8c7-11e6-bee7-42010a800002") pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002") has not yet been added to the list of VolumesInUse in the node's volume status.
I1202 19:59:14.491970 3560 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/secret/a1ad83ee-b8c4-11e6-bee7-42010a800002-default-token-et92n" (spec.Name: "default-token-et92n") pod "a1ad83ee-b8c4-11e6-bee7-42010a800002" (UID: "a1ad83ee-b8c4-11e6-bee7-42010a800002").
I1202 19:59:14.691758 3560 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/secret/60fb870e-b8c7-11e6-bee7-42010a800002-default-token-nmzqy" (spec.Name: "default-token-nmzqy") pod "60fb870e-b8c7-11e6-bee7-42010a800002" (UID: "60fb870e-b8c7-11e6-bee7-42010a800002").
I1202 19:59:14.762578 3560 docker_manager.go:1977] Need to restart pod infra container for "node-problem-detector-v0.1-jh0rp_kube-system(a1ad83ee-b8c4-11e6-bee7-42010a800002)" because it is not found
I1202 19:59:14.892498 3560 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/secret/70c91ccd-b8c8-11e6-aa17-42010a800002-default-token-et92n" (spec.Name: "default-token-et92n") pod "70c91ccd-b8c8-11e6-aa17-42010a800002" (UID: "70c91ccd-b8c8-11e6-aa17-42010a800002").
I1202 19:59:14.912626 3560 provider.go:119] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
I1202 19:59:14.912750 3560 provider.go:119] Refreshing cache for provider: *gcp_credentials.dockerConfigKeyProvider
I1202 19:59:14.913349 3560 config.go:185] body of failing http response: &{0x6e41f0 0xc420dc4f40 0x6e4010}
E1202 19:59:14.913384 3560 metadata.go:142] while reading 'google-dockercfg' metadata: http status code: 404 while fetching url http://metadata.google.internal./computeMetadata/v1/instance/attributes/google-dockercfg
I1202 19:59:14.913410 3560 provider.go:119] Refreshing cache for provider: *gcp_credentials.dockerConfigUrlKeyProvider
I1202 19:59:14.917127 3560 config.go:185] body of failing http response: &{0x6e41f0 0xc420dc56c0 0x6e4010}
E1202 19:59:14.917153 3560 metadata.go:159] while reading 'google-dockercfg-url' metadata: http status code: 404 while fetching url http://metadata.google.internal./computeMetadata/v1/instance/attributes/google-dockercfg-url
I1202 19:59:14.922372 3560 kubelet.go:1816] SyncLoop (PLEG): "kube-proxy-kubernetes-minion-group-yl0d_kube-system(2432565ca3c5351a67f0203bb8f07fa3)", event: &pleg.PodLifecycleEvent{ID:"2432565ca3c5351a67f0203bb8f07fa3", Type:"ContainerStarted", Data:"dd01b3bef9a6b26d5692c461dddc3b7029be0d619768ae3db350883f47fe4e2e"}
W1202 19:59:14.922729 3560 kubelet.go:1497] Deleting mirror pod "kube-proxy-kubernetes-minion-group-yl0d_kube-system(b83a7d0a-b8c4-11e6-bee7-42010a800002)" because it is outdated
I1202 19:59:14.922763 3560 mirror_client.go:84] Deleting a mirror pod "kube-proxy-kubernetes-minion-group-yl0d_kube-system"
I1202 19:59:14.922979 3560 kubelet.go:1816] SyncLoop (PLEG): "kube-proxy-kubernetes-minion-group-yl0d_kube-system(2432565ca3c5351a67f0203bb8f07fa3)", event: &pleg.PodLifecycleEvent{ID:"2432565ca3c5351a67f0203bb8f07fa3", Type:"ContainerStarted", Data:"4995124bdcc60339b14df257341e3d70ba7beafd8c67481516552ac9551cd143"}
I1202 19:59:14.925011 3560 kubelet.go:1816] SyncLoop (PLEG): "node-problem-detector-v0.1-jh0rp_kube-system(a1ad83ee-b8c4-11e6-bee7-42010a800002)", event: &pleg.PodLifecycleEvent{ID:"a1ad83ee-b8c4-11e6-bee7-42010a800002", Type:"ContainerStarted", Data:"59970493c8f3491cefec73c79ebb250dd9432e4de72c60606f31b32d19b64977"}
I1202 19:59:15.329273 3560 kubelet.go:1797] SyncLoop (DELETE, "api"): "kube-proxy-kubernetes-minion-group-yl0d_kube-system(b83a7d0a-b8c4-11e6-bee7-42010a800002)"
I1202 19:59:15.333870 3560 kubelet.go:1791] SyncLoop (REMOVE, "api"): "kube-proxy-kubernetes-minion-group-yl0d_kube-system(b83a7d0a-b8c4-11e6-bee7-42010a800002)"
Flag --api-servers has been deprecated, Use --kubeconfig instead. Will be removed in a future version.
Flag --config has been deprecated, Use --pod-manifest-path instead. Will be removed in a future version.
Flag --babysit-daemons has been deprecated, Will be removed in a future version.
I1202 19:59:15.609976 3891 feature_gate.go:181] feature gates: map[]
I1202 19:59:15.615606 3891 gce.go:331] Using existing Token Source &oauth2.reuseTokenSource{new:google.computeSource{account:""}, mu:sync.Mutex{state:0, sema:0x0}, t:(*oauth2.Token)(nil)}
I1202 19:59:15.620605 3891 server.go:370] Successfully initialized cloud provider: "gce" from the config file: ""
I1202 19:59:15.626330 3891 docker.go:356] Connecting to docker on unix:///var/run/docker.sock
I1202 19:59:15.626356 3891 docker.go:376] Start docker client with request timeout=2m0s
E1202 19:59:15.627437 3891 cni.go:163] error updating cni config: No networks found in /etc/cni/net.d
I1202 19:59:15.629579 3891 iptables.go:176] Could not connect to D-Bus system bus: dial unix /var/run/dbus/system_bus_socket: connect: no such file or directory
I1202 19:59:15.630983 3891 iptables.go:176] Could not connect to D-Bus system bus: dial unix /var/run/dbus/system_bus_socket: connect: no such file or directory
I1202 19:59:15.631074 3891 server.go:512] cloud provider determined current node name to be kubernetes-minion-group-yl0d
I1202 19:59:15.631171 3891 manager.go:143] cAdvisor running in container: "/system"
W1202 19:59:15.635538 3891 manager.go:151] unable to connect to Rkt api service: rkt: cannot tcp Dial rkt api service: dial tcp 127.0.0.1:15441: getsockopt: connection refused
I1202 19:59:15.639159 3891 fs.go:117] Filesystem partitions: map[/dev/sda1:{mountpoint:/var/lib/docker/aufs major:8 minor:1 fsType:ext4 blockSize:0}]
I1202 19:59:15.641367 3891 info.go:47] Couldn't collect info from any of the files in "/etc/machine-id,/var/lib/dbus/machine-id"
I1202 19:59:15.641413 3891 manager.go:198] Machine: {NumCores:4 CpuFrequency:2300000 MemoryCapacity:15807909888 MachineID: SystemUUID:851B5450-D8D9-804A-48F3-7659F0E53A76 BootID:c00b5c61-1e49-41bb-a1f1-5e7ad507a4c5 Filesystems:[{Device:/dev/sda1 Capacity:105553100800 Type:vfs Inodes:6553600 HasInodes:true}] DiskMap:map[8:0:{Name:sda Major:8 Minor:0 Size:107374182400 Scheduler:cfq} 8:16:{Name:sdb Major:8 Minor:16 Size:1073741824 Scheduler:cfq}] NetworkDevices:[{Name:eth0 MacAddress:42:01:0a:80:00:05 Speed:0 Mtu:1460}] Topology:[{Id:0 Memory:15807909888 Cores:[{Id:0 Threads:[0 1] Caches:[{Size:32768 Type:Data Level:1} {Size:32768 Type:Instruction Level:1} {Size:262144 Type:Unified Level:2}]} {Id:1 Threads:[2 3] Caches:[{Size:32768 Type:Data Level:1} {Size:32768 Type:Instruction Level:1} {Size:262144 Type:Unified Level:2}]}] Caches:[{Size:47185920 Type:Unified Level:3}]}] CloudProvider:GCE InstanceType:n1-standard-4 InstanceID:6866432937855577298}
I1202 19:59:15.642065 3891 manager.go:204] Version: {KernelVersion:3.16.0-4-amd64 ContainerOsVersion:Debian GNU/Linux 7 (wheezy) DockerVersion:1.11.2 CadvisorVersion: CadvisorRevision:}
I1202 19:59:15.644201 3891 server.go:512] cloud provider determined current node name to be kubernetes-minion-group-yl0d
I1202 19:59:15.644345 3891 server.go:706] Using root directory: /var/lib/kubelet
I1202 19:59:15.644537 3891 kubelet.go:308] cloud provider determined current node name to be kubernetes-minion-group-yl0d
I1202 19:59:15.644560 3891 kubelet.go:243] Adding manifest file: /etc/kubernetes/manifests
I1202 19:59:15.644587 3891 file.go:48] Watching path "/etc/kubernetes/manifests"
I1202 19:59:15.644606 3891 kubelet.go:253] Watching apiserver
I1202 19:59:15.648532 3891 iptables.go:176] Could not connect to D-Bus system bus: dial unix /var/run/dbus/system_bus_socket: connect: no such file or directory
I1202 19:59:15.648679 3891 kubelet.go:477] Hairpin mode set to "promiscuous-bridge"
I1202 19:59:15.652172 3891 plugins.go:181] Loaded network plugin "kubenet"
I1202 19:59:15.655459 3891 docker_manager.go:259] Setting dockerRoot to /var/lib/docker
I1202 19:59:15.655602 3891 docker_manager.go:262] Setting cgroupDriver to cgroupfs
I1202 19:59:15.658438 3891 plugins.go:344] Loaded volume plugin "kubernetes.io/aws-ebs"
I1202 19:59:15.658469 3891 plugins.go:344] Loaded volume plugin "kubernetes.io/empty-dir"
I1202 19:59:15.658481 3891 plugins.go:344] Loaded volume plugin "kubernetes.io/gce-pd"
I1202 19:59:15.658492 3891 plugins.go:344] Loaded volume plugin "kubernetes.io/git-repo"
I1202 19:59:15.658507 3891 plugins.go:344] Loaded volume plugin "kubernetes.io/host-path"
I1202 19:59:15.658518 3891 plugins.go:344] Loaded volume plugin "kubernetes.io/nfs"
I1202 19:59:15.658529 3891 plugins.go:344] Loaded volume plugin "kubernetes.io/secret"
I1202 19:59:15.658541 3891 plugins.go:344] Loaded volume plugin "kubernetes.io/iscsi"
I1202 19:59:15.658558 3891 plugins.go:344] Loaded volume plugin "kubernetes.io/glusterfs"
I1202 19:59:15.658568 3891 plugins.go:344] Loaded volume plugin "kubernetes.io/rbd"
I1202 19:59:15.658576 3891 plugins.go:344] Loaded volume plugin "kubernetes.io/cinder"
I1202 19:59:15.658583 3891 plugins.go:344] Loaded volume plugin "kubernetes.io/quobyte"
I1202 19:59:15.658590 3891 plugins.go:344] Loaded volume plugin "kubernetes.io/cephfs"
I1202 19:59:15.658610 3891 plugins.go:344] Loaded volume plugin "kubernetes.io/downward-api"
I1202 19:59:15.658618 3891 plugins.go:344] Loaded volume plugin "kubernetes.io/fc"
I1202 19:59:15.658625 3891 plugins.go:344] Loaded volume plugin "kubernetes.io/flocker"
I1202 19:59:15.658632 3891 plugins.go:344] Loaded volume plugin "kubernetes.io/azure-file"
I1202 19:59:15.658639 3891 plugins.go:344] Loaded volume plugin "kubernetes.io/configmap"
I1202 19:59:15.658651 3891 plugins.go:344] Loaded volume plugin "kubernetes.io/vsphere-volume"
I1202 19:59:15.658658 3891 plugins.go:344] Loaded volume plugin "kubernetes.io/azure-disk"
I1202 19:59:15.658665 3891 plugins.go:344] Loaded volume plugin "kubernetes.io/photon-pd"
I1202 19:59:15.659573 3891 server.go:776] Started kubelet v1.6.0-alpha.0.1228+2212c421f6e10e
E1202 19:59:15.659961 3891 kubelet.go:1145] Image garbage collection failed: unable to find data for container /
I1202 19:59:15.660065 3891 server.go:124] Starting to listen on 0.0.0.0:10250
I1202 19:59:15.660198 3891 kubelet_node_status.go:204] Setting node annotation to enable volume controller attach/detach
I1202 19:59:15.660362 3891 server.go:141] Starting to listen read-only on 0.0.0.0:10255
I1202 19:59:15.668469 3891 kubelet_node_status.go:246] Adding node label from cloud provider: beta.kubernetes.io/instance-type=n1-standard-4
I1202 19:59:15.668497 3891 kubelet_node_status.go:257] Adding node label from cloud provider: failure-domain.beta.kubernetes.io/zone=us-central1-b
I1202 19:59:15.668507 3891 kubelet_node_status.go:261] Adding node label from cloud provider: failure-domain.beta.kubernetes.io/region=us-central1
E1202 19:59:15.672769 3891 kubelet.go:1634] Failed to check if disk space is available for the runtime: failed to get fs info for "runtime": unable to find data for container /
E1202 19:59:15.672800 3891 kubelet.go:1642] Failed to check if disk space is available on the root partition: failed to get fs info for "root": unable to find data for container /
I1202 19:59:15.672808 3891 kubelet_node_status.go:358] Recording NodeHasSufficientDisk event message for node kubernetes-minion-group-yl0d
I1202 19:59:15.672835 3891 kubelet_node_status.go:358] Recording NodeHasSufficientMemory event message for node kubernetes-minion-group-yl0d
I1202 19:59:15.672846 3891 kubelet_node_status.go:358] Recording NodeHasNoDiskPressure event message for node kubernetes-minion-group-yl0d
I1202 19:59:15.673605 3891 container_manager_linux.go:405] Configure resource-only container /docker-daemon with memory limit: 11065536921
I1202 19:59:15.673648 3891 fs_resource_analyzer.go:66] Starting FS ResourceAnalyzer
I1202 19:59:15.673678 3891 status_manager.go:131] Starting to sync pod status with apiserver
I1202 19:59:15.673692 3891 kubelet.go:1714] Starting kubelet main sync loop.
I1202 19:59:15.673705 3891 kubelet.go:1725] skipping pod synchronization - [container runtime is down]
I1202 19:59:15.675339 3891 container_manager_linux.go:769] Found 75 PIDs in root, 69 of them are not to be moved
I1202 19:59:15.675359 3891 container_manager_linux.go:776] Moving non-kernel processes: [3764 3765 3766 3767 3768 3769]
I1202 19:59:15.679161 3891 factory.go:295] Registering Docker factory
W1202 19:59:15.679373 3891 manager.go:247] Registration of the rkt container factory failed: unable to communicate with Rkt api service: rkt: cannot tcp Dial rkt api service: dial tcp 127.0.0.1:15441: getsockopt: connection refused
I1202 19:59:15.679384 3891 factory.go:54] Registering systemd factory
I1202 19:59:15.679644 3891 factory.go:86] Registering Raw factory
I1202 19:59:15.679885 3891 manager.go:1106] Started watching for new ooms in manager
I1202 19:59:15.679944 3891 oomparser.go:200] OOM parser using kernel log file: "/var/log/kern.log"
I1202 19:59:15.681028 3891 manager.go:288] Starting recovery of all containers
I1202 19:59:15.703572 3891 container_manager_linux.go:769] Found 69 PIDs in root, 69 of them are not to be moved
I1202 19:59:15.704885 3891 volume_manager.go:240] The desired_state_of_world populator starts
I1202 19:59:15.704900 3891 volume_manager.go:242] Starting Kubelet Volume Manager
I1202 19:59:15.728821 3891 manager.go:293] Recovery completed
I1202 19:59:15.771267 3891 threshold_notifier_linux.go:76] eviction: setting notification threshold to 15545765888
I1202 19:59:15.805234 3891 kubelet_node_status.go:204] Setting node annotation to enable volume controller attach/detach
I1202 19:59:15.807437 3891 kubelet_node_status.go:246] Adding node label from cloud provider: beta.kubernetes.io/instance-type=n1-standard-4
I1202 19:59:15.807456 3891 kubelet_node_status.go:257] Adding node label from cloud provider: failure-domain.beta.kubernetes.io/zone=us-central1-b
I1202 19:59:15.807462 3891 kubelet_node_status.go:261] Adding node label from cloud provider: failure-domain.beta.kubernetes.io/region=us-central1
I1202 19:59:15.811381 3891 kubelet_node_status.go:358] Recording NodeHasSufficientDisk event message for node kubernetes-minion-group-yl0d
I1202 19:59:15.811418 3891 kubelet_node_status.go:358] Recording NodeHasSufficientMemory event message for node kubernetes-minion-group-yl0d
I1202 19:59:15.811429 3891 kubelet_node_status.go:358] Recording NodeHasNoDiskPressure event message for node kubernetes-minion-group-yl0d
I1202 19:59:15.811451 3891 kubelet_node_status.go:74] Attempting to register node kubernetes-minion-group-yl0d
I1202 19:59:15.819929 3891 kubelet_node_status.go:113] Node kubernetes-minion-group-yl0d was previously registered
I1202 19:59:15.819948 3891 kubelet_node_status.go:77] Successfully registered node kubernetes-minion-group-yl0d
I1202 19:59:15.821610 3891 kubenet_linux.go:262] CNI network config set to {
"cniVersion": "0.1.0",
"name": "kubenet",
"type": "bridge",
"bridge": "cbr0",
"mtu": 1460,
"addIf": "eth0",
"isGateway": true,
"ipMasq": false,
"hairpinMode": false,
"ipam": {
"type": "host-local",
"subnet": "10.244.8.0/24",
"gateway": "10.244.8.1",
"routes": [
{ "dst": "0.0.0.0/0" }
]
}
}
I1202 19:59:15.821758 3891 kubelet_network.go:211] Setting Pod CIDR: -> 10.244.8.0/24
I1202 19:59:20.673974 3891 kubelet.go:1781] SyncLoop (ADD, "file"): "fluentd-cloud-logging-kubernetes-minion-group-yl0d_kube-system(1ece262b44e6d33656e56a138518be7b), kube-proxy-kubernetes-minion-group-yl0d_kube-system(2432565ca3c5351a67f0203bb8f07fa3)"
I1202 19:59:20.674141 3891 kubelet.go:1781] SyncLoop (ADD, "api"): "web-2_default(10863ca9-b8c9-11e6-aa17-42010a800002), l7-default-backend-1869959889-n53x9_kube-system(70c91ccd-b8c8-11e6-aa17-42010a800002), fluentd-cloud-logging-kubernetes-minion-group-yl0d_kube-system(b83a347c-b8c4-11e6-bee7-42010a800002), node-problem-detector-v0.1-jh0rp_kube-system(a1ad83ee-b8c4-11e6-bee7-42010a800002), web-0_default(60fb870e-b8c7-11e6-bee7-42010a800002)"
I1202 19:59:20.674243 3891 kubelet.go:1816] SyncLoop (PLEG): "kube-proxy-kubernetes-minion-group-yl0d_kube-system(2432565ca3c5351a67f0203bb8f07fa3)", event: &pleg.PodLifecycleEvent{ID:"2432565ca3c5351a67f0203bb8f07fa3", Type:"ContainerStarted", Data:"dd01b3bef9a6b26d5692c461dddc3b7029be0d619768ae3db350883f47fe4e2e"}
I1202 19:59:20.674277 3891 kubelet.go:1816] SyncLoop (PLEG): "kube-proxy-kubernetes-minion-group-yl0d_kube-system(2432565ca3c5351a67f0203bb8f07fa3)", event: &pleg.PodLifecycleEvent{ID:"2432565ca3c5351a67f0203bb8f07fa3", Type:"ContainerStarted", Data:"4995124bdcc60339b14df257341e3d70ba7beafd8c67481516552ac9551cd143"}
E1202 19:59:20.674405 3891 pod_workers.go:184] Error syncing pod 10863ca9-b8c9-11e6-aa17-42010a800002, skipping: network is not ready: [Kubenet does not have netConfig. This is most likely due to lack of PodCIDR]
E1202 19:59:20.674405 3891 pod_workers.go:184] Error syncing pod 1ece262b44e6d33656e56a138518be7b, skipping: network is not ready: [Kubenet does not have netConfig. This is most likely due to lack of PodCIDR]
E1202 19:59:20.674670 3891 pod_workers.go:184] Error syncing pod 60fb870e-b8c7-11e6-bee7-42010a800002, skipping: network is not ready: [Kubenet does not have netConfig. This is most likely due to lack of PodCIDR]
E1202 19:59:20.674739 3891 pod_workers.go:184] Error syncing pod 70c91ccd-b8c8-11e6-aa17-42010a800002, skipping: network is not ready: [Kubenet does not have netConfig. This is most likely due to lack of PodCIDR]
I1202 19:59:20.681521 3891 kubelet.go:1781] SyncLoop (ADD, "api"): "kube-proxy-kubernetes-minion-group-yl0d_kube-system(d07cb1b3-b8c9-11e6-aa17-42010a800002)"
E1202 19:59:20.730127 3891 pod_workers.go:184] Error syncing pod 1ece262b44e6d33656e56a138518be7b, skipping: network is not ready: [Kubenet does not have netConfig. This is most likely due to lack of PodCIDR]
I1202 19:59:20.816283 3891 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/host-path/2432565ca3c5351a67f0203bb8f07fa3-kubeconfig" (spec.Name: "kubeconfig") pod "2432565ca3c5351a67f0203bb8f07fa3" (UID: "2432565ca3c5351a67f0203bb8f07fa3")
I1202 19:59:20.816340 3891 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/host-path/2432565ca3c5351a67f0203bb8f07fa3-varlog" (spec.Name: "varlog") pod "2432565ca3c5351a67f0203bb8f07fa3" (UID: "2432565ca3c5351a67f0203bb8f07fa3")
I1202 19:59:20.816360 3891 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/host-path/a1ad83ee-b8c4-11e6-bee7-42010a800002-log" (spec.Name: "log") pod "a1ad83ee-b8c4-11e6-bee7-42010a800002" (UID: "a1ad83ee-b8c4-11e6-bee7-42010a800002")
I1202 19:59:20.816378 3891 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/secret/a1ad83ee-b8c4-11e6-bee7-42010a800002-default-token-et92n" (spec.Name: "default-token-et92n") pod "a1ad83ee-b8c4-11e6-bee7-42010a800002" (UID: "a1ad83ee-b8c4-11e6-bee7-42010a800002")
I1202 19:59:20.816397 3891 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/host-path/1ece262b44e6d33656e56a138518be7b-varlog" (spec.Name: "varlog") pod "1ece262b44e6d33656e56a138518be7b" (UID: "1ece262b44e6d33656e56a138518be7b")
I1202 19:59:20.816415 3891 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/host-path/1ece262b44e6d33656e56a138518be7b-varlibdockercontainers" (spec.Name: "varlibdockercontainers") pod "1ece262b44e6d33656e56a138518be7b" (UID: "1ece262b44e6d33656e56a138518be7b")
I1202 19:59:20.816482 3891 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/host-path/2432565ca3c5351a67f0203bb8f07fa3-ssl-certs-host" (spec.Name: "ssl-certs-host") pod "2432565ca3c5351a67f0203bb8f07fa3" (UID: "2432565ca3c5351a67f0203bb8f07fa3")
I1202 19:59:20.916810 3891 reconciler.go:306] MountVolume operation started for volume "kubernetes.io/host-path/1ece262b44e6d33656e56a138518be7b-varlibdockercontainers" (spec.Name: "varlibdockercontainers") to pod "1ece262b44e6d33656e56a138518be7b" (UID: "1ece262b44e6d33656e56a138518be7b").
I1202 19:59:20.916893 3891 reconciler.go:306] MountVolume operation started for volume "kubernetes.io/host-path/2432565ca3c5351a67f0203bb8f07fa3-ssl-certs-host" (spec.Name: "ssl-certs-host") to pod "2432565ca3c5351a67f0203bb8f07fa3" (UID: "2432565ca3c5351a67f0203bb8f07fa3").
I1202 19:59:20.916919 3891 reconciler.go:306] MountVolume operation started for volume "kubernetes.io/host-path/2432565ca3c5351a67f0203bb8f07fa3-kubeconfig" (spec.Name: "kubeconfig") to pod "2432565ca3c5351a67f0203bb8f07fa3" (UID: "2432565ca3c5351a67f0203bb8f07fa3").
I1202 19:59:20.916801 3891 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/host-path/1ece262b44e6d33656e56a138518be7b-varlibdockercontainers" (spec.Name: "varlibdockercontainers") pod "1ece262b44e6d33656e56a138518be7b" (UID: "1ece262b44e6d33656e56a138518be7b").
I1202 19:59:20.916942 3891 reconciler.go:306] MountVolume operation started for volume "kubernetes.io/host-path/2432565ca3c5351a67f0203bb8f07fa3-varlog" (spec.Name: "varlog") to pod "2432565ca3c5351a67f0203bb8f07fa3" (UID: "2432565ca3c5351a67f0203bb8f07fa3").
I1202 19:59:20.916964 3891 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/host-path/2432565ca3c5351a67f0203bb8f07fa3-varlog" (spec.Name: "varlog") pod "2432565ca3c5351a67f0203bb8f07fa3" (UID: "2432565ca3c5351a67f0203bb8f07fa3").
I1202 19:59:20.916966 3891 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/host-path/2432565ca3c5351a67f0203bb8f07fa3-ssl-certs-host" (spec.Name: "ssl-certs-host") pod "2432565ca3c5351a67f0203bb8f07fa3" (UID: "2432565ca3c5351a67f0203bb8f07fa3").
I1202 19:59:20.917013 3891 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/host-path/2432565ca3c5351a67f0203bb8f07fa3-kubeconfig" (spec.Name: "kubeconfig") pod "2432565ca3c5351a67f0203bb8f07fa3" (UID: "2432565ca3c5351a67f0203bb8f07fa3").
I1202 19:59:20.917017 3891 reconciler.go:306] MountVolume operation started for volume "kubernetes.io/host-path/a1ad83ee-b8c4-11e6-bee7-42010a800002-log" (spec.Name: "log") to pod "a1ad83ee-b8c4-11e6-bee7-42010a800002" (UID: "a1ad83ee-b8c4-11e6-bee7-42010a800002").
I1202 19:59:20.917035 3891 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/host-path/a1ad83ee-b8c4-11e6-bee7-42010a800002-log" (spec.Name: "log") pod "a1ad83ee-b8c4-11e6-bee7-42010a800002" (UID: "a1ad83ee-b8c4-11e6-bee7-42010a800002").
I1202 19:59:20.917092 3891 reconciler.go:306] MountVolume operation started for volume "kubernetes.io/secret/a1ad83ee-b8c4-11e6-bee7-42010a800002-default-token-et92n" (spec.Name: "default-token-et92n") to pod "a1ad83ee-b8c4-11e6-bee7-42010a800002" (UID: "a1ad83ee-b8c4-11e6-bee7-42010a800002").
I1202 19:59:20.917126 3891 reconciler.go:306] MountVolume operation started for volume "kubernetes.io/host-path/1ece262b44e6d33656e56a138518be7b-varlog" (spec.Name: "varlog") to pod "1ece262b44e6d33656e56a138518be7b" (UID: "1ece262b44e6d33656e56a138518be7b").
I1202 19:59:20.917156 3891 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/host-path/1ece262b44e6d33656e56a138518be7b-varlog" (spec.Name: "varlog") pod "1ece262b44e6d33656e56a138518be7b" (UID: "1ece262b44e6d33656e56a138518be7b").
I1202 19:59:21.218197 3891 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-60f59472-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-60f59472-b8c7-11e6-bee7-42010a800002") pod "60fb870e-b8c7-11e6-bee7-42010a800002" (UID: "60fb870e-b8c7-11e6-bee7-42010a800002")
I1202 19:59:21.218250 3891 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/secret/60fb870e-b8c7-11e6-bee7-42010a800002-default-token-nmzqy" (spec.Name: "default-token-nmzqy") pod "60fb870e-b8c7-11e6-bee7-42010a800002" (UID: "60fb870e-b8c7-11e6-bee7-42010a800002")
I1202 19:59:21.218317 3891 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/secret/70c91ccd-b8c8-11e6-aa17-42010a800002-default-token-et92n" (spec.Name: "default-token-et92n") pod "70c91ccd-b8c8-11e6-aa17-42010a800002" (UID: "70c91ccd-b8c8-11e6-aa17-42010a800002")
E1202 19:59:21.218360 3891 nestedpendingoperations.go:262] Operation for "\"kubernetes.io/gce-pd/kubernetes-dynamic-pvc-60f59472-b8c7-11e6-bee7-42010a800002\"" failed. No retries permitted until 2016-12-02 19:59:21.718317233 +0000 UTC (durationBeforeRetry 500ms). Error: Volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-60f59472-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-60f59472-b8c7-11e6-bee7-42010a800002") pod "60fb870e-b8c7-11e6-bee7-42010a800002" (UID: "60fb870e-b8c7-11e6-bee7-42010a800002") has not yet been added to the list of VolumesInUse in the node's volume status.
I1202 19:59:21.318699 3891 reconciler.go:306] MountVolume operation started for volume "kubernetes.io/secret/60fb870e-b8c7-11e6-bee7-42010a800002-default-token-nmzqy" (spec.Name: "default-token-nmzqy") to pod "60fb870e-b8c7-11e6-bee7-42010a800002" (UID: "60fb870e-b8c7-11e6-bee7-42010a800002").
I1202 19:59:21.318784 3891 reconciler.go:306] MountVolume operation started for volume "kubernetes.io/secret/70c91ccd-b8c8-11e6-aa17-42010a800002-default-token-et92n" (spec.Name: "default-token-et92n") to pod "70c91ccd-b8c8-11e6-aa17-42010a800002" (UID: "70c91ccd-b8c8-11e6-aa17-42010a800002").
I1202 19:59:21.320106 3891 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/secret/a1ad83ee-b8c4-11e6-bee7-42010a800002-default-token-et92n" (spec.Name: "default-token-et92n") pod "a1ad83ee-b8c4-11e6-bee7-42010a800002" (UID: "a1ad83ee-b8c4-11e6-bee7-42010a800002").
I1202 19:59:21.576740 3891 provider.go:119] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
I1202 19:59:21.576868 3891 provider.go:119] Refreshing cache for provider: *gcp_credentials.dockerConfigKeyProvider
I1202 19:59:21.577551 3891 config.go:185] body of failing http response: &{0x6e41f0 0xc420bd6940 0x6e4010}
E1202 19:59:21.577584 3891 metadata.go:142] while reading 'google-dockercfg' metadata: http status code: 404 while fetching url http://metadata.google.internal./computeMetadata/v1/instance/attributes/google-dockercfg
I1202 19:59:21.577598 3891 provider.go:119] Refreshing cache for provider: *gcp_credentials.dockerConfigUrlKeyProvider
I1202 19:59:21.579314 3891 config.go:185] body of failing http response: &{0x6e41f0 0xc4211b0380 0x6e4010}
E1202 19:59:21.579333 3891 metadata.go:159] while reading 'google-dockercfg-url' metadata: http status code: 404 while fetching url http://metadata.google.internal./computeMetadata/v1/instance/attributes/google-dockercfg-url
I1202 19:59:21.720381 3891 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-60f59472-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-60f59472-b8c7-11e6-bee7-42010a800002") pod "60fb870e-b8c7-11e6-bee7-42010a800002" (UID: "60fb870e-b8c7-11e6-bee7-42010a800002")
E1202 19:59:21.720524 3891 nestedpendingoperations.go:262] Operation for "\"kubernetes.io/gce-pd/kubernetes-dynamic-pvc-60f59472-b8c7-11e6-bee7-42010a800002\"" failed. No retries permitted until 2016-12-02 19:59:22.720491621 +0000 UTC (durationBeforeRetry 1s). Error: Volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-60f59472-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-60f59472-b8c7-11e6-bee7-42010a800002") pod "60fb870e-b8c7-11e6-bee7-42010a800002" (UID: "60fb870e-b8c7-11e6-bee7-42010a800002") has not yet been added to the list of VolumesInUse in the node's volume status.
I1202 19:59:21.921605 3891 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/secret/60fb870e-b8c7-11e6-bee7-42010a800002-default-token-nmzqy" (spec.Name: "default-token-nmzqy") pod "60fb870e-b8c7-11e6-bee7-42010a800002" (UID: "60fb870e-b8c7-11e6-bee7-42010a800002").
I1202 19:59:22.121717 3891 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/secret/70c91ccd-b8c8-11e6-aa17-42010a800002-default-token-et92n" (spec.Name: "default-token-et92n") pod "70c91ccd-b8c8-11e6-aa17-42010a800002" (UID: "70c91ccd-b8c8-11e6-aa17-42010a800002").
I1202 19:59:22.622352 3891 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/secret/10863ca9-b8c9-11e6-aa17-42010a800002-default-token-nmzqy" (spec.Name: "default-token-nmzqy") pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002")
I1202 19:59:22.622422 3891 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-61045ddc-b8c7-11e6-bee7-42010a800002") pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002")
E1202 19:59:22.622498 3891 nestedpendingoperations.go:262] Operation for "\"kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002\"" failed. No retries permitted until 2016-12-02 19:59:23.122479183 +0000 UTC (durationBeforeRetry 500ms). Error: Volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-61045ddc-b8c7-11e6-bee7-42010a800002") pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002") has not yet been added to the list of VolumesInUse in the node's volume status.
I1202 19:59:22.722744 3891 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-60f59472-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-60f59472-b8c7-11e6-bee7-42010a800002") pod "60fb870e-b8c7-11e6-bee7-42010a800002" (UID: "60fb870e-b8c7-11e6-bee7-42010a800002")
E1202 19:59:22.722837 3891 nestedpendingoperations.go:262] Operation for "\"kubernetes.io/gce-pd/kubernetes-dynamic-pvc-60f59472-b8c7-11e6-bee7-42010a800002\"" failed. No retries permitted until 2016-12-02 19:59:24.722810581 +0000 UTC (durationBeforeRetry 2s). Error: Volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-60f59472-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-60f59472-b8c7-11e6-bee7-42010a800002") pod "60fb870e-b8c7-11e6-bee7-42010a800002" (UID: "60fb870e-b8c7-11e6-bee7-42010a800002") has not yet been added to the list of VolumesInUse in the node's volume status.
I1202 19:59:22.722887 3891 reconciler.go:306] MountVolume operation started for volume "kubernetes.io/secret/10863ca9-b8c9-11e6-aa17-42010a800002-default-token-nmzqy" (spec.Name: "default-token-nmzqy") to pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002").
I1202 19:59:22.906689 3891 kube_docker_client.go:331] Stop pulling image "gcr.io/google_containers/node-problem-detector:v0.1": "Status: Downloaded newer image for gcr.io/google_containers/node-problem-detector:v0.1"
I1202 19:59:22.924923 3891 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/secret/10863ca9-b8c9-11e6-aa17-42010a800002-default-token-nmzqy" (spec.Name: "default-token-nmzqy") pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002").
I1202 19:59:22.986944 3891 docker_manager.go:798] Container "node-problem-detector" of pod "node-problem-detector-v0.1-jh0rp_kube-system(a1ad83ee-b8c4-11e6-bee7-42010a800002)" created with warnings: [Your kernel does not support CPU cfs period. Period discarded. Your kernel does not support CPU cfs quota. Quota discarded.]
I1202 19:59:23.123920 3891 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-61045ddc-b8c7-11e6-bee7-42010a800002") pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002")
E1202 19:59:23.124051 3891 nestedpendingoperations.go:262] Operation for "\"kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002\"" failed. No retries permitted until 2016-12-02 19:59:24.124012464 +0000 UTC (durationBeforeRetry 1s). Error: Volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-61045ddc-b8c7-11e6-bee7-42010a800002") pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002") has not yet been added to the list of VolumesInUse in the node's volume status.
I1202 19:59:23.737683 3891 kubelet.go:1816] SyncLoop (PLEG): "node-problem-detector-v0.1-jh0rp_kube-system(a1ad83ee-b8c4-11e6-bee7-42010a800002)", event: &pleg.PodLifecycleEvent{ID:"a1ad83ee-b8c4-11e6-bee7-42010a800002", Type:"ContainerStarted", Data:"f2a656536023e8146e9e88e05feae65ac81fe1b34ff73a692bb5ed6380201310"}
I1202 19:59:23.829006 3891 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/secret/a1ad83ee-b8c4-11e6-bee7-42010a800002-default-token-et92n" (spec.Name: "default-token-et92n") pod "a1ad83ee-b8c4-11e6-bee7-42010a800002" (UID: "a1ad83ee-b8c4-11e6-bee7-42010a800002").
I1202 19:59:24.126976 3891 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-61045ddc-b8c7-11e6-bee7-42010a800002") pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002")
E1202 19:59:24.127106 3891 nestedpendingoperations.go:262] Operation for "\"kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002\"" failed. No retries permitted until 2016-12-02 19:59:26.127080341 +0000 UTC (durationBeforeRetry 2s). Error: Volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-61045ddc-b8c7-11e6-bee7-42010a800002") pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002") has not yet been added to the list of VolumesInUse in the node's volume status.
I1202 19:59:24.728758 3891 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-60f59472-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-60f59472-b8c7-11e6-bee7-42010a800002") pod "60fb870e-b8c7-11e6-bee7-42010a800002" (UID: "60fb870e-b8c7-11e6-bee7-42010a800002")
E1202 19:59:24.728893 3891 nestedpendingoperations.go:262] Operation for "\"kubernetes.io/gce-pd/kubernetes-dynamic-pvc-60f59472-b8c7-11e6-bee7-42010a800002\"" failed. No retries permitted until 2016-12-02 19:59:28.728858668 +0000 UTC (durationBeforeRetry 4s). Error: Volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-60f59472-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-60f59472-b8c7-11e6-bee7-42010a800002") pod "60fb870e-b8c7-11e6-bee7-42010a800002" (UID: "60fb870e-b8c7-11e6-bee7-42010a800002") has not yet been added to the list of VolumesInUse in the node's volume status.
I1202 19:59:26.132605 3891 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-61045ddc-b8c7-11e6-bee7-42010a800002") pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002")
E1202 19:59:26.135516 3891 nestedpendingoperations.go:262] Operation for "\"kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002\"" failed. No retries permitted until 2016-12-02 19:59:30.135493346 +0000 UTC (durationBeforeRetry 4s). Error: Volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-61045ddc-b8c7-11e6-bee7-42010a800002") pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002") is not yet attached according to node status.
I1202 19:59:28.740050 3891 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-60f59472-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-60f59472-b8c7-11e6-bee7-42010a800002") pod "60fb870e-b8c7-11e6-bee7-42010a800002" (UID: "60fb870e-b8c7-11e6-bee7-42010a800002")
I1202 19:59:28.742518 3891 operation_executor.go:1199] Controller successfully attached volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-60f59472-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-60f59472-b8c7-11e6-bee7-42010a800002") pod "60fb870e-b8c7-11e6-bee7-42010a800002" (UID: "60fb870e-b8c7-11e6-bee7-42010a800002") devicePath: "/dev/disk/by-id/google-kubernetes-dynamic-pvc-60f59472-b8c7-11e6-bee7-42010a800002"
I1202 19:59:28.840429 3891 reconciler.go:306] MountVolume operation started for volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-60f59472-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-60f59472-b8c7-11e6-bee7-42010a800002") to pod "60fb870e-b8c7-11e6-bee7-42010a800002" (UID: "60fb870e-b8c7-11e6-bee7-42010a800002").
I1202 19:59:28.840499 3891 operation_executor.go:811] Entering MountVolume.WaitForAttach for volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-60f59472-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-60f59472-b8c7-11e6-bee7-42010a800002") pod "60fb870e-b8c7-11e6-bee7-42010a800002" (UID: "60fb870e-b8c7-11e6-bee7-42010a800002") DevicePath: "/dev/disk/by-id/google-kubernetes-dynamic-pvc-60f59472-b8c7-11e6-bee7-42010a800002"
I1202 19:59:29.840912 3891 attacher.go:167] Successfully found attached GCE PD "kubernetes-dynamic-pvc-60f59472-b8c7-11e6-bee7-42010a800002".
I1202 19:59:29.840968 3891 operation_executor.go:831] MountVolume.WaitForAttach succeeded for volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-60f59472-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-60f59472-b8c7-11e6-bee7-42010a800002") pod "60fb870e-b8c7-11e6-bee7-42010a800002" (UID: "60fb870e-b8c7-11e6-bee7-42010a800002").
I1202 19:59:30.098058 3891 operation_executor.go:870] MountVolume.MountDevice succeeded for volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-60f59472-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-60f59472-b8c7-11e6-bee7-42010a800002") pod "60fb870e-b8c7-11e6-bee7-42010a800002" (UID: "60fb870e-b8c7-11e6-bee7-42010a800002") device mount path "/var/lib/kubelet/plugins/kubernetes.io/gce-pd/mounts/kubernetes-dynamic-pvc-60f59472-b8c7-11e6-bee7-42010a800002"
I1202 19:59:30.107279 3891 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-60f59472-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-60f59472-b8c7-11e6-bee7-42010a800002") pod "60fb870e-b8c7-11e6-bee7-42010a800002" (UID: "60fb870e-b8c7-11e6-bee7-42010a800002").
I1202 19:59:30.144815 3891 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-61045ddc-b8c7-11e6-bee7-42010a800002") pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002")
E1202 19:59:30.147579 3891 nestedpendingoperations.go:262] Operation for "\"kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002\"" failed. No retries permitted until 2016-12-02 19:59:38.147511314 +0000 UTC (durationBeforeRetry 8s). Error: Volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-61045ddc-b8c7-11e6-bee7-42010a800002") pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002") is not yet attached according to node status.
E1202 19:59:33.674486 3891 pod_workers.go:184] Error syncing pod 1ece262b44e6d33656e56a138518be7b, skipping: network is not ready: [Kubenet does not have netConfig. This is most likely due to lack of PodCIDR]
E1202 19:59:34.674134 3891 pod_workers.go:184] Error syncing pod 10863ca9-b8c9-11e6-aa17-42010a800002, skipping: network is not ready: [Kubenet does not have netConfig. This is most likely due to lack of PodCIDR]
E1202 19:59:34.674281 3891 pod_workers.go:184] Error syncing pod 60fb870e-b8c7-11e6-bee7-42010a800002, skipping: network is not ready: [Kubenet does not have netConfig. This is most likely due to lack of PodCIDR]
E1202 19:59:35.674409 3891 pod_workers.go:184] Error syncing pod 70c91ccd-b8c8-11e6-aa17-42010a800002, skipping: network is not ready: [Kubenet does not have netConfig. This is most likely due to lack of PodCIDR]
I1202 19:59:38.163576 3891 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-61045ddc-b8c7-11e6-bee7-42010a800002") pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002")
E1202 19:59:38.166404 3891 nestedpendingoperations.go:262] Operation for "\"kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002\"" failed. No retries permitted until 2016-12-02 19:59:54.166382317 +0000 UTC (durationBeforeRetry 16s). Error: Volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-61045ddc-b8c7-11e6-bee7-42010a800002") pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002") is not yet attached according to node status.
W1202 19:59:45.674488 3891 kubelet.go:1497] Deleting mirror pod "fluentd-cloud-logging-kubernetes-minion-group-yl0d_kube-system(b83a347c-b8c4-11e6-bee7-42010a800002)" because it is outdated
I1202 19:59:45.674516 3891 mirror_client.go:84] Deleting a mirror pod "fluentd-cloud-logging-kubernetes-minion-group-yl0d_kube-system"
I1202 19:59:45.679525 3891 kubelet.go:1797] SyncLoop (DELETE, "api"): "fluentd-cloud-logging-kubernetes-minion-group-yl0d_kube-system(b83a347c-b8c4-11e6-bee7-42010a800002)"
I1202 19:59:45.684794 3891 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/secret/60fb870e-b8c7-11e6-bee7-42010a800002-default-token-nmzqy" (spec.Name: "default-token-nmzqy") pod "60fb870e-b8c7-11e6-bee7-42010a800002" (UID: "60fb870e-b8c7-11e6-bee7-42010a800002").
I1202 19:59:45.689124 3891 kubelet.go:1791] SyncLoop (REMOVE, "api"): "fluentd-cloud-logging-kubernetes-minion-group-yl0d_kube-system(b83a347c-b8c4-11e6-bee7-42010a800002)"
I1202 19:59:45.702994 3891 kubelet.go:1781] SyncLoop (ADD, "api"): "fluentd-cloud-logging-kubernetes-minion-group-yl0d_kube-system(df671c6e-b8c9-11e6-aa17-42010a800002)"
I1202 19:59:45.868556 3891 kubelet_node_status.go:358] Recording NodeReady event message for node kubernetes-minion-group-yl0d
I1202 19:59:45.974622 3891 docker_manager.go:1977] Need to restart pod infra container for "web-0_default(60fb870e-b8c7-11e6-bee7-42010a800002)" because it is not found
I1202 19:59:46.004609 3891 docker_manager.go:1977] Need to restart pod infra container for "fluentd-cloud-logging-kubernetes-minion-group-yl0d_kube-system(1ece262b44e6d33656e56a138518be7b)" because it is not found
2016/12/02 19:59:46 Error retriving last reserved ip: Failed to retrieve last reserved ip: open /var/lib/cni/networks/kubenet/last_reserved_ip: no such file or directory
E1202 19:59:46.364558 3891 kubenet_linux.go:804] Failed to flush dedup chain: Failed to flush filter chain KUBE-DEDUP: exit status 255, output: Chain 'KUBE-DEDUP' doesn't exist.
I1202 19:59:46.657548 3891 docker_manager.go:2238] Determined pod ip after infra change: "web-0_default(60fb870e-b8c7-11e6-bee7-42010a800002)": "10.244.8.2"
I1202 19:59:46.658648 3891 docker_manager.go:2238] Determined pod ip after infra change: "fluentd-cloud-logging-kubernetes-minion-group-yl0d_kube-system(1ece262b44e6d33656e56a138518be7b)": "10.244.8.3"
I1202 19:59:46.771330 3891 kubelet.go:1816] SyncLoop (PLEG): "web-0_default(60fb870e-b8c7-11e6-bee7-42010a800002)", event: &pleg.PodLifecycleEvent{ID:"60fb870e-b8c7-11e6-bee7-42010a800002", Type:"ContainerStarted", Data:"75fe6583aa1cf8345ecc868b9d19866d4aed8baf6b5122505e8039601b215c5f"}
I1202 19:59:46.773606 3891 kubelet.go:1816] SyncLoop (PLEG): "fluentd-cloud-logging-kubernetes-minion-group-yl0d_kube-system(1ece262b44e6d33656e56a138518be7b)", event: &pleg.PodLifecycleEvent{ID:"1ece262b44e6d33656e56a138518be7b", Type:"ContainerStarted", Data:"424e106f7fd5250fd4689f86e0ef83411ff229e332a05e0382ef8e4a440eba57"}
I1202 19:59:49.695834 3891 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/secret/70c91ccd-b8c8-11e6-aa17-42010a800002-default-token-et92n" (spec.Name: "default-token-et92n") pod "70c91ccd-b8c8-11e6-aa17-42010a800002" (UID: "70c91ccd-b8c8-11e6-aa17-42010a800002").
I1202 19:59:49.696190 3891 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/secret/10863ca9-b8c9-11e6-aa17-42010a800002-default-token-nmzqy" (spec.Name: "default-token-nmzqy") pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002").
I1202 19:59:49.974596 3891 docker_manager.go:1977] Need to restart pod infra container for "l7-default-backend-1869959889-n53x9_kube-system(70c91ccd-b8c8-11e6-aa17-42010a800002)" because it is not found
I1202 19:59:50.408063 3891 docker_manager.go:2238] Determined pod ip after infra change: "l7-default-backend-1869959889-n53x9_kube-system(70c91ccd-b8c8-11e6-aa17-42010a800002)": "10.244.8.4"
I1202 19:59:50.782336 3891 kubelet.go:1816] SyncLoop (PLEG): "l7-default-backend-1869959889-n53x9_kube-system(70c91ccd-b8c8-11e6-aa17-42010a800002)", event: &pleg.PodLifecycleEvent{ID:"70c91ccd-b8c8-11e6-aa17-42010a800002", Type:"ContainerStarted", Data:"aea4e6557e6de16be3e6efae86817a0dbf3ea16622d4fb750fb2d041e3f7ba6d"}
I1202 19:59:51.470624 3891 kube_docker_client.go:331] Stop pulling image "gcr.io/google_containers/nginx-slim:0.8": "Status: Downloaded newer image for gcr.io/google_containers/nginx-slim:0.8"
I1202 19:59:51.788025 3891 kubelet.go:1816] SyncLoop (PLEG): "web-0_default(60fb870e-b8c7-11e6-bee7-42010a800002)", event: &pleg.PodLifecycleEvent{ID:"60fb870e-b8c7-11e6-bee7-42010a800002", Type:"ContainerStarted", Data:"d801820cadedfc1ca438819fa9e3ff32199e95416afe6c6ef10df30796c2841f"}
I1202 19:59:51.811147 3891 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/secret/60fb870e-b8c7-11e6-bee7-42010a800002-default-token-nmzqy" (spec.Name: "default-token-nmzqy") pod "60fb870e-b8c7-11e6-bee7-42010a800002" (UID: "60fb870e-b8c7-11e6-bee7-42010a800002").
I1202 19:59:52.807949 3891 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/secret/60fb870e-b8c7-11e6-bee7-42010a800002-default-token-nmzqy" (spec.Name: "default-token-nmzqy") pod "60fb870e-b8c7-11e6-bee7-42010a800002" (UID: "60fb870e-b8c7-11e6-bee7-42010a800002").
I1202 19:59:54.208405 3891 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-61045ddc-b8c7-11e6-bee7-42010a800002") pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002")
E1202 19:59:54.210923 3891 nestedpendingoperations.go:262] Operation for "\"kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002\"" failed. No retries permitted until 2016-12-02 20:00:26.21089928 +0000 UTC (durationBeforeRetry 32s). Error: Volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-61045ddc-b8c7-11e6-bee7-42010a800002") pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002") is not yet attached according to node status.
I1202 20:00:01.657068 3891 kube_docker_client.go:328] Pulling image "gcr.io/google_containers/fluentd-gcp:1.28": "c26ade95f65d: Extracting [===================================> ] 62.95 MB/89.33 MB"
I1202 20:00:04.722917 3891 kube_docker_client.go:331] Stop pulling image "gcr.io/google_containers/fluentd-gcp:1.28": "Status: Downloaded newer image for gcr.io/google_containers/fluentd-gcp:1.28"
I1202 20:00:05.076345 3891 server.go:741] GET /stats/summary/: (8.588696ms) 200 [[Go-http-client/1.1] 10.244.6.3:52209]
I1202 20:00:05.825272 3891 kubelet.go:1816] SyncLoop (PLEG): "fluentd-cloud-logging-kubernetes-minion-group-yl0d_kube-system(1ece262b44e6d33656e56a138518be7b)", event: &pleg.PodLifecycleEvent{ID:"1ece262b44e6d33656e56a138518be7b", Type:"ContainerStarted", Data:"4c7b0c7ebd5bee513c2d24e5ba44234d9c25175aaa3276602d7ca07ecc082611"}
I1202 20:00:07.567546 3891 kube_docker_client.go:331] Stop pulling image "gcr.io/google_containers/defaultbackend:1.0": "gcr.io/google_containers/defaultbackend: this image was pulled from a legacy registry. Important: This registry version will not be supported in future versions of docker."
I1202 20:00:07.643065 3891 docker_manager.go:798] Container "default-http-backend" of pod "l7-default-backend-1869959889-n53x9_kube-system(70c91ccd-b8c8-11e6-aa17-42010a800002)" created with warnings: [Your kernel does not support CPU cfs period. Period discarded. Your kernel does not support CPU cfs quota. Quota discarded.]
I1202 20:00:07.834684 3891 kubelet.go:1816] SyncLoop (PLEG): "l7-default-backend-1869959889-n53x9_kube-system(70c91ccd-b8c8-11e6-aa17-42010a800002)", event: &pleg.PodLifecycleEvent{ID:"70c91ccd-b8c8-11e6-aa17-42010a800002", Type:"ContainerStarted", Data:"440c5e1fd71332022eb4054efe2d2c2907641d5e511ba626076512340a58746b"}
I1202 20:00:07.852918 3891 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/secret/70c91ccd-b8c8-11e6-aa17-42010a800002-default-token-et92n" (spec.Name: "default-token-et92n") pod "70c91ccd-b8c8-11e6-aa17-42010a800002" (UID: "70c91ccd-b8c8-11e6-aa17-42010a800002").
I1202 20:00:08.845941 3891 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/secret/70c91ccd-b8c8-11e6-aa17-42010a800002-default-token-et92n" (spec.Name: "default-token-et92n") pod "70c91ccd-b8c8-11e6-aa17-42010a800002" (UID: "70c91ccd-b8c8-11e6-aa17-42010a800002").
I1202 20:00:15.484945 3891 server.go:741] GET /healthz: (44.815µs) 200 [[curl/7.26.0] 127.0.0.1:48737]
I1202 20:00:15.728646 3891 container_manager_linux.go:769] Found 71 PIDs in root, 71 of them are not to be moved
I1202 20:00:25.496777 3891 server.go:741] GET /healthz: (29.914µs) 200 [[curl/7.26.0] 127.0.0.1:48742]
I1202 20:00:26.283919 3891 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-61045ddc-b8c7-11e6-bee7-42010a800002") pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002")
E1202 20:00:26.286731 3891 nestedpendingoperations.go:262] Operation for "\"kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002\"" failed. No retries permitted until 2016-12-02 20:01:30.286708125 +0000 UTC (durationBeforeRetry 1m4s). Error: Volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-61045ddc-b8c7-11e6-bee7-42010a800002") pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002") is not yet attached according to node status.
I1202 20:00:35.509457 3891 server.go:741] GET /healthz: (37.944µs) 200 [[curl/7.26.0] 127.0.0.1:48746]
I1202 20:00:37.713836 3891 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/secret/a1ad83ee-b8c4-11e6-bee7-42010a800002-default-token-et92n" (spec.Name: "default-token-et92n") pod "a1ad83ee-b8c4-11e6-bee7-42010a800002" (UID: "a1ad83ee-b8c4-11e6-bee7-42010a800002").
I1202 20:00:45.522190 3891 server.go:741] GET /healthz: (29.094µs) 200 [[curl/7.26.0] 127.0.0.1:48752]
I1202 20:00:55.535347 3891 server.go:741] GET /healthz: (39.121µs) 200 [[curl/7.26.0] 127.0.0.1:48760]
I1202 20:00:58.763096 3891 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/secret/60fb870e-b8c7-11e6-bee7-42010a800002-default-token-nmzqy" (spec.Name: "default-token-nmzqy") pod "60fb870e-b8c7-11e6-bee7-42010a800002" (UID: "60fb870e-b8c7-11e6-bee7-42010a800002").
I1202 20:01:05.064232 3891 server.go:741] GET /stats/summary/: (6.969612ms) 200 [[Go-http-client/1.1] 10.244.6.3:52209]
I1202 20:01:05.548523 3891 server.go:741] GET /healthz: (39.127µs) 200 [[curl/7.26.0] 127.0.0.1:48764]
I1202 20:01:15.561102 3891 server.go:741] GET /healthz: (33.487µs) 200 [[curl/7.26.0] 127.0.0.1:48770]
I1202 20:01:15.729566 3891 container_manager_linux.go:769] Found 71 PIDs in root, 71 of them are not to be moved
I1202 20:01:25.573157 3891 server.go:741] GET /healthz: (40.183µs) 200 [[curl/7.26.0] 127.0.0.1:48776]
I1202 20:01:30.341248 3891 reconciler.go:230] VerifyControllerAttachedVolume operation started for volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-61045ddc-b8c7-11e6-bee7-42010a800002") pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002")
I1202 20:01:30.344184 3891 operation_executor.go:1199] Controller successfully attached volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-61045ddc-b8c7-11e6-bee7-42010a800002") pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002") devicePath: "/dev/disk/by-id/google-kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002"
I1202 20:01:30.441587 3891 reconciler.go:306] MountVolume operation started for volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-61045ddc-b8c7-11e6-bee7-42010a800002") to pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002").
I1202 20:01:30.441648 3891 operation_executor.go:811] Entering MountVolume.WaitForAttach for volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-61045ddc-b8c7-11e6-bee7-42010a800002") pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002") DevicePath: "/dev/disk/by-id/google-kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002"
I1202 20:01:31.442001 3891 attacher.go:167] Successfully found attached GCE PD "kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002".
I1202 20:01:31.442055 3891 operation_executor.go:831] MountVolume.WaitForAttach succeeded for volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-61045ddc-b8c7-11e6-bee7-42010a800002") pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002").
I1202 20:01:31.708433 3891 operation_executor.go:870] MountVolume.MountDevice succeeded for volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-61045ddc-b8c7-11e6-bee7-42010a800002") pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002") device mount path "/var/lib/kubelet/plugins/kubernetes.io/gce-pd/mounts/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002"
I1202 20:01:31.719114 3891 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/gce-pd/kubernetes-dynamic-pvc-61045ddc-b8c7-11e6-bee7-42010a800002" (spec.Name: "pvc-61045ddc-b8c7-11e6-bee7-42010a800002") pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002").
I1202 20:01:31.974842 3891 docker_manager.go:1977] Need to restart pod infra container for "web-2_default(10863ca9-b8c9-11e6-aa17-42010a800002)" because it is not found
I1202 20:01:32.365606 3891 docker_manager.go:2238] Determined pod ip after infra change: "web-2_default(10863ca9-b8c9-11e6-aa17-42010a800002)": "10.244.8.5"
I1202 20:01:33.005161 3891 kubelet.go:1816] SyncLoop (PLEG): "web-2_default(10863ca9-b8c9-11e6-aa17-42010a800002)", event: &pleg.PodLifecycleEvent{ID:"10863ca9-b8c9-11e6-aa17-42010a800002", Type:"ContainerStarted", Data:"124ff292444dae1e0ea440cfe7834e61ece2c7b3b4d4a42c19d01db5eaa3c347"}
I1202 20:01:33.005233 3891 kubelet.go:1816] SyncLoop (PLEG): "web-2_default(10863ca9-b8c9-11e6-aa17-42010a800002)", event: &pleg.PodLifecycleEvent{ID:"10863ca9-b8c9-11e6-aa17-42010a800002", Type:"ContainerStarted", Data:"44150d53d173d83f37bfdcd67536bc495d45cb738aa5b96cd2560c0fddbfd04a"}
I1202 20:01:33.051658 3891 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/secret/10863ca9-b8c9-11e6-aa17-42010a800002-default-token-nmzqy" (spec.Name: "default-token-nmzqy") pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002").
I1202 20:01:34.053305 3891 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/secret/10863ca9-b8c9-11e6-aa17-42010a800002-default-token-nmzqy" (spec.Name: "default-token-nmzqy") pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002").
I1202 20:01:35.585385 3891 server.go:741] GET /healthz: (40.536µs) 200 [[curl/7.26.0] 127.0.0.1:48781]
I1202 20:01:35.757178 3891 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/secret/70c91ccd-b8c8-11e6-aa17-42010a800002-default-token-et92n" (spec.Name: "default-token-et92n") pod "70c91ccd-b8c8-11e6-aa17-42010a800002" (UID: "70c91ccd-b8c8-11e6-aa17-42010a800002").
I1202 20:01:39.767385 3891 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/secret/a1ad83ee-b8c4-11e6-bee7-42010a800002-default-token-et92n" (spec.Name: "default-token-et92n") pod "a1ad83ee-b8c4-11e6-bee7-42010a800002" (UID: "a1ad83ee-b8c4-11e6-bee7-42010a800002").
I1202 20:01:45.597481 3891 server.go:741] GET /healthz: (36.799µs) 200 [[curl/7.26.0] 127.0.0.1:48787]
I1202 20:01:55.610199 3891 server.go:741] GET /healthz: (31.429µs) 200 [[curl/7.26.0] 127.0.0.1:48795]
I1202 20:02:05.034379 3891 server.go:741] GET /stats/summary/: (6.08946ms) 200 [[Go-http-client/1.1] 10.244.6.3:52209]
I1202 20:02:05.622666 3891 server.go:741] GET /healthz: (37.169µs) 200 [[curl/7.26.0] 127.0.0.1:48799]
I1202 20:02:13.748918 3891 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/secret/60fb870e-b8c7-11e6-bee7-42010a800002-default-token-nmzqy" (spec.Name: "default-token-nmzqy") pod "60fb870e-b8c7-11e6-bee7-42010a800002" (UID: "60fb870e-b8c7-11e6-bee7-42010a800002").
I1202 20:02:15.635375 3891 server.go:741] GET /healthz: (37.732µs) 200 [[curl/7.26.0] 127.0.0.1:48805]
I1202 20:02:15.730459 3891 container_manager_linux.go:769] Found 73 PIDs in root, 73 of them are not to be moved
I1202 20:02:25.647876 3891 server.go:741] GET /healthz: (30.583µs) 200 [[curl/7.26.0] 127.0.0.1:48811]
I1202 20:02:35.660830 3891 server.go:741] GET /healthz: (38.479µs) 200 [[curl/7.26.0] 127.0.0.1:48815]
I1202 20:02:42.719611 3891 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/secret/70c91ccd-b8c8-11e6-aa17-42010a800002-default-token-et92n" (spec.Name: "default-token-et92n") pod "70c91ccd-b8c8-11e6-aa17-42010a800002" (UID: "70c91ccd-b8c8-11e6-aa17-42010a800002").
I1202 20:02:45.673567 3891 server.go:741] GET /healthz: (34.887µs) 200 [[curl/7.26.0] 127.0.0.1:48820]
I1202 20:02:49.733255 3891 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/secret/a1ad83ee-b8c4-11e6-bee7-42010a800002-default-token-et92n" (spec.Name: "default-token-et92n") pod "a1ad83ee-b8c4-11e6-bee7-42010a800002" (UID: "a1ad83ee-b8c4-11e6-bee7-42010a800002").
I1202 20:02:55.686495 3891 server.go:741] GET /healthz: (38.548µs) 200 [[curl/7.26.0] 127.0.0.1:48828]
I1202 20:02:59.754398 3891 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/secret/10863ca9-b8c9-11e6-aa17-42010a800002-default-token-nmzqy" (spec.Name: "default-token-nmzqy") pod "10863ca9-b8c9-11e6-aa17-42010a800002" (UID: "10863ca9-b8c9-11e6-aa17-42010a800002").
I1202 20:03:05.052586 3891 server.go:741] GET /stats/summary/: (6.346393ms) 200 [[Go-http-client/1.1] 10.244.6.3:52209]
I1202 20:03:05.698737 3891 server.go:741] GET /healthz: (37.848µs) 200 [[curl/7.26.0] 127.0.0.1:48834]
I1202 20:03:15.711162 3891 server.go:741] GET /healthz: (25.864µs) 200 [[curl/7.26.0] 127.0.0.1:48840]
I1202 20:03:15.731378 3891 container_manager_linux.go:769] Found 68 PIDs in root, 68 of them are not to be moved
I1202 20:03:25.723429 3891 server.go:741] GET /healthz: (36.771µs) 200 [[curl/7.26.0] 127.0.0.1:48846]
I1202 20:03:35.735100 3891 server.go:741] GET /healthz: (34.137µs) 200 [[curl/7.26.0] 127.0.0.1:48850]
I1202 20:03:41.743170 3891 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/secret/60fb870e-b8c7-11e6-bee7-42010a800002-default-token-nmzqy" (spec.Name: "default-token-nmzqy") pod "60fb870e-b8c7-11e6-bee7-42010a800002" (UID: "60fb870e-b8c7-11e6-bee7-42010a800002").
I1202 20:03:45.747031 3891 server.go:741] GET /healthz: (28.922µs) 200 [[curl/7.26.0] 127.0.0.1:48855]
I1202 20:03:50.763794 3891 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/secret/70c91ccd-b8c8-11e6-aa17-42010a800002-default-token-et92n" (spec.Name: "default-token-et92n") pod "70c91ccd-b8c8-11e6-aa17-42010a800002" (UID: "70c91ccd-b8c8-11e6-aa17-42010a800002").
I1202 20:03:55.758816 3891 server.go:741] GET /healthz: (41.444µs) 200 [[curl/7.26.0] 127.0.0.1:48863]
I1202 20:04:04.693056 3891 operation_executor.go:916] MountVolume.SetUp succeeded for volume "kubernetes.io/secret/a1ad83ee-b8c4-11e6-bee7-42010a800002-default-token-et92n" (spec.Name: "default-token-et92n") pod "a1ad83ee-b8c4-11e6-bee7-42010a800002" (UID: "a1ad83ee-b8c4-11e6-bee7-42010a800002").
I1202 20:04:05.052529 3891 server.go:741] GET /stats/summary/: (6.518369ms) 200 [[Go-http-client/1.1] 10.244.6.3:52209]
I1202 20:04:05.770465 3891 server.go:741] GET /healthz: (40.547µs) 200 [[curl/7.26.0] 127.0.0.1:48869]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment