Skip to content

Instantly share code, notes, and snippets.

@joshuacox
Last active November 11, 2018 20:50
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save joshuacox/3c0b4aa2b66d1172067a32e6e064f948 to your computer and use it in GitHub Desktop.
Save joshuacox/3c0b4aa2b66d1172067a32e6e064f948 to your computer and use it in GitHub Desktop.
logs from kubelet
-- Unit kubelet.service has finished shutting down.
Nov 11 20:05:55 testymaster1 systemd[1]: Started kubelet: The Kubernetes Node Agent.
-- Subject: Unit kubelet.service has finished start-up
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
--
-- Unit kubelet.service has finished starting up.
--
-- The start-up result is done.
Nov 11 20:05:55 testymaster1 kubelet[3306]: Flag --address has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 11 20:05:55 testymaster1 kubelet[3306]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 11 20:05:55 testymaster1 kubelet[3306]: Flag --allow-privileged has been deprecated, will be removed in a future version
Nov 11 20:05:55 testymaster1 kubelet[3306]: I1111 20:05:55.684685 3306 server.go:408] Version: v1.12.2
Nov 11 20:05:55 testymaster1 kubelet[3306]: I1111 20:05:55.685191 3306 plugins.go:99] No cloud provider specified.
Nov 11 20:05:55 testymaster1 kubelet[3306]: W1111 20:05:55.685282 3306 server.go:553] standalone mode, no API client
Nov 11 20:05:55 testymaster1 kubelet[3306]: W1111 20:05:55.771167 3306 server.go:465] No api server defined - no events will be sent to API server.
Nov 11 20:05:55 testymaster1 kubelet[3306]: I1111 20:05:55.771213 3306 server.go:667] --cgroups-per-qos enabled, but --cgroup-root was not specified. defaulting to /
Nov 11 20:05:55 testymaster1 kubelet[3306]: I1111 20:05:55.772235 3306 container_manager_linux.go:247] container manager verified user specified cgroup-root exists: []
Nov 11 20:05:55 testymaster1 kubelet[3306]: I1111 20:05:55.772355 3306 container_manager_linux.go:252] Creating Container Manager object based on Node Config: {RuntimeCgroupsName: SystemCgroupsName: KubeletCgroupsName: ContainerRuntime:docker CgroupsPerQOS:true CgroupRoot:/ CgroupDriver:cgroupfs KubeletRootDir:/var/lib/kubelet ProtectKernelDefaults:false NodeAllocatableConfig:{KubeReservedCgroupName: SystemReservedCgroupName: EnforceNodeAllocatable:map[pods:{}] KubeReserved:map[] SystemReserved:map[] HardEvictionThresholds:[{Signal:nodefs.inodesFree Operator:LessThan Value:{Quantity:<nil> Percentage:0.05} GracePeriod:0s MinReclaim:<nil>} {Signal:imagefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.15} GracePeriod:0s MinReclaim:<nil>} {Signal:memory.available Operator:LessThan Value:{Quantity:100Mi Percentage:0} GracePeriod:0s MinReclaim:<nil>} {Signal:nodefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.1} GracePeriod:0s MinReclaim:<nil>}]} QOSReserved:map[] ExperimentalCPUManagerPolicy:none ExperimentalCPUManagerReconcilePeriod:10s ExperimentalPodPidsLimit:-1 EnforceCPULimits:true CPUCFSQuotaPeriod:100ms}
Nov 11 20:05:55 testymaster1 kubelet[3306]: I1111 20:05:55.772635 3306 container_manager_linux.go:271] Creating device plugin manager: true
Nov 11 20:05:55 testymaster1 kubelet[3306]: I1111 20:05:55.772731 3306 state_mem.go:36] [cpumanager] initializing new in-memory state store
Nov 11 20:05:55 testymaster1 kubelet[3306]: I1111 20:05:55.773738 3306 state_mem.go:84] [cpumanager] updated default cpuset: ""
Nov 11 20:05:55 testymaster1 kubelet[3306]: I1111 20:05:55.773760 3306 state_mem.go:92] [cpumanager] updated cpuset assignments: "map[]"
Nov 11 20:05:55 testymaster1 kubelet[3306]: I1111 20:05:55.775061 3306 kubelet.go:279] Adding pod path: /etc/kubernetes/manifests
Nov 11 20:05:55 testymaster1 kubelet[3306]: I1111 20:05:55.779729 3306 client.go:75] Connecting to docker on unix:///var/run/docker.sock
Nov 11 20:05:55 testymaster1 kubelet[3306]: I1111 20:05:55.779789 3306 client.go:104] Start docker client with request timeout=2m0s
Nov 11 20:05:55 testymaster1 kubelet[3306]: W1111 20:05:55.783258 3306 docker_service.go:540] Hairpin mode set to "promiscuous-bridge" but kubenet is not enabled, falling back to "hairpin-veth"
Nov 11 20:05:55 testymaster1 kubelet[3306]: I1111 20:05:55.783308 3306 docker_service.go:236] Hairpin mode set to "hairpin-veth"
Nov 11 20:05:55 testymaster1 kubelet[3306]: W1111 20:05:55.784205 3306 cni.go:188] Unable to update cni config: No networks found in /etc/cni/net.d
Nov 11 20:05:55 testymaster1 kubelet[3306]: W1111 20:05:55.788674 3306 hostport_manager.go:68] The binary conntrack is not installed, this can cause failures in network connection cleanup.
Nov 11 20:05:55 testymaster1 kubelet[3306]: I1111 20:05:55.791691 3306 docker_service.go:251] Docker cri networking managed by kubernetes.io/no-op
Nov 11 20:05:55 testymaster1 kubelet[3306]: I1111 20:05:55.809480 3306 docker_service.go:256] Docker Info: &{ID:SUMO:4FKY:QHYK:BUQC:BZDS:C7YI:XPHD:G7F6:UJVI:K4AB:JEY4:YDJT Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:0 Driver:aufs DriverStatus:[[Root Dir /var/lib/docker/aufs] [Backing Filesystem extfs] [Dirs 0] [Dirperm1 Supported true]] SystemStatus:[] Plugins:{Volume:[local] Network:[bridge host macvlan null overlay] Authorization:[] Log:[]} MemoryLimit:true SwapLimit:false KernelMemory:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6tables:true Debug:false NFd:15 OomKillDisable:true NGoroutines:22 SystemTime:2018-11-11T20:05:55.794739249Z LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.4.0-131-generic OperatingSystem:Ubuntu 16.04.5 LTS OSType:linux Architecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:0xc4208a4000 NCPU:22 MemTotal:2870374400 GenericResources:[] DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:testymaster1 Labels:[] ExperimentalBuild:false ServerVersion:17.03.3-ce ClusterStore: ClusterAdvertise: Runtimes:map[runc:{Path:docker-runc Args:[]}] DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:[] Nodes:0 Managers:0 Cluster:0xc420130000} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:6c463891b1ad274d505ae3bb738e530d1df2b3c7 Expected:6c463891b1ad274d505ae3bb738e530d1df2b3c7} RuncCommit:{ID:54296cf40ad8143b62dbcaa1d90e520a2136ddfe Expected:54296cf40ad8143b62dbcaa1d90e520a2136ddfe} InitCommit:{ID:949e6fa Expected:949e6fa} SecurityOptions:[name=apparmor name=seccomp,profile=default]}
Nov 11 20:05:55 testymaster1 kubelet[3306]: I1111 20:05:55.809688 3306 docker_service.go:269] Setting cgroupDriver to cgroupfs
Nov 11 20:05:55 testymaster1 kubelet[3306]: I1111 20:05:55.838290 3306 kuberuntime_manager.go:197] Container runtime docker initialized, version: 17.03.3-ce, apiVersion: 1.27.0
Nov 11 20:05:55 testymaster1 kubelet[3306]: I1111 20:05:55.844844 3306 server.go:1013] Started kubelet
Nov 11 20:05:55 testymaster1 kubelet[3306]: E1111 20:05:55.845080 3306 kubelet.go:1287] Image garbage collection failed once. Stats initialization may not have completed yet: failed to get imageFs info: unable to find data in memory cache
Nov 11 20:05:55 testymaster1 kubelet[3306]: I1111 20:05:55.845079 3306 server.go:133] Starting to listen on 127.0.0.1:10250
Nov 11 20:05:55 testymaster1 kubelet[3306]: W1111 20:05:55.844957 3306 kubelet.go:1387] No api server defined - no node status update will be sent.
Nov 11 20:05:55 testymaster1 kubelet[3306]: I1111 20:05:55.847849 3306 fs_resource_analyzer.go:66] Starting FS ResourceAnalyzer
Nov 11 20:05:55 testymaster1 kubelet[3306]: I1111 20:05:55.847959 3306 status_manager.go:148] Kubernetes client is nil, not starting status manager.
Nov 11 20:05:55 testymaster1 kubelet[3306]: I1111 20:05:55.847991 3306 kubelet.go:1804] Starting kubelet main sync loop.
Nov 11 20:05:55 testymaster1 kubelet[3306]: I1111 20:05:55.848036 3306 kubelet.go:1821] skipping pod synchronization - [container runtime is down PLEG is not healthy: pleg was last seen active 2562047h47m16.854775807s ago; threshold is 3m0s]
Nov 11 20:05:55 testymaster1 kubelet[3306]: I1111 20:05:55.848190 3306 volume_manager.go:248] Starting Kubelet Volume Manager
Nov 11 20:05:55 testymaster1 kubelet[3306]: I1111 20:05:55.848596 3306 desired_state_of_world_populator.go:130] Desired state populator starts to run
Nov 11 20:05:55 testymaster1 kubelet[3306]: I1111 20:05:55.851871 3306 server.go:318] Adding debug handlers to kubelet server.
Nov 11 20:05:55 testymaster1 kubelet[3306]: I1111 20:05:55.948422 3306 kubelet.go:1821] skipping pod synchronization - [container runtime is down]
Nov 11 20:05:56 testymaster1 kubelet[3306]: I1111 20:05:56.148868 3306 kubelet.go:1821] skipping pod synchronization - [container runtime is down]
Nov 11 20:05:56 testymaster1 kubelet[3306]: I1111 20:05:56.168766 3306 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:05:56 testymaster1 kubelet[3306]: I1111 20:05:56.173068 3306 cpu_manager.go:155] [cpumanager] starting with none policy
Nov 11 20:05:56 testymaster1 kubelet[3306]: I1111 20:05:56.173098 3306 cpu_manager.go:156] [cpumanager] reconciling every 10s
Nov 11 20:05:56 testymaster1 kubelet[3306]: I1111 20:05:56.173113 3306 policy_none.go:42] [cpumanager] none policy: Start
Nov 11 20:05:56 testymaster1 kubelet[3306]: W1111 20:05:56.210495 3306 manager.go:527] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
Nov 11 20:05:56 testymaster1 kubelet[3306]: I1111 20:05:56.211010 3306 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:05:56 testymaster1 kubelet[3306]: I1111 20:05:56.651113 3306 reconciler.go:154] Reconciler: start to sync state
Nov 11 20:06:06 testymaster1 kubelet[3306]: I1111 20:06:06.245653 3306 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:06:16 testymaster1 kubelet[3306]: I1111 20:06:16.275615 3306 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:06:26 testymaster1 kubelet[3306]: I1111 20:06:26.307166 3306 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:06:36 testymaster1 kubelet[3306]: I1111 20:06:36.344904 3306 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:06:46 testymaster1 kubelet[3306]: I1111 20:06:46.386146 3306 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:06:56 testymaster1 kubelet[3306]: I1111 20:06:56.443275 3306 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:07:06 testymaster1 kubelet[3306]: I1111 20:07:06.471471 3306 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:07:16 testymaster1 kubelet[3306]: I1111 20:07:16.514964 3306 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:07:18 testymaster1 systemd[1]: Stopping kubelet: The Kubernetes Node Agent...
-- Subject: Unit kubelet.service has begun shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
--
-- Unit kubelet.service has begun shutting down.
Nov 11 20:07:18 testymaster1 systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
-- Subject: Unit kubelet.service has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
--
-- Unit kubelet.service has finished shutting down.
Nov 11 20:09:13 testymaster1 systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
-- Subject: Unit kubelet.service has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
--
-- Unit kubelet.service has finished shutting down.
Nov 11 20:09:14 testymaster1 systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
-- Subject: Unit kubelet.service has finished shutting down
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
--
-- Unit kubelet.service has finished shutting down.
Nov 11 20:09:14 testymaster1 systemd[1]: Started kubelet: The Kubernetes Node Agent.
-- Subject: Unit kubelet.service has finished start-up
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
--
-- Unit kubelet.service has finished starting up.
--
-- The start-up result is done.
Nov 11 20:09:14 testymaster1 kubelet[4731]: Flag --address has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 11 20:09:14 testymaster1 kubelet[4731]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 11 20:09:14 testymaster1 kubelet[4731]: Flag --allow-privileged has been deprecated, will be removed in a future version
Nov 11 20:09:14 testymaster1 kubelet[4731]: I1111 20:09:14.303427 4731 server.go:408] Version: v1.12.2
Nov 11 20:09:14 testymaster1 kubelet[4731]: I1111 20:09:14.303723 4731 plugins.go:99] No cloud provider specified.
Nov 11 20:09:14 testymaster1 kubelet[4731]: W1111 20:09:14.303797 4731 server.go:553] standalone mode, no API client
Nov 11 20:09:14 testymaster1 kubelet[4731]: W1111 20:09:14.366601 4731 server.go:465] No api server defined - no events will be sent to API server.
Nov 11 20:09:14 testymaster1 kubelet[4731]: I1111 20:09:14.366638 4731 server.go:667] --cgroups-per-qos enabled, but --cgroup-root was not specified. defaulting to /
Nov 11 20:09:14 testymaster1 kubelet[4731]: I1111 20:09:14.367225 4731 container_manager_linux.go:247] container manager verified user specified cgroup-root exists: []
Nov 11 20:09:14 testymaster1 kubelet[4731]: I1111 20:09:14.367252 4731 container_manager_linux.go:252] Creating Container Manager object based on Node Config: {RuntimeCgroupsName: SystemCgroupsName: KubeletCgroupsName: ContainerRuntime:docker CgroupsPerQOS:true CgroupRoot:/ CgroupDriver:cgroupfs KubeletRootDir:/var/lib/kubelet ProtectKernelDefaults:false NodeAllocatableConfig:{KubeReservedCgroupName: SystemReservedCgroupName: EnforceNodeAllocatable:map[pods:{}] KubeReserved:map[] SystemReserved:map[] HardEvictionThresholds:[{Signal:memory.available Operator:LessThan Value:{Quantity:100Mi Percentage:0} GracePeriod:0s MinReclaim:<nil>} {Signal:nodefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.1} GracePeriod:0s MinReclaim:<nil>} {Signal:nodefs.inodesFree Operator:LessThan Value:{Quantity:<nil> Percentage:0.05} GracePeriod:0s MinReclaim:<nil>} {Signal:imagefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.15} GracePeriod:0s MinReclaim:<nil>}]} QOSReserved:map[] ExperimentalCPUManagerPolicy:none ExperimentalCPUManagerReconcilePeriod:10s ExperimentalPodPidsLimit:-1 EnforceCPULimits:true CPUCFSQuotaPeriod:100ms}
Nov 11 20:09:14 testymaster1 kubelet[4731]: I1111 20:09:14.367494 4731 container_manager_linux.go:271] Creating device plugin manager: true
Nov 11 20:09:14 testymaster1 kubelet[4731]: I1111 20:09:14.367579 4731 state_mem.go:36] [cpumanager] initializing new in-memory state store
Nov 11 20:09:14 testymaster1 kubelet[4731]: I1111 20:09:14.367848 4731 state_mem.go:84] [cpumanager] updated default cpuset: ""
Nov 11 20:09:14 testymaster1 kubelet[4731]: I1111 20:09:14.367870 4731 state_mem.go:92] [cpumanager] updated cpuset assignments: "map[]"
Nov 11 20:09:14 testymaster1 kubelet[4731]: I1111 20:09:14.368095 4731 kubelet.go:279] Adding pod path: /etc/kubernetes/manifests
Nov 11 20:09:14 testymaster1 kubelet[4731]: I1111 20:09:14.371863 4731 client.go:75] Connecting to docker on unix:///var/run/docker.sock
Nov 11 20:09:14 testymaster1 kubelet[4731]: I1111 20:09:14.371906 4731 client.go:104] Start docker client with request timeout=2m0s
Nov 11 20:09:14 testymaster1 kubelet[4731]: W1111 20:09:14.374831 4731 docker_service.go:540] Hairpin mode set to "promiscuous-bridge" but kubenet is not enabled, falling back to "hairpin-veth"
Nov 11 20:09:14 testymaster1 kubelet[4731]: I1111 20:09:14.374883 4731 docker_service.go:236] Hairpin mode set to "hairpin-veth"
Nov 11 20:09:14 testymaster1 kubelet[4731]: W1111 20:09:14.375118 4731 cni.go:188] Unable to update cni config: No networks found in /etc/cni/net.d
Nov 11 20:09:14 testymaster1 kubelet[4731]: W1111 20:09:14.378564 4731 hostport_manager.go:68] The binary conntrack is not installed, this can cause failures in network connection cleanup.
Nov 11 20:09:14 testymaster1 kubelet[4731]: I1111 20:09:14.380718 4731 docker_service.go:251] Docker cri networking managed by kubernetes.io/no-op
Nov 11 20:09:14 testymaster1 kubelet[4731]: I1111 20:09:14.401026 4731 docker_service.go:256] Docker Info: &{ID:SUMO:4FKY:QHYK:BUQC:BZDS:C7YI:XPHD:G7F6:UJVI:K4AB:JEY4:YDJT Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:6 Driver:aufs DriverStatus:[[Root Dir /var/lib/docker/aufs] [Backing Filesystem extfs] [Dirs 10] [Dirperm1 Supported true]] SystemStatus:[] Plugins:{Volume:[local] Network:[bridge host macvlan null overlay] Authorization:[] Log:[]} MemoryLimit:true SwapLimit:false KernelMemory:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6tables:true Debug:false NFd:17 OomKillDisable:true NGoroutines:23 SystemTime:2018-11-11T20:09:14.385895647Z LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.4.0-131-generic OperatingSystem:Ubuntu 16.04.5 LTS OSType:linux Architecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:0xc420903b90 NCPU:22 MemTotal:2870374400 GenericResources:[] DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:testymaster1 Labels:[] ExperimentalBuild:false ServerVersion:17.03.3-ce ClusterStore: ClusterAdvertise: Runtimes:map[runc:{Path:docker-runc Args:[]}] DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:[] Nodes:0 Managers:0 Cluster:0xc420239900} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:6c463891b1ad274d505ae3bb738e530d1df2b3c7 Expected:6c463891b1ad274d505ae3bb738e530d1df2b3c7} RuncCommit:{ID:54296cf40ad8143b62dbcaa1d90e520a2136ddfe Expected:54296cf40ad8143b62dbcaa1d90e520a2136ddfe} InitCommit:{ID:949e6fa Expected:949e6fa} SecurityOptions:[name=apparmor name=seccomp,profile=default]}
Nov 11 20:09:14 testymaster1 kubelet[4731]: I1111 20:09:14.401325 4731 docker_service.go:269] Setting cgroupDriver to cgroupfs
Nov 11 20:09:14 testymaster1 kubelet[4731]: I1111 20:09:14.427101 4731 kuberuntime_manager.go:197] Container runtime docker initialized, version: 17.03.3-ce, apiVersion: 1.27.0
Nov 11 20:09:14 testymaster1 kubelet[4731]: I1111 20:09:14.431698 4731 server.go:1013] Started kubelet
Nov 11 20:09:14 testymaster1 kubelet[4731]: W1111 20:09:14.431918 4731 kubelet.go:1387] No api server defined - no node status update will be sent.
Nov 11 20:09:14 testymaster1 kubelet[4731]: I1111 20:09:14.432095 4731 server.go:133] Starting to listen on 127.0.0.1:10250
Nov 11 20:09:14 testymaster1 kubelet[4731]: I1111 20:09:14.433747 4731 fs_resource_analyzer.go:66] Starting FS ResourceAnalyzer
Nov 11 20:09:14 testymaster1 kubelet[4731]: I1111 20:09:14.433831 4731 status_manager.go:148] Kubernetes client is nil, not starting status manager.
Nov 11 20:09:14 testymaster1 kubelet[4731]: I1111 20:09:14.433869 4731 kubelet.go:1804] Starting kubelet main sync loop.
Nov 11 20:09:14 testymaster1 kubelet[4731]: I1111 20:09:14.433943 4731 kubelet.go:1821] skipping pod synchronization - [container runtime is down PLEG is not healthy: pleg was last seen active 2562047h47m16.854775807s ago; threshold is 3m0s]
Nov 11 20:09:14 testymaster1 kubelet[4731]: I1111 20:09:14.434015 4731 volume_manager.go:248] Starting Kubelet Volume Manager
Nov 11 20:09:14 testymaster1 kubelet[4731]: I1111 20:09:14.434186 4731 server.go:318] Adding debug handlers to kubelet server.
Nov 11 20:09:14 testymaster1 kubelet[4731]: I1111 20:09:14.434639 4731 desired_state_of_world_populator.go:130] Desired state populator starts to run
Nov 11 20:09:14 testymaster1 kubelet[4731]: E1111 20:09:14.442078 4731 kubelet.go:1287] Image garbage collection failed once. Stats initialization may not have completed yet: failed to get imageFs info: unable to find data in memory cache
Nov 11 20:09:14 testymaster1 kubelet[4731]: I1111 20:09:14.534316 4731 kubelet.go:1821] skipping pod synchronization - [container runtime is down]
Nov 11 20:09:14 testymaster1 kubelet[4731]: I1111 20:09:14.734651 4731 kubelet.go:1821] skipping pod synchronization - [container runtime is down]
Nov 11 20:09:14 testymaster1 kubelet[4731]: I1111 20:09:14.771649 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:09:14 testymaster1 kubelet[4731]: I1111 20:09:14.775521 4731 cpu_manager.go:155] [cpumanager] starting with none policy
Nov 11 20:09:14 testymaster1 kubelet[4731]: I1111 20:09:14.775551 4731 cpu_manager.go:156] [cpumanager] reconciling every 10s
Nov 11 20:09:14 testymaster1 kubelet[4731]: I1111 20:09:14.775568 4731 policy_none.go:42] [cpumanager] none policy: Start
Nov 11 20:09:14 testymaster1 kubelet[4731]: W1111 20:09:14.776939 4731 manager.go:527] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
Nov 11 20:09:14 testymaster1 kubelet[4731]: I1111 20:09:14.777540 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:09:15 testymaster1 kubelet[4731]: I1111 20:09:15.136644 4731 reconciler.go:154] Reconciler: start to sync state
Nov 11 20:09:20 testymaster1 kubelet[4731]: I1111 20:09:20.970699 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:09:21 testymaster1 kubelet[4731]: I1111 20:09:21.009802 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:09:21 testymaster1 kubelet[4731]: I1111 20:09:21.020859 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:09:21 testymaster1 kubelet[4731]: I1111 20:09:21.021299 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:09:21 testymaster1 kubelet[4731]: I1111 20:09:21.031958 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:09:21 testymaster1 kubelet[4731]: I1111 20:09:21.065410 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:09:21 testymaster1 kubelet[4731]: I1111 20:09:21.152799 4731 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "k8s-certs" (UniqueName: "kubernetes.io/host-path/690790d9ba49d9118c24c004854af4db-k8s-certs") pod "kube-controller-manager-testymaster1" (UID: "690790d9ba49d9118c24c004854af4db")
Nov 11 20:09:21 testymaster1 kubelet[4731]: I1111 20:09:21.152896 4731 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "kubeconfig" (UniqueName: "kubernetes.io/host-path/ee7b1077c61516320f4273309e9b4690-kubeconfig") pod "kube-scheduler-testymaster1" (UID: "ee7b1077c61516320f4273309e9b4690")
Nov 11 20:09:21 testymaster1 kubelet[4731]: I1111 20:09:21.152971 4731 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "k8s-certs" (UniqueName: "kubernetes.io/host-path/c55b3dd53dd51e69d2acd3a6aa486e32-k8s-certs") pod "kube-apiserver-testymaster1" (UID: "c55b3dd53dd51e69d2acd3a6aa486e32")
Nov 11 20:09:21 testymaster1 kubelet[4731]: I1111 20:09:21.153045 4731 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "ca-certs" (UniqueName: "kubernetes.io/host-path/c55b3dd53dd51e69d2acd3a6aa486e32-ca-certs") pod "kube-apiserver-testymaster1" (UID: "c55b3dd53dd51e69d2acd3a6aa486e32")
Nov 11 20:09:21 testymaster1 kubelet[4731]: I1111 20:09:21.153122 4731 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "ca-certs" (UniqueName: "kubernetes.io/host-path/690790d9ba49d9118c24c004854af4db-ca-certs") pod "kube-controller-manager-testymaster1" (UID: "690790d9ba49d9118c24c004854af4db")
Nov 11 20:09:21 testymaster1 kubelet[4731]: I1111 20:09:21.153192 4731 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "kubeconfig" (UniqueName: "kubernetes.io/host-path/690790d9ba49d9118c24c004854af4db-kubeconfig") pod "kube-controller-manager-testymaster1" (UID: "690790d9ba49d9118c24c004854af4db")
Nov 11 20:09:21 testymaster1 kubelet[4731]: I1111 20:09:21.153443 4731 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "etc-ca-certificates" (UniqueName: "kubernetes.io/host-path/690790d9ba49d9118c24c004854af4db-etc-ca-certificates") pod "kube-controller-manager-testymaster1" (UID: "690790d9ba49d9118c24c004854af4db")
Nov 11 20:09:21 testymaster1 kubelet[4731]: I1111 20:09:21.153625 4731 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "usr-share-ca-certificates" (UniqueName: "kubernetes.io/host-path/c55b3dd53dd51e69d2acd3a6aa486e32-usr-share-ca-certificates") pod "kube-apiserver-testymaster1" (UID: "c55b3dd53dd51e69d2acd3a6aa486e32")
Nov 11 20:09:21 testymaster1 kubelet[4731]: I1111 20:09:21.153707 4731 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "usr-local-share-ca-certificates" (UniqueName: "kubernetes.io/host-path/c55b3dd53dd51e69d2acd3a6aa486e32-usr-local-share-ca-certificates") pod "kube-apiserver-testymaster1" (UID: "c55b3dd53dd51e69d2acd3a6aa486e32")
Nov 11 20:09:21 testymaster1 kubelet[4731]: I1111 20:09:21.153769 4731 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "etc-ca-certificates" (UniqueName: "kubernetes.io/host-path/c55b3dd53dd51e69d2acd3a6aa486e32-etc-ca-certificates") pod "kube-apiserver-testymaster1" (UID: "c55b3dd53dd51e69d2acd3a6aa486e32")
Nov 11 20:09:21 testymaster1 kubelet[4731]: I1111 20:09:21.153891 4731 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "flexvolume-dir" (UniqueName: "kubernetes.io/host-path/690790d9ba49d9118c24c004854af4db-flexvolume-dir") pod "kube-controller-manager-testymaster1" (UID: "690790d9ba49d9118c24c004854af4db")
Nov 11 20:09:21 testymaster1 kubelet[4731]: I1111 20:09:21.154036 4731 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "usr-share-ca-certificates" (UniqueName: "kubernetes.io/host-path/690790d9ba49d9118c24c004854af4db-usr-share-ca-certificates") pod "kube-controller-manager-testymaster1" (UID: "690790d9ba49d9118c24c004854af4db")
Nov 11 20:09:21 testymaster1 kubelet[4731]: I1111 20:09:21.154222 4731 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "usr-local-share-ca-certificates" (UniqueName: "kubernetes.io/host-path/690790d9ba49d9118c24c004854af4db-usr-local-share-ca-certificates") pod "kube-controller-manager-testymaster1" (UID: "690790d9ba49d9118c24c004854af4db")
Nov 11 20:09:23 testymaster1 kubelet[4731]: I1111 20:09:23.512407 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:09:23 testymaster1 kubelet[4731]: I1111 20:09:23.519412 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:09:23 testymaster1 kubelet[4731]: I1111 20:09:23.526786 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:09:24 testymaster1 kubelet[4731]: I1111 20:09:24.532791 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:09:24 testymaster1 kubelet[4731]: I1111 20:09:24.532996 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:09:24 testymaster1 kubelet[4731]: I1111 20:09:24.533148 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:09:24 testymaster1 kubelet[4731]: I1111 20:09:24.825260 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:09:34 testymaster1 kubelet[4731]: I1111 20:09:34.877468 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:09:44 testymaster1 kubelet[4731]: I1111 20:09:44.917918 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:09:54 testymaster1 kubelet[4731]: I1111 20:09:54.986087 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:10:05 testymaster1 kubelet[4731]: I1111 20:10:05.060157 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:10:15 testymaster1 kubelet[4731]: I1111 20:10:15.116747 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:10:25 testymaster1 kubelet[4731]: I1111 20:10:25.164172 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:10:26 testymaster1 kubelet[4731]: I1111 20:10:26.435059 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:10:31 testymaster1 kubelet[4731]: I1111 20:10:31.435084 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:10:35 testymaster1 kubelet[4731]: I1111 20:10:35.219384 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:10:45 testymaster1 kubelet[4731]: I1111 20:10:45.275531 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:10:53 testymaster1 kubelet[4731]: I1111 20:10:53.434965 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:10:55 testymaster1 kubelet[4731]: I1111 20:10:55.325598 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:11:05 testymaster1 kubelet[4731]: I1111 20:11:05.387734 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:11:15 testymaster1 kubelet[4731]: I1111 20:11:15.441309 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:11:25 testymaster1 kubelet[4731]: I1111 20:11:25.501328 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:11:35 testymaster1 kubelet[4731]: I1111 20:11:35.434763 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:11:35 testymaster1 kubelet[4731]: I1111 20:11:35.556771 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:11:45 testymaster1 kubelet[4731]: I1111 20:11:45.622979 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:11:52 testymaster1 kubelet[4731]: I1111 20:11:52.434959 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:11:55 testymaster1 kubelet[4731]: I1111 20:11:55.676944 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:11:58 testymaster1 kubelet[4731]: I1111 20:11:58.434927 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:12:05 testymaster1 kubelet[4731]: I1111 20:12:05.727770 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:12:15 testymaster1 kubelet[4731]: I1111 20:12:15.787417 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:12:25 testymaster1 kubelet[4731]: I1111 20:12:25.845445 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:12:35 testymaster1 kubelet[4731]: I1111 20:12:35.907987 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:12:45 testymaster1 kubelet[4731]: I1111 20:12:45.960229 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:12:56 testymaster1 kubelet[4731]: I1111 20:12:56.020880 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:12:58 testymaster1 kubelet[4731]: I1111 20:12:58.435293 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:13:02 testymaster1 kubelet[4731]: I1111 20:13:02.435531 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:13:06 testymaster1 kubelet[4731]: I1111 20:13:06.067443 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:13:07 testymaster1 kubelet[4731]: I1111 20:13:07.434766 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:13:16 testymaster1 kubelet[4731]: I1111 20:13:16.133360 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:13:26 testymaster1 kubelet[4731]: I1111 20:13:26.194113 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:13:36 testymaster1 kubelet[4731]: I1111 20:13:36.250803 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:13:46 testymaster1 kubelet[4731]: I1111 20:13:46.304205 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:13:56 testymaster1 kubelet[4731]: I1111 20:13:56.365543 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:14:06 testymaster1 kubelet[4731]: I1111 20:14:06.427834 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:14:15 testymaster1 kubelet[4731]: I1111 20:14:15.435367 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:14:16 testymaster1 kubelet[4731]: I1111 20:14:16.492778 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:14:19 testymaster1 kubelet[4731]: I1111 20:14:19.434836 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:14:21 testymaster1 kubelet[4731]: I1111 20:14:21.434733 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:14:26 testymaster1 kubelet[4731]: I1111 20:14:26.547106 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:14:36 testymaster1 kubelet[4731]: I1111 20:14:36.597076 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:14:46 testymaster1 kubelet[4731]: I1111 20:14:46.639868 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:14:56 testymaster1 kubelet[4731]: I1111 20:14:56.691478 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:15:06 testymaster1 kubelet[4731]: I1111 20:15:06.742147 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:15:16 testymaster1 kubelet[4731]: I1111 20:15:16.790085 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:15:26 testymaster1 kubelet[4731]: I1111 20:15:26.434901 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:15:26 testymaster1 kubelet[4731]: I1111 20:15:26.844810 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:15:28 testymaster1 kubelet[4731]: I1111 20:15:28.434970 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:15:36 testymaster1 kubelet[4731]: I1111 20:15:36.435002 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:15:36 testymaster1 kubelet[4731]: I1111 20:15:36.902359 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:15:46 testymaster1 kubelet[4731]: I1111 20:15:46.950355 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:15:57 testymaster1 kubelet[4731]: I1111 20:15:57.004320 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:16:07 testymaster1 kubelet[4731]: I1111 20:16:07.067467 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:16:17 testymaster1 kubelet[4731]: I1111 20:16:17.124841 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:16:27 testymaster1 kubelet[4731]: I1111 20:16:27.175520 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:16:29 testymaster1 kubelet[4731]: I1111 20:16:29.434935 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:16:37 testymaster1 kubelet[4731]: I1111 20:16:37.232658 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:16:47 testymaster1 kubelet[4731]: I1111 20:16:47.292289 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:16:51 testymaster1 kubelet[4731]: I1111 20:16:51.434940 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:16:57 testymaster1 kubelet[4731]: I1111 20:16:57.329104 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:16:58 testymaster1 kubelet[4731]: I1111 20:16:58.434901 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:17:07 testymaster1 kubelet[4731]: I1111 20:17:07.383328 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:17:17 testymaster1 kubelet[4731]: I1111 20:17:17.435414 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:17:27 testymaster1 kubelet[4731]: I1111 20:17:27.496570 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:17:37 testymaster1 kubelet[4731]: I1111 20:17:37.563293 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:17:47 testymaster1 kubelet[4731]: I1111 20:17:47.613360 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:17:56 testymaster1 kubelet[4731]: I1111 20:17:56.434795 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:17:57 testymaster1 kubelet[4731]: I1111 20:17:57.668889 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:18:03 testymaster1 kubelet[4731]: I1111 20:18:03.435021 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:18:05 testymaster1 kubelet[4731]: I1111 20:18:05.434998 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:18:07 testymaster1 kubelet[4731]: I1111 20:18:07.716813 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:18:17 testymaster1 kubelet[4731]: I1111 20:18:17.769833 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:18:27 testymaster1 kubelet[4731]: I1111 20:18:27.816644 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:18:37 testymaster1 kubelet[4731]: I1111 20:18:37.867124 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:18:47 testymaster1 kubelet[4731]: I1111 20:18:47.918181 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:18:57 testymaster1 kubelet[4731]: I1111 20:18:57.972143 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:19:05 testymaster1 kubelet[4731]: I1111 20:19:05.434817 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:19:08 testymaster1 kubelet[4731]: I1111 20:19:08.028910 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:19:14 testymaster1 kubelet[4731]: I1111 20:19:14.435060 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:19:14 testymaster1 kubelet[4731]: W1111 20:19:14.883704 4731 container.go:393] Failed to create summary reader for "/system.slice/systemd-tmpfiles-clean.service": none of the resources are being tracked.
Nov 11 20:19:18 testymaster1 kubelet[4731]: I1111 20:19:18.076246 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:19:19 testymaster1 kubelet[4731]: I1111 20:19:19.434876 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:19:28 testymaster1 kubelet[4731]: I1111 20:19:28.128817 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:19:38 testymaster1 kubelet[4731]: I1111 20:19:38.175639 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:19:48 testymaster1 kubelet[4731]: I1111 20:19:48.210191 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:19:58 testymaster1 kubelet[4731]: I1111 20:19:58.260270 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:20:08 testymaster1 kubelet[4731]: I1111 20:20:08.308067 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:20:13 testymaster1 kubelet[4731]: I1111 20:20:13.434634 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:20:18 testymaster1 kubelet[4731]: I1111 20:20:18.361806 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:20:28 testymaster1 kubelet[4731]: I1111 20:20:28.415416 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:20:31 testymaster1 kubelet[4731]: I1111 20:20:31.434697 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:20:38 testymaster1 kubelet[4731]: I1111 20:20:38.465556 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:20:45 testymaster1 kubelet[4731]: I1111 20:20:45.434848 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:20:48 testymaster1 kubelet[4731]: I1111 20:20:48.510106 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:20:58 testymaster1 kubelet[4731]: I1111 20:20:58.559811 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:21:08 testymaster1 kubelet[4731]: I1111 20:21:08.608355 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:21:18 testymaster1 kubelet[4731]: I1111 20:21:18.655919 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:21:27 testymaster1 kubelet[4731]: I1111 20:21:27.434597 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:21:28 testymaster1 kubelet[4731]: I1111 20:21:28.705727 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:21:38 testymaster1 kubelet[4731]: I1111 20:21:38.741709 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:21:48 testymaster1 kubelet[4731]: I1111 20:21:48.797634 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:21:57 testymaster1 kubelet[4731]: I1111 20:21:57.434900 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:21:58 testymaster1 kubelet[4731]: I1111 20:21:58.852109 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:22:02 testymaster1 kubelet[4731]: I1111 20:22:02.434880 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:22:08 testymaster1 kubelet[4731]: I1111 20:22:08.901684 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:22:18 testymaster1 kubelet[4731]: I1111 20:22:18.951225 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:22:29 testymaster1 kubelet[4731]: I1111 20:22:29.001957 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:22:39 testymaster1 kubelet[4731]: I1111 20:22:39.053908 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:22:47 testymaster1 kubelet[4731]: I1111 20:22:47.434971 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:22:49 testymaster1 kubelet[4731]: I1111 20:22:49.106985 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:22:59 testymaster1 kubelet[4731]: I1111 20:22:59.157240 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:23:08 testymaster1 kubelet[4731]: I1111 20:23:08.434916 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:23:09 testymaster1 kubelet[4731]: I1111 20:23:09.213300 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:23:10 testymaster1 kubelet[4731]: I1111 20:23:10.434637 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:23:19 testymaster1 kubelet[4731]: I1111 20:23:19.263381 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:23:29 testymaster1 kubelet[4731]: I1111 20:23:29.318963 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:23:39 testymaster1 kubelet[4731]: I1111 20:23:39.370758 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:23:49 testymaster1 kubelet[4731]: I1111 20:23:49.420809 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:23:59 testymaster1 kubelet[4731]: I1111 20:23:59.470994 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:24:04 testymaster1 kubelet[4731]: I1111 20:24:04.434875 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:24:09 testymaster1 kubelet[4731]: I1111 20:24:09.531959 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:24:19 testymaster1 kubelet[4731]: I1111 20:24:19.581274 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:24:20 testymaster1 kubelet[4731]: I1111 20:24:20.434903 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:24:29 testymaster1 kubelet[4731]: I1111 20:24:29.632091 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:24:36 testymaster1 kubelet[4731]: I1111 20:24:36.434890 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:24:39 testymaster1 kubelet[4731]: I1111 20:24:39.682510 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:24:49 testymaster1 kubelet[4731]: I1111 20:24:49.732181 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:24:59 testymaster1 kubelet[4731]: I1111 20:24:59.782903 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:25:09 testymaster1 kubelet[4731]: I1111 20:25:09.843564 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:25:19 testymaster1 kubelet[4731]: I1111 20:25:19.901459 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:25:29 testymaster1 kubelet[4731]: I1111 20:25:29.955801 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:25:32 testymaster1 kubelet[4731]: I1111 20:25:32.434946 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:25:38 testymaster1 kubelet[4731]: I1111 20:25:38.434725 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:25:40 testymaster1 kubelet[4731]: I1111 20:25:40.015992 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:25:48 testymaster1 kubelet[4731]: I1111 20:25:48.434847 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:25:50 testymaster1 kubelet[4731]: I1111 20:25:50.066864 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:26:00 testymaster1 kubelet[4731]: I1111 20:26:00.121072 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:26:10 testymaster1 kubelet[4731]: I1111 20:26:10.170379 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:26:20 testymaster1 kubelet[4731]: I1111 20:26:20.220686 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:26:30 testymaster1 kubelet[4731]: I1111 20:26:30.276114 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:26:37 testymaster1 kubelet[4731]: I1111 20:26:37.434714 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:26:40 testymaster1 kubelet[4731]: I1111 20:26:40.331210 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:26:48 testymaster1 kubelet[4731]: I1111 20:26:48.434707 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:26:50 testymaster1 kubelet[4731]: I1111 20:26:50.375700 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:26:53 testymaster1 kubelet[4731]: I1111 20:26:53.434744 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:27:00 testymaster1 kubelet[4731]: I1111 20:27:00.425381 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:27:10 testymaster1 kubelet[4731]: I1111 20:27:10.476622 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:27:20 testymaster1 kubelet[4731]: I1111 20:27:20.524873 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:27:30 testymaster1 kubelet[4731]: I1111 20:27:30.577274 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:27:40 testymaster1 kubelet[4731]: I1111 20:27:40.630803 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:27:50 testymaster1 kubelet[4731]: I1111 20:27:50.681707 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:27:54 testymaster1 kubelet[4731]: I1111 20:27:54.434903 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:27:58 testymaster1 kubelet[4731]: I1111 20:27:58.434922 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:28:00 testymaster1 kubelet[4731]: I1111 20:28:00.737709 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:28:10 testymaster1 kubelet[4731]: I1111 20:28:10.788482 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:28:18 testymaster1 kubelet[4731]: I1111 20:28:18.434933 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:28:20 testymaster1 kubelet[4731]: I1111 20:28:20.828593 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:28:30 testymaster1 kubelet[4731]: I1111 20:28:30.877710 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:28:40 testymaster1 kubelet[4731]: I1111 20:28:40.924675 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:28:50 testymaster1 kubelet[4731]: I1111 20:28:50.974638 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:29:01 testymaster1 kubelet[4731]: I1111 20:29:01.024980 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:29:11 testymaster1 kubelet[4731]: I1111 20:29:11.074592 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:29:21 testymaster1 kubelet[4731]: I1111 20:29:21.124304 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:29:24 testymaster1 kubelet[4731]: I1111 20:29:24.435035 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:29:25 testymaster1 kubelet[4731]: I1111 20:29:25.434726 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:29:31 testymaster1 kubelet[4731]: I1111 20:29:31.173994 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:29:41 testymaster1 kubelet[4731]: I1111 20:29:41.229293 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:29:48 testymaster1 kubelet[4731]: I1111 20:29:48.434952 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:29:51 testymaster1 kubelet[4731]: I1111 20:29:51.281594 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:30:01 testymaster1 kubelet[4731]: I1111 20:30:01.345255 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Nov 11 20:30:11 testymaster1 kubelet[4731]: I1111 20:30:11.391304 4731 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment