Skip to content

Instantly share code, notes, and snippets.

@tallclair

tallclair/e2e.log

Created April 30, 2022 00:26
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save tallclair/19d3c98a56a6f7ab63b829e2d27117cc to your computer and use it in GitHub Desktop.
Save tallclair/19d3c98a56a6f7ab63b829e2d27117cc to your computer and use it in GitHub Desktop.
Download ZIP
Sample output for timeout failures.
Raw
e2e.log
+++ [0429 17:13:35] Building go targets for linux/amd64
k8s.io/kubernetes/hack/make-rules/helpers/go2make (non-static)
+++ [0429 17:13:38] Building go targets for linux/amd64
k8s.io/kubernetes/test/e2e/e2e.test (test)
Conformance test: not doing test setup.
I0429 17:14:04.906220 524819 e2e.go:129] Starting e2e run "135bbd38-94fc-4c81-97d4-af1641a72153" on Ginkgo node 1
{"msg":"Test Suite starting","total":2,"completed":0,"skipped":0,"failed":0}
Running Suite: Kubernetes e2e suite
===================================
Random Seed: 1651277644 - Will randomize all specs
Will run 2 of 6967 specs
Apr 29 17:14:05.696: INFO: >>> kubeConfig: /home/stclair/.kube/config
Apr 29 17:14:05.697: INFO: Waiting up to 30m0s for all (but 0) nodes to be schedulable
Apr 29 17:14:06.471: INFO: Waiting up to 10m0s for all pods (need at least 0) in namespace 'kube-system' to be running and ready
Apr 29 17:14:06.644: INFO: 22 / 22 pods in namespace 'kube-system' are running and ready (0 seconds elapsed)
Apr 29 17:14:06.644: INFO: expected 10 pod replicas in namespace 'kube-system', 10 are Running and Ready.
Apr 29 17:14:06.644: INFO: Waiting up to 5m0s for all daemonsets in namespace 'kube-system' to start
Apr 29 17:14:06.702: INFO: 3 / 3 pods ready in namespace 'kube-system' in daemonset 'fluentbit-gke' (0 seconds elapsed)
Apr 29 17:14:06.702: INFO: 3 / 3 pods ready in namespace 'kube-system' in daemonset 'gke-metrics-agent' (0 seconds elapsed)
Apr 29 17:14:06.702: INFO: 0 / 0 pods ready in namespace 'kube-system' in daemonset 'gke-metrics-agent-windows' (0 seconds elapsed)
Apr 29 17:14:06.702: INFO: 0 / 0 pods ready in namespace 'kube-system' in daemonset 'kube-proxy' (0 seconds elapsed)
Apr 29 17:14:06.702: INFO: 0 / 0 pods ready in namespace 'kube-system' in daemonset 'metadata-proxy-v0.1' (0 seconds elapsed)
Apr 29 17:14:06.702: INFO: 0 / 0 pods ready in namespace 'kube-system' in daemonset 'nvidia-gpu-device-plugin' (0 seconds elapsed)
Apr 29 17:14:06.702: INFO: 3 / 3 pods ready in namespace 'kube-system' in daemonset 'pdcsi-node' (0 seconds elapsed)
Apr 29 17:14:06.702: INFO: 0 / 0 pods ready in namespace 'kube-system' in daemonset 'pdcsi-node-windows' (0 seconds elapsed)
Apr 29 17:14:06.702: INFO: e2e test version: v1.24.0-alpha.1.2414+b8881c2c5b781a-dirty
Apr 29 17:14:06.727: INFO: kube-apiserver version: v1.21.10-gke.2000
Apr 29 17:14:06.727: INFO: >>> kubeConfig: /home/stclair/.kube/config
Apr 29 17:14:06.855: INFO: Cluster IP family: ipv4
SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[sig-node] Pods
[qrchzpyqsnrjcpuhznphqxrncph] Dummy test function: Unschedulable
test/e2e/common/node/pods.go:200
[BeforeEach] [sig-node] Pods
test/e2e/framework/framework.go:187
STEP: Creating a kubernetes client
Apr 29 17:14:06.859: INFO: >>> kubeConfig: /home/stclair/.kube/config
STEP: Building a namespace api object, basename pods
Apr 29 17:14:07.114: INFO: Found PodSecurityPolicies; testing pod creation to see if PodSecurityPolicy is enabled
W0429 17:14:07.114666 524819 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
Apr 29 17:14:07.237: INFO: No PSP annotation exists on dry run pod; assuming PodSecurityPolicy is disabled
STEP: Waiting for a default service account to be provisioned in namespace
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[BeforeEach] [sig-node] Pods
test/e2e/common/node/pods.go:191
[It] [qrchzpyqsnrjcpuhznphqxrncph] Dummy test function: Unschedulable
test/e2e/common/node/pods.go:200
Apr 29 17:14:07.437: INFO: Waiting up to 20s for pod "unschedulable" in namespace "pods-5788" to be "not pending"
Apr 29 17:14:07.483: INFO: Pod "unschedulable": Phase="Pending", Reason="", readiness=false. Elapsed: 46.774918ms
Apr 29 17:14:09.508: INFO: Pod "unschedulable": Phase="Pending", Reason="", readiness=false. Elapsed: 2.071752595s
Apr 29 17:14:11.508: INFO: Pod "unschedulable": Phase="Pending", Reason="", readiness=false. Elapsed: 4.071677069s
Apr 29 17:14:13.510: INFO: Pod "unschedulable": Phase="Pending", Reason="", readiness=false. Elapsed: 6.073568129s
Apr 29 17:14:15.509: INFO: Pod "unschedulable": Phase="Pending", Reason="", readiness=false. Elapsed: 8.07205272s
Apr 29 17:14:17.511: INFO: Pod "unschedulable": Phase="Pending", Reason="", readiness=false. Elapsed: 10.07453987s
Apr 29 17:14:19.515: INFO: Pod "unschedulable": Phase="Pending", Reason="", readiness=false. Elapsed: 12.078271255s
Apr 29 17:14:21.510: INFO: Pod "unschedulable": Phase="Pending", Reason="", readiness=false. Elapsed: 14.073781902s
Apr 29 17:14:23.509: INFO: Pod "unschedulable": Phase="Pending", Reason="", readiness=false. Elapsed: 16.072079209s
Apr 29 17:14:25.508: INFO: Pod "unschedulable": Phase="Pending", Reason="", readiness=false. Elapsed: 18.071223115s
Apr 29 17:14:27.509: INFO: Pod "unschedulable": Phase="Pending", Reason="", readiness=false. Elapsed: 20.072846972s
Apr 29 17:14:27.532: INFO: Pod "unschedulable": Phase="Pending", Reason="", readiness=false. Elapsed: 20.095293467s
Apr 29 17:14:27.532: INFO: Timed out while waiting for pod pods-5788/unschedulable to be not pending. Last observed as: <*v1.Pod | 0xc003e16800>: {
TypeMeta: {Kind: "", APIVersion: ""},
ObjectMeta: {
Name: "unschedulable",
GenerateName: "",
Namespace: "pods-5788",
SelfLink: "",
UID: "0a58c9cf-5f50-475d-8094-5d4c1c0878fd",
ResourceVersion: "674795",
Generation: 0,
CreationTimestamp: {
Time: 2022-04-29T17:14:07-07:00,
},
DeletionTimestamp: nil,
DeletionGracePeriodSeconds: nil,
Labels: nil,
Annotations: nil,
OwnerReferences: nil,
Finalizers: nil,
ZZZ_DeprecatedClusterName: "",
ManagedFields: [
{
Manager: "e2e.test",
Operation: "Update",
APIVersion: "v1",
Time: {
Time: 2022-04-29T17:14:07-07:00,
},
FieldsType: "FieldsV1",
FieldsV1: {
Raw: "{\"f:spec\":{\"f:containers\":{\"k:{\\\"name\\\":\\\"pause\\\"}\":{\".\":{},\"f:image\":{},\"f:imagePullPolicy\":{},\"f:name\":{},\"f:resources\":{},\"f:terminationMessagePath\":{},\"f:terminationMessagePolicy\":{}}},\"f:dnsPolicy\":{},\"f:enableServiceLinks\":{},\"f:nodeSelector\":{\".\":{},\"f:made-up-label\":{}},\"f:restartPolicy\":{},\"f:schedulerName\":{},\"f:securityContext\":{},\"f:terminationGracePeriodSeconds\":{}}}",
},
Subresource: "",
},
{
Manager: "kube-scheduler",
Operation: "Update",
APIVersion: "v1",
Time: {
Time: 2022-04-29T17:14:08-07:00,
},
FieldsType: "FieldsV1",
FieldsV1: {
Raw: "{\"f:status\":{\"f:conditions\":{\".\":{},\"k:{\\\"type\\\":\\\"PodScheduled\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}}}}}",
},
Subresource: "",
},
],
},
Spec: {
Volumes: [
{
Name: "kube-api-access-pzczz",
VolumeSource: {
HostPath: nil,
EmptyDir: nil,
GCEPersistentDisk: nil,
AWSElasticBlockStore: nil,
GitRepo: nil,
Secret: nil,
NFS: nil,
ISCSI: nil,
Glusterfs: nil,
PersistentVolumeClaim: nil,
RBD: nil,
FlexVolume: nil,
Cinder: nil,
CephFS: nil,
Flocker: nil,
DownwardAPI: nil,
FC: nil,
AzureFile: nil,
ConfigMap: nil,
VsphereVolume: nil,
Quobyte: nil,
AzureDisk: nil,
PhotonPersistentDisk: nil,
Projected: {
Sources: [
{
Secret: nil,
DownwardAPI: nil,
ConfigMap: nil,
ServiceAccountToken: {
Audience: "",
ExpirationSeconds: 3607,
Path: "token",
},
},
{
Secret: nil,
DownwardAPI: nil,
ConfigMap: {
LocalObjectReference: {Name: ...},
Items: [...],
Optional: nil,
},
ServiceAccountToken: nil,
},
{
Secret: nil,
DownwardAPI: {Items: [...]},
ConfigMap: nil,
ServiceAccountToken: nil,
},
],
DefaultMode: 420,
},
PortworxVolume: nil,
ScaleIO: nil,
StorageOS: nil,
CSI: nil,
Ephemeral: nil,
},
},
],
InitContainers: nil,
Containers: [
{
Name: "pause",
Image: "k8s.gcr.io/pause:3.7",
Command: nil,
Args: nil,
WorkingDir: "",
Ports: nil,
EnvFrom: nil,
Env: nil,
Resources: {Limits: nil, Requests: nil},
VolumeMounts: [
{
Name: "kube-api-access-pzczz",
ReadOnly: true,
MountPath: "/var/run/secrets/kubernetes.io/serviceaccount",
SubPath: "",
MountPropagation: nil,
SubPathExpr: "",
},
],
VolumeDevices: nil,
LivenessProbe: nil,
ReadinessProbe: nil,
StartupProbe: nil,
Lifecycle: nil,
TerminationMessagePath: "/dev/termination-log",
TerminationMessagePolicy: "File",
ImagePullPolicy: "IfNotPresent",
SecurityContext: nil,
Stdin: false,
StdinOnce: false,
TTY: false,
},
],
EphemeralContainers: nil,
RestartPolicy: "Always",
TerminationGracePeriodSeconds: 30,
ActiveDeadlineSeconds: nil,
DNSPolicy: "ClusterFirst",
NodeSelector: {
"made-up-label": "bogus-value",
},
ServiceAccountName: "default",
DeprecatedServiceAccount: "default",
AutomountServiceAccountToken: nil,
NodeName: "",
HostNetwork: false,
HostPID: false,
HostIPC: false,
ShareProcessNamespace: nil,
SecurityContext: {
SELinuxOptions: nil,
WindowsOptions: nil,
RunAsUser: nil,
RunAsGroup: nil,
RunAsNonRoot: nil,
SupplementalGroups: nil,
FSGroup: nil,
Sysctls: nil,
FSGroupChangePolicy: nil,
SeccompProfile: nil,
},
ImagePullSecrets: nil,
Hostname: "",
Subdomain: "",
Affinity: nil,
SchedulerName: "default-scheduler",
Tolerations: [
{
Key: "node.kubernetes.io/not-ready",
Operator: "Exists",
Value: "",
Effect: "NoExecute",
TolerationSeconds: 300,
},
{
Key: "node.kubernetes.io/unreachable",
Operator: "Exists",
Value: "",
Effect: "NoExecute",
TolerationSeconds: 300,
},
],
HostAliases: nil,
PriorityClassName: "",
Priority: 0,
DNSConfig: nil,
ReadinessGates: nil,
RuntimeClassName: nil,
EnableServiceLinks: true,
PreemptionPolicy: "PreemptLowerPriority",
Overhead: nil,
TopologySpreadConstraints: nil,
SetHostnameAsFQDN: nil,
OS: nil,
},
Status: {
Phase: "Pending",
Conditions: [
{
Type: "PodScheduled",
Status: "False",
LastProbeTime: {
Time: 0001-01-01T00:00:00Z,
},
LastTransitionTime: {
Time: 2022-04-29T17:14:08-07:00,
},
Reason: "Unschedulable",
Message: "0/3 nodes are available: 3 node(s) didn't match Pod's node affinity/selector.",
},
],
Message: "",
Reason: "",
NominatedNodeName: "",
HostIP: "",
PodIP: "",
PodIPs: nil,
StartTime: nil,
InitContainerStatuses: nil,
ContainerStatuses: nil,
QOSClass: "BestEffort",
EphemeralContainerStatuses: nil,
},
}
Apr 29 17:14:27.533: FAIL: Unexpected error:
<*pod.timeoutError | 0xc003e42a50>: {
msg: "timed out while waiting for pod pods-5788/unschedulable to be not pending",
}
timed out while waiting for pod pods-5788/unschedulable to be not pending
occurred
Full Stack Trace
k8s.io/kubernetes/test/e2e/common/node.glob..func15.3()
test/e2e/common/node/pods.go:216 +0x2a7
k8s.io/kubernetes/test/e2e.RunE2ETests(0x257f5b7?)
test/e2e/e2e.go:130 +0x686
k8s.io/kubernetes/test/e2e.TestE2E(0x24f0d19?)
test/e2e/e2e_test.go:136 +0x19
testing.tRunner(0xc0000fab60, 0x73fc8a8)
/home/stclair/sdk/go1.18.1/src/testing/testing.go:1439 +0x102
created by testing.(*T).Run
/home/stclair/sdk/go1.18.1/src/testing/testing.go:1486 +0x35f
[AfterEach] [sig-node] Pods
test/e2e/framework/framework.go:188
STEP: Collecting events from namespace "pods-5788".
STEP: Found 3 events.
Apr 29 17:14:27.584: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for unschedulable: { } FailedScheduling: 0/3 nodes are available: 3 node(s) didn't match Pod's node affinity/selector.
Apr 29 17:14:27.584: INFO: At 0001-01-01 00:00:00 +0000 UTC - event for unschedulable: { } FailedScheduling: 0/3 nodes are available: 3 node(s) didn't match Pod's node affinity/selector.
Apr 29 17:14:27.584: INFO: At 2022-04-29 17:14:11 -0700 PDT - event for unschedulable: {cluster-autoscaler } NotTriggerScaleUp: pod didn't trigger scale-up:
Apr 29 17:14:27.628: INFO: POD NODE PHASE GRACE CONDITIONS
Apr 29 17:14:27.628: INFO: unschedulable Pending [{PodScheduled False 0001-01-01 00:00:00 +0000 UTC 2022-04-29 17:14:08 -0700 PDT Unschedulable 0/3 nodes are available: 3 node(s) didn't match Pod's node affinity/selector.}]
Apr 29 17:14:27.628: INFO:
Apr 29 17:14:27.673: INFO:
Logging node info for node gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-sv7r
Apr 29 17:14:27.722: INFO: Node Info: &Node{ObjectMeta:{gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-sv7r f9564258-5f5d-467a-a38d-0d84617291c6 673653 0 2022-04-28 10:42:37 -0700 PDT <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/gke-boot-disk:pd-standard cloud.google.com/gke-container-runtime:containerd cloud.google.com/gke-nodepool:default-pool cloud.google.com/gke-os-distribution:cos cloud.google.com/machine-family:e2 failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-sv7r kubernetes.io/os:linux node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[container.googleapis.com/instance_id:1758068127604109211 csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/tallclair-gke-dev/zones/us-west1-a/instances/gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-sv7r"} node.alpha.kubernetes.io/ttl:0 node.gke.io/last-applied-node-labels:cloud.google.com/gke-boot-disk=pd-standard,cloud.google.com/gke-container-runtime=containerd,cloud.google.com/gke-nodepool=default-pool,cloud.google.com/gke-os-distribution=cos,cloud.google.com/machine-family=e2 node.gke.io/last-applied-node-taints: volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-04-28 10:42:37 -0700 PDT FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.88.0.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} } {gcp-controller-manager Update v1 2022-04-28 10:42:38 -0700 PDT FieldsV1 {"f:metadata":{"f:annotations":{"f:container.googleapis.com/instance_id":{},"f:node.gke.io/last-applied-node-labels":{},"f:node.gke.io/last-applied-node-taints":{}},"f:labels":{"f:cloud.google.com/gke-boot-disk":{},"f:cloud.google.com/gke-container-runtime":{},"f:cloud.google.com/gke-nodepool":{},"f:cloud.google.com/gke-os-distribution":{},"f:cloud.google.com/machine-family":{}}}} } {node-problem-detector Update v1 2022-04-28 10:42:38 -0700 PDT FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} } {kubelet Update v1 2022-04-28 10:43:17 -0700 PDT FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} }]},Spec:NodeSpec{PodCIDR:10.88.0.0/24,DoNotUseExternalID:,ProviderID:gce://tallclair-gke-dev/us-west1-a/gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-sv7r,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.88.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4126040064 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{940 -3} {<nil>} 940m DecimalSI},ephemeral-storage: {{47093746742 0} {<nil>} 47093746742 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{2952683520 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-04-29 17:10:54 -0700 PDT,LastTransitionTime:2022-04-28 10:42:37 -0700 PDT,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-04-29 17:10:54 -0700 PDT,LastTransitionTime:2022-04-28 10:42:37 -0700 PDT,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-04-29 17:10:54 -0700 PDT,LastTransitionTime:2022-04-28 10:42:37 -0700 PDT,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-04-29 17:10:54 -0700 PDT,LastTransitionTime:2022-04-28 10:42:37 -0700 PDT,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-04-29 17:10:54 -0700 PDT,LastTransitionTime:2022-04-28 10:42:37 -0700 PDT,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-04-29 17:10:54 -0700 PDT,LastTransitionTime:2022-04-28 10:42:37 -0700 PDT,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-04-29 17:10:54 -0700 PDT,LastTransitionTime:2022-04-28 10:42:37 -0700 PDT,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-04-29 00:01:49 -0700 PDT,LastTransitionTime:2022-04-29 00:01:49 -0700 PDT,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-29 17:11:11 -0700 PDT,LastTransitionTime:2022-04-28 10:42:24 -0700 PDT,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-29 17:11:11 -0700 PDT,LastTransitionTime:2022-04-28 10:42:24 -0700 PDT,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-29 17:11:11 -0700 PDT,LastTransitionTime:2022-04-28 10:42:24 -0700 PDT,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-29 17:11:11 -0700 PDT,LastTransitionTime:2022-04-28 10:42:55 -0700 PDT,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.46,},NodeAddress{Type:ExternalIP,Address:34.82.34.204,},NodeAddress{Type:InternalDNS,Address:gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-sv7r.c.tallclair-gke-dev.internal,},NodeAddress{Type:Hostname,Address:gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-sv7r.c.tallclair-gke-dev.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58e06020bdd664c575924447a3a61b66,SystemUUID:58e06020-bdd6-64c5-7592-4447a3a61b66,BootID:f5917798-1b1d-45fb-9549-2e9705e3c874,KernelVersion:5.4.170+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.8,KubeletVersion:v1.21.10-gke.2000,KubeProxyVersion:v1.21.10-gke.2000,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gke.gcr.io/kube-proxy-amd64:v1.21.10-gke.2000 k8s.gcr.io/kube-proxy-amd64:v1.21.10-gke.2000],SizeBytes:107473607,},ContainerImage{Names:[gke.gcr.io/gcp-compute-persistent-disk-csi-driver@sha256:8522f566bd85b0c5cfd8e74a8223ada66bd774c8279b5242903bf796b141b493 gke.gcr.io/gcp-compute-persistent-disk-csi-driver:v1.3.6-gke.0],SizeBytes:70071363,},ContainerImage{Names:[gke.gcr.io/gke-metrics-agent@sha256:e595c92cfa77638c7745a6dcec3eda59eba39874480f02d1f2ec5d9353fbac4f gke.gcr.io/gke-metrics-agent:1.2.0-gke.1],SizeBytes:44619127,},ContainerImage{Names:[gke.gcr.io/fluent-bit@sha256:6f0313fb1b2c77ccd883f20348c63c7b4caca4f53658bd9a7043676db154beb2 gke.gcr.io/fluent-bit:v1.5.7-gke.2],SizeBytes:37858868,},ContainerImage{Names:[gcr.io/gke-release/metrics-server-amd64@sha256:6e4907f3b45db9408f2e99414e8da18d9400948abd747d6519ad7d69d8136785 gcr.io/gke-release/metrics-server-amd64:v0.4.5-gke.0],SizeBytes:25341240,},ContainerImage{Names:[gke.gcr.io/fluent-bit-gke-exporter@sha256:8c0d4d150bc42636d1449c810b808417352f5418e2d63c8f12833d9db2238e21 gke.gcr.io/fluent-bit-gke-exporter:v0.17.1-gke.0],SizeBytes:19656006,},ContainerImage{Names:[eu.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64@sha256:3b600d2d5eafa6d5fcedbd783b28694af3f7dd470f3580e83200244fab32b35e gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64@sha256:3b600d2d5eafa6d5fcedbd783b28694af3f7dd470f3580e83200244fab32b35e asia.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64@sha256:3b600d2d5eafa6d5fcedbd783b28694af3f7dd470f3580e83200244fab32b35e asia.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64:1.8.1-gke.0 gke.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1-gke.0],SizeBytes:16833220,},ContainerImage{Names:[eu.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64@sha256:e3f48b3d1e49cfa3e7f002020769c9cd01cd0e77bbc99dc133c7ab0f8097e989 asia.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64@sha256:e3f48b3d1e49cfa3e7f002020769c9cd01cd0e77bbc99dc133c7ab0f8097e989 gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64@sha256:e3f48b3d1e49cfa3e7f002020769c9cd01cd0e77bbc99dc133c7ab0f8097e989 eu.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64:1.7.1-gke.0 gke.gcr.io/cluster-proportional-autoscaler-amd64:1.7.1-gke.0],SizeBytes:16572417,},ContainerImage{Names:[eu.gcr.io/gke-release-staging/cpvpa-amd64@sha256:b802d79f207ea9cbc996cc208781ea34715fe796be68e5250da37b2ae73d42a6 gcr.io/gke-release-staging/cpvpa-amd64@sha256:b802d79f207ea9cbc996cc208781ea34715fe796be68e5250da37b2ae73d42a6 asia.gcr.io/gke-release-staging/cpvpa-amd64@sha256:b802d79f207ea9cbc996cc208781ea34715fe796be68e5250da37b2ae73d42a6 gcr.io/gke-release-staging/cpvpa-amd64:v0.8.3-gke.0 asia.gcr.io/gke-release-staging/cpvpa-amd64:v0.8.3-gke.0],SizeBytes:16376177,},ContainerImage{Names:[asia.gcr.io/gke-release-staging/addon-resizer@sha256:e595f19b1661c38d89ec46cd1b57a8220db0e8aca336de60a4c06305174710d9 eu.gcr.io/gke-release-staging/addon-resizer@sha256:e595f19b1661c38d89ec46cd1b57a8220db0e8aca336de60a4c06305174710d9 gcr.io/gke-release-staging/addon-resizer@sha256:e595f19b1661c38d89ec46cd1b57a8220db0e8aca336de60a4c06305174710d9 gke.gcr.io/addon-resizer:1.8.13-gke.0 eu.gcr.io/gke-release-staging/addon-resizer:1.8.13-gke.0],SizeBytes:9654882,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:1d49fb3b108e6b42542e4a9b056dee308f06f88824326cde1636eea0472b799d k8s.gcr.io/prometheus-to-sd:v0.7.2],SizeBytes:9588954,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[gke.gcr.io/proxy-agent@sha256:4137776b74c8e09396405d46bdf7ef045e9ca343fab1fe0bb97686eb5d596613 gke.gcr.io/proxy-agent:v0.0.24-gke.2],SizeBytes:9505027,},ContainerImage{Names:[gke.gcr.io/csi-node-driver-registrar@sha256:6be94ad46be5488c783bf03237cbd21cc03a1a679fe9d039c167082f6b866d51 gke.gcr.io/csi-node-driver-registrar:v2.1.0-gke.3],SizeBytes:8784992,},ContainerImage{Names:[asia.gcr.io/google-containers/pause-amd64:3.0 eu.gcr.io/google-containers/pause-amd64:3.0 gcr.io/google-containers/pause-amd64:3.0],SizeBytes:312520,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Apr 29 17:14:27.723: INFO:
Logging kubelet events for node gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-sv7r
Apr 29 17:14:27.771: INFO:
Logging pods the kubelet thinks is on node gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-sv7r
Apr 29 17:14:27.892: INFO: kube-proxy-gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-sv7r started at 2022-04-28 10:40:44 -0700 PDT (0+1 container statuses recorded)
Apr 29 17:14:27.892: INFO: Container kube-proxy ready: true, restart count 0
Apr 29 17:14:27.892: INFO: gke-metrics-agent-kfjgn started at 2022-04-28 10:42:56 -0700 PDT (0+1 container statuses recorded)
Apr 29 17:14:27.892: INFO: Container gke-metrics-agent ready: true, restart count 0
Apr 29 17:14:27.892: INFO: fluentbit-gke-dwg5h started at 2022-04-28 10:42:56 -0700 PDT (0+2 container statuses recorded)
Apr 29 17:14:27.892: INFO: Container fluentbit ready: true, restart count 0
Apr 29 17:14:27.892: INFO: Container fluentbit-gke ready: true, restart count 0
Apr 29 17:14:27.892: INFO: pdcsi-node-gn929 started at 2022-04-28 10:42:56 -0700 PDT (0+2 container statuses recorded)
Apr 29 17:14:27.892: INFO: Container csi-driver-registrar ready: true, restart count 0
Apr 29 17:14:27.892: INFO: Container gce-pd-driver ready: true, restart count 0
Apr 29 17:14:27.892: INFO: metrics-server-v0.4.5-bbb794dcc-65sbf started at 2022-04-28 10:43:01 -0700 PDT (0+2 container statuses recorded)
Apr 29 17:14:27.892: INFO: Container metrics-server ready: true, restart count 0
Apr 29 17:14:27.892: INFO: Container metrics-server-nanny ready: true, restart count 0
Apr 29 17:14:27.892: INFO: konnectivity-agent-bb4fc6f88-7vfvw started at 2022-04-28 10:43:03 -0700 PDT (0+1 container statuses recorded)
Apr 29 17:14:27.892: INFO: Container konnectivity-agent ready: true, restart count 0
Apr 29 17:14:28.046: INFO:
Latency metrics for node gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-sv7r
Apr 29 17:14:28.046: INFO:
Logging node info for node gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xj85
Apr 29 17:14:28.097: INFO: Node Info: &Node{ObjectMeta:{gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xj85 780ccb2c-1631-4aae-b0d5-6a29e5921015 673666 0 2022-04-28 10:42:35 -0700 PDT <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/gke-boot-disk:pd-standard cloud.google.com/gke-container-runtime:containerd cloud.google.com/gke-nodepool:default-pool cloud.google.com/gke-os-distribution:cos cloud.google.com/machine-family:e2 failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xj85 kubernetes.io/os:linux node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[container.googleapis.com/instance_id:1692967835124854683 csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/tallclair-gke-dev/zones/us-west1-a/instances/gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xj85"} node.alpha.kubernetes.io/ttl:0 node.gke.io/last-applied-node-labels:cloud.google.com/gke-boot-disk=pd-standard,cloud.google.com/gke-container-runtime=containerd,cloud.google.com/gke-nodepool=default-pool,cloud.google.com/gke-os-distribution=cos,cloud.google.com/machine-family=e2 node.gke.io/last-applied-node-taints: volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-04-28 10:42:36 -0700 PDT FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.88.2.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} } {node-problem-detector Update v1 2022-04-28 10:42:36 -0700 PDT FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} } {gcp-controller-manager Update v1 2022-04-28 10:42:38 -0700 PDT FieldsV1 {"f:metadata":{"f:annotations":{"f:container.googleapis.com/instance_id":{},"f:node.gke.io/last-applied-node-labels":{},"f:node.gke.io/last-applied-node-taints":{}},"f:labels":{"f:cloud.google.com/gke-boot-disk":{},"f:cloud.google.com/gke-container-runtime":{},"f:cloud.google.com/gke-nodepool":{},"f:cloud.google.com/gke-os-distribution":{},"f:cloud.google.com/machine-family":{}}}} } {kubelet Update v1 2022-04-28 10:43:16 -0700 PDT FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} }]},Spec:NodeSpec{PodCIDR:10.88.2.0/24,DoNotUseExternalID:,ProviderID:gce://tallclair-gke-dev/us-west1-a/gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xj85,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.88.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4126031872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{940 -3} {<nil>} 940m DecimalSI},ephemeral-storage: {{47093746742 0} {<nil>} 47093746742 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{2952675328 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-04-29 17:11:13 -0700 PDT,LastTransitionTime:2022-04-28 10:42:35 -0700 PDT,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-04-29 17:11:13 -0700 PDT,LastTransitionTime:2022-04-28 10:42:35 -0700 PDT,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-04-29 17:11:13 -0700 PDT,LastTransitionTime:2022-04-28 10:42:35 -0700 PDT,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-04-29 17:11:13 -0700 PDT,LastTransitionTime:2022-04-28 10:42:35 -0700 PDT,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-04-29 17:11:13 -0700 PDT,LastTransitionTime:2022-04-28 10:42:35 -0700 PDT,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-04-29 17:11:13 -0700 PDT,LastTransitionTime:2022-04-28 10:42:35 -0700 PDT,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-04-29 17:11:13 -0700 PDT,LastTransitionTime:2022-04-28 10:42:35 -0700 PDT,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-04-29 00:01:49 -0700 PDT,LastTransitionTime:2022-04-29 00:01:49 -0700 PDT,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-29 17:11:09 -0700 PDT,LastTransitionTime:2022-04-28 10:42:17 -0700 PDT,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-29 17:11:09 -0700 PDT,LastTransitionTime:2022-04-28 10:42:17 -0700 PDT,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-29 17:11:09 -0700 PDT,LastTransitionTime:2022-04-28 10:42:17 -0700 PDT,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-29 17:11:09 -0700 PDT,LastTransitionTime:2022-04-28 10:42:56 -0700 PDT,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.48,},NodeAddress{Type:ExternalIP,Address:34.127.16.75,},NodeAddress{Type:InternalDNS,Address:gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xj85.c.tallclair-gke-dev.internal,},NodeAddress{Type:Hostname,Address:gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xj85.c.tallclair-gke-dev.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:21b5a270daec3130a2eab817f32b40d6,SystemUUID:21b5a270-daec-3130-a2ea-b817f32b40d6,BootID:4f48c758-4185-4df6-9f5d-58690dd3f747,KernelVersion:5.4.170+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.8,KubeletVersion:v1.21.10-gke.2000,KubeProxyVersion:v1.21.10-gke.2000,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gke.gcr.io/kube-proxy-amd64:v1.21.10-gke.2000 k8s.gcr.io/kube-proxy-amd64:v1.21.10-gke.2000],SizeBytes:107473607,},ContainerImage{Names:[gke.gcr.io/gcp-compute-persistent-disk-csi-driver@sha256:8522f566bd85b0c5cfd8e74a8223ada66bd774c8279b5242903bf796b141b493 gke.gcr.io/gcp-compute-persistent-disk-csi-driver:v1.3.6-gke.0],SizeBytes:70071363,},ContainerImage{Names:[gke.gcr.io/gke-metrics-agent@sha256:e595c92cfa77638c7745a6dcec3eda59eba39874480f02d1f2ec5d9353fbac4f gke.gcr.io/gke-metrics-agent:1.2.0-gke.1],SizeBytes:44619127,},ContainerImage{Names:[gke.gcr.io/fluent-bit@sha256:6f0313fb1b2c77ccd883f20348c63c7b4caca4f53658bd9a7043676db154beb2 gke.gcr.io/fluent-bit:v1.5.7-gke.2],SizeBytes:37858868,},ContainerImage{Names:[gke.gcr.io/fluent-bit-gke-exporter@sha256:8c0d4d150bc42636d1449c810b808417352f5418e2d63c8f12833d9db2238e21 gke.gcr.io/fluent-bit-gke-exporter:v0.17.1-gke.0],SizeBytes:19656006,},ContainerImage{Names:[gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64@sha256:3b600d2d5eafa6d5fcedbd783b28694af3f7dd470f3580e83200244fab32b35e asia.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64@sha256:3b600d2d5eafa6d5fcedbd783b28694af3f7dd470f3580e83200244fab32b35e eu.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64@sha256:3b600d2d5eafa6d5fcedbd783b28694af3f7dd470f3580e83200244fab32b35e eu.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64:1.8.1-gke.0 gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64:1.8.1-gke.0],SizeBytes:16833220,},ContainerImage{Names:[asia.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64@sha256:e3f48b3d1e49cfa3e7f002020769c9cd01cd0e77bbc99dc133c7ab0f8097e989 eu.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64@sha256:e3f48b3d1e49cfa3e7f002020769c9cd01cd0e77bbc99dc133c7ab0f8097e989 gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64@sha256:e3f48b3d1e49cfa3e7f002020769c9cd01cd0e77bbc99dc133c7ab0f8097e989 asia.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64:1.7.1-gke.0 eu.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64:1.7.1-gke.0],SizeBytes:16572417,},ContainerImage{Names:[gcr.io/gke-release-staging/cpvpa-amd64@sha256:b802d79f207ea9cbc996cc208781ea34715fe796be68e5250da37b2ae73d42a6 asia.gcr.io/gke-release-staging/cpvpa-amd64@sha256:b802d79f207ea9cbc996cc208781ea34715fe796be68e5250da37b2ae73d42a6 eu.gcr.io/gke-release-staging/cpvpa-amd64@sha256:b802d79f207ea9cbc996cc208781ea34715fe796be68e5250da37b2ae73d42a6 gcr.io/gke-release-staging/cpvpa-amd64:v0.8.3-gke.0 eu.gcr.io/gke-release-staging/cpvpa-amd64:v0.8.3-gke.0],SizeBytes:16376177,},ContainerImage{Names:[eu.gcr.io/gke-release-staging/addon-resizer@sha256:e595f19b1661c38d89ec46cd1b57a8220db0e8aca336de60a4c06305174710d9 gcr.io/gke-release-staging/addon-resizer@sha256:e595f19b1661c38d89ec46cd1b57a8220db0e8aca336de60a4c06305174710d9 asia.gcr.io/gke-release-staging/addon-resizer@sha256:e595f19b1661c38d89ec46cd1b57a8220db0e8aca336de60a4c06305174710d9 eu.gcr.io/gke-release-staging/addon-resizer:1.8.13-gke.0 gke.gcr.io/addon-resizer:1.8.13-gke.0],SizeBytes:9654882,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:1d49fb3b108e6b42542e4a9b056dee308f06f88824326cde1636eea0472b799d k8s.gcr.io/prometheus-to-sd:v0.7.2],SizeBytes:9588954,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[gke.gcr.io/proxy-agent@sha256:4137776b74c8e09396405d46bdf7ef045e9ca343fab1fe0bb97686eb5d596613 gke.gcr.io/proxy-agent:v0.0.24-gke.2],SizeBytes:9505027,},ContainerImage{Names:[gke.gcr.io/csi-node-driver-registrar@sha256:6be94ad46be5488c783bf03237cbd21cc03a1a679fe9d039c167082f6b866d51 gke.gcr.io/csi-node-driver-registrar:v2.1.0-gke.3],SizeBytes:8784992,},ContainerImage{Names:[eu.gcr.io/google-containers/pause-amd64:3.0 gcr.io/google-containers/pause-amd64:3.0 asia.gcr.io/google-containers/pause-amd64:3.0],SizeBytes:312520,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Apr 29 17:14:28.097: INFO:
Logging kubelet events for node gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xj85
Apr 29 17:14:28.120: INFO:
Logging pods the kubelet thinks is on node gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xj85
Apr 29 17:14:28.196: INFO: konnectivity-agent-bb4fc6f88-b9hw8 started at 2022-04-28 10:43:03 -0700 PDT (0+1 container statuses recorded)
Apr 29 17:14:28.196: INFO: Container konnectivity-agent ready: true, restart count 0
Apr 29 17:14:28.196: INFO: kube-proxy-gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xj85 started at 2022-04-28 10:40:43 -0700 PDT (0+1 container statuses recorded)
Apr 29 17:14:28.196: INFO: Container kube-proxy ready: true, restart count 0
Apr 29 17:14:28.196: INFO: gke-metrics-agent-bwfjh started at 2022-04-28 10:42:59 -0700 PDT (0+1 container statuses recorded)
Apr 29 17:14:28.196: INFO: Container gke-metrics-agent ready: true, restart count 0
Apr 29 17:14:28.196: INFO: pdcsi-node-ls27b started at 2022-04-28 10:42:59 -0700 PDT (0+2 container statuses recorded)
Apr 29 17:14:28.196: INFO: Container csi-driver-registrar ready: true, restart count 0
Apr 29 17:14:28.196: INFO: Container gce-pd-driver ready: true, restart count 0
Apr 29 17:14:28.196: INFO: fluentbit-gke-bdwk7 started at 2022-04-28 10:42:59 -0700 PDT (0+2 container statuses recorded)
Apr 29 17:14:28.196: INFO: Container fluentbit ready: true, restart count 0
Apr 29 17:14:28.196: INFO: Container fluentbit-gke ready: true, restart count 0
Apr 29 17:14:28.383: INFO:
Latency metrics for node gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xj85
Apr 29 17:14:28.383: INFO:
Logging node info for node gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xvv1
Apr 29 17:14:28.433: INFO: Node Info: &Node{ObjectMeta:{gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xvv1 fc48aa33-9d71-4c47-94f4-84a3558fad40 673662 0 2022-04-28 10:42:36 -0700 PDT <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/gke-boot-disk:pd-standard cloud.google.com/gke-container-runtime:containerd cloud.google.com/gke-nodepool:default-pool cloud.google.com/gke-os-distribution:cos cloud.google.com/machine-family:e2 failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xvv1 kubernetes.io/os:linux node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[container.googleapis.com/instance_id:5437844833773776795 csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/tallclair-gke-dev/zones/us-west1-a/instances/gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xvv1"} node.alpha.kubernetes.io/ttl:0 node.gke.io/last-applied-node-labels:cloud.google.com/gke-boot-disk=pd-standard,cloud.google.com/gke-container-runtime=containerd,cloud.google.com/gke-nodepool=default-pool,cloud.google.com/gke-os-distribution=cos,cloud.google.com/machine-family=e2 node.gke.io/last-applied-node-taints: volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-04-28 10:42:36 -0700 PDT FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.88.1.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} } {gcp-controller-manager Update v1 2022-04-28 10:42:37 -0700 PDT FieldsV1 {"f:metadata":{"f:annotations":{"f:container.googleapis.com/instance_id":{},"f:node.gke.io/last-applied-node-labels":{},"f:node.gke.io/last-applied-node-taints":{}},"f:labels":{"f:cloud.google.com/gke-boot-disk":{},"f:cloud.google.com/gke-container-runtime":{},"f:cloud.google.com/gke-nodepool":{},"f:cloud.google.com/gke-os-distribution":{},"f:cloud.google.com/machine-family":{}}}} } {node-problem-detector Update v1 2022-04-28 10:42:41 -0700 PDT FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} } {kubelet Update v1 2022-04-28 10:43:01 -0700 PDT FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} }]},Spec:NodeSpec{PodCIDR:10.88.1.0/24,DoNotUseExternalID:,ProviderID:gce://tallclair-gke-dev/us-west1-a/gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xvv1,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.88.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4126031872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{940 -3} {<nil>} 940m DecimalSI},ephemeral-storage: {{47093746742 0} {<nil>} 47093746742 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{2952675328 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-04-29 17:11:13 -0700 PDT,LastTransitionTime:2022-04-28 10:42:40 -0700 PDT,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-04-29 17:11:13 -0700 PDT,LastTransitionTime:2022-04-28 10:42:40 -0700 PDT,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-04-29 17:11:13 -0700 PDT,LastTransitionTime:2022-04-28 10:42:40 -0700 PDT,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-04-29 17:11:13 -0700 PDT,LastTransitionTime:2022-04-28 10:42:40 -0700 PDT,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-04-29 17:11:13 -0700 PDT,LastTransitionTime:2022-04-28 10:42:40 -0700 PDT,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-04-29 17:11:13 -0700 PDT,LastTransitionTime:2022-04-28 10:42:40 -0700 PDT,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-04-29 17:11:13 -0700 PDT,LastTransitionTime:2022-04-28 10:42:40 -0700 PDT,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-04-29 00:01:49 -0700 PDT,LastTransitionTime:2022-04-29 00:01:49 -0700 PDT,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-29 17:11:11 -0700 PDT,LastTransitionTime:2022-04-28 10:42:19 -0700 PDT,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-29 17:11:11 -0700 PDT,LastTransitionTime:2022-04-28 10:42:19 -0700 PDT,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-29 17:11:11 -0700 PDT,LastTransitionTime:2022-04-28 10:42:19 -0700 PDT,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-29 17:11:11 -0700 PDT,LastTransitionTime:2022-04-28 10:42:36 -0700 PDT,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.47,},NodeAddress{Type:ExternalIP,Address:35.227.167.221,},NodeAddress{Type:InternalDNS,Address:gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xvv1.c.tallclair-gke-dev.internal,},NodeAddress{Type:Hostname,Address:gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xvv1.c.tallclair-gke-dev.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:b3bd57d8598ba36bd1ac228bab3eb5d1,SystemUUID:b3bd57d8-598b-a36b-d1ac-228bab3eb5d1,BootID:98c1ac3e-addf-4f22-943f-d6881acbf3ea,KernelVersion:5.4.170+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.8,KubeletVersion:v1.21.10-gke.2000,KubeProxyVersion:v1.21.10-gke.2000,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.21.10-gke.2000 gke.gcr.io/kube-proxy-amd64:v1.21.10-gke.2000],SizeBytes:107473607,},ContainerImage{Names:[gke.gcr.io/gcp-compute-persistent-disk-csi-driver@sha256:8522f566bd85b0c5cfd8e74a8223ada66bd774c8279b5242903bf796b141b493 gke.gcr.io/gcp-compute-persistent-disk-csi-driver:v1.3.6-gke.0],SizeBytes:70071363,},ContainerImage{Names:[gke.gcr.io/gke-metrics-agent@sha256:e595c92cfa77638c7745a6dcec3eda59eba39874480f02d1f2ec5d9353fbac4f gke.gcr.io/gke-metrics-agent:1.2.0-gke.1],SizeBytes:44619127,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:c5e12680a431990d5e39ed249dcb43a7672e99f7ef94a9928be40cf2f418f62f gke.gcr.io/prometheus-to-sd:v0.10.0-gke.0],SizeBytes:44144056,},ContainerImage{Names:[gke.gcr.io/k8s-dns-kube-dns@sha256:b5dd662f1a366bbc034954dcc66beb2a5009a78982479f2b7ab7d431b12efb3f gke.gcr.io/k8s-dns-kube-dns:1.21.0-gke.0],SizeBytes:43012814,},ContainerImage{Names:[gke.gcr.io/k8s-dns-sidecar@sha256:6a175b4ddbff9d87551437c481581f7c26444ff678ddf98d16bb458df75e0eb8 gke.gcr.io/k8s-dns-sidecar:1.21.0-gke.0],SizeBytes:41007040,},ContainerImage{Names:[gke.gcr.io/k8s-dns-dnsmasq-nanny@sha256:64b131898a7aead50510baa425a0525aa71b2b2733ea0352e50ccdebad682720 gke.gcr.io/k8s-dns-dnsmasq-nanny:1.21.0-gke.0],SizeBytes:40101539,},ContainerImage{Names:[gke.gcr.io/fluent-bit@sha256:6f0313fb1b2c77ccd883f20348c63c7b4caca4f53658bd9a7043676db154beb2 gke.gcr.io/fluent-bit:v1.5.7-gke.2],SizeBytes:37858868,},ContainerImage{Names:[gke.gcr.io/event-exporter@sha256:09e908d7ea0020f47cc1279caef6ce1b4d0cdebb9c9493b8550aace1d3c82c7c gke.gcr.io/event-exporter:v0.3.5-gke.0],SizeBytes:37797281,},ContainerImage{Names:[gcr.io/gke-release/metrics-server-amd64@sha256:6e4907f3b45db9408f2e99414e8da18d9400948abd747d6519ad7d69d8136785 gcr.io/gke-release/metrics-server-amd64:v0.4.5-gke.0],SizeBytes:25341240,},ContainerImage{Names:[gke.gcr.io/fluent-bit-gke-exporter@sha256:8c0d4d150bc42636d1449c810b808417352f5418e2d63c8f12833d9db2238e21 gke.gcr.io/fluent-bit-gke-exporter:v0.17.1-gke.0],SizeBytes:19656006,},ContainerImage{Names:[gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64@sha256:3b600d2d5eafa6d5fcedbd783b28694af3f7dd470f3580e83200244fab32b35e eu.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64@sha256:3b600d2d5eafa6d5fcedbd783b28694af3f7dd470f3580e83200244fab32b35e asia.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64@sha256:3b600d2d5eafa6d5fcedbd783b28694af3f7dd470f3580e83200244fab32b35e asia.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64:1.8.1-gke.0 eu.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64:1.8.1-gke.0],SizeBytes:16833220,},ContainerImage{Names:[gke.gcr.io/cluster-proportional-autoscaler@sha256:0f232ba18b63363e33f205d0242ef98324fb388434f8598c2fc8e967dca146bc gke.gcr.io/cluster-proportional-autoscaler:1.8.4-gke.1],SizeBytes:16831440,},ContainerImage{Names:[gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64@sha256:e3f48b3d1e49cfa3e7f002020769c9cd01cd0e77bbc99dc133c7ab0f8097e989 eu.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64@sha256:e3f48b3d1e49cfa3e7f002020769c9cd01cd0e77bbc99dc133c7ab0f8097e989 asia.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64@sha256:e3f48b3d1e49cfa3e7f002020769c9cd01cd0e77bbc99dc133c7ab0f8097e989 eu.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64:1.7.1-gke.0 gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64:1.7.1-gke.0],SizeBytes:16572417,},ContainerImage{Names:[asia.gcr.io/gke-release-staging/cpvpa-amd64@sha256:b802d79f207ea9cbc996cc208781ea34715fe796be68e5250da37b2ae73d42a6 gcr.io/gke-release-staging/cpvpa-amd64@sha256:b802d79f207ea9cbc996cc208781ea34715fe796be68e5250da37b2ae73d42a6 eu.gcr.io/gke-release-staging/cpvpa-amd64@sha256:b802d79f207ea9cbc996cc208781ea34715fe796be68e5250da37b2ae73d42a6 gcr.io/gke-release-staging/cpvpa-amd64:v0.8.3-gke.0 asia.gcr.io/gke-release-staging/cpvpa-amd64:v0.8.3-gke.0],SizeBytes:16376177,},ContainerImage{Names:[eu.gcr.io/gke-release-staging/addon-resizer@sha256:e595f19b1661c38d89ec46cd1b57a8220db0e8aca336de60a4c06305174710d9 gcr.io/gke-release-staging/addon-resizer@sha256:e595f19b1661c38d89ec46cd1b57a8220db0e8aca336de60a4c06305174710d9 asia.gcr.io/gke-release-staging/addon-resizer@sha256:e595f19b1661c38d89ec46cd1b57a8220db0e8aca336de60a4c06305174710d9 gcr.io/gke-release-staging/addon-resizer:1.8.13-gke.0 eu.gcr.io/gke-release-staging/addon-resizer:1.8.13-gke.0],SizeBytes:9654882,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:1d49fb3b108e6b42542e4a9b056dee308f06f88824326cde1636eea0472b799d k8s.gcr.io/prometheus-to-sd:v0.7.2],SizeBytes:9588954,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:aca8ef83a7fae83f1f8583e978dd4d1ff655b9f2ca0a76bda5edce6d8965bdf2 gke.gcr.io/prometheus-to-sd:v0.4.2],SizeBytes:9515926,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[gke.gcr.io/proxy-agent@sha256:4137776b74c8e09396405d46bdf7ef045e9ca343fab1fe0bb97686eb5d596613 gke.gcr.io/proxy-agent:v0.0.24-gke.2],SizeBytes:9505027,},ContainerImage{Names:[gke.gcr.io/csi-node-driver-registrar@sha256:6be94ad46be5488c783bf03237cbd21cc03a1a679fe9d039c167082f6b866d51 gke.gcr.io/csi-node-driver-registrar:v2.1.0-gke.3],SizeBytes:8784992,},ContainerImage{Names:[gke.gcr.io/ingress-gce-404-server-with-metrics@sha256:6d47f258d5fc8ef4e32641972840509701b3689d249c36a4282acf9cd89e04f4 gke.gcr.io/ingress-gce-404-server-with-metrics:v1.13.4],SizeBytes:7645836,},ContainerImage{Names:[eu.gcr.io/google-containers/pause-amd64:3.0 gcr.io/google-containers/pause-amd64:3.0 asia.gcr.io/google-containers/pause-amd64:3.0],SizeBytes:312520,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Apr 29 17:14:28.434: INFO:
Logging kubelet events for node gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xvv1
Apr 29 17:14:28.457: INFO:
Logging pods the kubelet thinks is on node gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xvv1
Apr 29 17:14:28.553: INFO: konnectivity-agent-autoscaler-6849fff748-wnlfs started at 2022-04-28 10:42:40 -0700 PDT (0+1 container statuses recorded)
Apr 29 17:14:28.553: INFO: Container autoscaler ready: true, restart count 0
Apr 29 17:14:28.553: INFO: event-exporter-gke-5479fd58c8-jg7sm started at 2022-04-28 10:42:40 -0700 PDT (0+2 container statuses recorded)
Apr 29 17:14:28.553: INFO: Container event-exporter ready: true, restart count 0
Apr 29 17:14:28.553: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0
Apr 29 17:14:28.553: INFO: l7-default-backend-69fb9fd9f9-jvcpj started at 2022-04-28 10:42:40 -0700 PDT (0+1 container statuses recorded)
Apr 29 17:14:28.553: INFO: Container default-http-backend ready: true, restart count 0
Apr 29 17:14:28.553: INFO: kube-proxy-gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xvv1 started at 2022-04-28 10:40:44 -0700 PDT (0+1 container statuses recorded)
Apr 29 17:14:28.553: INFO: Container kube-proxy ready: true, restart count 0
Apr 29 17:14:28.553: INFO: gke-metrics-agent-hks79 started at 2022-04-28 10:42:36 -0700 PDT (0+1 container statuses recorded)
Apr 29 17:14:28.553: INFO: Container gke-metrics-agent ready: true, restart count 0
Apr 29 17:14:28.553: INFO: kube-dns-autoscaler-844c9d9448-d4mzq started at 2022-04-28 10:42:40 -0700 PDT (0+1 container statuses recorded)
Apr 29 17:14:28.553: INFO: Container autoscaler ready: true, restart count 0
Apr 29 17:14:28.553: INFO: kube-dns-697dc8fc8b-4v9bv started at 2022-04-28 10:42:40 -0700 PDT (0+4 container statuses recorded)
Apr 29 17:14:28.553: INFO: Container dnsmasq ready: true, restart count 0
Apr 29 17:14:28.553: INFO: Container kubedns ready: true, restart count 0
Apr 29 17:14:28.553: INFO: Container prometheus-to-sd ready: true, restart count 0
Apr 29 17:14:28.553: INFO: Container sidecar ready: true, restart count 0
Apr 29 17:14:28.553: INFO: fluentbit-gke-hpwzr started at 2022-04-28 10:42:36 -0700 PDT (0+2 container statuses recorded)
Apr 29 17:14:28.553: INFO: Container fluentbit ready: true, restart count 0
Apr 29 17:14:28.553: INFO: Container fluentbit-gke ready: true, restart count 0
Apr 29 17:14:28.553: INFO: pdcsi-node-69kpb started at 2022-04-28 10:42:37 -0700 PDT (0+2 container statuses recorded)
Apr 29 17:14:28.553: INFO: Container csi-driver-registrar ready: true, restart count 0
Apr 29 17:14:28.553: INFO: Container gce-pd-driver ready: true, restart count 0
Apr 29 17:14:28.553: INFO: konnectivity-agent-bb4fc6f88-t89s8 started at 2022-04-28 10:42:40 -0700 PDT (0+1 container statuses recorded)
Apr 29 17:14:28.553: INFO: Container konnectivity-agent ready: true, restart count 0
Apr 29 17:14:28.553: INFO: kube-dns-697dc8fc8b-8qqp4 started at 2022-04-28 10:42:45 -0700 PDT (0+4 container statuses recorded)
Apr 29 17:14:28.553: INFO: Container dnsmasq ready: true, restart count 0
Apr 29 17:14:28.553: INFO: Container kubedns ready: true, restart count 0
Apr 29 17:14:28.553: INFO: Container prometheus-to-sd ready: true, restart count 0
Apr 29 17:14:28.553: INFO: Container sidecar ready: true, restart count 0
Apr 29 17:14:28.778: INFO:
Latency metrics for node gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xvv1
Apr 29 17:14:28.778: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "pods-5788" for this suite.
• Failure [22.005 seconds]
[sig-node] Pods
test/e2e/common/node/framework.go:23
[qrchzpyqsnrjcpuhznphqxrncph] Dummy test function: Unschedulable [It]
test/e2e/common/node/pods.go:200
Apr 29 17:14:27.533: Unexpected error:
<*pod.timeoutError | 0xc003e42a50>: {
msg: "timed out while waiting for pod pods-5788/unschedulable to be not pending",
}
timed out while waiting for pod pods-5788/unschedulable to be not pending
occurred
test/e2e/common/node/pods.go:216
------------------------------
{"msg":"FAILED [sig-node] Pods [qrchzpyqsnrjcpuhznphqxrncph] Dummy test function: Unschedulable","total":2,"completed":0,"skipped":990,"failed":1,"failures":["[sig-node] Pods [qrchzpyqsnrjcpuhznphqxrncph] Dummy test function: Unschedulable"]}
SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[sig-node] Pods
[qrchzpyqsnrjcpuhznphqxrncph] Dummy test function: Pod Not Found
test/e2e/common/node/pods.go:196
[BeforeEach] [sig-node] Pods
test/e2e/framework/framework.go:187
STEP: Creating a kubernetes client
Apr 29 17:14:28.885: INFO: >>> kubeConfig: /home/stclair/.kube/config
STEP: Building a namespace api object, basename pods
STEP: Waiting for a default service account to be provisioned in namespace
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[BeforeEach] [sig-node] Pods
test/e2e/common/node/pods.go:191
[It] [qrchzpyqsnrjcpuhznphqxrncph] Dummy test function: Pod Not Found
test/e2e/common/node/pods.go:196
Apr 29 17:14:29.191: INFO: Waiting up to 20s for pod "does-not-exist" in namespace "pods-210" to be "not pending"
Apr 29 17:14:29.233: INFO: Ignoring NotFound error while getting pod pods-210/does-not-exist
Apr 29 17:14:31.259: INFO: Ignoring NotFound error while getting pod pods-210/does-not-exist
Apr 29 17:14:33.262: INFO: Ignoring NotFound error while getting pod pods-210/does-not-exist
Apr 29 17:14:35.257: INFO: Ignoring NotFound error while getting pod pods-210/does-not-exist
Apr 29 17:14:37.258: INFO: Ignoring NotFound error while getting pod pods-210/does-not-exist
Apr 29 17:14:39.261: INFO: Ignoring NotFound error while getting pod pods-210/does-not-exist
Apr 29 17:14:41.260: INFO: Ignoring NotFound error while getting pod pods-210/does-not-exist
Apr 29 17:14:43.261: INFO: Ignoring NotFound error while getting pod pods-210/does-not-exist
Apr 29 17:14:45.261: INFO: Ignoring NotFound error while getting pod pods-210/does-not-exist
Apr 29 17:14:47.263: INFO: Ignoring NotFound error while getting pod pods-210/does-not-exist
Apr 29 17:14:49.261: INFO: Ignoring NotFound error while getting pod pods-210/does-not-exist
Apr 29 17:14:49.285: INFO: Ignoring NotFound error while getting pod pods-210/does-not-exist
Apr 29 17:14:49.285: INFO: Timed out while waiting for pod pods-210/does-not-exist to be not pending. Last observed as: <*v1.Pod | 0x0>: nil
Apr 29 17:14:49.285: FAIL: Unexpected error:
<*fmt.wrapError | 0xc002466720>: {
msg: "error while waiting for pod pods-210/does-not-exist to be not pending: pods \"does-not-exist\" not found",
err: {
ErrStatus: {
TypeMeta: {Kind: "", APIVersion: ""},
ListMeta: {
SelfLink: "",
ResourceVersion: "",
Continue: "",
RemainingItemCount: nil,
},
Status: "Failure",
Message: "pods \"does-not-exist\" not found",
Reason: "NotFound",
Details: {
Name: "does-not-exist",
Group: "",
Kind: "pods",
UID: "",
Causes: nil,
RetryAfterSeconds: 0,
},
Code: 404,
},
},
}
error while waiting for pod pods-210/does-not-exist to be not pending: pods "does-not-exist" not found
occurred
Full Stack Trace
k8s.io/kubernetes/test/e2e/common/node.glob..func15.2()
test/e2e/common/node/pods.go:197 +0x55
k8s.io/kubernetes/test/e2e.RunE2ETests(0x257f5b7?)
test/e2e/e2e.go:130 +0x686
k8s.io/kubernetes/test/e2e.TestE2E(0x24f0d19?)
test/e2e/e2e_test.go:136 +0x19
testing.tRunner(0xc0000fab60, 0x73fc8a8)
/home/stclair/sdk/go1.18.1/src/testing/testing.go:1439 +0x102
created by testing.(*T).Run
/home/stclair/sdk/go1.18.1/src/testing/testing.go:1486 +0x35f
[AfterEach] [sig-node] Pods
test/e2e/framework/framework.go:188
STEP: Collecting events from namespace "pods-210".
STEP: Found 0 events.
Apr 29 17:14:49.378: INFO: POD NODE PHASE GRACE CONDITIONS
Apr 29 17:14:49.378: INFO:
Apr 29 17:14:49.425: INFO:
Logging node info for node gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-sv7r
Apr 29 17:14:49.451: INFO: Node Info: &Node{ObjectMeta:{gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-sv7r f9564258-5f5d-467a-a38d-0d84617291c6 673653 0 2022-04-28 10:42:37 -0700 PDT <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/gke-boot-disk:pd-standard cloud.google.com/gke-container-runtime:containerd cloud.google.com/gke-nodepool:default-pool cloud.google.com/gke-os-distribution:cos cloud.google.com/machine-family:e2 failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-sv7r kubernetes.io/os:linux node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[container.googleapis.com/instance_id:1758068127604109211 csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/tallclair-gke-dev/zones/us-west1-a/instances/gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-sv7r"} node.alpha.kubernetes.io/ttl:0 node.gke.io/last-applied-node-labels:cloud.google.com/gke-boot-disk=pd-standard,cloud.google.com/gke-container-runtime=containerd,cloud.google.com/gke-nodepool=default-pool,cloud.google.com/gke-os-distribution=cos,cloud.google.com/machine-family=e2 node.gke.io/last-applied-node-taints: volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-04-28 10:42:37 -0700 PDT FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.88.0.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} } {gcp-controller-manager Update v1 2022-04-28 10:42:38 -0700 PDT FieldsV1 {"f:metadata":{"f:annotations":{"f:container.googleapis.com/instance_id":{},"f:node.gke.io/last-applied-node-labels":{},"f:node.gke.io/last-applied-node-taints":{}},"f:labels":{"f:cloud.google.com/gke-boot-disk":{},"f:cloud.google.com/gke-container-runtime":{},"f:cloud.google.com/gke-nodepool":{},"f:cloud.google.com/gke-os-distribution":{},"f:cloud.google.com/machine-family":{}}}} } {node-problem-detector Update v1 2022-04-28 10:42:38 -0700 PDT FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} } {kubelet Update v1 2022-04-28 10:43:17 -0700 PDT FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} }]},Spec:NodeSpec{PodCIDR:10.88.0.0/24,DoNotUseExternalID:,ProviderID:gce://tallclair-gke-dev/us-west1-a/gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-sv7r,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.88.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4126040064 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{940 -3} {<nil>} 940m DecimalSI},ephemeral-storage: {{47093746742 0} {<nil>} 47093746742 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{2952683520 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-04-29 17:10:54 -0700 PDT,LastTransitionTime:2022-04-28 10:42:37 -0700 PDT,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-04-29 17:10:54 -0700 PDT,LastTransitionTime:2022-04-28 10:42:37 -0700 PDT,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-04-29 17:10:54 -0700 PDT,LastTransitionTime:2022-04-28 10:42:37 -0700 PDT,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-04-29 17:10:54 -0700 PDT,LastTransitionTime:2022-04-28 10:42:37 -0700 PDT,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-04-29 17:10:54 -0700 PDT,LastTransitionTime:2022-04-28 10:42:37 -0700 PDT,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-04-29 17:10:54 -0700 PDT,LastTransitionTime:2022-04-28 10:42:37 -0700 PDT,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-04-29 17:10:54 -0700 PDT,LastTransitionTime:2022-04-28 10:42:37 -0700 PDT,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-04-29 00:01:49 -0700 PDT,LastTransitionTime:2022-04-29 00:01:49 -0700 PDT,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-29 17:11:11 -0700 PDT,LastTransitionTime:2022-04-28 10:42:24 -0700 PDT,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-29 17:11:11 -0700 PDT,LastTransitionTime:2022-04-28 10:42:24 -0700 PDT,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-29 17:11:11 -0700 PDT,LastTransitionTime:2022-04-28 10:42:24 -0700 PDT,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-29 17:11:11 -0700 PDT,LastTransitionTime:2022-04-28 10:42:55 -0700 PDT,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.46,},NodeAddress{Type:ExternalIP,Address:34.82.34.204,},NodeAddress{Type:InternalDNS,Address:gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-sv7r.c.tallclair-gke-dev.internal,},NodeAddress{Type:Hostname,Address:gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-sv7r.c.tallclair-gke-dev.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:58e06020bdd664c575924447a3a61b66,SystemUUID:58e06020-bdd6-64c5-7592-4447a3a61b66,BootID:f5917798-1b1d-45fb-9549-2e9705e3c874,KernelVersion:5.4.170+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.8,KubeletVersion:v1.21.10-gke.2000,KubeProxyVersion:v1.21.10-gke.2000,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gke.gcr.io/kube-proxy-amd64:v1.21.10-gke.2000 k8s.gcr.io/kube-proxy-amd64:v1.21.10-gke.2000],SizeBytes:107473607,},ContainerImage{Names:[gke.gcr.io/gcp-compute-persistent-disk-csi-driver@sha256:8522f566bd85b0c5cfd8e74a8223ada66bd774c8279b5242903bf796b141b493 gke.gcr.io/gcp-compute-persistent-disk-csi-driver:v1.3.6-gke.0],SizeBytes:70071363,},ContainerImage{Names:[gke.gcr.io/gke-metrics-agent@sha256:e595c92cfa77638c7745a6dcec3eda59eba39874480f02d1f2ec5d9353fbac4f gke.gcr.io/gke-metrics-agent:1.2.0-gke.1],SizeBytes:44619127,},ContainerImage{Names:[gke.gcr.io/fluent-bit@sha256:6f0313fb1b2c77ccd883f20348c63c7b4caca4f53658bd9a7043676db154beb2 gke.gcr.io/fluent-bit:v1.5.7-gke.2],SizeBytes:37858868,},ContainerImage{Names:[gcr.io/gke-release/metrics-server-amd64@sha256:6e4907f3b45db9408f2e99414e8da18d9400948abd747d6519ad7d69d8136785 gcr.io/gke-release/metrics-server-amd64:v0.4.5-gke.0],SizeBytes:25341240,},ContainerImage{Names:[gke.gcr.io/fluent-bit-gke-exporter@sha256:8c0d4d150bc42636d1449c810b808417352f5418e2d63c8f12833d9db2238e21 gke.gcr.io/fluent-bit-gke-exporter:v0.17.1-gke.0],SizeBytes:19656006,},ContainerImage{Names:[eu.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64@sha256:3b600d2d5eafa6d5fcedbd783b28694af3f7dd470f3580e83200244fab32b35e gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64@sha256:3b600d2d5eafa6d5fcedbd783b28694af3f7dd470f3580e83200244fab32b35e asia.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64@sha256:3b600d2d5eafa6d5fcedbd783b28694af3f7dd470f3580e83200244fab32b35e asia.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64:1.8.1-gke.0 gke.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1-gke.0],SizeBytes:16833220,},ContainerImage{Names:[eu.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64@sha256:e3f48b3d1e49cfa3e7f002020769c9cd01cd0e77bbc99dc133c7ab0f8097e989 asia.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64@sha256:e3f48b3d1e49cfa3e7f002020769c9cd01cd0e77bbc99dc133c7ab0f8097e989 gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64@sha256:e3f48b3d1e49cfa3e7f002020769c9cd01cd0e77bbc99dc133c7ab0f8097e989 eu.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64:1.7.1-gke.0 gke.gcr.io/cluster-proportional-autoscaler-amd64:1.7.1-gke.0],SizeBytes:16572417,},ContainerImage{Names:[eu.gcr.io/gke-release-staging/cpvpa-amd64@sha256:b802d79f207ea9cbc996cc208781ea34715fe796be68e5250da37b2ae73d42a6 gcr.io/gke-release-staging/cpvpa-amd64@sha256:b802d79f207ea9cbc996cc208781ea34715fe796be68e5250da37b2ae73d42a6 asia.gcr.io/gke-release-staging/cpvpa-amd64@sha256:b802d79f207ea9cbc996cc208781ea34715fe796be68e5250da37b2ae73d42a6 gcr.io/gke-release-staging/cpvpa-amd64:v0.8.3-gke.0 asia.gcr.io/gke-release-staging/cpvpa-amd64:v0.8.3-gke.0],SizeBytes:16376177,},ContainerImage{Names:[asia.gcr.io/gke-release-staging/addon-resizer@sha256:e595f19b1661c38d89ec46cd1b57a8220db0e8aca336de60a4c06305174710d9 eu.gcr.io/gke-release-staging/addon-resizer@sha256:e595f19b1661c38d89ec46cd1b57a8220db0e8aca336de60a4c06305174710d9 gcr.io/gke-release-staging/addon-resizer@sha256:e595f19b1661c38d89ec46cd1b57a8220db0e8aca336de60a4c06305174710d9 gke.gcr.io/addon-resizer:1.8.13-gke.0 eu.gcr.io/gke-release-staging/addon-resizer:1.8.13-gke.0],SizeBytes:9654882,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:1d49fb3b108e6b42542e4a9b056dee308f06f88824326cde1636eea0472b799d k8s.gcr.io/prometheus-to-sd:v0.7.2],SizeBytes:9588954,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[gke.gcr.io/proxy-agent@sha256:4137776b74c8e09396405d46bdf7ef045e9ca343fab1fe0bb97686eb5d596613 gke.gcr.io/proxy-agent:v0.0.24-gke.2],SizeBytes:9505027,},ContainerImage{Names:[gke.gcr.io/csi-node-driver-registrar@sha256:6be94ad46be5488c783bf03237cbd21cc03a1a679fe9d039c167082f6b866d51 gke.gcr.io/csi-node-driver-registrar:v2.1.0-gke.3],SizeBytes:8784992,},ContainerImage{Names:[asia.gcr.io/google-containers/pause-amd64:3.0 eu.gcr.io/google-containers/pause-amd64:3.0 gcr.io/google-containers/pause-amd64:3.0],SizeBytes:312520,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Apr 29 17:14:49.453: INFO:
Logging kubelet events for node gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-sv7r
Apr 29 17:14:49.477: INFO:
Logging pods the kubelet thinks is on node gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-sv7r
Apr 29 17:14:49.536: INFO: konnectivity-agent-bb4fc6f88-7vfvw started at 2022-04-28 10:43:03 -0700 PDT (0+1 container statuses recorded)
Apr 29 17:14:49.536: INFO: Container konnectivity-agent ready: true, restart count 0
Apr 29 17:14:49.536: INFO: kube-proxy-gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-sv7r started at 2022-04-28 10:40:44 -0700 PDT (0+1 container statuses recorded)
Apr 29 17:14:49.536: INFO: Container kube-proxy ready: true, restart count 0
Apr 29 17:14:49.536: INFO: gke-metrics-agent-kfjgn started at 2022-04-28 10:42:56 -0700 PDT (0+1 container statuses recorded)
Apr 29 17:14:49.536: INFO: Container gke-metrics-agent ready: true, restart count 0
Apr 29 17:14:49.536: INFO: fluentbit-gke-dwg5h started at 2022-04-28 10:42:56 -0700 PDT (0+2 container statuses recorded)
Apr 29 17:14:49.536: INFO: Container fluentbit ready: true, restart count 0
Apr 29 17:14:49.536: INFO: Container fluentbit-gke ready: true, restart count 0
Apr 29 17:14:49.536: INFO: pdcsi-node-gn929 started at 2022-04-28 10:42:56 -0700 PDT (0+2 container statuses recorded)
Apr 29 17:14:49.536: INFO: Container csi-driver-registrar ready: true, restart count 0
Apr 29 17:14:49.536: INFO: Container gce-pd-driver ready: true, restart count 0
Apr 29 17:14:49.536: INFO: metrics-server-v0.4.5-bbb794dcc-65sbf started at 2022-04-28 10:43:01 -0700 PDT (0+2 container statuses recorded)
Apr 29 17:14:49.536: INFO: Container metrics-server ready: true, restart count 0
Apr 29 17:14:49.536: INFO: Container metrics-server-nanny ready: true, restart count 0
Apr 29 17:14:49.757: INFO:
Latency metrics for node gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-sv7r
Apr 29 17:14:49.757: INFO:
Logging node info for node gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xj85
Apr 29 17:14:49.783: INFO: Node Info: &Node{ObjectMeta:{gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xj85 780ccb2c-1631-4aae-b0d5-6a29e5921015 673666 0 2022-04-28 10:42:35 -0700 PDT <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/gke-boot-disk:pd-standard cloud.google.com/gke-container-runtime:containerd cloud.google.com/gke-nodepool:default-pool cloud.google.com/gke-os-distribution:cos cloud.google.com/machine-family:e2 failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xj85 kubernetes.io/os:linux node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[container.googleapis.com/instance_id:1692967835124854683 csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/tallclair-gke-dev/zones/us-west1-a/instances/gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xj85"} node.alpha.kubernetes.io/ttl:0 node.gke.io/last-applied-node-labels:cloud.google.com/gke-boot-disk=pd-standard,cloud.google.com/gke-container-runtime=containerd,cloud.google.com/gke-nodepool=default-pool,cloud.google.com/gke-os-distribution=cos,cloud.google.com/machine-family=e2 node.gke.io/last-applied-node-taints: volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-04-28 10:42:36 -0700 PDT FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.88.2.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} } {node-problem-detector Update v1 2022-04-28 10:42:36 -0700 PDT FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} } {gcp-controller-manager Update v1 2022-04-28 10:42:38 -0700 PDT FieldsV1 {"f:metadata":{"f:annotations":{"f:container.googleapis.com/instance_id":{},"f:node.gke.io/last-applied-node-labels":{},"f:node.gke.io/last-applied-node-taints":{}},"f:labels":{"f:cloud.google.com/gke-boot-disk":{},"f:cloud.google.com/gke-container-runtime":{},"f:cloud.google.com/gke-nodepool":{},"f:cloud.google.com/gke-os-distribution":{},"f:cloud.google.com/machine-family":{}}}} } {kubelet Update v1 2022-04-28 10:43:16 -0700 PDT FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} }]},Spec:NodeSpec{PodCIDR:10.88.2.0/24,DoNotUseExternalID:,ProviderID:gce://tallclair-gke-dev/us-west1-a/gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xj85,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.88.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4126031872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{940 -3} {<nil>} 940m DecimalSI},ephemeral-storage: {{47093746742 0} {<nil>} 47093746742 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{2952675328 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-04-29 17:11:13 -0700 PDT,LastTransitionTime:2022-04-28 10:42:35 -0700 PDT,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-04-29 17:11:13 -0700 PDT,LastTransitionTime:2022-04-28 10:42:35 -0700 PDT,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-04-29 17:11:13 -0700 PDT,LastTransitionTime:2022-04-28 10:42:35 -0700 PDT,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-04-29 17:11:13 -0700 PDT,LastTransitionTime:2022-04-28 10:42:35 -0700 PDT,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-04-29 17:11:13 -0700 PDT,LastTransitionTime:2022-04-28 10:42:35 -0700 PDT,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-04-29 17:11:13 -0700 PDT,LastTransitionTime:2022-04-28 10:42:35 -0700 PDT,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-04-29 17:11:13 -0700 PDT,LastTransitionTime:2022-04-28 10:42:35 -0700 PDT,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-04-29 00:01:49 -0700 PDT,LastTransitionTime:2022-04-29 00:01:49 -0700 PDT,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-29 17:11:09 -0700 PDT,LastTransitionTime:2022-04-28 10:42:17 -0700 PDT,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-29 17:11:09 -0700 PDT,LastTransitionTime:2022-04-28 10:42:17 -0700 PDT,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-29 17:11:09 -0700 PDT,LastTransitionTime:2022-04-28 10:42:17 -0700 PDT,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-29 17:11:09 -0700 PDT,LastTransitionTime:2022-04-28 10:42:56 -0700 PDT,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.48,},NodeAddress{Type:ExternalIP,Address:34.127.16.75,},NodeAddress{Type:InternalDNS,Address:gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xj85.c.tallclair-gke-dev.internal,},NodeAddress{Type:Hostname,Address:gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xj85.c.tallclair-gke-dev.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:21b5a270daec3130a2eab817f32b40d6,SystemUUID:21b5a270-daec-3130-a2ea-b817f32b40d6,BootID:4f48c758-4185-4df6-9f5d-58690dd3f747,KernelVersion:5.4.170+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.8,KubeletVersion:v1.21.10-gke.2000,KubeProxyVersion:v1.21.10-gke.2000,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[gke.gcr.io/kube-proxy-amd64:v1.21.10-gke.2000 k8s.gcr.io/kube-proxy-amd64:v1.21.10-gke.2000],SizeBytes:107473607,},ContainerImage{Names:[gke.gcr.io/gcp-compute-persistent-disk-csi-driver@sha256:8522f566bd85b0c5cfd8e74a8223ada66bd774c8279b5242903bf796b141b493 gke.gcr.io/gcp-compute-persistent-disk-csi-driver:v1.3.6-gke.0],SizeBytes:70071363,},ContainerImage{Names:[gke.gcr.io/gke-metrics-agent@sha256:e595c92cfa77638c7745a6dcec3eda59eba39874480f02d1f2ec5d9353fbac4f gke.gcr.io/gke-metrics-agent:1.2.0-gke.1],SizeBytes:44619127,},ContainerImage{Names:[gke.gcr.io/fluent-bit@sha256:6f0313fb1b2c77ccd883f20348c63c7b4caca4f53658bd9a7043676db154beb2 gke.gcr.io/fluent-bit:v1.5.7-gke.2],SizeBytes:37858868,},ContainerImage{Names:[gke.gcr.io/fluent-bit-gke-exporter@sha256:8c0d4d150bc42636d1449c810b808417352f5418e2d63c8f12833d9db2238e21 gke.gcr.io/fluent-bit-gke-exporter:v0.17.1-gke.0],SizeBytes:19656006,},ContainerImage{Names:[gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64@sha256:3b600d2d5eafa6d5fcedbd783b28694af3f7dd470f3580e83200244fab32b35e asia.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64@sha256:3b600d2d5eafa6d5fcedbd783b28694af3f7dd470f3580e83200244fab32b35e eu.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64@sha256:3b600d2d5eafa6d5fcedbd783b28694af3f7dd470f3580e83200244fab32b35e eu.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64:1.8.1-gke.0 gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64:1.8.1-gke.0],SizeBytes:16833220,},ContainerImage{Names:[asia.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64@sha256:e3f48b3d1e49cfa3e7f002020769c9cd01cd0e77bbc99dc133c7ab0f8097e989 eu.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64@sha256:e3f48b3d1e49cfa3e7f002020769c9cd01cd0e77bbc99dc133c7ab0f8097e989 gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64@sha256:e3f48b3d1e49cfa3e7f002020769c9cd01cd0e77bbc99dc133c7ab0f8097e989 asia.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64:1.7.1-gke.0 eu.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64:1.7.1-gke.0],SizeBytes:16572417,},ContainerImage{Names:[gcr.io/gke-release-staging/cpvpa-amd64@sha256:b802d79f207ea9cbc996cc208781ea34715fe796be68e5250da37b2ae73d42a6 asia.gcr.io/gke-release-staging/cpvpa-amd64@sha256:b802d79f207ea9cbc996cc208781ea34715fe796be68e5250da37b2ae73d42a6 eu.gcr.io/gke-release-staging/cpvpa-amd64@sha256:b802d79f207ea9cbc996cc208781ea34715fe796be68e5250da37b2ae73d42a6 gcr.io/gke-release-staging/cpvpa-amd64:v0.8.3-gke.0 eu.gcr.io/gke-release-staging/cpvpa-amd64:v0.8.3-gke.0],SizeBytes:16376177,},ContainerImage{Names:[eu.gcr.io/gke-release-staging/addon-resizer@sha256:e595f19b1661c38d89ec46cd1b57a8220db0e8aca336de60a4c06305174710d9 gcr.io/gke-release-staging/addon-resizer@sha256:e595f19b1661c38d89ec46cd1b57a8220db0e8aca336de60a4c06305174710d9 asia.gcr.io/gke-release-staging/addon-resizer@sha256:e595f19b1661c38d89ec46cd1b57a8220db0e8aca336de60a4c06305174710d9 eu.gcr.io/gke-release-staging/addon-resizer:1.8.13-gke.0 gke.gcr.io/addon-resizer:1.8.13-gke.0],SizeBytes:9654882,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:1d49fb3b108e6b42542e4a9b056dee308f06f88824326cde1636eea0472b799d k8s.gcr.io/prometheus-to-sd:v0.7.2],SizeBytes:9588954,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[gke.gcr.io/proxy-agent@sha256:4137776b74c8e09396405d46bdf7ef045e9ca343fab1fe0bb97686eb5d596613 gke.gcr.io/proxy-agent:v0.0.24-gke.2],SizeBytes:9505027,},ContainerImage{Names:[gke.gcr.io/csi-node-driver-registrar@sha256:6be94ad46be5488c783bf03237cbd21cc03a1a679fe9d039c167082f6b866d51 gke.gcr.io/csi-node-driver-registrar:v2.1.0-gke.3],SizeBytes:8784992,},ContainerImage{Names:[eu.gcr.io/google-containers/pause-amd64:3.0 gcr.io/google-containers/pause-amd64:3.0 asia.gcr.io/google-containers/pause-amd64:3.0],SizeBytes:312520,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Apr 29 17:14:49.786: INFO:
Logging kubelet events for node gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xj85
Apr 29 17:14:49.810: INFO:
Logging pods the kubelet thinks is on node gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xj85
Apr 29 17:14:49.850: INFO: kube-proxy-gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xj85 started at 2022-04-28 10:40:43 -0700 PDT (0+1 container statuses recorded)
Apr 29 17:14:49.850: INFO: Container kube-proxy ready: true, restart count 0
Apr 29 17:14:49.850: INFO: gke-metrics-agent-bwfjh started at 2022-04-28 10:42:59 -0700 PDT (0+1 container statuses recorded)
Apr 29 17:14:49.850: INFO: Container gke-metrics-agent ready: true, restart count 0
Apr 29 17:14:49.850: INFO: pdcsi-node-ls27b started at 2022-04-28 10:42:59 -0700 PDT (0+2 container statuses recorded)
Apr 29 17:14:49.850: INFO: Container csi-driver-registrar ready: true, restart count 0
Apr 29 17:14:49.850: INFO: Container gce-pd-driver ready: true, restart count 0
Apr 29 17:14:49.850: INFO: fluentbit-gke-bdwk7 started at 2022-04-28 10:42:59 -0700 PDT (0+2 container statuses recorded)
Apr 29 17:14:49.850: INFO: Container fluentbit ready: true, restart count 0
Apr 29 17:14:49.850: INFO: Container fluentbit-gke ready: true, restart count 0
Apr 29 17:14:49.850: INFO: konnectivity-agent-bb4fc6f88-b9hw8 started at 2022-04-28 10:43:03 -0700 PDT (0+1 container statuses recorded)
Apr 29 17:14:49.850: INFO: Container konnectivity-agent ready: true, restart count 0
Apr 29 17:14:49.981: INFO:
Latency metrics for node gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xj85
Apr 29 17:14:49.981: INFO:
Logging node info for node gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xvv1
Apr 29 17:14:50.007: INFO: Node Info: &Node{ObjectMeta:{gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xvv1 fc48aa33-9d71-4c47-94f4-84a3558fad40 673662 0 2022-04-28 10:42:36 -0700 PDT <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:e2-medium beta.kubernetes.io/os:linux cloud.google.com/gke-boot-disk:pd-standard cloud.google.com/gke-container-runtime:containerd cloud.google.com/gke-nodepool:default-pool cloud.google.com/gke-os-distribution:cos cloud.google.com/machine-family:e2 failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-a kubernetes.io/arch:amd64 kubernetes.io/hostname:gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xvv1 kubernetes.io/os:linux node.kubernetes.io/instance-type:e2-medium topology.gke.io/zone:us-west1-a topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-a] map[container.googleapis.com/instance_id:5437844833773776795 csi.volume.kubernetes.io/nodeid:{"pd.csi.storage.gke.io":"projects/tallclair-gke-dev/zones/us-west1-a/instances/gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xvv1"} node.alpha.kubernetes.io/ttl:0 node.gke.io/last-applied-node-labels:cloud.google.com/gke-boot-disk=pd-standard,cloud.google.com/gke-container-runtime=containerd,cloud.google.com/gke-nodepool=default-pool,cloud.google.com/gke-os-distribution=cos,cloud.google.com/machine-family=e2 node.gke.io/last-applied-node-taints: volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2022-04-28 10:42:36 -0700 PDT FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.88.1.0/24\"":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} } {gcp-controller-manager Update v1 2022-04-28 10:42:37 -0700 PDT FieldsV1 {"f:metadata":{"f:annotations":{"f:container.googleapis.com/instance_id":{},"f:node.gke.io/last-applied-node-labels":{},"f:node.gke.io/last-applied-node-taints":{}},"f:labels":{"f:cloud.google.com/gke-boot-disk":{},"f:cloud.google.com/gke-container-runtime":{},"f:cloud.google.com/gke-nodepool":{},"f:cloud.google.com/gke-os-distribution":{},"f:cloud.google.com/machine-family":{}}}} } {node-problem-detector Update v1 2022-04-28 10:42:41 -0700 PDT FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} } {kubelet Update v1 2022-04-28 10:43:01 -0700 PDT FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:csi.volume.kubernetes.io/nodeid":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.gke.io/zone":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} }]},Spec:NodeSpec{PodCIDR:10.88.1.0/24,DoNotUseExternalID:,ProviderID:gce://tallclair-gke-dev/us-west1-a/gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xvv1,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.88.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101241290752 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4126031872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{15 0} {<nil>} 15 DecimalSI},cpu: {{940 -3} {<nil>} 940m DecimalSI},ephemeral-storage: {{47093746742 0} {<nil>} 47093746742 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{2952675328 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2022-04-29 17:11:13 -0700 PDT,LastTransitionTime:2022-04-28 10:42:40 -0700 PDT,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2022-04-29 17:11:13 -0700 PDT,LastTransitionTime:2022-04-28 10:42:40 -0700 PDT,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2022-04-29 17:11:13 -0700 PDT,LastTransitionTime:2022-04-28 10:42:40 -0700 PDT,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2022-04-29 17:11:13 -0700 PDT,LastTransitionTime:2022-04-28 10:42:40 -0700 PDT,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2022-04-29 17:11:13 -0700 PDT,LastTransitionTime:2022-04-28 10:42:40 -0700 PDT,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2022-04-29 17:11:13 -0700 PDT,LastTransitionTime:2022-04-28 10:42:40 -0700 PDT,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2022-04-29 17:11:13 -0700 PDT,LastTransitionTime:2022-04-28 10:42:40 -0700 PDT,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2022-04-29 00:01:49 -0700 PDT,LastTransitionTime:2022-04-29 00:01:49 -0700 PDT,Reason:RouteCreated,Message:NodeController create implicit route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-04-29 17:11:11 -0700 PDT,LastTransitionTime:2022-04-28 10:42:19 -0700 PDT,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-04-29 17:11:11 -0700 PDT,LastTransitionTime:2022-04-28 10:42:19 -0700 PDT,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-04-29 17:11:11 -0700 PDT,LastTransitionTime:2022-04-28 10:42:19 -0700 PDT,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-04-29 17:11:11 -0700 PDT,LastTransitionTime:2022-04-28 10:42:36 -0700 PDT,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.47,},NodeAddress{Type:ExternalIP,Address:35.227.167.221,},NodeAddress{Type:InternalDNS,Address:gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xvv1.c.tallclair-gke-dev.internal,},NodeAddress{Type:Hostname,Address:gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xvv1.c.tallclair-gke-dev.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:b3bd57d8598ba36bd1ac228bab3eb5d1,SystemUUID:b3bd57d8-598b-a36b-d1ac-228bab3eb5d1,BootID:98c1ac3e-addf-4f22-943f-d6881acbf3ea,KernelVersion:5.4.170+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.4.8,KubeletVersion:v1.21.10-gke.2000,KubeProxyVersion:v1.21.10-gke.2000,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[k8s.gcr.io/kube-proxy-amd64:v1.21.10-gke.2000 gke.gcr.io/kube-proxy-amd64:v1.21.10-gke.2000],SizeBytes:107473607,},ContainerImage{Names:[gke.gcr.io/gcp-compute-persistent-disk-csi-driver@sha256:8522f566bd85b0c5cfd8e74a8223ada66bd774c8279b5242903bf796b141b493 gke.gcr.io/gcp-compute-persistent-disk-csi-driver:v1.3.6-gke.0],SizeBytes:70071363,},ContainerImage{Names:[gke.gcr.io/gke-metrics-agent@sha256:e595c92cfa77638c7745a6dcec3eda59eba39874480f02d1f2ec5d9353fbac4f gke.gcr.io/gke-metrics-agent:1.2.0-gke.1],SizeBytes:44619127,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:c5e12680a431990d5e39ed249dcb43a7672e99f7ef94a9928be40cf2f418f62f gke.gcr.io/prometheus-to-sd:v0.10.0-gke.0],SizeBytes:44144056,},ContainerImage{Names:[gke.gcr.io/k8s-dns-kube-dns@sha256:b5dd662f1a366bbc034954dcc66beb2a5009a78982479f2b7ab7d431b12efb3f gke.gcr.io/k8s-dns-kube-dns:1.21.0-gke.0],SizeBytes:43012814,},ContainerImage{Names:[gke.gcr.io/k8s-dns-sidecar@sha256:6a175b4ddbff9d87551437c481581f7c26444ff678ddf98d16bb458df75e0eb8 gke.gcr.io/k8s-dns-sidecar:1.21.0-gke.0],SizeBytes:41007040,},ContainerImage{Names:[gke.gcr.io/k8s-dns-dnsmasq-nanny@sha256:64b131898a7aead50510baa425a0525aa71b2b2733ea0352e50ccdebad682720 gke.gcr.io/k8s-dns-dnsmasq-nanny:1.21.0-gke.0],SizeBytes:40101539,},ContainerImage{Names:[gke.gcr.io/fluent-bit@sha256:6f0313fb1b2c77ccd883f20348c63c7b4caca4f53658bd9a7043676db154beb2 gke.gcr.io/fluent-bit:v1.5.7-gke.2],SizeBytes:37858868,},ContainerImage{Names:[gke.gcr.io/event-exporter@sha256:09e908d7ea0020f47cc1279caef6ce1b4d0cdebb9c9493b8550aace1d3c82c7c gke.gcr.io/event-exporter:v0.3.5-gke.0],SizeBytes:37797281,},ContainerImage{Names:[gcr.io/gke-release/metrics-server-amd64@sha256:6e4907f3b45db9408f2e99414e8da18d9400948abd747d6519ad7d69d8136785 gcr.io/gke-release/metrics-server-amd64:v0.4.5-gke.0],SizeBytes:25341240,},ContainerImage{Names:[gke.gcr.io/fluent-bit-gke-exporter@sha256:8c0d4d150bc42636d1449c810b808417352f5418e2d63c8f12833d9db2238e21 gke.gcr.io/fluent-bit-gke-exporter:v0.17.1-gke.0],SizeBytes:19656006,},ContainerImage{Names:[gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64@sha256:3b600d2d5eafa6d5fcedbd783b28694af3f7dd470f3580e83200244fab32b35e eu.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64@sha256:3b600d2d5eafa6d5fcedbd783b28694af3f7dd470f3580e83200244fab32b35e asia.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64@sha256:3b600d2d5eafa6d5fcedbd783b28694af3f7dd470f3580e83200244fab32b35e asia.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64:1.8.1-gke.0 eu.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64:1.8.1-gke.0],SizeBytes:16833220,},ContainerImage{Names:[gke.gcr.io/cluster-proportional-autoscaler@sha256:0f232ba18b63363e33f205d0242ef98324fb388434f8598c2fc8e967dca146bc gke.gcr.io/cluster-proportional-autoscaler:1.8.4-gke.1],SizeBytes:16831440,},ContainerImage{Names:[gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64@sha256:e3f48b3d1e49cfa3e7f002020769c9cd01cd0e77bbc99dc133c7ab0f8097e989 eu.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64@sha256:e3f48b3d1e49cfa3e7f002020769c9cd01cd0e77bbc99dc133c7ab0f8097e989 asia.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64@sha256:e3f48b3d1e49cfa3e7f002020769c9cd01cd0e77bbc99dc133c7ab0f8097e989 eu.gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64:1.7.1-gke.0 gcr.io/gke-release-staging/cluster-proportional-autoscaler-amd64:1.7.1-gke.0],SizeBytes:16572417,},ContainerImage{Names:[asia.gcr.io/gke-release-staging/cpvpa-amd64@sha256:b802d79f207ea9cbc996cc208781ea34715fe796be68e5250da37b2ae73d42a6 gcr.io/gke-release-staging/cpvpa-amd64@sha256:b802d79f207ea9cbc996cc208781ea34715fe796be68e5250da37b2ae73d42a6 eu.gcr.io/gke-release-staging/cpvpa-amd64@sha256:b802d79f207ea9cbc996cc208781ea34715fe796be68e5250da37b2ae73d42a6 gcr.io/gke-release-staging/cpvpa-amd64:v0.8.3-gke.0 asia.gcr.io/gke-release-staging/cpvpa-amd64:v0.8.3-gke.0],SizeBytes:16376177,},ContainerImage{Names:[eu.gcr.io/gke-release-staging/addon-resizer@sha256:e595f19b1661c38d89ec46cd1b57a8220db0e8aca336de60a4c06305174710d9 gcr.io/gke-release-staging/addon-resizer@sha256:e595f19b1661c38d89ec46cd1b57a8220db0e8aca336de60a4c06305174710d9 asia.gcr.io/gke-release-staging/addon-resizer@sha256:e595f19b1661c38d89ec46cd1b57a8220db0e8aca336de60a4c06305174710d9 gcr.io/gke-release-staging/addon-resizer:1.8.13-gke.0 eu.gcr.io/gke-release-staging/addon-resizer:1.8.13-gke.0],SizeBytes:9654882,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:1d49fb3b108e6b42542e4a9b056dee308f06f88824326cde1636eea0472b799d k8s.gcr.io/prometheus-to-sd:v0.7.2],SizeBytes:9588954,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:aca8ef83a7fae83f1f8583e978dd4d1ff655b9f2ca0a76bda5edce6d8965bdf2 gke.gcr.io/prometheus-to-sd:v0.4.2],SizeBytes:9515926,},ContainerImage{Names:[k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e k8s.gcr.io/prometheus-to-sd:v0.5.0],SizeBytes:9515805,},ContainerImage{Names:[gke.gcr.io/proxy-agent@sha256:4137776b74c8e09396405d46bdf7ef045e9ca343fab1fe0bb97686eb5d596613 gke.gcr.io/proxy-agent:v0.0.24-gke.2],SizeBytes:9505027,},ContainerImage{Names:[gke.gcr.io/csi-node-driver-registrar@sha256:6be94ad46be5488c783bf03237cbd21cc03a1a679fe9d039c167082f6b866d51 gke.gcr.io/csi-node-driver-registrar:v2.1.0-gke.3],SizeBytes:8784992,},ContainerImage{Names:[gke.gcr.io/ingress-gce-404-server-with-metrics@sha256:6d47f258d5fc8ef4e32641972840509701b3689d249c36a4282acf9cd89e04f4 gke.gcr.io/ingress-gce-404-server-with-metrics:v1.13.4],SizeBytes:7645836,},ContainerImage{Names:[eu.gcr.io/google-containers/pause-amd64:3.0 gcr.io/google-containers/pause-amd64:3.0 asia.gcr.io/google-containers/pause-amd64:3.0],SizeBytes:312520,},ContainerImage{Names:[k8s.gcr.io/pause@sha256:927d98197ec1141a368550822d18fa1c60bdae27b78b0c004f705f548c07814f k8s.gcr.io/pause:3.2],SizeBytes:299513,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Apr 29 17:14:50.008: INFO:
Logging kubelet events for node gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xvv1
Apr 29 17:14:50.031: INFO:
Logging pods the kubelet thinks is on node gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xvv1
Apr 29 17:14:50.072: INFO: l7-default-backend-69fb9fd9f9-jvcpj started at 2022-04-28 10:42:40 -0700 PDT (0+1 container statuses recorded)
Apr 29 17:14:50.072: INFO: Container default-http-backend ready: true, restart count 0
Apr 29 17:14:50.072: INFO: kube-proxy-gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xvv1 started at 2022-04-28 10:40:44 -0700 PDT (0+1 container statuses recorded)
Apr 29 17:14:50.072: INFO: Container kube-proxy ready: true, restart count 0
Apr 29 17:14:50.072: INFO: gke-metrics-agent-hks79 started at 2022-04-28 10:42:36 -0700 PDT (0+1 container statuses recorded)
Apr 29 17:14:50.072: INFO: Container gke-metrics-agent ready: true, restart count 0
Apr 29 17:14:50.072: INFO: kube-dns-autoscaler-844c9d9448-d4mzq started at 2022-04-28 10:42:40 -0700 PDT (0+1 container statuses recorded)
Apr 29 17:14:50.072: INFO: Container autoscaler ready: true, restart count 0
Apr 29 17:14:50.072: INFO: kube-dns-697dc8fc8b-4v9bv started at 2022-04-28 10:42:40 -0700 PDT (0+4 container statuses recorded)
Apr 29 17:14:50.072: INFO: Container dnsmasq ready: true, restart count 0
Apr 29 17:14:50.072: INFO: Container kubedns ready: true, restart count 0
Apr 29 17:14:50.072: INFO: Container prometheus-to-sd ready: true, restart count 0
Apr 29 17:14:50.072: INFO: Container sidecar ready: true, restart count 0
Apr 29 17:14:50.072: INFO: konnectivity-agent-autoscaler-6849fff748-wnlfs started at 2022-04-28 10:42:40 -0700 PDT (0+1 container statuses recorded)
Apr 29 17:14:50.072: INFO: Container autoscaler ready: true, restart count 0
Apr 29 17:14:50.072: INFO: event-exporter-gke-5479fd58c8-jg7sm started at 2022-04-28 10:42:40 -0700 PDT (0+2 container statuses recorded)
Apr 29 17:14:50.072: INFO: Container event-exporter ready: true, restart count 0
Apr 29 17:14:50.072: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0
Apr 29 17:14:50.072: INFO: fluentbit-gke-hpwzr started at 2022-04-28 10:42:36 -0700 PDT (0+2 container statuses recorded)
Apr 29 17:14:50.072: INFO: Container fluentbit ready: true, restart count 0
Apr 29 17:14:50.072: INFO: Container fluentbit-gke ready: true, restart count 0
Apr 29 17:14:50.072: INFO: pdcsi-node-69kpb started at 2022-04-28 10:42:37 -0700 PDT (0+2 container statuses recorded)
Apr 29 17:14:50.072: INFO: Container csi-driver-registrar ready: true, restart count 0
Apr 29 17:14:50.072: INFO: Container gce-pd-driver ready: true, restart count 0
Apr 29 17:14:50.072: INFO: konnectivity-agent-bb4fc6f88-t89s8 started at 2022-04-28 10:42:40 -0700 PDT (0+1 container statuses recorded)
Apr 29 17:14:50.072: INFO: Container konnectivity-agent ready: true, restart count 0
Apr 29 17:14:50.072: INFO: kube-dns-697dc8fc8b-8qqp4 started at 2022-04-28 10:42:45 -0700 PDT (0+4 container statuses recorded)
Apr 29 17:14:50.072: INFO: Container dnsmasq ready: true, restart count 0
Apr 29 17:14:50.072: INFO: Container kubedns ready: true, restart count 0
Apr 29 17:14:50.072: INFO: Container prometheus-to-sd ready: true, restart count 0
Apr 29 17:14:50.072: INFO: Container sidecar ready: true, restart count 0
Apr 29 17:14:50.254: INFO:
Latency metrics for node gke-kt2-92da0400-cb67-44-default-pool-8bc1f77c-xvv1
Apr 29 17:14:50.254: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "pods-210" for this suite.
• Failure [21.449 seconds]
[sig-node] Pods
test/e2e/common/node/framework.go:23
[qrchzpyqsnrjcpuhznphqxrncph] Dummy test function: Pod Not Found [It]
test/e2e/common/node/pods.go:196
Apr 29 17:14:49.285: Unexpected error:
<*fmt.wrapError | 0xc002466720>: {
msg: "error while waiting for pod pods-210/does-not-exist to be not pending: pods \"does-not-exist\" not found",
err: {
ErrStatus: {
TypeMeta: {Kind: "", APIVersion: ""},
ListMeta: {
SelfLink: "",
ResourceVersion: "",
Continue: "",
RemainingItemCount: nil,
},
Status: "Failure",
Message: "pods \"does-not-exist\" not found",
Reason: "NotFound",
Details: {
Name: "does-not-exist",
Group: "",
Kind: "pods",
UID: "",
Causes: nil,
RetryAfterSeconds: 0,
},
Code: 404,
},
},
}
error while waiting for pod pods-210/does-not-exist to be not pending: pods "does-not-exist" not found
occurred
test/e2e/common/node/pods.go:197
------------------------------
{"msg":"FAILED [sig-node] Pods [qrchzpyqsnrjcpuhznphqxrncph] Dummy test function: Pod Not Found","total":2,"completed":0,"skipped":5580,"failed":2,"failures":["[sig-node] Pods [qrchzpyqsnrjcpuhznphqxrncph] Dummy test function: Unschedulable","[sig-node] Pods [qrchzpyqsnrjcpuhznphqxrncph] Dummy test function: Pod Not Found"]}
SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSApr 29 17:14:50.343: INFO: Running AfterSuite actions on all nodes
Apr 29 17:14:50.343: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func19.2
Apr 29 17:14:50.343: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func9.2
Apr 29 17:14:50.343: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func8.2
Apr 29 17:14:50.343: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage/vsphere.glob..func17.3
Apr 29 17:14:50.343: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage/vsphere.glob..func9.2
Apr 29 17:14:50.343: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage/vsphere.glob..func4.2
Apr 29 17:14:50.343: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage/vsphere.glob..func1.3
Apr 29 17:14:50.343: INFO: Running AfterSuite actions on node 1
{"msg":"Test Suite completed","total":2,"completed":0,"skipped":6965,"failed":2,"failures":["[sig-node] Pods [qrchzpyqsnrjcpuhznphqxrncph] Dummy test function: Unschedulable","[sig-node] Pods [qrchzpyqsnrjcpuhznphqxrncph] Dummy test function: Pod Not Found"]}
Summarizing 2 Failures:
[Fail] [sig-node] Pods [It] [qrchzpyqsnrjcpuhznphqxrncph] Dummy test function: Unschedulable
test/e2e/common/node/pods.go:216
[Fail] [sig-node] Pods [It] [qrchzpyqsnrjcpuhznphqxrncph] Dummy test function: Pod Not Found
test/e2e/common/node/pods.go:197
Ran 2 of 6967 Specs in 44.649 seconds
FAIL! -- 0 Passed | 2 Failed | 0 Pending | 6965 Skipped
--- FAIL: TestE2E (45.44s)
FAIL
Ginkgo ran 1 suite in 45.592986665s
Test Suite Failed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment