Skip to content

Instantly share code, notes, and snippets.

@chrisabrams
Created December 20, 2021 23:20
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save chrisabrams/87d2044e5a04f20a1571f4342b921961 to your computer and use it in GitHub Desktop.
Save chrisabrams/87d2044e5a04f20a1571f4342b921961 to your computer and use it in GitHub Desktop.
kubectl describe pod -n kube-system calico-node-mzd5x
Name: calico-node-mzd5x
Namespace: kube-system
Priority: 2000001000
Priority Class Name: system-node-critical
Node: node01/10.0.0.3
Start Time: Mon, 20 Dec 2021 23:08:40 +0000
Labels: controller-revision-hash=56dbff76cd
k8s-app=calico-node
pod-template-generation=2
Annotations: kubectl.kubernetes.io/restartedAt: 2021-12-20T23:08:31Z
scheduler.alpha.kubernetes.io/critical-pod:
Status: Running
IP: 10.0.0.3
IPs:
IP: 10.0.0.3
Controlled By: DaemonSet/calico-node
Init Containers:
upgrade-ipam:
Container ID: containerd://916cd094dbda42520bfde0a95ee5000e4cd8d1f6af5568d6210bac0db534d651
Image: docker.io/calico/cni:v3.19.1
Image ID: docker.io/calico/cni@sha256:f301171be0add870152483fcce71b28cafb8e910f61ff003032e9b1053b062c4
Port: <none>
Host Port: <none>
Command:
/opt/cni/bin/calico-ipam
-upgrade
State: Terminated
Reason: Completed
Exit Code: 0
Started: Mon, 20 Dec 2021 23:15:26 +0000
Finished: Mon, 20 Dec 2021 23:15:26 +0000
Ready: True
Restart Count: 0
Environment Variables from:
kubernetes-services-endpoint ConfigMap Optional: true
Environment:
KUBERNETES_NODE_NAME: (v1:spec.nodeName)
CALICO_NETWORKING_BACKEND: <set to the key 'calico_backend' of config map 'calico-config'> Optional: false
Mounts:
/host/opt/cni/bin from cni-bin-dir (rw)
/var/lib/cni/networks from host-local-net-dir (rw)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-l9tw4 (ro)
install-cni:
Container ID: containerd://d5ce531532f6bb3c386987502401496bec3c7e90c8da1523d6d8484a2368435d
Image: docker.io/calico/cni:v3.19.1
Image ID: docker.io/calico/cni@sha256:f301171be0add870152483fcce71b28cafb8e910f61ff003032e9b1053b062c4
Port: <none>
Host Port: <none>
Command:
/opt/cni/bin/install
State: Terminated
Reason: Completed
Exit Code: 0
Started: Mon, 20 Dec 2021 23:15:30 +0000
Finished: Mon, 20 Dec 2021 23:15:37 +0000
Ready: True
Restart Count: 0
Environment Variables from:
kubernetes-services-endpoint ConfigMap Optional: true
Environment:
CNI_CONF_NAME: 10-calico.conflist
CNI_NETWORK_CONFIG: <set to the key 'cni_network_config' of config map 'calico-config'> Optional: false
KUBERNETES_NODE_NAME: (v1:spec.nodeName)
CNI_MTU: <set to the key 'veth_mtu' of config map 'calico-config'> Optional: false
SLEEP: false
CNI_NET_DIR: /var/snap/microk8s/current/args/cni-network
Mounts:
/host/etc/cni/net.d from cni-net-dir (rw)
/host/opt/cni/bin from cni-bin-dir (rw)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-l9tw4 (ro)
flexvol-driver:
Container ID: containerd://34741d687367816686a04da39cb0b5173cbe78a9269a83f309a01e26fa6910de
Image: docker.io/calico/pod2daemon-flexvol:v3.19.1
Image ID: docker.io/calico/pod2daemon-flexvol@sha256:bcac7dc4f1301b062d91a177a52d13716907636975c44131fb8350e7f851c944
Port: <none>
Host Port: <none>
State: Terminated
Reason: Completed
Exit Code: 0
Started: Mon, 20 Dec 2021 23:16:05 +0000
Finished: Mon, 20 Dec 2021 23:16:05 +0000
Ready: True
Restart Count: 0
Environment: <none>
Mounts:
/host/driver from flexvol-driver-host (rw)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-l9tw4 (ro)
Containers:
calico-node:
Container ID: containerd://a3c87123e1224319bf0753250b70aeade670cc066047b1273dc577fe9ea9329a
Image: docker.io/calico/node:v3.19.1
Image ID: docker.io/calico/node@sha256:bc4a631d553b38fdc169ea4cb8027fa894a656e80d68d513359a4b9d46836b55
Port: <none>
Host Port: <none>
State: Running
Started: Mon, 20 Dec 2021 23:16:28 +0000
Ready: True
Restart Count: 0
Requests:
cpu: 250m
Liveness: exec [/bin/calico-node -felix-live] delay=10s timeout=1s period=10s #success=1 #failure=6
Readiness: exec [/bin/calico-node -felix-ready] delay=0s timeout=1s period=10s #success=1 #failure=3
Environment Variables from:
kubernetes-services-endpoint ConfigMap Optional: true
Environment:
DATASTORE_TYPE: kubernetes
WAIT_FOR_DATASTORE: true
NODENAME: (v1:spec.nodeName)
CALICO_NETWORKING_BACKEND: <set to the key 'calico_backend' of config map 'calico-config'> Optional: false
CLUSTER_TYPE: k8s,bgp
IP: autodetect
IP_AUTODETECTION_METHOD: first-found
CALICO_IPV4POOL_VXLAN: Always
FELIX_IPINIPMTU: <set to the key 'veth_mtu' of config map 'calico-config'> Optional: false
FELIX_VXLANMTU: <set to the key 'veth_mtu' of config map 'calico-config'> Optional: false
FELIX_WIREGUARDMTU: <set to the key 'veth_mtu' of config map 'calico-config'> Optional: false
CALICO_IPV4POOL_CIDR: 10.1.0.0/16
CALICO_DISABLE_FILE_LOGGING: true
FELIX_DEFAULTENDPOINTTOHOSTACTION: ACCEPT
FELIX_IPV6SUPPORT: false
FELIX_LOGSEVERITYSCREEN: error
FELIX_HEALTHENABLED: true
Mounts:
/lib/modules from lib-modules (ro)
/run/xtables.lock from xtables-lock (rw)
/var/lib/calico from var-lib-calico (rw)
/var/run/calico from var-run-calico (rw)
/var/run/nodeagent from policysync (rw)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-l9tw4 (ro)
Conditions:
Type Status
Initialized True
Ready True
ContainersReady True
PodScheduled True
Volumes:
lib-modules:
Type: HostPath (bare host directory volume)
Path: /lib/modules
HostPathType:
var-run-calico:
Type: HostPath (bare host directory volume)
Path: /var/snap/microk8s/current/var/run/calico
HostPathType:
var-lib-calico:
Type: HostPath (bare host directory volume)
Path: /var/snap/microk8s/current/var/lib/calico
HostPathType:
xtables-lock:
Type: HostPath (bare host directory volume)
Path: /run/xtables.lock
HostPathType: FileOrCreate
cni-bin-dir:
Type: HostPath (bare host directory volume)
Path: /var/snap/microk8s/current/opt/cni/bin
HostPathType:
cni-net-dir:
Type: HostPath (bare host directory volume)
Path: /var/snap/microk8s/current/args/cni-network
HostPathType:
host-local-net-dir:
Type: HostPath (bare host directory volume)
Path: /var/snap/microk8s/current/var/lib/cni/networks
HostPathType:
policysync:
Type: HostPath (bare host directory volume)
Path: /var/snap/microk8s/current/var/run/nodeagent
HostPathType: DirectoryOrCreate
flexvol-driver-host:
Type: HostPath (bare host directory volume)
Path: /usr/libexec/kubernetes/kubelet-plugins/volume/exec/nodeagent~uds
HostPathType: DirectoryOrCreate
kube-api-access-l9tw4:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
QoS Class: Burstable
Node-Selectors: kubernetes.io/os=linux
Tolerations: :NoSchedule op=Exists
:NoExecute op=Exists
CriticalAddonsOnly op=Exists
node.kubernetes.io/disk-pressure:NoSchedule op=Exists
node.kubernetes.io/memory-pressure:NoSchedule op=Exists
node.kubernetes.io/network-unavailable:NoSchedule op=Exists
node.kubernetes.io/not-ready:NoExecute op=Exists
node.kubernetes.io/pid-pressure:NoSchedule op=Exists
node.kubernetes.io/unreachable:NoExecute op=Exists
node.kubernetes.io/unschedulable:NoSchedule op=Exists
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 11m default-scheduler Successfully assigned kube-system/calico-node-mzd5x to node01
Warning Failed 11m kubelet Failed to pull image "docker.io/calico/cni:v3.19.1": rpc error: code = Unknown desc = failed to pull and unpack image "docker.io/calico/cni:v3.19.1": failed to resolve reference "docker.io/calico/cni:v3.19.1": failed to authorize: failed to fetch anonymous token: unexpected status: 502 Bad Gateway
Normal Pulling 9m38s (x4 over 11m) kubelet Pulling image "docker.io/calico/cni:v3.19.1"
Warning Failed 9m37s (x3 over 10m) kubelet Failed to pull image "docker.io/calico/cni:v3.19.1": rpc error: code = Unknown desc = failed to pull and unpack image "docker.io/calico/cni:v3.19.1": failed to resolve reference "docker.io/calico/cni:v3.19.1": failed to authorize: failed to fetch anonymous token: unexpected status: 503 Service Unavailable
Warning Failed 9m37s (x4 over 11m) kubelet Error: ErrImagePull
Warning Failed 9m27s (x6 over 11m) kubelet Error: ImagePullBackOff
Normal BackOff 6m11s (x20 over 11m) kubelet Back-off pulling image "docker.io/calico/cni:v3.19.1"
Warning Failed 5m19s (x2 over 5m35s) kubelet Failed to pull image "docker.io/calico/cni:v3.19.1": rpc error: code = Unknown desc = failed to pull and unpack image "docker.io/calico/cni:v3.19.1": failed to resolve reference "docker.io/calico/cni:v3.19.1": failed to authorize: failed to fetch anonymous token: unexpected status: 503 Service Unavailable
Warning Failed 5m19s (x2 over 5m35s) kubelet Error: ErrImagePull
Normal BackOff 5m8s (x2 over 5m34s) kubelet Back-off pulling image "docker.io/calico/cni:v3.19.1"
Warning Failed 5m8s (x2 over 5m34s) kubelet Error: ImagePullBackOff
Normal Pulling 4m57s (x3 over 5m36s) kubelet Pulling image "docker.io/calico/cni:v3.19.1"
Normal Pulled 4m44s kubelet Successfully pulled image "docker.io/calico/cni:v3.19.1" in 13.479644419s
Normal Created 4m35s kubelet Created container upgrade-ipam
Normal Started 4m34s kubelet Started container upgrade-ipam
Normal Pulled 4m32s kubelet Container image "docker.io/calico/cni:v3.19.1" already present on machine
Normal Created 4m31s kubelet Created container install-cni
Normal Started 4m30s kubelet Started container install-cni
Warning Failed 4m18s kubelet Failed to pull image "docker.io/calico/pod2daemon-flexvol:v3.19.1": rpc error: code = Unknown desc = failed to pull and unpack image "docker.io/calico/pod2daemon-flexvol:v3.19.1": failed to resolve reference "docker.io/calico/pod2daemon-flexvol:v3.19.1": failed to authorize: failed to fetch anonymous token: unexpected status: 503 Service Unavailable
Warning Failed 4m18s kubelet Error: ErrImagePull
Normal Pulling 4m2s (x2 over 4m22s) kubelet Pulling image "docker.io/calico/pod2daemon-flexvol:v3.19.1"
Normal Pulled 3m58s kubelet Successfully pulled image "docker.io/calico/pod2daemon-flexvol:v3.19.1" in 4.072171688s
Normal Created 3m56s kubelet Created container flexvol-driver
Normal Started 3m55s kubelet Started container flexvol-driver
Normal Pulling 3m54s kubelet Pulling image "docker.io/calico/node:v3.19.1"
Warning Unhealthy 27s (x15 over 3m7s) kubelet Readiness probe failed: calico/node is not ready: felix is not ready: readiness probe reporting 503
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment