Skip to content

Instantly share code, notes, and snippets.

@ctrahey
Created January 28, 2021 03:35
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save ctrahey/797ce0707f3bc658f3b5e37a8096b767 to your computer and use it in GitHub Desktop.
Save ctrahey/797ce0707f3bc658f3b5e37a8096b767 to your computer and use it in GitHub Desktop.
log output for Linkerd install issue
15-MBP:~ christophertrahey$ k get pods -n linkerd
NAME READY STATUS RESTARTS AGE
alpine2 1/1 Terminating 0 28m
linkerd-controller-864657567f-pp5ml 1/2 Running 0 33m
linkerd-destination-7f7fc6bf8f-xpwz9 1/2 Running 0 33m
linkerd-grafana-54d58fcc87-lct2q 1/2 Running 0 33m
linkerd-identity-77cd7df8b6-g77df 2/2 Running 0 33m
linkerd-prometheus-578869b9f4-tgqrz 1/2 Running 0 33m
linkerd-proxy-injector-576c6c96dc-mqssd 1/2 Running 0 33m
linkerd-sp-validator-67cbdf694f-n5cpw 1/2 Running 0 33m
linkerd-tap-97f99c757-pjbnj 1/2 Running 0 33m
linkerd-web-7c44d5bdbb-ghxjw 1/2 Running 0 33m
15-MBP:~ christophertrahey$ k logs -n linkerd linkerd-controller-864657567f-pp5ml public-api
time="2021-01-28T03:00:12Z" level=info msg="running version stable-2.9.2"
time="2021-01-28T03:00:12Z" level=info msg="Using cluster domain: cluster.local"
time="2021-01-28T03:00:12Z" level=info msg="waiting for caches to sync"
time="2021-01-28T03:00:13Z" level=info msg="caches synced"
time="2021-01-28T03:00:13Z" level=info msg="starting admin server on :9995"
time="2021-01-28T03:00:13Z" level=info msg="starting HTTP server on :8085"
15-MBP:~ christophertrahey$ k logs -n linkerd linkerd-controller-864657567f-pp5ml linkerd-proxy
time="2021-01-28T03:00:14Z" level=info msg="running version stable-2.9.2"
[ 0.002540s] INFO ThreadId(01) linkerd2_proxy::rt: Using single-threaded proxy runtime
[ 0.004385s] INFO ThreadId(01) linkerd2_proxy: Admin interface on 0.0.0.0:4191
[ 0.004438s] INFO ThreadId(01) linkerd2_proxy: Inbound interface on 0.0.0.0:4143
[ 0.004451s] INFO ThreadId(01) linkerd2_proxy: Outbound interface on 127.0.0.1:4140
[ 0.004462s] INFO ThreadId(01) linkerd2_proxy: Tap interface on 0.0.0.0:4190
[ 0.004473s] INFO ThreadId(01) linkerd2_proxy: Local identity is linkerd-controller.linkerd.serviceaccount.identity.linkerd.cluster.local
[ 0.004497s] INFO ThreadId(01) linkerd2_proxy: Identity verified via linkerd-identity-headless.linkerd.svc.cluster.local:8080 (linkerd-identity.linkerd.serviceaccount.identity.linkerd.cluster.local)
[ 0.004511s] INFO ThreadId(01) linkerd2_proxy: Destinations resolved via linkerd-dst-headless.linkerd.svc.cluster.local:8086 (linkerd-destination.linkerd.serviceaccount.identity.linkerd.cluster.local)
[ 0.005161s] INFO ThreadId(01) outbound: linkerd2_app: listen.addr=127.0.0.1:4140 ingress_mode=false
[ 0.005360s] INFO ThreadId(01) inbound: linkerd2_app: listen.addr=0.0.0.0:4143
15-MBP:~ christophertrahey$ k describe pod -n linkerd linkerd-controller-864657567f-pp5ml
Name: linkerd-controller-864657567f-pp5ml
Namespace: linkerd
Priority: 0
Node: pi-05/10.4.10.5
Start Time: Wed, 27 Jan 2021 19:00:05 -0800
Labels: linkerd.io/control-plane-component=controller
linkerd.io/control-plane-ns=linkerd
linkerd.io/proxy-deployment=linkerd-controller
linkerd.io/workload-ns=linkerd
pod-template-hash=864657567f
Annotations: cni.projectcalico.org/podIP: 10.124.186.196/32
cni.projectcalico.org/podIPs: 10.124.186.196/32
linkerd.io/created-by: linkerd/cli stable-2.9.2
linkerd.io/identity-mode: default
linkerd.io/proxy-version: stable-2.9.2
Status: Running
IP: 10.124.186.196
IPs:
IP: 10.124.186.196
Controlled By: ReplicaSet/linkerd-controller-864657567f
Init Containers:
linkerd-init:
Container ID: containerd://559343a340dfc5dfea9937964d1ac1819d44347a970d188e97d1d4c392706111
Image: ghcr.io/linkerd/proxy-init:v1.3.6
Image ID: ghcr.io/linkerd/proxy-init@sha256:591d4f578a8c4431fc6343c8f2703338888865440f02f4cb44862a87c5557859
Port: <none>
Host Port: <none>
Args:
--incoming-proxy-port
4143
--outgoing-proxy-port
4140
--proxy-uid
2102
--inbound-ports-to-ignore
4190,4191,25,443,587,3306,11211
--outbound-ports-to-ignore
25,443,587,3306,11211
State: Terminated
Reason: Completed
Exit Code: 0
Started: Wed, 27 Jan 2021 19:00:08 -0800
Finished: Wed, 27 Jan 2021 19:00:09 -0800
Ready: True
Restart Count: 0
Limits:
cpu: 100m
memory: 50Mi
Requests:
cpu: 10m
memory: 10Mi
Environment: <none>
Mounts:
/run from linkerd-proxy-init-xtables-lock (rw)
/var/run/secrets/kubernetes.io/serviceaccount from linkerd-controller-token-7vxsj (ro)
Containers:
public-api:
Container ID: containerd://dd2e620cc77c8cfe559db501fa2ff2fc19550a1bf0423e2b70f424f320f1aa71
Image: ghcr.io/linkerd/controller:stable-2.9.2
Image ID: ghcr.io/linkerd/controller@sha256:ca199e87b9e754da32580827d4210f3a72862609ccff678ec93ad255910a8ba0
Ports: 8085/TCP, 9995/TCP
Host Ports: 0/TCP, 0/TCP
Args:
public-api
-destination-addr=linkerd-dst.linkerd.svc.cluster.local:8086
-controller-namespace=linkerd
-log-level=info
-cluster-domain=cluster.local
-prometheus-url=http://linkerd-prometheus.linkerd.svc.cluster.local:9090
State: Running
Started: Wed, 27 Jan 2021 19:00:12 -0800
Ready: True
Restart Count: 0
Liveness: http-get http://:9995/ping delay=10s timeout=1s period=10s #success=1 #failure=3
Readiness: http-get http://:9995/ready delay=0s timeout=1s period=10s #success=1 #failure=7
Environment: <none>
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from linkerd-controller-token-7vxsj (ro)
linkerd-proxy:
Container ID: containerd://41194536d02c77354d3a7c1265bcaf21adaca4c3f18ba42472c0fc9cf3a731f3
Image: ghcr.io/linkerd/proxy:stable-2.9.2
Image ID: ghcr.io/linkerd/proxy@sha256:9c5764fb6c865e72b11157f01e1470bc44bf22cc6322372c58e8d34ca3492e26
Ports: 4143/TCP, 4191/TCP
Host Ports: 0/TCP, 0/TCP
State: Running
Started: Wed, 27 Jan 2021 19:00:14 -0800
Ready: False
Restart Count: 0
Liveness: http-get http://:4191/live delay=10s timeout=1s period=10s #success=1 #failure=3
Readiness: http-get http://:4191/ready delay=2s timeout=1s period=10s #success=1 #failure=3
Environment:
LINKERD2_PROXY_LOG: warn,linkerd=info
LINKERD2_PROXY_LOG_FORMAT: plain
LINKERD2_PROXY_DESTINATION_SVC_ADDR: linkerd-dst-headless.linkerd.svc.cluster.local:8086
LINKERD2_PROXY_DESTINATION_PROFILE_NETWORKS: 10.0.0.0/8,100.64.0.0/10,172.16.0.0/12,192.168.0.0/16
LINKERD2_PROXY_INBOUND_CONNECT_TIMEOUT: 100ms
LINKERD2_PROXY_OUTBOUND_CONNECT_TIMEOUT: 1000ms
LINKERD2_PROXY_CONTROL_LISTEN_ADDR: 0.0.0.0:4190
LINKERD2_PROXY_ADMIN_LISTEN_ADDR: 0.0.0.0:4191
LINKERD2_PROXY_OUTBOUND_LISTEN_ADDR: 127.0.0.1:4140
LINKERD2_PROXY_INBOUND_LISTEN_ADDR: 0.0.0.0:4143
LINKERD2_PROXY_DESTINATION_PROFILE_SUFFIXES: svc.cluster.local.
LINKERD2_PROXY_INBOUND_ACCEPT_KEEPALIVE: 10000ms
LINKERD2_PROXY_OUTBOUND_CONNECT_KEEPALIVE: 10000ms
_pod_ns: linkerd (v1:metadata.namespace)
_pod_nodeName: (v1:spec.nodeName)
LINKERD2_PROXY_DESTINATION_CONTEXT: {"ns":"$(_pod_ns)", "nodeName":"$(_pod_nodeName)"}
LINKERD2_PROXY_IDENTITY_DIR: /var/run/linkerd/identity/end-entity
LINKERD2_PROXY_IDENTITY_TRUST_ANCHORS: -----BEGIN CERTIFICATE-----
MIIBhDCCASmgAwIBAgIBATAKBggqhkjOPQQDAjApMScwJQYDVQQDEx5pZGVudGl0
eS5saW5rZXJkLmNsdXN0ZXIubG9jYWwwHhcNMjEwMTI4MDI1OTQ4WhcNMjIwMTI4
MDMwMDA4WjApMScwJQYDVQQDEx5pZGVudGl0eS5saW5rZXJkLmNsdXN0ZXIubG9j
YWwwWTATBgcqhkjOPQIBBggqhkjOPQMBBwNCAAQJBWkrjm2vy9eU6PCnE65Hu5vf
+3fX9U7jyOzC6bAvf/HpYpPwz4kfI0QxGldPQnix8vd5H4z75S4Ini+xVzu4o0Iw
QDAOBgNVHQ8BAf8EBAMCAQYwHQYDVR0lBBYwFAYIKwYBBQUHAwEGCCsGAQUFBwMC
MA8GA1UdEwEB/wQFMAMBAf8wCgYIKoZIzj0EAwIDSQAwRgIhAIsVDG9yqS5ozvJc
6qZNU8D0qL6qBrxhx+oCMJdDj/MAAiEAnrfcUkVVBa9EvfKa7cak8eYrbyFDaMT/
qFhligOgg+g=
-----END CERTIFICATE-----
LINKERD2_PROXY_IDENTITY_TOKEN_FILE: /var/run/secrets/kubernetes.io/serviceaccount/token
LINKERD2_PROXY_IDENTITY_SVC_ADDR: linkerd-identity-headless.linkerd.svc.cluster.local:8080
_pod_sa: (v1:spec.serviceAccountName)
_l5d_ns: linkerd
_l5d_trustdomain: cluster.local
LINKERD2_PROXY_IDENTITY_LOCAL_NAME: $(_pod_sa).$(_pod_ns).serviceaccount.identity.$(_l5d_ns).$(_l5d_trustdomain)
LINKERD2_PROXY_IDENTITY_SVC_NAME: linkerd-identity.$(_l5d_ns).serviceaccount.identity.$(_l5d_ns).$(_l5d_trustdomain)
LINKERD2_PROXY_DESTINATION_SVC_NAME: linkerd-destination.$(_l5d_ns).serviceaccount.identity.$(_l5d_ns).$(_l5d_trustdomain)
LINKERD2_PROXY_TAP_SVC_NAME: linkerd-tap.$(_l5d_ns).serviceaccount.identity.$(_l5d_ns).$(_l5d_trustdomain)
Mounts:
/var/run/linkerd/identity/end-entity from linkerd-identity-end-entity (rw)
/var/run/secrets/kubernetes.io/serviceaccount from linkerd-controller-token-7vxsj (ro)
Conditions:
Type Status
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
linkerd-proxy-init-xtables-lock:
Type: EmptyDir (a temporary directory that shares a pod's lifetime)
Medium:
SizeLimit: <unset>
linkerd-identity-end-entity:
Type: EmptyDir (a temporary directory that shares a pod's lifetime)
Medium: Memory
SizeLimit: <unset>
linkerd-controller-token-7vxsj:
Type: Secret (a volume populated by a Secret)
SecretName: linkerd-controller-token-7vxsj
Optional: false
QoS Class: Burstable
Node-Selectors: beta.kubernetes.io/os=linux
Tolerations: node.kubernetes.io/not-ready:NoExecute for 300s
node.kubernetes.io/unreachable:NoExecute for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled <unknown> Successfully assigned linkerd/linkerd-controller-864657567f-pp5ml to pi-05
Normal Pulled 34m kubelet, pi-05 Container image "ghcr.io/linkerd/proxy-init:v1.3.6" already present on machine
Normal Created 34m kubelet, pi-05 Created container linkerd-init
Normal Started 34m kubelet, pi-05 Started container linkerd-init
Normal Pulled 34m kubelet, pi-05 Container image "ghcr.io/linkerd/controller:stable-2.9.2" already present on machine
Normal Created 34m kubelet, pi-05 Created container public-api
Normal Started 34m kubelet, pi-05 Started container public-api
Normal Pulled 34m kubelet, pi-05 Container image "ghcr.io/linkerd/proxy:stable-2.9.2" already present on machine
Normal Created 34m kubelet, pi-05 Created container linkerd-proxy
Normal Started 34m kubelet, pi-05 Started container linkerd-proxy
Warning Unhealthy 4m4s (x180 over 33m) kubelet, pi-05 Readiness probe failed: HTTP probe failed with statuscode: 503
15-MBP:~ christophertrahey$
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment