Skip to content

Instantly share code, notes, and snippets.

@rphillips

rphillips/gist:05c5593556e9b9ced007acb5f8e58026 Secret

Last active March 2, 2021 22:45
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save rphillips/05c5593556e9b9ced007acb5f8e58026 to your computer and use it in GitHub Desktop.
Save rphillips/05c5593556e9b9ced007acb5f8e58026 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
gistfile1.txt
┌Mar 02 09:56:39.530840 ip-10-0-190-53 hyperkube[1431]: I0302 09:56:39.530808 1431 kubelet.go:1920] SyncLoop (ADD, "file"): "kube-apiserver-ip-10-0-190-53.us-west-1.compute.internal_openshift-kube-apiserver(b47fadda-bd25-43c1-a0b8-a67aac895c2d)" ┤
│Mar 02 09:56:39.607029 ip-10-0-190-53 hyperkube[1431]: I0302 09:56:39.605649 1431 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "resource-dir" (UniqueName: "kubernetes.io/host-path/b47fadda-bd25-43c1-a0b8-a67aac895c2d-resource-dir") pod "kube-apiserver-ip-10-0-190-53.us-west-1.compute.internal" (UID: "b47fadda-bd25-43c1-a0b8-a67aac895c2d") ┤
│Mar 02 09:56:39.607029 ip-10-0-190-53 hyperkube[1431]: I0302 09:56:39.605734 1431 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "cert-dir" (UniqueName: "kubernetes.io/host-path/b47fadda-bd25-43c1-a0b8-a67aac895c2d-cert-dir") pod "kube-apiserver-ip-10-0-190-53.us-west-1.compute.internal" (UID: "b47fadda-bd25-43c1-a0b8-a67aac895c2d") ┤
│Mar 02 09:56:39.607029 ip-10-0-190-53 hyperkube[1431]: I0302 09:56:39.605761 1431 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "audit-dir" (UniqueName: "kubernetes.io/host-path/b47fadda-bd25-43c1-a0b8-a67aac895c2d-audit-dir") pod "kube-apiserver-ip-10-0-190-53.us-west-1.compute.internal" (UID: "b47fadda-bd25-43c1-a0b8-a67aac895c2d") ┤
│Mar 02 09:56:39.706294 ip-10-0-190-53 hyperkube[1431]: I0302 09:56:39.706262 1431 reconciler.go:269] operationExecutor.MountVolume started for volume "resource-dir" (UniqueName: "kubernetes.io/host-path/b47fadda-bd25-43c1-a0b8-a67aac895c2d-resource-dir") pod "kube-apiserver-ip-10-0-190-53.us-west-1.compute.internal" (UID: "b47fadda-bd25-43c1-a0b8-a67aac895c2d") ┤
│Mar 02 09:56:39.706294 ip-10-0-190-53 hyperkube[1431]: I0302 09:56:39.706308 1431 reconciler.go:269] operationExecutor.MountVolume started for volume "cert-dir" (UniqueName: "kubernetes.io/host-path/b47fadda-bd25-43c1-a0b8-a67aac895c2d-cert-dir") pod "kube-apiserver-ip-10-0-190-53.us-west-1.compute.internal" (UID: "b47fadda-bd25-43c1-a0b8-a67aac895c2d") ┤
│Mar 02 09:56:39.706652 ip-10-0-190-53 hyperkube[1431]: I0302 09:56:39.706333 1431 reconciler.go:269] operationExecutor.MountVolume started for volume "audit-dir" (UniqueName: "kubernetes.io/host-path/b47fadda-bd25-43c1-a0b8-a67aac895c2d-audit-dir") pod "kube-apiserver-ip-10-0-190-53.us-west-1.compute.internal" (UID: "b47fadda-bd25-43c1-a0b8-a67aac895c2d") ┤
│Mar 02 09:56:39.706652 ip-10-0-190-53 hyperkube[1431]: I0302 09:56:39.706452 1431 operation_generator.go:672] MountVolume.SetUp succeeded for volume "audit-dir" (UniqueName: "kubernetes.io/host-path/b47fadda-bd25-43c1-a0b8-a67aac895c2d-audit-dir") pod "kube-apiserver-ip-10-0-190-53.us-west-1.compute.internal" (UID: "b47fadda-bd25-43c1-a0b8-a67aac895c2d") ┤
│Mar 02 09:56:39.706652 ip-10-0-190-53 hyperkube[1431]: I0302 09:56:39.706495 1431 operation_generator.go:672] MountVolume.SetUp succeeded for volume "resource-dir" (UniqueName: "kubernetes.io/host-path/b47fadda-bd25-43c1-a0b8-a67aac895c2d-resource-dir") pod "kube-apiserver-ip-10-0-190-53.us-west-1.compute.internal" (UID: "b47fadda-bd25-43c1-a0b8-a67aac895c2d") ┤
│Mar 02 09:56:39.706652 ip-10-0-190-53 hyperkube[1431]: I0302 09:56:39.706523 1431 operation_generator.go:672] MountVolume.SetUp succeeded for volume "cert-dir" (UniqueName: "kubernetes.io/host-path/b47fadda-bd25-43c1-a0b8-a67aac895c2d-cert-dir") pod "kube-apiserver-ip-10-0-190-53.us-west-1.compute.internal" (UID: "b47fadda-bd25-43c1-a0b8-a67aac895c2d") ┤
│Mar 02 09:56:39.888623 ip-10-0-190-53 hyperkube[1431]: I0302 09:56:39.888594 1431 kuberuntime_manager.go:443] No sandbox for pod "kube-apiserver-ip-10-0-190-53.us-west-1.compute.internal_openshift-kube-apiserver(b47fadda-bd25-43c1-a0b8-a67aac895c2d)" can be found. Need to start a new one ┤
│Mar 02 09:56:50.423659 ip-10-0-190-53 hyperkube[1431]: I0302 09:56:50.423607 1431 kubelet.go:1958] SyncLoop (PLEG): "kube-apiserver-ip-10-0-190-53.us-west-1.compute.internal_openshift-kube-apiserver(b47fadda-bd25-43c1-a0b8-a67aac895c2d)", event: &pleg.PodLifecycleEvent{ID:"b47fadda-bd25-43c1-a0b8-a67aac895c2d", Type:"ContainerStarted", Data:"ed1398dbffbcc93b5c3e29805ae020fa8ac11ad2466b555b2c4825e0526d954d"} ┤
│Mar 02 09:56:51.429777 ip-10-0-190-53 hyperkube[1431]: I0302 09:56:51.429671 1431 kubelet.go:1958] SyncLoop (PLEG): "kube-apiserver-ip-10-0-190-53.us-west-1.compute.internal_openshift-kube-apiserver(b47fadda-bd25-43c1-a0b8-a67aac895c2d)", event: &pleg.PodLifecycleEvent{ID:"b47fadda-bd25-43c1-a0b8-a67aac895c2d", Type:"ContainerDied", Data:"d0730e3f8700df431e5c4dd2634786e3e7ec88a8afab756f0b97d25aee850162"} ┤
│Mar 02 09:56:52.481975 ip-10-0-190-53 hyperkube[1431]: I0302 09:56:52.481930 1431 kubelet.go:1958] SyncLoop (PLEG): "kube-apiserver-ip-10-0-190-53.us-west-1.compute.internal_openshift-kube-apiserver(b47fadda-bd25-43c1-a0b8-a67aac895c2d)", event: &pleg.PodLifecycleEvent{ID:"b47fadda-bd25-43c1-a0b8-a67aac895c2d", Type:"ContainerStarted", Data:"c226416052a8496b5dffc210b2f93c02eadca298434cec4fc5d42c38a2fa3bb2"} ┤
│Mar 02 09:56:53.599399 ip-10-0-190-53 hyperkube[1431]: I0302 09:56:53.595413 1431 kubelet.go:1958] SyncLoop (PLEG): "kube-apiserver-ip-10-0-190-53.us-west-1.compute.internal_openshift-kube-apiserver(b47fadda-bd25-43c1-a0b8-a67aac895c2d)", event: &pleg.PodLifecycleEvent{ID:"b47fadda-bd25-43c1-a0b8-a67aac895c2d", Type:"ContainerStarted", Data:"14847e736c8edd8c857c10765bc529e11678bba35a41494677db5928a42cea2f"} ┤
│Mar 02 09:56:53.599399 ip-10-0-190-53 hyperkube[1431]: I0302 09:56:53.595460 1431 kubelet.go:1958] SyncLoop (PLEG): "kube-apiserver-ip-10-0-190-53.us-west-1.compute.internal_openshift-kube-apiserver(b47fadda-bd25-43c1-a0b8-a67aac895c2d)", event: &pleg.PodLifecycleEvent{ID:"b47fadda-bd25-43c1-a0b8-a67aac895c2d", Type:"ContainerStarted", Data:"9466b981eb7070f1558dedf067fd35ca5588af4a1168cc60da2501fcb244f721"} ┤
│Mar 02 09:56:54.606534 ip-10-0-190-53 hyperkube[1431]: I0302 09:56:54.605486 1431 kubelet.go:1958] SyncLoop (PLEG): "kube-apiserver-ip-10-0-190-53.us-west-1.compute.internal_openshift-kube-apiserver(b47fadda-bd25-43c1-a0b8-a67aac895c2d)", event: &pleg.PodLifecycleEvent{ID:"b47fadda-bd25-43c1-a0b8-a67aac895c2d", Type:"ContainerStarted", Data:"0e85fa56e5912a8a8bcda62e9ad291d62d9eac386bb1ae12adb82f600e167f0c"} ┤
│Mar 02 09:56:54.606534 ip-10-0-190-53 hyperkube[1431]: I0302 09:56:54.605554 1431 kubelet.go:1958] SyncLoop (PLEG): "kube-apiserver-ip-10-0-190-53.us-west-1.compute.internal_openshift-kube-apiserver(b47fadda-bd25-43c1-a0b8-a67aac895c2d)", event: &pleg.PodLifecycleEvent{ID:"b47fadda-bd25-43c1-a0b8-a67aac895c2d", Type:"ContainerStarted", Data:"6ed4ae12f0c51ee54d378d8b6b25e0c1880985e93b10e4aaa5eedd28be208a1f"} ┤
│Mar 02 10:01:09.813865 ip-10-0-190-53 hyperkube[1431]: I0302 10:01:09.813657 1431 prober.go:117] Readiness probe for "kube-apiserver-ip-10-0-190-53.us-west-1.compute.internal_openshift-kube-apiserver(b47fadda-bd25-43c1-a0b8-a67aac895c2d):kube-apiserver" failed (failure): Get "https://10.0.190.53:6443/healthz": net/http: request canceled (Client.Timeout exceeded while awaiting headers) ┤
│Mar 02 10:01:10.736710 ip-10-0-190-53 hyperkube[1431]: I0302 10:01:10.736671 1431 prober.go:117] Liveness probe for "kube-apiserver-ip-10-0-190-53.us-west-1.compute.internal_openshift-kube-apiserver(b47fadda-bd25-43c1-a0b8-a67aac895c2d):kube-apiserver" failed (failure): Get "https://10.0.190.53:6443/healthz": net/http: request canceled (Client.Timeout exceeded while awaiting headers) ┤
│Mar 02 10:01:19.813952 ip-10-0-190-53 hyperkube[1431]: I0302 10:01:19.813918 1431 prober.go:117] Readiness probe for "kube-apiserver-ip-10-0-190-53.us-west-1.compute.internal_openshift-kube-apiserver(b47fadda-bd25-43c1-a0b8-a67aac895c2d):kube-apiserver" failed (failure): Get "https://10.0.190.53:6443/healthz": net/http: request canceled (Client.Timeout exceeded while awaiting headers) ┤
│Mar 02 10:01:20.737213 ip-10-0-190-53 hyperkube[1431]: I0302 10:01:20.737160 1431 prober.go:117] Liveness probe for "kube-apiserver-ip-10-0-190-53.us-west-1.compute.internal_openshift-kube-apiserver(b47fadda-bd25-43c1-a0b8-a67aac895c2d):kube-apiserver" failed (failure): Get "https://10.0.190.53:6443/healthz": net/http: request canceled (Client.Timeout exceeded while awaiting headers) ┤
│Mar 02 10:01:29.816403 ip-10-0-190-53 hyperkube[1431]: I0302 10:01:29.814924 1431 prober.go:117] Readiness probe for "kube-apiserver-ip-10-0-190-53.us-west-1.compute.internal_openshift-kube-apiserver(b47fadda-bd25-43c1-a0b8-a67aac895c2d):kube-apiserver" failed (failure): Get "https://10.0.190.53:6443/healthz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) ┤
│Mar 02 10:01:30.737489 ip-10-0-190-53 hyperkube[1431]: I0302 10:01:30.737438 1431 prober.go:117] Liveness probe for "kube-apiserver-ip-10-0-190-53.us-west-1.compute.internal_openshift-kube-apiserver(b47fadda-bd25-43c1-a0b8-a67aac895c2d):kube-apiserver" failed (failure): Get "https://10.0.190.53:6443/healthz": net/http: request canceled (Client.Timeout exceeded while awaiting headers) ┤
│Mar 02 10:01:30.737596 ip-10-0-190-53 hyperkube[1431]: I0302 10:01:30.737513 1431 kubelet.go:1991] SyncLoop (container unhealthy): "kube-apiserver-ip-10-0-190-53.us-west-1.compute.internal_openshift-kube-apiserver(b47fadda-bd25-43c1-a0b8-a67aac895c2d)" ┤
│Mar 02 10:01:30.738389 ip-10-0-190-53 hyperkube[1431]: I0302 10:01:30.738339 1431 kuberuntime_manager.go:660] Container "kube-apiserver" ({"cri-o" "c226416052a8496b5dffc210b2f93c02eadca298434cec4fc5d42c38a2fa3bb2"}) of pod kube-apiserver-ip-10-0-190-53.us-west-1.compute.internal_openshift-kube-apiserver(b47fadda-bd25-43c1-a0b8-a67aac895c2d): Container kube-apiserver failed liveness probe, will be restarted ┤
│Mar 02 10:01:31.535248 ip-10-0-190-53 hyperkube[1431]: I0302 10:01:31.535210 1431 kubelet.go:1958] SyncLoop (PLEG): "kube-apiserver-ip-10-0-190-53.us-west-1.compute.internal_openshift-kube-apiserver(b47fadda-bd25-43c1-a0b8-a67aac895c2d)", event: &pleg.PodLifecycleEvent{ID:"b47fadda-bd25-43c1-a0b8-a67aac895c2d", Type:"ContainerDied", Data:"14847e736c8edd8c857c10765bc529e11678bba35a41494677db5928a42cea2f"} ┤
│Mar 02 10:01:39.815398 ip-10-0-190-53 hyperkube[1431]: I0302 10:01:39.815263 1431 prober.go:117] Readiness probe for "kube-apiserver-ip-10-0-190-53.us-west-1.compute.internal_openshift-kube-apiserver(b47fadda-bd25-43c1-a0b8-a67aac895c2d):kube-apiserver" failed (failure): Get "https://10.0.190.53:6443/healthz": net/http: request canceled (Client.Timeout exceeded while awaiting headers) ┤
│Mar 02 10:01:49.816084 ip-10-0-190-53 hyperkube[1431]: I0302 10:01:49.815514 1431 prober.go:117] Readiness probe for "kube-apiserver-ip-10-0-190-53.us-west-1.compute.internal_openshift-kube-apiserver(b47fadda-bd25-43c1-a0b8-a67aac895c2d):kube-apiserver" failed (failure): Get "https://10.0.190.53:6443/healthz": net/http: request canceled (Client.Timeout exceeded while awaiting headers) ┤
│Mar 02 10:01:59.815847 ip-10-0-190-53 hyperkube[1431]: I0302 10:01:59.815802 1431 prober.go:117] Readiness probe for "kube-apiserver-ip-10-0-190-53.us-west-1.compute.internal_openshift-kube-apiserver(b47fadda-bd25-43c1-a0b8-a67aac895c2d):kube-apiserver" failed (failure): Get "https://10.0.190.53:6443/healthz": net/http: request canceled (Client.Timeout exceeded while awaiting headers) ┤
│Mar 02 10:03:09.813821 ip-10-0-190-53 hyperkube[1431]: I0302 10:03:09.813785 1431 prober.go:117] Readiness probe for "kube-apiserver-ip-10-0-190-53.us-west-1.compute.internal_openshift-kube-apiserver(b47fadda-bd25-43c1-a0b8-a67aac895c2d):kube-apiserver" failed (failure): Get "https://10.0.190.53:6443/healthz": dial tcp 10.0.190.53:6443: connect: connection refused ┤
│Mar 02 10:03:19.813813 ip-10-0-190-53 hyperkube[1431]: I0302 10:03:19.813778 1431 prober.go:117] Readiness probe for "kube-apiserver-ip-10-0-190-53.us-west-1.compute.internal_openshift-kube-apiserver(b47fadda-bd25-43c1-a0b8-a67aac895c2d):kube-apiserver" failed (failure): Get "https://10.0.190.53:6443/healthz": dial tcp 10.0.190.53:6443: connect: connection refused ┤
│Mar 02 10:03:29.813842 ip-10-0-190-53 hyperkube[1431]: I0302 10:03:29.813810 1431 prober.go:117] Readiness probe for "kube-apiserver-ip-10-0-190-53.us-west-1.compute.internal_openshift-kube-apiserver(b47fadda-bd25-43c1-a0b8-a67aac895c2d):kube-apiserver" failed (failure): Get "https://10.0.190.53:6443/healthz": dial tcp 10.0.190.53:6443: connect: connection refused ┤
│Mar 02 10:03:39.813840 ip-10-0-190-53 hyperkube[1431]: I0302 10:03:39.813808 1431 prober.go:117] Readiness probe for "kube-apiserver-ip-10-0-190-53.us-west-1.compute.internal_openshift-kube-apiserver(b47fadda-bd25-43c1-a0b8-a67aac895c2d):kube-apiserver" failed (failure): Get "https://10.0.190.53:6443/healthz": dial tcp 10.0.190.53:6443: connect: connection refused
Raw
gistfile2.txt
┌Mar 02 09:56:04.431399 ip-10-0-190-53 hyperkube[1431]: I0302 09:56:04.430806 1431 kubelet.go:1920] SyncLoop (ADD, "file"): "etcd-ip-10-0-190-53.us-west-1.compute.internal_openshift-etcd(3cbdb766-6913-480a-9a34-7a8c643b22c6)" │
│Mar 02 09:56:04.464649 ip-10-0-190-53 hyperkube[1431]: I0302 09:56:04.464626 1431 kubelet.go:1920] SyncLoop (ADD, "api"): "etcd-ip-10-0-190-53.us-west-1.compute.internal_openshift-etcd(76b91f00-1081-4232-8f85-35985c2b5d29)" │
│Mar 02 09:56:04.764270 ip-10-0-190-53 hyperkube[1431]: I0302 09:56:04.763839 1431 kuberuntime_manager.go:443] No sandbox for pod "etcd-ip-10-0-190-53.us-west-1.compute.internal_openshift-etcd(3cbdb766-6913-480a-9a34-7a8c643b22c6)" can be found. Need to start a new one │
│Mar 02 09:56:12.173058 ip-10-0-190-53 hyperkube[1431]: I0302 09:56:12.172166 1431 kubelet.go:1958] SyncLoop (PLEG): "etcd-ip-10-0-190-53.us-west-1.compute.internal_openshift-etcd(3cbdb766-6913-480a-9a34-7a8c643b22c6)", event: &pleg.PodLifecycleEvent{ID:"3cbdb766-6913-480a-9a34-7a8c643b22c6", Type:"ContainerStarted", Data:"ea7a2daca57b475275d2be8b10056925de68effe72ffc5a36b23779bb0dbea80"} │
│Mar 02 09:56:51.436559 ip-10-0-190-53 hyperkube[1431]: I0302 09:56:51.436527 1431 kubelet.go:1958] SyncLoop (PLEG): "etcd-ip-10-0-190-53.us-west-1.compute.internal_openshift-etcd(3cbdb766-6913-480a-9a34-7a8c643b22c6)", event: &pleg.PodLifecycleEvent{ID:"3cbdb766-6913-480a-9a34-7a8c643b22c6", Type:"ContainerDied", Data:"4632b87669428a8c08f8d1baeab9aba4723c131f3abda11a127649bf4105c5b0"} │
│Mar 02 09:56:52.467269 ip-10-0-190-53 hyperkube[1431]: I0302 09:56:52.467224 1431 kubelet.go:1958] SyncLoop (PLEG): "etcd-ip-10-0-190-53.us-west-1.compute.internal_openshift-etcd(3cbdb766-6913-480a-9a34-7a8c643b22c6)", event: &pleg.PodLifecycleEvent{ID:"3cbdb766-6913-480a-9a34-7a8c643b22c6", Type:"ContainerDied", Data:"4360e649a925311183dc592102dcdd687b4d1add974d8236e2cc732b07c7d74c"} │
│Mar 02 09:56:53.537555 ip-10-0-190-53 hyperkube[1431]: I0302 09:56:53.537119 1431 kubelet.go:1958] SyncLoop (PLEG): "etcd-ip-10-0-190-53.us-west-1.compute.internal_openshift-etcd(3cbdb766-6913-480a-9a34-7a8c643b22c6)", event: &pleg.PodLifecycleEvent{ID:"3cbdb766-6913-480a-9a34-7a8c643b22c6", Type:"ContainerStarted", Data:"2a33df045a1176871f262541e9075e1befdf23b61ac9b2a7a2d20af7ae0b3888"} │
│Mar 02 09:56:53.537555 ip-10-0-190-53 hyperkube[1431]: I0302 09:56:53.537184 1431 kubelet.go:1958] SyncLoop (PLEG): "etcd-ip-10-0-190-53.us-west-1.compute.internal_openshift-etcd(3cbdb766-6913-480a-9a34-7a8c643b22c6)", event: &pleg.PodLifecycleEvent{ID:"3cbdb766-6913-480a-9a34-7a8c643b22c6", Type:"ContainerStarted", Data:"d30888b058fa5fd6348cdc96d6f843498fdc0588090baca516067a9c1a101e1a"} │
│Mar 02 09:56:54.617925 ip-10-0-190-53 hyperkube[1431]: I0302 09:56:54.616976 1431 kubelet.go:1958] SyncLoop (PLEG): "etcd-ip-10-0-190-53.us-west-1.compute.internal_openshift-etcd(3cbdb766-6913-480a-9a34-7a8c643b22c6)", event: &pleg.PodLifecycleEvent{ID:"3cbdb766-6913-480a-9a34-7a8c643b22c6", Type:"ContainerStarted", Data:"8b51a8de1f77ed33a8595eed074275caa934e4e4e722bf83688f88dae327681a"} │
│Mar 02 09:56:57.569237 ip-10-0-190-53 hyperkube[1431]: I0302 09:56:57.569197 1431 prober.go:117] Readiness probe for "etcd-ip-10-0-190-53.us-west-1.compute.internal_openshift-etcd(3cbdb766-6913-480a-9a34-7a8c643b22c6):etcd" failed (failure): dial tcp 10.0.190.53:2380: connect: connection refused │
│Mar 02 10:00:51.608689 ip-10-0-190-53 hyperkube[1431]: I0302 10:00:51.608654 1431 kubelet.go:1930] SyncLoop (REMOVE, "file"): "etcd-ip-10-0-190-53.us-west-1.compute.internal_openshift-etcd(3cbdb766-6913-480a-9a34-7a8c643b22c6)" │
│Mar 02 10:00:51.610891 ip-10-0-190-53 hyperkube[1431]: I0302 10:00:51.610856 1431 kubelet.go:1920] SyncLoop (ADD, "file"): "etcd-ip-10-0-190-53.us-west-1.compute.internal_openshift-etcd(d7ee4294-ebe5-4ca5-a925-ab915e815430)"
@rphillips
Copy link
Author

https://prow.ci.openshift.org/view/gs/origin-ci-test/logs/promote-release-openshift-machine-os-content-e2e-aws-4.8/1366801481130315776

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment