Skip to content

Instantly share code, notes, and snippets.

@smarterclayton
Created December 27, 2018 18:20
Show Gist options
  • Save smarterclayton/053d1e8dd10ff582d1e4ff20d8021ad2 to your computer and use it in GitHub Desktop.
Save smarterclayton/053d1e8dd10ff582d1e4ff20d8021ad2 to your computer and use it in GitHub Desktop.
Rough timeline of pod start
NAMESPACE NAME READY STATUS RESTARTS AGE
openshift-cluster-kube-apiserver-operator openshift-cluster-kube-apiserver-operator-5c44566d56-hz5s7 1/1 Running 1 33m
openshift-cluster-kube-scheduler-operator openshift-cluster-kube-scheduler-operator-5bfd6877d6-96sk7 1/1 Running 0 33m
openshift-cluster-kube-controller-manager-operator openshift-cluster-kube-controller-manager-operator-6c496f7w5p9r 1/1 Running 0 33m
openshift-cluster-openshift-apiserver-operator openshift-cluster-openshift-apiserver-operator-845b8c9b57-pjxjt 1/1 Running 1 33m
openshift-dns-operator dns-operator-9b99c5887-d2zkd 1/1 Running 0 33m
openshift-core-operators openshift-service-cert-signer-operator-7df87bf9b4-6bvd4 1/1 Running 0 33m
openshift-core-operators origin-cluster-osin-operator2-697b68b5c4-q9ncl 1/1 Running 4 33m
openshift-cluster-openshift-controller-manager-operator openshift-cluster-openshift-controller-manager-operator-5756gnv 1/1 Running 0 33m
openshift-core-operators origin-cluster-osin-operator-6f67b69bfd-wtlzr 1/1 Running 0 33m
openshift-cluster-version cluster-version-operator-998dc55cf-9bx5g 1/1 Running 0 33m
openshift-cluster-network-operator cluster-network-operator-tsp2h 1/1 Running 0 33m
openshift-cluster-network-operator cluster-network-operator-9rxw9 1/1 Running 0 33m
openshift-operator-lifecycle-manager catalog-operator-7d5c85c7bf-mbpvk 1/1 Running 0 33m
openshift-operator-lifecycle-manager olm-operator-57c569f758-vfv2l 1/1 Running 0 33m
openshift-cluster-network-operator cluster-network-operator-8wf6q 1/1 Running 0 33m
openshift-cluster-api cluster-autoscaler-operator-67b954cd94-wb442 1/1 Running 0 33m
openshift-cluster-api machine-api-operator-5b474d94b7-99cmw 1/1 Running 0 33m
openshift-machine-config-operator machine-config-operator-5695ff5d47-xpq2h 1/1 Running 0 33m
openshift-cluster-machine-approver machine-approver-59bc987855-j9lhg 1/1 Running 0 33m
openshift-sdn ovs-2rsgq 1/1 Running 0 33m
openshift-sdn ovs-l9kq7 1/1 Running 0 33m
openshift-sdn sdn-controller-p5xc2 1/1 Running 0 33m
openshift-sdn sdn-controller-hdj2k 1/1 Running 0 33m
openshift-sdn ovs-bszj9 1/1 Running 0 33m
openshift-sdn sdn-controller-zwgm5 1/1 Running 0 33m
openshift-sdn sdn-s5zzm 1/1 Running 0 33m
openshift-sdn sdn-7v4wg 1/1 Running 0 33m
openshift-sdn sdn-kqdtl 1/1 Running 0 33m
kube-system etcd-member-ip-10-0-33-43.ec2.internal 1/1 Running 0 32m
kube-system etcd-member-ip-10-0-12-206.ec2.internal 1/1 Running 0 32m
kube-system etcd-member-ip-10-0-30-101.ec2.internal 1/1 Running 0 32m
openshift-dns dns-default-g27zs 2/2 Running 0 31m
openshift-dns dns-default-zv48s 2/2 Running 0 31m
openshift-dns dns-default-lptd4 2/2 Running 0 31m
openshift-machine-config-operator machine-config-controller-55fcd8945d-xb4h6 1/1 Running 0 30m
openshift-cluster-api clusterapi-manager-controllers-7dd649d6b-5vwcq 4/4 Running 0 30m
openshift-service-cert-signer service-serving-cert-signer-c44bff5fc-q6zf7 1/1 Running 0 30m
openshift-service-cert-signer apiservice-cabundle-injector-778778fd75-f7pkx 1/1 Running 0 30m
openshift-kube-scheduler installer-1-ip-10-0-33-43.ec2.internal 0/1 Completed 0 30m
openshift-service-cert-signer configmap-cabundle-injector-7449dcf778-wzs9z 1/1 Running 0 30m
openshift-machine-config-operator machine-config-server-l85ww 1/1 Running 0 30m
openshift-machine-config-operator machine-config-server-jqdz9 1/1 Running 0 30m
openshift-machine-config-operator machine-config-server-lwl26 1/1 Running 0 30m
openshift-kube-apiserver installer-1-ip-10-0-12-206.ec2.internal 0/1 Completed 0 30m
openshift-kube-scheduler openshift-kube-scheduler-ip-10-0-33-43.ec2.internal 1/1 Running 0 30m
openshift-machine-config-operator machine-config-daemon-s8l47 1/1 Running 0 30m
openshift-machine-config-operator machine-config-daemon-wxfbj 1/1 Running 0 30m
openshift-machine-config-operator machine-config-daemon-nhp9t 1/1 Running 0 30m
openshift-operator-lifecycle-manager certified-operators-mbvrl 1/1 Running 0 30m
openshift-kube-controller-manager installer-1-ip-10-0-30-101.ec2.internal 0/1 Completed 0 30m
openshift-operator-lifecycle-manager rh-operators-pb7dg 1/1 Running 0 30m
openshift-operator-lifecycle-manager olm-operators-k9jdc 1/1 Running 0 30m
openshift-kube-controller-manager openshift-kube-controller-manager-ip-10-0-30-101.ec2.internal 1/1 Running 0 30m
openshift-kube-apiserver installer-2-ip-10-0-12-206.ec2.internal 0/1 Completed 0 30m
openshift-operator-lifecycle-manager packageserver-657699878d-jz4nq 1/1 Running 0 30m
openshift-kube-controller-manager installer-1-ip-10-0-33-43.ec2.internal 0/1 Completed 0 29m
openshift-kube-apiserver installer-2-ip-10-0-30-101.ec2.internal 0/1 Completed 0 29m
openshift-kube-controller-manager openshift-kube-controller-manager-ip-10-0-33-43.ec2.internal 1/1 Running 0 29m
openshift-sdn ovs-2rwxh 1/1 Running 0 29m
openshift-sdn sdn-g8hg9 1/1 Running 0 29m
openshift-machine-config-operator machine-config-daemon-8wl4c 1/1 Running 0 29m
openshift-dns dns-default-r77bg 2/2 Running 0 29m
openshift-sdn ovs-rwv97 1/1 Running 0 29m
openshift-kube-controller-manager installer-1-ip-10-0-12-206.ec2.internal 0/1 Completed 0 29m
openshift-sdn sdn-wsskg 1/1 Running 0 29m
openshift-machine-config-operator machine-config-daemon-k4w55 1/1 Running 0 29m
openshift-dns dns-default-h82v2 2/2 Running 0 29m
openshift-dns dns-default-xtj2b 2/2 Running 0 29m
openshift-machine-config-operator machine-config-daemon-pw4m5 1/1 Running 0 29m
openshift-sdn sdn-7r4n5 1/1 Running 0 29m
openshift-sdn ovs-9qkc6 1/1 Running 0 29m
openshift-kube-controller-manager openshift-kube-controller-manager-ip-10-0-12-206.ec2.internal 1/1 Running 0 29m
openshift-kube-scheduler installer-1-ip-10-0-12-206.ec2.internal 0/1 Completed 0 29m
openshift-kube-apiserver installer-2-ip-10-0-33-43.ec2.internal 0/1 Completed 0 29m
openshift-kube-scheduler openshift-kube-scheduler-ip-10-0-12-206.ec2.internal 1/1 Running 0 28m
openshift-kube-scheduler installer-1-ip-10-0-30-101.ec2.internal 0/1 OOMKilled 0 28m
openshift-kube-scheduler openshift-kube-scheduler-ip-10-0-30-101.ec2.internal 1/1 Running 0 28m
openshift-image-registry cluster-image-registry-operator-856b88cbdb-rvs5c 1/1 Running 0 27m
openshift-image-registry registry-ca-hostmapper-qb8wz 1/1 Running 0 27m
openshift-image-registry registry-ca-hostmapper-ngw6n 1/1 Running 0 27m
openshift-image-registry registry-ca-hostmapper-m6h8d 1/1 Running 0 27m
openshift-image-registry registry-ca-hostmapper-lk6fk 1/1 Running 0 27m
openshift-image-registry registry-ca-hostmapper-fx5w4 1/1 Running 0 27m
openshift-image-registry registry-ca-hostmapper-k6nh6 1/1 Running 0 27m
openshift-monitoring cluster-monitoring-operator-56db7f6d97-wd7bd 1/1 Running 0 27m
openshift-ingress-operator ingress-operator-694bd9bf8d-52njj 1/1 Running 0 27m
openshift-cluster-node-tuning-operator cluster-node-tuning-operator-76c84fc5f5-s6zdq 1/1 Running 0 27m
openshift-cluster-samples-operator cluster-samples-operator-784f74d486-xg9gj 1/1 Running 0 27m
openshift-cluster-storage-operator cluster-storage-operator-5d8d77976d-bq6kf 1/1 Running 0 27m
openshift-console console-operator-5d979b9854-fct6l 1/1 Running 0 27m
openshift-csi-operator csi-operator-6d644cdb5f-nlwgj 1/1 Running 0 27m
openshift-image-registry image-registry-5cc7c4f4fc-rzsfz 1/1 Running 0 27m
openshift-console openshift-console-5b88cf9649-h4xs2 1/1 Running 0 26m
openshift-console openshift-console-5b88cf9649-j5zmj 1/1 Running 0 26m
openshift-console openshift-console-5b88cf9649-wmnp7 1/1 Running 0 26m
openshift-cluster-node-tuning-operator tuned-b8tmq 1/1 Running 2 26m
openshift-cluster-node-tuning-operator tuned-cxjc9 1/1 Running 2 26m
openshift-cluster-node-tuning-operator tuned-p2ggp 1/1 Running 1 26m
openshift-cluster-node-tuning-operator tuned-t92zr 1/1 Running 1 26m
openshift-cluster-node-tuning-operator tuned-68rsp 1/1 Running 1 26m
openshift-cluster-node-tuning-operator tuned-twr6k 1/1 Running 1 26m
openshift-ingress router-default-b79dc5894-t77g4 1/1 Running 0 26m
openshift-monitoring prometheus-operator-7b5b4b567b-mnbb2 1/1 Running 0 26m
openshift-controller-manager controller-manager-58r2w 1/1 Running 0 26m
openshift-apiserver apiserver-7h7td 1/1 Running 0 26m
openshift-kube-apiserver installer-3-ip-10-0-12-206.ec2.internal 0/1 Completed 0 26m
openshift-apiserver apiserver-wsjnb 1/1 Running 0 26m
openshift-monitoring grafana-58456d859d-n8s7j 2/2 Running 0 26m
openshift-controller-manager controller-manager-2qgd4 1/1 Running 0 26m
openshift-kube-apiserver installer-4-ip-10-0-12-206.ec2.internal 0/1 Completed 0 26m
openshift-kube-apiserver openshift-kube-apiserver-ip-10-0-12-206.ec2.internal 1/1 Running 0 25m
openshift-apiserver apiserver-8htcf 1/1 Running 0 25m
openshift-kube-apiserver installer-4-ip-10-0-30-101.ec2.internal 0/1 Completed 0 25m
openshift-kube-apiserver openshift-kube-apiserver-ip-10-0-30-101.ec2.internal 1/1 Running 0 25m
openshift-controller-manager controller-manager-qbf49 1/1 Running 0 25m
openshift-monitoring prometheus-k8s-0 6/6 Running 1 25m
openshift-kube-apiserver installer-4-ip-10-0-33-43.ec2.internal 0/1 Completed 0 24m
openshift-kube-apiserver openshift-kube-apiserver-ip-10-0-33-43.ec2.internal 1/1 Running 0 24m
openshift-monitoring prometheus-k8s-1 6/6 Running 1 23m
openshift-monitoring alertmanager-main-0 3/3 Running 0 23m
openshift-monitoring alertmanager-main-1 3/3 Running 0 22m
openshift-monitoring alertmanager-main-2 3/3 Running 0 22m
openshift-monitoring node-exporter-nvz8s 2/2 Running 0 22m
openshift-monitoring node-exporter-w247k 2/2 Running 0 22m
openshift-monitoring node-exporter-gq66l 2/2 Running 0 22m
openshift-monitoring node-exporter-wzlmt 2/2 Running 0 22m
openshift-monitoring node-exporter-zrn8w 2/2 Running 0 22m
openshift-monitoring node-exporter-4nl84 2/2 Running 0 22m
openshift-monitoring kube-state-metrics-dcf7dc56d-hgwrb 3/3 Running 0 21m
openshift-monitoring prometheus-adapter-7fb498bdc-sbcvj 1/1 Running 0 21m
openshift-monitoring telemeter-client-747b776f55-gtqwg 3/3 Running 0 21m
@smarterclayton
Copy link
Author

Takes 3m for the first installer pod to succeed (scheduler). Seems really long?

Takes 9m for the last kube-apiserver pod to come up (that may be ok, although the dropouts we see while that is happening are not)

Takes 6m from the time the cluster monitoring operator is up for telemetry to start.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment