Skip to content

Instantly share code, notes, and snippets.

@MeirP-3

MeirP-3/gist:f91ca9d5f382ecff1c2c327c9f4ddf01

Last active November 4, 2020 15:13
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save MeirP-3/f91ca9d5f382ecff1c2c327c9f4ddf01 to your computer and use it in GitHub Desktop.
Save MeirP-3/f91ca9d5f382ecff1c2c327c9f4ddf01 to your computer and use it in GitHub Desktop.
Download ZIP
log of rolling update --yes
Raw
gistfile1.txt
This file has been truncated, but you can view the full file.
I1104 15:54:48.294095 12586 featureflag.go:154] FeatureFlag "Spotinst"=true
I1104 15:54:48.343142 12586 loader.go:375] Config loaded from file: /home/meirp/.kube/config
Using cluster from kubectl context: example.com
I1104 15:54:48.343211 12586 factory.go:68] state store s3://example-dev-state/kops
I1104 15:54:48.343248 12586 s3context.go:328] unable to read /sys/devices/virtual/dmi/id/product_uuid, assuming not running on EC2: open /sys/devices/virtual/dmi/id/product_uuid: permission denied
I1104 15:54:49.913351 12586 s3context.go:163] unable to get region from metadata:unable to get region from metadata: EC2MetadataRequestError: failed to get EC2 instance identity document
caused by: RequestError: send request failed
caused by: Get http://169.254.169.254/latest/dynamic/instance-identity/document: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
I1104 15:54:49.913409 12586 s3context.go:173] defaulting region to "us-east-1"
I1104 15:54:51.671512 12586 s3context.go:213] found bucket in region "us-east-1"
I1104 15:54:51.671581 12586 s3fs.go:290] Reading file "s3://example-dev-state/kops/example.com/config"
I1104 15:54:52.383690 12586 loader.go:375] Config loaded from file: /home/meirp/.kube/config
I1104 15:54:52.388601 12586 round_trippers.go:423] curl -k -v -XGET -H "Authorization: Basic ******" -H "Accept: application/json, */*" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" 'https://api.example.com/api/v1/nodes'
I1104 15:54:53.246062 12586 round_trippers.go:443] GET https://api.example.com/api/v1/nodes 200 OK in 857 milliseconds
I1104 15:54:53.246128 12586 round_trippers.go:449] Response Headers:
I1104 15:54:53.246144 12586 round_trippers.go:452] Audit-Id: 2aea8756-e54a-4034-bd97-677a87505667
I1104 15:54:53.246155 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:54:53.246168 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:54:53 GMT
I1104 15:54:53.549266 12586 request.go:1068] Response Body: {"kind":"NodeList","apiVersion":"v1","metadata":{"selfLink":"/api/v1/nodes","resourceVersion":"45489042"},"items":[{"metadata":{"name":"ip-10-40-41-169.ec2.internal","selfLink":"/api/v1/nodes/ip-10-40-41-169.ec2.internal","uid":"507b5bdd-1ea0-11eb-9aff-16da7cad7b07","resourceVersion":"45488998","creationTimestamp":"2020-11-04T13:19:05Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/instance-type":"t3a.2xlarge","beta.kubernetes.io/os":"linux","dedicated":"algo","failure-domain.beta.kubernetes.io/region":"us-east-1","failure-domain.beta.kubernetes.io/zone":"us-east-1f","kops.k8s.io/instancegroup":"algo","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"ip-10-40-41-169.ec2.internal","kubernetes.io/os":"linux","kubernetes.io/role":"node","node-role.kubernetes.io/node":"","spotinst.io/node-lifecycle":"spot"},"annotations":{"node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"}},"spec":{"podCIDR":"100.96.115.0/24","providerID":"aws:///us-east-1f/i-0c8dfd269d1bffd81","taints":[{"key":"dedicated","value":"algo","effect":"NoSchedule"}]},"status":{"capacity":{"attachable-volumes-aws-ebs":"25","cpu":"8","ephemeral-storage":"130045936Ki","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"32665868Ki","pods":"58"},"allocatable":{"attachable-volumes-aws-ebs":"25","cpu":"8","ephemeral-storage":"119850334420","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"32563468Ki","pods":"58"},"conditions":[{"type":"MemoryPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:37Z","lastTransitionTime":"2020-11-04T13:19:05Z","reason":"KubeletHasSufficientMemory","message":"kubelet has sufficient memory available"},{"type":"DiskPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:37Z","lastTransitionTime":"2020-11-04T13:19:05Z","reason":"KubeletHasNoDiskPressure","message":"kubelet has no disk pressure"},{"type":"PIDPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:37Z","lastTransitionTime":"2020-11-04T13:19:05Z","reason":"KubeletHasSufficientPID","message":"kubelet has sufficient PID available"},{"type":"Ready","status":"True","lastHeartbeatTime":"2020-11-04T13:54:37Z","lastTransitionTime":"2020-11-04T13:19:55Z","reason":"KubeletReady","message":"kubelet is posting ready status. AppArmor enabled"}],"addresses":[{"type":"InternalIP","address":"10.40.41.169"},{"type":"InternalDNS","address":"ip-10-40-41-169.ec2.internal"},{"type":"Hostname","address":"ip-10-40-41-169.ec2.internal"}],"daemonEndpoints":{"kubeletEndpoint":{"Port":10250}},"nodeInfo":{"machineID":"ec2fd7328ad5220ca24cde06a441ae5a","systemUUID":"EC2FD732-8AD5-220C-A24C-DE06A441AE5A","bootID":"d8912c50-c519-4500-a536-1f43b0077e2b","kernelVersion":"4.15.0-1039-aws","osImage":"Ubuntu 18.04.2 LTS","containerRuntimeVersion":"docker://18.6.3","kubeletVersion":"v1.14.2","kubeProxyVersion":"v1.14.2","operatingSystem":"linux","architecture":"amd64"},"images":[{"names":["registry.example.com/cybervision/invu-algorithm-service@sha256:ec66013ab9c9e14369cd38501e09a399595a52f4b7424d9883d40009c12f705a","registry.example.com/cybervision/invu-algorithm-service:2.0.0-38065"],"sizeBytes":709056632},{"names":["602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni@sha256:a6d23b9fb3d4ba549321e32a28c42d8e79da203897072e93874472ab9e80b768","602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5"],"sizeBytes":263850871},{"names":["k8s.gcr.io/kube-proxy@sha256:c91687ff6145f7fcdc7d8b3da3c530a9a9b50f0734c7a945a0d9c18fc3790dbc","k8s.gcr.io/kube-proxy:v1.14.2"],"sizeBytes":82106236},{"names":["jtblin/kube2iam@sha256:92363f1c52fe5f433487b35c3f9c242e4733717ef7ac88c7137fc3824cfad4d3","jtblin/kube2iam:0.10.8"],"sizeBytes":34303129},{"names":["k8s.gcr.io/pause-amd64@sha256:4a1c4b21597c1b4415bdbecb28a3296c6b5e23ca4f9feeb599860a1dac6a0108","k8s.gcr.io/pause-amd64:3.2"],"sizeBytes":682696}]}},{"metadata":{"name":"ip-10-40-42-110.ec2.internal","selfLink":"/api/v1/nodes/ip-10-40-42-110.ec2.internal","uid":"3d99698f-1e9c-11eb-9aff-16da7cad7b07","resourceVersion":"45488977","creationTimestamp":"2020-11-04T12:49:56Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/instance-type":"m5a.xlarge","beta.kubernetes.io/os":"linux","failure-domain.beta.kubernetes.io/region":"us-east-1","failure-domain.beta.kubernetes.io/zone":"us-east-1f","kops.k8s.io/instancegroup":"nodes","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"ip-10-40-42-110.ec2.internal","kubernetes.io/os":"linux","kubernetes.io/role":"node","node-role.kubernetes.io/node":"","spotinst.io/node-lifecycle":"spot"},"annotations":{"node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"}},"spec":{"podCIDR":"100.96.114.0/24","providerID":"aws:///us-east-1f/i-0b738537410c47ce9"},"status":{"capacity":{"attachable-volumes-aws-ebs":"25","cpu":"4","ephemeral-storage":"130045936Ki","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"16038900Ki","pods":"58"},"allocatable":{"attachable-volumes-aws-ebs":"25","cpu":"4","ephemeral-storage":"119850334420","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"15936500Ki","pods":"58"},"conditions":[{"type":"MemoryPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:28Z","lastTransitionTime":"2020-11-04T12:49:56Z","reason":"KubeletHasSufficientMemory","message":"kubelet has sufficient memory available"},{"type":"DiskPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:28Z","lastTransitionTime":"2020-11-04T12:49:56Z","reason":"KubeletHasNoDiskPressure","message":"kubelet has no disk pressure"},{"type":"PIDPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:28Z","lastTransitionTime":"2020-11-04T12:49:56Z","reason":"KubeletHasSufficientPID","message":"kubelet has sufficient PID available"},{"type":"Ready","status":"True","lastHeartbeatTime":"2020-11-04T13:54:28Z","lastTransitionTime":"2020-11-04T12:50:16Z","reason":"KubeletReady","message":"kubelet is posting ready status. AppArmor enabled"}],"addresses":[{"type":"InternalIP","address":"10.40.42.110"},{"type":"InternalDNS","address":"ip-10-40-42-110.ec2.internal"},{"type":"Hostname","address":"ip-10-40-42-110.ec2.internal"}],"daemonEndpoints":{"kubeletEndpoint":{"Port":10250}},"nodeInfo":{"machineID":"ec2b9b820e177da80fbd1e4c85bbf31a","systemUUID":"EC2B9B82-0E17-7DA8-0FBD-1E4C85BBF31A","bootID":"ffffbb68-1815-42b8-bf09-86fce9b807c5","kernelVersion":"4.15.0-1039-aws","osImage":"Ubuntu 18.04.2 LTS","containerRuntimeVersion":"docker://18.6.3","kubeletVersion":"v1.14.2","kubeProxyVersion":"v1.14.2","operatingSystem":"linux","architecture":"amd64"},"images":[{"names":["registry.example.com/cybervision/pregsense-monitoring-session-service@sha256:eedc23e0c6848e90c6725ea2e0f821a9911a8651cdf964b48a818526c6154d99","registry.example.com/cybervision/pregsense-monitoring-session-service:2.0.0-37729"],"sizeBytes":916680232},{"names":["confluentinc/cp-ksql-server@sha256:a0b75d2f9926ac31139b2bebff3ac95a24e9f08465176aef16ed3c481b39a297","confluentinc/cp-ksql-server:5.2.2"],"sizeBytes":524657779},{"names":["registry.example.com/cybervision/pregsense-mail-service@sha256:633a2b3faf69477dfd745b83def6689077641309c1092121edb215bcfec06d8d","registry.example.com/cybervision/pregsense-mail-service:1.1.0-38167"],"sizeBytes":331982846},{"names":["registry.example.com/cybervision/pregsense-geo-service@sha256:9e44ea04116b0dad47c7774c04666e6a74de49e252ebd2b3f3d562ce63bf9bbc","registry.example.com/cybervision/pregsense-geo-service:2.0.0-37561"],"sizeBytes":298502628},{"names":["example/jmx-prometheus-httpserver@sha256:725e8a9bfec05f432b931edc11b1ee8bac3895e408bb91af58266dc88ee4e63b","example/jmx-prometheus-httpserver:0.11.0"],"sizeBytes":273954021},{"names":["registry.example.com/ce/middleware/kafka@sha256:5a13ea153f26ac29e73fd3a0ed67c701f33ea761a0b10a03870fdda51e3975cc","registry.example.com/ce/middleware/kafka:0.6.33"],"sizeBytes":269199283},{"names":["602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni@sha256:a6d23b9fb3d4ba549321e32a28c42d8e79da203897072e93874472ab9e80b768","602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5"],"sizeBytes":263850871},{"names":["registry.example.com/cybervision/invu-web/pro@sha256:4a75e40bc1774e59e805ff68e713542d6c839e54e550b21688f9b23ec401de28","registry.example.com/cybervision/invu-web/pro:2.0.0-38041"],"sizeBytes":107688818},{"names":["k8s.gcr.io/kube-proxy@sha256:c91687ff6145f7fcdc7d8b3da3c530a9a9b50f0734c7a945a0d9c18fc3790dbc","k8s.gcr.io/kube-proxy:v1.14.2"],"sizeBytes":82106236},{"names":["registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","registry.example.com/ce/utilities/mysql-client:latest"],"sizeBytes":38388577},{"names":["jtblin/kube2iam@sha256:92363f1c52fe5f433487b35c3f9c242e4733717ef7ac88c7137fc3824cfad4d3","jtblin/kube2iam:0.10.8"],"sizeBytes":34303129},{"names":["registry.example.com/ce/utilities/kt@sha256:a52550f941a9449ea205201f2c42d0352da5f70bf281d1d638944352781851b2","registry.example.com/ce/utilities/kt:latest"],"sizeBytes":22871156},{"names":["busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","busybox:latest"],"sizeBytes":1231733},{"names":["k8s.gcr.io/pause-amd64@sha256:4a1c4b21597c1b4415bdbecb28a3296c6b5e23ca4f9feeb599860a1dac6a0108","k8s.gcr.io/pause-amd64:3.2"],"sizeBytes":682696}],"volumesInUse":["kubernetes.io/aws-ebs/aws://us-east-1f/vol-04eda9d82d6dabadd"],"volumesAttached":[{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-04eda9d82d6dabadd","devicePath":"/dev/xvdbn"}]}},{"metadata":{"name":"ip-10-40-45-241.ec2.internal","selfLink":"/api/v1/nodes/ip-10-40-45-241.ec2.internal","uid":"33bf1cf2-1e96-11eb-9aff-16da7cad7b07","resourceVersion":"45488941","creationTimestamp":"2020-11-04T12:06:42Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/instance-type":"c5.xlarge","beta.kubernetes.io/os":"linux","failure-domain.beta.kubernetes.io/region":"us-east-1","failure-domain.beta.kubernetes.io/zone":"us-east-1f","kops.k8s.io/instancegroup":"nodes","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"ip-10-40-45-241.ec2.internal","kubernetes.io/os":"linux","kubernetes.io/role":"node","node-role.kubernetes.io/node":"","spotinst.io/node-lifecycle":"spot"},"annotations":{"node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"}},"spec":{"podCIDR":"100.96.111.0/24","providerID":"aws:///us-east-1f/i-091d1b1a0cf8a3486"},"status":{"capacity":{"attachable-volumes-aws-ebs":"25","cpu":"4","ephemeral-storage":"130045936Ki","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"7807996Ki","pods":"58"},"allocatable":{"attachable-volumes-aws-ebs":"25","cpu":"4","ephemeral-storage":"119850334420","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"7705596Ki","pods":"58"},"conditions":[{"type":"MemoryPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:16Z","lastTransitionTime":"2020-11-04T12:06:42Z","reason":"KubeletHasSufficientMemory","message":"kubelet has sufficient memory available"},{"type":"DiskPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:16Z","lastTransitionTime":"2020-11-04T12:06:42Z","reason":"KubeletHasNoDiskPressure","message":"kubelet has no disk pressure"},{"type":"PIDPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:16Z","lastTransitionTime":"2020-11-04T12:06:42Z","reason":"KubeletHasSufficientPID","message":"kubelet has sufficient PID available"},{"type":"Ready","status":"True","lastHeartbeatTime":"2020-11-04T13:54:16Z","lastTransitionTime":"2020-11-04T12:07:22Z","reason":"KubeletReady","message":"kubelet is posting ready status. AppArmor enabled"}],"addresses":[{"type":"InternalIP","address":"10.40.45.241"},{"type":"InternalDNS","address":"ip-10-40-45-241.ec2.internal"},{"type":"Hostname","address":"ip-10-40-45-241.ec2.internal"}],"daemonEndpoints":{"kubeletEndpoint":{"Port":10250}},"nodeInfo":{"machineID":"ec24bda60e4af050185e3f297f0861eb","systemUUID":"EC24BDA6-0E4A-F050-185E-3F297F0861EB","bootID":"ce4d0187-9021-48d6-b39f-ea9771db9035","kernelVersion":"4.15.0-1039-aws","osImage":"Ubuntu 18.04.2 LTS","containerRuntimeVersion":"docker://18.6.3","kubeletVersion":"v1.14.2","kubeProxyVersion":"v1.14.2","operatingSystem":"linux","architecture":"amd64"},"images":[{"names":["registry.example.com/cybervision/pregsense-user-management-service@sha256:e487a407cfaa96fa00f4d40a71e2792d26db1ad72843d9302588d18b0fb23326","registry.example.com/cybervision/pregsense-user-management-service:2.0.0-37765"],"sizeBytes":1268651197},{"names":["registry.example.com/ce/utilities/kafka-manager@sha256:c04a2fcec27aca7a0e8c70105ebd4c5f960ca81d6d867d4d584bcab9b7173fbc","registry.example.com/ce/utilities/kafka-manager:2.0.0.2"],"sizeBytes":547394080},{"names":["registry.example.com/ce/middleware/cassandra@sha256:29ff685aae75edaae14d052e723a66fabbd8e6e9ede068bb4a901776ada3b493","registry.example.com/ce/middleware/cassandra:0.6.40"],"sizeBytes":384610888},{"names":["registry.example.com/cybervision/pregsense-mobile-device-service@sha256:057469801785596922de4ad1866a4d2f7e26271d925889f1533fe8cf06b0db51","registry.example.com/cybervision/pregsense-mobile-device-service:2.0.0-37577"],"sizeBytes":367804418},{"names":["registry.example.com/cybervision/usability-data-extractor-service@sha256:e22df292989e525a9339b690d6d6a8e14134bb5ea6a06235691c019e11135f51","registry.example.com/cybervision/usability-data-extractor-service:2.0.0-38072"],"sizeBytes":310003340},{"names":["registry.example.com/cybervision/pregsense-medex-service@sha256:a6a38353b3b4ee41627606873b884cabf0a37bd0d6afb9b5f823b0e64d988d5b","registry.example.com/cybervision/pregsense-medex-service:2.0.0-37573"],"sizeBytes":302750971},{"names":["602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni@sha256:a6d23b9fb3d4ba549321e32a28c42d8e79da203897072e93874472ab9e80b768","602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5"],"sizeBytes":263850871},{"names":["zookeeper@sha256:b7a76ec06f68fd9c801b72dfd283701bc7d8a8b0609277a0d570e8e6768e4ad9","zookeeper:3.5.5"],"sizeBytes":225210868},{"names":["k8s.gcr.io/kube-proxy@sha256:c91687ff6145f7fcdc7d8b3da3c530a9a9b50f0734c7a945a0d9c18fc3790dbc","k8s.gcr.io/kube-proxy:v1.14.2"],"sizeBytes":82106236},{"names":["registry.example.com/ce/utilities/cqlsh@sha256:36818e33bb74a5570efb254a468136d84f8520719e966927d0797ea512d9b073","registry.example.com/ce/utilities/cqlsh:latest"],"sizeBytes":74739843},{"names":["redis@sha256:f8c22abc77f3f9cc1c2516062e4a2a71375859d7922da3faf9e4160e6ba4c3c2","redis:5.0.3-alpine"],"sizeBytes":50831292},{"names":["example/kube-tasks@sha256:713a62fab6a3075227d6a53681e548bc7cdaa39143bb135c939cc9573fd66965","example/kube-tasks:latest"],"sizeBytes":47161417},{"names":["registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","registry.example.com/ce/utilities/mysql-client:latest"],"sizeBytes":38388577},{"names":["jtblin/kube2iam@sha256:92363f1c52fe5f433487b35c3f9c242e4733717ef7ac88c7137fc3824cfad4d3","jtblin/kube2iam:0.10.8"],"sizeBytes":34303129},{"names":["registry.example.com/ce/utilities/kt@sha256:a52550f941a9449ea205201f2c42d0352da5f70bf281d1d638944352781851b2","registry.example.com/ce/utilities/kt:latest"],"sizeBytes":22871156},{"names":["registry.example.com/ce/observability/kafka-minion@sha256:34e6a52c9cef9b5d01f704c07913bd13b37a3465ae50d3adf56dd9a0ffd1aea5","registry.example.com/ce/observability/kafka-minion:1.0.1"],"sizeBytes":19445889},{"names":["busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","busybox:latest"],"sizeBytes":1231733},{"names":["busybox@sha256:7964ad52e396a6e045c39b5a44438424ac52e12e4d5a25d94895f2058cb863a0","busybox:1.30.0"],"sizeBytes":1199417},{"names":["busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47","busybox:1.28.4"],"sizeBytes":1146369},{"names":["k8s.gcr.io/pause-amd64@sha256:4a1c4b21597c1b4415bdbecb28a3296c6b5e23ca4f9feeb599860a1dac6a0108","k8s.gcr.io/pause-amd64:3.2"],"sizeBytes":682696}],"volumesInUse":["kubernetes.io/aws-ebs/aws://us-east-1f/vol-05a535855fa31264f","kubernetes.io/aws-ebs/aws://us-east-1f/vol-05f9ce80197f24f96","kubernetes.io/aws-ebs/aws://us-east-1f/vol-0b17552f50ccb204e"],"volumesAttached":[{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-0b17552f50ccb204e","devicePath":"/dev/xvdca"},{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-05a535855fa31264f","devicePath":"/dev/xvdch"},{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-05f9ce80197f24f96","devicePath":"/dev/xvdce"}]}},{"metadata":{"name":"ip-10-40-51-35.ec2.internal","selfLink":"/api/v1/nodes/ip-10-40-51-35.ec2.internal","uid":"1066fa28-1dfc-11eb-9aff-16da7cad7b07","resourceVersion":"45488913","creationTimestamp":"2020-11-03T17:43:20Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/instance-type":"r5.large","beta.kubernetes.io/os":"linux","failure-domain.beta.kubernetes.io/region":"us-east-1","failure-domain.beta.kubernetes.io/zone":"us-east-1f","kops.k8s.io/instancegroup":"nodes","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"ip-10-40-51-35.ec2.internal","kubernetes.io/os":"linux","kubernetes.io/role":"node","node-role.kubernetes.io/node":""},"annotations":{"node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"}},"spec":{"podCIDR":"100.96.79.0/24","providerID":"aws:///us-east-1f/i-0e4fb331463f91e5b"},"status":{"capacity":{"attachable-volumes-aws-ebs":"25","cpu":"2","ephemeral-storage":"130045936Ki","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"16123244Ki","pods":"29"},"allocatable":{"attachable-volumes-aws-ebs":"25","cpu":"2","ephemeral-storage":"119850334420","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"16020844Ki","pods":"29"},"conditions":[{"type":"MemoryPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:06Z","lastTransitionTime":"2020-11-03T17:43:20Z","reason":"KubeletHasSufficientMemory","message":"kubelet has sufficient memory available"},{"type":"DiskPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:06Z","lastTransitionTime":"2020-11-03T17:43:20Z","reason":"KubeletHasNoDiskPressure","message":"kubelet has no disk pressure"},{"type":"PIDPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:06Z","lastTransitionTime":"2020-11-03T17:43:20Z","reason":"KubeletHasSufficientPID","message":"kubelet has sufficient PID available"},{"type":"Ready","status":"True","lastHeartbeatTime":"2020-11-04T13:54:06Z","lastTransitionTime":"2020-11-03T17:43:41Z","reason":"KubeletReady","message":"kubelet is posting ready status. AppArmor enabled"}],"addresses":[{"type":"InternalIP","address":"10.40.51.35"},{"type":"InternalDNS","address":"ip-10-40-51-35.ec2.internal"},{"type":"Hostname","address":"ip-10-40-51-35.ec2.internal"}],"daemonEndpoints":{"kubeletEndpoint":{"Port":10250}},"nodeInfo":{"machineID":"ec21be1b38ff213ea283c19838e97f88","systemUUID":"EC21BE1B-38FF-213E-A283-C19838E97F88","bootID":"d7cb4873-93f4-4022-b59b-70fb30031938","kernelVersion":"4.15.0-1039-aws","osImage":"Ubuntu 18.04.2 LTS","containerRuntimeVersion":"docker://18.6.3","kubeletVersion":"v1.14.2","kubeProxyVersion":"v1.14.2","operatingSystem":"linux","architecture":"amd64"},"images":[{"names":["registry.example.com/ce/utilities/kafka-shell@sha256:8a8a80dfaae72664413657ee2ea2bd4543f08163035bdefcb163456af9a8e316","registry.example.com/ce/utilities/kafka-shell:latest"],"sizeBytes":697357066},{"names":["quay.io/kubernetes-ingress-controller/nginx-ingress-controller@sha256:617076c3e3d4d0638a4927702530d8456bda64c67194f6daed272a59e93b992f","quay.io/kubernetes-ingress-controller/nginx-ingress-controller:0.21.0"],"sizeBytes":568075227},{"names":["registry.example.com/ce/utilities/kafka-manager@sha256:c04a2fcec27aca7a0e8c70105ebd4c5f960ca81d6d867d4d584bcab9b7173fbc","registry.example.com/ce/utilities/kafka-manager:2.0.0.2"],"sizeBytes":547394080},{"names":["registry.example.com/ce/middleware/cassandra@sha256:29ff685aae75edaae14d052e723a66fabbd8e6e9ede068bb4a901776ada3b493","registry.example.com/ce/middleware/cassandra:0.6.40"],"sizeBytes":384610888},{"names":["registry.example.com/ce/middleware/mariadb@sha256:b4c12c27093137dbf047773d4ddb99676bedd32c8606bfa1e3c50876d5ce659f","registry.example.com/ce/middleware/mariadb:0.6.56"],"sizeBytes":373763438},{"names":["registry.example.com/cybervision/pregsense-mobile-device-service@sha256:057469801785596922de4ad1866a4d2f7e26271d925889f1533fe8cf06b0db51","registry.example.com/cybervision/pregsense-mobile-device-service:2.0.0-37577"],"sizeBytes":367804418},{"names":["registry.example.com/cybervision/pregsense-scheduler-service@sha256:7ad590d9311407a5c36583316cd79b66906db26085e56b5c37d9d3125d522fc2","registry.example.com/cybervision/pregsense-scheduler-service:1.1.0-37581"],"sizeBytes":327939018},{"names":["registry.example.com/cybervision/pregsense-medex-service@sha256:a6a38353b3b4ee41627606873b884cabf0a37bd0d6afb9b5f823b0e64d988d5b","registry.example.com/cybervision/pregsense-medex-service:2.0.0-37573"],"sizeBytes":302750971},{"names":["602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni@sha256:a6d23b9fb3d4ba549321e32a28c42d8e79da203897072e93874472ab9e80b768","602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5"],"sizeBytes":263850871},{"names":["zookeeper@sha256:b7a76ec06f68fd9c801b72dfd283701bc7d8a8b0609277a0d570e8e6768e4ad9","zookeeper:3.5.5"],"sizeBytes":225210868},{"names":["registry.example.com/ce/utilities/kubectl-in-pod@sha256:8b9d9dcedcc1eb0a3fa81971787469527333f0ee9aaf1eb296affba1da64a0e5","registry.example.com/ce/utilities/kubectl-in-pod:0.0.4"],"sizeBytes":188973770},{"names":["registry.example.com/cybervision/invu-web/support@sha256:de25604e5609c81e2d180b86126f00441671ab242555bda54a0b4e56d6a9b374","registry.example.com/cybervision/invu-web/support:2.0.0-38041"],"sizeBytes":107592777},{"names":["gcr.io/kubernetes-helm/tiller@sha256:f8002b91997fdc2c15a9c2aa994bea117b5b1683933f3144369862f0883c3c42","gcr.io/kubernetes-helm/tiller:v2.14.1"],"sizeBytes":94194761},{"names":["emqx/emqx@sha256:3f31ee2793b4446e98183659b4493992355e2b0d8603df946c641b47f29ced78","emqx/emqx:v3.2.7"],"sizeBytes":89389623},{"names":["k8s.gcr.io/kube-proxy@sha256:c91687ff6145f7fcdc7d8b3da3c530a9a9b50f0734c7a945a0d9c18fc3790dbc","k8s.gcr.io/kube-proxy:v1.14.2"],"sizeBytes":82106236},{"names":["registry.example.com/ce/utilities/cqlsh@sha256:36818e33bb74a5570efb254a468136d84f8520719e966927d0797ea512d9b073","registry.example.com/ce/utilities/cqlsh:latest"],"sizeBytes":74739843},{"names":["example/kube-tasks@sha256:713a62fab6a3075227d6a53681e548bc7cdaa39143bb135c939cc9573fd66965","example/kube-tasks:latest"],"sizeBytes":47161417},{"names":["k8s.gcr.io/coredns@sha256:2c8d61c46f484d881db43b34d13ca47a269336e576c81cf007ca740fa9ec0800","k8s.gcr.io/coredns:1.6.7"],"sizeBytes":43794147},{"names":["k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f","k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1"],"sizeBytes":40684734},{"names":["k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b","k8s.gcr.io/metrics-server-amd64:v0.3.6"],"sizeBytes":39944451},{"names":["registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","registry.example.com/ce/utilities/mysql-client:latest"],"sizeBytes":38388577},{"names":["jtblin/kube2iam@sha256:92363f1c52fe5f433487b35c3f9c242e4733717ef7ac88c7137fc3824cfad4d3","jtblin/kube2iam:0.10.8"],"sizeBytes":34303129},{"names":["registry.example.com/ce/middleware/connect-operator@sha256:7e5df82e5a2fc470d4f647d42b6849477ac712799868c87db99bdb88c778746f","registry.example.com/ce/middleware/connect-operator:0.2.6"],"sizeBytes":32127859},{"names":["registry.example.com/ce/observability/kafka-minion@sha256:34e6a52c9cef9b5d01f704c07913bd13b37a3465ae50d3adf56dd9a0ffd1aea5","registry.example.com/ce/observability/kafka-minion:1.0.1"],"sizeBytes":19445889},{"names":["prom/mysqld-exporter@sha256:9f4fb61cca309cb4a8c1b9ed9fb4aa75af0f7a21f36d3954667db37c062a0172","prom/mysqld-exporter:v0.11.0"],"sizeBytes":17003848},{"names":["example/emq_exporter@sha256:1526c0476c1e5d740dfc4df36f3295ea27f87b41becf274c760fbd0a51011233","example/emq_exporter:v0.4.1"],"sizeBytes":11467840},{"names":["example/default-backend@sha256:14f15b1c7b037f32cc816e37259ffa386f2b0fdab5e48058b61323a389450f11","example/default-backend:latest"],"sizeBytes":5447342},{"names":["busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","busybox:latest"],"sizeBytes":1231733},{"names":["busybox@sha256:7964ad52e396a6e045c39b5a44438424ac52e12e4d5a25d94895f2058cb863a0","busybox:1.30.0"],"sizeBytes":1199417},{"names":["busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47","busybox:1.28.4"],"sizeBytes":1146369},{"names":["k8s.gcr.io/pause-amd64@sha256:4a1c4b21597c1b4415bdbecb28a3296c6b5e23ca4f9feeb599860a1dac6a0108","k8s.gcr.io/pause-amd64:3.2"],"sizeBytes":682696}],"volumesInUse":["kubernetes.io/aws-ebs/aws://us-east-1f/vol-069646aaf149403ec","kubernetes.io/aws-ebs/aws://us-east-1f/vol-09a7d97ad0391bab1","kubernetes.io/aws-ebs/aws://us-east-1f/vol-0ebef74c040715d7b"],"volumesAttached":[{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-069646aaf149403ec","devicePath":"/dev/xvdch"},{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-0ebef74c040715d7b","devicePath":"/dev/xvdce"},{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-09a7d97ad0391bab1","devicePath":"/dev/xvdcg"}]}},{"metadata":{"name":"ip-10-40-54-156.ec2.internal","selfLink":"/api/v1/nodes/ip-10-40-54-156.ec2.internal","uid":"fafce029-0e0b-11eb-9aff-16da7cad7b07","resourceVersion":"45488876","creationTimestamp":"2020-10-14T10:56:58Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/instance-type":"m5a.large","beta.kubernetes.io/os":"linux","failure-domain.beta.kubernetes.io/region":"us-east-1","failure-domain.beta.kubernetes.io/zone":"us-east-1f","kops.k8s.io/instancegroup":"master-us-east-1f","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"ip-10-40-54-156.ec2.internal","kubernetes.io/os":"linux","kubernetes.io/role":"master","node-role.kubernetes.io/master":""},"annotations":{"node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"}},"spec":{"podCIDR":"100.96.0.0/24","providerID":"aws:///us-east-1f/i-015c846b225ceb0dc","taints":[{"key":"node-role.kubernetes.io/master","effect":"NoSchedule"}]},"status":{"capacity":{"attachable-volumes-aws-ebs":"25","cpu":"2","ephemeral-storage":"64989720Ki","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"7910764Ki","pods":"29"},"allocatable":{"attachable-volumes-aws-ebs":"25","cpu":"2","ephemeral-storage":"59894525853","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"7808364Ki","pods":"29"},"conditions":[{"type":"MemoryPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:53:53Z","lastTransitionTime":"2020-10-14T10:56:58Z","reason":"KubeletHasSufficientMemory","message":"kubelet has sufficient memory available"},{"type":"DiskPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:53:53Z","lastTransitionTime":"2020-10-14T10:56:58Z","reason":"KubeletHasNoDiskPressure","message":"kubelet has no disk pressure"},{"type":"PIDPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:53:53Z","lastTransitionTime":"2020-10-14T10:56:58Z","reason":"KubeletHasSufficientPID","message":"kubelet has sufficient PID available"},{"type":"Ready","status":"True","lastHeartbeatTime":"2020-11-04T13:53:53Z","lastTransitionTime":"2020-10-14T10:58:38Z","reason":"KubeletReady","message":"kubelet is posting ready status. AppArmor enabled"}],"addresses":[{"type":"InternalIP","address":"10.40.54.156"},{"type":"InternalDNS","address":"ip-10-40-54-156.ec2.internal"},{"type":"Hostname","address":"ip-10-40-54-156.ec2.internal"}],"daemonEndpoints":{"kubeletEndpoint":{"Port":10250}},"nodeInfo":{"machineID":"ec2efbdeec6baae7f801227a04215e39","systemUUID":"EC2EFBDE-EC6B-AAE7-F801-227A04215E39","bootID":"41f6da35-f429-4543-bd6d-17c44e7c4cfc","kernelVersion":"4.15.0-1039-aws","osImage":"Ubuntu 18.04.2 LTS","containerRuntimeVersion":"docker://18.6.3","kubeletVersion":"v1.14.2","kubeProxyVersion":"v1.14.2","operatingSystem":"linux","architecture":"amd64"},"images":[{"names":["spotinst/kubernetes-cluster-controller@sha256:f82c58b3e5374331ace6bf988987e2f0b390abedad313a31e5c8aaede3c580c2","spotinst/kubernetes-cluster-controller:1.0.68"],"sizeBytes":806421680},{"names":["kopeio/etcd-manager@sha256:08d90e866611142896c18c325d6b058d0aa0993f5b255807c17610a75cbe7392","kopeio/etcd-manager:3.0.20200531"],"sizeBytes":753910355},{"names":["spotinst/kubernetes-cluster-controller@sha256:28fb487f458ed0e2037cc7fe2e0d6a5df6ae095b5f4ad479cac07a0620d05ece","spotinst/kubernetes-cluster-controller:1.0.67"],"sizeBytes":740622913},{"names":["protokube:1.18.1"],"sizeBytes":285224997},{"names":["602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni@sha256:a6d23b9fb3d4ba549321e32a28c42d8e79da203897072e93874472ab9e80b768","602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5"],"sizeBytes":263850871},{"names":["k8s.gcr.io/kube-apiserver@sha256:223577e889dfb1a6e85faa6e3993308ead0b48b2a9c9d22c8fcd84b03d8a3af0","k8s.gcr.io/kube-apiserver:v1.14.2"],"sizeBytes":209916798},{"names":["k8s.gcr.io/kube-controller-manager@sha256:51a382e90acd9d11d5571850312ad4b268db8b28b2868516dfda19a6933a095c","k8s.gcr.io/kube-controller-manager:v1.14.2"],"sizeBytes":157933630},{"names":["kope/dns-controller@sha256:1df57184ec694b5a5839d2f59b54cc2a2857b34d94b3011063b3bc7caf8afb6d","kope/dns-controller:1.18.1"],"sizeBytes":89717254},{"names":["kope/dns-controller@sha256:ad0f2562cef00e77bb5c0ff255b682e25b14d24723e1e37057d349e39c7ff28d","kope/dns-controller:1.18.2"],"sizeBytes":89717254},{"names":["k8s.gcr.io/kube-proxy@sha256:c91687ff6145f7fcdc7d8b3da3c530a9a9b50f0734c7a945a0d9c18fc3790dbc","k8s.gcr.io/kube-proxy:v1.14.2"],"sizeBytes":82106236},{"names":["k8s.gcr.io/kube-scheduler@sha256:052e0322b8a2b22819ab0385089f202555c4099493d1bd33205a34753494d2c2","k8s.gcr.io/kube-scheduler:v1.14.2"],"sizeBytes":81579742},{"names":["fluent/fluent-bit@sha256:5ff3eb13d23c38aac5aefcd0db5ea3562917d5c690b4b88257751667ac413ebd","fluent/fluent-bit:1.1.3"],"sizeBytes":53391352},{"names":["jtblin/kube2iam@sha256:92363f1c52fe5f433487b35c3f9c242e4733717ef7ac88c7137fc3824cfad4d3","jtblin/kube2iam:0.10.8"],"sizeBytes":34303129},{"names":["602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon/aws-iam-authenticator@sha256:1477d16f77b237d26d34f1cde1885931fbf98669c478a72e6849c1fcdc9365fe","602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon/aws-iam-authenticator:v0.4.0"],"sizeBytes":23762101},{"names":["prom/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee","prom/node-exporter:v0.18.1"],"sizeBytes":22933477},{"names":["k8s.gcr.io/pause-amd64@sha256:4a1c4b21597c1b4415bdbecb28a3296c6b5e23ca4f9feeb599860a1dac6a0108","k8s.gcr.io/pause-amd64:3.2"],"sizeBytes":682696}]}},{"metadata":{"name":"ip-10-40-55-41.ec2.internal","selfLink":"/api/v1/nodes/ip-10-40-55-41.ec2.internal","uid":"b4f79ec1-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45488925","creationTimestamp":"2020-11-04T12:46:06Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/instance-type":"t3.xlarge","beta.kubernetes.io/os":"linux","failure-domain.beta.kubernetes.io/region":"us-east-1","failure-domain.beta.kubernetes.io/zone":"us-east-1f","kops.k8s.io/instancegroup":"nodes","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"ip-10-40-55-41.ec2.internal","kubernetes.io/os":"linux","kubernetes.io/role":"node","node-role.kubernetes.io/node":"","spotinst.io/node-lifecycle":"spot"},"annotations":{"node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"}},"spec":{"podCIDR":"100.96.113.0/24","providerID":"aws:///us-east-1f/i-07759285ebe2a969d"},"status":{"capacity":{"attachable-volumes-aws-ebs":"25","cpu":"4","ephemeral-storage":"130045936Ki","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"16235512Ki","pods":"58"},"allocatable":{"attachable-volumes-aws-ebs":"25","cpu":"4","ephemeral-storage":"119850334420","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"16133112Ki","pods":"58"},"conditions":[{"type":"MemoryPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:09Z","lastTransitionTime":"2020-11-04T12:46:06Z","reason":"KubeletHasSufficientMemory","message":"kubelet has sufficient memory available"},{"type":"DiskPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:09Z","lastTransitionTime":"2020-11-04T12:46:06Z","reason":"KubeletHasNoDiskPressure","message":"kubelet has no disk pressure"},{"type":"PIDPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:09Z","lastTransitionTime":"2020-11-04T12:46:06Z","reason":"KubeletHasSufficientPID","message":"kubelet has sufficient PID available"},{"type":"Ready","status":"True","lastHeartbeatTime":"2020-11-04T13:54:09Z","lastTransitionTime":"2020-11-04T12:46:27Z","reason":"KubeletReady","message":"kubelet is posting ready status. AppArmor enabled"}],"addresses":[{"type":"InternalIP","address":"10.40.55.41"},{"type":"InternalDNS","address":"ip-10-40-55-41.ec2.internal"},{"type":"Hostname","address":"ip-10-40-55-41.ec2.internal"}],"daemonEndpoints":{"kubeletEndpoint":{"Port":10250}},"nodeInfo":{"machineID":"ec21154ae839a2204770777d165a898f","systemUUID":"EC21154A-E839-A220-4770-777D165A898F","bootID":"f2e8e581-1789-4138-bd5c-7c60dfa26880","kernelVersion":"4.15.0-1039-aws","osImage":"Ubuntu 18.04.2 LTS","containerRuntimeVersion":"docker://18.6.3","kubeletVersion":"v1.14.2","kubeProxyVersion":"v1.14.2","operatingSystem":"linux","architecture":"amd64"},"images":[{"names":["registry.example.com/cybervision/invu-kafka-connect-sinks/kafka-connect@sha256:6a584826ecf0bbdf654fbe27201e2ed07d5586bd6f0c414c13be40ac3f6cc62f","registry.example.com/cybervision/invu-kafka-connect-sinks/kafka-connect:2.0.0-37698"],"sizeBytes":643296613},{"names":["registry.example.com/ce/middleware/cassandra@sha256:29ff685aae75edaae14d052e723a66fabbd8e6e9ede068bb4a901776ada3b493","registry.example.com/ce/middleware/cassandra:0.6.40"],"sizeBytes":384610888},{"names":["registry.example.com/cybervision/pregsense-device-service@sha256:ccdcd8bec0cc02d64da785a6ae863b31e335e28f089a92f071affaee5ec1a2cb","registry.example.com/cybervision/pregsense-device-service:2.0.0-37554"],"sizeBytes":321951523},{"names":["registry.example.com/ce/middleware/kafka@sha256:5a13ea153f26ac29e73fd3a0ed67c701f33ea761a0b10a03870fdda51e3975cc","registry.example.com/ce/middleware/kafka:0.6.33"],"sizeBytes":269199283},{"names":["602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni@sha256:a6d23b9fb3d4ba549321e32a28c42d8e79da203897072e93874472ab9e80b768","602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5"],"sizeBytes":263850871},{"names":["k8s.gcr.io/kube-proxy@sha256:c91687ff6145f7fcdc7d8b3da3c530a9a9b50f0734c7a945a0d9c18fc3790dbc","k8s.gcr.io/kube-proxy:v1.14.2"],"sizeBytes":82106236},{"names":["registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","registry.example.com/ce/utilities/mysql-client:latest"],"sizeBytes":38388577},{"names":["jtblin/kube2iam@sha256:92363f1c52fe5f433487b35c3f9c242e4733717ef7ac88c7137fc3824cfad4d3","jtblin/kube2iam:0.10.8"],"sizeBytes":34303129},{"names":["busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","busybox:latest"],"sizeBytes":1231733},{"names":["busybox@sha256:7964ad52e396a6e045c39b5a44438424ac52e12e4d5a25d94895f2058cb863a0","busybox:1.30.0"],"sizeBytes":1199417},{"names":["k8s.gcr.io/pause-amd64@sha256:4a1c4b21597c1b4415bdbecb28a3296c6b5e23ca4f9feeb599860a1dac6a0108","k8s.gcr.io/pause-amd64:3.2"],"sizeBytes":682696}],"volumesInUse":["kubernetes.io/aws-ebs/aws://us-east-1f/vol-093bc9911e6b69ad5","kubernetes.io/aws-ebs/aws://us-east-1f/vol-0aa3e57d85128ef60"],"volumesAttached":[{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-093bc9911e6b69ad5","devicePath":"/dev/xvdbp"},{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-0aa3e57d85128ef60","devicePath":"/dev/xvdcc"}]}},{"metadata":{"name":"ip-10-40-56-27.ec2.internal","selfLink":"/api/v1/nodes/ip-10-40-56-27.ec2.internal","uid":"21d0f8a8-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45488903","creationTimestamp":"2020-11-04T12:42:00Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/instance-type":"t3a.xlarge","beta.kubernetes.io/os":"linux","failure-domain.beta.kubernetes.io/region":"us-east-1","failure-domain.beta.kubernetes.io/zone":"us-east-1f","kops.k8s.io/instancegroup":"nodes","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"ip-10-40-56-27.ec2.internal","kubernetes.io/os":"linux","kubernetes.io/role":"node","node-role.kubernetes.io/node":"","spotinst.io/node-lifecycle":"spot"},"annotations":{"node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"}},"spec":{"podCIDR":"100.96.112.0/24","providerID":"aws:///us-east-1f/i-036e06b204f56f316"},"status":{"capacity":{"attachable-volumes-aws-ebs":"25","cpu":"4","ephemeral-storage":"130045936Ki","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"16280568Ki","pods":"58"},"allocatable":{"attachable-volumes-aws-ebs":"25","cpu":"4","ephemeral-storage":"119850334420","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"16178168Ki","pods":"58"},"conditions":[{"type":"MemoryPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:03Z","lastTransitionTime":"2020-11-04T12:42:00Z","reason":"KubeletHasSufficientMemory","message":"kubelet has sufficient memory available"},{"type":"DiskPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:03Z","lastTransitionTime":"2020-11-04T12:42:00Z","reason":"KubeletHasNoDiskPressure","message":"kubelet has no disk pressure"},{"type":"PIDPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:03Z","lastTransitionTime":"2020-11-04T12:42:00Z","reason":"KubeletHasSufficientPID","message":"kubelet has sufficient PID available"},{"type":"Ready","status":"True","lastHeartbeatTime":"2020-11-04T13:54:03Z","lastTransitionTime":"2020-11-04T12:42:50Z","reason":"KubeletReady","message":"kubelet is posting ready status. AppArmor enabled"}],"addresses":[{"type":"InternalIP","address":"10.40.56.27"},{"type":"InternalDNS","address":"ip-10-40-56-27.ec2.internal"},{"type":"Hostname","address":"ip-10-40-56-27.ec2.internal"}],"daemonEndpoints":{"kubeletEndpoint":{"Port":10250}},"nodeInfo":{"machineID":"ec2fa63e40c54f665cbfe09ae4ec16d9","systemUUID":"EC2FA63E-40C5-4F66-5CBF-E09AE4EC16D9","bootID":"f2e9e82a-9b29-4591-a662-9fe3f838585e","kernelVersion":"4.15.0-1039-aws","osImage":"Ubuntu 18.04.2 LTS","containerRuntimeVersion":"docker://18.6.3","kubeletVersion":"v1.14.2","kubeProxyVersion":"v1.14.2","operatingSystem":"linux","architecture":"amd64"},"images":[{"names":["confluentinc/cp-schema-registry@sha256:0d7a84d486477a0c203ae21d5d52c40d26e810f5b5cfa27a56274692b70949f5","confluentinc/cp-schema-registry:5.2.2"],"sizeBytes":746078624},{"names":["registry.example.com/cybervision/invu-kafka-connect-sinks/kafka-connect@sha256:6a584826ecf0bbdf654fbe27201e2ed07d5586bd6f0c414c13be40ac3f6cc62f","registry.example.com/cybervision/invu-kafka-connect-sinks/kafka-connect:2.0.0-37698"],"sizeBytes":643296613},{"names":["confluentinc/cp-ksql-server@sha256:a0b75d2f9926ac31139b2bebff3ac95a24e9f08465176aef16ed3c481b39a297","confluentinc/cp-ksql-server:5.2.2"],"sizeBytes":524657779},{"names":["registry.example.com/ce/middleware/mariadb@sha256:b4c12c27093137dbf047773d4ddb99676bedd32c8606bfa1e3c50876d5ce659f","registry.example.com/ce/middleware/mariadb:0.6.56"],"sizeBytes":373763438},{"names":["registry.example.com/cybervision/invu-infrastructure-service@sha256:00f75459b2ee50deb47884131608f73108158d4faa085d1a5cc237aacd3f2112","registry.example.com/cybervision/invu-infrastructure-service:2.0.0-37566"],"sizeBytes":312358195},{"names":["example/jmx-prometheus-httpserver@sha256:725e8a9bfec05f432b931edc11b1ee8bac3895e408bb91af58266dc88ee4e63b","example/jmx-prometheus-httpserver:0.11.0"],"sizeBytes":273954021},{"names":["registry.example.com/ce/middleware/kafka@sha256:5a13ea153f26ac29e73fd3a0ed67c701f33ea761a0b10a03870fdda51e3975cc","registry.example.com/ce/middleware/kafka:0.6.33"],"sizeBytes":269199283},{"names":["602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni@sha256:a6d23b9fb3d4ba549321e32a28c42d8e79da203897072e93874472ab9e80b768","602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5"],"sizeBytes":263850871},{"names":["emqx/emqx@sha256:3f31ee2793b4446e98183659b4493992355e2b0d8603df946c641b47f29ced78","emqx/emqx:v3.2.7"],"sizeBytes":89389623},{"names":["k8s.gcr.io/kube-proxy@sha256:c91687ff6145f7fcdc7d8b3da3c530a9a9b50f0734c7a945a0d9c18fc3790dbc","k8s.gcr.io/kube-proxy:v1.14.2"],"sizeBytes":82106236},{"names":["registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","registry.example.com/ce/utilities/mysql-client:latest"],"sizeBytes":38388577},{"names":["jtblin/kube2iam@sha256:92363f1c52fe5f433487b35c3f9c242e4733717ef7ac88c7137fc3824cfad4d3","jtblin/kube2iam:0.10.8"],"sizeBytes":34303129},{"names":["registry.example.com/ce/utilities/kt@sha256:a52550f941a9449ea205201f2c42d0352da5f70bf281d1d638944352781851b2","registry.example.com/ce/utilities/kt:latest"],"sizeBytes":22871156},{"names":["prom/mysqld-exporter@sha256:9f4fb61cca309cb4a8c1b9ed9fb4aa75af0f7a21f36d3954667db37c062a0172","prom/mysqld-exporter:v0.11.0"],"sizeBytes":17003848},{"names":["example/emq_exporter@sha256:1526c0476c1e5d740dfc4df36f3295ea27f87b41becf274c760fbd0a51011233","example/emq_exporter:v0.4.1"],"sizeBytes":11467840},{"names":["busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","busybox:latest"],"sizeBytes":1231733},{"names":["k8s.gcr.io/pause-amd64@sha256:4a1c4b21597c1b4415bdbecb28a3296c6b5e23ca4f9feeb599860a1dac6a0108","k8s.gcr.io/pause-amd64:3.2"],"sizeBytes":682696}],"volumesInUse":["kubernetes.io/aws-ebs/aws://us-east-1f/vol-0153f8347ff8a2cd1","kubernetes.io/aws-ebs/aws://us-east-1f/vol-0cb2890c3adac40d4"],"volumesAttached":[{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-0153f8347ff8a2cd1","devicePath":"/dev/xvdbj"},{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-0cb2890c3adac40d4","devicePath":"/dev/xvdcd"}]}},{"metadata":{"name":"ip-10-40-57-245.ec2.internal","selfLink":"/api/v1/nodes/ip-10-40-57-245.ec2.internal","uid":"b7917ff0-1e95-11eb-9aff-16da7cad7b07","resourceVersion":"45489033","creationTimestamp":"2020-11-04T12:03:14Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/instance-type":"t3a.medium","beta.kubernetes.io/os":"linux","failure-domain.beta.kubernetes.io/region":"us-east-1","failure-domain.beta.kubernetes.io/zone":"us-east-1f","kops.k8s.io/instancegroup":"nodes","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"ip-10-40-57-245.ec2.internal","kubernetes.io/os":"linux","kubernetes.io/role":"node","node-role.kubernetes.io/node":"","spotinst.io/node-lifecycle":"spot"},"annotations":{"node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"}},"spec":{"podCIDR":"100.96.107.0/24","providerID":"aws:///us-east-1f/i-0deead86f7d952607"},"status":{"capacity":{"attachable-volumes-aws-ebs":"25","cpu":"2","ephemeral-storage":"130045936Ki","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"3990892Ki","pods":"17"},"allocatable":{"attachable-volumes-aws-ebs":"25","cpu":"2","ephemeral-storage":"119850334420","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"3888492Ki","pods":"17"},"conditions":[{"type":"MemoryPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:49Z","lastTransitionTime":"2020-11-04T12:03:14Z","reason":"KubeletHasSufficientMemory","message":"kubelet has sufficient memory available"},{"type":"DiskPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:49Z","lastTransitionTime":"2020-11-04T12:03:14Z","reason":"KubeletHasNoDiskPressure","message":"kubelet has no disk pressure"},{"type":"PIDPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:49Z","lastTransitionTime":"2020-11-04T12:03:14Z","reason":"KubeletHasSufficientPID","message":"kubelet has sufficient PID available"},{"type":"Ready","status":"True","lastHeartbeatTime":"2020-11-04T13:54:49Z","lastTransitionTime":"2020-11-04T12:03:34Z","reason":"KubeletReady","message":"kubelet is posting ready status. AppArmor enabled"}],"addresses":[{"type":"InternalIP","address":"10.40.57.245"},{"type":"InternalDNS","address":"ip-10-40-57-245.ec2.internal"},{"type":"Hostname","address":"ip-10-40-57-245.ec2.internal"}],"daemonEndpoints":{"kubeletEndpoint":{"Port":10250}},"nodeInfo":{"machineID":"ec2d967bf15437edf65a244bceea6ecc","systemUUID":"EC2D967B-F154-37ED-F65A-244BCEEA6ECC","bootID":"924eea63-f8c3-4e69-8932-c2622c6c300d","kernelVersion":"4.15.0-1039-aws","osImage":"Ubuntu 18.04.2 LTS","containerRuntimeVersion":"docker://18.6.3","kubeletVersion":"v1.14.2","kubeProxyVersion":"v1.14.2","operatingSystem":"linux","architecture":"amd64"},"images":[{"names":["registry.example.com/cybervision/pregsense-gateway-service@sha256:ba2b7c16fd295c73ab75edee8808ffd8758c01ad0bd74d394aa7b3395f61d4ad","registry.example.com/cybervision/pregsense-gateway-service:2.0.0-38164"],"sizeBytes":339009338},{"names":["registry.example.com/cybervision/pregsense-auth-service@sha256:96526bbbd74cffab866d7cdf38ccc23cc59228a95d6d6c10d28f4ee056f7f4d0","registry.example.com/cybervision/pregsense-auth-service:2.0.0-37888"],"sizeBytes":333981635},{"names":["registry.example.com/cybervision/pregsense-activity-service@sha256:52a50e96512249156c779d18a5aecc8082e2829221ecd3bc635401bf76ab9c61","registry.example.com/cybervision/pregsense-activity-service:2.0.0-37549"],"sizeBytes":325759251},{"names":["registry.example.com/cybervision/pregsense-geo-service@sha256:9e44ea04116b0dad47c7774c04666e6a74de49e252ebd2b3f3d562ce63bf9bbc","registry.example.com/cybervision/pregsense-geo-service:2.0.0-37561"],"sizeBytes":298502628},{"names":["602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni@sha256:a6d23b9fb3d4ba549321e32a28c42d8e79da203897072e93874472ab9e80b768","602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5"],"sizeBytes":263850871},{"names":["zookeeper@sha256:b7a76ec06f68fd9c801b72dfd283701bc7d8a8b0609277a0d570e8e6768e4ad9","zookeeper:3.5.5"],"sizeBytes":225210868},{"names":["emqx/emqx@sha256:3f31ee2793b4446e98183659b4493992355e2b0d8603df946c641b47f29ced78","emqx/emqx:v3.2.7"],"sizeBytes":89389623},{"names":["k8s.gcr.io/kube-proxy@sha256:c91687ff6145f7fcdc7d8b3da3c530a9a9b50f0734c7a945a0d9c18fc3790dbc","k8s.gcr.io/kube-proxy:v1.14.2"],"sizeBytes":82106236},{"names":["registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","registry.example.com/ce/utilities/mysql-client:latest"],"sizeBytes":38388577},{"names":["jtblin/kube2iam@sha256:92363f1c52fe5f433487b35c3f9c242e4733717ef7ac88c7137fc3824cfad4d3","jtblin/kube2iam:0.10.8"],"sizeBytes":34303129},{"names":["example/emq_exporter@sha256:1526c0476c1e5d740dfc4df36f3295ea27f87b41becf274c760fbd0a51011233","example/emq_exporter:v0.4.1"],"sizeBytes":11467840},{"names":["busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","busybox:latest"],"sizeBytes":1231733},{"names":["k8s.gcr.io/pause-amd64@sha256:4a1c4b21597c1b4415bdbecb28a3296c6b5e23ca4f9feeb599860a1dac6a0108","k8s.gcr.io/pause-amd64:3.2"],"sizeBytes":682696}],"volumesInUse":["kubernetes.io/aws-ebs/aws://us-east-1f/vol-032d1079efa034f3c"],"volumesAttached":[{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-032d1079efa034f3c","devicePath":"/dev/xvdcx"}]}},{"metadata":{"name":"ip-10-40-59-224.ec2.internal","selfLink":"/api/v1/nodes/ip-10-40-59-224.ec2.internal","uid":"555d2c07-1ea0-11eb-9aff-16da7cad7b07","resourceVersion":"45489020","creationTimestamp":"2020-11-04T13:19:14Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/instance-type":"t3a.2xlarge","beta.kubernetes.io/os":"linux","failure-domain.beta.kubernetes.io/region":"us-east-1","failure-domain.beta.kubernetes.io/zone":"us-east-1f","kops.k8s.io/instancegroup":"nodes","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"ip-10-40-59-224.ec2.internal","kubernetes.io/os":"linux","kubernetes.io/role":"node","node-role.kubernetes.io/node":"","spotinst.io/node-lifecycle":"spot"},"annotations":{"node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"}},"spec":{"podCIDR":"100.96.117.0/24","providerID":"aws:///us-east-1f/i-0ffadee0802927c01"},"status":{"capacity":{"attachable-volumes-aws-ebs":"25","cpu":"8","ephemeral-storage":"130045936Ki","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"32665868Ki","pods":"58"},"allocatable":{"attachable-volumes-aws-ebs":"25","cpu":"8","ephemeral-storage":"119850334420","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"32563468Ki","pods":"58"},"conditions":[{"type":"MemoryPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:45Z","lastTransitionTime":"2020-11-04T13:19:14Z","reason":"KubeletHasSufficientMemory","message":"kubelet has sufficient memory available"},{"type":"DiskPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:45Z","lastTransitionTime":"2020-11-04T13:19:14Z","reason":"KubeletHasNoDiskPressure","message":"kubelet has no disk pressure"},{"type":"PIDPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:45Z","lastTransitionTime":"2020-11-04T13:19:14Z","reason":"KubeletHasSufficientPID","message":"kubelet has sufficient PID available"},{"type":"Ready","status":"True","lastHeartbeatTime":"2020-11-04T13:54:45Z","lastTransitionTime":"2020-11-04T13:20:04Z","reason":"KubeletReady","message":"kubelet is posting ready status. AppArmor enabled"}],"addresses":[{"type":"InternalIP","address":"10.40.59.224"},{"type":"InternalDNS","address":"ip-10-40-59-224.ec2.internal"},{"type":"Hostname","address":"ip-10-40-59-224.ec2.internal"}],"daemonEndpoints":{"kubeletEndpoint":{"Port":10250}},"nodeInfo":{"machineID":"ec2d3362029642b9b8a2cb822c33b5db","systemUUID":"EC2D3362-0296-42B9-B8A2-CB822C33B5DB","bootID":"25c585bc-acbd-4a0e-bbe1-a99b8f545565","kernelVersion":"4.15.0-1039-aws","osImage":"Ubuntu 18.04.2 LTS","containerRuntimeVersion":"docker://18.6.3","kubeletVersion":"v1.14.2","kubeProxyVersion":"v1.14.2","operatingSystem":"linux","architecture":"amd64"},"images":[{"names":["registry.example.com/cybervision/pregsense-user-management-service@sha256:e487a407cfaa96fa00f4d40a71e2792d26db1ad72843d9302588d18b0fb23326","registry.example.com/cybervision/pregsense-user-management-service:2.0.0-37765"],"sizeBytes":1268651197},{"names":["registry.example.com/cybervision/usability-data-extractor-service@sha256:e22df292989e525a9339b690d6d6a8e14134bb5ea6a06235691c019e11135f51","registry.example.com/cybervision/usability-data-extractor-service:2.0.0-38072"],"sizeBytes":310003340},{"names":["602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni@sha256:a6d23b9fb3d4ba549321e32a28c42d8e79da203897072e93874472ab9e80b768","602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5"],"sizeBytes":263850871},{"names":["k8s.gcr.io/kube-proxy@sha256:c91687ff6145f7fcdc7d8b3da3c530a9a9b50f0734c7a945a0d9c18fc3790dbc","k8s.gcr.io/kube-proxy:v1.14.2"],"sizeBytes":82106236},{"names":["registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","registry.example.com/ce/utilities/mysql-client:latest"],"sizeBytes":38388577},{"names":["jtblin/kube2iam@sha256:92363f1c52fe5f433487b35c3f9c242e4733717ef7ac88c7137fc3824cfad4d3","jtblin/kube2iam:0.10.8"],"sizeBytes":34303129},{"names":["k8s.gcr.io/pause-amd64@sha256:4a1c4b21597c1b4415bdbecb28a3296c6b5e23ca4f9feeb599860a1dac6a0108","k8s.gcr.io/pause-amd64:3.2"],"sizeBytes":682696}]}}]}
I1104 15:54:53.550757 12586 s3fs.go:327] Listing objects in S3 bucket "example-dev-state" with prefix "kops/example.com/instancegroup/"
I1104 15:54:53.729190 12586 s3fs.go:355] Listed files in s3://example-dev-state/kops/example.com/instancegroup: [s3://example-dev-state/kops/example.com/instancegroup/algo s3://example-dev-state/kops/example.com/instancegroup/bastions s3://example-dev-state/kops/example.com/instancegroup/master-us-east-1f s3://example-dev-state/kops/example.com/instancegroup/nodes]
I1104 15:54:53.729299 12586 s3fs.go:290] Reading file "s3://example-dev-state/kops/example.com/instancegroup/algo"
I1104 15:54:53.924145 12586 s3fs.go:290] Reading file "s3://example-dev-state/kops/example.com/instancegroup/bastions"
I1104 15:54:54.130189 12586 s3fs.go:290] Reading file "s3://example-dev-state/kops/example.com/instancegroup/master-us-east-1f"
I1104 15:54:54.314853 12586 s3fs.go:290] Reading file "s3://example-dev-state/kops/example.com/instancegroup/nodes"
I1104 15:54:54.509023 12586 aws_cloud.go:1340] Querying EC2 for all valid zones in region "us-east-1"
I1104 15:54:54.679837 12586 request_logger.go:45] AWS request: ec2/DescribeAvailabilityZones
I1104 15:54:55.749601 12586 resources.go:36] Listing all resources
I1104 15:54:55.749655 12586 resources.go:58] Listing all Elastigroup resources
I1104 15:54:55.749981 12586 spotinst.go:80] SPOTINST: Request "GET https://api.spotinst.io/aws/ec2/group?accountId=act-*****" details:
---[ REQUEST ]---------------------------------------
GET /aws/ec2/group?accountId=act-***** HTTP/1.1
Host: api.spotinst.io
User-Agent: kubernetes-kops/1.18.2 spotinst-sdk-go/1.49.0 (go1.13.9; linux; amd64)
Accept: application/json
Authorization: Bearer ****
Content-Type: application/json
Accept-Encoding: gzip
-----------------------------------------------------
I1104 15:54:56.955900 12586 spotinst.go:80] SPOTINST: Response "GET https://api.spotinst.io/aws/ec2/group?accountId=act-*****" details:
---[ RESPONSE ]----------------------------------------
HTTP/1.1 200 OK
Content-Length: 139539
Access-Control-Allow-Headers: Origin,Accept,Content-Type,Authorization,X-CSRF-Token
Access-Control-Allow-Methods: GET,POST,DELETE,PUT
Access-Control-Allow-Origin: *
Connection: keep-alive
Content-Type: application/json; charset=utf-8
Date: Wed, 04 Nov 2020 13:54:56 GMT
X-Download-Options: noopen
X-Frame-Options: SAMEORIGIN
X-Ratelimit-Limit: 300
X-Ratelimit-Remaining: 299
X-Request-Id: d8a37d82-bda0-4692-a251-c9dbc165a6c0
X-Response-Time: 31ms
{
"request": {
"id": "d8a37d82-bda0-4692-a251-c9dbc165a6c0",
"url": "/aws/ec2/group",
"method": "GET",
"timestamp": "2020-11-04T13:54:56.423Z"
},
"response": {
"status": {
"code": 200,
"message": "OK"
},
"kind": "spotinst:aws:ec2:group",
"items": [
{
"id": "sig-****",
"name": "master-us-east-1c.masters.example.com",
"description": "master-us-east-1c.masters.example.com",
"capacity": {
"minimum": 1,
"maximum": 1,
"target": 1,
"unit": "instance"
},
"strategy": {
"risk": 0,
"onDemandCount": null,
"availabilityVsCost": "balanced",
"drainingTimeout": 120,
"utilizeReservedInstances": true,
"fallbackToOd": true,
"scalingStrategy": {}
},
"compute": {
"instanceTypes": {
"ondemand": "m5a.large",
"spot": [
"m5a.large",
"m5.large",
"m4.large"
]
},
"availabilityZones": [
{
"name": "us-east-1c",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
}
],
"product": "Linux/UNIX",
"launchSpecification": {
"loadBalancerNames": null,
"loadBalancersConfig": {
"loadBalancers": [
{
"name": "api-dev-example-com-vo1g1r",
"type": "CLASSIC"
}
]
},
"securityGroupIds": [
"sg-0c04097ebbe0cfa7f"
],
"monitoring": false,
"ebsOptimized": false,
"imageId": "ami-024a64a6685d05041",
"iamRole": {
"name": "masters.example.com",
"arn": null
},
"keyPair": "kubernetes.example.com-90:b9:67:c4:09:c3:53:a3:b4:9a:82:f6:b3:a6:22:fe",
"userData": "..."
"shutdownScript": null,
"blockDeviceMappings": [
{
"deviceName": "/dev/sda1",
"ebs": {
"deleteOnTermination": true,
"volumeSize": 64,
"volumeType": "GP2"
}
}
],
"tags": [
{
"tagKey": "Name",
"tagValue": "master-us-east-1c.masters.example.com"
},
{
"tagKey": "KubernetesCluster",
"tagValue": "example.com"
},
{
"tagKey": "kubernetes.io/cluster/example.com",
"tagValue": "owned"
},
{
"tagKey": "env",
"tagValue": "dev"
},
{
"tagKey": "k8s.io/cluster-autoscaler/node-template/label/kops.k8s.io/instancegroup",
"tagValue": "master-us-east-1c"
},
{
"tagKey": "k8s.io/role/master",
"tagValue": "1"
},
{
"tagKey": "kops.k8s.io/instancegroup",
"tagValue": "master-us-east-1c"
}
]
}
},
"scaling": {},
"scheduling": {},
"thirdPartiesIntegration": {
"kubernetes": {
"integrationMode": "pod",
"clusterIdentifier": "example.com",
"autoScale": {
"isEnabled": false,
"isAutoConfig": true
}
}
},
"multai": null,
"createdAt": "2019-04-14T07:44:27.000Z",
"updatedAt": "2020-10-14T10:02:58.000Z"
},
{
"id": "sig-****",
"name": "master-us-east-1f.masters.example.com",
"description": "master-us-east-1f.masters.example.com",
"capacity": {
"minimum": 1,
"maximum": 1,
"target": 1,
"unit": "instance"
},
"strategy": {
"risk": 0,
"onDemandCount": null,
"availabilityVsCost": "balanced",
"drainingTimeout": 120,
"utilizeReservedInstances": true,
"fallbackToOd": true,
"scalingStrategy": {}
},
"compute": {
"instanceTypes": {
"ondemand": "m5a.large",
"spot": [
"m5a.large",
"m5.large",
"m4.large"
]
},
"availabilityZones": [
{
"name": "us-east-1f",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
}
],
"product": "Linux/UNIX",
"launchSpecification": {
"loadBalancerNames": null,
"loadBalancersConfig": {
"loadBalancers": [
{
"name": "api-dev-example-com-vo1g1r",
"type": "CLASSIC"
}
]
},
"securityGroupIds": [
"sg-0c04097ebbe0cfa7f"
],
"monitoring": false,
"ebsOptimized": false,
"imageId": "ami-024a64a6685d05041",
"iamRole": {
"name": "masters.example.com",
"arn": null
},
"keyPair": "kubernetes.example.com-90:b9:67:c4:09:c3:53:a3:b4:9a:82:f6:b3:a6:22:fe",
"userData": "..."
"shutdownScript": null,
"blockDeviceMappings": [
{
"deviceName": "/dev/sda1",
"ebs": {
"deleteOnTermination": true,
"volumeSize": 64,
"volumeType": "GP2"
}
}
],
"tags": [
{
"tagKey": "KubernetesCluster",
"tagValue": "example.com"
},
{
"tagKey": "kubernetes.io/cluster/example.com",
"tagValue": "owned"
},
{
"tagKey": "env",
"tagValue": "dev"
},
{
"tagKey": "k8s.io/cluster-autoscaler/node-template/label/kops.k8s.io/instancegroup",
"tagValue": "master-us-east-1f"
},
{
"tagKey": "k8s.io/role/master",
"tagValue": "1"
},
{
"tagKey": "kops.k8s.io/instancegroup",
"tagValue": "master-us-east-1f"
},
{
"tagKey": "Name",
"tagValue": "master-us-east-1f.masters.example.com"
}
]
}
},
"scaling": {},
"scheduling": {},
"thirdPartiesIntegration": {
"kubernetes": {
"integrationMode": "pod",
"clusterIdentifier": "example.com",
"autoScale": {
"isEnabled": false,
"down": {
"evaluationPeriods": 3
},
"headroom": {
"cpuPerUnit": 0,
"memoryPerUnit": 0,
"gpuPerUnit": 0,
"numOfUnits": 0
},
"isAutoConfig": false
}
}
},
"multai": null,
"createdAt": "2019-04-14T07:44:38.000Z",
"updatedAt": "2020-10-14T10:07:30.000Z"
},
{
"id": "sig-****",
"name": "bastions.example.com",
"description": "bastions.example.com",
"capacity": {
"minimum": 1,
"maximum": 1,
"target": 1,
"unit": "instance"
},
"strategy": {
"risk": 100,
"onDemandCount": null,
"availabilityVsCost": "balanced",
"drainingTimeout": 120,
"lifetimePeriod": "days",
"utilizeReservedInstances": true,
"fallbackToOd": true,
"scalingStrategy": {},
"persistence": {},
"revertToSpot": {
"performAt": "always"
}
},
"compute": {
"instanceTypes": {
"ondemand": "t3a.nano",
"spot": [
"t3a.nano",
"t3.nano",
"t3a.micro",
"t3.micro",
"t2.micro",
"t3a.small",
"t3.small",
"t2.small"
]
},
"availabilityZones": [
{
"name": "us-east-1b",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
},
{
"name": "us-east-1c",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
},
{
"name": "us-east-1f",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
}
],
"product": "Linux/UNIX",
"launchSpecification": {
"loadBalancerNames": null,
"loadBalancersConfig": {
"loadBalancers": [
{
"name": "bastion-dev-example-com-mknckd",
"type": "CLASSIC"
}
]
},
"healthCheckType": null,
"securityGroupIds": [
"sg-0c03575c501eeb4f8"
],
"monitoring": false,
"ebsOptimized": false,
"imageId": "ami-024a64a6685d05041",
"iamRole": {
"name": "bastions.example.com",
"arn": null
},
"keyPair": "kubernetes.example.com-90:b9:67:c4:09:c3:53:a3:b4:9a:82:f6:b3:a6:22:fe",
"userData": "..."
"shutdownScript": null,
"blockDeviceMappings": [
{
"deviceName": "/dev/sda1",
"ebs": {
"deleteOnTermination": true,
"volumeSize": 32,
"volumeType": "GP2"
}
}
],
"networkInterfaces": [
{
"deviceIndex": 0,
"associatePublicIpAddress": true,
"deleteOnTermination": true,
"associateIpv6Address": false
}
],
"tags": [
{
"tagKey": "kops.k8s.io/instancegroup",
"tagValue": "bastions"
},
{
"tagKey": "Name",
"tagValue": "bastions.example.com"
},
{
"tagKey": "KubernetesCluster",
"tagValue": "example.com"
},
{
"tagKey": "kubernetes.io/cluster/example.com",
"tagValue": "owned"
},
{
"tagKey": "env",
"tagValue": "dev"
},
{
"tagKey": "k8s.io/cluster-autoscaler/node-template/label/kops.k8s.io/instancegroup",
"tagValue": "bastions"
},
{
"tagKey": "k8s.io/role/bastion",
"tagValue": "1"
}
],
"tenancy": "default"
}
},
"scaling": {},
"scheduling": {},
"thirdPartiesIntegration": {},
"multai": null,
"createdAt": "2019-04-14T07:44:38.000Z",
"updatedAt": "2020-10-11T10:59:26.000Z"
},
{
"id": "sig-****",
"name": "r-nodes.example.com",
"description": "r-nodes.example.com",
"capacity": {
"minimum": 5,
"maximum": 30,
"target": 21,
"unit": "instance"
},
"strategy": {
"risk": 0,
"onDemandCount": 40,
"availabilityVsCost": "equalAzDistribution",
"drainingTimeout": 120,
"utilizeReservedInstances": true,
"fallbackToOd": true,
"scalingStrategy": {}
},
"compute": {
"instanceTypes": {
"ondemand": "m5a.large",
"spot": [
"m5a.large",
"m5a.xlarge",
"m5a.2xlarge",
"m5.large",
"m5.xlarge",
"m5.2xlarge",
"m4.large",
"m4.xlarge",
"m4.2xlarge",
"t3.micro",
"t3a.micro",
"t3.small",
"t3a.small",
"t3.medium",
"t3a.medium",
"t3.large",
"t3a.large",
"t3.xlarge",
"t3a.xlarge",
"t3.2xlarge",
"t3a.2xlarge",
"r5a.large",
"r5a.xlarge",
"r5a.2xlarge",
"r5.large",
"r5.xlarge",
"r5.2xlarge",
"c5.large",
"c5.xlarge",
"c5.2xlarge"
]
},
"availabilityZones": [
{
"name": "us-east-1b",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
},
{
"name": "us-east-1c",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
},
{
"name": "us-east-1f",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
}
],
"product": "Linux/UNIX",
"launchSpecification": {
"loadBalancerNames": null,
"loadBalancersConfig": {
"loadBalancers": null
},
"healthCheckType": "K8S_NODE",
"securityGroupIds": [
"sg-0655cde58fc563d18"
],
"monitoring": false,
"ebsOptimized": false,
"imageId": "ami-024a64a6685d05041",
"iamRole": {
"name": "nodes.example.com",
"arn": null
},
"keyPair": "kubernetes.example.com-90:b9:67:c4:09:c3:53:a3:b4:9a:82:f6:b3:a6:22:fe",
"userData": "..."
"shutdownScript": null,
"blockDeviceMappings": [
{
"deviceName": "/dev/sda1",
"ebs": {
"deleteOnTermination": true,
"volumeSize": 128,
"volumeType": "GP2"
}
}
],
"networkInterfaces": [
{
"description": "eth0",
"deviceIndex": 0,
"associatePublicIpAddress": false,
"deleteOnTermination": true,
"associateIpv6Address": false
}
],
"tags": [
{
"tagKey": "env",
"tagValue": "dev"
},
{
"tagKey": "k8s.io/cluster-autoscaler/node-template/label/kops.k8s.io/instancegroup",
"tagValue": "r-nodes"
},
{
"tagKey": "k8s.io/role/node",
"tagValue": "1"
},
{
"tagKey": "kops.k8s.io/instancegroup",
"tagValue": "r-nodes"
},
{
"tagKey": "Name",
"tagValue": "r-nodes.example.com"
},
{
"tagKey": "KubernetesCluster",
"tagValue": "example.com"
},
{
"tagKey": "kubernetes.io/cluster/example.com",
"tagValue": "owned"
}
]
}
},
"scaling": {},
"scheduling": {},
"thirdPartiesIntegration": {
"kubernetes": {
"integrationMode": "pod",
"clusterIdentifier": "example.com",
"autoScale": {
"isEnabled": true,
"cooldown": 300,
"headroom": {
"cpuPerUnit": 0,
"memoryPerUnit": 0,
"gpuPerUnit": 0,
"numOfUnits": 0
},
"isAutoConfig": false
}
}
},
"multai": null,
"createdAt": "2020-01-07T09:51:47.000Z",
"updatedAt": "2020-11-04T11:37:12.000Z"
},
{
"id": "sig-****",
"name": "algo.example.com",
"description": "algo.example.com",
"capacity": {
"minimum": 1,
"maximum": 8,
"target": 3,
"unit": "instance"
},
"strategy": {
"risk": 0,
"onDemandCount": 60,
"availabilityVsCost": "balanced",
"drainingTimeout": 120,
"utilizeReservedInstances": true,
"fallbackToOd": true,
"scalingStrategy": {}
},
"compute": {
"instanceTypes": {
"ondemand": "c5.2xlarge",
"spot": [
"c5.2xlarge"
]
},
"availabilityZones": [
{
"name": "us-east-1b",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
},
{
"name": "us-east-1c",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
},
{
"name": "us-east-1f",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
}
],
"product": "Linux/UNIX",
"launchSpecification": {
"loadBalancerNames": null,
"loadBalancersConfig": {
"loadBalancers": null
},
"securityGroupIds": [
"sg-0655cde58fc563d18"
],
"monitoring": false,
"ebsOptimized": false,
"imageId": "ami-024a64a6685d05041",
"iamRole": {
"name": "nodes.example.com",
"arn": null
},
"keyPair": "kubernetes.example.com-90:b9:67:c4:09:c3:53:a3:b4:9a:82:f6:b3:a6:22:fe",
"userData": "..."
"shutdownScript": null,
"blockDeviceMappings": [
{
"deviceName": "/dev/sda1",
"ebs": {
"deleteOnTermination": true,
"volumeSize": 128,
"volumeType": "GP2"
}
}
],
"tags": [
{
"tagKey": "KubernetesCluster",
"tagValue": "example.com"
},
{
"tagKey": "kubernetes.io/cluster/example.com",
"tagValue": "owned"
},
{
"tagKey": "k8s.io/cluster-autoscaler/node-template/label/dedicated",
"tagValue": "algo"
},
{
"tagKey": "k8s.io/cluster-autoscaler/node-template/label/kops.k8s.io/instancegroup",
"tagValue": "algo"
},
{
"tagKey": "Name",
"tagValue": "algo.example.com"
},
{
"tagKey": "env",
"tagValue": "dev"
},
{
"tagKey": "k8s.io/cluster-autoscaler/node-template/taint/dedicated",
"tagValue": "algo:NoSchedule"
},
{
"tagKey": "k8s.io/role/node",
"tagValue": "1"
},
{
"tagKey": "kops.k8s.io/instancegroup",
"tagValue": "algo"
}
]
}
},
"scaling": {},
"scheduling": {},
"thirdPartiesIntegration": {
"kubernetes": {
"integrationMode": "pod",
"clusterIdentifier": "example.com",
"autoScale": {
"isEnabled": true,
"cooldown": 300,
"headroom": {
"cpuPerUnit": 0,
"memoryPerUnit": 0,
"gpuPerUnit": 0,
"numOfUnits": 0
},
"labels": [
{
"key": "dedicated",
"value": "algo"
}
],
"isAutoConfig": false
}
}
},
"multai": null,
"createdAt": "2019-04-14T07:43:51.000Z",
"updatedAt": "2020-11-04T09:42:12.000Z"
},
{
"id": "sig-****",
"name": "dev-tools.example.com",
"description": "dev-tools.example.com",
"capacity": {
"minimum": 3,
"maximum": 5,
"target": 3,
"unit": "instance"
},
"strategy": {
"risk": 100,
"onDemandCount": 3,
"availabilityVsCost": "balanced",
"drainingTimeout": 120,
"utilizeReservedInstances": true,
"fallbackToOd": true,
"scalingStrategy": {}
},
"compute": {
"instanceTypes": {
"ondemand": "m5a.large",
"spot": [
"m5a.large",
"m5a.xlarge",
"m5a.2xlarge",
"m5.large",
"m5.xlarge",
"m5.2xlarge",
"m4.large",
"m4.xlarge",
"m4.2xlarge",
"t3.micro",
"t3a.micro",
"t3.small",
"t3a.small",
"t3.medium",
"t3a.medium",
"t3.large",
"t3a.large",
"t3.xlarge",
"t3a.xlarge",
"t3.2xlarge",
"t3a.2xlarge",
"r5a.large",
"r5a.xlarge",
"r5a.2xlarge",
"r5.large",
"r5.xlarge",
"r5.2xlarge",
"c5.large",
"c5.xlarge",
"c5.2xlarge"
]
},
"availabilityZones": [
{
"name": "us-east-1b",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
},
{
"name": "us-east-1c",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
},
{
"name": "us-east-1f",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
}
],
"product": "Linux/UNIX",
"launchSpecification": {
"loadBalancerNames": null,
"loadBalancersConfig": {
"loadBalancers": null
},
"securityGroupIds": [
"sg-0655cde58fc563d18"
],
"monitoring": false,
"ebsOptimized": false,
"imageId": "ami-024a64a6685d05041",
"iamRole": {
"name": "nodes.example.com",
"arn": null
},
"keyPair": "kubernetes.example.com-90:b9:67:c4:09:c3:53:a3:b4:9a:82:f6:b3:a6:22:fe",
"userData": "..."
"shutdownScript": null,
"blockDeviceMappings": [
{
"deviceName": "/dev/sda1",
"ebs": {
"deleteOnTermination": true,
"volumeSize": 128,
"volumeType": "GP2"
}
}
],
"tags": [
{
"tagKey": "k8s.io/cluster-autoscaler/node-template/label/dedicated",
"tagValue": "dev-tools"
},
{
"tagKey": "k8s.io/cluster-autoscaler/node-template/taint/dedicated",
"tagValue": "dev-tools:NoSchedule"
},
{
"tagKey": "k8s.io/role/node",
"tagValue": "1"
},
{
"tagKey": "kops.k8s.io/instancegroup",
"tagValue": "dev-tools"
},
{
"tagKey": "Name",
"tagValue": "dev-tools.example.com"
},
{
"tagKey": "KubernetesCluster",
"tagValue": "example.com"
},
{
"tagKey": "env",
"tagValue": "dev"
},
{
"tagKey": "kubernetes.io/cluster/example.com",
"tagValue": "owned"
},
{
"tagKey": "k8s.io/cluster-autoscaler/node-template/label/kops.k8s.io/instancegroup",
"tagValue": "dev-tools"
}
]
}
},
"scaling": {},
"scheduling": {},
"thirdPartiesIntegration": {
"kubernetes": {
"integrationMode": "pod",
"clusterIdentifier": "example.com",
"autoScale": {
"isEnabled": true,
"cooldown": 300,
"headroom": {
"cpuPerUnit": 0,
"memoryPerUnit": 0,
"gpuPerUnit": 0,
"numOfUnits": 0
},
"labels": [
{
"key": "dedicated",
"value": "dev-tools"
}
],
"isAutoConfig": false
}
}
},
"multai": null,
"createdAt": "2019-04-14T07:43:58.000Z",
"updatedAt": "2020-10-12T20:04:14.000Z"
},
{
"id": "sig-****",
"name": "bastions.example.com",
"description": "bastions.example.com",
"capacity": {
"minimum": 1,
"maximum": 1,
"target": 1,
"unit": "instance"
},
"strategy": {
"risk": 100,
"availabilityVsCost": "balanced",
"utilizeReservedInstances": true,
"fallbackToOd": true
},
"compute": {
"instanceTypes": {
"ondemand": "m5a.large",
"spot": [
"m5a.large",
"m5a.xlarge",
"m5a.2xlarge",
"m5.large",
"m5.xlarge",
"m5.2xlarge",
"m4.large",
"m4.xlarge",
"m4.2xlarge",
"t3.small",
"t3a.small",
"t3.medium",
"t3a.medium",
"t3.large",
"t3a.large",
"t3.xlarge",
"t3a.xlarge",
"t3.2xlarge",
"t3a.2xlarge",
"r5a.large",
"r5a.xlarge",
"r5a.2xlarge",
"r5.large",
"r5.xlarge",
"r5.2xlarge",
"c5.large",
"c5.xlarge",
"c5.2xlarge",
"c5a.large",
"c5a.xlarge",
"c5a.2xlarge"
]
},
"availabilityZones": [
{
"name": "us-east-1f",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
}
],
"product": "Linux/UNIX",
"launchSpecification": {
"loadBalancersConfig": {
"loadBalancers": [
{
"name": "bastion-test-example-com-ogksqp",
"type": "CLASSIC"
}
]
},
"healthCheckType": "K8S_NODE",
"securityGroupIds": [
"sg-0e55267107f6e0e84"
],
"monitoring": false,
"imageId": "ami-024a64a6685d05041",
"iamRole": {
"name": "bastions.example.com",
"arn": null
},
"keyPair": "kubernetes.example.com-73:e8:15:08:29:5d:99:c2:94:68:5b:e5:e9:f7:25:ab",
"blockDeviceMappings": [
{
"deviceName": "/dev/sda1",
"ebs": {
"deleteOnTermination": true,
"volumeSize": 32,
"volumeType": "GP2"
}
}
],
"networkInterfaces": [
{
"description": "eth0",
"deviceIndex": 0,
"associatePublicIpAddress": true,
"deleteOnTermination": true,
"associateIpv6Address": false
}
],
"tags": [
{
"tagKey": "k8s.io/role/bastion",
"tagValue": "1"
},
{
"tagKey": "kops.k8s.io/instancegroup",
"tagValue": "bastions"
},
{
"tagKey": "Name",
"tagValue": "bastions.example.com"
},
{
"tagKey": "KubernetesCluster",
"tagValue": "example.com"
},
{
"tagKey": "kubernetes.io/cluster/example.com",
"tagValue": "owned"
},
{
"tagKey": "env",
"tagValue": "test"
},
{
"tagKey": "k8s.io/cluster-autoscaler/node-template/label/kops.k8s.io/instancegroup",
"tagValue": "bastions"
}
]
}
},
"createdAt": "2019-11-19T16:49:13.000Z",
"updatedAt": "2020-10-14T11:37:54.000Z"
},
{
"id": "sig-****",
"name": "nodes.example.com",
"description": "nodes.example.com",
"capacity": {
"minimum": 0,
"maximum": 17,
"target": 7,
"unit": "instance"
},
"strategy": {
"risk": 100,
"onDemandCount": null,
"availabilityVsCost": "balanced",
"drainingTimeout": 120,
"lifetimePeriod": "days",
"utilizeReservedInstances": true,
"fallbackToOd": true,
"scalingStrategy": {},
"persistence": {},
"revertToSpot": {
"performAt": "always"
}
},
"compute": {
"instanceTypes": {
"ondemand": "m5a.large",
"spot": [
"m5a.large",
"m5a.xlarge",
"m5a.2xlarge",
"m5.large",
"m5.xlarge",
"m5.2xlarge",
"m4.large",
"m4.xlarge",
"m4.2xlarge",
"t3.small",
"t3a.small",
"t3.medium",
"t3a.medium",
"t3.large",
"t3a.large",
"t3.xlarge",
"t3a.xlarge",
"t3.2xlarge",
"t3a.2xlarge",
"r5a.large",
"r5a.xlarge",
"r5a.2xlarge",
"r5.large",
"r5.xlarge",
"r5.2xlarge",
"c5.large",
"c5.xlarge",
"c5.2xlarge",
"c5a.large",
"c5a.xlarge",
"c5a.2xlarge"
]
},
"availabilityZones": [
{
"name": "us-east-1f",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
}
],
"preferredAvailabilityZones": null,
"product": "Linux/UNIX",
"launchSpecification": {
"loadBalancerNames": null,
"loadBalancersConfig": {
"loadBalancers": null
},
"healthCheckType": "K8S_NODE",
"healthCheckGracePeriod": 600,
"securityGroupIds": [
"sg-0300a03f04c61b109"
],
"monitoring": false,
"ebsOptimized": false,
"imageId": "ami-024a64a6685d05041",
"iamRole": {
"name": "nodes.example.com",
"arn": null
},
"keyPair": "kubernetes.example.com-73:e8:15:08:29:5d:99:c2:94:68:5b:e5:e9:f7:25:ab",
"userData": "..."
"shutdownScript": null,
"blockDeviceMappings": [
{
"deviceName": "/dev/sda1",
"ebs": {
"deleteOnTermination": true,
"volumeSize": 128,
"volumeType": "GP2"
}
}
],
"networkInterfaces": [
{
"description": "eth0",
"deviceIndex": 0,
"associatePublicIpAddress": false,
"deleteOnTermination": true,
"associateIpv6Address": false
}
],
"tags": [
{
"tagKey": "kubernetes.io/cluster/example.com",
"tagValue": "owned"
},
{
"tagKey": "env",
"tagValue": "test"
},
{
"tagKey": "k8s.io/cluster-autoscaler/node-template/label/kops.k8s.io/instancegroup",
"tagValue": "nodes"
},
{
"tagKey": "k8s.io/role/node",
"tagValue": "1"
},
{
"tagKey": "kops.k8s.io/instancegroup",
"tagValue": "nodes"
},
{
"tagKey": "Name",
"tagValue": "nodes.example.com"
},
{
"tagKey": "KubernetesCluster",
"tagValue": "example.com"
}
],
"tenancy": "default"
}
},
"scaling": {},
"scheduling": {},
"thirdPartiesIntegration": {
"kubernetes": {
"integrationMode": "pod",
"clusterIdentifier": "example.com",
"autoScale": {
"isEnabled": true,
"cooldown": 300,
"headroom": {
"cpuPerUnit": 0,
"memoryPerUnit": 0,
"gpuPerUnit": 0,
"numOfUnits": 0
},
"isAutoConfig": false
}
}
},
"multai": null,
"createdAt": "2019-11-19T16:48:56.000Z",
"updatedAt": "2020-11-04T13:17:13.000Z"
},
{
"id": "sig-****",
"name": "algo.example.com",
"description": "algo.example.com",
"capacity": {
"minimum": 0,
"maximum": 8,
"target": 1,
"unit": "instance"
},
"strategy": {
"risk": 100,
"availabilityVsCost": "balanced",
"utilizeReservedInstances": true,
"fallbackToOd": true
},
"compute": {
"instanceTypes": {
"ondemand": "m5a.large",
"spot": [
"m5a.large",
"m5a.xlarge",
"m5a.2xlarge",
"m5.large",
"m5.xlarge",
"m5.2xlarge",
"m4.large",
"m4.xlarge",
"m4.2xlarge",
"t3.small",
"t3a.small",
"t3.medium",
"t3a.medium",
"t3.large",
"t3a.large",
"t3.xlarge",
"t3a.xlarge",
"t3.2xlarge",
"t3a.2xlarge",
"r5a.large",
"r5a.xlarge",
"r5a.2xlarge",
"r5.large",
"r5.xlarge",
"r5.2xlarge",
"c5.large",
"c5.xlarge",
"c5.2xlarge",
"c5a.large",
"c5a.xlarge",
"c5a.2xlarge"
]
},
"availabilityZones": [
{
"name": "us-east-1f",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
}
],
"product": "Linux/UNIX",
"launchSpecification": {
"securityGroupIds": [
"sg-0300a03f04c61b109"
],
"monitoring": false,
"imageId": "ami-024a64a6685d05041",
"iamRole": {
"name": "nodes.example.com",
"arn": null
},
"keyPair": "kubernetes.example.com-73:e8:15:08:29:5d:99:c2:94:68:5b:e5:e9:f7:25:ab",
"userData": "..."
"blockDeviceMappings": [
{
"deviceName": "/dev/sda1",
"ebs": {
"deleteOnTermination": true,
"volumeSize": 128,
"volumeType": "GP2"
}
}
],
"tags": [
{
"tagKey": "KubernetesCluster",
"tagValue": "example.com"
},
{
"tagKey": "kubernetes.io/cluster/example.com",
"tagValue": "owned"
},
{
"tagKey": "env",
"tagValue": "test"
},
{
"tagKey": "k8s.io/cluster-autoscaler/node-template/label/dedicated",
"tagValue": "algo"
},
{
"tagKey": "k8s.io/cluster-autoscaler/node-template/label/kops.k8s.io/instancegroup",
"tagValue": "algo"
},
{
"tagKey": "k8s.io/role/node",
"tagValue": "1"
},
{
"tagKey": "Name",
"tagValue": "algo.example.com"
},
{
"tagKey": "k8s.io/cluster-autoscaler/node-template/taint/dedicated",
"tagValue": "algo:NoSchedule"
},
{
"tagKey": "kops.k8s.io/instancegroup",
"tagValue": "algo"
}
]
}
},
"thirdPartiesIntegration": {
"kubernetes": {
"integrationMode": "pod",
"clusterIdentifier": "example.com",
"autoScale": {
"isEnabled": true,
"cooldown": 300,
"headroom": {
"cpuPerUnit": 0,
"memoryPerUnit": 0,
"gpuPerUnit": 0,
"numOfUnits": 0
},
"labels": [
{
"key": "dedicated",
"value": "algo"
}
],
"isAutoConfig": false
}
}
},
"createdAt": "2020-08-18T11:14:10.000Z",
"updatedAt": "2020-11-04T13:17:14.000Z"
},
{
"id": "sig-****",
"name": "master-us-east-1b.masters.example.com",
"description": "master-us-east-1b.masters.example.com",
"capacity": {
"minimum": 1,
"maximum": 1,
"target": 1,
"unit": "instance"
},
"strategy": {
"risk": 0,
"onDemandCount": null,
"availabilityVsCost": "balanced",
"drainingTimeout": 120,
"utilizeReservedInstances": true,
"fallbackToOd": true,
"scalingStrategy": {}
},
"compute": {
"instanceTypes": {
"ondemand": "m5a.large",
"spot": [
"m5a.large",
"m5.large",
"m4.large"
]
},
"availabilityZones": [
{
"name": "us-east-1b",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
}
],
"product": "Linux/UNIX",
"launchSpecification": {
"loadBalancerNames": null,
"loadBalancersConfig": {
"loadBalancers": [
{
"name": "api-dev-example-com-vo1g1r",
"type": "CLASSIC"
}
]
},
"securityGroupIds": [
"sg-0c04097ebbe0cfa7f"
],
"monitoring": false,
"ebsOptimized": false,
"imageId": "ami-024a64a6685d05041",
"iamRole": {
"name": "masters.example.com",
"arn": null
},
"keyPair": "kubernetes.example.com-90:b9:67:c4:09:c3:53:a3:b4:9a:82:f6:b3:a6:22:fe",
"userData": "..."
"shutdownScript": null,
"blockDeviceMappings": [
{
"deviceName": "/dev/sda1",
"ebs": {
"deleteOnTermination": true,
"volumeSize": 64,
"volumeType": "GP2"
}
}
],
"tags": [
{
"tagKey": "kubernetes.io/cluster/example.com",
"tagValue": "owned"
},
{
"tagKey": "env",
"tagValue": "dev"
},
{
"tagKey": "k8s.io/cluster-autoscaler/node-template/label/kops.k8s.io/instancegroup",
"tagValue": "master-us-east-1b"
},
{
"tagKey": "k8s.io/role/master",
"tagValue": "1"
},
{
"tagKey": "kops.k8s.io/instancegroup",
"tagValue": "master-us-east-1b"
},
{
"tagKey": "Name",
"tagValue": "master-us-east-1b.masters.example.com"
},
{
"tagKey": "KubernetesCluster",
"tagValue": "example.com"
}
]
}
},
"scaling": {},
"scheduling": {},
"thirdPartiesIntegration": {
"kubernetes": {
"integrationMode": "pod",
"clusterIdentifier": "example.com",
"autoScale": {
"isEnabled": false,
"down": {
"evaluationPeriods": 3
},
"headroom": {
"cpuPerUnit": 0,
"memoryPerUnit": 0,
"gpuPerUnit": 0,
"numOfUnits": 0
},
"isAutoConfig": false
}
}
},
"multai": null,
"createdAt": "2019-04-14T07:44:38.000Z",
"updatedAt": "2020-10-14T10:08:27.000Z"
},
{
"id": "sig-****",
"name": "master-us-east-1f.masters.example.com",
"description": "master-us-east-1f.masters.example.com",
"capacity": {
"minimum": 1,
"maximum": 1,
"target": 1,
"unit": "instance"
},
"strategy": {
"risk": 0,
"onDemandCount": null,
"availabilityVsCost": "balanced",
"drainingTimeout": 120,
"utilizeReservedInstances": true,
"fallbackToOd": true,
"scalingStrategy": {}
},
"compute": {
"instanceTypes": {
"ondemand": "m5a.large",
"spot": [
"m5a.large",
"m5a.xlarge",
"m5a.2xlarge",
"m5.large",
"m5.xlarge",
"m5.2xlarge",
"m4.large",
"m4.xlarge",
"m4.2xlarge",
"t3.small",
"t3a.small",
"t3.medium",
"t3a.medium",
"t3.large",
"t3a.large",
"t3.xlarge",
"t3a.xlarge",
"t3.2xlarge",
"t3a.2xlarge",
"r5a.large",
"r5a.xlarge",
"r5a.2xlarge",
"r5.large",
"r5.xlarge",
"r5.2xlarge",
"c5.large",
"c5.xlarge",
"c5.2xlarge",
"c5a.large",
"c5a.xlarge",
"c5a.2xlarge"
]
},
"availabilityZones": [
{
"name": "us-east-1f",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
}
],
"product": "Linux/UNIX",
"launchSpecification": {
"loadBalancerNames": null,
"loadBalancersConfig": {
"loadBalancers": [
{
"name": "api-test-example-com-ps2tfr",
"type": "CLASSIC"
}
]
},
"healthCheckType": "K8S_NODE",
"securityGroupIds": [
"sg-0ea9c09b1cf6d2246"
],
"monitoring": false,
"ebsOptimized": false,
"imageId": "ami-024a64a6685d05041",
"iamRole": {
"name": "masters.example.com",
"arn": null
},
"keyPair": "kubernetes.example.com-73:e8:15:08:29:5d:99:c2:94:68:5b:e5:e9:f7:25:ab",
"userData": "..."
"shutdownScript": null,
"blockDeviceMappings": [
{
"deviceName": "/dev/sda1",
"ebs": {
"deleteOnTermination": true,
"volumeSize": 64,
"volumeType": "GP2"
}
}
],
"networkInterfaces": [
{
"description": "eth0",
"deviceIndex": 0,
"associatePublicIpAddress": false,
"deleteOnTermination": true,
"associateIpv6Address": false
}
],
"tags": [
{
"tagKey": "kops.k8s.io/instancegroup",
"tagValue": "master-us-east-1f"
},
{
"tagKey": "Name",
"tagValue": "master-us-east-1f.masters.example.com"
},
{
"tagKey": "KubernetesCluster",
"tagValue": "example.com"
},
{
"tagKey": "kubernetes.io/cluster/example.com",
"tagValue": "owned"
},
{
"tagKey": "env",
"tagValue": "test"
},
{
"tagKey": "k8s.io/cluster-autoscaler/node-template/label/kops.k8s.io/instancegroup",
"tagValue": "master-us-east-1f"
},
{
"tagKey": "k8s.io/role/master",
"tagValue": "1"
}
]
}
},
"scaling": {},
"scheduling": {},
"thirdPartiesIntegration": {
"kubernetes": {
"integrationMode": "pod",
"clusterIdentifier": "example.com",
"autoScale": {
"isEnabled": false,
"cooldown": 300,
"isAutoConfig": true
}
}
},
"multai": null,
"createdAt": "2019-11-19T16:49:11.000Z",
"updatedAt": "2020-11-02T18:29:04.000Z"
}
],
"count": 11
}
}
-------------------------------------------------------
I1104 15:54:56.959980 12586 resources.go:71] Listing all Ocean resources
I1104 15:54:56.960267 12586 spotinst.go:80] SPOTINST: Request "GET https://api.spotinst.io/ocean/aws/k8s/cluster?accountId=act-*****" details:
---[ REQUEST ]---------------------------------------
GET /ocean/aws/k8s/cluster?accountId=act-***** HTTP/1.1
Host: api.spotinst.io
User-Agent: kubernetes-kops/1.18.2 spotinst-sdk-go/1.49.0 (go1.13.9; linux; amd64)
Accept: application/json
Authorization: Bearer ****
Content-Type: application/json
Accept-Encoding: gzip
-----------------------------------------------------
I1104 15:54:57.499428 12586 spotinst.go:80] SPOTINST: Response "GET https://api.spotinst.io/ocean/aws/k8s/cluster?accountId=act-*****" details:
---[ RESPONSE ]----------------------------------------
HTTP/1.1 200 OK
Content-Length: 352
Access-Control-Allow-Headers: Origin,Accept,Content-Type,Authorization,X-CSRF-Token
Access-Control-Allow-Methods: GET,POST,DELETE,PUT
Access-Control-Allow-Origin: *
Connection: keep-alive
Content-Type: application/json; charset=utf-8
Date: Wed, 04 Nov 2020 13:54:57 GMT
X-Download-Options: noopen
X-Frame-Options: SAMEORIGIN
X-Ratelimit-Limit: 300
X-Ratelimit-Remaining: 299
X-Request-Id: 4d22d93c-ac41-44f0-93a3-f67a7003b759
X-Response-Time: 368ms
{
"request": {
"id": "4d22d93c-ac41-44f0-93a3-f67a7003b759",
"url": "/ocean/aws/k8s/cluster?accountId=act-*****",
"method": "GET",
"timestamp": "2020-11-04T13:54:57.387Z"
},
"response": {
"status": {
"code": 200,
"message": "OK"
},
"kind": "spotinst:ocean:aws:k8s",
"items": [],
"count": 0
}
}
-------------------------------------------------------
I1104 15:54:57.499907 12586 resources.go:405] Found group with corresponding instance group: "nodes.example.com"
I1104 15:54:57.499960 12586 resources.go:295] Attempting to fetch all instances of instance group: "nodes.example.com" (id: "sig-****")
I1104 15:54:57.500428 12586 spotinst.go:80] SPOTINST: Request "GET https://api.spotinst.io/aws/ec2/group/sig-****/status?accountId=act-*****" details:
---[ REQUEST ]---------------------------------------
GET /aws/ec2/group/sig-****/status?accountId=act-***** HTTP/1.1
Host: api.spotinst.io
User-Agent: kubernetes-kops/1.18.2 spotinst-sdk-go/1.49.0 (go1.13.9; linux; amd64)
Accept: application/json
Authorization: Bearer ****
Content-Type: application/json
Accept-Encoding: gzip
-----------------------------------------------------
I1104 15:54:57.710212 12586 spotinst.go:80] SPOTINST: Response "GET https://api.spotinst.io/aws/ec2/group/sig-****/status?accountId=act-*****" details:
---[ RESPONSE ]----------------------------------------
HTTP/1.1 200 OK
Content-Length: 3146
Access-Control-Allow-Headers: Origin,Accept,Content-Type,Authorization,X-CSRF-Token
Access-Control-Allow-Methods: GET,POST,DELETE,PUT
Access-Control-Allow-Origin: *
Connection: keep-alive
Content-Type: application/json; charset=utf-8
Date: Wed, 04 Nov 2020 13:54:57 GMT
X-Download-Options: noopen
X-Frame-Options: SAMEORIGIN
X-Ratelimit-Limit: 300
X-Ratelimit-Remaining: 299
X-Request-Id: 0701cf1f-f671-4123-bb53-67acc7cbd8fe
X-Response-Time: 47ms
{
"request": {
"id": "0701cf1f-f671-4123-bb53-67acc7cbd8fe",
"url": "/aws/ec2/group/sig-****/status",
"method": "GET",
"timestamp": "2020-11-04T13:54:57.606Z"
},
"response": {
"status": {
"code": 200,
"message": "OK"
},
"kind": "spotinst:aws:ec2:group",
"items": [
{
"spotInstanceRequestId": "sir-3p4hksgj",
"instanceId": "i-0ffadee0802927c01",
"instanceType": "t3a.2xlarge",
"product": "Linux/UNIX",
"groupId": "sig-****",
"availabilityZone": "us-east-1f",
"privateIp": "10.40.59.224",
"createdAt": "2020-11-04T13:17:13.000Z",
"publicIp": null,
"status": "fulfilled"
},
{
"spotInstanceRequestId": "sir-6h49kq6k",
"instanceId": "i-036e06b204f56f316",
"instanceType": "t3a.xlarge",
"product": "Linux/UNIX",
"groupId": "sig-****",
"availabilityZone": "us-east-1f",
"privateIp": "10.40.56.27",
"createdAt": "2020-11-04T12:40:12.000Z",
"publicIp": null,
"status": "fulfilled"
},
{
"spotInstanceRequestId": "sir-ryr1ka4g",
"instanceId": "i-0e4fb331463f91e5b",
"instanceType": "r5.large",
"product": "Linux/UNIX",
"groupId": "sig-****",
"availabilityZone": "us-east-1f",
"privateIp": "10.40.51.35",
"createdAt": "2020-11-03T17:41:47.000Z",
"publicIp": null,
"status": "fulfilled"
},
{
"spotInstanceRequestId": "sir-v4n9ghqk",
"instanceId": "i-091d1b1a0cf8a3486",
"instanceType": "c5.xlarge",
"product": "Linux/UNIX",
"groupId": "sig-****",
"availabilityZone": "us-east-1f",
"privateIp": "10.40.45.241",
"createdAt": "2020-11-04T12:05:15.000Z",
"publicIp": null,
"status": "fulfilled"
},
{
"spotInstanceRequestId": "sir-xtjsgyzg",
"instanceId": "i-0b738537410c47ce9",
"instanceType": "m5a.xlarge",
"product": "Linux/UNIX",
"groupId": "sig-****",
"availabilityZone": "us-east-1f",
"privateIp": "10.40.42.110",
"createdAt": "2020-11-04T12:48:16.000Z",
"publicIp": null,
"status": "fulfilled"
},
{
"spotInstanceRequestId": "sir-xyn1kmik",
"instanceId": "i-07759285ebe2a969d",
"instanceType": "t3.xlarge",
"product": "Linux/UNIX",
"groupId": "sig-****",
"availabilityZone": "us-east-1f",
"privateIp": "10.40.55.41",
"createdAt": "2020-11-04T12:44:13.000Z",
"publicIp": null,
"status": "fulfilled"
},
{
"spotInstanceRequestId": "sir-y869jykg",
"instanceId": "i-0deead86f7d952607",
"instanceType": "t3a.medium",
"product": "Linux/UNIX",
"groupId": "sig-****",
"availabilityZone": "us-east-1f",
"privateIp": "10.40.57.245",
"createdAt": "2020-11-04T12:01:29.000Z",
"publicIp": null,
"status": "fulfilled"
}
],
"count": 7
}
}
-------------------------------------------------------
I1104 15:54:57.711164 12586 resources.go:377] Adding instance "i-0ffadee0802927c01" (created at: 2020-11-04T13:17:13Z) to instance group: "nodes.example.com" (updated at: 2020-11-04T13:15:13Z)
I1104 15:54:57.711246 12586 resources.go:377] Adding instance "i-036e06b204f56f316" (created at: 2020-11-04T12:40:12Z) to instance group: "nodes.example.com" (updated at: 2020-11-04T13:15:13Z)
I1104 15:54:57.711282 12586 resources.go:377] Adding instance "i-0e4fb331463f91e5b" (created at: 2020-11-03T17:41:47Z) to instance group: "nodes.example.com" (updated at: 2020-11-04T13:15:13Z)
I1104 15:54:57.711323 12586 resources.go:377] Adding instance "i-091d1b1a0cf8a3486" (created at: 2020-11-04T12:05:15Z) to instance group: "nodes.example.com" (updated at: 2020-11-04T13:15:13Z)
I1104 15:54:57.711345 12586 resources.go:377] Adding instance "i-0b738537410c47ce9" (created at: 2020-11-04T12:48:16Z) to instance group: "nodes.example.com" (updated at: 2020-11-04T13:15:13Z)
I1104 15:54:57.711368 12586 resources.go:377] Adding instance "i-07759285ebe2a969d" (created at: 2020-11-04T12:44:13Z) to instance group: "nodes.example.com" (updated at: 2020-11-04T13:15:13Z)
I1104 15:54:57.711395 12586 resources.go:377] Adding instance "i-0deead86f7d952607" (created at: 2020-11-04T12:01:29Z) to instance group: "nodes.example.com" (updated at: 2020-11-04T13:15:13Z)
NAME STATUS NEEDUPDATE READY MIN TARGET MAX NODES
nodes NeedsUpdate 6 1 0 0 17 7
I1104 15:54:57.711820 12586 instancegroups.go:383] Validating the cluster.
I1104 15:54:57.715230 12586 loader.go:375] Config loaded from file: /home/meirp/.kube/config
I1104 15:54:57.716990 12586 round_trippers.go:423] curl -k -v -XGET -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Accept: application/json, */*" -H "Authorization: Basic ******" 'https://api.example.com/api/v1/nodes'
I1104 15:54:57.910386 12586 round_trippers.go:443] GET https://api.example.com/api/v1/nodes 200 OK in 193 milliseconds
I1104 15:54:57.910424 12586 round_trippers.go:449] Response Headers:
I1104 15:54:57.910450 12586 round_trippers.go:452] Audit-Id: 0b3dc7f4-0e27-42f1-96b7-c26aadb7d584
I1104 15:54:57.910456 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:54:57.910462 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:54:57 GMT
I1104 15:54:57.911008 12586 request.go:1068] Response Body: {"kind":"NodeList","apiVersion":"v1","metadata":{"selfLink":"/api/v1/nodes","resourceVersion":"45489057"},"items":[{"metadata":{"name":"ip-10-40-41-169.ec2.internal","selfLink":"/api/v1/nodes/ip-10-40-41-169.ec2.internal","uid":"507b5bdd-1ea0-11eb-9aff-16da7cad7b07","resourceVersion":"45488998","creationTimestamp":"2020-11-04T13:19:05Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/instance-type":"t3a.2xlarge","beta.kubernetes.io/os":"linux","dedicated":"algo","failure-domain.beta.kubernetes.io/region":"us-east-1","failure-domain.beta.kubernetes.io/zone":"us-east-1f","kops.k8s.io/instancegroup":"algo","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"ip-10-40-41-169.ec2.internal","kubernetes.io/os":"linux","kubernetes.io/role":"node","node-role.kubernetes.io/node":"","spotinst.io/node-lifecycle":"spot"},"annotations":{"node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"}},"spec":{"podCIDR":"100.96.115.0/24","providerID":"aws:///us-east-1f/i-0c8dfd269d1bffd81","taints":[{"key":"dedicated","value":"algo","effect":"NoSchedule"}]},"status":{"capacity":{"attachable-volumes-aws-ebs":"25","cpu":"8","ephemeral-storage":"130045936Ki","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"32665868Ki","pods":"58"},"allocatable":{"attachable-volumes-aws-ebs":"25","cpu":"8","ephemeral-storage":"119850334420","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"32563468Ki","pods":"58"},"conditions":[{"type":"MemoryPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:37Z","lastTransitionTime":"2020-11-04T13:19:05Z","reason":"KubeletHasSufficientMemory","message":"kubelet has sufficient memory available"},{"type":"DiskPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:37Z","lastTransitionTime":"2020-11-04T13:19:05Z","reason":"KubeletHasNoDiskPressure","message":"kubelet has no disk pressure"},{"type":"PIDPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:37Z","lastTransitionTime":"2020-11-04T13:19:05Z","reason":"KubeletHasSufficientPID","message":"kubelet has sufficient PID available"},{"type":"Ready","status":"True","lastHeartbeatTime":"2020-11-04T13:54:37Z","lastTransitionTime":"2020-11-04T13:19:55Z","reason":"KubeletReady","message":"kubelet is posting ready status. AppArmor enabled"}],"addresses":[{"type":"InternalIP","address":"10.40.41.169"},{"type":"InternalDNS","address":"ip-10-40-41-169.ec2.internal"},{"type":"Hostname","address":"ip-10-40-41-169.ec2.internal"}],"daemonEndpoints":{"kubeletEndpoint":{"Port":10250}},"nodeInfo":{"machineID":"ec2fd7328ad5220ca24cde06a441ae5a","systemUUID":"EC2FD732-8AD5-220C-A24C-DE06A441AE5A","bootID":"d8912c50-c519-4500-a536-1f43b0077e2b","kernelVersion":"4.15.0-1039-aws","osImage":"Ubuntu 18.04.2 LTS","containerRuntimeVersion":"docker://18.6.3","kubeletVersion":"v1.14.2","kubeProxyVersion":"v1.14.2","operatingSystem":"linux","architecture":"amd64"},"images":[{"names":["registry.example.com/cybervision/invu-algorithm-service@sha256:ec66013ab9c9e14369cd38501e09a399595a52f4b7424d9883d40009c12f705a","registry.example.com/cybervision/invu-algorithm-service:2.0.0-38065"],"sizeBytes":709056632},{"names":["602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni@sha256:a6d23b9fb3d4ba549321e32a28c42d8e79da203897072e93874472ab9e80b768","602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5"],"sizeBytes":263850871},{"names":["k8s.gcr.io/kube-proxy@sha256:c91687ff6145f7fcdc7d8b3da3c530a9a9b50f0734c7a945a0d9c18fc3790dbc","k8s.gcr.io/kube-proxy:v1.14.2"],"sizeBytes":82106236},{"names":["jtblin/kube2iam@sha256:92363f1c52fe5f433487b35c3f9c242e4733717ef7ac88c7137fc3824cfad4d3","jtblin/kube2iam:0.10.8"],"sizeBytes":34303129},{"names":["k8s.gcr.io/pause-amd64@sha256:4a1c4b21597c1b4415bdbecb28a3296c6b5e23ca4f9feeb599860a1dac6a0108","k8s.gcr.io/pause-amd64:3.2"],"sizeBytes":682696}]}},{"metadata":{"name":"ip-10-40-42-110.ec2.internal","selfLink":"/api/v1/nodes/ip-10-40-42-110.ec2.internal","uid":"3d99698f-1e9c-11eb-9aff-16da7cad7b07","resourceVersion":"45488977","creationTimestamp":"2020-11-04T12:49:56Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/instance-type":"m5a.xlarge","beta.kubernetes.io/os":"linux","failure-domain.beta.kubernetes.io/region":"us-east-1","failure-domain.beta.kubernetes.io/zone":"us-east-1f","kops.k8s.io/instancegroup":"nodes","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"ip-10-40-42-110.ec2.internal","kubernetes.io/os":"linux","kubernetes.io/role":"node","node-role.kubernetes.io/node":"","spotinst.io/node-lifecycle":"spot"},"annotations":{"node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"}},"spec":{"podCIDR":"100.96.114.0/24","providerID":"aws:///us-east-1f/i-0b738537410c47ce9"},"status":{"capacity":{"attachable-volumes-aws-ebs":"25","cpu":"4","ephemeral-storage":"130045936Ki","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"16038900Ki","pods":"58"},"allocatable":{"attachable-volumes-aws-ebs":"25","cpu":"4","ephemeral-storage":"119850334420","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"15936500Ki","pods":"58"},"conditions":[{"type":"MemoryPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:28Z","lastTransitionTime":"2020-11-04T12:49:56Z","reason":"KubeletHasSufficientMemory","message":"kubelet has sufficient memory available"},{"type":"DiskPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:28Z","lastTransitionTime":"2020-11-04T12:49:56Z","reason":"KubeletHasNoDiskPressure","message":"kubelet has no disk pressure"},{"type":"PIDPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:28Z","lastTransitionTime":"2020-11-04T12:49:56Z","reason":"KubeletHasSufficientPID","message":"kubelet has sufficient PID available"},{"type":"Ready","status":"True","lastHeartbeatTime":"2020-11-04T13:54:28Z","lastTransitionTime":"2020-11-04T12:50:16Z","reason":"KubeletReady","message":"kubelet is posting ready status. AppArmor enabled"}],"addresses":[{"type":"InternalIP","address":"10.40.42.110"},{"type":"InternalDNS","address":"ip-10-40-42-110.ec2.internal"},{"type":"Hostname","address":"ip-10-40-42-110.ec2.internal"}],"daemonEndpoints":{"kubeletEndpoint":{"Port":10250}},"nodeInfo":{"machineID":"ec2b9b820e177da80fbd1e4c85bbf31a","systemUUID":"EC2B9B82-0E17-7DA8-0FBD-1E4C85BBF31A","bootID":"ffffbb68-1815-42b8-bf09-86fce9b807c5","kernelVersion":"4.15.0-1039-aws","osImage":"Ubuntu 18.04.2 LTS","containerRuntimeVersion":"docker://18.6.3","kubeletVersion":"v1.14.2","kubeProxyVersion":"v1.14.2","operatingSystem":"linux","architecture":"amd64"},"images":[{"names":["registry.example.com/cybervision/pregsense-monitoring-session-service@sha256:eedc23e0c6848e90c6725ea2e0f821a9911a8651cdf964b48a818526c6154d99","registry.example.com/cybervision/pregsense-monitoring-session-service:2.0.0-37729"],"sizeBytes":916680232},{"names":["confluentinc/cp-ksql-server@sha256:a0b75d2f9926ac31139b2bebff3ac95a24e9f08465176aef16ed3c481b39a297","confluentinc/cp-ksql-server:5.2.2"],"sizeBytes":524657779},{"names":["registry.example.com/cybervision/pregsense-mail-service@sha256:633a2b3faf69477dfd745b83def6689077641309c1092121edb215bcfec06d8d","registry.example.com/cybervision/pregsense-mail-service:1.1.0-38167"],"sizeBytes":331982846},{"names":["registry.example.com/cybervision/pregsense-geo-service@sha256:9e44ea04116b0dad47c7774c04666e6a74de49e252ebd2b3f3d562ce63bf9bbc","registry.example.com/cybervision/pregsense-geo-service:2.0.0-37561"],"sizeBytes":298502628},{"names":["example/jmx-prometheus-httpserver@sha256:725e8a9bfec05f432b931edc11b1ee8bac3895e408bb91af58266dc88ee4e63b","example/jmx-prometheus-httpserver:0.11.0"],"sizeBytes":273954021},{"names":["registry.example.com/ce/middleware/kafka@sha256:5a13ea153f26ac29e73fd3a0ed67c701f33ea761a0b10a03870fdda51e3975cc","registry.example.com/ce/middleware/kafka:0.6.33"],"sizeBytes":269199283},{"names":["602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni@sha256:a6d23b9fb3d4ba549321e32a28c42d8e79da203897072e93874472ab9e80b768","602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5"],"sizeBytes":263850871},{"names":["registry.example.com/cybervision/invu-web/pro@sha256:4a75e40bc1774e59e805ff68e713542d6c839e54e550b21688f9b23ec401de28","registry.example.com/cybervision/invu-web/pro:2.0.0-38041"],"sizeBytes":107688818},{"names":["k8s.gcr.io/kube-proxy@sha256:c91687ff6145f7fcdc7d8b3da3c530a9a9b50f0734c7a945a0d9c18fc3790dbc","k8s.gcr.io/kube-proxy:v1.14.2"],"sizeBytes":82106236},{"names":["registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","registry.example.com/ce/utilities/mysql-client:latest"],"sizeBytes":38388577},{"names":["jtblin/kube2iam@sha256:92363f1c52fe5f433487b35c3f9c242e4733717ef7ac88c7137fc3824cfad4d3","jtblin/kube2iam:0.10.8"],"sizeBytes":34303129},{"names":["registry.example.com/ce/utilities/kt@sha256:a52550f941a9449ea205201f2c42d0352da5f70bf281d1d638944352781851b2","registry.example.com/ce/utilities/kt:latest"],"sizeBytes":22871156},{"names":["busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","busybox:latest"],"sizeBytes":1231733},{"names":["k8s.gcr.io/pause-amd64@sha256:4a1c4b21597c1b4415bdbecb28a3296c6b5e23ca4f9feeb599860a1dac6a0108","k8s.gcr.io/pause-amd64:3.2"],"sizeBytes":682696}],"volumesInUse":["kubernetes.io/aws-ebs/aws://us-east-1f/vol-04eda9d82d6dabadd"],"volumesAttached":[{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-04eda9d82d6dabadd","devicePath":"/dev/xvdbn"}]}},{"metadata":{"name":"ip-10-40-45-241.ec2.internal","selfLink":"/api/v1/nodes/ip-10-40-45-241.ec2.internal","uid":"33bf1cf2-1e96-11eb-9aff-16da7cad7b07","resourceVersion":"45488941","creationTimestamp":"2020-11-04T12:06:42Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/instance-type":"c5.xlarge","beta.kubernetes.io/os":"linux","failure-domain.beta.kubernetes.io/region":"us-east-1","failure-domain.beta.kubernetes.io/zone":"us-east-1f","kops.k8s.io/instancegroup":"nodes","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"ip-10-40-45-241.ec2.internal","kubernetes.io/os":"linux","kubernetes.io/role":"node","node-role.kubernetes.io/node":"","spotinst.io/node-lifecycle":"spot"},"annotations":{"node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"}},"spec":{"podCIDR":"100.96.111.0/24","providerID":"aws:///us-east-1f/i-091d1b1a0cf8a3486"},"status":{"capacity":{"attachable-volumes-aws-ebs":"25","cpu":"4","ephemeral-storage":"130045936Ki","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"7807996Ki","pods":"58"},"allocatable":{"attachable-volumes-aws-ebs":"25","cpu":"4","ephemeral-storage":"119850334420","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"7705596Ki","pods":"58"},"conditions":[{"type":"MemoryPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:16Z","lastTransitionTime":"2020-11-04T12:06:42Z","reason":"KubeletHasSufficientMemory","message":"kubelet has sufficient memory available"},{"type":"DiskPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:16Z","lastTransitionTime":"2020-11-04T12:06:42Z","reason":"KubeletHasNoDiskPressure","message":"kubelet has no disk pressure"},{"type":"PIDPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:16Z","lastTransitionTime":"2020-11-04T12:06:42Z","reason":"KubeletHasSufficientPID","message":"kubelet has sufficient PID available"},{"type":"Ready","status":"True","lastHeartbeatTime":"2020-11-04T13:54:16Z","lastTransitionTime":"2020-11-04T12:07:22Z","reason":"KubeletReady","message":"kubelet is posting ready status. AppArmor enabled"}],"addresses":[{"type":"InternalIP","address":"10.40.45.241"},{"type":"InternalDNS","address":"ip-10-40-45-241.ec2.internal"},{"type":"Hostname","address":"ip-10-40-45-241.ec2.internal"}],"daemonEndpoints":{"kubeletEndpoint":{"Port":10250}},"nodeInfo":{"machineID":"ec24bda60e4af050185e3f297f0861eb","systemUUID":"EC24BDA6-0E4A-F050-185E-3F297F0861EB","bootID":"ce4d0187-9021-48d6-b39f-ea9771db9035","kernelVersion":"4.15.0-1039-aws","osImage":"Ubuntu 18.04.2 LTS","containerRuntimeVersion":"docker://18.6.3","kubeletVersion":"v1.14.2","kubeProxyVersion":"v1.14.2","operatingSystem":"linux","architecture":"amd64"},"images":[{"names":["registry.example.com/cybervision/pregsense-user-management-service@sha256:e487a407cfaa96fa00f4d40a71e2792d26db1ad72843d9302588d18b0fb23326","registry.example.com/cybervision/pregsense-user-management-service:2.0.0-37765"],"sizeBytes":1268651197},{"names":["registry.example.com/ce/utilities/kafka-manager@sha256:c04a2fcec27aca7a0e8c70105ebd4c5f960ca81d6d867d4d584bcab9b7173fbc","registry.example.com/ce/utilities/kafka-manager:2.0.0.2"],"sizeBytes":547394080},{"names":["registry.example.com/ce/middleware/cassandra@sha256:29ff685aae75edaae14d052e723a66fabbd8e6e9ede068bb4a901776ada3b493","registry.example.com/ce/middleware/cassandra:0.6.40"],"sizeBytes":384610888},{"names":["registry.example.com/cybervision/pregsense-mobile-device-service@sha256:057469801785596922de4ad1866a4d2f7e26271d925889f1533fe8cf06b0db51","registry.example.com/cybervision/pregsense-mobile-device-service:2.0.0-37577"],"sizeBytes":367804418},{"names":["registry.example.com/cybervision/usability-data-extractor-service@sha256:e22df292989e525a9339b690d6d6a8e14134bb5ea6a06235691c019e11135f51","registry.example.com/cybervision/usability-data-extractor-service:2.0.0-38072"],"sizeBytes":310003340},{"names":["registry.example.com/cybervision/pregsense-medex-service@sha256:a6a38353b3b4ee41627606873b884cabf0a37bd0d6afb9b5f823b0e64d988d5b","registry.example.com/cybervision/pregsense-medex-service:2.0.0-37573"],"sizeBytes":302750971},{"names":["602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni@sha256:a6d23b9fb3d4ba549321e32a28c42d8e79da203897072e93874472ab9e80b768","602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5"],"sizeBytes":263850871},{"names":["zookeeper@sha256:b7a76ec06f68fd9c801b72dfd283701bc7d8a8b0609277a0d570e8e6768e4ad9","zookeeper:3.5.5"],"sizeBytes":225210868},{"names":["k8s.gcr.io/kube-proxy@sha256:c91687ff6145f7fcdc7d8b3da3c530a9a9b50f0734c7a945a0d9c18fc3790dbc","k8s.gcr.io/kube-proxy:v1.14.2"],"sizeBytes":82106236},{"names":["registry.example.com/ce/utilities/cqlsh@sha256:36818e33bb74a5570efb254a468136d84f8520719e966927d0797ea512d9b073","registry.example.com/ce/utilities/cqlsh:latest"],"sizeBytes":74739843},{"names":["redis@sha256:f8c22abc77f3f9cc1c2516062e4a2a71375859d7922da3faf9e4160e6ba4c3c2","redis:5.0.3-alpine"],"sizeBytes":50831292},{"names":["example/kube-tasks@sha256:713a62fab6a3075227d6a53681e548bc7cdaa39143bb135c939cc9573fd66965","example/kube-tasks:latest"],"sizeBytes":47161417},{"names":["registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","registry.example.com/ce/utilities/mysql-client:latest"],"sizeBytes":38388577},{"names":["jtblin/kube2iam@sha256:92363f1c52fe5f433487b35c3f9c242e4733717ef7ac88c7137fc3824cfad4d3","jtblin/kube2iam:0.10.8"],"sizeBytes":34303129},{"names":["registry.example.com/ce/utilities/kt@sha256:a52550f941a9449ea205201f2c42d0352da5f70bf281d1d638944352781851b2","registry.example.com/ce/utilities/kt:latest"],"sizeBytes":22871156},{"names":["registry.example.com/ce/observability/kafka-minion@sha256:34e6a52c9cef9b5d01f704c07913bd13b37a3465ae50d3adf56dd9a0ffd1aea5","registry.example.com/ce/observability/kafka-minion:1.0.1"],"sizeBytes":19445889},{"names":["busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","busybox:latest"],"sizeBytes":1231733},{"names":["busybox@sha256:7964ad52e396a6e045c39b5a44438424ac52e12e4d5a25d94895f2058cb863a0","busybox:1.30.0"],"sizeBytes":1199417},{"names":["busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47","busybox:1.28.4"],"sizeBytes":1146369},{"names":["k8s.gcr.io/pause-amd64@sha256:4a1c4b21597c1b4415bdbecb28a3296c6b5e23ca4f9feeb599860a1dac6a0108","k8s.gcr.io/pause-amd64:3.2"],"sizeBytes":682696}],"volumesInUse":["kubernetes.io/aws-ebs/aws://us-east-1f/vol-05a535855fa31264f","kubernetes.io/aws-ebs/aws://us-east-1f/vol-05f9ce80197f24f96","kubernetes.io/aws-ebs/aws://us-east-1f/vol-0b17552f50ccb204e"],"volumesAttached":[{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-0b17552f50ccb204e","devicePath":"/dev/xvdca"},{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-05a535855fa31264f","devicePath":"/dev/xvdch"},{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-05f9ce80197f24f96","devicePath":"/dev/xvdce"}]}},{"metadata":{"name":"ip-10-40-51-35.ec2.internal","selfLink":"/api/v1/nodes/ip-10-40-51-35.ec2.internal","uid":"1066fa28-1dfc-11eb-9aff-16da7cad7b07","resourceVersion":"45488913","creationTimestamp":"2020-11-03T17:43:20Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/instance-type":"r5.large","beta.kubernetes.io/os":"linux","failure-domain.beta.kubernetes.io/region":"us-east-1","failure-domain.beta.kubernetes.io/zone":"us-east-1f","kops.k8s.io/instancegroup":"nodes","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"ip-10-40-51-35.ec2.internal","kubernetes.io/os":"linux","kubernetes.io/role":"node","node-role.kubernetes.io/node":""},"annotations":{"node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"}},"spec":{"podCIDR":"100.96.79.0/24","providerID":"aws:///us-east-1f/i-0e4fb331463f91e5b"},"status":{"capacity":{"attachable-volumes-aws-ebs":"25","cpu":"2","ephemeral-storage":"130045936Ki","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"16123244Ki","pods":"29"},"allocatable":{"attachable-volumes-aws-ebs":"25","cpu":"2","ephemeral-storage":"119850334420","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"16020844Ki","pods":"29"},"conditions":[{"type":"MemoryPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:06Z","lastTransitionTime":"2020-11-03T17:43:20Z","reason":"KubeletHasSufficientMemory","message":"kubelet has sufficient memory available"},{"type":"DiskPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:06Z","lastTransitionTime":"2020-11-03T17:43:20Z","reason":"KubeletHasNoDiskPressure","message":"kubelet has no disk pressure"},{"type":"PIDPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:06Z","lastTransitionTime":"2020-11-03T17:43:20Z","reason":"KubeletHasSufficientPID","message":"kubelet has sufficient PID available"},{"type":"Ready","status":"True","lastHeartbeatTime":"2020-11-04T13:54:06Z","lastTransitionTime":"2020-11-03T17:43:41Z","reason":"KubeletReady","message":"kubelet is posting ready status. AppArmor enabled"}],"addresses":[{"type":"InternalIP","address":"10.40.51.35"},{"type":"InternalDNS","address":"ip-10-40-51-35.ec2.internal"},{"type":"Hostname","address":"ip-10-40-51-35.ec2.internal"}],"daemonEndpoints":{"kubeletEndpoint":{"Port":10250}},"nodeInfo":{"machineID":"ec21be1b38ff213ea283c19838e97f88","systemUUID":"EC21BE1B-38FF-213E-A283-C19838E97F88","bootID":"d7cb4873-93f4-4022-b59b-70fb30031938","kernelVersion":"4.15.0-1039-aws","osImage":"Ubuntu 18.04.2 LTS","containerRuntimeVersion":"docker://18.6.3","kubeletVersion":"v1.14.2","kubeProxyVersion":"v1.14.2","operatingSystem":"linux","architecture":"amd64"},"images":[{"names":["registry.example.com/ce/utilities/kafka-shell@sha256:8a8a80dfaae72664413657ee2ea2bd4543f08163035bdefcb163456af9a8e316","registry.example.com/ce/utilities/kafka-shell:latest"],"sizeBytes":697357066},{"names":["quay.io/kubernetes-ingress-controller/nginx-ingress-controller@sha256:617076c3e3d4d0638a4927702530d8456bda64c67194f6daed272a59e93b992f","quay.io/kubernetes-ingress-controller/nginx-ingress-controller:0.21.0"],"sizeBytes":568075227},{"names":["registry.example.com/ce/utilities/kafka-manager@sha256:c04a2fcec27aca7a0e8c70105ebd4c5f960ca81d6d867d4d584bcab9b7173fbc","registry.example.com/ce/utilities/kafka-manager:2.0.0.2"],"sizeBytes":547394080},{"names":["registry.example.com/ce/middleware/cassandra@sha256:29ff685aae75edaae14d052e723a66fabbd8e6e9ede068bb4a901776ada3b493","registry.example.com/ce/middleware/cassandra:0.6.40"],"sizeBytes":384610888},{"names":["registry.example.com/ce/middleware/mariadb@sha256:b4c12c27093137dbf047773d4ddb99676bedd32c8606bfa1e3c50876d5ce659f","registry.example.com/ce/middleware/mariadb:0.6.56"],"sizeBytes":373763438},{"names":["registry.example.com/cybervision/pregsense-mobile-device-service@sha256:057469801785596922de4ad1866a4d2f7e26271d925889f1533fe8cf06b0db51","registry.example.com/cybervision/pregsense-mobile-device-service:2.0.0-37577"],"sizeBytes":367804418},{"names":["registry.example.com/cybervision/pregsense-scheduler-service@sha256:7ad590d9311407a5c36583316cd79b66906db26085e56b5c37d9d3125d522fc2","registry.example.com/cybervision/pregsense-scheduler-service:1.1.0-37581"],"sizeBytes":327939018},{"names":["registry.example.com/cybervision/pregsense-medex-service@sha256:a6a38353b3b4ee41627606873b884cabf0a37bd0d6afb9b5f823b0e64d988d5b","registry.example.com/cybervision/pregsense-medex-service:2.0.0-37573"],"sizeBytes":302750971},{"names":["602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni@sha256:a6d23b9fb3d4ba549321e32a28c42d8e79da203897072e93874472ab9e80b768","602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5"],"sizeBytes":263850871},{"names":["zookeeper@sha256:b7a76ec06f68fd9c801b72dfd283701bc7d8a8b0609277a0d570e8e6768e4ad9","zookeeper:3.5.5"],"sizeBytes":225210868},{"names":["registry.example.com/ce/utilities/kubectl-in-pod@sha256:8b9d9dcedcc1eb0a3fa81971787469527333f0ee9aaf1eb296affba1da64a0e5","registry.example.com/ce/utilities/kubectl-in-pod:0.0.4"],"sizeBytes":188973770},{"names":["registry.example.com/cybervision/invu-web/support@sha256:de25604e5609c81e2d180b86126f00441671ab242555bda54a0b4e56d6a9b374","registry.example.com/cybervision/invu-web/support:2.0.0-38041"],"sizeBytes":107592777},{"names":["gcr.io/kubernetes-helm/tiller@sha256:f8002b91997fdc2c15a9c2aa994bea117b5b1683933f3144369862f0883c3c42","gcr.io/kubernetes-helm/tiller:v2.14.1"],"sizeBytes":94194761},{"names":["emqx/emqx@sha256:3f31ee2793b4446e98183659b4493992355e2b0d8603df946c641b47f29ced78","emqx/emqx:v3.2.7"],"sizeBytes":89389623},{"names":["k8s.gcr.io/kube-proxy@sha256:c91687ff6145f7fcdc7d8b3da3c530a9a9b50f0734c7a945a0d9c18fc3790dbc","k8s.gcr.io/kube-proxy:v1.14.2"],"sizeBytes":82106236},{"names":["registry.example.com/ce/utilities/cqlsh@sha256:36818e33bb74a5570efb254a468136d84f8520719e966927d0797ea512d9b073","registry.example.com/ce/utilities/cqlsh:latest"],"sizeBytes":74739843},{"names":["example/kube-tasks@sha256:713a62fab6a3075227d6a53681e548bc7cdaa39143bb135c939cc9573fd66965","example/kube-tasks:latest"],"sizeBytes":47161417},{"names":["k8s.gcr.io/coredns@sha256:2c8d61c46f484d881db43b34d13ca47a269336e576c81cf007ca740fa9ec0800","k8s.gcr.io/coredns:1.6.7"],"sizeBytes":43794147},{"names":["k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f","k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1"],"sizeBytes":40684734},{"names":["k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b","k8s.gcr.io/metrics-server-amd64:v0.3.6"],"sizeBytes":39944451},{"names":["registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","registry.example.com/ce/utilities/mysql-client:latest"],"sizeBytes":38388577},{"names":["jtblin/kube2iam@sha256:92363f1c52fe5f433487b35c3f9c242e4733717ef7ac88c7137fc3824cfad4d3","jtblin/kube2iam:0.10.8"],"sizeBytes":34303129},{"names":["registry.example.com/ce/middleware/connect-operator@sha256:7e5df82e5a2fc470d4f647d42b6849477ac712799868c87db99bdb88c778746f","registry.example.com/ce/middleware/connect-operator:0.2.6"],"sizeBytes":32127859},{"names":["registry.example.com/ce/observability/kafka-minion@sha256:34e6a52c9cef9b5d01f704c07913bd13b37a3465ae50d3adf56dd9a0ffd1aea5","registry.example.com/ce/observability/kafka-minion:1.0.1"],"sizeBytes":19445889},{"names":["prom/mysqld-exporter@sha256:9f4fb61cca309cb4a8c1b9ed9fb4aa75af0f7a21f36d3954667db37c062a0172","prom/mysqld-exporter:v0.11.0"],"sizeBytes":17003848},{"names":["example/emq_exporter@sha256:1526c0476c1e5d740dfc4df36f3295ea27f87b41becf274c760fbd0a51011233","example/emq_exporter:v0.4.1"],"sizeBytes":11467840},{"names":["example/default-backend@sha256:14f15b1c7b037f32cc816e37259ffa386f2b0fdab5e48058b61323a389450f11","example/default-backend:latest"],"sizeBytes":5447342},{"names":["busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","busybox:latest"],"sizeBytes":1231733},{"names":["busybox@sha256:7964ad52e396a6e045c39b5a44438424ac52e12e4d5a25d94895f2058cb863a0","busybox:1.30.0"],"sizeBytes":1199417},{"names":["busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47","busybox:1.28.4"],"sizeBytes":1146369},{"names":["k8s.gcr.io/pause-amd64@sha256:4a1c4b21597c1b4415bdbecb28a3296c6b5e23ca4f9feeb599860a1dac6a0108","k8s.gcr.io/pause-amd64:3.2"],"sizeBytes":682696}],"volumesInUse":["kubernetes.io/aws-ebs/aws://us-east-1f/vol-069646aaf149403ec","kubernetes.io/aws-ebs/aws://us-east-1f/vol-09a7d97ad0391bab1","kubernetes.io/aws-ebs/aws://us-east-1f/vol-0ebef74c040715d7b"],"volumesAttached":[{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-069646aaf149403ec","devicePath":"/dev/xvdch"},{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-0ebef74c040715d7b","devicePath":"/dev/xvdce"},{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-09a7d97ad0391bab1","devicePath":"/dev/xvdcg"}]}},{"metadata":{"name":"ip-10-40-54-156.ec2.internal","selfLink":"/api/v1/nodes/ip-10-40-54-156.ec2.internal","uid":"fafce029-0e0b-11eb-9aff-16da7cad7b07","resourceVersion":"45489043","creationTimestamp":"2020-10-14T10:56:58Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/instance-type":"m5a.large","beta.kubernetes.io/os":"linux","failure-domain.beta.kubernetes.io/region":"us-east-1","failure-domain.beta.kubernetes.io/zone":"us-east-1f","kops.k8s.io/instancegroup":"master-us-east-1f","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"ip-10-40-54-156.ec2.internal","kubernetes.io/os":"linux","kubernetes.io/role":"master","node-role.kubernetes.io/master":""},"annotations":{"node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"}},"spec":{"podCIDR":"100.96.0.0/24","providerID":"aws:///us-east-1f/i-015c846b225ceb0dc","taints":[{"key":"node-role.kubernetes.io/master","effect":"NoSchedule"}]},"status":{"capacity":{"attachable-volumes-aws-ebs":"25","cpu":"2","ephemeral-storage":"64989720Ki","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"7910764Ki","pods":"29"},"allocatable":{"attachable-volumes-aws-ebs":"25","cpu":"2","ephemeral-storage":"59894525853","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"7808364Ki","pods":"29"},"conditions":[{"type":"MemoryPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:53Z","lastTransitionTime":"2020-10-14T10:56:58Z","reason":"KubeletHasSufficientMemory","message":"kubelet has sufficient memory available"},{"type":"DiskPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:53Z","lastTransitionTime":"2020-10-14T10:56:58Z","reason":"KubeletHasNoDiskPressure","message":"kubelet has no disk pressure"},{"type":"PIDPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:53Z","lastTransitionTime":"2020-10-14T10:56:58Z","reason":"KubeletHasSufficientPID","message":"kubelet has sufficient PID available"},{"type":"Ready","status":"True","lastHeartbeatTime":"2020-11-04T13:54:53Z","lastTransitionTime":"2020-10-14T10:58:38Z","reason":"KubeletReady","message":"kubelet is posting ready status. AppArmor enabled"}],"addresses":[{"type":"InternalIP","address":"10.40.54.156"},{"type":"InternalDNS","address":"ip-10-40-54-156.ec2.internal"},{"type":"Hostname","address":"ip-10-40-54-156.ec2.internal"}],"daemonEndpoints":{"kubeletEndpoint":{"Port":10250}},"nodeInfo":{"machineID":"ec2efbdeec6baae7f801227a04215e39","systemUUID":"EC2EFBDE-EC6B-AAE7-F801-227A04215E39","bootID":"41f6da35-f429-4543-bd6d-17c44e7c4cfc","kernelVersion":"4.15.0-1039-aws","osImage":"Ubuntu 18.04.2 LTS","containerRuntimeVersion":"docker://18.6.3","kubeletVersion":"v1.14.2","kubeProxyVersion":"v1.14.2","operatingSystem":"linux","architecture":"amd64"},"images":[{"names":["spotinst/kubernetes-cluster-controller@sha256:f82c58b3e5374331ace6bf988987e2f0b390abedad313a31e5c8aaede3c580c2","spotinst/kubernetes-cluster-controller:1.0.68"],"sizeBytes":806421680},{"names":["kopeio/etcd-manager@sha256:08d90e866611142896c18c325d6b058d0aa0993f5b255807c17610a75cbe7392","kopeio/etcd-manager:3.0.20200531"],"sizeBytes":753910355},{"names":["spotinst/kubernetes-cluster-controller@sha256:28fb487f458ed0e2037cc7fe2e0d6a5df6ae095b5f4ad479cac07a0620d05ece","spotinst/kubernetes-cluster-controller:1.0.67"],"sizeBytes":740622913},{"names":["protokube:1.18.1"],"sizeBytes":285224997},{"names":["602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni@sha256:a6d23b9fb3d4ba549321e32a28c42d8e79da203897072e93874472ab9e80b768","602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5"],"sizeBytes":263850871},{"names":["k8s.gcr.io/kube-apiserver@sha256:223577e889dfb1a6e85faa6e3993308ead0b48b2a9c9d22c8fcd84b03d8a3af0","k8s.gcr.io/kube-apiserver:v1.14.2"],"sizeBytes":209916798},{"names":["k8s.gcr.io/kube-controller-manager@sha256:51a382e90acd9d11d5571850312ad4b268db8b28b2868516dfda19a6933a095c","k8s.gcr.io/kube-controller-manager:v1.14.2"],"sizeBytes":157933630},{"names":["kope/dns-controller@sha256:1df57184ec694b5a5839d2f59b54cc2a2857b34d94b3011063b3bc7caf8afb6d","kope/dns-controller:1.18.1"],"sizeBytes":89717254},{"names":["kope/dns-controller@sha256:ad0f2562cef00e77bb5c0ff255b682e25b14d24723e1e37057d349e39c7ff28d","kope/dns-controller:1.18.2"],"sizeBytes":89717254},{"names":["k8s.gcr.io/kube-proxy@sha256:c91687ff6145f7fcdc7d8b3da3c530a9a9b50f0734c7a945a0d9c18fc3790dbc","k8s.gcr.io/kube-proxy:v1.14.2"],"sizeBytes":82106236},{"names":["k8s.gcr.io/kube-scheduler@sha256:052e0322b8a2b22819ab0385089f202555c4099493d1bd33205a34753494d2c2","k8s.gcr.io/kube-scheduler:v1.14.2"],"sizeBytes":81579742},{"names":["fluent/fluent-bit@sha256:5ff3eb13d23c38aac5aefcd0db5ea3562917d5c690b4b88257751667ac413ebd","fluent/fluent-bit:1.1.3"],"sizeBytes":53391352},{"names":["jtblin/kube2iam@sha256:92363f1c52fe5f433487b35c3f9c242e4733717ef7ac88c7137fc3824cfad4d3","jtblin/kube2iam:0.10.8"],"sizeBytes":34303129},{"names":["602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon/aws-iam-authenticator@sha256:1477d16f77b237d26d34f1cde1885931fbf98669c478a72e6849c1fcdc9365fe","602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon/aws-iam-authenticator:v0.4.0"],"sizeBytes":23762101},{"names":["prom/node-exporter@sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee","prom/node-exporter:v0.18.1"],"sizeBytes":22933477},{"names":["k8s.gcr.io/pause-amd64@sha256:4a1c4b21597c1b4415bdbecb28a3296c6b5e23ca4f9feeb599860a1dac6a0108","k8s.gcr.io/pause-amd64:3.2"],"sizeBytes":682696}]}},{"metadata":{"name":"ip-10-40-55-41.ec2.internal","selfLink":"/api/v1/nodes/ip-10-40-55-41.ec2.internal","uid":"b4f79ec1-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45488925","creationTimestamp":"2020-11-04T12:46:06Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/instance-type":"t3.xlarge","beta.kubernetes.io/os":"linux","failure-domain.beta.kubernetes.io/region":"us-east-1","failure-domain.beta.kubernetes.io/zone":"us-east-1f","kops.k8s.io/instancegroup":"nodes","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"ip-10-40-55-41.ec2.internal","kubernetes.io/os":"linux","kubernetes.io/role":"node","node-role.kubernetes.io/node":"","spotinst.io/node-lifecycle":"spot"},"annotations":{"node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"}},"spec":{"podCIDR":"100.96.113.0/24","providerID":"aws:///us-east-1f/i-07759285ebe2a969d"},"status":{"capacity":{"attachable-volumes-aws-ebs":"25","cpu":"4","ephemeral-storage":"130045936Ki","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"16235512Ki","pods":"58"},"allocatable":{"attachable-volumes-aws-ebs":"25","cpu":"4","ephemeral-storage":"119850334420","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"16133112Ki","pods":"58"},"conditions":[{"type":"MemoryPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:09Z","lastTransitionTime":"2020-11-04T12:46:06Z","reason":"KubeletHasSufficientMemory","message":"kubelet has sufficient memory available"},{"type":"DiskPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:09Z","lastTransitionTime":"2020-11-04T12:46:06Z","reason":"KubeletHasNoDiskPressure","message":"kubelet has no disk pressure"},{"type":"PIDPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:09Z","lastTransitionTime":"2020-11-04T12:46:06Z","reason":"KubeletHasSufficientPID","message":"kubelet has sufficient PID available"},{"type":"Ready","status":"True","lastHeartbeatTime":"2020-11-04T13:54:09Z","lastTransitionTime":"2020-11-04T12:46:27Z","reason":"KubeletReady","message":"kubelet is posting ready status. AppArmor enabled"}],"addresses":[{"type":"InternalIP","address":"10.40.55.41"},{"type":"InternalDNS","address":"ip-10-40-55-41.ec2.internal"},{"type":"Hostname","address":"ip-10-40-55-41.ec2.internal"}],"daemonEndpoints":{"kubeletEndpoint":{"Port":10250}},"nodeInfo":{"machineID":"ec21154ae839a2204770777d165a898f","systemUUID":"EC21154A-E839-A220-4770-777D165A898F","bootID":"f2e8e581-1789-4138-bd5c-7c60dfa26880","kernelVersion":"4.15.0-1039-aws","osImage":"Ubuntu 18.04.2 LTS","containerRuntimeVersion":"docker://18.6.3","kubeletVersion":"v1.14.2","kubeProxyVersion":"v1.14.2","operatingSystem":"linux","architecture":"amd64"},"images":[{"names":["registry.example.com/cybervision/invu-kafka-connect-sinks/kafka-connect@sha256:6a584826ecf0bbdf654fbe27201e2ed07d5586bd6f0c414c13be40ac3f6cc62f","registry.example.com/cybervision/invu-kafka-connect-sinks/kafka-connect:2.0.0-37698"],"sizeBytes":643296613},{"names":["registry.example.com/ce/middleware/cassandra@sha256:29ff685aae75edaae14d052e723a66fabbd8e6e9ede068bb4a901776ada3b493","registry.example.com/ce/middleware/cassandra:0.6.40"],"sizeBytes":384610888},{"names":["registry.example.com/cybervision/pregsense-device-service@sha256:ccdcd8bec0cc02d64da785a6ae863b31e335e28f089a92f071affaee5ec1a2cb","registry.example.com/cybervision/pregsense-device-service:2.0.0-37554"],"sizeBytes":321951523},{"names":["registry.example.com/ce/middleware/kafka@sha256:5a13ea153f26ac29e73fd3a0ed67c701f33ea761a0b10a03870fdda51e3975cc","registry.example.com/ce/middleware/kafka:0.6.33"],"sizeBytes":269199283},{"names":["602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni@sha256:a6d23b9fb3d4ba549321e32a28c42d8e79da203897072e93874472ab9e80b768","602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5"],"sizeBytes":263850871},{"names":["k8s.gcr.io/kube-proxy@sha256:c91687ff6145f7fcdc7d8b3da3c530a9a9b50f0734c7a945a0d9c18fc3790dbc","k8s.gcr.io/kube-proxy:v1.14.2"],"sizeBytes":82106236},{"names":["registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","registry.example.com/ce/utilities/mysql-client:latest"],"sizeBytes":38388577},{"names":["jtblin/kube2iam@sha256:92363f1c52fe5f433487b35c3f9c242e4733717ef7ac88c7137fc3824cfad4d3","jtblin/kube2iam:0.10.8"],"sizeBytes":34303129},{"names":["busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","busybox:latest"],"sizeBytes":1231733},{"names":["busybox@sha256:7964ad52e396a6e045c39b5a44438424ac52e12e4d5a25d94895f2058cb863a0","busybox:1.30.0"],"sizeBytes":1199417},{"names":["k8s.gcr.io/pause-amd64@sha256:4a1c4b21597c1b4415bdbecb28a3296c6b5e23ca4f9feeb599860a1dac6a0108","k8s.gcr.io/pause-amd64:3.2"],"sizeBytes":682696}],"volumesInUse":["kubernetes.io/aws-ebs/aws://us-east-1f/vol-093bc9911e6b69ad5","kubernetes.io/aws-ebs/aws://us-east-1f/vol-0aa3e57d85128ef60"],"volumesAttached":[{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-093bc9911e6b69ad5","devicePath":"/dev/xvdbp"},{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-0aa3e57d85128ef60","devicePath":"/dev/xvdcc"}]}},{"metadata":{"name":"ip-10-40-56-27.ec2.internal","selfLink":"/api/v1/nodes/ip-10-40-56-27.ec2.internal","uid":"21d0f8a8-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45488903","creationTimestamp":"2020-11-04T12:42:00Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/instance-type":"t3a.xlarge","beta.kubernetes.io/os":"linux","failure-domain.beta.kubernetes.io/region":"us-east-1","failure-domain.beta.kubernetes.io/zone":"us-east-1f","kops.k8s.io/instancegroup":"nodes","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"ip-10-40-56-27.ec2.internal","kubernetes.io/os":"linux","kubernetes.io/role":"node","node-role.kubernetes.io/node":"","spotinst.io/node-lifecycle":"spot"},"annotations":{"node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"}},"spec":{"podCIDR":"100.96.112.0/24","providerID":"aws:///us-east-1f/i-036e06b204f56f316"},"status":{"capacity":{"attachable-volumes-aws-ebs":"25","cpu":"4","ephemeral-storage":"130045936Ki","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"16280568Ki","pods":"58"},"allocatable":{"attachable-volumes-aws-ebs":"25","cpu":"4","ephemeral-storage":"119850334420","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"16178168Ki","pods":"58"},"conditions":[{"type":"MemoryPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:03Z","lastTransitionTime":"2020-11-04T12:42:00Z","reason":"KubeletHasSufficientMemory","message":"kubelet has sufficient memory available"},{"type":"DiskPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:03Z","lastTransitionTime":"2020-11-04T12:42:00Z","reason":"KubeletHasNoDiskPressure","message":"kubelet has no disk pressure"},{"type":"PIDPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:03Z","lastTransitionTime":"2020-11-04T12:42:00Z","reason":"KubeletHasSufficientPID","message":"kubelet has sufficient PID available"},{"type":"Ready","status":"True","lastHeartbeatTime":"2020-11-04T13:54:03Z","lastTransitionTime":"2020-11-04T12:42:50Z","reason":"KubeletReady","message":"kubelet is posting ready status. AppArmor enabled"}],"addresses":[{"type":"InternalIP","address":"10.40.56.27"},{"type":"InternalDNS","address":"ip-10-40-56-27.ec2.internal"},{"type":"Hostname","address":"ip-10-40-56-27.ec2.internal"}],"daemonEndpoints":{"kubeletEndpoint":{"Port":10250}},"nodeInfo":{"machineID":"ec2fa63e40c54f665cbfe09ae4ec16d9","systemUUID":"EC2FA63E-40C5-4F66-5CBF-E09AE4EC16D9","bootID":"f2e9e82a-9b29-4591-a662-9fe3f838585e","kernelVersion":"4.15.0-1039-aws","osImage":"Ubuntu 18.04.2 LTS","containerRuntimeVersion":"docker://18.6.3","kubeletVersion":"v1.14.2","kubeProxyVersion":"v1.14.2","operatingSystem":"linux","architecture":"amd64"},"images":[{"names":["confluentinc/cp-schema-registry@sha256:0d7a84d486477a0c203ae21d5d52c40d26e810f5b5cfa27a56274692b70949f5","confluentinc/cp-schema-registry:5.2.2"],"sizeBytes":746078624},{"names":["registry.example.com/cybervision/invu-kafka-connect-sinks/kafka-connect@sha256:6a584826ecf0bbdf654fbe27201e2ed07d5586bd6f0c414c13be40ac3f6cc62f","registry.example.com/cybervision/invu-kafka-connect-sinks/kafka-connect:2.0.0-37698"],"sizeBytes":643296613},{"names":["confluentinc/cp-ksql-server@sha256:a0b75d2f9926ac31139b2bebff3ac95a24e9f08465176aef16ed3c481b39a297","confluentinc/cp-ksql-server:5.2.2"],"sizeBytes":524657779},{"names":["registry.example.com/ce/middleware/mariadb@sha256:b4c12c27093137dbf047773d4ddb99676bedd32c8606bfa1e3c50876d5ce659f","registry.example.com/ce/middleware/mariadb:0.6.56"],"sizeBytes":373763438},{"names":["registry.example.com/cybervision/invu-infrastructure-service@sha256:00f75459b2ee50deb47884131608f73108158d4faa085d1a5cc237aacd3f2112","registry.example.com/cybervision/invu-infrastructure-service:2.0.0-37566"],"sizeBytes":312358195},{"names":["example/jmx-prometheus-httpserver@sha256:725e8a9bfec05f432b931edc11b1ee8bac3895e408bb91af58266dc88ee4e63b","example/jmx-prometheus-httpserver:0.11.0"],"sizeBytes":273954021},{"names":["registry.example.com/ce/middleware/kafka@sha256:5a13ea153f26ac29e73fd3a0ed67c701f33ea761a0b10a03870fdda51e3975cc","registry.example.com/ce/middleware/kafka:0.6.33"],"sizeBytes":269199283},{"names":["602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni@sha256:a6d23b9fb3d4ba549321e32a28c42d8e79da203897072e93874472ab9e80b768","602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5"],"sizeBytes":263850871},{"names":["emqx/emqx@sha256:3f31ee2793b4446e98183659b4493992355e2b0d8603df946c641b47f29ced78","emqx/emqx:v3.2.7"],"sizeBytes":89389623},{"names":["k8s.gcr.io/kube-proxy@sha256:c91687ff6145f7fcdc7d8b3da3c530a9a9b50f0734c7a945a0d9c18fc3790dbc","k8s.gcr.io/kube-proxy:v1.14.2"],"sizeBytes":82106236},{"names":["registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","registry.example.com/ce/utilities/mysql-client:latest"],"sizeBytes":38388577},{"names":["jtblin/kube2iam@sha256:92363f1c52fe5f433487b35c3f9c242e4733717ef7ac88c7137fc3824cfad4d3","jtblin/kube2iam:0.10.8"],"sizeBytes":34303129},{"names":["registry.example.com/ce/utilities/kt@sha256:a52550f941a9449ea205201f2c42d0352da5f70bf281d1d638944352781851b2","registry.example.com/ce/utilities/kt:latest"],"sizeBytes":22871156},{"names":["prom/mysqld-exporter@sha256:9f4fb61cca309cb4a8c1b9ed9fb4aa75af0f7a21f36d3954667db37c062a0172","prom/mysqld-exporter:v0.11.0"],"sizeBytes":17003848},{"names":["example/emq_exporter@sha256:1526c0476c1e5d740dfc4df36f3295ea27f87b41becf274c760fbd0a51011233","example/emq_exporter:v0.4.1"],"sizeBytes":11467840},{"names":["busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","busybox:latest"],"sizeBytes":1231733},{"names":["k8s.gcr.io/pause-amd64@sha256:4a1c4b21597c1b4415bdbecb28a3296c6b5e23ca4f9feeb599860a1dac6a0108","k8s.gcr.io/pause-amd64:3.2"],"sizeBytes":682696}],"volumesInUse":["kubernetes.io/aws-ebs/aws://us-east-1f/vol-0153f8347ff8a2cd1","kubernetes.io/aws-ebs/aws://us-east-1f/vol-0cb2890c3adac40d4"],"volumesAttached":[{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-0153f8347ff8a2cd1","devicePath":"/dev/xvdbj"},{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-0cb2890c3adac40d4","devicePath":"/dev/xvdcd"}]}},{"metadata":{"name":"ip-10-40-57-245.ec2.internal","selfLink":"/api/v1/nodes/ip-10-40-57-245.ec2.internal","uid":"b7917ff0-1e95-11eb-9aff-16da7cad7b07","resourceVersion":"45489033","creationTimestamp":"2020-11-04T12:03:14Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/instance-type":"t3a.medium","beta.kubernetes.io/os":"linux","failure-domain.beta.kubernetes.io/region":"us-east-1","failure-domain.beta.kubernetes.io/zone":"us-east-1f","kops.k8s.io/instancegroup":"nodes","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"ip-10-40-57-245.ec2.internal","kubernetes.io/os":"linux","kubernetes.io/role":"node","node-role.kubernetes.io/node":"","spotinst.io/node-lifecycle":"spot"},"annotations":{"node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"}},"spec":{"podCIDR":"100.96.107.0/24","providerID":"aws:///us-east-1f/i-0deead86f7d952607"},"status":{"capacity":{"attachable-volumes-aws-ebs":"25","cpu":"2","ephemeral-storage":"130045936Ki","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"3990892Ki","pods":"17"},"allocatable":{"attachable-volumes-aws-ebs":"25","cpu":"2","ephemeral-storage":"119850334420","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"3888492Ki","pods":"17"},"conditions":[{"type":"MemoryPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:49Z","lastTransitionTime":"2020-11-04T12:03:14Z","reason":"KubeletHasSufficientMemory","message":"kubelet has sufficient memory available"},{"type":"DiskPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:49Z","lastTransitionTime":"2020-11-04T12:03:14Z","reason":"KubeletHasNoDiskPressure","message":"kubelet has no disk pressure"},{"type":"PIDPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:49Z","lastTransitionTime":"2020-11-04T12:03:14Z","reason":"KubeletHasSufficientPID","message":"kubelet has sufficient PID available"},{"type":"Ready","status":"True","lastHeartbeatTime":"2020-11-04T13:54:49Z","lastTransitionTime":"2020-11-04T12:03:34Z","reason":"KubeletReady","message":"kubelet is posting ready status. AppArmor enabled"}],"addresses":[{"type":"InternalIP","address":"10.40.57.245"},{"type":"InternalDNS","address":"ip-10-40-57-245.ec2.internal"},{"type":"Hostname","address":"ip-10-40-57-245.ec2.internal"}],"daemonEndpoints":{"kubeletEndpoint":{"Port":10250}},"nodeInfo":{"machineID":"ec2d967bf15437edf65a244bceea6ecc","systemUUID":"EC2D967B-F154-37ED-F65A-244BCEEA6ECC","bootID":"924eea63-f8c3-4e69-8932-c2622c6c300d","kernelVersion":"4.15.0-1039-aws","osImage":"Ubuntu 18.04.2 LTS","containerRuntimeVersion":"docker://18.6.3","kubeletVersion":"v1.14.2","kubeProxyVersion":"v1.14.2","operatingSystem":"linux","architecture":"amd64"},"images":[{"names":["registry.example.com/cybervision/pregsense-gateway-service@sha256:ba2b7c16fd295c73ab75edee8808ffd8758c01ad0bd74d394aa7b3395f61d4ad","registry.example.com/cybervision/pregsense-gateway-service:2.0.0-38164"],"sizeBytes":339009338},{"names":["registry.example.com/cybervision/pregsense-auth-service@sha256:96526bbbd74cffab866d7cdf38ccc23cc59228a95d6d6c10d28f4ee056f7f4d0","registry.example.com/cybervision/pregsense-auth-service:2.0.0-37888"],"sizeBytes":333981635},{"names":["registry.example.com/cybervision/pregsense-activity-service@sha256:52a50e96512249156c779d18a5aecc8082e2829221ecd3bc635401bf76ab9c61","registry.example.com/cybervision/pregsense-activity-service:2.0.0-37549"],"sizeBytes":325759251},{"names":["registry.example.com/cybervision/pregsense-geo-service@sha256:9e44ea04116b0dad47c7774c04666e6a74de49e252ebd2b3f3d562ce63bf9bbc","registry.example.com/cybervision/pregsense-geo-service:2.0.0-37561"],"sizeBytes":298502628},{"names":["602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni@sha256:a6d23b9fb3d4ba549321e32a28c42d8e79da203897072e93874472ab9e80b768","602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5"],"sizeBytes":263850871},{"names":["zookeeper@sha256:b7a76ec06f68fd9c801b72dfd283701bc7d8a8b0609277a0d570e8e6768e4ad9","zookeeper:3.5.5"],"sizeBytes":225210868},{"names":["emqx/emqx@sha256:3f31ee2793b4446e98183659b4493992355e2b0d8603df946c641b47f29ced78","emqx/emqx:v3.2.7"],"sizeBytes":89389623},{"names":["k8s.gcr.io/kube-proxy@sha256:c91687ff6145f7fcdc7d8b3da3c530a9a9b50f0734c7a945a0d9c18fc3790dbc","k8s.gcr.io/kube-proxy:v1.14.2"],"sizeBytes":82106236},{"names":["registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","registry.example.com/ce/utilities/mysql-client:latest"],"sizeBytes":38388577},{"names":["jtblin/kube2iam@sha256:92363f1c52fe5f433487b35c3f9c242e4733717ef7ac88c7137fc3824cfad4d3","jtblin/kube2iam:0.10.8"],"sizeBytes":34303129},{"names":["example/emq_exporter@sha256:1526c0476c1e5d740dfc4df36f3295ea27f87b41becf274c760fbd0a51011233","example/emq_exporter:v0.4.1"],"sizeBytes":11467840},{"names":["busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","busybox:latest"],"sizeBytes":1231733},{"names":["k8s.gcr.io/pause-amd64@sha256:4a1c4b21597c1b4415bdbecb28a3296c6b5e23ca4f9feeb599860a1dac6a0108","k8s.gcr.io/pause-amd64:3.2"],"sizeBytes":682696}],"volumesInUse":["kubernetes.io/aws-ebs/aws://us-east-1f/vol-032d1079efa034f3c"],"volumesAttached":[{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-032d1079efa034f3c","devicePath":"/dev/xvdcx"}]}},{"metadata":{"name":"ip-10-40-59-224.ec2.internal","selfLink":"/api/v1/nodes/ip-10-40-59-224.ec2.internal","uid":"555d2c07-1ea0-11eb-9aff-16da7cad7b07","resourceVersion":"45489020","creationTimestamp":"2020-11-04T13:19:14Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/instance-type":"t3a.2xlarge","beta.kubernetes.io/os":"linux","failure-domain.beta.kubernetes.io/region":"us-east-1","failure-domain.beta.kubernetes.io/zone":"us-east-1f","kops.k8s.io/instancegroup":"nodes","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"ip-10-40-59-224.ec2.internal","kubernetes.io/os":"linux","kubernetes.io/role":"node","node-role.kubernetes.io/node":"","spotinst.io/node-lifecycle":"spot"},"annotations":{"node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"}},"spec":{"podCIDR":"100.96.117.0/24","providerID":"aws:///us-east-1f/i-0ffadee0802927c01"},"status":{"capacity":{"attachable-volumes-aws-ebs":"25","cpu":"8","ephemeral-storage":"130045936Ki","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"32665868Ki","pods":"58"},"allocatable":{"attachable-volumes-aws-ebs":"25","cpu":"8","ephemeral-storage":"119850334420","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"32563468Ki","pods":"58"},"conditions":[{"type":"MemoryPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:45Z","lastTransitionTime":"2020-11-04T13:19:14Z","reason":"KubeletHasSufficientMemory","message":"kubelet has sufficient memory available"},{"type":"DiskPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:45Z","lastTransitionTime":"2020-11-04T13:19:14Z","reason":"KubeletHasNoDiskPressure","message":"kubelet has no disk pressure"},{"type":"PIDPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:45Z","lastTransitionTime":"2020-11-04T13:19:14Z","reason":"KubeletHasSufficientPID","message":"kubelet has sufficient PID available"},{"type":"Ready","status":"True","lastHeartbeatTime":"2020-11-04T13:54:45Z","lastTransitionTime":"2020-11-04T13:20:04Z","reason":"KubeletReady","message":"kubelet is posting ready status. AppArmor enabled"}],"addresses":[{"type":"InternalIP","address":"10.40.59.224"},{"type":"InternalDNS","address":"ip-10-40-59-224.ec2.internal"},{"type":"Hostname","address":"ip-10-40-59-224.ec2.internal"}],"daemonEndpoints":{"kubeletEndpoint":{"Port":10250}},"nodeInfo":{"machineID":"ec2d3362029642b9b8a2cb822c33b5db","systemUUID":"EC2D3362-0296-42B9-B8A2-CB822C33B5DB","bootID":"25c585bc-acbd-4a0e-bbe1-a99b8f545565","kernelVersion":"4.15.0-1039-aws","osImage":"Ubuntu 18.04.2 LTS","containerRuntimeVersion":"docker://18.6.3","kubeletVersion":"v1.14.2","kubeProxyVersion":"v1.14.2","operatingSystem":"linux","architecture":"amd64"},"images":[{"names":["registry.example.com/cybervision/pregsense-user-management-service@sha256:e487a407cfaa96fa00f4d40a71e2792d26db1ad72843d9302588d18b0fb23326","registry.example.com/cybervision/pregsense-user-management-service:2.0.0-37765"],"sizeBytes":1268651197},{"names":["registry.example.com/cybervision/usability-data-extractor-service@sha256:e22df292989e525a9339b690d6d6a8e14134bb5ea6a06235691c019e11135f51","registry.example.com/cybervision/usability-data-extractor-service:2.0.0-38072"],"sizeBytes":310003340},{"names":["602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni@sha256:a6d23b9fb3d4ba549321e32a28c42d8e79da203897072e93874472ab9e80b768","602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5"],"sizeBytes":263850871},{"names":["k8s.gcr.io/kube-proxy@sha256:c91687ff6145f7fcdc7d8b3da3c530a9a9b50f0734c7a945a0d9c18fc3790dbc","k8s.gcr.io/kube-proxy:v1.14.2"],"sizeBytes":82106236},{"names":["registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","registry.example.com/ce/utilities/mysql-client:latest"],"sizeBytes":38388577},{"names":["jtblin/kube2iam@sha256:92363f1c52fe5f433487b35c3f9c242e4733717ef7ac88c7137fc3824cfad4d3","jtblin/kube2iam:0.10.8"],"sizeBytes":34303129},{"names":["k8s.gcr.io/pause-amd64@sha256:4a1c4b21597c1b4415bdbecb28a3296c6b5e23ca4f9feeb599860a1dac6a0108","k8s.gcr.io/pause-amd64:3.2"],"sizeBytes":682696}]}}]}
I1104 15:54:57.912875 12586 resources.go:36] Listing all resources
I1104 15:54:57.912896 12586 resources.go:58] Listing all Elastigroup resources
I1104 15:54:57.913056 12586 spotinst.go:80] SPOTINST: Request "GET https://api.spotinst.io/aws/ec2/group?accountId=act-*****" details:
---[ REQUEST ]---------------------------------------
GET /aws/ec2/group?accountId=act-***** HTTP/1.1
Host: api.spotinst.io
User-Agent: kubernetes-kops/1.18.2 spotinst-sdk-go/1.49.0 (go1.13.9; linux; amd64)
Accept: application/json
Authorization: Bearer ****
Content-Type: application/json
Accept-Encoding: gzip
-----------------------------------------------------
I1104 15:54:58.116938 12586 spotinst.go:80] SPOTINST: Response "GET https://api.spotinst.io/aws/ec2/group?accountId=act-*****" details:
---[ RESPONSE ]----------------------------------------
HTTP/1.1 200 OK
Content-Length: 139539
Access-Control-Allow-Headers: Origin,Accept,Content-Type,Authorization,X-CSRF-Token
Access-Control-Allow-Methods: GET,POST,DELETE,PUT
Access-Control-Allow-Origin: *
Connection: keep-alive
Content-Type: application/json; charset=utf-8
Date: Wed, 04 Nov 2020 13:54:57 GMT
X-Download-Options: noopen
X-Frame-Options: SAMEORIGIN
X-Ratelimit-Limit: 300
X-Ratelimit-Remaining: 299
X-Request-Id: 553a05d9-2665-4b5d-9ffe-d1dd3d818f73
X-Response-Time: 24ms
{
"request": {
"id": "553a05d9-2665-4b5d-9ffe-d1dd3d818f73",
"url": "/aws/ec2/group",
"method": "GET",
"timestamp": "2020-11-04T13:54:57.995Z"
},
"response": {
"status": {
"code": 200,
"message": "OK"
},
"kind": "spotinst:aws:ec2:group",
"items": [
{
"id": "sig-****",
"name": "master-us-east-1c.masters.example.com",
"description": "master-us-east-1c.masters.example.com",
"capacity": {
"minimum": 1,
"maximum": 1,
"target": 1,
"unit": "instance"
},
"strategy": {
"risk": 0,
"onDemandCount": null,
"availabilityVsCost": "balanced",
"drainingTimeout": 120,
"utilizeReservedInstances": true,
"fallbackToOd": true,
"scalingStrategy": {}
},
"compute": {
"instanceTypes": {
"ondemand": "m5a.large",
"spot": [
"m5a.large",
"m5.large",
"m4.large"
]
},
"availabilityZones": [
{
"name": "us-east-1c",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
}
],
"product": "Linux/UNIX",
"launchSpecification": {
"loadBalancerNames": null,
"loadBalancersConfig": {
"loadBalancers": [
{
"name": "api-dev-example-com-vo1g1r",
"type": "CLASSIC"
}
]
},
"securityGroupIds": [
"sg-0c04097ebbe0cfa7f"
],
"monitoring": false,
"ebsOptimized": false,
"imageId": "ami-024a64a6685d05041",
"iamRole": {
"name": "masters.example.com",
"arn": null
},
"keyPair": "kubernetes.example.com-90:b9:67:c4:09:c3:53:a3:b4:9a:82:f6:b3:a6:22:fe",
"userData": "..."
"shutdownScript": null,
"blockDeviceMappings": [
{
"deviceName": "/dev/sda1",
"ebs": {
"deleteOnTermination": true,
"volumeSize": 64,
"volumeType": "GP2"
}
}
],
"tags": [
{
"tagKey": "Name",
"tagValue": "master-us-east-1c.masters.example.com"
},
{
"tagKey": "KubernetesCluster",
"tagValue": "example.com"
},
{
"tagKey": "kubernetes.io/cluster/example.com",
"tagValue": "owned"
},
{
"tagKey": "env",
"tagValue": "dev"
},
{
"tagKey": "k8s.io/cluster-autoscaler/node-template/label/kops.k8s.io/instancegroup",
"tagValue": "master-us-east-1c"
},
{
"tagKey": "k8s.io/role/master",
"tagValue": "1"
},
{
"tagKey": "kops.k8s.io/instancegroup",
"tagValue": "master-us-east-1c"
}
]
}
},
"scaling": {},
"scheduling": {},
"thirdPartiesIntegration": {
"kubernetes": {
"integrationMode": "pod",
"clusterIdentifier": "example.com",
"autoScale": {
"isEnabled": false,
"isAutoConfig": true
}
}
},
"multai": null,
"createdAt": "2019-04-14T07:44:27.000Z",
"updatedAt": "2020-10-14T10:02:58.000Z"
},
{
"id": "sig-****",
"name": "master-us-east-1f.masters.example.com",
"description": "master-us-east-1f.masters.example.com",
"capacity": {
"minimum": 1,
"maximum": 1,
"target": 1,
"unit": "instance"
},
"strategy": {
"risk": 0,
"onDemandCount": null,
"availabilityVsCost": "balanced",
"drainingTimeout": 120,
"utilizeReservedInstances": true,
"fallbackToOd": true,
"scalingStrategy": {}
},
"compute": {
"instanceTypes": {
"ondemand": "m5a.large",
"spot": [
"m5a.large",
"m5.large",
"m4.large"
]
},
"availabilityZones": [
{
"name": "us-east-1f",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
}
],
"product": "Linux/UNIX",
"launchSpecification": {
"loadBalancerNames": null,
"loadBalancersConfig": {
"loadBalancers": [
{
"name": "api-dev-example-com-vo1g1r",
"type": "CLASSIC"
}
]
},
"securityGroupIds": [
"sg-0c04097ebbe0cfa7f"
],
"monitoring": false,
"ebsOptimized": false,
"imageId": "ami-024a64a6685d05041",
"iamRole": {
"name": "masters.example.com",
"arn": null
},
"keyPair": "kubernetes.example.com-90:b9:67:c4:09:c3:53:a3:b4:9a:82:f6:b3:a6:22:fe",
"userData": "..."
"shutdownScript": null,
"blockDeviceMappings": [
{
"deviceName": "/dev/sda1",
"ebs": {
"deleteOnTermination": true,
"volumeSize": 64,
"volumeType": "GP2"
}
}
],
"tags": [
{
"tagKey": "KubernetesCluster",
"tagValue": "example.com"
},
{
"tagKey": "kubernetes.io/cluster/example.com",
"tagValue": "owned"
},
{
"tagKey": "env",
"tagValue": "dev"
},
{
"tagKey": "k8s.io/cluster-autoscaler/node-template/label/kops.k8s.io/instancegroup",
"tagValue": "master-us-east-1f"
},
{
"tagKey": "k8s.io/role/master",
"tagValue": "1"
},
{
"tagKey": "kops.k8s.io/instancegroup",
"tagValue": "master-us-east-1f"
},
{
"tagKey": "Name",
"tagValue": "master-us-east-1f.masters.example.com"
}
]
}
},
"scaling": {},
"scheduling": {},
"thirdPartiesIntegration": {
"kubernetes": {
"integrationMode": "pod",
"clusterIdentifier": "example.com",
"autoScale": {
"isEnabled": false,
"down": {
"evaluationPeriods": 3
},
"headroom": {
"cpuPerUnit": 0,
"memoryPerUnit": 0,
"gpuPerUnit": 0,
"numOfUnits": 0
},
"isAutoConfig": false
}
}
},
"multai": null,
"createdAt": "2019-04-14T07:44:38.000Z",
"updatedAt": "2020-10-14T10:07:30.000Z"
},
{
"id": "sig-****",
"name": "bastions.example.com",
"description": "bastions.example.com",
"capacity": {
"minimum": 1,
"maximum": 1,
"target": 1,
"unit": "instance"
},
"strategy": {
"risk": 100,
"onDemandCount": null,
"availabilityVsCost": "balanced",
"drainingTimeout": 120,
"lifetimePeriod": "days",
"utilizeReservedInstances": true,
"fallbackToOd": true,
"scalingStrategy": {},
"persistence": {},
"revertToSpot": {
"performAt": "always"
}
},
"compute": {
"instanceTypes": {
"ondemand": "t3a.nano",
"spot": [
"t3a.nano",
"t3.nano",
"t3a.micro",
"t3.micro",
"t2.micro",
"t3a.small",
"t3.small",
"t2.small"
]
},
"availabilityZones": [
{
"name": "us-east-1b",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
},
{
"name": "us-east-1c",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
},
{
"name": "us-east-1f",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
}
],
"product": "Linux/UNIX",
"launchSpecification": {
"loadBalancerNames": null,
"loadBalancersConfig": {
"loadBalancers": [
{
"name": "bastion-dev-example-com-mknckd",
"type": "CLASSIC"
}
]
},
"healthCheckType": null,
"securityGroupIds": [
"sg-0c03575c501eeb4f8"
],
"monitoring": false,
"ebsOptimized": false,
"imageId": "ami-024a64a6685d05041",
"iamRole": {
"name": "bastions.example.com",
"arn": null
},
"keyPair": "kubernetes.example.com-90:b9:67:c4:09:c3:53:a3:b4:9a:82:f6:b3:a6:22:fe",
"userData": "..."
"shutdownScript": null,
"blockDeviceMappings": [
{
"deviceName": "/dev/sda1",
"ebs": {
"deleteOnTermination": true,
"volumeSize": 32,
"volumeType": "GP2"
}
}
],
"networkInterfaces": [
{
"deviceIndex": 0,
"associatePublicIpAddress": true,
"deleteOnTermination": true,
"associateIpv6Address": false
}
],
"tags": [
{
"tagKey": "kops.k8s.io/instancegroup",
"tagValue": "bastions"
},
{
"tagKey": "Name",
"tagValue": "bastions.example.com"
},
{
"tagKey": "KubernetesCluster",
"tagValue": "example.com"
},
{
"tagKey": "kubernetes.io/cluster/example.com",
"tagValue": "owned"
},
{
"tagKey": "env",
"tagValue": "dev"
},
{
"tagKey": "k8s.io/cluster-autoscaler/node-template/label/kops.k8s.io/instancegroup",
"tagValue": "bastions"
},
{
"tagKey": "k8s.io/role/bastion",
"tagValue": "1"
}
],
"tenancy": "default"
}
},
"scaling": {},
"scheduling": {},
"thirdPartiesIntegration": {},
"multai": null,
"createdAt": "2019-04-14T07:44:38.000Z",
"updatedAt": "2020-10-11T10:59:26.000Z"
},
{
"id": "sig-****",
"name": "r-nodes.example.com",
"description": "r-nodes.example.com",
"capacity": {
"minimum": 5,
"maximum": 30,
"target": 21,
"unit": "instance"
},
"strategy": {
"risk": 0,
"onDemandCount": 40,
"availabilityVsCost": "equalAzDistribution",
"drainingTimeout": 120,
"utilizeReservedInstances": true,
"fallbackToOd": true,
"scalingStrategy": {}
},
"compute": {
"instanceTypes": {
"ondemand": "m5a.large",
"spot": [
"m5a.large",
"m5a.xlarge",
"m5a.2xlarge",
"m5.large",
"m5.xlarge",
"m5.2xlarge",
"m4.large",
"m4.xlarge",
"m4.2xlarge",
"t3.micro",
"t3a.micro",
"t3.small",
"t3a.small",
"t3.medium",
"t3a.medium",
"t3.large",
"t3a.large",
"t3.xlarge",
"t3a.xlarge",
"t3.2xlarge",
"t3a.2xlarge",
"r5a.large",
"r5a.xlarge",
"r5a.2xlarge",
"r5.large",
"r5.xlarge",
"r5.2xlarge",
"c5.large",
"c5.xlarge",
"c5.2xlarge"
]
},
"availabilityZones": [
{
"name": "us-east-1b",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
},
{
"name": "us-east-1c",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
},
{
"name": "us-east-1f",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
}
],
"product": "Linux/UNIX",
"launchSpecification": {
"loadBalancerNames": null,
"loadBalancersConfig": {
"loadBalancers": null
},
"healthCheckType": "K8S_NODE",
"securityGroupIds": [
"sg-0655cde58fc563d18"
],
"monitoring": false,
"ebsOptimized": false,
"imageId": "ami-024a64a6685d05041",
"iamRole": {
"name": "nodes.example.com",
"arn": null
},
"keyPair": "kubernetes.example.com-90:b9:67:c4:09:c3:53:a3:b4:9a:82:f6:b3:a6:22:fe",
"userData": "..."
"shutdownScript": null,
"blockDeviceMappings": [
{
"deviceName": "/dev/sda1",
"ebs": {
"deleteOnTermination": true,
"volumeSize": 128,
"volumeType": "GP2"
}
}
],
"networkInterfaces": [
{
"description": "eth0",
"deviceIndex": 0,
"associatePublicIpAddress": false,
"deleteOnTermination": true,
"associateIpv6Address": false
}
],
"tags": [
{
"tagKey": "env",
"tagValue": "dev"
},
{
"tagKey": "k8s.io/cluster-autoscaler/node-template/label/kops.k8s.io/instancegroup",
"tagValue": "r-nodes"
},
{
"tagKey": "k8s.io/role/node",
"tagValue": "1"
},
{
"tagKey": "kops.k8s.io/instancegroup",
"tagValue": "r-nodes"
},
{
"tagKey": "Name",
"tagValue": "r-nodes.example.com"
},
{
"tagKey": "KubernetesCluster",
"tagValue": "example.com"
},
{
"tagKey": "kubernetes.io/cluster/example.com",
"tagValue": "owned"
}
]
}
},
"scaling": {},
"scheduling": {},
"thirdPartiesIntegration": {
"kubernetes": {
"integrationMode": "pod",
"clusterIdentifier": "example.com",
"autoScale": {
"isEnabled": true,
"cooldown": 300,
"headroom": {
"cpuPerUnit": 0,
"memoryPerUnit": 0,
"gpuPerUnit": 0,
"numOfUnits": 0
},
"isAutoConfig": false
}
}
},
"multai": null,
"createdAt": "2020-01-07T09:51:47.000Z",
"updatedAt": "2020-11-04T11:37:12.000Z"
},
{
"id": "sig-****",
"name": "algo.example.com",
"description": "algo.example.com",
"capacity": {
"minimum": 1,
"maximum": 8,
"target": 3,
"unit": "instance"
},
"strategy": {
"risk": 0,
"onDemandCount": 60,
"availabilityVsCost": "balanced",
"drainingTimeout": 120,
"utilizeReservedInstances": true,
"fallbackToOd": true,
"scalingStrategy": {}
},
"compute": {
"instanceTypes": {
"ondemand": "c5.2xlarge",
"spot": [
"c5.2xlarge"
]
},
"availabilityZones": [
{
"name": "us-east-1b",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
},
{
"name": "us-east-1c",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
},
{
"name": "us-east-1f",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
}
],
"product": "Linux/UNIX",
"launchSpecification": {
"loadBalancerNames": null,
"loadBalancersConfig": {
"loadBalancers": null
},
"securityGroupIds": [
"sg-0655cde58fc563d18"
],
"monitoring": false,
"ebsOptimized": false,
"imageId": "ami-024a64a6685d05041",
"iamRole": {
"name": "nodes.example.com",
"arn": null
},
"keyPair": "kubernetes.example.com-90:b9:67:c4:09:c3:53:a3:b4:9a:82:f6:b3:a6:22:fe",
"userData": "..."
"shutdownScript": null,
"blockDeviceMappings": [
{
"deviceName": "/dev/sda1",
"ebs": {
"deleteOnTermination": true,
"volumeSize": 128,
"volumeType": "GP2"
}
}
],
"tags": [
{
"tagKey": "KubernetesCluster",
"tagValue": "example.com"
},
{
"tagKey": "kubernetes.io/cluster/example.com",
"tagValue": "owned"
},
{
"tagKey": "k8s.io/cluster-autoscaler/node-template/label/dedicated",
"tagValue": "algo"
},
{
"tagKey": "k8s.io/cluster-autoscaler/node-template/label/kops.k8s.io/instancegroup",
"tagValue": "algo"
},
{
"tagKey": "Name",
"tagValue": "algo.example.com"
},
{
"tagKey": "env",
"tagValue": "dev"
},
{
"tagKey": "k8s.io/cluster-autoscaler/node-template/taint/dedicated",
"tagValue": "algo:NoSchedule"
},
{
"tagKey": "k8s.io/role/node",
"tagValue": "1"
},
{
"tagKey": "kops.k8s.io/instancegroup",
"tagValue": "algo"
}
]
}
},
"scaling": {},
"scheduling": {},
"thirdPartiesIntegration": {
"kubernetes": {
"integrationMode": "pod",
"clusterIdentifier": "example.com",
"autoScale": {
"isEnabled": true,
"cooldown": 300,
"headroom": {
"cpuPerUnit": 0,
"memoryPerUnit": 0,
"gpuPerUnit": 0,
"numOfUnits": 0
},
"labels": [
{
"key": "dedicated",
"value": "algo"
}
],
"isAutoConfig": false
}
}
},
"multai": null,
"createdAt": "2019-04-14T07:43:51.000Z",
"updatedAt": "2020-11-04T09:42:12.000Z"
},
{
"id": "sig-****",
"name": "dev-tools.example.com",
"description": "dev-tools.example.com",
"capacity": {
"minimum": 3,
"maximum": 5,
"target": 3,
"unit": "instance"
},
"strategy": {
"risk": 100,
"onDemandCount": 3,
"availabilityVsCost": "balanced",
"drainingTimeout": 120,
"utilizeReservedInstances": true,
"fallbackToOd": true,
"scalingStrategy": {}
},
"compute": {
"instanceTypes": {
"ondemand": "m5a.large",
"spot": [
"m5a.large",
"m5a.xlarge",
"m5a.2xlarge",
"m5.large",
"m5.xlarge",
"m5.2xlarge",
"m4.large",
"m4.xlarge",
"m4.2xlarge",
"t3.micro",
"t3a.micro",
"t3.small",
"t3a.small",
"t3.medium",
"t3a.medium",
"t3.large",
"t3a.large",
"t3.xlarge",
"t3a.xlarge",
"t3.2xlarge",
"t3a.2xlarge",
"r5a.large",
"r5a.xlarge",
"r5a.2xlarge",
"r5.large",
"r5.xlarge",
"r5.2xlarge",
"c5.large",
"c5.xlarge",
"c5.2xlarge"
]
},
"availabilityZones": [
{
"name": "us-east-1b",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
},
{
"name": "us-east-1c",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
},
{
"name": "us-east-1f",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
}
],
"product": "Linux/UNIX",
"launchSpecification": {
"loadBalancerNames": null,
"loadBalancersConfig": {
"loadBalancers": null
},
"securityGroupIds": [
"sg-0655cde58fc563d18"
],
"monitoring": false,
"ebsOptimized": false,
"imageId": "ami-024a64a6685d05041",
"iamRole": {
"name": "nodes.example.com",
"arn": null
},
"keyPair": "kubernetes.example.com-90:b9:67:c4:09:c3:53:a3:b4:9a:82:f6:b3:a6:22:fe",
"userData": "..."
"shutdownScript": null,
"blockDeviceMappings": [
{
"deviceName": "/dev/sda1",
"ebs": {
"deleteOnTermination": true,
"volumeSize": 128,
"volumeType": "GP2"
}
}
],
"tags": [
{
"tagKey": "k8s.io/cluster-autoscaler/node-template/label/dedicated",
"tagValue": "dev-tools"
},
{
"tagKey": "k8s.io/cluster-autoscaler/node-template/taint/dedicated",
"tagValue": "dev-tools:NoSchedule"
},
{
"tagKey": "k8s.io/role/node",
"tagValue": "1"
},
{
"tagKey": "kops.k8s.io/instancegroup",
"tagValue": "dev-tools"
},
{
"tagKey": "Name",
"tagValue": "dev-tools.example.com"
},
{
"tagKey": "KubernetesCluster",
"tagValue": "example.com"
},
{
"tagKey": "env",
"tagValue": "dev"
},
{
"tagKey": "kubernetes.io/cluster/example.com",
"tagValue": "owned"
},
{
"tagKey": "k8s.io/cluster-autoscaler/node-template/label/kops.k8s.io/instancegroup",
"tagValue": "dev-tools"
}
]
}
},
"scaling": {},
"scheduling": {},
"thirdPartiesIntegration": {
"kubernetes": {
"integrationMode": "pod",
"clusterIdentifier": "example.com",
"autoScale": {
"isEnabled": true,
"cooldown": 300,
"headroom": {
"cpuPerUnit": 0,
"memoryPerUnit": 0,
"gpuPerUnit": 0,
"numOfUnits": 0
},
"labels": [
{
"key": "dedicated",
"value": "dev-tools"
}
],
"isAutoConfig": false
}
}
},
"multai": null,
"createdAt": "2019-04-14T07:43:58.000Z",
"updatedAt": "2020-10-12T20:04:14.000Z"
},
{
"id": "sig-****",
"name": "bastions.example.com",
"description": "bastions.example.com",
"capacity": {
"minimum": 1,
"maximum": 1,
"target": 1,
"unit": "instance"
},
"strategy": {
"risk": 100,
"availabilityVsCost": "balanced",
"utilizeReservedInstances": true,
"fallbackToOd": true
},
"compute": {
"instanceTypes": {
"ondemand": "m5a.large",
"spot": [
"m5a.large",
"m5a.xlarge",
"m5a.2xlarge",
"m5.large",
"m5.xlarge",
"m5.2xlarge",
"m4.large",
"m4.xlarge",
"m4.2xlarge",
"t3.small",
"t3a.small",
"t3.medium",
"t3a.medium",
"t3.large",
"t3a.large",
"t3.xlarge",
"t3a.xlarge",
"t3.2xlarge",
"t3a.2xlarge",
"r5a.large",
"r5a.xlarge",
"r5a.2xlarge",
"r5.large",
"r5.xlarge",
"r5.2xlarge",
"c5.large",
"c5.xlarge",
"c5.2xlarge",
"c5a.large",
"c5a.xlarge",
"c5a.2xlarge"
]
},
"availabilityZones": [
{
"name": "us-east-1f",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
}
],
"product": "Linux/UNIX",
"launchSpecification": {
"loadBalancersConfig": {
"loadBalancers": [
{
"name": "bastion-test-example-com-ogksqp",
"type": "CLASSIC"
}
]
},
"healthCheckType": "K8S_NODE",
"securityGroupIds": [
"sg-0e55267107f6e0e84"
],
"monitoring": false,
"imageId": "ami-024a64a6685d05041",
"iamRole": {
"name": "bastions.example.com",
"arn": null
},
"keyPair": "kubernetes.example.com-73:e8:15:08:29:5d:99:c2:94:68:5b:e5:e9:f7:25:ab",
"blockDeviceMappings": [
{
"deviceName": "/dev/sda1",
"ebs": {
"deleteOnTermination": true,
"volumeSize": 32,
"volumeType": "GP2"
}
}
],
"networkInterfaces": [
{
"description": "eth0",
"deviceIndex": 0,
"associatePublicIpAddress": true,
"deleteOnTermination": true,
"associateIpv6Address": false
}
],
"tags": [
{
"tagKey": "k8s.io/role/bastion",
"tagValue": "1"
},
{
"tagKey": "kops.k8s.io/instancegroup",
"tagValue": "bastions"
},
{
"tagKey": "Name",
"tagValue": "bastions.example.com"
},
{
"tagKey": "KubernetesCluster",
"tagValue": "example.com"
},
{
"tagKey": "kubernetes.io/cluster/example.com",
"tagValue": "owned"
},
{
"tagKey": "env",
"tagValue": "test"
},
{
"tagKey": "k8s.io/cluster-autoscaler/node-template/label/kops.k8s.io/instancegroup",
"tagValue": "bastions"
}
]
}
},
"createdAt": "2019-11-19T16:49:13.000Z",
"updatedAt": "2020-10-14T11:37:54.000Z"
},
{
"id": "sig-****",
"name": "nodes.example.com",
"description": "nodes.example.com",
"capacity": {
"minimum": 0,
"maximum": 17,
"target": 7,
"unit": "instance"
},
"strategy": {
"risk": 100,
"onDemandCount": null,
"availabilityVsCost": "balanced",
"drainingTimeout": 120,
"lifetimePeriod": "days",
"utilizeReservedInstances": true,
"fallbackToOd": true,
"scalingStrategy": {},
"persistence": {},
"revertToSpot": {
"performAt": "always"
}
},
"compute": {
"instanceTypes": {
"ondemand": "m5a.large",
"spot": [
"m5a.large",
"m5a.xlarge",
"m5a.2xlarge",
"m5.large",
"m5.xlarge",
"m5.2xlarge",
"m4.large",
"m4.xlarge",
"m4.2xlarge",
"t3.small",
"t3a.small",
"t3.medium",
"t3a.medium",
"t3.large",
"t3a.large",
"t3.xlarge",
"t3a.xlarge",
"t3.2xlarge",
"t3a.2xlarge",
"r5a.large",
"r5a.xlarge",
"r5a.2xlarge",
"r5.large",
"r5.xlarge",
"r5.2xlarge",
"c5.large",
"c5.xlarge",
"c5.2xlarge",
"c5a.large",
"c5a.xlarge",
"c5a.2xlarge"
]
},
"availabilityZones": [
{
"name": "us-east-1f",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
}
],
"preferredAvailabilityZones": null,
"product": "Linux/UNIX",
"launchSpecification": {
"loadBalancerNames": null,
"loadBalancersConfig": {
"loadBalancers": null
},
"healthCheckType": "K8S_NODE",
"healthCheckGracePeriod": 600,
"securityGroupIds": [
"sg-0300a03f04c61b109"
],
"monitoring": false,
"ebsOptimized": false,
"imageId": "ami-024a64a6685d05041",
"iamRole": {
"name": "nodes.example.com",
"arn": null
},
"keyPair": "kubernetes.example.com-73:e8:15:08:29:5d:99:c2:94:68:5b:e5:e9:f7:25:ab",
"userData": "..."
"shutdownScript": null,
"blockDeviceMappings": [
{
"deviceName": "/dev/sda1",
"ebs": {
"deleteOnTermination": true,
"volumeSize": 128,
"volumeType": "GP2"
}
}
],
"networkInterfaces": [
{
"description": "eth0",
"deviceIndex": 0,
"associatePublicIpAddress": false,
"deleteOnTermination": true,
"associateIpv6Address": false
}
],
"tags": [
{
"tagKey": "kubernetes.io/cluster/example.com",
"tagValue": "owned"
},
{
"tagKey": "env",
"tagValue": "test"
},
{
"tagKey": "k8s.io/cluster-autoscaler/node-template/label/kops.k8s.io/instancegroup",
"tagValue": "nodes"
},
{
"tagKey": "k8s.io/role/node",
"tagValue": "1"
},
{
"tagKey": "kops.k8s.io/instancegroup",
"tagValue": "nodes"
},
{
"tagKey": "Name",
"tagValue": "nodes.example.com"
},
{
"tagKey": "KubernetesCluster",
"tagValue": "example.com"
}
],
"tenancy": "default"
}
},
"scaling": {},
"scheduling": {},
"thirdPartiesIntegration": {
"kubernetes": {
"integrationMode": "pod",
"clusterIdentifier": "example.com",
"autoScale": {
"isEnabled": true,
"cooldown": 300,
"headroom": {
"cpuPerUnit": 0,
"memoryPerUnit": 0,
"gpuPerUnit": 0,
"numOfUnits": 0
},
"isAutoConfig": false
}
}
},
"multai": null,
"createdAt": "2019-11-19T16:48:56.000Z",
"updatedAt": "2020-11-04T13:17:13.000Z"
},
{
"id": "sig-****",
"name": "algo.example.com",
"description": "algo.example.com",
"capacity": {
"minimum": 0,
"maximum": 8,
"target": 1,
"unit": "instance"
},
"strategy": {
"risk": 100,
"availabilityVsCost": "balanced",
"utilizeReservedInstances": true,
"fallbackToOd": true
},
"compute": {
"instanceTypes": {
"ondemand": "m5a.large",
"spot": [
"m5a.large",
"m5a.xlarge",
"m5a.2xlarge",
"m5.large",
"m5.xlarge",
"m5.2xlarge",
"m4.large",
"m4.xlarge",
"m4.2xlarge",
"t3.small",
"t3a.small",
"t3.medium",
"t3a.medium",
"t3.large",
"t3a.large",
"t3.xlarge",
"t3a.xlarge",
"t3.2xlarge",
"t3a.2xlarge",
"r5a.large",
"r5a.xlarge",
"r5a.2xlarge",
"r5.large",
"r5.xlarge",
"r5.2xlarge",
"c5.large",
"c5.xlarge",
"c5.2xlarge",
"c5a.large",
"c5a.xlarge",
"c5a.2xlarge"
]
},
"availabilityZones": [
{
"name": "us-east-1f",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
}
],
"product": "Linux/UNIX",
"launchSpecification": {
"securityGroupIds": [
"sg-0300a03f04c61b109"
],
"monitoring": false,
"imageId": "ami-024a64a6685d05041",
"iamRole": {
"name": "nodes.example.com",
"arn": null
},
"keyPair": "kubernetes.example.com-73:e8:15:08:29:5d:99:c2:94:68:5b:e5:e9:f7:25:ab",
"userData": "..."
"blockDeviceMappings": [
{
"deviceName": "/dev/sda1",
"ebs": {
"deleteOnTermination": true,
"volumeSize": 128,
"volumeType": "GP2"
}
}
],
"tags": [
{
"tagKey": "KubernetesCluster",
"tagValue": "example.com"
},
{
"tagKey": "kubernetes.io/cluster/example.com",
"tagValue": "owned"
},
{
"tagKey": "env",
"tagValue": "test"
},
{
"tagKey": "k8s.io/cluster-autoscaler/node-template/label/dedicated",
"tagValue": "algo"
},
{
"tagKey": "k8s.io/cluster-autoscaler/node-template/label/kops.k8s.io/instancegroup",
"tagValue": "algo"
},
{
"tagKey": "k8s.io/role/node",
"tagValue": "1"
},
{
"tagKey": "Name",
"tagValue": "algo.example.com"
},
{
"tagKey": "k8s.io/cluster-autoscaler/node-template/taint/dedicated",
"tagValue": "algo:NoSchedule"
},
{
"tagKey": "kops.k8s.io/instancegroup",
"tagValue": "algo"
}
]
}
},
"thirdPartiesIntegration": {
"kubernetes": {
"integrationMode": "pod",
"clusterIdentifier": "example.com",
"autoScale": {
"isEnabled": true,
"cooldown": 300,
"headroom": {
"cpuPerUnit": 0,
"memoryPerUnit": 0,
"gpuPerUnit": 0,
"numOfUnits": 0
},
"labels": [
{
"key": "dedicated",
"value": "algo"
}
],
"isAutoConfig": false
}
}
},
"createdAt": "2020-08-18T11:14:10.000Z",
"updatedAt": "2020-11-04T13:17:14.000Z"
},
{
"id": "sig-****",
"name": "master-us-east-1b.masters.example.com",
"description": "master-us-east-1b.masters.example.com",
"capacity": {
"minimum": 1,
"maximum": 1,
"target": 1,
"unit": "instance"
},
"strategy": {
"risk": 0,
"onDemandCount": null,
"availabilityVsCost": "balanced",
"drainingTimeout": 120,
"utilizeReservedInstances": true,
"fallbackToOd": true,
"scalingStrategy": {}
},
"compute": {
"instanceTypes": {
"ondemand": "m5a.large",
"spot": [
"m5a.large",
"m5.large",
"m4.large"
]
},
"availabilityZones": [
{
"name": "us-east-1b",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
}
],
"product": "Linux/UNIX",
"launchSpecification": {
"loadBalancerNames": null,
"loadBalancersConfig": {
"loadBalancers": [
{
"name": "api-dev-example-com-vo1g1r",
"type": "CLASSIC"
}
]
},
"securityGroupIds": [
"sg-0c04097ebbe0cfa7f"
],
"monitoring": false,
"ebsOptimized": false,
"imageId": "ami-024a64a6685d05041",
"iamRole": {
"name": "masters.example.com",
"arn": null
},
"keyPair": "kubernetes.example.com-90:b9:67:c4:09:c3:53:a3:b4:9a:82:f6:b3:a6:22:fe",
"userData": "..."
"shutdownScript": null,
"blockDeviceMappings": [
{
"deviceName": "/dev/sda1",
"ebs": {
"deleteOnTermination": true,
"volumeSize": 64,
"volumeType": "GP2"
}
}
],
"tags": [
{
"tagKey": "kubernetes.io/cluster/example.com",
"tagValue": "owned"
},
{
"tagKey": "env",
"tagValue": "dev"
},
{
"tagKey": "k8s.io/cluster-autoscaler/node-template/label/kops.k8s.io/instancegroup",
"tagValue": "master-us-east-1b"
},
{
"tagKey": "k8s.io/role/master",
"tagValue": "1"
},
{
"tagKey": "kops.k8s.io/instancegroup",
"tagValue": "master-us-east-1b"
},
{
"tagKey": "Name",
"tagValue": "master-us-east-1b.masters.example.com"
},
{
"tagKey": "KubernetesCluster",
"tagValue": "example.com"
}
]
}
},
"scaling": {},
"scheduling": {},
"thirdPartiesIntegration": {
"kubernetes": {
"integrationMode": "pod",
"clusterIdentifier": "example.com",
"autoScale": {
"isEnabled": false,
"down": {
"evaluationPeriods": 3
},
"headroom": {
"cpuPerUnit": 0,
"memoryPerUnit": 0,
"gpuPerUnit": 0,
"numOfUnits": 0
},
"isAutoConfig": false
}
}
},
"multai": null,
"createdAt": "2019-04-14T07:44:38.000Z",
"updatedAt": "2020-10-14T10:08:27.000Z"
},
{
"id": "sig-****",
"name": "master-us-east-1f.masters.example.com",
"description": "master-us-east-1f.masters.example.com",
"capacity": {
"minimum": 1,
"maximum": 1,
"target": 1,
"unit": "instance"
},
"strategy": {
"risk": 0,
"onDemandCount": null,
"availabilityVsCost": "balanced",
"drainingTimeout": 120,
"utilizeReservedInstances": true,
"fallbackToOd": true,
"scalingStrategy": {}
},
"compute": {
"instanceTypes": {
"ondemand": "m5a.large",
"spot": [
"m5a.large",
"m5a.xlarge",
"m5a.2xlarge",
"m5.large",
"m5.xlarge",
"m5.2xlarge",
"m4.large",
"m4.xlarge",
"m4.2xlarge",
"t3.small",
"t3a.small",
"t3.medium",
"t3a.medium",
"t3.large",
"t3a.large",
"t3.xlarge",
"t3a.xlarge",
"t3.2xlarge",
"t3a.2xlarge",
"r5a.large",
"r5a.xlarge",
"r5a.2xlarge",
"r5.large",
"r5.xlarge",
"r5.2xlarge",
"c5.large",
"c5.xlarge",
"c5.2xlarge",
"c5a.large",
"c5a.xlarge",
"c5a.2xlarge"
]
},
"availabilityZones": [
{
"name": "us-east-1f",
"subnetIds": [
"subnet-*****"
],
"subnetId": "subnet-*****"
}
],
"product": "Linux/UNIX",
"launchSpecification": {
"loadBalancerNames": null,
"loadBalancersConfig": {
"loadBalancers": [
{
"name": "api-test-example-com-ps2tfr",
"type": "CLASSIC"
}
]
},
"healthCheckType": "K8S_NODE",
"securityGroupIds": [
"sg-0ea9c09b1cf6d2246"
],
"monitoring": false,
"ebsOptimized": false,
"imageId": "ami-024a64a6685d05041",
"iamRole": {
"name": "masters.example.com",
"arn": null
},
"keyPair": "kubernetes.example.com-73:e8:15:08:29:5d:99:c2:94:68:5b:e5:e9:f7:25:ab",
"userData": "..."
"shutdownScript": null,
"blockDeviceMappings": [
{
"deviceName": "/dev/sda1",
"ebs": {
"deleteOnTermination": true,
"volumeSize": 64,
"volumeType": "GP2"
}
}
],
"networkInterfaces": [
{
"description": "eth0",
"deviceIndex": 0,
"associatePublicIpAddress": false,
"deleteOnTermination": true,
"associateIpv6Address": false
}
],
"tags": [
{
"tagKey": "kops.k8s.io/instancegroup",
"tagValue": "master-us-east-1f"
},
{
"tagKey": "Name",
"tagValue": "master-us-east-1f.masters.example.com"
},
{
"tagKey": "KubernetesCluster",
"tagValue": "example.com"
},
{
"tagKey": "kubernetes.io/cluster/example.com",
"tagValue": "owned"
},
{
"tagKey": "env",
"tagValue": "test"
},
{
"tagKey": "k8s.io/cluster-autoscaler/node-template/label/kops.k8s.io/instancegroup",
"tagValue": "master-us-east-1f"
},
{
"tagKey": "k8s.io/role/master",
"tagValue": "1"
}
]
}
},
"scaling": {},
"scheduling": {},
"thirdPartiesIntegration": {
"kubernetes": {
"integrationMode": "pod",
"clusterIdentifier": "example.com",
"autoScale": {
"isEnabled": false,
"cooldown": 300,
"isAutoConfig": true
}
}
},
"multai": null,
"createdAt": "2019-11-19T16:49:11.000Z",
"updatedAt": "2020-11-02T18:29:04.000Z"
}
],
"count": 11
}
}
-------------------------------------------------------
I1104 15:54:58.123274 12586 resources.go:71] Listing all Ocean resources
I1104 15:54:58.123547 12586 spotinst.go:80] SPOTINST: Request "GET https://api.spotinst.io/ocean/aws/k8s/cluster?accountId=act-*****" details:
---[ REQUEST ]---------------------------------------
GET /ocean/aws/k8s/cluster?accountId=act-***** HTTP/1.1
Host: api.spotinst.io
User-Agent: kubernetes-kops/1.18.2 spotinst-sdk-go/1.49.0 (go1.13.9; linux; amd64)
Accept: application/json
Authorization: Bearer ****
Content-Type: application/json
Accept-Encoding: gzip
-----------------------------------------------------
I1104 15:54:58.369996 12586 spotinst.go:80] SPOTINST: Response "GET https://api.spotinst.io/ocean/aws/k8s/cluster?accountId=act-*****" details:
---[ RESPONSE ]----------------------------------------
HTTP/1.1 200 OK
Content-Length: 352
Access-Control-Allow-Headers: Origin,Accept,Content-Type,Authorization,X-CSRF-Token
Access-Control-Allow-Methods: GET,POST,DELETE,PUT
Access-Control-Allow-Origin: *
Connection: keep-alive
Content-Type: application/json; charset=utf-8
Date: Wed, 04 Nov 2020 13:54:58 GMT
X-Download-Options: noopen
X-Frame-Options: SAMEORIGIN
X-Ratelimit-Limit: 300
X-Ratelimit-Remaining: 299
X-Request-Id: f537a97e-6431-49ba-941f-abcb1974554b
X-Response-Time: 74ms
{
"request": {
"id": "f537a97e-6431-49ba-941f-abcb1974554b",
"url": "/ocean/aws/k8s/cluster?accountId=act-*****",
"method": "GET",
"timestamp": "2020-11-04T13:54:58.257Z"
},
"response": {
"status": {
"code": 200,
"message": "OK"
},
"kind": "spotinst:ocean:aws:k8s",
"items": [],
"count": 0
}
}
-------------------------------------------------------
I1104 15:54:58.370346 12586 resources.go:405] Found group with corresponding instance group: "bastions.example.com"
I1104 15:54:58.370386 12586 resources.go:295] Attempting to fetch all instances of instance group: "bastions.example.com" (id: "sig-****")
I1104 15:54:58.370580 12586 spotinst.go:80] SPOTINST: Request "GET https://api.spotinst.io/aws/ec2/group/sig-****/status?accountId=act-*****" details:
---[ REQUEST ]---------------------------------------
GET /aws/ec2/group/sig-****/status?accountId=act-***** HTTP/1.1
Host: api.spotinst.io
User-Agent: kubernetes-kops/1.18.2 spotinst-sdk-go/1.49.0 (go1.13.9; linux; amd64)
Accept: application/json
Authorization: Bearer ****
Content-Type: application/json
Accept-Encoding: gzip
-----------------------------------------------------
I1104 15:54:58.597118 12586 spotinst.go:80] SPOTINST: Response "GET https://api.spotinst.io/aws/ec2/group/sig-****/status?accountId=act-*****" details:
---[ RESPONSE ]----------------------------------------
HTTP/1.1 200 OK
Content-Length: 752
Access-Control-Allow-Headers: Origin,Accept,Content-Type,Authorization,X-CSRF-Token
Access-Control-Allow-Methods: GET,POST,DELETE,PUT
Access-Control-Allow-Origin: *
Connection: keep-alive
Content-Type: application/json; charset=utf-8
Date: Wed, 04 Nov 2020 13:54:58 GMT
X-Download-Options: noopen
X-Frame-Options: SAMEORIGIN
X-Ratelimit-Limit: 300
X-Ratelimit-Remaining: 299
X-Request-Id: 7f403b50-71b5-44ef-b9ae-f68270ae1bab
X-Response-Time: 80ms
{
"request": {
"id": "7f403b50-71b5-44ef-b9ae-f68270ae1bab",
"url": "/aws/ec2/group/sig-****/status",
"method": "GET",
"timestamp": "2020-11-04T13:54:58.508Z"
},
"response": {
"status": {
"code": 200,
"message": "OK"
},
"kind": "spotinst:aws:ec2:group",
"items": [
{
"spotInstanceRequestId": "sir-vdshhd7g",
"instanceId": "i-0d11eb3533519438d",
"instanceType": "t3a.small",
"product": "Linux/UNIX",
"groupId": "sig-****",
"availabilityZone": "us-east-1f",
"privateIp": "10.40.2.39",
"createdAt": "2020-10-14T11:37:54.000Z",
"status": "fulfilled"
}
],
"count": 1
}
}
-------------------------------------------------------
I1104 15:54:58.597228 12586 resources.go:377] Adding instance "i-0d11eb3533519438d" (created at: 2020-10-14T11:37:54Z) to instance group: "bastions.example.com" (updated at: 2020-10-14T11:35:54Z)
I1104 15:54:58.597240 12586 cloud_instance_group.go:68] unable to find node for instance: i-0d11eb3533519438d
I1104 15:54:58.597248 12586 resources.go:405] Found group with corresponding instance group: "nodes.example.com"
I1104 15:54:58.597255 12586 resources.go:295] Attempting to fetch all instances of instance group: "nodes.example.com" (id: "sig-****")
I1104 15:54:58.597400 12586 spotinst.go:80] SPOTINST: Request "GET https://api.spotinst.io/aws/ec2/group/sig-****/status?accountId=act-*****" details:
---[ REQUEST ]---------------------------------------
GET /aws/ec2/group/sig-****/status?accountId=act-***** HTTP/1.1
Host: api.spotinst.io
User-Agent: kubernetes-kops/1.18.2 spotinst-sdk-go/1.49.0 (go1.13.9; linux; amd64)
Accept: application/json
Authorization: Bearer ****
Content-Type: application/json
Accept-Encoding: gzip
-----------------------------------------------------
I1104 15:54:58.791567 12586 spotinst.go:80] SPOTINST: Response "GET https://api.spotinst.io/aws/ec2/group/sig-****/status?accountId=act-*****" details:
---[ RESPONSE ]----------------------------------------
HTTP/1.1 200 OK
Content-Length: 3146
Access-Control-Allow-Headers: Origin,Accept,Content-Type,Authorization,X-CSRF-Token
Access-Control-Allow-Methods: GET,POST,DELETE,PUT
Access-Control-Allow-Origin: *
Connection: keep-alive
Content-Type: application/json; charset=utf-8
Date: Wed, 04 Nov 2020 13:54:58 GMT
X-Download-Options: noopen
X-Frame-Options: SAMEORIGIN
X-Ratelimit-Limit: 300
X-Ratelimit-Remaining: 299
X-Request-Id: 9ea4d42f-ab7c-4b78-acfd-4eea47107933
X-Response-Time: 47ms
{
"request": {
"id": "9ea4d42f-ab7c-4b78-acfd-4eea47107933",
"url": "/aws/ec2/group/sig-****/status",
"method": "GET",
"timestamp": "2020-11-04T13:54:58.701Z"
},
"response": {
"status": {
"code": 200,
"message": "OK"
},
"kind": "spotinst:aws:ec2:group",
"items": [
{
"spotInstanceRequestId": "sir-3p4hksgj",
"instanceId": "i-0ffadee0802927c01",
"instanceType": "t3a.2xlarge",
"product": "Linux/UNIX",
"groupId": "sig-****",
"availabilityZone": "us-east-1f",
"privateIp": "10.40.59.224",
"createdAt": "2020-11-04T13:17:13.000Z",
"publicIp": null,
"status": "fulfilled"
},
{
"spotInstanceRequestId": "sir-6h49kq6k",
"instanceId": "i-036e06b204f56f316",
"instanceType": "t3a.xlarge",
"product": "Linux/UNIX",
"groupId": "sig-****",
"availabilityZone": "us-east-1f",
"privateIp": "10.40.56.27",
"createdAt": "2020-11-04T12:40:12.000Z",
"publicIp": null,
"status": "fulfilled"
},
{
"spotInstanceRequestId": "sir-ryr1ka4g",
"instanceId": "i-0e4fb331463f91e5b",
"instanceType": "r5.large",
"product": "Linux/UNIX",
"groupId": "sig-****",
"availabilityZone": "us-east-1f",
"privateIp": "10.40.51.35",
"createdAt": "2020-11-03T17:41:47.000Z",
"publicIp": null,
"status": "fulfilled"
},
{
"spotInstanceRequestId": "sir-v4n9ghqk",
"instanceId": "i-091d1b1a0cf8a3486",
"instanceType": "c5.xlarge",
"product": "Linux/UNIX",
"groupId": "sig-****",
"availabilityZone": "us-east-1f",
"privateIp": "10.40.45.241",
"createdAt": "2020-11-04T12:05:15.000Z",
"publicIp": null,
"status": "fulfilled"
},
{
"spotInstanceRequestId": "sir-xtjsgyzg",
"instanceId": "i-0b738537410c47ce9",
"instanceType": "m5a.xlarge",
"product": "Linux/UNIX",
"groupId": "sig-****",
"availabilityZone": "us-east-1f",
"privateIp": "10.40.42.110",
"createdAt": "2020-11-04T12:48:16.000Z",
"publicIp": null,
"status": "fulfilled"
},
{
"spotInstanceRequestId": "sir-xyn1kmik",
"instanceId": "i-07759285ebe2a969d",
"instanceType": "t3.xlarge",
"product": "Linux/UNIX",
"groupId": "sig-****",
"availabilityZone": "us-east-1f",
"privateIp": "10.40.55.41",
"createdAt": "2020-11-04T12:44:13.000Z",
"publicIp": null,
"status": "fulfilled"
},
{
"spotInstanceRequestId": "sir-y869jykg",
"instanceId": "i-0deead86f7d952607",
"instanceType": "t3a.medium",
"product": "Linux/UNIX",
"groupId": "sig-****",
"availabilityZone": "us-east-1f",
"privateIp": "10.40.57.245",
"createdAt": "2020-11-04T12:01:29.000Z",
"publicIp": null,
"status": "fulfilled"
}
],
"count": 7
}
}
-------------------------------------------------------
I1104 15:54:58.791704 12586 resources.go:377] Adding instance "i-0ffadee0802927c01" (created at: 2020-11-04T13:17:13Z) to instance group: "nodes.example.com" (updated at: 2020-11-04T13:15:13Z)
I1104 15:54:58.791716 12586 resources.go:377] Adding instance "i-036e06b204f56f316" (created at: 2020-11-04T12:40:12Z) to instance group: "nodes.example.com" (updated at: 2020-11-04T13:15:13Z)
I1104 15:54:58.791720 12586 resources.go:377] Adding instance "i-0e4fb331463f91e5b" (created at: 2020-11-03T17:41:47Z) to instance group: "nodes.example.com" (updated at: 2020-11-04T13:15:13Z)
I1104 15:54:58.791725 12586 resources.go:377] Adding instance "i-091d1b1a0cf8a3486" (created at: 2020-11-04T12:05:15Z) to instance group: "nodes.example.com" (updated at: 2020-11-04T13:15:13Z)
I1104 15:54:58.791729 12586 resources.go:377] Adding instance "i-0b738537410c47ce9" (created at: 2020-11-04T12:48:16Z) to instance group: "nodes.example.com" (updated at: 2020-11-04T13:15:13Z)
I1104 15:54:58.791734 12586 resources.go:377] Adding instance "i-07759285ebe2a969d" (created at: 2020-11-04T12:44:13Z) to instance group: "nodes.example.com" (updated at: 2020-11-04T13:15:13Z)
I1104 15:54:58.791738 12586 resources.go:377] Adding instance "i-0deead86f7d952607" (created at: 2020-11-04T12:01:29Z) to instance group: "nodes.example.com" (updated at: 2020-11-04T13:15:13Z)
I1104 15:54:58.791747 12586 resources.go:405] Found group with corresponding instance group: "algo.example.com"
I1104 15:54:58.791753 12586 resources.go:295] Attempting to fetch all instances of instance group: "algo.example.com" (id: "sig-****")
I1104 15:54:58.791855 12586 spotinst.go:80] SPOTINST: Request "GET https://api.spotinst.io/aws/ec2/group/sig-****/status?accountId=act-*****" details:
---[ REQUEST ]---------------------------------------
GET /aws/ec2/group/sig-****/status?accountId=act-***** HTTP/1.1
Host: api.spotinst.io
User-Agent: kubernetes-kops/1.18.2 spotinst-sdk-go/1.49.0 (go1.13.9; linux; amd64)
Accept: application/json
Authorization: Bearer ****
Content-Type: application/json
Accept-Encoding: gzip
-----------------------------------------------------
I1104 15:54:59.231743 12586 spotinst.go:80] SPOTINST: Response "GET https://api.spotinst.io/aws/ec2/group/sig-****/status?accountId=act-*****" details:
---[ RESPONSE ]----------------------------------------
HTTP/1.1 200 OK
Content-Length: 747
Access-Control-Allow-Headers: Origin,Accept,Content-Type,Authorization,X-CSRF-Token
Access-Control-Allow-Methods: GET,POST,DELETE,PUT
Access-Control-Allow-Origin: *
Connection: keep-alive
Content-Type: application/json; charset=utf-8
Date: Wed, 04 Nov 2020 13:54:59 GMT
X-Download-Options: noopen
X-Frame-Options: SAMEORIGIN
X-Ratelimit-Limit: 300
X-Ratelimit-Remaining: 299
X-Request-Id: 46f3a906-493a-4abd-b477-73c9af6f665f
X-Response-Time: 293ms
{
"request": {
"id": "46f3a906-493a-4abd-b477-73c9af6f665f",
"url": "/aws/ec2/group/sig-****/status",
"method": "GET",
"timestamp": "2020-11-04T13:54:59.143Z"
},
"response": {
"status": {
"code": 200,
"message": "OK"
},
"kind": "spotinst:aws:ec2:group",
"items": [
{
"spotInstanceRequestId": "sir-tjdsjmch",
"instanceId": "i-0c8dfd269d1bffd81",
"instanceType": "t3a.2xlarge",
"product": "Linux/UNIX",
"groupId": "sig-****",
"availabilityZone": "us-east-1f",
"privateIp": "10.40.41.169",
"createdAt": "2020-11-04T13:17:13.000Z",
"publicIp": null,
"status": "fulfilled"
}
],
"count": 1
}
}
-------------------------------------------------------
I1104 15:54:59.231807 12586 resources.go:377] Adding instance "i-0c8dfd269d1bffd81" (created at: 2020-11-04T13:17:13Z) to instance group: "algo.example.com" (updated at: 2020-11-04T13:15:14Z)
I1104 15:54:59.231818 12586 resources.go:405] Found group with corresponding instance group: "master-us-east-1f.masters.example.com"
I1104 15:54:59.231824 12586 resources.go:295] Attempting to fetch all instances of instance group: "master-us-east-1f.masters.example.com" (id: "sig-****")
I1104 15:54:59.231916 12586 spotinst.go:80] SPOTINST: Request "GET https://api.spotinst.io/aws/ec2/group/sig-****/status?accountId=act-*****" details:
---[ REQUEST ]---------------------------------------
GET /aws/ec2/group/sig-****/status?accountId=act-***** HTTP/1.1
Host: api.spotinst.io
User-Agent: kubernetes-kops/1.18.2 spotinst-sdk-go/1.49.0 (go1.13.9; linux; amd64)
Accept: application/json
Authorization: Bearer ****
Content-Type: application/json
Accept-Encoding: gzip
-----------------------------------------------------
I1104 15:54:59.396698 12586 spotinst.go:80] SPOTINST: Response "GET https://api.spotinst.io/aws/ec2/group/sig-****/status?accountId=act-*****" details:
---[ RESPONSE ]----------------------------------------
HTTP/1.1 200 OK
Content-Length: 733
Access-Control-Allow-Headers: Origin,Accept,Content-Type,Authorization,X-CSRF-Token
Access-Control-Allow-Methods: GET,POST,DELETE,PUT
Access-Control-Allow-Origin: *
Connection: keep-alive
Content-Type: application/json; charset=utf-8
Date: Wed, 04 Nov 2020 13:54:59 GMT
X-Download-Options: noopen
X-Frame-Options: SAMEORIGIN
X-Ratelimit-Limit: 300
X-Ratelimit-Remaining: 299
X-Request-Id: 96d415f7-090c-48d1-9aab-6bc29e45a600
X-Response-Time: 18ms
{
"request": {
"id": "96d415f7-090c-48d1-9aab-6bc29e45a600",
"url": "/aws/ec2/group/sig-****/status",
"method": "GET",
"timestamp": "2020-11-04T13:54:59.308Z"
},
"response": {
"status": {
"code": 200,
"message": "OK"
},
"kind": "spotinst:aws:ec2:group",
"items": [
{
"spotInstanceRequestId": null,
"instanceId": "i-015c846b225ceb0dc",
"instanceType": "m5a.large",
"product": "Linux/UNIX",
"groupId": "sig-****",
"availabilityZone": "us-east-1f",
"privateIp": "10.40.54.156",
"createdAt": "2020-10-14T10:49:26.000Z",
"publicIp": null,
"status": "running"
}
],
"count": 1
}
}
-------------------------------------------------------
I1104 15:54:59.396822 12586 resources.go:377] Adding instance "i-015c846b225ceb0dc" (created at: 2020-10-14T10:49:26Z) to instance group: "master-us-east-1f.masters.example.com" (updated at: 2020-11-02T18:27:04Z)
I1104 15:54:59.396843 12586 node_conditions.go:64] v1.NodeNetworkUnavailable condition not set on node ip-10-40-41-169.ec2.internal
I1104 15:54:59.396852 12586 node_conditions.go:64] v1.NodeNetworkUnavailable condition not set on node ip-10-40-54-156.ec2.internal
I1104 15:54:59.396861 12586 node_conditions.go:64] v1.NodeNetworkUnavailable condition not set on node ip-10-40-59-224.ec2.internal
I1104 15:54:59.396869 12586 node_conditions.go:64] v1.NodeNetworkUnavailable condition not set on node ip-10-40-56-27.ec2.internal
I1104 15:54:59.396875 12586 node_conditions.go:64] v1.NodeNetworkUnavailable condition not set on node ip-10-40-51-35.ec2.internal
I1104 15:54:59.396883 12586 node_conditions.go:64] v1.NodeNetworkUnavailable condition not set on node ip-10-40-45-241.ec2.internal
I1104 15:54:59.396888 12586 node_conditions.go:64] v1.NodeNetworkUnavailable condition not set on node ip-10-40-42-110.ec2.internal
I1104 15:54:59.396894 12586 node_conditions.go:64] v1.NodeNetworkUnavailable condition not set on node ip-10-40-55-41.ec2.internal
I1104 15:54:59.396900 12586 node_conditions.go:64] v1.NodeNetworkUnavailable condition not set on node ip-10-40-57-245.ec2.internal
I1104 15:54:59.396987 12586 round_trippers.go:423] curl -k -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" 'https://api.example.com/api/v1/componentstatuses'
I1104 15:54:59.563016 12586 round_trippers.go:443] GET https://api.example.com/api/v1/componentstatuses 200 OK in 166 milliseconds
I1104 15:54:59.563064 12586 round_trippers.go:449] Response Headers:
I1104 15:54:59.563072 12586 round_trippers.go:452] Audit-Id: e5b36d84-3e56-4b60-9e63-41d83bc4b28e
I1104 15:54:59.563078 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:54:59.563082 12586 round_trippers.go:452] Content-Length: 847
I1104 15:54:59.563087 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:54:59 GMT
I1104 15:54:59.563112 12586 request.go:1068] Response Body: {"kind":"ComponentStatusList","apiVersion":"v1","metadata":{"selfLink":"/api/v1/componentstatuses"},"items":[{"metadata":{"name":"controller-manager","selfLink":"/api/v1/componentstatuses/controller-manager","creationTimestamp":null},"conditions":[{"type":"Healthy","status":"True","message":"ok"}]},{"metadata":{"name":"scheduler","selfLink":"/api/v1/componentstatuses/scheduler","creationTimestamp":null},"conditions":[{"type":"Healthy","status":"True","message":"ok"}]},{"metadata":{"name":"etcd-1","selfLink":"/api/v1/componentstatuses/etcd-1","creationTimestamp":null},"conditions":[{"type":"Healthy","status":"True","message":"{\"health\":\"true\"}"}]},{"metadata":{"name":"etcd-0","selfLink":"/api/v1/componentstatuses/etcd-0","creationTimestamp":null},"conditions":[{"type":"Healthy","status":"True","message":"{\"health\":\"true\"}"}]}]}
I1104 15:54:59.563898 12586 round_trippers.go:423] curl -k -v -XGET -H "Authorization: Basic ******" -H "Accept: application/json, */*" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" 'https://api.example.com/api/v1/pods?limit=500'
I1104 15:54:59.723093 12586 round_trippers.go:443] GET https://api.example.com/api/v1/pods?limit=500 200 OK in 159 milliseconds
I1104 15:54:59.723120 12586 round_trippers.go:449] Response Headers:
I1104 15:54:59.723126 12586 round_trippers.go:452] Audit-Id: fad90dd8-a336-40f3-863c-1e810661772b
I1104 15:54:59.723131 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:54:59.723135 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:54:59 GMT
I1104 15:55:00.026954 12586 request.go:1068] Response Body: {"kind":"PodList","apiVersion":"v1","metadata":{"selfLink":"/api/v1/pods","resourceVersion":"45489061"},"items":[{"metadata":{"name":"algorithm-service-68df684767-wh7wv","generateName":"algorithm-service-68df684767-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/algorithm-service-68df684767-wh7wv","uid":"f442f532-1e9f-11eb-9aff-16da7cad7b07","resourceVersion":"45483330","creationTimestamp":"2020-11-04T13:16:31Z","labels":{"app":"algorithm-service","pod-template-hash":"68df684767","release":"invu-sre-algorithm-service"},"annotations":{"iam.amazonaws.com/role":"invu-sre-objects-access"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"algorithm-service-68df684767","uid":"f441a383-1e9f-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-kvb6j","secret":{"secretName":"default-token-kvb6j","defaultMode":420}}],"containers":[{"name":"algorithm-service","image":"registry.example.com/cybervision/invu-algorithm-service:2.0.0-38065","ports":[{"name":"http","containerPort":80,"protocol":"TCP"}],"env":[{"name":"FMHR_MIN_FHR_VALID_SAMPLES","value":"15"},{"name":"USE_EXTERNAL","value":"true"},{"name":"S3_BUCKET_NAME","value":"invu-sre-objects"},{"name":"BOOTSTRAP_SERVERS","value":"kafka:9092"},{"name":"DEBUG_PORT","value":"15013"},{"name":"OMP_NUM_THREADS","value":"4"},{"name":"REDIS_HOST","value":"redis"},{"name":"REDIS_PORT","value":"6379"},{"name":"ZOOKEEPER_CONNECT_STRING","value":"kafka-zookeeper:2181"},{"name":"ACTIVE_PROFILES","value":"no-jwt,monitoring"},{"name":"AUTH_SERVICE_HOST","value":"auth-service"},{"name":"CASSANDRA_HOST","value":"cassandra"},{"name":"CASSANDRA_PREFIX","value":"invu"},{"name":"LIB_PATH_UNCOMM","value":"true"},{"name":"SERVICE_NAME","value":"algorithm-service"},{"name":"INSTANCE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.name"}}},{"name":"MY_POD_NAMESPACE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}},{"name":"REPLICATION_FACTOR","valueFrom":{"configMapKeyRef":{"name":"invu-configmap","key":"invu-kafka-replication-factor"}}}],"resources":{"limits":{"cpu":"3900m","memory":"7Gi"},"requests":{"cpu":"3900m","memory":"7Gi"}},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":240,"timeoutSeconds":1,"periodSeconds":15,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":15,"timeoutSeconds":1,"periodSeconds":15,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","nodeSelector":{"dedicated":"algo"},"serviceAccountName":"default","serviceAccount":"default","nodeName":"ip-10-40-41-169.ec2.internal","securityContext":{},"affinity":{"nodeAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":{"nodeSelectorTerms":[{"matchExpressions":[{"key":"dedicated","operator":"In","values":["algo"]}]}]}},"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"dedicated","operator":"Equal","value":"algo","effect":"NoSchedule"},{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:19:57Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:20:49Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:20:49Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:19:57Z"}],"hostIP":"10.40.41.169","podIP":"10.40.32.137","startTime":"2020-11-04T13:19:57Z","containerStatuses":[{"name":"algorithm-service","state":{"running":{"startedAt":"2020-11-04T13:20:13Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/cybervision/invu-algorithm-service:2.0.0-38065","imageID":"docker-pullable://registry.example.com/cybervision/invu-algorithm-service@sha256:ec66013ab9c9e14369cd38501e09a399595a52f4b7424d9883d40009c12f705a","containerID":"docker://78d0502e1ca1b82bf4d12230ee484181e91c2b60fc5561481b09698d0d1b54d5"}],"qosClass":"Guaranteed"}},{"metadata":{"name":"auth-service-795989cdd7-ptwk8","generateName":"auth-service-795989cdd7-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/auth-service-795989cdd7-ptwk8","uid":"f55440f0-1e9f-11eb-9aff-16da7cad7b07","resourceVersion":"45482894","creationTimestamp":"2020-11-04T13:16:32Z","labels":{"app":"auth-service","pod-template-hash":"795989cdd7","release":"invu-sre-auth-service"},"annotations":{"iam.amazonaws.com/role":"invu-sre-objects-access"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"auth-service-795989cdd7","uid":"f5526627-1e9f-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-kvb6j","secret":{"secretName":"default-token-kvb6j","defaultMode":420}}],"initContainers":[{"name":"mysql-client","image":"registry.example.com/ce/utilities/mysql-client","env":[{"name":"DATABASE_NAME","value":"pregsense_auth_service"},{"name":"MYSQL_USER","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MYSQL_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}}],"resources":{},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"auth-service","image":"registry.example.com/cybervision/pregsense-auth-service:2.0.0-37888","ports":[{"name":"http","containerPort":80,"protocol":"TCP"}],"env":[{"name":"AUTH0_CONFIGURATION_SERVICE_MAIN_CLIENT_ID","value":"ZPCAUpbJZnSPWN7Zs1EQXkX2CBnrMgDg"},{"name":"AUTH0_MAIN_CLIENT_ID","value":"guxq2R8Ciy0A56uKK4MZRhtiSAihcjJL"},{"name":"AUTH0_MAIN_CLIENT_SECRET","value":"EIt1jVa5nCWQdvtQusbSvaeMR37z0YUlutpDOy9CC49Jxd-7NZuyYK5KXFSEWakA"},{"name":"AUTH0_MDOMAIN","value":"example-sre-invu.us.auth0.com"},{"name":"ZOOKEEPER_CONNECT_STRING","value":"kafka-zookeeper:2181"},{"name":"AUTH_SERVICE_HOST","value":"auth-service"},{"name":"BOOTSTRAP_SERVERS","value":"kafka:9092"},{"name":"DEBUG","value":"false"},{"name":"JAVA_OPTS","value":"-Xmx512M"},{"name":"MARIADB_HOST","value":"mariadb"},{"name":"MARIADB_USERNAME","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MARIADB_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}},{"name":"DEPLOYMENT_ADMIN_EMAIL","valueFrom":{"secretKeyRef":{"name":"auth-service-credentials","key":"email"}}},{"name":"DEPLOYMENT_ADMIN_PASSWORD","valueFrom":{"secretKeyRef":{"name":"auth-service-credentials","key":"password"}}},{"name":"S3_BUCKET_NAME","value":"invu-sre-objects"},{"name":"INSTANCE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.name"}}},{"name":"REPLICATION_FACTOR","valueFrom":{"configMapKeyRef":{"name":"invu-configmap","key":"invu-kafka-replication-factor"}}}],"resources":{"limits":{"cpu":"500m","memory":"1Gi"},"requests":{"cpu":"500m","memory":"750Mi"}},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/api/v1/uaa/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":240,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/api/v1/uaa/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":5,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"ip-10-40-57-245.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app","operator":"In","values":["auth-service"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:34Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:18:45Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:18:45Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:32Z"}],"hostIP":"10.40.57.245","podIP":"10.40.63.180","startTime":"2020-11-04T13:16:33Z","initContainerStatuses":[{"name":"mysql-client","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T13:16:34Z","finishedAt":"2020-11-04T13:16:34Z","containerID":"docker://fc9d465f3960a0f31adb6be0cace2081375d13abb464b7437b9f147ed8b1fa91"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/utilities/mysql-client:latest","imageID":"docker-pullable://registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","containerID":"docker://fc9d465f3960a0f31adb6be0cace2081375d13abb464b7437b9f147ed8b1fa91"}],"containerStatuses":[{"name":"auth-service","state":{"running":{"startedAt":"2020-11-04T13:16:39Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/cybervision/pregsense-auth-service:2.0.0-37888","imageID":"docker-pullable://registry.example.com/cybervision/pregsense-auth-service@sha256:96526bbbd74cffab866d7cdf38ccc23cc59228a95d6d6c10d28f4ee056f7f4d0","containerID":"docker://fd4d94d0dc8c448894e279e5f7eb94803fc4a34e8108b8ba3fdd082b1003beeb"}],"qosClass":"Burstable"}},{"metadata":{"name":"business-service-activity-787b4d67c7-nf7dw","generateName":"business-service-activity-787b4d67c7-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/business-service-activity-787b4d67c7-nf7dw","uid":"f662517e-1e9f-11eb-9aff-16da7cad7b07","resourceVersion":"45482867","creationTimestamp":"2020-11-04T13:16:34Z","labels":{"app":"business-service-activity","pod-template-hash":"787b4d67c7","release":"invu-sre-business-service-activity"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"business-service-activity-787b4d67c7","uid":"f65fff87-1e9f-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-kvb6j","secret":{"secretName":"default-token-kvb6j","defaultMode":420}}],"initContainers":[{"name":"mysql-client","image":"registry.example.com/ce/utilities/mysql-client","env":[{"name":"DATABASE_NAME","value":"invu_activity_service"},{"name":"MYSQL_USER","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MYSQL_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}}],"resources":{},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"business-service-activity","image":"registry.example.com/cybervision/pregsense-activity-service:2.0.0-37549","ports":[{"name":"http","containerPort":80,"protocol":"TCP"}],"env":[{"name":"BOOTSTRAP_SERVERS","value":"kafka:9092"},{"name":"ZOOKEEPER_CONNECT_STRING","value":"kafka-zookeeper:2181"},{"name":"AUTH_SERVICE_HOST","value":"auth-service"},{"name":"DEBUG","value":"false"},{"name":"JAVA_OPTS","value":"-Xmx512M"},{"name":"MARIADB_HOST","value":"mariadb"},{"name":"MARIADB_USERNAME","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MARIADB_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}},{"name":"INSTANCE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.name"}}}],"resources":{"limits":{"cpu":"500m","memory":"1Gi"},"requests":{"cpu":"500m","memory":"750Mi"}},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/api/v1/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":240,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/api/v1/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":5,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"ip-10-40-57-245.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app","operator":"In","values":["business-service-activity"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:40Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:18:36Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:18:36Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:34Z"}],"hostIP":"10.40.57.245","podIP":"10.40.39.108","startTime":"2020-11-04T13:16:34Z","initContainerStatuses":[{"name":"mysql-client","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T13:16:39Z","finishedAt":"2020-11-04T13:16:39Z","containerID":"docker://fc183e45e36031910a9a168cb95934b70dc938be49d4623cf31fd288fc7f655e"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/utilities/mysql-client:latest","imageID":"docker-pullable://registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","containerID":"docker://fc183e45e36031910a9a168cb95934b70dc938be49d4623cf31fd288fc7f655e"}],"containerStatuses":[{"name":"business-service-activity","state":{"running":{"startedAt":"2020-11-04T13:16:40Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/cybervision/pregsense-activity-service:2.0.0-37549","imageID":"docker-pullable://registry.example.com/cybervision/pregsense-activity-service@sha256:52a50e96512249156c779d18a5aecc8082e2829221ecd3bc635401bf76ab9c61","containerID":"docker://361969700ed16ad4f267eb30be8c4e10abb844876b351a9becdd1a56749c2b69"}],"qosClass":"Burstable"}},{"metadata":{"name":"business-service-data-extractor-6b698d7cdc-zhjn7","generateName":"business-service-data-extractor-6b698d7cdc-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/business-service-data-extractor-6b698d7cdc-zhjn7","uid":"0a509844-1ea0-11eb-9aff-16da7cad7b07","resourceVersion":"45483499","creationTimestamp":"2020-11-04T13:17:08Z","labels":{"app":"business-service-data-extractor","pod-template-hash":"6b698d7cdc","release":"invu-sre-business-service-data-extractor"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"business-service-data-extractor-6b698d7cdc","uid":"0a49e5e1-1ea0-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-kvb6j","secret":{"secretName":"default-token-kvb6j","defaultMode":420}}],"containers":[{"name":"business-service-data-extractor","image":"registry.example.com/cybervision/usability-data-extractor-service:2.0.0-38072","ports":[{"name":"http","containerPort":8080,"protocol":"TCP"}],"env":[{"name":"CASSANDRA_HOST","value":"cassandra"},{"name":"DEBUG","value":"false"},{"name":"JAVA_OPTS","value":"-Xmx512M"},{"name":"MARIADB_HOST","value":"mariadb"},{"name":"MARIADB_USERNAME","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MARIADB_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}}],"resources":{"limits":{"cpu":"500m","memory":"1Gi"},"requests":{"cpu":"500m","memory":"750Mi"}},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/api/v1/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":240,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/api/v1/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":5,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"ip-10-40-59-224.ec2.internal","securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:20:05Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:21:47Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:21:47Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:20:05Z"}],"hostIP":"10.40.59.224","podIP":"10.40.52.186","startTime":"2020-11-04T13:20:05Z","containerStatuses":[{"name":"business-service-data-extractor","state":{"running":{"startedAt":"2020-11-04T13:20:14Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/cybervision/usability-data-extractor-service:2.0.0-38072","imageID":"docker-pullable://registry.example.com/cybervision/usability-data-extractor-service@sha256:e22df292989e525a9339b690d6d6a8e14134bb5ea6a06235691c019e11135f51","containerID":"docker://ca5d72fa9b390ba238f869308e91c5273c1dd73ed689c1bcba51e9a126d8c5bf"}],"qosClass":"Burstable"}},{"metadata":{"name":"business-service-monitoring-session-56796f5968-jj2sm","generateName":"business-service-monitoring-session-56796f5968-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/business-service-monitoring-session-56796f5968-jj2sm","uid":"f7c63c23-1e9f-11eb-9aff-16da7cad7b07","resourceVersion":"45482939","creationTimestamp":"2020-11-04T13:16:37Z","labels":{"app":"business-service-monitoring-session","pod-template-hash":"56796f5968","release":"invu-sre-business-service-monitoring-session"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"business-service-monitoring-session-56796f5968","uid":"f7c4be7f-1e9f-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-kvb6j","secret":{"secretName":"default-token-kvb6j","defaultMode":420}}],"initContainers":[{"name":"mysql-client","image":"registry.example.com/ce/utilities/mysql-client","env":[{"name":"DATABASE_NAME","value":"invu_monitoring_session_service"},{"name":"MYSQL_USER","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MYSQL_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}}],"resources":{},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"business-service-monitoring-session","image":"registry.example.com/cybervision/pregsense-monitoring-session-service:2.0.0-37729","ports":[{"name":"http","containerPort":80,"protocol":"TCP"}],"env":[{"name":"BOOTSTRAP_SERVERS","value":"kafka:9092"},{"name":"DEVICE_USAGE_LIMIT","value":"7.2e+06"},{"name":"SESSION_DELAY_LIMIT","value":"0"},{"name":"ZOOKEEPER_CONNECT_STRING","value":"kafka-zookeeper:2181"},{"name":"AUTH_SERVICE_HOST","value":"auth-service"},{"name":"DEBUG","value":"false"},{"name":"JAVA_OPTS","value":"-Xmx512M"},{"name":"MARIADB_HOST","value":"mariadb"},{"name":"REDIS_HOST","value":"redis"},{"name":"MARIADB_USERNAME","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MARIADB_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}},{"name":"INSTANCE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.name"}}}],"resources":{"limits":{"cpu":"500m","memory":"1Gi"},"requests":{"cpu":"500m","memory":"750Mi"}},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/api/v1/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":240,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/api/v1/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":5,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"ip-10-40-42-110.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}],"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":100,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"kubernetes.io/hostname"}}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app","operator":"In","values":["business-service-monitoring-session"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:40Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:18:57Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:18:57Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:37Z"}],"hostIP":"10.40.42.110","podIP":"10.40.42.59","startTime":"2020-11-04T13:16:37Z","initContainerStatuses":[{"name":"mysql-client","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T13:16:39Z","finishedAt":"2020-11-04T13:16:39Z","containerID":"docker://165c34c605f5dd986fe8cfb93cb0c452d4c8a47962b9e71e4dcc627a1222cabd"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/utilities/mysql-client:latest","imageID":"docker-pullable://registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","containerID":"docker://165c34c605f5dd986fe8cfb93cb0c452d4c8a47962b9e71e4dcc627a1222cabd"}],"containerStatuses":[{"name":"business-service-monitoring-session","state":{"running":{"startedAt":"2020-11-04T13:16:53Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/cybervision/pregsense-monitoring-session-service:2.0.0-37729","imageID":"docker-pullable://registry.example.com/cybervision/pregsense-monitoring-session-service@sha256:eedc23e0c6848e90c6725ea2e0f821a9911a8651cdf964b48a818526c6154d99","containerID":"docker://0b425c7d872e7c56cb4d2aa8cd720d181047150fc5843de4a262993bcba95234"}],"qosClass":"Burstable"}},{"metadata":{"name":"cassandra-0","generateName":"cassandra-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/cassandra-0","uid":"c4fccc98-1e9a-11eb-9aff-16da7cad7b07","resourceVersion":"45476654","creationTimestamp":"2020-11-04T12:39:24Z","labels":{"app":"cassandra","controller-revision-hash":"cassandra-d8959bdd7","release":"invu-sre-cassandra","statefulset.kubernetes.io/pod-name":"cassandra-0"},"annotations":{"prometheus.io/port":"7070","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"StatefulSet","name":"cassandra","uid":"c4f2979b-1e9a-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"data","persistentVolumeClaim":{"claimName":"data-cassandra-0"}}],"initContainers":[{"name":"init","image":"busybox:1.30.0","command":["/bin/sh","-c","sysctl -w vm.max_map_count=1048575"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"privileged":true,"procMount":"Default"}}],"containers":[{"name":"cassandra","image":"registry.example.com/ce/middleware/cassandra:0.6.40","ports":[{"name":"intra","containerPort":7000,"protocol":"TCP"},{"name":"tls","containerPort":7001,"protocol":"TCP"},{"name":"jmx","containerPort":7199,"protocol":"TCP"},{"name":"cql","containerPort":9042,"protocol":"TCP"},{"name":"metrics","containerPort":7070,"protocol":"TCP"}],"env":[{"name":"CASSANDRA_SEEDS","value":"cassandra-0.cassandra.invu-sre.svc.cluster.local,cassandra-1.cassandra.invu-sre.svc.cluster.local"},{"name":"CASSANDRA_BROADCAST_ADDRESS","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}},{"name":"CASSANDRA_CLUSTER_NAME","value":"cassandra"},{"name":"CASSANDRA_COMMITLOG_SEGMENT_SIZE_IN_MB","value":"64"},{"name":"CASSANDRA_DC","value":"DC1"},{"name":"CASSANDRA_ENDPOINT_SNITCH","value":"Ec2Snitch"},{"name":"CASSANDRA_MAX_MUTATION_SIZE_IN_KB","value":"32768"},{"name":"CASSANDRA_NUM_TOKENS","value":"256"},{"name":"CASSANDRA_RACK","value":"RAC1"},{"name":"CASSANDRA_START_RPC","value":"false"},{"name":"HEAP_NEWSIZE","value":"512M"},{"name":"MAX_HEAP_SIZE","value":"2048M"}],"resources":{"limits":{"cpu":"2400m","memory":"4Gi"},"requests":{"cpu":"600m","memory":"4Gi"}},"volumeMounts":[{"name":"data","mountPath":"/var/lib/cassandra"}],"livenessProbe":{"exec":{"command":["/bin/sh","-c","nodetool status"]},"initialDelaySeconds":30,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"exec":{"command":["/bin/sh","-c","nodetool status | grep -E \"^UN\\s+${POD_IP}\""]},"initialDelaySeconds":30,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"lifecycle":{"preStop":{"exec":{"command":["/bin/sh","-c","nodetool drain"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"runAsUser":999,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-45-241.ec2.internal","securityContext":{"fsGroup":999},"hostname":"cassandra-0","subdomain":"cassandra","affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app","operator":"In","values":["cassandra"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:43:21Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:05Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:05Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:42:56Z"}],"hostIP":"10.40.45.241","podIP":"10.40.55.34","startTime":"2020-11-04T12:42:56Z","initContainerStatuses":[{"name":"init","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T12:43:20Z","finishedAt":"2020-11-04T12:43:20Z","containerID":"docker://b73f34e58139d64b63efad70a20f12f96b80c90e6a7c092ce33767c737f27b06"}},"lastState":{},"ready":true,"restartCount":0,"image":"busybox:1.30.0","imageID":"docker-pullable://busybox@sha256:7964ad52e396a6e045c39b5a44438424ac52e12e4d5a25d94895f2058cb863a0","containerID":"docker://b73f34e58139d64b63efad70a20f12f96b80c90e6a7c092ce33767c737f27b06"}],"containerStatuses":[{"name":"cassandra","state":{"running":{"startedAt":"2020-11-04T12:43:30Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/middleware/cassandra:0.6.40","imageID":"docker-pullable://registry.example.com/ce/middleware/cassandra@sha256:29ff685aae75edaae14d052e723a66fabbd8e6e9ede068bb4a901776ada3b493","containerID":"docker://d61a99f47a0607979406c5c5b504a62ed253678a83993366d54824ca00d8ddaa"}],"qosClass":"Burstable"}},{"metadata":{"name":"cassandra-1","generateName":"cassandra-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/cassandra-1","uid":"6cbb6c68-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45476933","creationTimestamp":"2020-11-04T12:44:05Z","labels":{"app":"cassandra","controller-revision-hash":"cassandra-d8959bdd7","release":"invu-sre-cassandra","statefulset.kubernetes.io/pod-name":"cassandra-1"},"annotations":{"prometheus.io/port":"7070","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"StatefulSet","name":"cassandra","uid":"c4f2979b-1e9a-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"data","persistentVolumeClaim":{"claimName":"data-cassandra-1"}}],"initContainers":[{"name":"init","image":"busybox:1.30.0","command":["/bin/sh","-c","sysctl -w vm.max_map_count=1048575"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"privileged":true,"procMount":"Default"}}],"containers":[{"name":"cassandra","image":"registry.example.com/ce/middleware/cassandra:0.6.40","ports":[{"name":"intra","containerPort":7000,"protocol":"TCP"},{"name":"tls","containerPort":7001,"protocol":"TCP"},{"name":"jmx","containerPort":7199,"protocol":"TCP"},{"name":"cql","containerPort":9042,"protocol":"TCP"},{"name":"metrics","containerPort":7070,"protocol":"TCP"}],"env":[{"name":"CASSANDRA_SEEDS","value":"cassandra-0.cassandra.invu-sre.svc.cluster.local,cassandra-1.cassandra.invu-sre.svc.cluster.local"},{"name":"CASSANDRA_BROADCAST_ADDRESS","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}},{"name":"CASSANDRA_CLUSTER_NAME","value":"cassandra"},{"name":"CASSANDRA_COMMITLOG_SEGMENT_SIZE_IN_MB","value":"64"},{"name":"CASSANDRA_DC","value":"DC1"},{"name":"CASSANDRA_ENDPOINT_SNITCH","value":"Ec2Snitch"},{"name":"CASSANDRA_MAX_MUTATION_SIZE_IN_KB","value":"32768"},{"name":"CASSANDRA_NUM_TOKENS","value":"256"},{"name":"CASSANDRA_RACK","value":"RAC1"},{"name":"CASSANDRA_START_RPC","value":"false"},{"name":"HEAP_NEWSIZE","value":"512M"},{"name":"MAX_HEAP_SIZE","value":"2048M"}],"resources":{"limits":{"cpu":"2400m","memory":"4Gi"},"requests":{"cpu":"600m","memory":"4Gi"}},"volumeMounts":[{"name":"data","mountPath":"/var/lib/cassandra"}],"livenessProbe":{"exec":{"command":["/bin/sh","-c","nodetool status"]},"initialDelaySeconds":30,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"exec":{"command":["/bin/sh","-c","nodetool status | grep -E \"^UN\\s+${POD_IP}\""]},"initialDelaySeconds":30,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"lifecycle":{"preStop":{"exec":{"command":["/bin/sh","-c","nodetool drain"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"runAsUser":999,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-51-35.ec2.internal","securityContext":{"fsGroup":999},"hostname":"cassandra-1","subdomain":"cassandra","affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app","operator":"In","values":["cassandra"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:21Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:58Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:58Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:10Z"}],"hostIP":"10.40.51.35","podIP":"10.40.50.154","startTime":"2020-11-04T12:44:10Z","initContainerStatuses":[{"name":"init","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T12:44:20Z","finishedAt":"2020-11-04T12:44:20Z","containerID":"docker://a32c42e569e13a39e62b36e158ef9a67dacf1c8e74c2a19697b9a88857a0ccab"}},"lastState":{},"ready":true,"restartCount":0,"image":"busybox:1.30.0","imageID":"docker-pullable://busybox@sha256:7964ad52e396a6e045c39b5a44438424ac52e12e4d5a25d94895f2058cb863a0","containerID":"docker://a32c42e569e13a39e62b36e158ef9a67dacf1c8e74c2a19697b9a88857a0ccab"}],"containerStatuses":[{"name":"cassandra","state":{"running":{"startedAt":"2020-11-04T12:44:21Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/middleware/cassandra:0.6.40","imageID":"docker-pullable://registry.example.com/ce/middleware/cassandra@sha256:29ff685aae75edaae14d052e723a66fabbd8e6e9ede068bb4a901776ada3b493","containerID":"docker://4883ece4b3e63aa2c27956fb2ca081101f2b3ad489de78aac23e920f7d4520e3"}],"qosClass":"Burstable"}},{"metadata":{"name":"cassandra-2","generateName":"cassandra-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/cassandra-2","uid":"8be6017e-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45477503","creationTimestamp":"2020-11-04T12:44:58Z","labels":{"app":"cassandra","controller-revision-hash":"cassandra-d8959bdd7","release":"invu-sre-cassandra","statefulset.kubernetes.io/pod-name":"cassandra-2"},"annotations":{"prometheus.io/port":"7070","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"StatefulSet","name":"cassandra","uid":"c4f2979b-1e9a-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"data","persistentVolumeClaim":{"claimName":"data-cassandra-2"}}],"initContainers":[{"name":"init","image":"busybox:1.30.0","command":["/bin/sh","-c","sysctl -w vm.max_map_count=1048575"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"privileged":true,"procMount":"Default"}}],"containers":[{"name":"cassandra","image":"registry.example.com/ce/middleware/cassandra:0.6.40","ports":[{"name":"intra","containerPort":7000,"protocol":"TCP"},{"name":"tls","containerPort":7001,"protocol":"TCP"},{"name":"jmx","containerPort":7199,"protocol":"TCP"},{"name":"cql","containerPort":9042,"protocol":"TCP"},{"name":"metrics","containerPort":7070,"protocol":"TCP"}],"env":[{"name":"CASSANDRA_SEEDS","value":"cassandra-0.cassandra.invu-sre.svc.cluster.local,cassandra-1.cassandra.invu-sre.svc.cluster.local"},{"name":"CASSANDRA_BROADCAST_ADDRESS","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}},{"name":"CASSANDRA_CLUSTER_NAME","value":"cassandra"},{"name":"CASSANDRA_COMMITLOG_SEGMENT_SIZE_IN_MB","value":"64"},{"name":"CASSANDRA_DC","value":"DC1"},{"name":"CASSANDRA_ENDPOINT_SNITCH","value":"Ec2Snitch"},{"name":"CASSANDRA_MAX_MUTATION_SIZE_IN_KB","value":"32768"},{"name":"CASSANDRA_NUM_TOKENS","value":"256"},{"name":"CASSANDRA_RACK","value":"RAC1"},{"name":"CASSANDRA_START_RPC","value":"false"},{"name":"HEAP_NEWSIZE","value":"512M"},{"name":"MAX_HEAP_SIZE","value":"2048M"}],"resources":{"limits":{"cpu":"2400m","memory":"4Gi"},"requests":{"cpu":"600m","memory":"4Gi"}},"volumeMounts":[{"name":"data","mountPath":"/var/lib/cassandra"}],"livenessProbe":{"exec":{"command":["/bin/sh","-c","nodetool status"]},"initialDelaySeconds":30,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"exec":{"command":["/bin/sh","-c","nodetool status | grep -E \"^UN\\s+${POD_IP}\""]},"initialDelaySeconds":30,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"lifecycle":{"preStop":{"exec":{"command":["/bin/sh","-c","nodetool drain"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"runAsUser":999,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-55-41.ec2.internal","securityContext":{"fsGroup":999},"hostname":"cassandra-2","subdomain":"cassandra","affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app","operator":"In","values":["cassandra"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:46:45Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:47:33Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:47:33Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:46:34Z"}],"hostIP":"10.40.55.41","podIP":"10.40.37.136","startTime":"2020-11-04T12:46:34Z","initContainerStatuses":[{"name":"init","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T12:46:44Z","finishedAt":"2020-11-04T12:46:44Z","containerID":"docker://5bcbb0a13e576366dfbc5912e1961a37b68550ef7b4d3c6acba2b7ddd2d003fe"}},"lastState":{},"ready":true,"restartCount":0,"image":"busybox:1.30.0","imageID":"docker-pullable://busybox@sha256:7964ad52e396a6e045c39b5a44438424ac52e12e4d5a25d94895f2058cb863a0","containerID":"docker://5bcbb0a13e576366dfbc5912e1961a37b68550ef7b4d3c6acba2b7ddd2d003fe"}],"containerStatuses":[{"name":"cassandra","state":{"running":{"startedAt":"2020-11-04T12:46:53Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/middleware/cassandra:0.6.40","imageID":"docker-pullable://registry.example.com/ce/middleware/cassandra@sha256:29ff685aae75edaae14d052e723a66fabbd8e6e9ede068bb4a901776ada3b493","containerID":"docker://7d77b6c7e0e1f6ea08db7f6de348b755aeafdefdab36b8347ecbd3f0a441b691"}],"qosClass":"Burstable"}},{"metadata":{"name":"cassandra-repairer-n2b5d","generateName":"cassandra-repairer-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/cassandra-repairer-n2b5d","uid":"c4f87bf0-1e9a-11eb-9aff-16da7cad7b07","resourceVersion":"45477566","creationTimestamp":"2020-11-04T12:39:24Z","labels":{"controller-uid":"c4f460f7-1e9a-11eb-9aff-16da7cad7b07","job-name":"cassandra-repairer"},"ownerReferences":[{"apiVersion":"batch/v1","kind":"Job","name":"cassandra-repairer","uid":"c4f460f7-1e9a-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"cassandra-tasks-token-fwmkp","secret":{"secretName":"cassandra-tasks-token-fwmkp","defaultMode":420}}],"initContainers":[{"name":"waiter","image":"example/kube-tasks:latest","command":["kube-tasks","wait-for-pods","-n","invu-sre","-l","release=invu-sre-cassandra","--replicas","3"],"resources":{},"volumeMounts":[{"name":"cassandra-tasks-token-fwmkp","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"repairer","image":"example/kube-tasks:latest","command":["kube-tasks","execute","-n","invu-sre","-l","release=invu-sre-cassandra","--command","nodetool repair --full"],"resources":{},"volumeMounts":[{"name":"cassandra-tasks-token-fwmkp","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"restartPolicy":"OnFailure","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"cassandra-tasks","serviceAccount":"cassandra-tasks","nodeName":"ip-10-40-45-241.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":1,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app","operator":"In","values":["cassandra"]},{"key":"release","operator":"In","values":["invu-sre-cassandra"]}]},"topologyKey":"kubernetes.io/hostname"}}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Succeeded","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:47:36Z","reason":"PodCompleted"},{"type":"Ready","status":"False","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:47:55Z","reason":"PodCompleted"},{"type":"ContainersReady","status":"False","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:47:55Z","reason":"PodCompleted"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:39:24Z"}],"hostIP":"10.40.45.241","podIP":"10.40.38.2","startTime":"2020-11-04T12:39:24Z","initContainerStatuses":[{"name":"waiter","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T12:39:26Z","finishedAt":"2020-11-04T12:47:36Z","containerID":"docker://cd4459b203d6b588b30d6ad65be8cb76b7e546bb49ac406a2b413ce5c77b8e8e"}},"lastState":{},"ready":true,"restartCount":0,"image":"example/kube-tasks:latest","imageID":"docker-pullable://example/kube-tasks@sha256:713a62fab6a3075227d6a53681e548bc7cdaa39143bb135c939cc9573fd66965","containerID":"docker://cd4459b203d6b588b30d6ad65be8cb76b7e546bb49ac406a2b413ce5c77b8e8e"}],"containerStatuses":[{"name":"repairer","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T12:47:37Z","finishedAt":"2020-11-04T12:47:54Z","containerID":"docker://fc59c77c863f040b974806b448d88a24f15795bbdf6c7cc96ee7eca9ebae2883"}},"lastState":{},"ready":false,"restartCount":0,"image":"example/kube-tasks:latest","imageID":"docker-pullable://example/kube-tasks@sha256:713a62fab6a3075227d6a53681e548bc7cdaa39143bb135c939cc9573fd66965","containerID":"docker://fc59c77c863f040b974806b448d88a24f15795bbdf6c7cc96ee7eca9ebae2883"}],"qosClass":"BestEffort"}},{"metadata":{"name":"device-service-859d78f779-gpnlj","generateName":"device-service-859d78f779-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/device-service-859d78f779-gpnlj","uid":"f8f16fc2-1e9f-11eb-9aff-16da7cad7b07","resourceVersion":"45482804","creationTimestamp":"2020-11-04T13:16:39Z","labels":{"app":"device-service","pod-template-hash":"859d78f779","release":"invu-sre-device-service"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"device-service-859d78f779","uid":"f8eff495-1e9f-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-kvb6j","secret":{"secretName":"default-token-kvb6j","defaultMode":420}}],"initContainers":[{"name":"mysql-client","image":"registry.example.com/ce/utilities/mysql-client","env":[{"name":"DATABASE_NAME","value":"invu_device_service"},{"name":"MYSQL_USER","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MYSQL_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}}],"resources":{},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"device-service","image":"registry.example.com/cybervision/pregsense-device-service:2.0.0-37554","ports":[{"name":"http","containerPort":80,"protocol":"TCP"}],"env":[{"name":"ZOOKEEPER_CONNECT_STRING","value":"kafka-zookeeper:2181"},{"name":"AUTH_SERVICE_HOST","value":"auth-service"},{"name":"BOOTSTRAP_SERVERS","value":"kafka:9092"},{"name":"DEBUG","value":"false"},{"name":"JAVA_OPTS","value":"-Xmx512M"},{"name":"MARIADB_HOST","value":"mariadb"},{"name":"MARIADB_USERNAME","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MARIADB_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}},{"name":"INSTANCE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.name"}}}],"resources":{"limits":{"cpu":"500m","memory":"1Gi"},"requests":{"cpu":"500m","memory":"750Mi"}},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/api/v1/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":240,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/api/v1/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":5,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"ip-10-40-55-41.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app","operator":"In","values":["device-service"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:46Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:18:19Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:18:19Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:39Z"}],"hostIP":"10.40.55.41","podIP":"10.40.44.227","startTime":"2020-11-04T13:16:39Z","initContainerStatuses":[{"name":"mysql-client","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T13:16:45Z","finishedAt":"2020-11-04T13:16:45Z","containerID":"docker://82940018dbfb21f66d70ae8308d2a2a08c8f35d6dac041698e86c7f694b93da0"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/utilities/mysql-client:latest","imageID":"docker-pullable://registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","containerID":"docker://82940018dbfb21f66d70ae8308d2a2a08c8f35d6dac041698e86c7f694b93da0"}],"containerStatuses":[{"name":"device-service","state":{"running":{"startedAt":"2020-11-04T13:16:51Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/cybervision/pregsense-device-service:2.0.0-37554","imageID":"docker-pullable://registry.example.com/cybervision/pregsense-device-service@sha256:ccdcd8bec0cc02d64da785a6ae863b31e335e28f089a92f071affaee5ec1a2cb","containerID":"docker://5e61a987cddcd5854996b4c92c1b9022d8e8654ab5522859b3b9d90ab3e40c05"}],"qosClass":"Burstable"}},{"metadata":{"name":"edge-service-64bcfb8746-58c66","generateName":"edge-service-64bcfb8746-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/edge-service-64bcfb8746-58c66","uid":"f9f9fb9a-1e9f-11eb-9aff-16da7cad7b07","resourceVersion":"45483056","creationTimestamp":"2020-11-04T13:16:40Z","labels":{"app":"edge-service","pod-template-hash":"64bcfb8746","release":"invu-sre-edge-service"},"annotations":{"iam.amazonaws.com/role":"invu-sre-objects-access"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"edge-service-64bcfb8746","uid":"f9f90cdd-1e9f-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-kvb6j","secret":{"secretName":"default-token-kvb6j","defaultMode":420}}],"initContainers":[{"name":"mysql-client","image":"registry.example.com/ce/utilities/mysql-client","env":[{"name":"DATABASE_NAME","value":"invu_gateway_service"},{"name":"MYSQL_USER","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MYSQL_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}}],"resources":{},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"edge-service","image":"registry.example.com/cybervision/pregsense-gateway-service:2.0.0-38164","ports":[{"name":"http","containerPort":80,"protocol":"TCP"}],"env":[{"name":"S3_BUCKET_NAME","value":"invu-sre-objects"},{"name":"CARE_PLAN_MIN_DURATION","value":"10"},{"name":"CARE_PLAN_MAX_DURATION","value":"null"},{"name":"CARE_PLAN_DEFAULT_DURATION","value":"20"},{"name":"ENVIRONMENT_TYPE","value":"EFM"},{"name":"HTTP_DOMAINS","value":"example.com,localhost"},{"name":"SWAGGER_ENABLED","value":"false"},{"name":"AUTH0_DOMAIN","value":"example-sre-invu.us.auth0.com"},{"name":"BOOTSTRAP_SERVERS","value":"kafka:9092"},{"name":"ZOOKEEPER_CONNECT_STRING","value":"kafka-zookeeper:2181"},{"name":"AUTH_SERVICE_HOST","value":"auth-service"},{"name":"DEBUG","value":"false"},{"name":"JAVA_OPTS","value":"-Xmx1G"},{"name":"MARIADB_HOST","value":"mariadb"},{"name":"MARIADB_USERNAME","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MARIADB_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}},{"name":"INSTANCE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.name"}}},{"name":"REPLICATION_FACTOR","valueFrom":{"configMapKeyRef":{"name":"invu-configmap","key":"invu-kafka-replication-factor"}}}],"resources":{"limits":{"cpu":"500m","memory":"2Gi"},"requests":{"cpu":"500m","memory":"1G"}},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":240,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":5,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"ip-10-40-57-245.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app","operator":"In","values":["edge-service"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:44Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:19:21Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:19:21Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:40Z"}],"hostIP":"10.40.57.245","podIP":"10.40.63.106","startTime":"2020-11-04T13:16:40Z","initContainerStatuses":[{"name":"mysql-client","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T13:16:42Z","finishedAt":"2020-11-04T13:16:42Z","containerID":"docker://bf36ba08427fce4b54cb87cfe9757b2cd49596dc631a912d30774b4a16645978"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/utilities/mysql-client:latest","imageID":"docker-pullable://registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","containerID":"docker://bf36ba08427fce4b54cb87cfe9757b2cd49596dc631a912d30774b4a16645978"}],"containerStatuses":[{"name":"edge-service","state":{"running":{"startedAt":"2020-11-04T13:16:44Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/cybervision/pregsense-gateway-service:2.0.0-38164","imageID":"docker-pullable://registry.example.com/cybervision/pregsense-gateway-service@sha256:ba2b7c16fd295c73ab75edee8808ffd8758c01ad0bd74d394aa7b3395f61d4ad","containerID":"docker://8e64216f3171c2bfb19693ea38419768ef2c9f21b8153d5830ca4a75daa160bc"}],"qosClass":"Burstable"}},{"metadata":{"name":"emqx-758448bfd5-h7s9j","generateName":"emqx-758448bfd5-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/emqx-758448bfd5-h7s9j","uid":"7540f9d4-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45477000","creationTimestamp":"2020-11-04T12:44:20Z","labels":{"app.kubernetes.io/name":"emqx","app.kubernetes.io/part-of":"invu-sre-emqx","pod-template-hash":"758448bfd5"},"annotations":{"prometheus.io/port":"9540","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"emqx-758448bfd5","uid":"753f9db6-1e9b-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"data","configMap":{"name":"emqx","items":[{"key":"loaded_plugins","path":"loaded_plugins"}],"defaultMode":420}},{"name":"plugins","configMap":{"name":"emqx","items":[{"key":"emqx_auth_username.conf","path":"emqx_auth_username.conf"},{"key":"emqx_auth_jwt.conf","path":"emqx_auth_jwt.conf"}],"defaultMode":420}},{"name":"certs","configMap":{"name":"emqx","items":[{"key":"jwt_public_key.pem","path":"jwt_public_key.pem"}],"defaultMode":420}},{"name":"emqx-token-nf8kx","secret":{"secretName":"emqx-token-nf8kx","defaultMode":420}}],"containers":[{"name":"exporter","image":"example/emq_exporter:v0.4.1","args":["--emq.node=emqx@$(POD_IP)","--emq.api-version=v3"],"ports":[{"name":"metrics","containerPort":9540,"protocol":"TCP"}],"env":[{"name":"EMQ_USERNAME","value":"admin"},{"name":"EMQ_PASSWORD","valueFrom":{"secretKeyRef":{"name":"emqx","key":"admin_password"}}},{"name":"POD_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}}],"resources":{"limits":{"cpu":"50m","memory":"64Mi"},"requests":{"cpu":"15m","memory":"32Mi"}},"volumeMounts":[{"name":"emqx-token-nf8kx","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"},{"name":"emqx","image":"emqx/emqx:v3.2.7","ports":[{"name":"mqtt","containerPort":1883,"protocol":"TCP"},{"name":"websocket","containerPort":8083,"protocol":"TCP"},{"name":"mgmt","containerPort":8080,"protocol":"TCP"},{"name":"dashboard","containerPort":18083,"protocol":"TCP"}],"env":[{"name":"EMQ_NODE__COOKIE","valueFrom":{"secretKeyRef":{"name":"emqx","key":"node_cookie"}}},{"name":"EMQX_DASHBOARD__DEFAULT_USER__PASSWORD","valueFrom":{"secretKeyRef":{"name":"emqx","key":"admin_password"}}},{"name":"EMQX_ALLOW_ANONYMOUS","value":"false"},{"name":"EMQX_CLUSTER__AUTOCLEAN","value":"5m"},{"name":"EMQX_CLUSTER__AUTOHEAL","value":"on"},{"name":"EMQX_CLUSTER__DISCOVERY","value":"k8s"},{"name":"EMQX_CLUSTER__K8S__ADDRESS_TYPE","value":"ip"},{"name":"EMQX_CLUSTER__K8S__APISERVER","value":"https://kubernetes.default.svc.cluster.local:443"},{"name":"EMQX_CLUSTER__K8S__APP_NAME","value":"emqx"},{"name":"EMQX_CLUSTER__K8S__NAMESPACE","value":"invu-sre"},{"name":"EMQX_CLUSTER__K8S__SERVICE_NAME","value":"emqx"},{"name":"EMQX_CLUSTER__NAME","value":"emqx_cluster"},{"name":"EMQX_MQTT__MAX_PACKET_SIZE","value":"10MB"},{"name":"EMQX_NAME","value":"emqx"}],"resources":{"limits":{"cpu":"500m","memory":"512Mi"},"requests":{"cpu":"200m","memory":"256Mi"}},"volumeMounts":[{"name":"data","mountPath":"/opt/emqx/data/loaded_plugins","subPath":"loaded_plugins"},{"name":"plugins","mountPath":"/opt/emqx/etc/plugins/emqx_auth_username.conf","subPath":"emqx_auth_username.conf"},{"name":"plugins","mountPath":"/opt/emqx/etc/plugins/emqx_auth_jwt.conf","subPath":"emqx_auth_jwt.conf"},{"name":"certs","mountPath":"/opt/emqx/etc/certs/jwt_public_key.pem","subPath":"jwt_public_key.pem"},{"name":"emqx-token-nf8kx","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"exec":{"command":["/bin/sh","-c","emqx_ctl status | grep 'is running'"]},"initialDelaySeconds":45,"timeoutSeconds":1,"periodSeconds":15,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"exec":{"command":["/bin/sh","-c","emqx_ctl status | grep 'is running'"]},"initialDelaySeconds":45,"timeoutSeconds":1,"periodSeconds":15,"successThreshold":1,"failureThreshold":3},"lifecycle":{"preStop":{"exec":{"command":["/bin/sh","-c","emqx stop"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"runAsUser":1000,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"emqx","serviceAccount":"emqx","nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}],"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":100,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"kubernetes.io/hostname"}}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["emqx"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:20Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:45:16Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:45:16Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:20Z"}],"hostIP":"10.40.56.27","podIP":"10.40.32.131","startTime":"2020-11-04T12:44:20Z","containerStatuses":[{"name":"emqx","state":{"running":{"startedAt":"2020-11-04T12:44:26Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"emqx/emqx:v3.2.7","imageID":"docker-pullable://emqx/emqx@sha256:3f31ee2793b4446e98183659b4493992355e2b0d8603df946c641b47f29ced78","containerID":"docker://974f27ae72445d1d6506dd99933c36122005477e60125d19123b9c633295a6e6"},{"name":"exporter","state":{"running":{"startedAt":"2020-11-04T12:44:23Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"example/emq_exporter:v0.4.1","imageID":"docker-pullable://example/emq_exporter@sha256:1526c0476c1e5d740dfc4df36f3295ea27f87b41becf274c760fbd0a51011233","containerID":"docker://f3270342707cf0eb993e24680050991e5bb867a885b32fddd01c81db07c7ab54"}],"qosClass":"Burstable"}},{"metadata":{"name":"emqx-758448bfd5-x4zrx","generateName":"emqx-758448bfd5-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/emqx-758448bfd5-x4zrx","uid":"7546572e-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45477033","creationTimestamp":"2020-11-04T12:44:20Z","labels":{"app.kubernetes.io/name":"emqx","app.kubernetes.io/part-of":"invu-sre-emqx","pod-template-hash":"758448bfd5"},"annotations":{"prometheus.io/port":"9540","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"emqx-758448bfd5","uid":"753f9db6-1e9b-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"data","configMap":{"name":"emqx","items":[{"key":"loaded_plugins","path":"loaded_plugins"}],"defaultMode":420}},{"name":"plugins","configMap":{"name":"emqx","items":[{"key":"emqx_auth_username.conf","path":"emqx_auth_username.conf"},{"key":"emqx_auth_jwt.conf","path":"emqx_auth_jwt.conf"}],"defaultMode":420}},{"name":"certs","configMap":{"name":"emqx","items":[{"key":"jwt_public_key.pem","path":"jwt_public_key.pem"}],"defaultMode":420}},{"name":"emqx-token-nf8kx","secret":{"secretName":"emqx-token-nf8kx","defaultMode":420}}],"containers":[{"name":"exporter","image":"example/emq_exporter:v0.4.1","args":["--emq.node=emqx@$(POD_IP)","--emq.api-version=v3"],"ports":[{"name":"metrics","containerPort":9540,"protocol":"TCP"}],"env":[{"name":"EMQ_USERNAME","value":"admin"},{"name":"EMQ_PASSWORD","valueFrom":{"secretKeyRef":{"name":"emqx","key":"admin_password"}}},{"name":"POD_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}}],"resources":{"limits":{"cpu":"50m","memory":"64Mi"},"requests":{"cpu":"15m","memory":"32Mi"}},"volumeMounts":[{"name":"emqx-token-nf8kx","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"},{"name":"emqx","image":"emqx/emqx:v3.2.7","ports":[{"name":"mqtt","containerPort":1883,"protocol":"TCP"},{"name":"websocket","containerPort":8083,"protocol":"TCP"},{"name":"mgmt","containerPort":8080,"protocol":"TCP"},{"name":"dashboard","containerPort":18083,"protocol":"TCP"}],"env":[{"name":"EMQ_NODE__COOKIE","valueFrom":{"secretKeyRef":{"name":"emqx","key":"node_cookie"}}},{"name":"EMQX_DASHBOARD__DEFAULT_USER__PASSWORD","valueFrom":{"secretKeyRef":{"name":"emqx","key":"admin_password"}}},{"name":"EMQX_ALLOW_ANONYMOUS","value":"false"},{"name":"EMQX_CLUSTER__AUTOCLEAN","value":"5m"},{"name":"EMQX_CLUSTER__AUTOHEAL","value":"on"},{"name":"EMQX_CLUSTER__DISCOVERY","value":"k8s"},{"name":"EMQX_CLUSTER__K8S__ADDRESS_TYPE","value":"ip"},{"name":"EMQX_CLUSTER__K8S__APISERVER","value":"https://kubernetes.default.svc.cluster.local:443"},{"name":"EMQX_CLUSTER__K8S__APP_NAME","value":"emqx"},{"name":"EMQX_CLUSTER__K8S__NAMESPACE","value":"invu-sre"},{"name":"EMQX_CLUSTER__K8S__SERVICE_NAME","value":"emqx"},{"name":"EMQX_CLUSTER__NAME","value":"emqx_cluster"},{"name":"EMQX_MQTT__MAX_PACKET_SIZE","value":"10MB"},{"name":"EMQX_NAME","value":"emqx"}],"resources":{"limits":{"cpu":"500m","memory":"512Mi"},"requests":{"cpu":"200m","memory":"256Mi"}},"volumeMounts":[{"name":"data","mountPath":"/opt/emqx/data/loaded_plugins","subPath":"loaded_plugins"},{"name":"plugins","mountPath":"/opt/emqx/etc/plugins/emqx_auth_username.conf","subPath":"emqx_auth_username.conf"},{"name":"plugins","mountPath":"/opt/emqx/etc/plugins/emqx_auth_jwt.conf","subPath":"emqx_auth_jwt.conf"},{"name":"certs","mountPath":"/opt/emqx/etc/certs/jwt_public_key.pem","subPath":"jwt_public_key.pem"},{"name":"emqx-token-nf8kx","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"exec":{"command":["/bin/sh","-c","emqx_ctl status | grep 'is running'"]},"initialDelaySeconds":45,"timeoutSeconds":1,"periodSeconds":15,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"exec":{"command":["/bin/sh","-c","emqx_ctl status | grep 'is running'"]},"initialDelaySeconds":45,"timeoutSeconds":1,"periodSeconds":15,"successThreshold":1,"failureThreshold":3},"lifecycle":{"preStop":{"exec":{"command":["/bin/sh","-c","emqx stop"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"runAsUser":1000,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"emqx","serviceAccount":"emqx","nodeName":"ip-10-40-57-245.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}],"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":100,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"kubernetes.io/hostname"}}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["emqx"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:20Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:45:25Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:45:25Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:20Z"}],"hostIP":"10.40.57.245","podIP":"10.40.46.164","startTime":"2020-11-04T12:44:20Z","containerStatuses":[{"name":"emqx","state":{"running":{"startedAt":"2020-11-04T12:44:27Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"emqx/emqx:v3.2.7","imageID":"docker-pullable://emqx/emqx@sha256:3f31ee2793b4446e98183659b4493992355e2b0d8603df946c641b47f29ced78","containerID":"docker://c4fe7fe7658849b7f842f0497031cae20c9a911bd325b606cd4cf20c5d1b163a"},{"name":"exporter","state":{"running":{"startedAt":"2020-11-04T12:44:22Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"example/emq_exporter:v0.4.1","imageID":"docker-pullable://example/emq_exporter@sha256:1526c0476c1e5d740dfc4df36f3295ea27f87b41becf274c760fbd0a51011233","containerID":"docker://1a483a5a8d44c9ee5c475bdf8c23a9c8933696828d5463f7a86d599d430f144c"}],"qosClass":"Burstable"}},{"metadata":{"name":"geo-service-54dbbd66f5-p4bbc","generateName":"geo-service-54dbbd66f5-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/geo-service-54dbbd66f5-p4bbc","uid":"fb18ed53-1e9f-11eb-9aff-16da7cad7b07","resourceVersion":"45482927","creationTimestamp":"2020-11-04T13:16:42Z","labels":{"app":"geo-service","pod-template-hash":"54dbbd66f5","release":"invu-sre-geo-service"},"annotations":{"iam.amazonaws.com/role":"medex-results-access"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"geo-service-54dbbd66f5","uid":"fb18096c-1e9f-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-kvb6j","secret":{"secretName":"default-token-kvb6j","defaultMode":420}}],"initContainers":[{"name":"mysql-client","image":"registry.example.com/ce/utilities/mysql-client","env":[{"name":"DATABASE_NAME","value":"pregsense_geo_service"},{"name":"MYSQL_USER","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MYSQL_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}}],"resources":{},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"geo-service","image":"registry.example.com/cybervision/pregsense-geo-service:2.0.0-37561","ports":[{"name":"http","containerPort":80,"protocol":"TCP"}],"env":[{"name":"BOOTSTRAP_SERVERS","value":"kafka:9092"},{"name":"ZOOKEEPER_CONNECT_STRING","value":"kafka-zookeeper:2181"},{"name":"AUTH_SERVICE_HOST","value":"auth-service"},{"name":"DEBUG","value":"false"},{"name":"JAVA_OPTS","value":"-Xmx512M"},{"name":"MARIADB_HOST","value":"mariadb"},{"name":"MARIADB_USERNAME","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MARIADB_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}},{"name":"INSTANCE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.name"}}}],"resources":{"limits":{"cpu":"500m","memory":"1Gi"},"requests":{"cpu":"500m","memory":"750Mi"}},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":240,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":5,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"ip-10-40-42-110.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app","operator":"In","values":["geo-service"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:53Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:18:54Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:18:54Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:42Z"}],"hostIP":"10.40.42.110","podIP":"10.40.35.8","startTime":"2020-11-04T13:16:42Z","initContainerStatuses":[{"name":"mysql-client","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T13:16:53Z","finishedAt":"2020-11-04T13:16:53Z","containerID":"docker://7a541d5b07befa56510480bf4dbca208d4fd90e51d0eba74b11362f07a3bb550"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/utilities/mysql-client:latest","imageID":"docker-pullable://registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","containerID":"docker://7a541d5b07befa56510480bf4dbca208d4fd90e51d0eba74b11362f07a3bb550"}],"containerStatuses":[{"name":"geo-service","state":{"running":{"startedAt":"2020-11-04T13:17:01Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/cybervision/pregsense-geo-service:2.0.0-37561","imageID":"docker-pullable://registry.example.com/cybervision/pregsense-geo-service@sha256:9e44ea04116b0dad47c7774c04666e6a74de49e252ebd2b3f3d562ce63bf9bbc","containerID":"docker://f52827729433e235e0343c21ff457e61611f1c7a25357a0a75bc9577e93e9b0d"}],"qosClass":"Burstable"}},{"metadata":{"name":"infrastructure-service-5b8746775c-v98mn","generateName":"infrastructure-service-5b8746775c-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/infrastructure-service-5b8746775c-v98mn","uid":"fc2f3532-1e9f-11eb-9aff-16da7cad7b07","resourceVersion":"45482822","creationTimestamp":"2020-11-04T13:16:44Z","labels":{"app":"infrastructure-service","pod-template-hash":"5b8746775c","release":"invu-sre-infrastructure-service"},"annotations":{"iam.amazonaws.com/role":"invu-sre-objects-access"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"infrastructure-service-5b8746775c","uid":"fc2d93cc-1e9f-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-kvb6j","secret":{"secretName":"default-token-kvb6j","defaultMode":420}}],"initContainers":[{"name":"mysql-client","image":"registry.example.com/ce/utilities/mysql-client","env":[{"name":"DATABASE_NAME","value":"invu_infrastructure_service"},{"name":"MYSQL_USER","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MYSQL_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}}],"resources":{},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"infrastructure-service","image":"registry.example.com/cybervision/invu-infrastructure-service:2.0.0-37566","ports":[{"name":"http","containerPort":80,"protocol":"TCP"}],"env":[{"name":"S3_BUCKET_NAME","value":"invu-sre-objects"},{"name":"LOG_LEVEL_example","value":"DEBUG"},{"name":"S3_BUCKET_REGION","value":"us-east-1"},{"name":"ZOOKEEPER_CONNECT_STRING","value":"kafka-zookeeper:2181"},{"name":"BOOTSTRAP_SERVERS","value":"kafka:9092"},{"name":"DEBUG","value":"false"},{"name":"JAVA_OPTS","value":"-Xmx512M"},{"name":"MARIADB_HOST","value":"mariadb"},{"name":"MARIADB_USERNAME","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MARIADB_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}},{"name":"INSTANCE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.name"}}}],"resources":{"limits":{"cpu":"500m","memory":"1Gi"},"requests":{"cpu":"500m","memory":"750Mi"}},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":240,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":5,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app","operator":"In","values":["infrastructure-service"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:47Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:18:25Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:18:25Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:44Z"}],"hostIP":"10.40.56.27","podIP":"10.40.44.73","startTime":"2020-11-04T13:16:44Z","initContainerStatuses":[{"name":"mysql-client","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T13:16:47Z","finishedAt":"2020-11-04T13:16:47Z","containerID":"docker://bd524fa563b598c44d93acb77f9abfc0891e9c8b3fedce934ddd7d06bc699b91"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/utilities/mysql-client:latest","imageID":"docker-pullable://registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","containerID":"docker://bd524fa563b598c44d93acb77f9abfc0891e9c8b3fedce934ddd7d06bc699b91"}],"containerStatuses":[{"name":"infrastructure-service","state":{"running":{"startedAt":"2020-11-04T13:16:53Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/cybervision/invu-infrastructure-service:2.0.0-37566","imageID":"docker-pullable://registry.example.com/cybervision/invu-infrastructure-service@sha256:00f75459b2ee50deb47884131608f73108158d4faa085d1a5cc237aacd3f2112","containerID":"docker://05675f6f5f5781c38c509dcea0f48266dc9836bedfbdd15df1092499788fa2f4"}],"qosClass":"Burstable"}},{"metadata":{"name":"invu-pro-77ff679969-zxcn2","generateName":"invu-pro-77ff679969-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/invu-pro-77ff679969-zxcn2","uid":"fd51edb9-1e9f-11eb-9aff-16da7cad7b07","resourceVersion":"45482565","creationTimestamp":"2020-11-04T13:16:46Z","labels":{"app.kubernetes.io/name":"invu-pro","app.kubernetes.io/part-of":"invu-sre-invu-pro","pod-template-hash":"77ff679969"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"invu-pro-77ff679969","uid":"fd4f4233-1e9f-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-kvb6j","secret":{"secretName":"default-token-kvb6j","defaultMode":420}}],"containers":[{"name":"invu-pro","image":"registry.example.com/cybervision/invu-web/pro:2.0.0-38041","ports":[{"name":"http","containerPort":80,"protocol":"TCP"}],"env":[{"name":"NODE_PROXY_APP_ORIGIN","value":"https://pro-invu-sre.example.com"},{"name":"NODE_PROXY_APP_API_URL","value":"https://app-invu-sre.example.com/edge/api/v1"},{"name":"NODE_PROXY_APP_URL","value":"https://app-invu-sre.example.com/edge"},{"name":"NODE_PROXY_APP_WS_URL","value":"wss://emqx-ws-invu-sre.example.com:443/mqtt"},{"name":"NODE_PROXY_APP_CLIENT_ID"},{"name":"NODE_PROXY_APP_AUTH_DOMAIN"}],"resources":{"limits":{"cpu":"300m","memory":"300Mi"},"requests":{"cpu":"100m","memory":"100Mi"}},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/","port":"http","scheme":"HTTP"},"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/","port":"http","scheme":"HTTP"},"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"ip-10-40-42-110.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["invu-pro"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:46Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:17:03Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:17:03Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:46Z"}],"hostIP":"10.40.42.110","podIP":"10.40.53.158","startTime":"2020-11-04T13:16:46Z","containerStatuses":[{"name":"invu-pro","state":{"running":{"startedAt":"2020-11-04T13:16:58Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/cybervision/invu-web/pro:2.0.0-38041","imageID":"docker-pullable://registry.example.com/cybervision/invu-web/pro@sha256:4a75e40bc1774e59e805ff68e713542d6c839e54e550b21688f9b23ec401de28","containerID":"docker://a7954328fc75d3bacbf8b187e5f4ee1dff12b07c8dc64711437cd4e6f8735d58"}],"qosClass":"Burstable"}},{"metadata":{"name":"invu-support-675ddd9b6f-xcvj9","generateName":"invu-support-675ddd9b6f-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/invu-support-675ddd9b6f-xcvj9","uid":"fea398dd-1e9f-11eb-9aff-16da7cad7b07","resourceVersion":"45482549","creationTimestamp":"2020-11-04T13:16:48Z","labels":{"app.kubernetes.io/name":"invu-support","app.kubernetes.io/part-of":"invu-sre-invu-support","pod-template-hash":"675ddd9b6f"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"invu-support-675ddd9b6f","uid":"fea2381b-1e9f-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-kvb6j","secret":{"secretName":"default-token-kvb6j","defaultMode":420}}],"containers":[{"name":"invu-support","image":"registry.example.com/cybervision/invu-web/support:2.0.0-38041","ports":[{"name":"http","containerPort":80,"protocol":"TCP"}],"env":[{"name":"NODE_PROXY_APP_ORIGIN","value":"https://support-invu-sre.example.com"},{"name":"NODE_PROXY_APP_API_URL","value":"https://app-invu-sre.example.com/edge/api/v1/support"},{"name":"NODE_PROXY_APP_URL","value":"https://app-invu-sre.example.com/edge"},{"name":"NODE_PROXY_APP_WS_URL","value":"wss://emqx-ws-invu-sre.example.com:443/mqtt"},{"name":"NODE_PROXY_APP_CLIENT_ID"},{"name":"NODE_PROXY_APP_AUTH_DOMAIN"}],"resources":{"limits":{"cpu":"300m","memory":"300Mi"},"requests":{"cpu":"100m","memory":"100Mi"}},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/","port":"http","scheme":"HTTP"},"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/","port":"http","scheme":"HTTP"},"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"ip-10-40-51-35.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["invu-support"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:48Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:17:00Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:17:00Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:48Z"}],"hostIP":"10.40.51.35","podIP":"10.40.60.0","startTime":"2020-11-04T13:16:48Z","containerStatuses":[{"name":"invu-support","state":{"running":{"startedAt":"2020-11-04T13:16:55Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/cybervision/invu-web/support:2.0.0-38041","imageID":"docker-pullable://registry.example.com/cybervision/invu-web/support@sha256:de25604e5609c81e2d180b86126f00441671ab242555bda54a0b4e56d6a9b374","containerID":"docker://1dc86e3bb4b97e54ac7fffe6556fd9046b8883ed04dcfc888d9ced93421ee96f"}],"qosClass":"Burstable"}},{"metadata":{"name":"kafka-0","generateName":"kafka-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/kafka-0","uid":"bf92b223-1e9a-11eb-9aff-16da7cad7b07","resourceVersion":"45476504","creationTimestamp":"2020-11-04T12:39:15Z","labels":{"app.kubernetes.io/name":"kafka","app.kubernetes.io/part-of":"invu-sre-kafka","controller-revision-hash":"kafka-7874665d8f","statefulset.kubernetes.io/pod-name":"kafka-0"},"annotations":{"checksum/config":"daad60db589e4fb5a1e13238ca6a87b4e363dc0a8a47c039efb620b65e86d9b9","prometheus.io/port":"9020","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"StatefulSet","name":"kafka","uid":"bf66bc4b-1e9a-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"data","persistentVolumeClaim":{"claimName":"data-kafka-0"}},{"name":"config","configMap":{"name":"kafka","defaultMode":420}}],"initContainers":[{"name":"delete-lost-found","image":"busybox","command":["/bin/sh","-c","rm -rf /dst/lost+found"],"resources":{},"volumeMounts":[{"name":"data","mountPath":"/dst"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"},{"name":"wait-for-zookeeper","image":"busybox","command":["/bin/sh","-c","until echo srvr | nc -w 5 kafka-zookeeper 2181 | grep Mode \u0026\u0026 echo zookeeper ok; do sleep 5; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"broker","image":"registry.example.com/ce/middleware/kafka:0.6.33","command":["/bin/bash","-c","exec ./bin/kafka-server-start.sh /etc/kafka/server.properties --override broker.id=${HOSTNAME##*-} --override advertised.host.name=${HOSTNAME}.kafka-headless.invu-sre.svc.cluster.local "],"ports":[{"name":"client","containerPort":9092,"protocol":"TCP"},{"name":"jmx","containerPort":9999,"protocol":"TCP"},{"name":"agent","containerPort":9020,"protocol":"TCP"}],"env":[{"name":"DNS_NAME","value":"example.com"},{"name":"KAFKA_HEAP_OPTS","value":"-Xmx7g -Xms7g"}],"resources":{"limits":{"cpu":"2","memory":"8Gi"},"requests":{"cpu":"2","memory":"8Gi"}},"volumeMounts":[{"name":"data","mountPath":"/var/lib/kafka"},{"name":"config","mountPath":"/etc/kafka"}],"lifecycle":{"preStop":{"exec":{"command":["/bin/bash","-c","exec ./bin/kafka-server-stop.sh"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"runAsUser":1001,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":180,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{"fsGroup":1001},"hostname":"kafka-0","subdomain":"kafka-headless","affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["zookeeper"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}],"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":100,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["zookeeper"]}]},"topologyKey":"kubernetes.io/hostname"}}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:43:09Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:43:15Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:43:15Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:42:54Z"}],"hostIP":"10.40.56.27","podIP":"10.40.44.88","startTime":"2020-11-04T12:42:54Z","initContainerStatuses":[{"name":"delete-lost-found","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T12:43:07Z","finishedAt":"2020-11-04T12:43:07Z","containerID":"docker://2774295ea860555b7db14d5bdd827b40b3971976f8af9e5c3ff0eef8ff491b2c"}},"lastState":{},"ready":true,"restartCount":0,"image":"busybox:latest","imageID":"docker-pullable://busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","containerID":"docker://2774295ea860555b7db14d5bdd827b40b3971976f8af9e5c3ff0eef8ff491b2c"},{"name":"wait-for-zookeeper","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T12:43:09Z","finishedAt":"2020-11-04T12:43:09Z","containerID":"docker://1d6f11662dce2bdbfe8c27a73383f62f7a9adb72323fd786a91e5c62b106e19e"}},"lastState":{},"ready":true,"restartCount":0,"image":"busybox:latest","imageID":"docker-pullable://busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","containerID":"docker://1d6f11662dce2bdbfe8c27a73383f62f7a9adb72323fd786a91e5c62b106e19e"}],"containerStatuses":[{"name":"broker","state":{"running":{"startedAt":"2020-11-04T12:43:15Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/middleware/kafka:0.6.33","imageID":"docker-pullable://registry.example.com/ce/middleware/kafka@sha256:5a13ea153f26ac29e73fd3a0ed67c701f33ea761a0b10a03870fdda51e3975cc","containerID":"docker://aab562c6506685007f59fc42f95492910f41f3e3a4106afc8c1c4803eaf3a61c"}],"qosClass":"Guaranteed"}},{"metadata":{"name":"kafka-1","generateName":"kafka-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/kafka-1","uid":"4ee7c223-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45477399","creationTimestamp":"2020-11-04T12:43:15Z","labels":{"app.kubernetes.io/name":"kafka","app.kubernetes.io/part-of":"invu-sre-kafka","controller-revision-hash":"kafka-7874665d8f","statefulset.kubernetes.io/pod-name":"kafka-1"},"annotations":{"checksum/config":"daad60db589e4fb5a1e13238ca6a87b4e363dc0a8a47c039efb620b65e86d9b9","prometheus.io/port":"9020","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"StatefulSet","name":"kafka","uid":"bf66bc4b-1e9a-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"data","persistentVolumeClaim":{"claimName":"data-kafka-1"}},{"name":"config","configMap":{"name":"kafka","defaultMode":420}}],"initContainers":[{"name":"delete-lost-found","image":"busybox","command":["/bin/sh","-c","rm -rf /dst/lost+found"],"resources":{},"volumeMounts":[{"name":"data","mountPath":"/dst"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"},{"name":"wait-for-zookeeper","image":"busybox","command":["/bin/sh","-c","until echo srvr | nc -w 5 kafka-zookeeper 2181 | grep Mode \u0026\u0026 echo zookeeper ok; do sleep 5; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"broker","image":"registry.example.com/ce/middleware/kafka:0.6.33","command":["/bin/bash","-c","exec ./bin/kafka-server-start.sh /etc/kafka/server.properties --override broker.id=${HOSTNAME##*-} --override advertised.host.name=${HOSTNAME}.kafka-headless.invu-sre.svc.cluster.local "],"ports":[{"name":"client","containerPort":9092,"protocol":"TCP"},{"name":"jmx","containerPort":9999,"protocol":"TCP"},{"name":"agent","containerPort":9020,"protocol":"TCP"}],"env":[{"name":"DNS_NAME","value":"example.com"},{"name":"KAFKA_HEAP_OPTS","value":"-Xmx7g -Xms7g"}],"resources":{"limits":{"cpu":"2","memory":"8Gi"},"requests":{"cpu":"2","memory":"8Gi"}},"volumeMounts":[{"name":"data","mountPath":"/var/lib/kafka"},{"name":"config","mountPath":"/etc/kafka"}],"lifecycle":{"preStop":{"exec":{"command":["/bin/bash","-c","exec ./bin/kafka-server-stop.sh"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"runAsUser":1001,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":180,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-55-41.ec2.internal","securityContext":{"fsGroup":1001},"hostname":"kafka-1","subdomain":"kafka-headless","affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["zookeeper"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}],"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":100,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["zookeeper"]}]},"topologyKey":"kubernetes.io/hostname"}}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:46:55Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:47:02Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:47:02Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:46:32Z"}],"hostIP":"10.40.55.41","podIP":"10.40.37.138","startTime":"2020-11-04T12:46:32Z","initContainerStatuses":[{"name":"delete-lost-found","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T12:46:53Z","finishedAt":"2020-11-04T12:46:53Z","containerID":"docker://43c030dc71d885caa72f51c72fd7be3766b587569bf5050ab813d07ec56d07d6"}},"lastState":{},"ready":true,"restartCount":0,"image":"busybox:latest","imageID":"docker-pullable://busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","containerID":"docker://43c030dc71d885caa72f51c72fd7be3766b587569bf5050ab813d07ec56d07d6"},{"name":"wait-for-zookeeper","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T12:46:54Z","finishedAt":"2020-11-04T12:46:55Z","containerID":"docker://d37dca10c7a7adc072386246ae6a21541df9e239ec762f081ab87c85d6542c67"}},"lastState":{},"ready":true,"restartCount":0,"image":"busybox:latest","imageID":"docker-pullable://busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","containerID":"docker://d37dca10c7a7adc072386246ae6a21541df9e239ec762f081ab87c85d6542c67"}],"containerStatuses":[{"name":"broker","state":{"running":{"startedAt":"2020-11-04T12:47:02Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/middleware/kafka:0.6.33","imageID":"docker-pullable://registry.example.com/ce/middleware/kafka@sha256:5a13ea153f26ac29e73fd3a0ed67c701f33ea761a0b10a03870fdda51e3975cc","containerID":"docker://1dcd61cd3d4053e514b7c2b34cce5b26fb4331a5a2f6e8a7672bddd2a3edeb39"}],"qosClass":"Guaranteed"}},{"metadata":{"name":"kafka-2","generateName":"kafka-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/kafka-2","uid":"d62a4f74-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45478053","creationTimestamp":"2020-11-04T12:47:02Z","labels":{"app.kubernetes.io/name":"kafka","app.kubernetes.io/part-of":"invu-sre-kafka","controller-revision-hash":"kafka-7874665d8f","statefulset.kubernetes.io/pod-name":"kafka-2"},"annotations":{"checksum/config":"daad60db589e4fb5a1e13238ca6a87b4e363dc0a8a47c039efb620b65e86d9b9","prometheus.io/port":"9020","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"StatefulSet","name":"kafka","uid":"bf66bc4b-1e9a-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"data","persistentVolumeClaim":{"claimName":"data-kafka-2"}},{"name":"config","configMap":{"name":"kafka","defaultMode":420}}],"initContainers":[{"name":"delete-lost-found","image":"busybox","command":["/bin/sh","-c","rm -rf /dst/lost+found"],"resources":{},"volumeMounts":[{"name":"data","mountPath":"/dst"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"},{"name":"wait-for-zookeeper","image":"busybox","command":["/bin/sh","-c","until echo srvr | nc -w 5 kafka-zookeeper 2181 | grep Mode \u0026\u0026 echo zookeeper ok; do sleep 5; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"broker","image":"registry.example.com/ce/middleware/kafka:0.6.33","command":["/bin/bash","-c","exec ./bin/kafka-server-start.sh /etc/kafka/server.properties --override broker.id=${HOSTNAME##*-} --override advertised.host.name=${HOSTNAME}.kafka-headless.invu-sre.svc.cluster.local "],"ports":[{"name":"client","containerPort":9092,"protocol":"TCP"},{"name":"jmx","containerPort":9999,"protocol":"TCP"},{"name":"agent","containerPort":9020,"protocol":"TCP"}],"env":[{"name":"DNS_NAME","value":"example.com"},{"name":"KAFKA_HEAP_OPTS","value":"-Xmx7g -Xms7g"}],"resources":{"limits":{"cpu":"2","memory":"8Gi"},"requests":{"cpu":"2","memory":"8Gi"}},"volumeMounts":[{"name":"data","mountPath":"/var/lib/kafka"},{"name":"config","mountPath":"/etc/kafka"}],"lifecycle":{"preStop":{"exec":{"command":["/bin/bash","-c","exec ./bin/kafka-server-stop.sh"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"runAsUser":1001,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":180,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-42-110.ec2.internal","securityContext":{"fsGroup":1001},"hostname":"kafka-2","subdomain":"kafka-headless","affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["zookeeper"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}],"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":100,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["zookeeper"]}]},"topologyKey":"kubernetes.io/hostname"}}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:50:38Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:50:44Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:50:44Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:50:22Z"}],"hostIP":"10.40.42.110","podIP":"10.40.59.125","startTime":"2020-11-04T12:50:22Z","initContainerStatuses":[{"name":"delete-lost-found","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T12:50:36Z","finishedAt":"2020-11-04T12:50:36Z","containerID":"docker://86eaec938009e279f353fd3411c973a00388abcc8d5995077e56e62ba8328dae"}},"lastState":{},"ready":true,"restartCount":0,"image":"busybox:latest","imageID":"docker-pullable://busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","containerID":"docker://86eaec938009e279f353fd3411c973a00388abcc8d5995077e56e62ba8328dae"},{"name":"wait-for-zookeeper","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T12:50:38Z","finishedAt":"2020-11-04T12:50:38Z","containerID":"docker://0fc017f35f0025525296a06c5352d092e86aa76cdbdea1ced97a377c795ff4cf"}},"lastState":{},"ready":true,"restartCount":0,"image":"busybox:latest","imageID":"docker-pullable://busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","containerID":"docker://0fc017f35f0025525296a06c5352d092e86aa76cdbdea1ced97a377c795ff4cf"}],"containerStatuses":[{"name":"broker","state":{"running":{"startedAt":"2020-11-04T12:50:44Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/middleware/kafka:0.6.33","imageID":"docker-pullable://registry.example.com/ce/middleware/kafka@sha256:5a13ea153f26ac29e73fd3a0ed67c701f33ea761a0b10a03870fdda51e3975cc","containerID":"docker://61fe16cb671e4b1033992e3f2b65ef7ca4162929cf88d9b77b186d19ca7543a1"}],"qosClass":"Guaranteed"}},{"metadata":{"name":"kafka-connect-6c5dfdbfb4-2hdbw","generateName":"kafka-connect-6c5dfdbfb4-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/kafka-connect-6c5dfdbfb4-2hdbw","uid":"f328eda8-1e9f-11eb-9aff-16da7cad7b07","resourceVersion":"45482621","creationTimestamp":"2020-11-04T13:16:29Z","labels":{"app.kubernetes.io/instance":"kafka-connect","app.kubernetes.io/name":"kafka-connect","pod-template-hash":"6c5dfdbfb4"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"kafka-connect-6c5dfdbfb4","uid":"f323a896-1e9f-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"config","configMap":{"name":"kafka-connect","defaultMode":420}}],"containers":[{"name":"kafka-connect","image":"registry.example.com/cybervision/invu-kafka-connect-sinks/kafka-connect:2.0.0-37698","command":["/bin/sh","-c","$KAFKA_HOME/bin/connect-distributed.sh /etc/connect/connect-distributed.properties"],"ports":[{"name":"http","containerPort":8083,"protocol":"TCP"},{"name":"jmx","containerPort":9999,"protocol":"TCP"}],"env":[{"name":"KAFKA_HEAP_OPTS","value":"-Xmx750m -Xms750m"},{"name":"JMXPORT","value":"9999"}],"resources":{"limits":{"cpu":"1","memory":"1500Mi"},"requests":{"cpu":"750m","memory":"1000Mi"}},"volumeMounts":[{"name":"config","mountPath":"/etc/connect/"}],"livenessProbe":{"httpGet":{"path":"/","port":8083,"scheme":"HTTP"},"initialDelaySeconds":45,"timeoutSeconds":10,"periodSeconds":10,"successThreshold":1,"failureThreshold":6},"readinessProbe":{"httpGet":{"path":"/connector-plugins","port":8083,"scheme":"HTTP"},"initialDelaySeconds":30,"timeoutSeconds":10,"periodSeconds":10,"successThreshold":1,"failureThreshold":5},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{"runAsUser":1001,"runAsNonRoot":true},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}],"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":100,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"kubernetes.io/hostname"}}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka-connect"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:29Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:17:15Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:17:15Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:29Z"}],"hostIP":"10.40.56.27","podIP":"10.40.45.113","startTime":"2020-11-04T13:16:29Z","containerStatuses":[{"name":"kafka-connect","state":{"running":{"startedAt":"2020-11-04T13:16:44Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/cybervision/invu-kafka-connect-sinks/kafka-connect:2.0.0-37698","imageID":"docker-pullable://registry.example.com/cybervision/invu-kafka-connect-sinks/kafka-connect@sha256:6a584826ecf0bbdf654fbe27201e2ed07d5586bd6f0c414c13be40ac3f6cc62f","containerID":"docker://3431c9748539e0095632c7c7f336a4b6c2ca51420e0ab614aebcc7d2263c625d"}],"qosClass":"Burstable"}},{"metadata":{"name":"kafka-connect-6c5dfdbfb4-qg858","generateName":"kafka-connect-6c5dfdbfb4-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/kafka-connect-6c5dfdbfb4-qg858","uid":"f3260576-1e9f-11eb-9aff-16da7cad7b07","resourceVersion":"45482614","creationTimestamp":"2020-11-04T13:16:29Z","labels":{"app.kubernetes.io/instance":"kafka-connect","app.kubernetes.io/name":"kafka-connect","pod-template-hash":"6c5dfdbfb4"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"kafka-connect-6c5dfdbfb4","uid":"f323a896-1e9f-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"config","configMap":{"name":"kafka-connect","defaultMode":420}}],"containers":[{"name":"kafka-connect","image":"registry.example.com/cybervision/invu-kafka-connect-sinks/kafka-connect:2.0.0-37698","command":["/bin/sh","-c","$KAFKA_HOME/bin/connect-distributed.sh /etc/connect/connect-distributed.properties"],"ports":[{"name":"http","containerPort":8083,"protocol":"TCP"},{"name":"jmx","containerPort":9999,"protocol":"TCP"}],"env":[{"name":"KAFKA_HEAP_OPTS","value":"-Xmx750m -Xms750m"},{"name":"JMXPORT","value":"9999"}],"resources":{"limits":{"cpu":"1","memory":"1500Mi"},"requests":{"cpu":"750m","memory":"1000Mi"}},"volumeMounts":[{"name":"config","mountPath":"/etc/connect/"}],"livenessProbe":{"httpGet":{"path":"/","port":8083,"scheme":"HTTP"},"initialDelaySeconds":45,"timeoutSeconds":10,"periodSeconds":10,"successThreshold":1,"failureThreshold":6},"readinessProbe":{"httpGet":{"path":"/connector-plugins","port":8083,"scheme":"HTTP"},"initialDelaySeconds":30,"timeoutSeconds":10,"periodSeconds":10,"successThreshold":1,"failureThreshold":5},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-55-41.ec2.internal","securityContext":{"runAsUser":1001,"runAsNonRoot":true},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}],"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":100,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"kubernetes.io/hostname"}}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka-connect"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:29Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:17:14Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:17:14Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:29Z"}],"hostIP":"10.40.55.41","podIP":"10.40.51.0","startTime":"2020-11-04T13:16:29Z","containerStatuses":[{"name":"kafka-connect","state":{"running":{"startedAt":"2020-11-04T13:16:43Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/cybervision/invu-kafka-connect-sinks/kafka-connect:2.0.0-37698","imageID":"docker-pullable://registry.example.com/cybervision/invu-kafka-connect-sinks/kafka-connect@sha256:6a584826ecf0bbdf654fbe27201e2ed07d5586bd6f0c414c13be40ac3f6cc62f","containerID":"docker://3e0da9fc8ed4d6c7ebebcc79580431ad86b7dfaa1214af4b0911a531c7c03416"}],"qosClass":"Burstable"}},{"metadata":{"name":"kafka-manager-5bf7f458db-798wd","generateName":"kafka-manager-5bf7f458db-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/kafka-manager-5bf7f458db-798wd","uid":"bf6b1672-1e9a-11eb-9aff-16da7cad7b07","resourceVersion":"45476622","creationTimestamp":"2020-11-04T12:39:15Z","labels":{"app.kubernetes.io/name":"kafka-manager","app.kubernetes.io/part-of":"invu-sre-kafka","pod-template-hash":"5bf7f458db"},"annotations":{"checksum/config":"a15f2f3ea2bf74aaba118e53a6959d4199bbe39fc2a970ef4f94a7b94f15a7cb"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"kafka-manager-5bf7f458db","uid":"bf5b319e-1e9a-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"config","configMap":{"name":"kafka-manager","items":[{"key":"application.conf","path":"application.conf"}],"defaultMode":420}}],"containers":[{"name":"kafka-manager","image":"registry.example.com/ce/utilities/kafka-manager:2.0.0.2","ports":[{"name":"http","containerPort":9000,"protocol":"TCP"}],"env":[{"name":"ZK_HOSTS","value":"kafka-zookeeper:2181"},{"name":"KAFKA_MANAGER_AUTH_ENABLED","value":"true"},{"name":"KAFKA_MANAGER_USERNAME","valueFrom":{"secretKeyRef":{"name":"kafka-manager","key":"username"}}},{"name":"KAFKA_MANAGER_PASSWORD","valueFrom":{"secretKeyRef":{"name":"kafka-manager","key":"password"}}}],"resources":{"limits":{"cpu":"200m","memory":"512Mi"},"requests":{"cpu":"50m","memory":"512Mi"}},"volumeMounts":[{"name":"config","mountPath":"/kafka-manager/conf/application.conf","subPath":"application.conf"}],"livenessProbe":{"httpGet":{"path":"/km/api/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":90,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":12},"readinessProbe":{"httpGet":{"path":"/km/api/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":3,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-45-241.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka-manager"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:42:52Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:43:54Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:43:54Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:42:52Z"}],"hostIP":"10.40.45.241","podIP":"10.40.63.234","startTime":"2020-11-04T12:42:52Z","containerStatuses":[{"name":"kafka-manager","state":{"running":{"startedAt":"2020-11-04T12:43:01Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/utilities/kafka-manager:2.0.0.2","imageID":"docker-pullable://registry.example.com/ce/utilities/kafka-manager@sha256:c04a2fcec27aca7a0e8c70105ebd4c5f960ca81d6d867d4d584bcab9b7173fbc","containerID":"docker://a3c4938de72a2ba34f96cfa302828b242570e247181f26c052f5da8b6b653fab"}],"qosClass":"Burstable"}},{"metadata":{"name":"kafka-minion-7758b9c57f-zgqw2","generateName":"kafka-minion-7758b9c57f-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/kafka-minion-7758b9c57f-zgqw2","uid":"bf67785c-1e9a-11eb-9aff-16da7cad7b07","resourceVersion":"45478086","creationTimestamp":"2020-11-04T12:39:14Z","labels":{"app":"kafka-minion","pod-template-hash":"7758b9c57f","release":"invu-sre-kafka"},"annotations":{"prometheus.io/port":"9208","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"kafka-minion-7758b9c57f","uid":"bf5c59f0-1e9a-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-kvb6j","secret":{"secretName":"default-token-kvb6j","defaultMode":420}}],"containers":[{"name":"kafka-minion","image":"registry.example.com/ce/observability/kafka-minion:1.0.1","ports":[{"name":"http","containerPort":9208,"protocol":"TCP"}],"env":[{"name":"KAFKA_BROKERS","value":"kafka:9092"},{"name":"TELEMETRY_PORT","value":"9208"}],"resources":{"limits":{"cpu":"200m","memory":"500Mi"},"requests":{"cpu":"200m","memory":"500Mi"}},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/healthcheck","port":9208,"scheme":"HTTP"},"initialDelaySeconds":300,"timeoutSeconds":10,"periodSeconds":10,"successThreshold":1,"failureThreshold":12},"readinessProbe":{"httpGet":{"path":"/readycheck","port":9208,"scheme":"HTTP"},"initialDelaySeconds":5,"timeoutSeconds":10,"periodSeconds":10,"successThreshold":1,"failureThreshold":1},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"ip-10-40-45-241.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":100,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"kubernetes.io/hostname"}}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:39:15Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:50:53Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:50:53Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:39:15Z"}],"hostIP":"10.40.45.241","podIP":"10.40.49.217","startTime":"2020-11-04T12:39:15Z","containerStatuses":[{"name":"kafka-minion","state":{"running":{"startedAt":"2020-11-04T12:50:46Z"}},"lastState":{"terminated":{"exitCode":2,"reason":"Error","startedAt":"2020-11-04T12:45:41Z","finishedAt":"2020-11-04T12:45:41Z","containerID":"docker://72e7b2639ac87eee97269d497df653967427a963fb4524d2413284530e33856f"}},"ready":true,"restartCount":7,"image":"registry.example.com/ce/observability/kafka-minion:1.0.1","imageID":"docker-pullable://registry.example.com/ce/observability/kafka-minion@sha256:34e6a52c9cef9b5d01f704c07913bd13b37a3465ae50d3adf56dd9a0ffd1aea5","containerID":"docker://ea702e87d6d5de5c0fe2ed2954adf3ca5fd41e60f4565dbd98f80be920b30871"}],"qosClass":"Guaranteed"}},{"metadata":{"name":"kafka-zookeeper-0","generateName":"kafka-zookeeper-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/kafka-zookeeper-0","uid":"bf771a1d-1e9a-11eb-9aff-16da7cad7b07","resourceVersion":"45476007","creationTimestamp":"2020-11-04T12:39:15Z","labels":{"app.kubernetes.io/name":"zookeeper","app.kubernetes.io/part-of":"invu-sre-kafka","controller-revision-hash":"kafka-zookeeper-59954f556b","statefulset.kubernetes.io/pod-name":"kafka-zookeeper-0"},"annotations":{"checksum/config":"318e3426b1dc0247d932194c6b881bcca694e9c8651a74ad49e14852c4544d00","prometheus.io/port":"7070","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"StatefulSet","name":"kafka-zookeeper","uid":"bf606b1e-1e9a-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"data","persistentVolumeClaim":{"claimName":"data-kafka-zookeeper-0"}},{"name":"exporter","emptyDir":{}},{"name":"config","configMap":{"name":"kafka-zookeeper","defaultMode":420}}],"initContainers":[{"name":"init","image":"busybox","command":["/bin/sh","-c","wget -O /opt/exporter/jmx_prometheus_javaagent.jar https://repo1.maven.org/maven2/io/prometheus/jmx/jmx_prometheus_javaagent/${AGENT_VER}/jmx_prometheus_javaagent-${AGENT_VER}.jar \u0026\u0026 echo ${HOSTNAME##*-} \u003e /data/myid"],"env":[{"name":"AGENT_VER","value":"0.11.0"}],"resources":{},"volumeMounts":[{"name":"exporter","mountPath":"/opt/exporter"},{"name":"data","mountPath":"/data","subPath":"data"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"zookeeper","image":"zookeeper:3.5.5","ports":[{"name":"client","containerPort":2181,"protocol":"TCP"},{"name":"server","containerPort":2888,"protocol":"TCP"},{"name":"leader-election","containerPort":3888,"protocol":"TCP"},{"name":"metrics","containerPort":7070,"protocol":"TCP"},{"name":"admin","containerPort":8080,"protocol":"TCP"},{"name":"jmx","containerPort":3080,"protocol":"TCP"}],"env":[{"name":"JVMFLAGS","value":"-javaagent:/opt/exporter/jmx_prometheus_javaagent.jar=7070:/opt/exporter/jmx_config.yaml"},{"name":"JMXPORT","value":"3080"}],"resources":{"limits":{"cpu":"400m","memory":"500Mi"},"requests":{"cpu":"100m","memory":"500Mi"}},"volumeMounts":[{"name":"data","mountPath":"/data","subPath":"data"},{"name":"data","mountPath":"/datalog","subPath":"datalog"},{"name":"exporter","mountPath":"/opt/exporter"},{"name":"config","mountPath":"/conf/zoo.cfg","subPath":"zoo.cfg"},{"name":"config","mountPath":"/opt/exporter/jmx_config.yaml","subPath":"jmx_config.yaml"}],"livenessProbe":{"httpGet":{"path":"/commands/ruok","port":"admin","scheme":"HTTP"},"initialDelaySeconds":15,"timeoutSeconds":1,"periodSeconds":30,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/commands/ruok","port":"admin","scheme":"HTTP"},"initialDelaySeconds":30,"timeoutSeconds":1,"periodSeconds":30,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"runAsUser":1000,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-45-241.ec2.internal","securityContext":{"fsGroup":1000},"hostname":"kafka-zookeeper-0","subdomain":"kafka-zookeeper-headless","affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["zookeeper"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["zookeeper"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:39:30Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:40:29Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:40:29Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:39:19Z"}],"hostIP":"10.40.45.241","podIP":"10.40.61.185","startTime":"2020-11-04T12:39:19Z","initContainerStatuses":[{"name":"init","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T12:39:30Z","finishedAt":"2020-11-04T12:39:30Z","containerID":"docker://12afad7921426602cdba061c23d72a14317891e87339db2d95451d066a207421"}},"lastState":{},"ready":true,"restartCount":0,"image":"busybox:latest","imageID":"docker-pullable://busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","containerID":"docker://12afad7921426602cdba061c23d72a14317891e87339db2d95451d066a207421"}],"containerStatuses":[{"name":"zookeeper","state":{"running":{"startedAt":"2020-11-04T12:39:34Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"zookeeper:3.5.5","imageID":"docker-pullable://zookeeper@sha256:b7a76ec06f68fd9c801b72dfd283701bc7d8a8b0609277a0d570e8e6768e4ad9","containerID":"docker://02eec2323a0e365e3614ccce316705b61462a47736206a62287ad3e4a20a8739"}],"qosClass":"Burstable"}},{"metadata":{"name":"kafka-zookeeper-1","generateName":"kafka-zookeeper-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/kafka-zookeeper-1","uid":"bf8417c4-1e9a-11eb-9aff-16da7cad7b07","resourceVersion":"45475991","creationTimestamp":"2020-11-04T12:39:15Z","labels":{"app.kubernetes.io/name":"zookeeper","app.kubernetes.io/part-of":"invu-sre-kafka","controller-revision-hash":"kafka-zookeeper-59954f556b","statefulset.kubernetes.io/pod-name":"kafka-zookeeper-1"},"annotations":{"checksum/config":"318e3426b1dc0247d932194c6b881bcca694e9c8651a74ad49e14852c4544d00","prometheus.io/port":"7070","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"StatefulSet","name":"kafka-zookeeper","uid":"bf606b1e-1e9a-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"data","persistentVolumeClaim":{"claimName":"data-kafka-zookeeper-1"}},{"name":"exporter","emptyDir":{}},{"name":"config","configMap":{"name":"kafka-zookeeper","defaultMode":420}}],"initContainers":[{"name":"init","image":"busybox","command":["/bin/sh","-c","wget -O /opt/exporter/jmx_prometheus_javaagent.jar https://repo1.maven.org/maven2/io/prometheus/jmx/jmx_prometheus_javaagent/${AGENT_VER}/jmx_prometheus_javaagent-${AGENT_VER}.jar \u0026\u0026 echo ${HOSTNAME##*-} \u003e /data/myid"],"env":[{"name":"AGENT_VER","value":"0.11.0"}],"resources":{},"volumeMounts":[{"name":"exporter","mountPath":"/opt/exporter"},{"name":"data","mountPath":"/data","subPath":"data"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"zookeeper","image":"zookeeper:3.5.5","ports":[{"name":"client","containerPort":2181,"protocol":"TCP"},{"name":"server","containerPort":2888,"protocol":"TCP"},{"name":"leader-election","containerPort":3888,"protocol":"TCP"},{"name":"metrics","containerPort":7070,"protocol":"TCP"},{"name":"admin","containerPort":8080,"protocol":"TCP"},{"name":"jmx","containerPort":3080,"protocol":"TCP"}],"env":[{"name":"JVMFLAGS","value":"-javaagent:/opt/exporter/jmx_prometheus_javaagent.jar=7070:/opt/exporter/jmx_config.yaml"},{"name":"JMXPORT","value":"3080"}],"resources":{"limits":{"cpu":"400m","memory":"500Mi"},"requests":{"cpu":"100m","memory":"500Mi"}},"volumeMounts":[{"name":"data","mountPath":"/data","subPath":"data"},{"name":"data","mountPath":"/datalog","subPath":"datalog"},{"name":"exporter","mountPath":"/opt/exporter"},{"name":"config","mountPath":"/conf/zoo.cfg","subPath":"zoo.cfg"},{"name":"config","mountPath":"/opt/exporter/jmx_config.yaml","subPath":"jmx_config.yaml"}],"livenessProbe":{"httpGet":{"path":"/commands/ruok","port":"admin","scheme":"HTTP"},"initialDelaySeconds":15,"timeoutSeconds":1,"periodSeconds":30,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/commands/ruok","port":"admin","scheme":"HTTP"},"initialDelaySeconds":30,"timeoutSeconds":1,"periodSeconds":30,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"runAsUser":1000,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-57-245.ec2.internal","securityContext":{"fsGroup":1000},"hostname":"kafka-zookeeper-1","subdomain":"kafka-zookeeper-headless","affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["zookeeper"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["zookeeper"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:39:30Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:40:25Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:40:25Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:39:19Z"}],"hostIP":"10.40.57.245","podIP":"10.40.53.105","startTime":"2020-11-04T12:39:19Z","initContainerStatuses":[{"name":"init","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T12:39:30Z","finishedAt":"2020-11-04T12:39:30Z","containerID":"docker://a2db0cf67ba9b0aa04f1f6191157e86a9f42fb65e301396aa44f2c40539f40ca"}},"lastState":{},"ready":true,"restartCount":0,"image":"busybox:latest","imageID":"docker-pullable://busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","containerID":"docker://a2db0cf67ba9b0aa04f1f6191157e86a9f42fb65e301396aa44f2c40539f40ca"}],"containerStatuses":[{"name":"zookeeper","state":{"running":{"startedAt":"2020-11-04T12:39:36Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"zookeeper:3.5.5","imageID":"docker-pullable://zookeeper@sha256:b7a76ec06f68fd9c801b72dfd283701bc7d8a8b0609277a0d570e8e6768e4ad9","containerID":"docker://9ce943e9c22dc94bcb8ab8e98436d82bb2179ba389d8400e9440c660b9548f57"}],"qosClass":"Burstable"}},{"metadata":{"name":"kafka-zookeeper-2","generateName":"kafka-zookeeper-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/kafka-zookeeper-2","uid":"bf8ba0d0-1e9a-11eb-9aff-16da7cad7b07","resourceVersion":"45475945","creationTimestamp":"2020-11-04T12:39:15Z","labels":{"app.kubernetes.io/name":"zookeeper","app.kubernetes.io/part-of":"invu-sre-kafka","controller-revision-hash":"kafka-zookeeper-59954f556b","statefulset.kubernetes.io/pod-name":"kafka-zookeeper-2"},"annotations":{"checksum/config":"318e3426b1dc0247d932194c6b881bcca694e9c8651a74ad49e14852c4544d00","prometheus.io/port":"7070","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"StatefulSet","name":"kafka-zookeeper","uid":"bf606b1e-1e9a-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"data","persistentVolumeClaim":{"claimName":"data-kafka-zookeeper-2"}},{"name":"exporter","emptyDir":{}},{"name":"config","configMap":{"name":"kafka-zookeeper","defaultMode":420}}],"initContainers":[{"name":"init","image":"busybox","command":["/bin/sh","-c","wget -O /opt/exporter/jmx_prometheus_javaagent.jar https://repo1.maven.org/maven2/io/prometheus/jmx/jmx_prometheus_javaagent/${AGENT_VER}/jmx_prometheus_javaagent-${AGENT_VER}.jar \u0026\u0026 echo ${HOSTNAME##*-} \u003e /data/myid"],"env":[{"name":"AGENT_VER","value":"0.11.0"}],"resources":{},"volumeMounts":[{"name":"exporter","mountPath":"/opt/exporter"},{"name":"data","mountPath":"/data","subPath":"data"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"zookeeper","image":"zookeeper:3.5.5","ports":[{"name":"client","containerPort":2181,"protocol":"TCP"},{"name":"server","containerPort":2888,"protocol":"TCP"},{"name":"leader-election","containerPort":3888,"protocol":"TCP"},{"name":"metrics","containerPort":7070,"protocol":"TCP"},{"name":"admin","containerPort":8080,"protocol":"TCP"},{"name":"jmx","containerPort":3080,"protocol":"TCP"}],"env":[{"name":"JVMFLAGS","value":"-javaagent:/opt/exporter/jmx_prometheus_javaagent.jar=7070:/opt/exporter/jmx_config.yaml"},{"name":"JMXPORT","value":"3080"}],"resources":{"limits":{"cpu":"400m","memory":"500Mi"},"requests":{"cpu":"100m","memory":"500Mi"}},"volumeMounts":[{"name":"data","mountPath":"/data","subPath":"data"},{"name":"data","mountPath":"/datalog","subPath":"datalog"},{"name":"exporter","mountPath":"/opt/exporter"},{"name":"config","mountPath":"/conf/zoo.cfg","subPath":"zoo.cfg"},{"name":"config","mountPath":"/opt/exporter/jmx_config.yaml","subPath":"jmx_config.yaml"}],"livenessProbe":{"httpGet":{"path":"/commands/ruok","port":"admin","scheme":"HTTP"},"initialDelaySeconds":15,"timeoutSeconds":1,"periodSeconds":30,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/commands/ruok","port":"admin","scheme":"HTTP"},"initialDelaySeconds":30,"timeoutSeconds":1,"periodSeconds":30,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"runAsUser":1000,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-51-35.ec2.internal","securityContext":{"fsGroup":1000},"hostname":"kafka-zookeeper-2","subdomain":"kafka-zookeeper-headless","affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["zookeeper"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["zookeeper"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:39:27Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:40:08Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:40:08Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:39:20Z"}],"hostIP":"10.40.51.35","podIP":"10.40.61.44","startTime":"2020-11-04T12:39:20Z","initContainerStatuses":[{"name":"init","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T12:39:26Z","finishedAt":"2020-11-04T12:39:26Z","containerID":"docker://431ddff532b53581a9b7d9850529803cd505db4d76a3a5c38eac0b486a4b3707"}},"lastState":{},"ready":true,"restartCount":0,"image":"busybox:latest","imageID":"docker-pullable://busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","containerID":"docker://431ddff532b53581a9b7d9850529803cd505db4d76a3a5c38eac0b486a4b3707"}],"containerStatuses":[{"name":"zookeeper","state":{"running":{"startedAt":"2020-11-04T12:39:27Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"zookeeper:3.5.5","imageID":"docker-pullable://zookeeper@sha256:b7a76ec06f68fd9c801b72dfd283701bc7d8a8b0609277a0d570e8e6768e4ad9","containerID":"docker://5a23b168fcd24cb11af8108565951ff5245033ff94662e036bf762535ee238a0"}],"qosClass":"Burstable"}},{"metadata":{"name":"ksql-server-8677c5b7f8-q42w8","generateName":"ksql-server-8677c5b7f8-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/ksql-server-8677c5b7f8-q42w8","uid":"145212e7-1e9e-11eb-9aff-16da7cad7b07","resourceVersion":"45480188","creationTimestamp":"2020-11-04T13:03:05Z","labels":{"app.kubernetes.io/name":"ksql-server","app.kubernetes.io/part-of":"invu-sre-ksql-server","pod-template-hash":"8677c5b7f8"},"annotations":{"checksum/config":"dc3caa66ae8b7f8260e59838548975a5c48e91afabc88356beeb76a13129f25c","prometheus.io/port":"5556","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"ksql-server-8677c5b7f8","uid":"82f4d704-1e9b-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"create-topics","configMap":{"name":"ksql-server-create-topics","defaultMode":511}},{"name":"jmx-config","configMap":{"name":"ksql-server-jmx-config","defaultMode":420}},{"name":"queries","configMap":{"name":"ksql-server-queries","defaultMode":420}}],"initContainers":[{"name":"create-topics","image":"registry.example.com/ce/utilities/kt","command":["/bin/bash","-c","/etc/topics/create-topics.sh"],"resources":{},"volumeMounts":[{"name":"create-topics","mountPath":"/etc/topics"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"exporter","image":"example/jmx-prometheus-httpserver:0.11.0","args":["5556","/etc/jmx-ksql-server/jmx-ksql-server-prometheus.yml"],"ports":[{"name":"metrics","containerPort":5556,"protocol":"TCP"}],"resources":{"limits":{"cpu":"150m","memory":"256Mi"},"requests":{"cpu":"75m","memory":"128Mi"}},"volumeMounts":[{"name":"jmx-config","mountPath":"/etc/jmx-ksql-server"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"},{"name":"ksql-server","image":"confluentinc/cp-ksql-server:5.2.2","ports":[{"name":"http","containerPort":8088,"protocol":"TCP"},{"name":"jmx","containerPort":1099,"protocol":"TCP"}],"env":[{"name":"KSQL_BOOTSTRAP_SERVERS","value":"PLAINTEXT://kafka:9092"},{"name":"KSQL_KSQL_SCHEMA_REGISTRY_URL","value":"http://schema-registry-svc:8081"},{"name":"KSQL_KSQL_SERVICE_ID","value":"invu-sre-ksql-server"},{"name":"KSQL_CONFLUENT_SUPPORT_METRICS_ENABLE","value":"false"},{"name":"KSQL_JMX_PORT","value":"1099"},{"name":"KSQL_KSQL_QUERIES_FILE","value":"/opt/queries/ksql_queries.sql"},{"name":"KSQL_KSQL_SINK_PARTITIONS","value":"10"},{"name":"KSQL_KSQL_SINK_REPLICAS","value":"2"},{"name":"KSQL_KSQL_STREAMS_AUTO_OFFSET_RESET","value":"earliest"},{"name":"KSQL_LISTENERS","value":"http://0.0.0.0:8088"},{"name":"KSQL_REPLICA_FETCH_MAX_BYTES","value":"2097152"},{"name":"KSQL_MAX_REQUEST_SIZE","value":"2097152"},{"name":"KSQL_MESSAGE_MAX_BYTES","value":"2097152"},{"name":"KSQL_PRODUCER_MAX_REQUEST_SIZE","value":"2097152"},{"name":"KSQL_CONSUMER_MAX_PARTITION_FETCH_BYTES","value":"2097152"}],"resources":{"limits":{"cpu":"1","memory":"4Gi"},"requests":{"cpu":"500m","memory":"2Gi"}},"volumeMounts":[{"name":"queries","mountPath":"/opt/queries"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-42-110.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}],"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":100,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"kubernetes.io/hostname"}}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["ksql-server"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:03:19Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:03:40Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:03:40Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:03:05Z"}],"hostIP":"10.40.42.110","podIP":"10.40.63.123","startTime":"2020-11-04T13:03:06Z","initContainerStatuses":[{"name":"create-topics","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T13:03:13Z","finishedAt":"2020-11-04T13:03:18Z","containerID":"docker://ee72cb27f1a9ff8bdc53691add152a6f9879cf21198ddc00ac2d086d5330fdd7"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/utilities/kt:latest","imageID":"docker-pullable://registry.example.com/ce/utilities/kt@sha256:a52550f941a9449ea205201f2c42d0352da5f70bf281d1d638944352781851b2","containerID":"docker://ee72cb27f1a9ff8bdc53691add152a6f9879cf21198ddc00ac2d086d5330fdd7"}],"containerStatuses":[{"name":"exporter","state":{"running":{"startedAt":"2020-11-04T13:03:26Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"example/jmx-prometheus-httpserver:0.11.0","imageID":"docker-pullable://example/jmx-prometheus-httpserver@sha256:725e8a9bfec05f432b931edc11b1ee8bac3895e408bb91af58266dc88ee4e63b","containerID":"docker://194bad9256147465d9d4408ce83599d778431293d9a07386f3156daf41d968cb"},{"name":"ksql-server","state":{"running":{"startedAt":"2020-11-04T13:03:39Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"confluentinc/cp-ksql-server:5.2.2","imageID":"docker-pullable://confluentinc/cp-ksql-server@sha256:a0b75d2f9926ac31139b2bebff3ac95a24e9f08465176aef16ed3c481b39a297","containerID":"docker://01b5000af50c8b6b2e0f766742a3f17fc246dc3e47f9646b440d3d2a0928b92e"}],"qosClass":"Burstable"}},{"metadata":{"name":"mail-service-6b77fcf69c-p6jgf","generateName":"mail-service-6b77fcf69c-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/mail-service-6b77fcf69c-p6jgf","uid":"ffbb729e-1e9f-11eb-9aff-16da7cad7b07","resourceVersion":"45482907","creationTimestamp":"2020-11-04T13:16:50Z","labels":{"app":"mail-service","pod-template-hash":"6b77fcf69c","release":"invu-sre-mail-service"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"mail-service-6b77fcf69c","uid":"ffba819b-1e9f-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-kvb6j","secret":{"secretName":"default-token-kvb6j","defaultMode":420}}],"initContainers":[{"name":"mysql-client","image":"registry.example.com/ce/utilities/mysql-client","env":[{"name":"DATABASE_NAME","value":"invu_mail_service"},{"name":"MYSQL_USER","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MYSQL_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}}],"resources":{},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"mail-service","image":"registry.example.com/cybervision/pregsense-mail-service:1.1.0-38167","ports":[{"name":"http","containerPort":80,"protocol":"TCP"}],"env":[{"name":"ZOOKEEPER_CONNECT_STRING","value":"kafka-zookeeper:2181"},{"name":"AUTH_SERVICE_HOST","value":"auth-service"},{"name":"BOOTSTRAP_SERVERS","value":"kafka:9092"},{"name":"DEBUG","value":"false"},{"name":"JAVA_OPTS","value":"-Xmx512M"},{"name":"MARIADB_HOST","value":"mariadb"},{"name":"SMTP_HOST","value":"smtp.gmail.com"},{"name":"SMTP_PORT","value":"587"},{"name":"MARIADB_USERNAME","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MARIADB_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}},{"name":"SMTP_USERNAME","valueFrom":{"secretKeyRef":{"name":"mail-service-credentials","key":"username"}}},{"name":"SMTP_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mail-service-credentials","key":"password"}}},{"name":"INSTANCE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.name"}}},{"name":"REPLICATION_FACTOR","valueFrom":{"configMapKeyRef":{"name":"invu-configmap","key":"invu-kafka-replication-factor"}}},{"name":"ENVIRONMENT_TYPE"}],"resources":{"limits":{"cpu":"500m","memory":"1Gi"},"requests":{"cpu":"100m","memory":"128Mi"}},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/api/v1/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":240,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/api/v1/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":5,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"ip-10-40-42-110.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app","operator":"In","values":["mail-service"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:59Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:18:48Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:18:48Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:50Z"}],"hostIP":"10.40.42.110","podIP":"10.40.36.203","startTime":"2020-11-04T13:16:50Z","initContainerStatuses":[{"name":"mysql-client","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T13:16:57Z","finishedAt":"2020-11-04T13:16:58Z","containerID":"docker://fb8c312c7dd22bab24734f384b925f7d5bef7a87c08538a7f5fa8a0fdb96f22f"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/utilities/mysql-client:latest","imageID":"docker-pullable://registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","containerID":"docker://fb8c312c7dd22bab24734f384b925f7d5bef7a87c08538a7f5fa8a0fdb96f22f"}],"containerStatuses":[{"name":"mail-service","state":{"running":{"startedAt":"2020-11-04T13:17:05Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/cybervision/pregsense-mail-service:1.1.0-38167","imageID":"docker-pullable://registry.example.com/cybervision/pregsense-mail-service@sha256:633a2b3faf69477dfd745b83def6689077641309c1092121edb215bcfec06d8d","containerID":"docker://0d94c9824f0aad9d4341ca65ceb40d9264778b73877799ed297b1d8173385416"}],"qosClass":"Burstable"}},{"metadata":{"name":"mariadb-0","generateName":"mariadb-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/mariadb-0","uid":"8427b17b-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45477237","creationTimestamp":"2020-11-04T12:44:45Z","labels":{"app.kubernetes.io/name":"mariadb","app.kubernetes.io/part-of":"invu-sre-mariadb","controller-revision-hash":"mariadb-b5b65b86c","statefulset.kubernetes.io/pod-name":"mariadb-0"},"annotations":{"checksum/config":"dc020dcc29b6f60d457b31746cd171c10007bd02dc2efc5284aed55dd9e790f0","prometheus.io/port":"9104","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"StatefulSet","name":"mariadb","uid":"8421568d-1e9b-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"data","persistentVolumeClaim":{"claimName":"data-mariadb-0"}},{"name":"init","configMap":{"name":"mariadb-init","defaultMode":420}},{"name":"config-dir","emptyDir":{}},{"name":"config","configMap":{"name":"mariadb-config","defaultMode":420}}],"initContainers":[{"name":"init","image":"busybox","command":["/bin/sh","-c","cp /src/*.cnf /dist"],"resources":{},"volumeMounts":[{"name":"config-dir","mountPath":"/dist"},{"name":"config","mountPath":"/src"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"mariadb","image":"registry.example.com/ce/middleware/mariadb:0.6.56","ports":[{"name":"ist","containerPort":4568,"protocol":"TCP"},{"name":"mysql","containerPort":3306,"protocol":"TCP"},{"name":"replication","containerPort":4567,"protocol":"TCP"},{"name":"sst","containerPort":4444,"protocol":"TCP"}],"env":[{"name":"POD_NAMESPACE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}},{"name":"MYSQL_ROOT_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb","key":"mysql_root_password"}}},{"name":"MYSQL_CLIENT_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}},{"name":"GALERA_SERVICE","value":"mariadb-headless"},{"name":"TRACE","value":"1"}],"resources":{"limits":{"cpu":"500m","memory":"1717986918400m"},"requests":{"cpu":"125m","memory":"1717986918400m"}},"volumeMounts":[{"name":"config-dir","mountPath":"/etc/mysql/conf.d"},{"name":"data","mountPath":"/var/lib/mysql"},{"name":"init","mountPath":"/docker-entrypoint-initdb.d"}],"livenessProbe":{"exec":{"command":["/bin/sh","-c","mysqladmin ping -p${MYSQL_ROOT_PASSWORD}"]},"initialDelaySeconds":3000,"timeoutSeconds":5,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"exec":{"command":["/bin/sh","-c","mysql -p${MYSQL_ROOT_PASSWORD} -e 'SELECT 1';"]},"initialDelaySeconds":30,"timeoutSeconds":5,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"},{"name":"metrics","image":"prom/mysqld-exporter:v0.11.0","ports":[{"name":"metrics","containerPort":9104,"protocol":"TCP"}],"env":[{"name":"DATA_SOURCE_NAME","value":"exporter:zeefah9Tei3he0@(localhost:3306)/"}],"resources":{"limits":{"cpu":"100m","memory":"64Mi"},"requests":{"cpu":"50m","memory":"32Mi"}},"livenessProbe":{"httpGet":{"path":"/","port":"metrics","scheme":"HTTP"},"initialDelaySeconds":30,"timeoutSeconds":5,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/","port":"metrics","scheme":"HTTP"},"initialDelaySeconds":30,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{},"hostname":"mariadb-0","subdomain":"mariadb-headless","affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["mariadb"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:45:19Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:46:23Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:46:23Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:49Z"}],"hostIP":"10.40.56.27","podIP":"10.40.59.179","startTime":"2020-11-04T12:44:49Z","initContainerStatuses":[{"name":"init","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T12:45:19Z","finishedAt":"2020-11-04T12:45:19Z","containerID":"docker://7a827ee7a851ff3e7d4a398feb3d9c3902404ea0ec1a7a208caeb664157ba2cc"}},"lastState":{},"ready":true,"restartCount":0,"image":"busybox:latest","imageID":"docker-pullable://busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","containerID":"docker://7a827ee7a851ff3e7d4a398feb3d9c3902404ea0ec1a7a208caeb664157ba2cc"}],"containerStatuses":[{"name":"mariadb","state":{"running":{"startedAt":"2020-11-04T12:45:29Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/middleware/mariadb:0.6.56","imageID":"docker-pullable://registry.example.com/ce/middleware/mariadb@sha256:b4c12c27093137dbf047773d4ddb99676bedd32c8606bfa1e3c50876d5ce659f","containerID":"docker://07539803833e2d16998d3db0256858cbb47fcf88bef3c0a0ca658ebd249b133d"},{"name":"metrics","state":{"running":{"startedAt":"2020-11-04T12:45:30Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"prom/mysqld-exporter:v0.11.0","imageID":"docker-pullable://prom/mysqld-exporter@sha256:9f4fb61cca309cb4a8c1b9ed9fb4aa75af0f7a21f36d3954667db37c062a0172","containerID":"docker://95101d440115a7b6c4b74e38717130e649cf0753b0eb3f8007b056f14c2cff63"}],"qosClass":"Burstable"}},{"metadata":{"name":"mariadb-1","generateName":"mariadb-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/mariadb-1","uid":"beb6f470-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45477436","creationTimestamp":"2020-11-04T12:46:23Z","labels":{"app.kubernetes.io/name":"mariadb","app.kubernetes.io/part-of":"invu-sre-mariadb","controller-revision-hash":"mariadb-b5b65b86c","statefulset.kubernetes.io/pod-name":"mariadb-1"},"annotations":{"checksum/config":"dc020dcc29b6f60d457b31746cd171c10007bd02dc2efc5284aed55dd9e790f0","prometheus.io/port":"9104","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"StatefulSet","name":"mariadb","uid":"8421568d-1e9b-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"data","persistentVolumeClaim":{"claimName":"data-mariadb-1"}},{"name":"init","configMap":{"name":"mariadb-init","defaultMode":420}},{"name":"config-dir","emptyDir":{}},{"name":"config","configMap":{"name":"mariadb-config","defaultMode":420}}],"initContainers":[{"name":"init","image":"busybox","command":["/bin/sh","-c","cp /src/*.cnf /dist"],"resources":{},"volumeMounts":[{"name":"config-dir","mountPath":"/dist"},{"name":"config","mountPath":"/src"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"mariadb","image":"registry.example.com/ce/middleware/mariadb:0.6.56","ports":[{"name":"ist","containerPort":4568,"protocol":"TCP"},{"name":"mysql","containerPort":3306,"protocol":"TCP"},{"name":"replication","containerPort":4567,"protocol":"TCP"},{"name":"sst","containerPort":4444,"protocol":"TCP"}],"env":[{"name":"POD_NAMESPACE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}},{"name":"MYSQL_ROOT_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb","key":"mysql_root_password"}}},{"name":"MYSQL_CLIENT_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}},{"name":"GALERA_SERVICE","value":"mariadb-headless"},{"name":"TRACE","value":"1"}],"resources":{"limits":{"cpu":"500m","memory":"1717986918400m"},"requests":{"cpu":"125m","memory":"1717986918400m"}},"volumeMounts":[{"name":"config-dir","mountPath":"/etc/mysql/conf.d"},{"name":"data","mountPath":"/var/lib/mysql"},{"name":"init","mountPath":"/docker-entrypoint-initdb.d"}],"livenessProbe":{"exec":{"command":["/bin/sh","-c","mysqladmin ping -p${MYSQL_ROOT_PASSWORD}"]},"initialDelaySeconds":3000,"timeoutSeconds":5,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"exec":{"command":["/bin/sh","-c","mysql -p${MYSQL_ROOT_PASSWORD} -e 'SELECT 1';"]},"initialDelaySeconds":30,"timeoutSeconds":5,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"},{"name":"metrics","image":"prom/mysqld-exporter:v0.11.0","ports":[{"name":"metrics","containerPort":9104,"protocol":"TCP"}],"env":[{"name":"DATA_SOURCE_NAME","value":"exporter:zeefah9Tei3he0@(localhost:3306)/"}],"resources":{"limits":{"cpu":"100m","memory":"64Mi"},"requests":{"cpu":"50m","memory":"32Mi"}},"livenessProbe":{"httpGet":{"path":"/","port":"metrics","scheme":"HTTP"},"initialDelaySeconds":30,"timeoutSeconds":5,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/","port":"metrics","scheme":"HTTP"},"initialDelaySeconds":30,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-51-35.ec2.internal","securityContext":{},"hostname":"mariadb-1","subdomain":"mariadb-headless","affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["mariadb"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:46:41Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:47:13Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:47:13Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:46:27Z"}],"hostIP":"10.40.51.35","podIP":"10.40.38.175","startTime":"2020-11-04T12:46:27Z","initContainerStatuses":[{"name":"init","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T12:46:40Z","finishedAt":"2020-11-04T12:46:40Z","containerID":"docker://d0258bcef6ab20af3de47fe4e623339fa189f20b7cd5cde17d17ced145350b18"}},"lastState":{},"ready":true,"restartCount":0,"image":"busybox:latest","imageID":"docker-pullable://busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","containerID":"docker://d0258bcef6ab20af3de47fe4e623339fa189f20b7cd5cde17d17ced145350b18"}],"containerStatuses":[{"name":"mariadb","state":{"running":{"startedAt":"2020-11-04T12:46:41Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/middleware/mariadb:0.6.56","imageID":"docker-pullable://registry.example.com/ce/middleware/mariadb@sha256:b4c12c27093137dbf047773d4ddb99676bedd32c8606bfa1e3c50876d5ce659f","containerID":"docker://0cf34b4cd17c878fe0b3456df66d3c3c33464186a18511ca2610ed6915f5d405"},{"name":"metrics","state":{"running":{"startedAt":"2020-11-04T12:46:42Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"prom/mysqld-exporter:v0.11.0","imageID":"docker-pullable://prom/mysqld-exporter@sha256:9f4fb61cca309cb4a8c1b9ed9fb4aa75af0f7a21f36d3954667db37c062a0172","containerID":"docker://4eddb995a5bbf31f8ecf6910bd1fdf64d13c5c536ce746728a00610b22e7c3ad"}],"qosClass":"Burstable"}},{"metadata":{"name":"medex-service-758944946b-4w5zz","generateName":"medex-service-758944946b-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/medex-service-758944946b-4w5zz","uid":"00c87d6d-1ea0-11eb-9aff-16da7cad7b07","resourceVersion":"45482776","creationTimestamp":"2020-11-04T13:16:52Z","labels":{"app":"medex-service","pod-template-hash":"758944946b","release":"invu-sre-medex-service"},"annotations":{"iam.amazonaws.com/role":"medex-results-access"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"medex-service-758944946b","uid":"00c6d3fd-1ea0-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-kvb6j","secret":{"secretName":"default-token-kvb6j","defaultMode":420}}],"initContainers":[{"name":"mysql-client","image":"registry.example.com/ce/utilities/mysql-client","env":[{"name":"DATABASE_NAME","value":"invu_medex_service"},{"name":"MYSQL_USER","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MYSQL_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}}],"resources":{},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"medex-service","image":"registry.example.com/cybervision/pregsense-medex-service:2.0.0-37573","ports":[{"name":"http","containerPort":80,"protocol":"TCP"}],"env":[{"name":"BOOTSTRAP_SERVERS","value":"kafka:9092"},{"name":"AUTH_SERVICE_HOST","value":"auth-service"},{"name":"DEBUG","value":"false"},{"name":"JAVA_OPTS","value":"-Xmx512M"},{"name":"MARIADB_HOST","value":"mariadb"},{"name":"MARIADB_USERNAME","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MARIADB_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}},{"name":"INSTANCE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.name"}}}],"resources":{"limits":{"cpu":"500m","memory":"1Gi"},"requests":{"cpu":"500m","memory":"750Mi"}},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/api/v1/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":240,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/api/v1/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":5,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"ip-10-40-45-241.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["mariadb"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}],"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":3,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["mariadb"]}]},"topologyKey":"kubernetes.io/hostname"}},{"weight":1,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app","operator":"In","values":["medex-service"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:54Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:18:10Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:18:10Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:52Z"}],"hostIP":"10.40.45.241","podIP":"10.40.51.63","startTime":"2020-11-04T13:16:52Z","initContainerStatuses":[{"name":"mysql-client","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T13:16:53Z","finishedAt":"2020-11-04T13:16:53Z","containerID":"docker://89a7e81a0e9736f2c34cf6d42dae07957402dac0182e5145e4bf756ea36e83d0"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/utilities/mysql-client:latest","imageID":"docker-pullable://registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","containerID":"docker://89a7e81a0e9736f2c34cf6d42dae07957402dac0182e5145e4bf756ea36e83d0"}],"containerStatuses":[{"name":"medex-service","state":{"running":{"startedAt":"2020-11-04T13:16:57Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/cybervision/pregsense-medex-service:2.0.0-37573","imageID":"docker-pullable://registry.example.com/cybervision/pregsense-medex-service@sha256:a6a38353b3b4ee41627606873b884cabf0a37bd0d6afb9b5f823b0e64d988d5b","containerID":"docker://1a4849764f2c6377b930a931a5c2b0d6f6e5eeb8ac086b28932ae47e07e9a752"}],"qosClass":"Burstable"}},{"metadata":{"name":"mobile-device-service-b74974b86-5phf8","generateName":"mobile-device-service-b74974b86-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/mobile-device-service-b74974b86-5phf8","uid":"01de3f5e-1ea0-11eb-9aff-16da7cad7b07","resourceVersion":"45482944","creationTimestamp":"2020-11-04T13:16:53Z","labels":{"app":"mobile-device-service","pod-template-hash":"b74974b86","release":"invu-sre-mobile-device-service"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"mobile-device-service-b74974b86","uid":"01dd2066-1ea0-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-kvb6j","secret":{"secretName":"default-token-kvb6j","defaultMode":420}}],"initContainers":[{"name":"mysql-client","image":"registry.example.com/ce/utilities/mysql-client","env":[{"name":"DATABASE_NAME","value":"invu_mobile_device_service"},{"name":"MYSQL_USER","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MYSQL_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}}],"resources":{},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"mobile-device-service","image":"registry.example.com/cybervision/pregsense-mobile-device-service:2.0.0-37577","ports":[{"name":"http","containerPort":80,"protocol":"TCP"}],"env":[{"name":"BOOTSTRAP_SERVERS","value":"kafka:9092"},{"name":"ZOOKEEPER_CONNECT_STRING","value":"kafka-zookeeper:2181"},{"name":"AUTH_SERVICE_HOST","value":"auth-service"},{"name":"DEBUG","value":"false"},{"name":"JAVA_OPTS","value":"-Xmx512M"},{"name":"MARIADB_HOST","value":"mariadb"},{"name":"MARIADB_USERNAME","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MARIADB_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}},{"name":"INSTANCE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.name"}}}],"resources":{"limits":{"cpu":"500m","memory":"1Gi"},"requests":{"cpu":"500m","memory":"750Mi"}},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/api/v1/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":240,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/api/v1/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":5,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"ip-10-40-45-241.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app","operator":"In","values":["mobile-device-service"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:58Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:18:58Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:18:58Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:54Z"}],"hostIP":"10.40.45.241","podIP":"10.40.57.153","startTime":"2020-11-04T13:16:54Z","initContainerStatuses":[{"name":"mysql-client","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T13:16:57Z","finishedAt":"2020-11-04T13:16:57Z","containerID":"docker://87c653d32dbba31b1e68b71ca077f11101c3687b929dd84acbc8896851e2d27b"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/utilities/mysql-client:latest","imageID":"docker-pullable://registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","containerID":"docker://87c653d32dbba31b1e68b71ca077f11101c3687b929dd84acbc8896851e2d27b"}],"containerStatuses":[{"name":"mobile-device-service","state":{"running":{"startedAt":"2020-11-04T13:17:05Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/cybervision/pregsense-mobile-device-service:2.0.0-37577","imageID":"docker-pullable://registry.example.com/cybervision/pregsense-mobile-device-service@sha256:057469801785596922de4ad1866a4d2f7e26271d925889f1533fe8cf06b0db51","containerID":"docker://8e726dc844164cd61acf13b9f2f812d267eb5d0b7bb27c1e2fcf01f2fad9a799"}],"qosClass":"Burstable"}},{"metadata":{"name":"redis-9ddbb99d8-tvr7n","generateName":"redis-9ddbb99d8-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/redis-9ddbb99d8-tvr7n","uid":"c3ba6348-1e9a-11eb-9aff-16da7cad7b07","resourceVersion":"45476538","creationTimestamp":"2020-11-04T12:39:22Z","labels":{"app":"redis","pod-template-hash":"9ddbb99d8","release":"invu-sre-redis"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"redis-9ddbb99d8","uid":"c3b837f7-1e9a-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"data","persistentVolumeClaim":{"claimName":"redis"}},{"name":"default-token-kvb6j","secret":{"secretName":"default-token-kvb6j","defaultMode":420}}],"containers":[{"name":"redis","image":"redis:5.0.3-alpine","args":["--appendonly yes","--appendfsync everysec"],"ports":[{"name":"redis","containerPort":6379,"protocol":"TCP"}],"resources":{"limits":{"cpu":"400m","memory":"1Gi"},"requests":{"cpu":"100m","memory":"256Mi"}},"volumeMounts":[{"name":"data","mountPath":"/data"},{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"exec":{"command":["redis-cli","ping"]},"initialDelaySeconds":30,"timeoutSeconds":5,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"exec":{"command":["redis-cli","ping"]},"initialDelaySeconds":5,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"ip-10-40-45-241.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app","operator":"In","values":["redis"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:42:54Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:43:23Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:43:23Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:42:54Z"}],"hostIP":"10.40.45.241","podIP":"10.40.52.239","startTime":"2020-11-04T12:42:54Z","containerStatuses":[{"name":"redis","state":{"running":{"startedAt":"2020-11-04T12:43:16Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"redis:5.0.3-alpine","imageID":"docker-pullable://redis@sha256:f8c22abc77f3f9cc1c2516062e4a2a71375859d7922da3faf9e4160e6ba4c3c2","containerID":"docker://dfd37666d139061d5e26c943ec8d7f8653e4a4c9e9ee6150448f41fda33cbd43"}],"qosClass":"Burstable"}},{"metadata":{"name":"scheduler-service-c7b5f998f-9dmkv","generateName":"scheduler-service-c7b5f998f-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/scheduler-service-c7b5f998f-9dmkv","uid":"0394c97c-1ea0-11eb-9aff-16da7cad7b07","resourceVersion":"45482843","creationTimestamp":"2020-11-04T13:16:56Z","labels":{"app":"scheduler-service","pod-template-hash":"c7b5f998f","release":"invu-sre-scheduler-service"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"scheduler-service-c7b5f998f","uid":"0393ee5d-1ea0-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-kvb6j","secret":{"secretName":"default-token-kvb6j","defaultMode":420}}],"initContainers":[{"name":"mysql-client","image":"registry.example.com/ce/utilities/mysql-client","env":[{"name":"DATABASE_NAME","value":"invu_scheduler_service"},{"name":"MYSQL_USER","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MYSQL_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}}],"resources":{},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"scheduler-service","image":"registry.example.com/cybervision/pregsense-scheduler-service:1.1.0-37581","ports":[{"name":"http","containerPort":80,"protocol":"TCP"}],"env":[{"name":"ZOOKEEPER_CONNECT_STRING","value":"kafka-zookeeper:2181"},{"name":"AUTH_SERVICE_HOST","value":"auth-service"},{"name":"BOOTSTRAP_SERVERS","value":"kafka:9092"},{"name":"DEBUG","value":"false"},{"name":"JAVA_OPTS","value":"-Xmx512M"},{"name":"MARIADB_HOST","value":"mariadb"},{"name":"MARIADB_USERNAME","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MARIADB_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}},{"name":"INSTANCE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.name"}}},{"name":"INVU_PRO_URL","value":"pro-invu-sre.example.com"}],"resources":{"limits":{"cpu":"500m","memory":"1Gi"},"requests":{"cpu":"100m","memory":"128Mi"}},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/api/v1/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":240,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/api/v1/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":5,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"ip-10-40-51-35.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app","operator":"In","values":["scheduler-service"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:59Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:18:32Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:18:32Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:56Z"}],"hostIP":"10.40.51.35","podIP":"10.40.49.157","startTime":"2020-11-04T13:16:56Z","initContainerStatuses":[{"name":"mysql-client","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T13:16:58Z","finishedAt":"2020-11-04T13:16:58Z","containerID":"docker://b033ef4e725bebc8d34663d6b827da66b7cdc0f94df3a66d22414b51e552391b"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/utilities/mysql-client:latest","imageID":"docker-pullable://registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","containerID":"docker://b033ef4e725bebc8d34663d6b827da66b7cdc0f94df3a66d22414b51e552391b"}],"containerStatuses":[{"name":"scheduler-service","state":{"running":{"startedAt":"2020-11-04T13:16:59Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/cybervision/pregsense-scheduler-service:1.1.0-37581","imageID":"docker-pullable://registry.example.com/cybervision/pregsense-scheduler-service@sha256:7ad590d9311407a5c36583316cd79b66906db26085e56b5c37d9d3125d522fc2","containerID":"docker://9adc049140367830dfd2994732362f221eccf24761012ecdba44a617c1cc0994"}],"qosClass":"Burstable"}},{"metadata":{"name":"schema-registry-7c97c65ddf-dtrwh","generateName":"schema-registry-7c97c65ddf-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/schema-registry-7c97c65ddf-dtrwh","uid":"82f8c4bb-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45477468","creationTimestamp":"2020-11-04T12:44:43Z","labels":{"app.kubernetes.io/name":"schema-registry","app.kubernetes.io/part-of":"invu-sre-ksql-server","pod-template-hash":"7c97c65ddf"},"annotations":{"prometheus.io/port":"5556","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"schema-registry-7c97c65ddf","uid":"82f1e9b2-1e9b-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"jmx-config","configMap":{"name":"schema-registry-jmx-config","defaultMode":420}}],"containers":[{"name":"exporter","image":"example/jmx-prometheus-httpserver:0.11.0","args":["5556","/etc/jmx-schema-registry/jmx-schema-registry-prometheus.yml"],"ports":[{"name":"exporter","containerPort":5556,"protocol":"TCP"}],"resources":{"limits":{"cpu":"25m","memory":"128Mi"},"requests":{"cpu":"10m","memory":"64Mi"}},"volumeMounts":[{"name":"jmx-config","mountPath":"/etc/jmx-schema-registry"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"},{"name":"schema-registry","image":"confluentinc/cp-schema-registry:5.2.2","ports":[{"name":"http","containerPort":8081,"protocol":"TCP"},{"name":"jmx","containerPort":5555,"protocol":"TCP"}],"env":[{"name":"SCHEMA_REGISTRY_KAFKASTORE_BOOTSTRAP_SERVERS","value":"PLAINTEXT://kafka:9092"},{"name":"SCHEMA_REGISTRY_HOST_NAME","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}},{"name":"SCHEMA_REGISTRY_KAFKASTORE_GROUP_ID","value":"invu-sre-ksql-server"},{"name":"SCHEMA_REGISTRY_LISTENERS","value":"http://0.0.0.0:8081"},{"name":"JMX_PORT","value":"5555"}],"resources":{"limits":{"cpu":"500m","memory":"2Gi"},"requests":{"cpu":"200m","memory":"1Gi"}},"livenessProbe":{"httpGet":{"path":"/","port":"http","scheme":"HTTP"},"initialDelaySeconds":45,"timeoutSeconds":1,"periodSeconds":15,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/","port":"http","scheme":"HTTP"},"initialDelaySeconds":45,"timeoutSeconds":1,"periodSeconds":15,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}],"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":100,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"kubernetes.io/hostname"}}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["schema-registry"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:43Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:47:22Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:47:22Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:43Z"}],"hostIP":"10.40.56.27","podIP":"10.40.48.113","startTime":"2020-11-04T12:44:43Z","containerStatuses":[{"name":"exporter","state":{"running":{"startedAt":"2020-11-04T12:44:50Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"example/jmx-prometheus-httpserver:0.11.0","imageID":"docker-pullable://example/jmx-prometheus-httpserver@sha256:725e8a9bfec05f432b931edc11b1ee8bac3895e408bb91af58266dc88ee4e63b","containerID":"docker://c14b0899acd56fa6dbcf478acb6ca6ad50b729ed4fc5484fc331ed704ee29c84"},{"name":"schema-registry","state":{"running":{"startedAt":"2020-11-04T12:46:25Z"}},"lastState":{"terminated":{"exitCode":1,"reason":"Error","startedAt":"2020-11-04T12:45:05Z","finishedAt":"2020-11-04T12:46:25Z","containerID":"docker://46b2bb766b699eca062c6a48dc429c7d4af432b005712b338c5deb9e848de146"}},"ready":true,"restartCount":1,"image":"confluentinc/cp-schema-registry:5.2.2","imageID":"docker-pullable://confluentinc/cp-schema-registry@sha256:0d7a84d486477a0c203ae21d5d52c40d26e810f5b5cfa27a56274692b70949f5","containerID":"docker://7d4a1500d2c48880f43b6b3b657cdd5b4171cad147467607fdef274b694a9592"}],"qosClass":"Burstable"}},{"metadata":{"name":"user-management-869b6d8c95-cz5j6","generateName":"user-management-869b6d8c95-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/user-management-869b6d8c95-cz5j6","uid":"053e1967-1ea0-11eb-9aff-16da7cad7b07","resourceVersion":"45483368","creationTimestamp":"2020-11-04T13:16:59Z","labels":{"app":"user-management","pod-template-hash":"869b6d8c95","release":"invu-sre-user-management"},"annotations":{"iam.amazonaws.com/role":"invu-sre-objects-access"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"user-management-869b6d8c95","uid":"053be9f6-1ea0-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-kvb6j","secret":{"secretName":"default-token-kvb6j","defaultMode":420}}],"initContainers":[{"name":"mysql-client","image":"registry.example.com/ce/utilities/mysql-client","env":[{"name":"DATABASE_NAME","value":"pregsense_user_management_service"},{"name":"MYSQL_USER","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MYSQL_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}}],"resources":{},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"user-management","image":"registry.example.com/cybervision/pregsense-user-management-service:2.0.0-37765","ports":[{"name":"http","containerPort":80,"protocol":"TCP"}],"env":[{"name":"INVU_PRO_URL","value":"https://pro-invu-sre.example.com"},{"name":"ZOOKEEPER_CONNECT_STRING","value":"kafka-zookeeper:2181"},{"name":"AUTH_SERVICE_HOST","value":"auth-service"},{"name":"BOOTSTRAP_SERVERS","value":"kafka:9092"},{"name":"DEBUG","value":"false"},{"name":"JAVA_OPTS","value":"-Xmx1G"},{"name":"MARIADB_HOST","value":"mariadb"},{"name":"MARIADB_USERNAME","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MARIADB_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}},{"name":"S3_BUCKET_NAME","value":"invu-sre-objects"},{"name":"INSTANCE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.name"}}},{"name":"REPLICATION_FACTOR","valueFrom":{"configMapKeyRef":{"name":"invu-configmap","key":"invu-kafka-replication-factor"}}}],"resources":{"limits":{"cpu":"2500m","memory":"5000Mi"},"requests":{"cpu":"2","memory":"2500Mi"}},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/api/v1/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":240,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/api/v1/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":5,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"ip-10-40-59-224.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app","operator":"In","values":["user-management"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:20:14Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:21:03Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:21:03Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:20:08Z"}],"hostIP":"10.40.59.224","podIP":"10.40.33.210","startTime":"2020-11-04T13:20:08Z","initContainerStatuses":[{"name":"mysql-client","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T13:20:14Z","finishedAt":"2020-11-04T13:20:14Z","containerID":"docker://f92c9373a620e5de59e6b4cdc2490548957e6d77e40b12023bf703c7e67586fe"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/utilities/mysql-client:latest","imageID":"docker-pullable://registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","containerID":"docker://f92c9373a620e5de59e6b4cdc2490548957e6d77e40b12023bf703c7e67586fe"}],"containerStatuses":[{"name":"user-management","state":{"running":{"startedAt":"2020-11-04T13:20:39Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/cybervision/pregsense-user-management-service:2.0.0-37765","imageID":"docker-pullable://registry.example.com/cybervision/pregsense-user-management-service@sha256:e487a407cfaa96fa00f4d40a71e2792d26db1ad72843d9302588d18b0fb23326","containerID":"docker://fd15b128436b6d9237c4043f287d251646f79f20bd92984a1deed7e2e9fdbaa6"}],"qosClass":"Burstable"}},{"metadata":{"name":"aws-iam-authenticator-65vhw","generateName":"aws-iam-authenticator-","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/aws-iam-authenticator-65vhw","uid":"36a7d775-0e0c-11eb-9aff-16da7cad7b07","resourceVersion":"41346236","creationTimestamp":"2020-10-14T10:58:38Z","labels":{"controller-revision-hash":"5f6884c7bc","k8s-app":"aws-iam-authenticator","pod-template-generation":"2"},"annotations":{"scheduler.alpha.kubernetes.io/critical-pod":""},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"aws-iam-authenticator","uid":"5eaafffd-0aed-11ea-98f1-16c576d8665d","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"config","configMap":{"name":"aws-iam-authenticator","defaultMode":420}},{"name":"output","hostPath":{"path":"/srv/kubernetes/aws-iam-authenticator/","type":""}},{"name":"state","hostPath":{"path":"/srv/kubernetes/aws-iam-authenticator/","type":""}},{"name":"default-token-hdds9","secret":{"secretName":"default-token-hdds9","defaultMode":420}}],"containers":[{"name":"aws-iam-authenticator","image":"602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon/aws-iam-authenticator:v0.4.0","args":["server","--config=/etc/aws-iam-authenticator/config.yaml","--state-dir=/var/aws-iam-authenticator","--kubeconfig-pregenerated=true"],"resources":{"limits":{"cpu":"100m","memory":"20Mi"},"requests":{"cpu":"10m","memory":"20Mi"}},"volumeMounts":[{"name":"config","mountPath":"/etc/aws-iam-authenticator/"},{"name":"state","mountPath":"/var/aws-iam-authenticator/"},{"name":"output","mountPath":"/etc/kubernetes/aws-iam-authenticator/"},{"name":"default-token-hdds9","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","nodeSelector":{"node-role.kubernetes.io/master":""},"serviceAccountName":"default","serviceAccount":"default","nodeName":"ip-10-40-54-156.ec2.internal","hostNetwork":true,"securityContext":{},"affinity":{"nodeAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":{"nodeSelectorTerms":[{"matchFields":[{"key":"metadata.name","operator":"In","values":["ip-10-40-54-156.ec2.internal"]}]}]}}},"schedulerName":"default-scheduler","tolerations":[{"key":"node-role.kubernetes.io/master","effect":"NoSchedule"},{"key":"CriticalAddonsOnly","operator":"Exists"},{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/disk-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/memory-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/pid-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/unschedulable","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/network-unavailable","operator":"Exists","effect":"NoSchedule"}],"priorityClassName":"system-node-critical","priority":2000001000,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-14T10:58:38Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-14T10:58:42Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-14T10:58:42Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-14T10:58:38Z"}],"hostIP":"10.40.54.156","podIP":"10.40.54.156","startTime":"2020-10-14T10:58:38Z","containerStatuses":[{"name":"aws-iam-authenticator","state":{"running":{"startedAt":"2020-10-14T10:58:41Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon/aws-iam-authenticator:v0.4.0","imageID":"docker-pullable://602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon/aws-iam-authenticator@sha256:1477d16f77b237d26d34f1cde1885931fbf98669c478a72e6849c1fcdc9365fe","containerID":"docker://d7bfcdf7d0854f5429c8ab5e838de712a74033e65335e2a76b934fa1886902f6"}],"qosClass":"Burstable"}},{"metadata":{"name":"aws-node-dfwxr","generateName":"aws-node-","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/aws-node-dfwxr","uid":"106e9488-1dfc-11eb-9aff-16da7cad7b07","resourceVersion":"45293219","creationTimestamp":"2020-11-03T17:43:20Z","labels":{"controller-revision-hash":"bfff688fb","k8s-app":"aws-node","pod-template-generation":"2"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"aws-node","uid":"602ab1b3-0aed-11ea-98f1-16c576d8665d","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"cni-bin-dir","hostPath":{"path":"/opt/cni/bin","type":""}},{"name":"cni-net-dir","hostPath":{"path":"/etc/cni/net.d","type":""}},{"name":"log-dir","hostPath":{"path":"/var/log","type":""}},{"name":"dockersock","hostPath":{"path":"/var/run/docker.sock","type":""}},{"name":"aws-node-token-wrj7h","secret":{"secretName":"aws-node-token-wrj7h","defaultMode":420}}],"containers":[{"name":"aws-node","image":"602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5","ports":[{"name":"metrics","hostPort":61678,"containerPort":61678,"protocol":"TCP"}],"env":[{"name":"CLUSTER_NAME","value":"example.com"},{"name":"AWS_VPC_K8S_CNI_LOGLEVEL","value":"DEBUG"},{"name":"MY_NODE_NAME","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"spec.nodeName"}}},{"name":"WATCH_NAMESPACE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}}],"resources":{"requests":{"cpu":"10m"}},"volumeMounts":[{"name":"cni-bin-dir","mountPath":"/host/opt/cni/bin"},{"name":"cni-net-dir","mountPath":"/host/etc/cni/net.d"},{"name":"log-dir","mountPath":"/host/var/log"},{"name":"dockersock","mountPath":"/var/run/docker.sock"},{"name":"aws-node-token-wrj7h","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always","securityContext":{"privileged":true,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"aws-node","serviceAccount":"aws-node","nodeName":"ip-10-40-51-35.ec2.internal","hostNetwork":true,"securityContext":{},"affinity":{"nodeAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":{"nodeSelectorTerms":[{"matchFields":[{"key":"metadata.name","operator":"In","values":["ip-10-40-51-35.ec2.internal"]}]}]}}},"schedulerName":"default-scheduler","tolerations":[{"operator":"Exists"},{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/disk-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/memory-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/pid-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/unschedulable","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/network-unavailable","operator":"Exists","effect":"NoSchedule"}],"priorityClassName":"system-node-critical","priority":2000001000,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-03T17:43:21Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-03T17:43:33Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-03T17:43:33Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-03T17:43:21Z"}],"hostIP":"10.40.51.35","podIP":"10.40.51.35","startTime":"2020-11-03T17:43:21Z","containerStatuses":[{"name":"aws-node","state":{"running":{"startedAt":"2020-11-03T17:43:33Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5","imageID":"docker-pullable://602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni@sha256:a6d23b9fb3d4ba549321e32a28c42d8e79da203897072e93874472ab9e80b768","containerID":"docker://1d4a2c8113cc4a4f1d9629b9e6f1c5ff27462e78fcd77ac7ad7620a7c4541fc9"}],"qosClass":"Burstable"}},{"metadata":{"name":"aws-node-fnxht","generateName":"aws-node-","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/aws-node-fnxht","uid":"b4fdea5f-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45477221","creationTimestamp":"2020-11-04T12:46:07Z","labels":{"controller-revision-hash":"bfff688fb","k8s-app":"aws-node","pod-template-generation":"2"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"aws-node","uid":"602ab1b3-0aed-11ea-98f1-16c576d8665d","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"cni-bin-dir","hostPath":{"path":"/opt/cni/bin","type":""}},{"name":"cni-net-dir","hostPath":{"path":"/etc/cni/net.d","type":""}},{"name":"log-dir","hostPath":{"path":"/var/log","type":""}},{"name":"dockersock","hostPath":{"path":"/var/run/docker.sock","type":""}},{"name":"aws-node-token-wrj7h","secret":{"secretName":"aws-node-token-wrj7h","defaultMode":420}}],"containers":[{"name":"aws-node","image":"602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5","ports":[{"name":"metrics","hostPort":61678,"containerPort":61678,"protocol":"TCP"}],"env":[{"name":"CLUSTER_NAME","value":"example.com"},{"name":"AWS_VPC_K8S_CNI_LOGLEVEL","value":"DEBUG"},{"name":"MY_NODE_NAME","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"spec.nodeName"}}},{"name":"WATCH_NAMESPACE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}}],"resources":{"requests":{"cpu":"10m"}},"volumeMounts":[{"name":"cni-bin-dir","mountPath":"/host/opt/cni/bin"},{"name":"cni-net-dir","mountPath":"/host/etc/cni/net.d"},{"name":"log-dir","mountPath":"/host/var/log"},{"name":"dockersock","mountPath":"/var/run/docker.sock"},{"name":"aws-node-token-wrj7h","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always","securityContext":{"privileged":true,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"aws-node","serviceAccount":"aws-node","nodeName":"ip-10-40-55-41.ec2.internal","hostNetwork":true,"securityContext":{},"affinity":{"nodeAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":{"nodeSelectorTerms":[{"matchFields":[{"key":"metadata.name","operator":"In","values":["ip-10-40-55-41.ec2.internal"]}]}]}}},"schedulerName":"default-scheduler","tolerations":[{"operator":"Exists"},{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/disk-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/memory-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/pid-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/unschedulable","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/network-unavailable","operator":"Exists","effect":"NoSchedule"}],"priorityClassName":"system-node-critical","priority":2000001000,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:46:07Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:46:19Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:46:19Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:46:07Z"}],"hostIP":"10.40.55.41","podIP":"10.40.55.41","startTime":"2020-11-04T12:46:07Z","containerStatuses":[{"name":"aws-node","state":{"running":{"startedAt":"2020-11-04T12:46:19Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5","imageID":"docker-pullable://602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni@sha256:a6d23b9fb3d4ba549321e32a28c42d8e79da203897072e93874472ab9e80b768","containerID":"docker://90a8f8b8341f844045eb1d00405914300a58383b67d685900497d7b5983ca14a"}],"qosClass":"Burstable"}},{"metadata":{"name":"aws-node-gqbkl","generateName":"aws-node-","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/aws-node-gqbkl","uid":"21d6fe2e-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45476291","creationTimestamp":"2020-11-04T12:42:00Z","labels":{"controller-revision-hash":"bfff688fb","k8s-app":"aws-node","pod-template-generation":"2"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"aws-node","uid":"602ab1b3-0aed-11ea-98f1-16c576d8665d","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"cni-bin-dir","hostPath":{"path":"/opt/cni/bin","type":""}},{"name":"cni-net-dir","hostPath":{"path":"/etc/cni/net.d","type":""}},{"name":"log-dir","hostPath":{"path":"/var/log","type":""}},{"name":"dockersock","hostPath":{"path":"/var/run/docker.sock","type":""}},{"name":"aws-node-token-wrj7h","secret":{"secretName":"aws-node-token-wrj7h","defaultMode":420}}],"containers":[{"name":"aws-node","image":"602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5","ports":[{"name":"metrics","hostPort":61678,"containerPort":61678,"protocol":"TCP"}],"env":[{"name":"CLUSTER_NAME","value":"example.com"},{"name":"AWS_VPC_K8S_CNI_LOGLEVEL","value":"DEBUG"},{"name":"MY_NODE_NAME","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"spec.nodeName"}}},{"name":"WATCH_NAMESPACE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}}],"resources":{"requests":{"cpu":"10m"}},"volumeMounts":[{"name":"cni-bin-dir","mountPath":"/host/opt/cni/bin"},{"name":"cni-net-dir","mountPath":"/host/etc/cni/net.d"},{"name":"log-dir","mountPath":"/host/var/log"},{"name":"dockersock","mountPath":"/var/run/docker.sock"},{"name":"aws-node-token-wrj7h","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always","securityContext":{"privileged":true,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"aws-node","serviceAccount":"aws-node","nodeName":"ip-10-40-56-27.ec2.internal","hostNetwork":true,"securityContext":{},"affinity":{"nodeAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":{"nodeSelectorTerms":[{"matchFields":[{"key":"metadata.name","operator":"In","values":["ip-10-40-56-27.ec2.internal"]}]}]}}},"schedulerName":"default-scheduler","tolerations":[{"operator":"Exists"},{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/disk-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/memory-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/pid-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/unschedulable","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/network-unavailable","operator":"Exists","effect":"NoSchedule"}],"priorityClassName":"system-node-critical","priority":2000001000,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:42:00Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:42:12Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:42:12Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:42:00Z"}],"hostIP":"10.40.56.27","podIP":"10.40.56.27","startTime":"2020-11-04T12:42:00Z","containerStatuses":[{"name":"aws-node","state":{"running":{"startedAt":"2020-11-04T12:42:11Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5","imageID":"docker-pullable://602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni@sha256:a6d23b9fb3d4ba549321e32a28c42d8e79da203897072e93874472ab9e80b768","containerID":"docker://6558951b77e098fa30a31c8c9b0eee11a1ce75fee84709e6e25c5d4e29fd790f"}],"qosClass":"Burstable"}},{"metadata":{"name":"aws-node-qbww2","generateName":"aws-node-","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/aws-node-qbww2","uid":"55604ca9-1ea0-11eb-9aff-16da7cad7b07","resourceVersion":"45483070","creationTimestamp":"2020-11-04T13:19:14Z","labels":{"controller-revision-hash":"bfff688fb","k8s-app":"aws-node","pod-template-generation":"2"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"aws-node","uid":"602ab1b3-0aed-11ea-98f1-16c576d8665d","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"cni-bin-dir","hostPath":{"path":"/opt/cni/bin","type":""}},{"name":"cni-net-dir","hostPath":{"path":"/etc/cni/net.d","type":""}},{"name":"log-dir","hostPath":{"path":"/var/log","type":""}},{"name":"dockersock","hostPath":{"path":"/var/run/docker.sock","type":""}},{"name":"aws-node-token-wrj7h","secret":{"secretName":"aws-node-token-wrj7h","defaultMode":420}}],"containers":[{"name":"aws-node","image":"602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5","ports":[{"name":"metrics","hostPort":61678,"containerPort":61678,"protocol":"TCP"}],"env":[{"name":"CLUSTER_NAME","value":"example.com"},{"name":"AWS_VPC_K8S_CNI_LOGLEVEL","value":"DEBUG"},{"name":"MY_NODE_NAME","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"spec.nodeName"}}},{"name":"WATCH_NAMESPACE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}}],"resources":{"requests":{"cpu":"10m"}},"volumeMounts":[{"name":"cni-bin-dir","mountPath":"/host/opt/cni/bin"},{"name":"cni-net-dir","mountPath":"/host/etc/cni/net.d"},{"name":"log-dir","mountPath":"/host/var/log"},{"name":"dockersock","mountPath":"/var/run/docker.sock"},{"name":"aws-node-token-wrj7h","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always","securityContext":{"privileged":true,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"aws-node","serviceAccount":"aws-node","nodeName":"ip-10-40-59-224.ec2.internal","hostNetwork":true,"securityContext":{},"affinity":{"nodeAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":{"nodeSelectorTerms":[{"matchFields":[{"key":"metadata.name","operator":"In","values":["ip-10-40-59-224.ec2.internal"]}]}]}}},"schedulerName":"default-scheduler","tolerations":[{"operator":"Exists"},{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/disk-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/memory-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/pid-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/unschedulable","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/network-unavailable","operator":"Exists","effect":"NoSchedule"}],"priorityClassName":"system-node-critical","priority":2000001000,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:19:14Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:19:25Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:19:25Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:19:14Z"}],"hostIP":"10.40.59.224","podIP":"10.40.59.224","startTime":"2020-11-04T13:19:14Z","containerStatuses":[{"name":"aws-node","state":{"running":{"startedAt":"2020-11-04T13:19:25Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5","imageID":"docker-pullable://602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni@sha256:a6d23b9fb3d4ba549321e32a28c42d8e79da203897072e93874472ab9e80b768","containerID":"docker://f35cb57f5512eee47987e4c7ce98e40966f441157cdcb8872ac63937d8bf851a"}],"qosClass":"Burstable"}},{"metadata":{"name":"aws-node-rtx8f","generateName":"aws-node-","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/aws-node-rtx8f","uid":"b7a01f54-1e95-11eb-9aff-16da7cad7b07","resourceVersion":"45468513","creationTimestamp":"2020-11-04T12:03:14Z","labels":{"controller-revision-hash":"bfff688fb","k8s-app":"aws-node","pod-template-generation":"2"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"aws-node","uid":"602ab1b3-0aed-11ea-98f1-16c576d8665d","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"cni-bin-dir","hostPath":{"path":"/opt/cni/bin","type":""}},{"name":"cni-net-dir","hostPath":{"path":"/etc/cni/net.d","type":""}},{"name":"log-dir","hostPath":{"path":"/var/log","type":""}},{"name":"dockersock","hostPath":{"path":"/var/run/docker.sock","type":""}},{"name":"aws-node-token-wrj7h","secret":{"secretName":"aws-node-token-wrj7h","defaultMode":420}}],"containers":[{"name":"aws-node","image":"602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5","ports":[{"name":"metrics","hostPort":61678,"containerPort":61678,"protocol":"TCP"}],"env":[{"name":"CLUSTER_NAME","value":"example.com"},{"name":"AWS_VPC_K8S_CNI_LOGLEVEL","value":"DEBUG"},{"name":"MY_NODE_NAME","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"spec.nodeName"}}},{"name":"WATCH_NAMESPACE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}}],"resources":{"requests":{"cpu":"10m"}},"volumeMounts":[{"name":"cni-bin-dir","mountPath":"/host/opt/cni/bin"},{"name":"cni-net-dir","mountPath":"/host/etc/cni/net.d"},{"name":"log-dir","mountPath":"/host/var/log"},{"name":"dockersock","mountPath":"/var/run/docker.sock"},{"name":"aws-node-token-wrj7h","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always","securityContext":{"privileged":true,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"aws-node","serviceAccount":"aws-node","nodeName":"ip-10-40-57-245.ec2.internal","hostNetwork":true,"securityContext":{},"affinity":{"nodeAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":{"nodeSelectorTerms":[{"matchFields":[{"key":"metadata.name","operator":"In","values":["ip-10-40-57-245.ec2.internal"]}]}]}}},"schedulerName":"default-scheduler","tolerations":[{"operator":"Exists"},{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/disk-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/memory-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/pid-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/unschedulable","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/network-unavailable","operator":"Exists","effect":"NoSchedule"}],"priorityClassName":"system-node-critical","priority":2000001000,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:03:14Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:03:28Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:03:28Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:03:14Z"}],"hostIP":"10.40.57.245","podIP":"10.40.57.245","startTime":"2020-11-04T12:03:14Z","containerStatuses":[{"name":"aws-node","state":{"running":{"startedAt":"2020-11-04T12:03:27Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5","imageID":"docker-pullable://602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni@sha256:a6d23b9fb3d4ba549321e32a28c42d8e79da203897072e93874472ab9e80b768","containerID":"docker://ba3bf2c419c2e6f50c360d510ce9c0d8e3f84af02d81859a5ef1e9a3e0e9f63b"}],"qosClass":"Burstable"}},{"metadata":{"name":"aws-node-t66mv","generateName":"aws-node-","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/aws-node-t66mv","uid":"5080cb9f-1ea0-11eb-9aff-16da7cad7b07","resourceVersion":"45483045","creationTimestamp":"2020-11-04T13:19:05Z","labels":{"controller-revision-hash":"bfff688fb","k8s-app":"aws-node","pod-template-generation":"2"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"aws-node","uid":"602ab1b3-0aed-11ea-98f1-16c576d8665d","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"cni-bin-dir","hostPath":{"path":"/opt/cni/bin","type":""}},{"name":"cni-net-dir","hostPath":{"path":"/etc/cni/net.d","type":""}},{"name":"log-dir","hostPath":{"path":"/var/log","type":""}},{"name":"dockersock","hostPath":{"path":"/var/run/docker.sock","type":""}},{"name":"aws-node-token-wrj7h","secret":{"secretName":"aws-node-token-wrj7h","defaultMode":420}}],"containers":[{"name":"aws-node","image":"602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5","ports":[{"name":"metrics","hostPort":61678,"containerPort":61678,"protocol":"TCP"}],"env":[{"name":"CLUSTER_NAME","value":"example.com"},{"name":"AWS_VPC_K8S_CNI_LOGLEVEL","value":"DEBUG"},{"name":"MY_NODE_NAME","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"spec.nodeName"}}},{"name":"WATCH_NAMESPACE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}}],"resources":{"requests":{"cpu":"10m"}},"volumeMounts":[{"name":"cni-bin-dir","mountPath":"/host/opt/cni/bin"},{"name":"cni-net-dir","mountPath":"/host/etc/cni/net.d"},{"name":"log-dir","mountPath":"/host/var/log"},{"name":"dockersock","mountPath":"/var/run/docker.sock"},{"name":"aws-node-token-wrj7h","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always","securityContext":{"privileged":true,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"aws-node","serviceAccount":"aws-node","nodeName":"ip-10-40-41-169.ec2.internal","hostNetwork":true,"securityContext":{},"affinity":{"nodeAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":{"nodeSelectorTerms":[{"matchFields":[{"key":"metadata.name","operator":"In","values":["ip-10-40-41-169.ec2.internal"]}]}]}}},"schedulerName":"default-scheduler","tolerations":[{"operator":"Exists"},{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/disk-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/memory-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/pid-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/unschedulable","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/network-unavailable","operator":"Exists","effect":"NoSchedule"}],"priorityClassName":"system-node-critical","priority":2000001000,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:19:06Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:19:18Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:19:18Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:19:05Z"}],"hostIP":"10.40.41.169","podIP":"10.40.41.169","startTime":"2020-11-04T13:19:06Z","containerStatuses":[{"name":"aws-node","state":{"running":{"startedAt":"2020-11-04T13:19:17Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5","imageID":"docker-pullable://602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni@sha256:a6d23b9fb3d4ba549321e32a28c42d8e79da203897072e93874472ab9e80b768","containerID":"docker://96f1ad6c89ea09dc4d0941aea7d6d15b04b34cb408448f5309f1fe9932c67f68"}],"qosClass":"Burstable"}},{"metadata":{"name":"aws-node-vx64l","generateName":"aws-node-","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/aws-node-vx64l","uid":"3da73bd2-1e9c-11eb-9aff-16da7cad7b07","resourceVersion":"45477943","creationTimestamp":"2020-11-04T12:49:56Z","labels":{"controller-revision-hash":"bfff688fb","k8s-app":"aws-node","pod-template-generation":"2"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"aws-node","uid":"602ab1b3-0aed-11ea-98f1-16c576d8665d","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"cni-bin-dir","hostPath":{"path":"/opt/cni/bin","type":""}},{"name":"cni-net-dir","hostPath":{"path":"/etc/cni/net.d","type":""}},{"name":"log-dir","hostPath":{"path":"/var/log","type":""}},{"name":"dockersock","hostPath":{"path":"/var/run/docker.sock","type":""}},{"name":"aws-node-token-wrj7h","secret":{"secretName":"aws-node-token-wrj7h","defaultMode":420}}],"containers":[{"name":"aws-node","image":"602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5","ports":[{"name":"metrics","hostPort":61678,"containerPort":61678,"protocol":"TCP"}],"env":[{"name":"CLUSTER_NAME","value":"example.com"},{"name":"AWS_VPC_K8S_CNI_LOGLEVEL","value":"DEBUG"},{"name":"MY_NODE_NAME","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"spec.nodeName"}}},{"name":"WATCH_NAMESPACE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}}],"resources":{"requests":{"cpu":"10m"}},"volumeMounts":[{"name":"cni-bin-dir","mountPath":"/host/opt/cni/bin"},{"name":"cni-net-dir","mountPath":"/host/etc/cni/net.d"},{"name":"log-dir","mountPath":"/host/var/log"},{"name":"dockersock","mountPath":"/var/run/docker.sock"},{"name":"aws-node-token-wrj7h","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always","securityContext":{"privileged":true,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"aws-node","serviceAccount":"aws-node","nodeName":"ip-10-40-42-110.ec2.internal","hostNetwork":true,"securityContext":{},"affinity":{"nodeAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":{"nodeSelectorTerms":[{"matchFields":[{"key":"metadata.name","operator":"In","values":["ip-10-40-42-110.ec2.internal"]}]}]}}},"schedulerName":"default-scheduler","tolerations":[{"operator":"Exists"},{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/disk-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/memory-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/pid-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/unschedulable","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/network-unavailable","operator":"Exists","effect":"NoSchedule"}],"priorityClassName":"system-node-critical","priority":2000001000,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:49:56Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:50:09Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:50:09Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:49:56Z"}],"hostIP":"10.40.42.110","podIP":"10.40.42.110","startTime":"2020-11-04T12:49:56Z","containerStatuses":[{"name":"aws-node","state":{"running":{"startedAt":"2020-11-04T12:50:09Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5","imageID":"docker-pullable://602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni@sha256:a6d23b9fb3d4ba549321e32a28c42d8e79da203897072e93874472ab9e80b768","containerID":"docker://762cf07587bcd28f90e74274960ae13596d1092a7ca0fe2219d09823c43a6015"}],"qosClass":"Burstable"}},{"metadata":{"name":"aws-node-wxx8d","generateName":"aws-node-","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/aws-node-wxx8d","uid":"1db0a0ac-0e0c-11eb-9aff-16da7cad7b07","resourceVersion":"41346024","creationTimestamp":"2020-10-14T10:57:56Z","labels":{"controller-revision-hash":"bfff688fb","k8s-app":"aws-node","pod-template-generation":"2"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"aws-node","uid":"602ab1b3-0aed-11ea-98f1-16c576d8665d","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"cni-bin-dir","hostPath":{"path":"/opt/cni/bin","type":""}},{"name":"cni-net-dir","hostPath":{"path":"/etc/cni/net.d","type":""}},{"name":"log-dir","hostPath":{"path":"/var/log","type":""}},{"name":"dockersock","hostPath":{"path":"/var/run/docker.sock","type":""}},{"name":"aws-node-token-wrj7h","secret":{"secretName":"aws-node-token-wrj7h","defaultMode":420}}],"containers":[{"name":"aws-node","image":"602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5","ports":[{"name":"metrics","hostPort":61678,"containerPort":61678,"protocol":"TCP"}],"env":[{"name":"CLUSTER_NAME","value":"example.com"},{"name":"AWS_VPC_K8S_CNI_LOGLEVEL","value":"DEBUG"},{"name":"MY_NODE_NAME","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"spec.nodeName"}}},{"name":"WATCH_NAMESPACE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}}],"resources":{"requests":{"cpu":"10m"}},"volumeMounts":[{"name":"cni-bin-dir","mountPath":"/host/opt/cni/bin"},{"name":"cni-net-dir","mountPath":"/host/etc/cni/net.d"},{"name":"log-dir","mountPath":"/host/var/log"},{"name":"dockersock","mountPath":"/var/run/docker.sock"},{"name":"aws-node-token-wrj7h","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always","securityContext":{"privileged":true,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"aws-node","serviceAccount":"aws-node","nodeName":"ip-10-40-54-156.ec2.internal","hostNetwork":true,"securityContext":{},"affinity":{"nodeAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":{"nodeSelectorTerms":[{"matchFields":[{"key":"metadata.name","operator":"In","values":["ip-10-40-54-156.ec2.internal"]}]}]}}},"schedulerName":"default-scheduler","tolerations":[{"operator":"Exists"},{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/disk-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/memory-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/pid-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/unschedulable","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/network-unavailable","operator":"Exists","effect":"NoSchedule"}],"priorityClassName":"system-node-critical","priority":2000001000,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-14T10:57:56Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-14T10:58:08Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-14T10:58:08Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-14T10:57:56Z"}],"hostIP":"10.40.54.156","podIP":"10.40.54.156","startTime":"2020-10-14T10:57:56Z","containerStatuses":[{"name":"aws-node","state":{"running":{"startedAt":"2020-10-14T10:58:07Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5","imageID":"docker-pullable://602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni@sha256:a6d23b9fb3d4ba549321e32a28c42d8e79da203897072e93874472ab9e80b768","containerID":"docker://fe59c6a5d32f55f86d810efb450887cab8f725d199ed4115e1de768a7c5736eb"}],"qosClass":"Burstable"}},{"metadata":{"name":"aws-node-x7pls","generateName":"aws-node-","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/aws-node-x7pls","uid":"33c4ae36-1e96-11eb-9aff-16da7cad7b07","resourceVersion":"45469371","creationTimestamp":"2020-11-04T12:06:42Z","labels":{"controller-revision-hash":"bfff688fb","k8s-app":"aws-node","pod-template-generation":"2"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"aws-node","uid":"602ab1b3-0aed-11ea-98f1-16c576d8665d","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"cni-bin-dir","hostPath":{"path":"/opt/cni/bin","type":""}},{"name":"cni-net-dir","hostPath":{"path":"/etc/cni/net.d","type":""}},{"name":"log-dir","hostPath":{"path":"/var/log","type":""}},{"name":"dockersock","hostPath":{"path":"/var/run/docker.sock","type":""}},{"name":"aws-node-token-wrj7h","secret":{"secretName":"aws-node-token-wrj7h","defaultMode":420}}],"containers":[{"name":"aws-node","image":"602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5","ports":[{"name":"metrics","hostPort":61678,"containerPort":61678,"protocol":"TCP"}],"env":[{"name":"CLUSTER_NAME","value":"example.com"},{"name":"AWS_VPC_K8S_CNI_LOGLEVEL","value":"DEBUG"},{"name":"MY_NODE_NAME","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"spec.nodeName"}}},{"name":"WATCH_NAMESPACE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}}],"resources":{"requests":{"cpu":"10m"}},"volumeMounts":[{"name":"cni-bin-dir","mountPath":"/host/opt/cni/bin"},{"name":"cni-net-dir","mountPath":"/host/etc/cni/net.d"},{"name":"log-dir","mountPath":"/host/var/log"},{"name":"dockersock","mountPath":"/var/run/docker.sock"},{"name":"aws-node-token-wrj7h","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always","securityContext":{"privileged":true,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"aws-node","serviceAccount":"aws-node","nodeName":"ip-10-40-45-241.ec2.internal","hostNetwork":true,"securityContext":{},"affinity":{"nodeAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":{"nodeSelectorTerms":[{"matchFields":[{"key":"metadata.name","operator":"In","values":["ip-10-40-45-241.ec2.internal"]}]}]}}},"schedulerName":"default-scheduler","tolerations":[{"operator":"Exists"},{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/disk-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/memory-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/pid-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/unschedulable","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/network-unavailable","operator":"Exists","effect":"NoSchedule"}],"priorityClassName":"system-node-critical","priority":2000001000,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:06:42Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:06:52Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:06:52Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:06:42Z"}],"hostIP":"10.40.45.241","podIP":"10.40.45.241","startTime":"2020-11-04T12:06:42Z","containerStatuses":[{"name":"aws-node","state":{"running":{"startedAt":"2020-11-04T12:06:51Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5","imageID":"docker-pullable://602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni@sha256:a6d23b9fb3d4ba549321e32a28c42d8e79da203897072e93874472ab9e80b768","containerID":"docker://0ca0f706be72d5110e92acd215272c89969f12a510b67914010554368e6c30f9"}],"qosClass":"Burstable"}},{"metadata":{"name":"coredns-755858b644-c5fxh","generateName":"coredns-755858b644-","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/coredns-755858b644-c5fxh","uid":"d81d1cca-1e7d-11eb-9aff-16da7cad7b07","resourceVersion":"45439803","creationTimestamp":"2020-11-04T09:12:21Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"755858b644"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-755858b644","uid":"e3ab6591-0338-11eb-8924-162710c08987","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"config-volume","configMap":{"name":"coredns","items":[{"key":"Corefile","path":"Corefile"}],"defaultMode":420}},{"name":"coredns-token-zdth4","secret":{"secretName":"coredns-token-zdth4","defaultMode":420}}],"containers":[{"name":"coredns","image":"k8s.gcr.io/coredns:1.6.7","args":["-conf","/etc/coredns/Corefile"],"ports":[{"name":"dns","containerPort":53,"protocol":"UDP"},{"name":"dns-tcp","containerPort":53,"protocol":"TCP"},{"name":"metrics","containerPort":9153,"protocol":"TCP"}],"resources":{"limits":{"memory":"170Mi"},"requests":{"cpu":"100m","memory":"70Mi"}},"volumeMounts":[{"name":"config-volume","readOnly":true,"mountPath":"/etc/coredns"},{"name":"coredns-token-zdth4","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/health","port":8080,"scheme":"HTTP"},"initialDelaySeconds":60,"timeoutSeconds":5,"periodSeconds":10,"successThreshold":1,"failureThreshold":5},"readinessProbe":{"httpGet":{"path":"/health","port":8080,"scheme":"HTTP"},"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"capabilities":{"add":["NET_BIND_SERVICE"],"drop":["all"]},"readOnlyRootFilesystem":true,"allowPrivilegeEscalation":false,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"Default","nodeSelector":{"beta.kubernetes.io/os":"linux"},"serviceAccountName":"coredns","serviceAccount":"coredns","nodeName":"ip-10-40-51-35.ec2.internal","securityContext":{},"affinity":{"podAntiAffinity":{"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":1,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"k8s-app","operator":"In","values":["kube-dns"]}]},"topologyKey":"kubernetes.io/hostname"}}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"CriticalAddonsOnly","operator":"Exists"},{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priorityClassName":"system-cluster-critical","priority":2000000000,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T09:12:21Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T09:12:29Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T09:12:29Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T09:12:21Z"}],"hostIP":"10.40.51.35","podIP":"10.40.43.120","startTime":"2020-11-04T09:12:21Z","containerStatuses":[{"name":"coredns","state":{"running":{"startedAt":"2020-11-04T09:12:22Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"k8s.gcr.io/coredns:1.6.7","imageID":"docker-pullable://k8s.gcr.io/coredns@sha256:2c8d61c46f484d881db43b34d13ca47a269336e576c81cf007ca740fa9ec0800","containerID":"docker://8cf10d97be5baae998ef2a76ca7df6909f530bdb50859c435b5156b5460613a1"}],"qosClass":"Burstable"}},{"metadata":{"name":"coredns-755858b644-qzjwz","generateName":"coredns-755858b644-","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/coredns-755858b644-qzjwz","uid":"0106151f-1e7d-11eb-9aff-16da7cad7b07","resourceVersion":"45439117","creationTimestamp":"2020-11-04T09:06:20Z","labels":{"k8s-app":"kube-dns","pod-template-hash":"755858b644"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-755858b644","uid":"e3ab6591-0338-11eb-8924-162710c08987","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"config-volume","configMap":{"name":"coredns","items":[{"key":"Corefile","path":"Corefile"}],"defaultMode":420}},{"name":"coredns-token-zdth4","secret":{"secretName":"coredns-token-zdth4","defaultMode":420}}],"containers":[{"name":"coredns","image":"k8s.gcr.io/coredns:1.6.7","args":["-conf","/etc/coredns/Corefile"],"ports":[{"name":"dns","containerPort":53,"protocol":"UDP"},{"name":"dns-tcp","containerPort":53,"protocol":"TCP"},{"name":"metrics","containerPort":9153,"protocol":"TCP"}],"resources":{"limits":{"memory":"170Mi"},"requests":{"cpu":"100m","memory":"70Mi"}},"volumeMounts":[{"name":"config-volume","readOnly":true,"mountPath":"/etc/coredns"},{"name":"coredns-token-zdth4","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/health","port":8080,"scheme":"HTTP"},"initialDelaySeconds":60,"timeoutSeconds":5,"periodSeconds":10,"successThreshold":1,"failureThreshold":5},"readinessProbe":{"httpGet":{"path":"/health","port":8080,"scheme":"HTTP"},"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"capabilities":{"add":["NET_BIND_SERVICE"],"drop":["all"]},"readOnlyRootFilesystem":true,"allowPrivilegeEscalation":false,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"Default","nodeSelector":{"beta.kubernetes.io/os":"linux"},"serviceAccountName":"coredns","serviceAccount":"coredns","nodeName":"ip-10-40-51-35.ec2.internal","securityContext":{},"affinity":{"podAntiAffinity":{"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":1,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"k8s-app","operator":"In","values":["kube-dns"]}]},"topologyKey":"kubernetes.io/hostname"}}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"CriticalAddonsOnly","operator":"Exists"},{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priorityClassName":"system-cluster-critical","priority":2000000000,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T09:06:20Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T09:06:27Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T09:06:27Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T09:06:20Z"}],"hostIP":"10.40.51.35","podIP":"10.40.40.231","startTime":"2020-11-04T09:06:20Z","containerStatuses":[{"name":"coredns","state":{"running":{"startedAt":"2020-11-04T09:06:22Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"k8s.gcr.io/coredns:1.6.7","imageID":"docker-pullable://k8s.gcr.io/coredns@sha256:2c8d61c46f484d881db43b34d13ca47a269336e576c81cf007ca740fa9ec0800","containerID":"docker://61444edc92ee127678dd457a81e4d34d60ddcd0301208c996b95e14acba12dfd"}],"qosClass":"Burstable"}},{"metadata":{"name":"coredns-autoscaler-68c6f4869b-f6kgg","generateName":"coredns-autoscaler-68c6f4869b-","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/coredns-autoscaler-68c6f4869b-f6kgg","uid":"e667ac63-1e7d-11eb-9aff-16da7cad7b07","resourceVersion":"45439864","creationTimestamp":"2020-11-04T09:12:45Z","labels":{"k8s-app":"coredns-autoscaler","pod-template-hash":"68c6f4869b"},"annotations":{"scheduler.alpha.kubernetes.io/critical-pod":""},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"coredns-autoscaler-68c6f4869b","uid":"e3a5f92b-0338-11eb-8924-162710c08987","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"coredns-autoscaler-token-68n4v","secret":{"secretName":"coredns-autoscaler-token-68n4v","defaultMode":420}}],"containers":[{"name":"autoscaler","image":"k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1","command":["/cluster-proportional-autoscaler","--namespace=kube-system","--configmap=coredns-autoscaler","--target=Deployment/coredns","--default-params={\"linear\":{\"coresPerReplica\":256,\"nodesPerReplica\":16,\"preventSinglePointFailure\":true}}","--logtostderr=true","--v=2"],"resources":{"requests":{"cpu":"20m","memory":"10Mi"}},"volumeMounts":[{"name":"coredns-autoscaler-token-68n4v","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"coredns-autoscaler","serviceAccount":"coredns-autoscaler","nodeName":"ip-10-40-51-35.ec2.internal","securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"CriticalAddonsOnly","operator":"Exists"},{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priorityClassName":"system-cluster-critical","priority":2000000000,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T09:12:45Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T09:12:47Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T09:12:47Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T09:12:45Z"}],"hostIP":"10.40.51.35","podIP":"10.40.58.184","startTime":"2020-11-04T09:12:45Z","containerStatuses":[{"name":"autoscaler","state":{"running":{"startedAt":"2020-11-04T09:12:47Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1","imageID":"docker-pullable://k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f","containerID":"docker://5912eaf227149a5473be8930900ec1b60ede1df1dedc9533dfe685bd196d60ff"}],"qosClass":"Burstable"}},{"metadata":{"name":"dns-controller-5c5d58649f-fzpjj","generateName":"dns-controller-5c5d58649f-","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/dns-controller-5c5d58649f-fzpjj","uid":"8003f381-1d35-11eb-9aff-16da7cad7b07","resourceVersion":"45050195","creationTimestamp":"2020-11-02T18:01:58Z","labels":{"k8s-addon":"dns-controller.addons.k8s.io","k8s-app":"dns-controller","pod-template-hash":"5c5d58649f","version":"v1.18.2"},"annotations":{"scheduler.alpha.kubernetes.io/critical-pod":""},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"dns-controller-5c5d58649f","uid":"7fffd9c8-1d35-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"dns-controller-token-thb6w","secret":{"secretName":"dns-controller-token-thb6w","defaultMode":420}}],"containers":[{"name":"dns-controller","image":"kope/dns-controller:1.18.2","command":["/usr/bin/dns-controller","--watch-ingress=false","--dns=aws-route53","--zone=example.com","--zone=*/*","-v=2"],"env":[{"name":"KUBERNETES_SERVICE_HOST","value":"127.0.0.1"}],"resources":{"requests":{"cpu":"50m","memory":"50Mi"}},"volumeMounts":[{"name":"dns-controller-token-thb6w","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"runAsNonRoot":true,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"Default","nodeSelector":{"node-role.kubernetes.io/master":""},"serviceAccountName":"dns-controller","serviceAccount":"dns-controller","nodeName":"ip-10-40-54-156.ec2.internal","hostNetwork":true,"securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"operator":"Exists"}],"priorityClassName":"system-cluster-critical","priority":2000000000,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-02T18:01:58Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-02T18:02:00Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-02T18:02:00Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-02T18:01:58Z"}],"hostIP":"10.40.54.156","podIP":"10.40.54.156","startTime":"2020-11-02T18:01:58Z","containerStatuses":[{"name":"dns-controller","state":{"running":{"startedAt":"2020-11-02T18:02:00Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"kope/dns-controller:1.18.2","imageID":"docker-pullable://kope/dns-controller@sha256:ad0f2562cef00e77bb5c0ff255b682e25b14d24723e1e37057d349e39c7ff28d","containerID":"docker://02e7411dc3d830f7f7c1500bd6431e530fd305375db0aae307c484f169a88986"}],"qosClass":"Burstable"}},{"metadata":{"name":"etcd-manager-events-ip-10-40-54-156.ec2.internal","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/etcd-manager-events-ip-10-40-54-156.ec2.internal","uid":"195648c2-0e0c-11eb-9aff-16da7cad7b07","resourceVersion":"41346008","creationTimestamp":"2020-10-14T10:57:49Z","labels":{"k8s-app":"etcd-manager-events"},"annotations":{"kubernetes.io/config.hash":"f3e54575606e5131006dd5cc682bd429","kubernetes.io/config.mirror":"f3e54575606e5131006dd5cc682bd429","kubernetes.io/config.seen":"2020-10-14T10:51:28.195753259Z","kubernetes.io/config.source":"file","scheduler.alpha.kubernetes.io/critical-pod":""}},"spec":{"volumes":[{"name":"rootfs","hostPath":{"path":"/","type":"Directory"}},{"name":"pki","hostPath":{"path":"/etc/kubernetes/pki/etcd-manager-events","type":"DirectoryOrCreate"}},{"name":"hosts","hostPath":{"path":"/etc/hosts","type":"File"}},{"name":"varlogetcd","hostPath":{"path":"/var/log/etcd-events.log","type":"FileOrCreate"}}],"containers":[{"name":"etcd-manager","image":"kopeio/etcd-manager:3.0.20200531","command":["/bin/sh","-c","mkfifo /tmp/pipe; (tee -a /var/log/etcd.log \u003c /tmp/pipe \u0026 ) ; exec /etcd-manager --backup-store=s3://example-dev-state/kops/example.com/backups/etcd/events --client-urls=https://__name__:4002 --cluster-name=etcd-events --containerized=true --dns-suffix=.internal.example.com --etcd-insecure=false --grpc-port=3997 --insecure=false --peer-urls=https://__name__:2381 --quarantine-client-urls=https://__name__:3995 --v=6 --volume-name-tag=k8s.io/etcd/events --volume-provider=aws --volume-tag=k8s.io/etcd/events --volume-tag=k8s.io/role/master=1 --volume-tag=kubernetes.io/cluster/example.com=owned \u003e /tmp/pipe 2\u003e\u00261"],"resources":{"requests":{"cpu":"200m","memory":"100Mi"}},"volumeMounts":[{"name":"rootfs","mountPath":"/rootfs"},{"name":"pki","mountPath":"/etc/kubernetes/pki/etcd-manager"},{"name":"hosts","mountPath":"/etc/hosts"},{"name":"varlogetcd","mountPath":"/var/log/etcd.log"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"privileged":true,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","nodeName":"ip-10-40-54-156.ec2.internal","hostNetwork":true,"hostPID":true,"securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"CriticalAddonsOnly","operator":"Exists"},{"operator":"Exists","effect":"NoExecute"}],"priorityClassName":"system-cluster-critical","priority":2000000000,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-14T10:51:28Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-14T10:51:50Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-14T10:51:50Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-14T10:51:28Z"}],"hostIP":"10.40.54.156","podIP":"10.40.54.156","startTime":"2020-10-14T10:51:28Z","containerStatuses":[{"name":"etcd-manager","state":{"running":{"startedAt":"2020-10-14T10:51:50Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"kopeio/etcd-manager:3.0.20200531","imageID":"docker-pullable://kopeio/etcd-manager@sha256:08d90e866611142896c18c325d6b058d0aa0993f5b255807c17610a75cbe7392","containerID":"docker://cd3569b1f466464daaef0f4c983209bb72de590df34a97ea4e89935fa5eb1d85"}],"qosClass":"Burstable"}},{"metadata":{"name":"etcd-manager-main-ip-10-40-54-156.ec2.internal","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/etcd-manager-main-ip-10-40-54-156.ec2.internal","uid":"ff1cb3e8-0e0b-11eb-9aff-16da7cad7b07","resourceVersion":"41345898","creationTimestamp":"2020-10-14T10:57:05Z","labels":{"k8s-app":"etcd-manager-main"},"annotations":{"kubernetes.io/config.hash":"cac9cb5465336e6d4685261bc133f43c","kubernetes.io/config.mirror":"cac9cb5465336e6d4685261bc133f43c","kubernetes.io/config.seen":"2020-10-14T10:51:28.19575901Z","kubernetes.io/config.source":"file","scheduler.alpha.kubernetes.io/critical-pod":""}},"spec":{"volumes":[{"name":"rootfs","hostPath":{"path":"/","type":"Directory"}},{"name":"pki","hostPath":{"path":"/etc/kubernetes/pki/etcd-manager-main","type":"DirectoryOrCreate"}},{"name":"hosts","hostPath":{"path":"/etc/hosts","type":"File"}},{"name":"varlogetcd","hostPath":{"path":"/var/log/etcd.log","type":"FileOrCreate"}}],"containers":[{"name":"etcd-manager","image":"kopeio/etcd-manager:3.0.20200531","command":["/bin/sh","-c","mkfifo /tmp/pipe; (tee -a /var/log/etcd.log \u003c /tmp/pipe \u0026 ) ; exec /etcd-manager --backup-store=s3://example-dev-state/kops/example.com/backups/etcd/main --client-urls=https://__name__:4001 --cluster-name=etcd --containerized=true --dns-suffix=.internal.example.com --etcd-insecure=false --grpc-port=3996 --insecure=false --peer-urls=https://__name__:2380 --quarantine-client-urls=https://__name__:3994 --v=6 --volume-name-tag=k8s.io/etcd/main --volume-provider=aws --volume-tag=k8s.io/etcd/main --volume-tag=k8s.io/role/master=1 --volume-tag=kubernetes.io/cluster/example.com=owned \u003e /tmp/pipe 2\u003e\u00261"],"resources":{"requests":{"cpu":"200m","memory":"100Mi"}},"volumeMounts":[{"name":"rootfs","mountPath":"/rootfs"},{"name":"pki","mountPath":"/etc/kubernetes/pki/etcd-manager"},{"name":"hosts","mountPath":"/etc/hosts"},{"name":"varlogetcd","mountPath":"/var/log/etcd.log"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"privileged":true,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","nodeName":"ip-10-40-54-156.ec2.internal","hostNetwork":true,"hostPID":true,"securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"CriticalAddonsOnly","operator":"Exists"},{"operator":"Exists","effect":"NoExecute"}],"priorityClassName":"system-cluster-critical","priority":2000000000,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-14T10:51:28Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-14T10:51:53Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-14T10:51:53Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-14T10:51:28Z"}],"hostIP":"10.40.54.156","podIP":"10.40.54.156","startTime":"2020-10-14T10:51:28Z","containerStatuses":[{"name":"etcd-manager","state":{"running":{"startedAt":"2020-10-14T10:51:52Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"kopeio/etcd-manager:3.0.20200531","imageID":"docker-pullable://kopeio/etcd-manager@sha256:08d90e866611142896c18c325d6b058d0aa0993f5b255807c17610a75cbe7392","containerID":"docker://fcc73e78edc0ba1bbf9d30ffdf846b16ef3194f113caf3e141c8bb000d64a6fa"}],"qosClass":"Burstable"}},{"metadata":{"name":"kube-apiserver-ip-10-40-54-156.ec2.internal","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/kube-apiserver-ip-10-40-54-156.ec2.internal","uid":"1c5122ff-0e0c-11eb-9aff-16da7cad7b07","resourceVersion":"41346009","creationTimestamp":"2020-10-14T10:57:54Z","labels":{"k8s-app":"kube-apiserver"},"annotations":{"dns.alpha.kubernetes.io/internal":"api.internal.example.com","kubernetes.io/config.hash":"945f3a0c37fcb238728f15bd29404387","kubernetes.io/config.mirror":"945f3a0c37fcb238728f15bd29404387","kubernetes.io/config.seen":"2020-10-14T10:51:28.19576153Z","kubernetes.io/config.source":"file","scheduler.alpha.kubernetes.io/critical-pod":""}},"spec":{"volumes":[{"name":"logfile","hostPath":{"path":"/var/log/kube-apiserver.log","type":""}},{"name":"etcssl","hostPath":{"path":"/etc/ssl","type":""}},{"name":"etcpkitls","hostPath":{"path":"/etc/pki/tls","type":""}},{"name":"etcpkica-trust","hostPath":{"path":"/etc/pki/ca-trust","type":""}},{"name":"usrsharessl","hostPath":{"path":"/usr/share/ssl","type":""}},{"name":"usrssl","hostPath":{"path":"/usr/ssl","type":""}},{"name":"usrlibssl","hostPath":{"path":"/usr/lib/ssl","type":""}},{"name":"usrlocalopenssl","hostPath":{"path":"/usr/local/openssl","type":""}},{"name":"varssl","hostPath":{"path":"/var/ssl","type":""}},{"name":"etcopenssl","hostPath":{"path":"/etc/openssl","type":""}},{"name":"pki","hostPath":{"path":"/etc/kubernetes/pki/kube-apiserver","type":"DirectoryOrCreate"}},{"name":"srvkube","hostPath":{"path":"/srv/kubernetes","type":""}},{"name":"srvsshproxy","hostPath":{"path":"/srv/sshproxy","type":""}},{"name":"auditlogpathdir","hostPath":{"path":"/var/log","type":""}},{"name":"authn-config","hostPath":{"path":"/etc/kubernetes/authn.config","type":""}}],"containers":[{"name":"kube-apiserver","image":"k8s.gcr.io/kube-apiserver:v1.14.2","command":["/bin/sh","-c","mkfifo /tmp/pipe; (tee -a /var/log/kube-apiserver.log \u003c /tmp/pipe \u0026 ) ; exec /usr/local/bin/kube-apiserver --allow-privileged=true --anonymous-auth=false --apiserver-count=1 --audit-log-maxage=10 --audit-log-maxbackup=1 --audit-log-maxsize=100 --audit-log-path=/var/log/kube-apiserver-audit.log --audit-policy-file=/srv/kubernetes/assets/audit-policy --authentication-token-webhook-config-file=/etc/kubernetes/authn.config --authorization-mode=RBAC --basic-auth-file=/srv/kubernetes/basic_auth.csv --bind-address=0.0.0.0 --client-ca-file=/srv/kubernetes/ca.crt --cloud-provider=aws --enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,PersistentVolumeLabel,DefaultStorageClass,DefaultTolerationSeconds,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,NodeRestriction,ResourceQuota --etcd-cafile=/etc/kubernetes/pki/kube-apiserver/etcd-ca.crt --etcd-certfile=/etc/kubernetes/pki/kube-apiserver/etcd-client.crt --etcd-keyfile=/etc/kubernetes/pki/kube-apiserver/etcd-client.key --etcd-servers-overrides=/events#https://127.0.0.1:4002 --etcd-servers=https://127.0.0.1:4001 --insecure-bind-address=127.0.0.1 --insecure-port=8080 --kubelet-client-certificate=/srv/kubernetes/kubelet-api.pem --kubelet-client-key=/srv/kubernetes/kubelet-api-key.pem --kubelet-preferred-address-types=InternalIP,Hostname,ExternalIP --proxy-client-cert-file=/srv/kubernetes/apiserver-aggregator.cert --proxy-client-key-file=/srv/kubernetes/apiserver-aggregator.key --requestheader-allowed-names=aggregator --requestheader-client-ca-file=/srv/kubernetes/apiserver-aggregator-ca.cert --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=443 --service-cluster-ip-range=100.64.0.0/13 --storage-backend=etcd3 --tls-cert-file=/srv/kubernetes/server.cert --tls-private-key-file=/srv/kubernetes/server.key --token-auth-file=/srv/kubernetes/known_tokens.csv --v=2 \u003e /tmp/pipe 2\u003e\u00261"],"ports":[{"name":"https","hostPort":443,"containerPort":443,"protocol":"TCP"},{"name":"local","hostPort":8080,"containerPort":8080,"protocol":"TCP"}],"resources":{"requests":{"cpu":"150m"}},"volumeMounts":[{"name":"logfile","mountPath":"/var/log/kube-apiserver.log"},{"name":"etcssl","readOnly":true,"mountPath":"/etc/ssl"},{"name":"etcpkitls","readOnly":true,"mountPath":"/etc/pki/tls"},{"name":"etcpkica-trust","readOnly":true,"mountPath":"/etc/pki/ca-trust"},{"name":"usrsharessl","readOnly":true,"mountPath":"/usr/share/ssl"},{"name":"usrssl","readOnly":true,"mountPath":"/usr/ssl"},{"name":"usrlibssl","readOnly":true,"mountPath":"/usr/lib/ssl"},{"name":"usrlocalopenssl","readOnly":true,"mountPath":"/usr/local/openssl"},{"name":"varssl","readOnly":true,"mountPath":"/var/ssl"},{"name":"etcopenssl","readOnly":true,"mountPath":"/etc/openssl"},{"name":"pki","mountPath":"/etc/kubernetes/pki/kube-apiserver"},{"name":"srvkube","readOnly":true,"mountPath":"/srv/kubernetes"},{"name":"srvsshproxy","readOnly":true,"mountPath":"/srv/sshproxy"},{"name":"auditlogpathdir","mountPath":"/var/log"},{"name":"authn-config","readOnly":true,"mountPath":"/etc/kubernetes/authn.config"}],"livenessProbe":{"httpGet":{"path":"/healthz","port":8080,"host":"127.0.0.1","scheme":"HTTP"},"initialDelaySeconds":45,"timeoutSeconds":15,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","nodeName":"ip-10-40-54-156.ec2.internal","hostNetwork":true,"securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"CriticalAddonsOnly","operator":"Exists"},{"operator":"Exists","effect":"NoExecute"}],"priorityClassName":"system-cluster-critical","priority":2000000000,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-14T10:51:28Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-14T10:56:46Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-14T10:56:46Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-14T10:51:28Z"}],"hostIP":"10.40.54.156","podIP":"10.40.54.156","startTime":"2020-10-14T10:51:28Z","containerStatuses":[{"name":"kube-apiserver","state":{"running":{"startedAt":"2020-10-14T10:56:46Z"}},"lastState":{"terminated":{"exitCode":255,"reason":"Error","startedAt":"2020-10-14T10:55:01Z","finishedAt":"2020-10-14T10:55:22Z","containerID":"docker://09df71eeca8fafc2e3bb1b02e6cdf576ec6fe50677e8caaaefc68632072a724e"}},"ready":true,"restartCount":5,"image":"k8s.gcr.io/kube-apiserver:v1.14.2","imageID":"docker-pullable://k8s.gcr.io/kube-apiserver@sha256:223577e889dfb1a6e85faa6e3993308ead0b48b2a9c9d22c8fcd84b03d8a3af0","containerID":"docker://aa6313329c74b6f17d508b0d655c57202e53dbb1ecd9296fde987d83984ebffc"}],"qosClass":"Burstable"}},{"metadata":{"name":"kube-controller-manager-ip-10-40-54-156.ec2.internal","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/kube-controller-manager-ip-10-40-54-156.ec2.internal","uid":"283d461e-0e0c-11eb-9aff-16da7cad7b07","resourceVersion":"41346045","creationTimestamp":"2020-10-14T10:58:14Z","labels":{"k8s-app":"kube-controller-manager"},"annotations":{"kubernetes.io/config.hash":"585ab3c55c4e807b8ee125c713ff961f","kubernetes.io/config.mirror":"585ab3c55c4e807b8ee125c713ff961f","kubernetes.io/config.seen":"2020-10-14T10:51:28.19576394Z","kubernetes.io/config.source":"file","scheduler.alpha.kubernetes.io/critical-pod":""}},"spec":{"volumes":[{"name":"logfile","hostPath":{"path":"/var/log/kube-controller-manager.log","type":""}},{"name":"etcssl","hostPath":{"path":"/etc/ssl","type":""}},{"name":"etcpkitls","hostPath":{"path":"/etc/pki/tls","type":""}},{"name":"etcpkica-trust","hostPath":{"path":"/etc/pki/ca-trust","type":""}},{"name":"usrsharessl","hostPath":{"path":"/usr/share/ssl","type":""}},{"name":"usrssl","hostPath":{"path":"/usr/ssl","type":""}},{"name":"usrlibssl","hostPath":{"path":"/usr/lib/ssl","type":""}},{"name":"usrlocalopenssl","hostPath":{"path":"/usr/local/openssl","type":""}},{"name":"varssl","hostPath":{"path":"/var/ssl","type":""}},{"name":"etcopenssl","hostPath":{"path":"/etc/openssl","type":""}},{"name":"srvkube","hostPath":{"path":"/srv/kubernetes","type":""}},{"name":"varlibkcm","hostPath":{"path":"/var/lib/kube-controller-manager","type":""}},{"name":"volplugins","hostPath":{"path":"/usr/libexec/kubernetes/kubelet-plugins/volume/exec/","type":""}}],"containers":[{"name":"kube-controller-manager","image":"k8s.gcr.io/kube-controller-manager:v1.14.2","command":["/bin/sh","-c","mkfifo /tmp/pipe; (tee -a /var/log/kube-controller-manager.log \u003c /tmp/pipe \u0026 ) ; exec /usr/local/bin/kube-controller-manager --allocate-node-cidrs=true --attach-detach-reconcile-sync-period=1m0s --cloud-provider=aws --cluster-cidr=100.96.0.0/11 --cluster-name=example.com --cluster-signing-cert-file=/srv/kubernetes/ca.crt --cluster-signing-key-file=/srv/kubernetes/ca.key --configure-cloud-routes=false --flex-volume-plugin-dir=/usr/libexec/kubernetes/kubelet-plugins/volume/exec/ --kubeconfig=/var/lib/kube-controller-manager/kubeconfig --leader-elect=true --root-ca-file=/srv/kubernetes/ca.crt --service-account-private-key-file=/srv/kubernetes/server.key --use-service-account-credentials=true --v=2 \u003e /tmp/pipe 2\u003e\u00261"],"resources":{"requests":{"cpu":"100m"}},"volumeMounts":[{"name":"logfile","mountPath":"/var/log/kube-controller-manager.log"},{"name":"etcssl","readOnly":true,"mountPath":"/etc/ssl"},{"name":"etcpkitls","readOnly":true,"mountPath":"/etc/pki/tls"},{"name":"etcpkica-trust","readOnly":true,"mountPath":"/etc/pki/ca-trust"},{"name":"usrsharessl","readOnly":true,"mountPath":"/usr/share/ssl"},{"name":"usrssl","readOnly":true,"mountPath":"/usr/ssl"},{"name":"usrlibssl","readOnly":true,"mountPath":"/usr/lib/ssl"},{"name":"usrlocalopenssl","readOnly":true,"mountPath":"/usr/local/openssl"},{"name":"varssl","readOnly":true,"mountPath":"/var/ssl"},{"name":"etcopenssl","readOnly":true,"mountPath":"/etc/openssl"},{"name":"srvkube","readOnly":true,"mountPath":"/srv/kubernetes"},{"name":"varlibkcm","readOnly":true,"mountPath":"/var/lib/kube-controller-manager"},{"name":"volplugins","mountPath":"/usr/libexec/kubernetes/kubelet-plugins/volume/exec/"}],"livenessProbe":{"httpGet":{"path":"/healthz","port":10252,"host":"127.0.0.1","scheme":"HTTP"},"initialDelaySeconds":15,"timeoutSeconds":15,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","nodeName":"ip-10-40-54-156.ec2.internal","hostNetwork":true,"securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"CriticalAddonsOnly","operator":"Exists"},{"operator":"Exists","effect":"NoExecute"}],"priorityClassName":"system-cluster-critical","priority":2000000000,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-14T10:51:28Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-14T10:51:50Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-14T10:51:50Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-14T10:51:28Z"}],"hostIP":"10.40.54.156","podIP":"10.40.54.156","startTime":"2020-10-14T10:51:28Z","containerStatuses":[{"name":"kube-controller-manager","state":{"running":{"startedAt":"2020-10-14T10:51:50Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"k8s.gcr.io/kube-controller-manager:v1.14.2","imageID":"docker-pullable://k8s.gcr.io/kube-controller-manager@sha256:51a382e90acd9d11d5571850312ad4b268db8b28b2868516dfda19a6933a095c","containerID":"docker://f936eea9815026effe7a03c920921650c30acec54c16df0ca8f12443c879221a"}],"qosClass":"Burstable"}},{"metadata":{"name":"kube-proxy-ip-10-40-41-169.ec2.internal","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/kube-proxy-ip-10-40-41-169.ec2.internal","uid":"50a7411c-1ea0-11eb-9aff-16da7cad7b07","resourceVersion":"45483047","creationTimestamp":"2020-11-04T13:19:06Z","labels":{"k8s-app":"kube-proxy","tier":"node"},"annotations":{"kubernetes.io/config.hash":"226022e7e464fa82af8122241510a105","kubernetes.io/config.mirror":"226022e7e464fa82af8122241510a105","kubernetes.io/config.seen":"2020-11-04T13:19:05.727676597Z","kubernetes.io/config.source":"file","scheduler.alpha.kubernetes.io/critical-pod":""}},"spec":{"volumes":[{"name":"logfile","hostPath":{"path":"/var/log/kube-proxy.log","type":""}},{"name":"kubeconfig","hostPath":{"path":"/var/lib/kube-proxy/kubeconfig","type":""}},{"name":"modules","hostPath":{"path":"/lib/modules","type":""}},{"name":"ssl-certs-hosts","hostPath":{"path":"/usr/share/ca-certificates","type":""}},{"name":"iptableslock","hostPath":{"path":"/run/xtables.lock","type":"FileOrCreate"}}],"containers":[{"name":"kube-proxy","image":"k8s.gcr.io/kube-proxy:v1.14.2","command":["/bin/sh","-c","mkfifo /tmp/pipe; (tee -a /var/log/kube-proxy.log \u003c /tmp/pipe \u0026 ) ; exec /usr/local/bin/kube-proxy --conntrack-max-per-core=131072 --hostname-override=ip-10-40-41-169.ec2.internal --kubeconfig=/var/lib/kube-proxy/kubeconfig --master=https://api.internal.example.com --oom-score-adj=-998 --resource-container=\"\" --v=2 \u003e /tmp/pipe 2\u003e\u00261"],"resources":{"requests":{"cpu":"100m"}},"volumeMounts":[{"name":"logfile","mountPath":"/var/log/kube-proxy.log"},{"name":"kubeconfig","readOnly":true,"mountPath":"/var/lib/kube-proxy/kubeconfig"},{"name":"modules","readOnly":true,"mountPath":"/lib/modules"},{"name":"ssl-certs-hosts","readOnly":true,"mountPath":"/etc/ssl/certs"},{"name":"iptableslock","mountPath":"/run/xtables.lock"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"privileged":true,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","nodeName":"ip-10-40-41-169.ec2.internal","hostNetwork":true,"securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"CriticalAddonsOnly","operator":"Exists"},{"operator":"Exists","effect":"NoExecute"}],"priorityClassName":"system-node-critical","priority":2000001000,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:19:06Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:19:18Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:19:18Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:19:06Z"}],"hostIP":"10.40.41.169","podIP":"10.40.41.169","startTime":"2020-11-04T13:19:06Z","containerStatuses":[{"name":"kube-proxy","state":{"running":{"startedAt":"2020-11-04T13:19:18Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"k8s.gcr.io/kube-proxy:v1.14.2","imageID":"docker-pullable://k8s.gcr.io/kube-proxy@sha256:c91687ff6145f7fcdc7d8b3da3c530a9a9b50f0734c7a945a0d9c18fc3790dbc","containerID":"docker://035cb8976d446dfc3a35397bc5491baa6810d1d952a2cf2267517001f8f17478"}],"qosClass":"Burstable"}},{"metadata":{"name":"kube-proxy-ip-10-40-42-110.ec2.internal","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/kube-proxy-ip-10-40-42-110.ec2.internal","uid":"3dca1b24-1e9c-11eb-9aff-16da7cad7b07","resourceVersion":"45477919","creationTimestamp":"2020-11-04T12:49:56Z","labels":{"k8s-app":"kube-proxy","tier":"node"},"annotations":{"kubernetes.io/config.hash":"50d157ef00199ef143687308feb864b1","kubernetes.io/config.mirror":"50d157ef00199ef143687308feb864b1","kubernetes.io/config.seen":"2020-11-04T12:49:56.083267071Z","kubernetes.io/config.source":"file","scheduler.alpha.kubernetes.io/critical-pod":""}},"spec":{"volumes":[{"name":"logfile","hostPath":{"path":"/var/log/kube-proxy.log","type":""}},{"name":"kubeconfig","hostPath":{"path":"/var/lib/kube-proxy/kubeconfig","type":""}},{"name":"modules","hostPath":{"path":"/lib/modules","type":""}},{"name":"ssl-certs-hosts","hostPath":{"path":"/usr/share/ca-certificates","type":""}},{"name":"iptableslock","hostPath":{"path":"/run/xtables.lock","type":"FileOrCreate"}}],"containers":[{"name":"kube-proxy","image":"k8s.gcr.io/kube-proxy:v1.14.2","command":["/bin/sh","-c","mkfifo /tmp/pipe; (tee -a /var/log/kube-proxy.log \u003c /tmp/pipe \u0026 ) ; exec /usr/local/bin/kube-proxy --conntrack-max-per-core=131072 --hostname-override=ip-10-40-42-110.ec2.internal --kubeconfig=/var/lib/kube-proxy/kubeconfig --master=https://api.internal.example.com --oom-score-adj=-998 --resource-container=\"\" --v=2 \u003e /tmp/pipe 2\u003e\u00261"],"resources":{"requests":{"cpu":"100m"}},"volumeMounts":[{"name":"logfile","mountPath":"/var/log/kube-proxy.log"},{"name":"kubeconfig","readOnly":true,"mountPath":"/var/lib/kube-proxy/kubeconfig"},{"name":"modules","readOnly":true,"mountPath":"/lib/modules"},{"name":"ssl-certs-hosts","readOnly":true,"mountPath":"/etc/ssl/certs"},{"name":"iptableslock","mountPath":"/run/xtables.lock"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"privileged":true,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","nodeName":"ip-10-40-42-110.ec2.internal","hostNetwork":true,"securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"CriticalAddonsOnly","operator":"Exists"},{"operator":"Exists","effect":"NoExecute"}],"priorityClassName":"system-node-critical","priority":2000001000,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:49:56Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:50:01Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:50:01Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:49:56Z"}],"hostIP":"10.40.42.110","podIP":"10.40.42.110","startTime":"2020-11-04T12:49:56Z","containerStatuses":[{"name":"kube-proxy","state":{"running":{"startedAt":"2020-11-04T12:50:00Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"k8s.gcr.io/kube-proxy:v1.14.2","imageID":"docker-pullable://k8s.gcr.io/kube-proxy@sha256:c91687ff6145f7fcdc7d8b3da3c530a9a9b50f0734c7a945a0d9c18fc3790dbc","containerID":"docker://90449afa4af75fd705659d84322f9622c1765d4de1bcd9d2c9e6f69589889150"}],"qosClass":"Burstable"}},{"metadata":{"name":"kube-proxy-ip-10-40-45-241.ec2.internal","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/kube-proxy-ip-10-40-45-241.ec2.internal","uid":"39aaa438-1e96-11eb-9aff-16da7cad7b07","resourceVersion":"45469408","creationTimestamp":"2020-11-04T12:06:52Z","labels":{"k8s-app":"kube-proxy","tier":"node"},"annotations":{"kubernetes.io/config.hash":"8ffb9a7b9b19976dc7725b3e259cfff2","kubernetes.io/config.mirror":"8ffb9a7b9b19976dc7725b3e259cfff2","kubernetes.io/config.seen":"2020-11-04T12:06:42.56549252Z","kubernetes.io/config.source":"file","scheduler.alpha.kubernetes.io/critical-pod":""}},"spec":{"volumes":[{"name":"logfile","hostPath":{"path":"/var/log/kube-proxy.log","type":""}},{"name":"kubeconfig","hostPath":{"path":"/var/lib/kube-proxy/kubeconfig","type":""}},{"name":"modules","hostPath":{"path":"/lib/modules","type":""}},{"name":"ssl-certs-hosts","hostPath":{"path":"/usr/share/ca-certificates","type":""}},{"name":"iptableslock","hostPath":{"path":"/run/xtables.lock","type":"FileOrCreate"}}],"containers":[{"name":"kube-proxy","image":"k8s.gcr.io/kube-proxy:v1.14.2","command":["/bin/sh","-c","mkfifo /tmp/pipe; (tee -a /var/log/kube-proxy.log \u003c /tmp/pipe \u0026 ) ; exec /usr/local/bin/kube-proxy --conntrack-max-per-core=131072 --hostname-override=ip-10-40-45-241.ec2.internal --kubeconfig=/var/lib/kube-proxy/kubeconfig --master=https://api.internal.example.com --oom-score-adj=-998 --resource-container=\"\" --v=2 \u003e /tmp/pipe 2\u003e\u00261"],"resources":{"requests":{"cpu":"100m"}},"volumeMounts":[{"name":"logfile","mountPath":"/var/log/kube-proxy.log"},{"name":"kubeconfig","readOnly":true,"mountPath":"/var/lib/kube-proxy/kubeconfig"},{"name":"modules","readOnly":true,"mountPath":"/lib/modules"},{"name":"ssl-certs-hosts","readOnly":true,"mountPath":"/etc/ssl/certs"},{"name":"iptableslock","mountPath":"/run/xtables.lock"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"privileged":true,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","nodeName":"ip-10-40-45-241.ec2.internal","hostNetwork":true,"securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"CriticalAddonsOnly","operator":"Exists"},{"operator":"Exists","effect":"NoExecute"}],"priorityClassName":"system-node-critical","priority":2000001000,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:06:42Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:06:52Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:06:52Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:06:42Z"}],"hostIP":"10.40.45.241","podIP":"10.40.45.241","startTime":"2020-11-04T12:06:42Z","containerStatuses":[{"name":"kube-proxy","state":{"running":{"startedAt":"2020-11-04T12:06:52Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"k8s.gcr.io/kube-proxy:v1.14.2","imageID":"docker-pullable://k8s.gcr.io/kube-proxy@sha256:c91687ff6145f7fcdc7d8b3da3c530a9a9b50f0734c7a945a0d9c18fc3790dbc","containerID":"docker://85bf7883cc73c53b3aabe0a65facbd64b5536dc92b84acde6b23b342c0a4d305"}],"qosClass":"Burstable"}},{"metadata":{"name":"kube-proxy-ip-10-40-51-35.ec2.internal","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/kube-proxy-ip-10-40-51-35.ec2.internal","uid":"1086d9fb-1dfc-11eb-9aff-16da7cad7b07","resourceVersion":"45293188","creationTimestamp":"2020-11-03T17:43:21Z","labels":{"k8s-app":"kube-proxy","tier":"node"},"annotations":{"kubernetes.io/config.hash":"fef51119213c603e333aed93af5c2c5c","kubernetes.io/config.mirror":"fef51119213c603e333aed93af5c2c5c","kubernetes.io/config.seen":"2020-11-03T17:43:20.63150433Z","kubernetes.io/config.source":"file","scheduler.alpha.kubernetes.io/critical-pod":""}},"spec":{"volumes":[{"name":"logfile","hostPath":{"path":"/var/log/kube-proxy.log","type":""}},{"name":"kubeconfig","hostPath":{"path":"/var/lib/kube-proxy/kubeconfig","type":""}},{"name":"modules","hostPath":{"path":"/lib/modules","type":""}},{"name":"ssl-certs-hosts","hostPath":{"path":"/usr/share/ca-certificates","type":""}},{"name":"iptableslock","hostPath":{"path":"/run/xtables.lock","type":"FileOrCreate"}}],"containers":[{"name":"kube-proxy","image":"k8s.gcr.io/kube-proxy:v1.14.2","command":["/bin/sh","-c","mkfifo /tmp/pipe; (tee -a /var/log/kube-proxy.log \u003c /tmp/pipe \u0026 ) ; exec /usr/local/bin/kube-proxy --conntrack-max-per-core=131072 --hostname-override=ip-10-40-51-35.ec2.internal --kubeconfig=/var/lib/kube-proxy/kubeconfig --master=https://api.internal.example.com --oom-score-adj=-998 --resource-container=\"\" --v=2 \u003e /tmp/pipe 2\u003e\u00261"],"resources":{"requests":{"cpu":"100m"}},"volumeMounts":[{"name":"logfile","mountPath":"/var/log/kube-proxy.log"},{"name":"kubeconfig","readOnly":true,"mountPath":"/var/lib/kube-proxy/kubeconfig"},{"name":"modules","readOnly":true,"mountPath":"/lib/modules"},{"name":"ssl-certs-hosts","readOnly":true,"mountPath":"/etc/ssl/certs"},{"name":"iptableslock","mountPath":"/run/xtables.lock"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"privileged":true,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","nodeName":"ip-10-40-51-35.ec2.internal","hostNetwork":true,"securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"CriticalAddonsOnly","operator":"Exists"},{"operator":"Exists","effect":"NoExecute"}],"priorityClassName":"system-node-critical","priority":2000001000,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-03T17:43:21Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-03T17:43:25Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-03T17:43:25Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-03T17:43:21Z"}],"hostIP":"10.40.51.35","podIP":"10.40.51.35","startTime":"2020-11-03T17:43:21Z","containerStatuses":[{"name":"kube-proxy","state":{"running":{"startedAt":"2020-11-03T17:43:24Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"k8s.gcr.io/kube-proxy:v1.14.2","imageID":"docker-pullable://k8s.gcr.io/kube-proxy@sha256:c91687ff6145f7fcdc7d8b3da3c530a9a9b50f0734c7a945a0d9c18fc3790dbc","containerID":"docker://f1ed67012b170046bcb39cbf0710c74d4abce023ed264af26cef591a95a67b47"}],"qosClass":"Burstable"}},{"metadata":{"name":"kube-proxy-ip-10-40-54-156.ec2.internal","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/kube-proxy-ip-10-40-54-156.ec2.internal","uid":"02171d01-0e0c-11eb-9aff-16da7cad7b07","resourceVersion":"41345914","creationTimestamp":"2020-10-14T10:57:10Z","labels":{"k8s-app":"kube-proxy","tier":"node"},"annotations":{"kubernetes.io/config.hash":"cff431d2dcd044da1d25412252dc15c9","kubernetes.io/config.mirror":"cff431d2dcd044da1d25412252dc15c9","kubernetes.io/config.seen":"2020-10-14T10:51:28.1957657Z","kubernetes.io/config.source":"file","scheduler.alpha.kubernetes.io/critical-pod":""}},"spec":{"volumes":[{"name":"logfile","hostPath":{"path":"/var/log/kube-proxy.log","type":""}},{"name":"kubeconfig","hostPath":{"path":"/var/lib/kube-proxy/kubeconfig","type":""}},{"name":"modules","hostPath":{"path":"/lib/modules","type":""}},{"name":"ssl-certs-hosts","hostPath":{"path":"/usr/share/ca-certificates","type":""}},{"name":"iptableslock","hostPath":{"path":"/run/xtables.lock","type":"FileOrCreate"}}],"containers":[{"name":"kube-proxy","image":"k8s.gcr.io/kube-proxy:v1.14.2","command":["/bin/sh","-c","mkfifo /tmp/pipe; (tee -a /var/log/kube-proxy.log \u003c /tmp/pipe \u0026 ) ; exec /usr/local/bin/kube-proxy --conntrack-max-per-core=131072 --hostname-override=ip-10-40-54-156.ec2.internal --kubeconfig=/var/lib/kube-proxy/kubeconfig --master=https://127.0.0.1 --oom-score-adj=-998 --resource-container=\"\" --v=2 \u003e /tmp/pipe 2\u003e\u00261"],"resources":{"requests":{"cpu":"100m"}},"volumeMounts":[{"name":"logfile","mountPath":"/var/log/kube-proxy.log"},{"name":"kubeconfig","readOnly":true,"mountPath":"/var/lib/kube-proxy/kubeconfig"},{"name":"modules","readOnly":true,"mountPath":"/lib/modules"},{"name":"ssl-certs-hosts","readOnly":true,"mountPath":"/etc/ssl/certs"},{"name":"iptableslock","mountPath":"/run/xtables.lock"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"privileged":true,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","nodeName":"ip-10-40-54-156.ec2.internal","hostNetwork":true,"securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"CriticalAddonsOnly","operator":"Exists"},{"operator":"Exists","effect":"NoExecute"}],"priorityClassName":"system-node-critical","priority":2000001000,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-14T10:51:28Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-14T10:51:53Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-14T10:51:53Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-14T10:51:28Z"}],"hostIP":"10.40.54.156","podIP":"10.40.54.156","startTime":"2020-10-14T10:51:28Z","containerStatuses":[{"name":"kube-proxy","state":{"running":{"startedAt":"2020-10-14T10:51:52Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"k8s.gcr.io/kube-proxy:v1.14.2","imageID":"docker-pullable://k8s.gcr.io/kube-proxy@sha256:c91687ff6145f7fcdc7d8b3da3c530a9a9b50f0734c7a945a0d9c18fc3790dbc","containerID":"docker://182e9e9081c7427434d89e2a5fc34a6c99beefe439d5c881e79a148d7d7bc19c"}],"qosClass":"Burstable"}},{"metadata":{"name":"kube-proxy-ip-10-40-55-41.ec2.internal","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/kube-proxy-ip-10-40-55-41.ec2.internal","uid":"b51bd7b1-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45477199","creationTimestamp":"2020-11-04T12:46:07Z","labels":{"k8s-app":"kube-proxy","tier":"node"},"annotations":{"kubernetes.io/config.hash":"77762be6c07d295dbe05160fe0e9e432","kubernetes.io/config.mirror":"77762be6c07d295dbe05160fe0e9e432","kubernetes.io/config.seen":"2020-11-04T12:46:06.534489167Z","kubernetes.io/config.source":"file","scheduler.alpha.kubernetes.io/critical-pod":""}},"spec":{"volumes":[{"name":"logfile","hostPath":{"path":"/var/log/kube-proxy.log","type":""}},{"name":"kubeconfig","hostPath":{"path":"/var/lib/kube-proxy/kubeconfig","type":""}},{"name":"modules","hostPath":{"path":"/lib/modules","type":""}},{"name":"ssl-certs-hosts","hostPath":{"path":"/usr/share/ca-certificates","type":""}},{"name":"iptableslock","hostPath":{"path":"/run/xtables.lock","type":"FileOrCreate"}}],"containers":[{"name":"kube-proxy","image":"k8s.gcr.io/kube-proxy:v1.14.2","command":["/bin/sh","-c","mkfifo /tmp/pipe; (tee -a /var/log/kube-proxy.log \u003c /tmp/pipe \u0026 ) ; exec /usr/local/bin/kube-proxy --conntrack-max-per-core=131072 --hostname-override=ip-10-40-55-41.ec2.internal --kubeconfig=/var/lib/kube-proxy/kubeconfig --master=https://api.internal.example.com --oom-score-adj=-998 --resource-container=\"\" --v=2 \u003e /tmp/pipe 2\u003e\u00261"],"resources":{"requests":{"cpu":"100m"}},"volumeMounts":[{"name":"logfile","mountPath":"/var/log/kube-proxy.log"},{"name":"kubeconfig","readOnly":true,"mountPath":"/var/lib/kube-proxy/kubeconfig"},{"name":"modules","readOnly":true,"mountPath":"/lib/modules"},{"name":"ssl-certs-hosts","readOnly":true,"mountPath":"/etc/ssl/certs"},{"name":"iptableslock","mountPath":"/run/xtables.lock"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"privileged":true,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","nodeName":"ip-10-40-55-41.ec2.internal","hostNetwork":true,"securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"CriticalAddonsOnly","operator":"Exists"},{"operator":"Exists","effect":"NoExecute"}],"priorityClassName":"system-node-critical","priority":2000001000,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:46:07Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:46:12Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:46:12Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:46:07Z"}],"hostIP":"10.40.55.41","podIP":"10.40.55.41","startTime":"2020-11-04T12:46:07Z","containerStatuses":[{"name":"kube-proxy","state":{"running":{"startedAt":"2020-11-04T12:46:11Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"k8s.gcr.io/kube-proxy:v1.14.2","imageID":"docker-pullable://k8s.gcr.io/kube-proxy@sha256:c91687ff6145f7fcdc7d8b3da3c530a9a9b50f0734c7a945a0d9c18fc3790dbc","containerID":"docker://29a1db8756fd9ef6095bb038dbf5d95ea271c8f98c1bdc917b97b6adc462147b"}],"qosClass":"Burstable"}},{"metadata":{"name":"kube-proxy-ip-10-40-56-27.ec2.internal","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/kube-proxy-ip-10-40-56-27.ec2.internal","uid":"21f0ab63-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45476290","creationTimestamp":"2020-11-04T12:42:00Z","labels":{"k8s-app":"kube-proxy","tier":"node"},"annotations":{"kubernetes.io/config.hash":"408295f4302c6a748085190f1d44270d","kubernetes.io/config.mirror":"408295f4302c6a748085190f1d44270d","kubernetes.io/config.seen":"2020-11-04T12:41:59.977858709Z","kubernetes.io/config.source":"file","scheduler.alpha.kubernetes.io/critical-pod":""}},"spec":{"volumes":[{"name":"logfile","hostPath":{"path":"/var/log/kube-proxy.log","type":""}},{"name":"kubeconfig","hostPath":{"path":"/var/lib/kube-proxy/kubeconfig","type":""}},{"name":"modules","hostPath":{"path":"/lib/modules","type":""}},{"name":"ssl-certs-hosts","hostPath":{"path":"/usr/share/ca-certificates","type":""}},{"name":"iptableslock","hostPath":{"path":"/run/xtables.lock","type":"FileOrCreate"}}],"containers":[{"name":"kube-proxy","image":"k8s.gcr.io/kube-proxy:v1.14.2","command":["/bin/sh","-c","mkfifo /tmp/pipe; (tee -a /var/log/kube-proxy.log \u003c /tmp/pipe \u0026 ) ; exec /usr/local/bin/kube-proxy --conntrack-max-per-core=131072 --hostname-override=ip-10-40-56-27.ec2.internal --kubeconfig=/var/lib/kube-proxy/kubeconfig --master=https://api.internal.example.com --oom-score-adj=-998 --resource-container=\"\" --v=2 \u003e /tmp/pipe 2\u003e\u00261"],"resources":{"requests":{"cpu":"100m"}},"volumeMounts":[{"name":"logfile","mountPath":"/var/log/kube-proxy.log"},{"name":"kubeconfig","readOnly":true,"mountPath":"/var/lib/kube-proxy/kubeconfig"},{"name":"modules","readOnly":true,"mountPath":"/lib/modules"},{"name":"ssl-certs-hosts","readOnly":true,"mountPath":"/etc/ssl/certs"},{"name":"iptableslock","mountPath":"/run/xtables.lock"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"privileged":true,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","nodeName":"ip-10-40-56-27.ec2.internal","hostNetwork":true,"securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"CriticalAddonsOnly","operator":"Exists"},{"operator":"Exists","effect":"NoExecute"}],"priorityClassName":"system-node-critical","priority":2000001000,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:42:00Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:42:12Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:42:12Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:42:00Z"}],"hostIP":"10.40.56.27","podIP":"10.40.56.27","startTime":"2020-11-04T12:42:00Z","containerStatuses":[{"name":"kube-proxy","state":{"running":{"startedAt":"2020-11-04T12:42:11Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"k8s.gcr.io/kube-proxy:v1.14.2","imageID":"docker-pullable://k8s.gcr.io/kube-proxy@sha256:c91687ff6145f7fcdc7d8b3da3c530a9a9b50f0734c7a945a0d9c18fc3790dbc","containerID":"docker://e89bb9fcfa7102d3b40a35cee45b991689a1328350c2118acba3ca896525c75d"}],"qosClass":"Burstable"}},{"metadata":{"name":"kube-proxy-ip-10-40-57-245.ec2.internal","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/kube-proxy-ip-10-40-57-245.ec2.internal","uid":"b7aaaadf-1e95-11eb-9aff-16da7cad7b07","resourceVersion":"45468432","creationTimestamp":"2020-11-04T12:03:14Z","labels":{"k8s-app":"kube-proxy","tier":"node"},"annotations":{"kubernetes.io/config.hash":"3d841796cdb0088607b46f371bdaa922","kubernetes.io/config.mirror":"3d841796cdb0088607b46f371bdaa922","kubernetes.io/config.seen":"2020-11-04T12:03:14.061525149Z","kubernetes.io/config.source":"file","scheduler.alpha.kubernetes.io/critical-pod":""}},"spec":{"volumes":[{"name":"logfile","hostPath":{"path":"/var/log/kube-proxy.log","type":""}},{"name":"kubeconfig","hostPath":{"path":"/var/lib/kube-proxy/kubeconfig","type":""}},{"name":"modules","hostPath":{"path":"/lib/modules","type":""}},{"name":"ssl-certs-hosts","hostPath":{"path":"/usr/share/ca-certificates","type":""}},{"name":"iptableslock","hostPath":{"path":"/run/xtables.lock","type":"FileOrCreate"}}],"containers":[{"name":"kube-proxy","image":"k8s.gcr.io/kube-proxy:v1.14.2","command":["/bin/sh","-c","mkfifo /tmp/pipe; (tee -a /var/log/kube-proxy.log \u003c /tmp/pipe \u0026 ) ; exec /usr/local/bin/kube-proxy --conntrack-max-per-core=131072 --hostname-override=ip-10-40-57-245.ec2.internal --kubeconfig=/var/lib/kube-proxy/kubeconfig --master=https://api.internal.example.com --oom-score-adj=-998 --resource-container=\"\" --v=2 \u003e /tmp/pipe 2\u003e\u00261"],"resources":{"requests":{"cpu":"100m"}},"volumeMounts":[{"name":"logfile","mountPath":"/var/log/kube-proxy.log"},{"name":"kubeconfig","readOnly":true,"mountPath":"/var/lib/kube-proxy/kubeconfig"},{"name":"modules","readOnly":true,"mountPath":"/lib/modules"},{"name":"ssl-certs-hosts","readOnly":true,"mountPath":"/etc/ssl/certs"},{"name":"iptableslock","mountPath":"/run/xtables.lock"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"privileged":true,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","nodeName":"ip-10-40-57-245.ec2.internal","hostNetwork":true,"securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"CriticalAddonsOnly","operator":"Exists"},{"operator":"Exists","effect":"NoExecute"}],"priorityClassName":"system-node-critical","priority":2000001000,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:03:14Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:03:19Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:03:19Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:03:14Z"}],"hostIP":"10.40.57.245","podIP":"10.40.57.245","startTime":"2020-11-04T12:03:14Z","containerStatuses":[{"name":"kube-proxy","state":{"running":{"startedAt":"2020-11-04T12:03:18Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"k8s.gcr.io/kube-proxy:v1.14.2","imageID":"docker-pullable://k8s.gcr.io/kube-proxy@sha256:c91687ff6145f7fcdc7d8b3da3c530a9a9b50f0734c7a945a0d9c18fc3790dbc","containerID":"docker://d85c647cbe7b912535225dd9c576885d0ee59ad77b36e421dcd448fba2549800"}],"qosClass":"Burstable"}},{"metadata":{"name":"kube-proxy-ip-10-40-59-224.ec2.internal","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/kube-proxy-ip-10-40-59-224.ec2.internal","uid":"557f1b08-1ea0-11eb-9aff-16da7cad7b07","resourceVersion":"45483073","creationTimestamp":"2020-11-04T13:19:14Z","labels":{"k8s-app":"kube-proxy","tier":"node"},"annotations":{"kubernetes.io/config.hash":"9114e7a4501b0b3401a12f2366fa375e","kubernetes.io/config.mirror":"9114e7a4501b0b3401a12f2366fa375e","kubernetes.io/config.seen":"2020-11-04T13:19:13.900285608Z","kubernetes.io/config.source":"file","scheduler.alpha.kubernetes.io/critical-pod":""}},"spec":{"volumes":[{"name":"logfile","hostPath":{"path":"/var/log/kube-proxy.log","type":""}},{"name":"kubeconfig","hostPath":{"path":"/var/lib/kube-proxy/kubeconfig","type":""}},{"name":"modules","hostPath":{"path":"/lib/modules","type":""}},{"name":"ssl-certs-hosts","hostPath":{"path":"/usr/share/ca-certificates","type":""}},{"name":"iptableslock","hostPath":{"path":"/run/xtables.lock","type":"FileOrCreate"}}],"containers":[{"name":"kube-proxy","image":"k8s.gcr.io/kube-proxy:v1.14.2","command":["/bin/sh","-c","mkfifo /tmp/pipe; (tee -a /var/log/kube-proxy.log \u003c /tmp/pipe \u0026 ) ; exec /usr/local/bin/kube-proxy --conntrack-max-per-core=131072 --hostname-override=ip-10-40-59-224.ec2.internal --kubeconfig=/var/lib/kube-proxy/kubeconfig --master=https://api.internal.example.com --oom-score-adj=-998 --resource-container=\"\" --v=2 \u003e /tmp/pipe 2\u003e\u00261"],"resources":{"requests":{"cpu":"100m"}},"volumeMounts":[{"name":"logfile","mountPath":"/var/log/kube-proxy.log"},{"name":"kubeconfig","readOnly":true,"mountPath":"/var/lib/kube-proxy/kubeconfig"},{"name":"modules","readOnly":true,"mountPath":"/lib/modules"},{"name":"ssl-certs-hosts","readOnly":true,"mountPath":"/etc/ssl/certs"},{"name":"iptableslock","mountPath":"/run/xtables.lock"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"privileged":true,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","nodeName":"ip-10-40-59-224.ec2.internal","hostNetwork":true,"securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"CriticalAddonsOnly","operator":"Exists"},{"operator":"Exists","effect":"NoExecute"}],"priorityClassName":"system-node-critical","priority":2000001000,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:19:14Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:19:26Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:19:26Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:19:14Z"}],"hostIP":"10.40.59.224","podIP":"10.40.59.224","startTime":"2020-11-04T13:19:14Z","containerStatuses":[{"name":"kube-proxy","state":{"running":{"startedAt":"2020-11-04T13:19:25Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"k8s.gcr.io/kube-proxy:v1.14.2","imageID":"docker-pullable://k8s.gcr.io/kube-proxy@sha256:c91687ff6145f7fcdc7d8b3da3c530a9a9b50f0734c7a945a0d9c18fc3790dbc","containerID":"docker://46bb39865951e9fc7ca387edd8fcb6072ab80f0c592b153bcb83b901f8e19fca"}],"qosClass":"Burstable"}},{"metadata":{"name":"kube-scheduler-ip-10-40-54-156.ec2.internal","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/kube-scheduler-ip-10-40-54-156.ec2.internal","uid":"02afb1ce-0e0c-11eb-9aff-16da7cad7b07","resourceVersion":"41345915","creationTimestamp":"2020-10-14T10:57:11Z","labels":{"k8s-app":"kube-scheduler"},"annotations":{"kubernetes.io/config.hash":"19be248965a41d80ef8ca4642e948682","kubernetes.io/config.mirror":"19be248965a41d80ef8ca4642e948682","kubernetes.io/config.seen":"2020-10-14T10:51:28.195767971Z","kubernetes.io/config.source":"file","scheduler.alpha.kubernetes.io/critical-pod":""}},"spec":{"volumes":[{"name":"varlibkubescheduler","hostPath":{"path":"/var/lib/kube-scheduler","type":""}},{"name":"logfile","hostPath":{"path":"/var/log/kube-scheduler.log","type":""}}],"containers":[{"name":"kube-scheduler","image":"k8s.gcr.io/kube-scheduler:v1.14.2","command":["/bin/sh","-c","mkfifo /tmp/pipe; (tee -a /var/log/kube-scheduler.log \u003c /tmp/pipe \u0026 ) ; exec /usr/local/bin/kube-scheduler --config=/var/lib/kube-scheduler/config.yaml --leader-elect=true --v=2 \u003e /tmp/pipe 2\u003e\u00261"],"resources":{"requests":{"cpu":"100m"}},"volumeMounts":[{"name":"varlibkubescheduler","readOnly":true,"mountPath":"/var/lib/kube-scheduler"},{"name":"logfile","mountPath":"/var/log/kube-scheduler.log"}],"livenessProbe":{"httpGet":{"path":"/healthz","port":10251,"host":"127.0.0.1","scheme":"HTTP"},"initialDelaySeconds":15,"timeoutSeconds":15,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","nodeName":"ip-10-40-54-156.ec2.internal","hostNetwork":true,"securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"CriticalAddonsOnly","operator":"Exists"},{"operator":"Exists","effect":"NoExecute"}],"priorityClassName":"system-cluster-critical","priority":2000000000,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-14T10:51:28Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-14T10:51:54Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-14T10:51:54Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-14T10:51:28Z"}],"hostIP":"10.40.54.156","podIP":"10.40.54.156","startTime":"2020-10-14T10:51:28Z","containerStatuses":[{"name":"kube-scheduler","state":{"running":{"startedAt":"2020-10-14T10:51:54Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"k8s.gcr.io/kube-scheduler:v1.14.2","imageID":"docker-pullable://k8s.gcr.io/kube-scheduler@sha256:052e0322b8a2b22819ab0385089f202555c4099493d1bd33205a34753494d2c2","containerID":"docker://7c89c7826fb6695196ef29aa75c59027591e6499ee43eeea7bacb2726abfef23"}],"qosClass":"Burstable"}},{"metadata":{"name":"kube2iam-498q9","generateName":"kube2iam-","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/kube2iam-498q9","uid":"b4fdd33a-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45477230","creationTimestamp":"2020-11-04T12:46:07Z","labels":{"app.kubernetes.io/name":"kube2iam","app.kubernetes.io/part-of":"kube2iam","controller-revision-hash":"6bb8d8748d","pod-template-generation":"1"},"annotations":{"prometheus.io/port":"7070","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube2iam","uid":"d5b4183b-2d71-11ea-98f1-16c576d8665d","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"kube2iam-token-qdd4v","secret":{"secretName":"kube2iam-token-qdd4v","defaultMode":420}}],"containers":[{"name":"kube2iam","image":"jtblin/kube2iam:0.10.8","args":["--app-port=8181","--metrics-port=7070","--host-interface=eni+","--host-ip=$(HOST_IP)","--iptables=true","--auto-discover-base-arn=true","--use-regional-sts-endpoint=true"],"ports":[{"name":"http","hostPort":8181,"containerPort":8181,"protocol":"TCP"},{"name":"metrics","hostPort":7070,"containerPort":7070,"protocol":"TCP"}],"env":[{"name":"HOST_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}},{"name":"AWS_REGION","value":"eu-central-1"}],"resources":{"limits":{"cpu":"50m","memory":"64Mi"},"requests":{"cpu":"25m","memory":"32Mi"}},"volumeMounts":[{"name":"kube2iam-token-qdd4v","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"privileged":true,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"kube2iam","serviceAccount":"kube2iam","nodeName":"ip-10-40-55-41.ec2.internal","hostNetwork":true,"securityContext":{},"affinity":{"nodeAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":{"nodeSelectorTerms":[{"matchFields":[{"key":"metadata.name","operator":"In","values":["ip-10-40-55-41.ec2.internal"]}]}]}}},"schedulerName":"default-scheduler","tolerations":[{"operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/disk-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/memory-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/pid-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/unschedulable","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/network-unavailable","operator":"Exists","effect":"NoSchedule"}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:46:07Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:46:20Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:46:20Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:46:07Z"}],"hostIP":"10.40.55.41","podIP":"10.40.55.41","startTime":"2020-11-04T12:46:07Z","containerStatuses":[{"name":"kube2iam","state":{"running":{"startedAt":"2020-11-04T12:46:19Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"jtblin/kube2iam:0.10.8","imageID":"docker-pullable://jtblin/kube2iam@sha256:92363f1c52fe5f433487b35c3f9c242e4733717ef7ac88c7137fc3824cfad4d3","containerID":"docker://3732732c7ea49a1df1b97bc4258fd901213ef730de1e851e5243c568f08c01ae"}],"qosClass":"Burstable"}},{"metadata":{"name":"kube2iam-4xjjj","generateName":"kube2iam-","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/kube2iam-4xjjj","uid":"3da81d44-1e9c-11eb-9aff-16da7cad7b07","resourceVersion":"45477946","creationTimestamp":"2020-11-04T12:49:56Z","labels":{"app.kubernetes.io/name":"kube2iam","app.kubernetes.io/part-of":"kube2iam","controller-revision-hash":"6bb8d8748d","pod-template-generation":"1"},"annotations":{"prometheus.io/port":"7070","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube2iam","uid":"d5b4183b-2d71-11ea-98f1-16c576d8665d","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"kube2iam-token-qdd4v","secret":{"secretName":"kube2iam-token-qdd4v","defaultMode":420}}],"containers":[{"name":"kube2iam","image":"jtblin/kube2iam:0.10.8","args":["--app-port=8181","--metrics-port=7070","--host-interface=eni+","--host-ip=$(HOST_IP)","--iptables=true","--auto-discover-base-arn=true","--use-regional-sts-endpoint=true"],"ports":[{"name":"http","hostPort":8181,"containerPort":8181,"protocol":"TCP"},{"name":"metrics","hostPort":7070,"containerPort":7070,"protocol":"TCP"}],"env":[{"name":"HOST_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}},{"name":"AWS_REGION","value":"eu-central-1"}],"resources":{"limits":{"cpu":"50m","memory":"64Mi"},"requests":{"cpu":"25m","memory":"32Mi"}},"volumeMounts":[{"name":"kube2iam-token-qdd4v","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"privileged":true,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"kube2iam","serviceAccount":"kube2iam","nodeName":"ip-10-40-42-110.ec2.internal","hostNetwork":true,"securityContext":{},"affinity":{"nodeAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":{"nodeSelectorTerms":[{"matchFields":[{"key":"metadata.name","operator":"In","values":["ip-10-40-42-110.ec2.internal"]}]}]}}},"schedulerName":"default-scheduler","tolerations":[{"operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/disk-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/memory-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/pid-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/unschedulable","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/network-unavailable","operator":"Exists","effect":"NoSchedule"}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:49:56Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:50:10Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:50:10Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:49:56Z"}],"hostIP":"10.40.42.110","podIP":"10.40.42.110","startTime":"2020-11-04T12:49:56Z","containerStatuses":[{"name":"kube2iam","state":{"running":{"startedAt":"2020-11-04T12:50:09Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"jtblin/kube2iam:0.10.8","imageID":"docker-pullable://jtblin/kube2iam@sha256:92363f1c52fe5f433487b35c3f9c242e4733717ef7ac88c7137fc3824cfad4d3","containerID":"docker://3d362281070f7788186af480b08945edef5973255e2e20e412d0b2d00b5d84e3"}],"qosClass":"Burstable"}},{"metadata":{"name":"kube2iam-5s9j6","generateName":"kube2iam-","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/kube2iam-5s9j6","uid":"106e7f1a-1dfc-11eb-9aff-16da7cad7b07","resourceVersion":"45293222","creationTimestamp":"2020-11-03T17:43:20Z","labels":{"app.kubernetes.io/name":"kube2iam","app.kubernetes.io/part-of":"kube2iam","controller-revision-hash":"6bb8d8748d","pod-template-generation":"1"},"annotations":{"prometheus.io/port":"7070","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube2iam","uid":"d5b4183b-2d71-11ea-98f1-16c576d8665d","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"kube2iam-token-qdd4v","secret":{"secretName":"kube2iam-token-qdd4v","defaultMode":420}}],"containers":[{"name":"kube2iam","image":"jtblin/kube2iam:0.10.8","args":["--app-port=8181","--metrics-port=7070","--host-interface=eni+","--host-ip=$(HOST_IP)","--iptables=true","--auto-discover-base-arn=true","--use-regional-sts-endpoint=true"],"ports":[{"name":"http","hostPort":8181,"containerPort":8181,"protocol":"TCP"},{"name":"metrics","hostPort":7070,"containerPort":7070,"protocol":"TCP"}],"env":[{"name":"HOST_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}},{"name":"AWS_REGION","value":"eu-central-1"}],"resources":{"limits":{"cpu":"50m","memory":"64Mi"},"requests":{"cpu":"25m","memory":"32Mi"}},"volumeMounts":[{"name":"kube2iam-token-qdd4v","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"privileged":true,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"kube2iam","serviceAccount":"kube2iam","nodeName":"ip-10-40-51-35.ec2.internal","hostNetwork":true,"securityContext":{},"affinity":{"nodeAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":{"nodeSelectorTerms":[{"matchFields":[{"key":"metadata.name","operator":"In","values":["ip-10-40-51-35.ec2.internal"]}]}]}}},"schedulerName":"default-scheduler","tolerations":[{"operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/disk-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/memory-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/pid-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/unschedulable","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/network-unavailable","operator":"Exists","effect":"NoSchedule"}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-03T17:43:21Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-03T17:43:34Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-03T17:43:34Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-03T17:43:21Z"}],"hostIP":"10.40.51.35","podIP":"10.40.51.35","startTime":"2020-11-03T17:43:21Z","containerStatuses":[{"name":"kube2iam","state":{"running":{"startedAt":"2020-11-03T17:43:34Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"jtblin/kube2iam:0.10.8","imageID":"docker-pullable://jtblin/kube2iam@sha256:92363f1c52fe5f433487b35c3f9c242e4733717ef7ac88c7137fc3824cfad4d3","containerID":"docker://1176995685a0e38f45a92cfe33b5645c237ef34553a24729c2852d50d56a72bc"}],"qosClass":"Burstable"}},{"metadata":{"name":"kube2iam-5tcml","generateName":"kube2iam-","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/kube2iam-5tcml","uid":"1db171f2-0e0c-11eb-9aff-16da7cad7b07","resourceVersion":"41346027","creationTimestamp":"2020-10-14T10:57:56Z","labels":{"app.kubernetes.io/name":"kube2iam","app.kubernetes.io/part-of":"kube2iam","controller-revision-hash":"6bb8d8748d","pod-template-generation":"1"},"annotations":{"prometheus.io/port":"7070","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube2iam","uid":"d5b4183b-2d71-11ea-98f1-16c576d8665d","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"kube2iam-token-qdd4v","secret":{"secretName":"kube2iam-token-qdd4v","defaultMode":420}}],"containers":[{"name":"kube2iam","image":"jtblin/kube2iam:0.10.8","args":["--app-port=8181","--metrics-port=7070","--host-interface=eni+","--host-ip=$(HOST_IP)","--iptables=true","--auto-discover-base-arn=true","--use-regional-sts-endpoint=true"],"ports":[{"name":"http","hostPort":8181,"containerPort":8181,"protocol":"TCP"},{"name":"metrics","hostPort":7070,"containerPort":7070,"protocol":"TCP"}],"env":[{"name":"HOST_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}},{"name":"AWS_REGION","value":"eu-central-1"}],"resources":{"limits":{"cpu":"50m","memory":"64Mi"},"requests":{"cpu":"25m","memory":"32Mi"}},"volumeMounts":[{"name":"kube2iam-token-qdd4v","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"privileged":true,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"kube2iam","serviceAccount":"kube2iam","nodeName":"ip-10-40-54-156.ec2.internal","hostNetwork":true,"securityContext":{},"affinity":{"nodeAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":{"nodeSelectorTerms":[{"matchFields":[{"key":"metadata.name","operator":"In","values":["ip-10-40-54-156.ec2.internal"]}]}]}}},"schedulerName":"default-scheduler","tolerations":[{"operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/disk-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/memory-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/pid-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/unschedulable","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/network-unavailable","operator":"Exists","effect":"NoSchedule"}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-14T10:57:56Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-14T10:58:09Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-14T10:58:09Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-14T10:57:56Z"}],"hostIP":"10.40.54.156","podIP":"10.40.54.156","startTime":"2020-10-14T10:57:56Z","containerStatuses":[{"name":"kube2iam","state":{"running":{"startedAt":"2020-10-14T10:58:08Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"jtblin/kube2iam:0.10.8","imageID":"docker-pullable://jtblin/kube2iam@sha256:92363f1c52fe5f433487b35c3f9c242e4733717ef7ac88c7137fc3824cfad4d3","containerID":"docker://3851aab1e34f3197b64fe8f5a518beca28e1525337af0d3f58eb76f08129204b"}],"qosClass":"Burstable"}},{"metadata":{"name":"kube2iam-6bpxr","generateName":"kube2iam-","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/kube2iam-6bpxr","uid":"b79a926c-1e95-11eb-9aff-16da7cad7b07","resourceVersion":"45468516","creationTimestamp":"2020-11-04T12:03:14Z","labels":{"app.kubernetes.io/name":"kube2iam","app.kubernetes.io/part-of":"kube2iam","controller-revision-hash":"6bb8d8748d","pod-template-generation":"1"},"annotations":{"prometheus.io/port":"7070","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube2iam","uid":"d5b4183b-2d71-11ea-98f1-16c576d8665d","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"kube2iam-token-qdd4v","secret":{"secretName":"kube2iam-token-qdd4v","defaultMode":420}}],"containers":[{"name":"kube2iam","image":"jtblin/kube2iam:0.10.8","args":["--app-port=8181","--metrics-port=7070","--host-interface=eni+","--host-ip=$(HOST_IP)","--iptables=true","--auto-discover-base-arn=true","--use-regional-sts-endpoint=true"],"ports":[{"name":"http","hostPort":8181,"containerPort":8181,"protocol":"TCP"},{"name":"metrics","hostPort":7070,"containerPort":7070,"protocol":"TCP"}],"env":[{"name":"HOST_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}},{"name":"AWS_REGION","value":"eu-central-1"}],"resources":{"limits":{"cpu":"50m","memory":"64Mi"},"requests":{"cpu":"25m","memory":"32Mi"}},"volumeMounts":[{"name":"kube2iam-token-qdd4v","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"privileged":true,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"kube2iam","serviceAccount":"kube2iam","nodeName":"ip-10-40-57-245.ec2.internal","hostNetwork":true,"securityContext":{},"affinity":{"nodeAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":{"nodeSelectorTerms":[{"matchFields":[{"key":"metadata.name","operator":"In","values":["ip-10-40-57-245.ec2.internal"]}]}]}}},"schedulerName":"default-scheduler","tolerations":[{"operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/disk-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/memory-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/pid-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/unschedulable","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/network-unavailable","operator":"Exists","effect":"NoSchedule"}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:03:14Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:03:29Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:03:29Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:03:14Z"}],"hostIP":"10.40.57.245","podIP":"10.40.57.245","startTime":"2020-11-04T12:03:14Z","containerStatuses":[{"name":"kube2iam","state":{"running":{"startedAt":"2020-11-04T12:03:28Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"jtblin/kube2iam:0.10.8","imageID":"docker-pullable://jtblin/kube2iam@sha256:92363f1c52fe5f433487b35c3f9c242e4733717ef7ac88c7137fc3824cfad4d3","containerID":"docker://ae5720b8f7a1a70869f427da6ed01b7e9936527fa07b30ee2be65be29af3a3fb"}],"qosClass":"Burstable"}},{"metadata":{"name":"kube2iam-8t2j8","generateName":"kube2iam-","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/kube2iam-8t2j8","uid":"33c4c33e-1e96-11eb-9aff-16da7cad7b07","resourceVersion":"45469377","creationTimestamp":"2020-11-04T12:06:42Z","labels":{"app.kubernetes.io/name":"kube2iam","app.kubernetes.io/part-of":"kube2iam","controller-revision-hash":"6bb8d8748d","pod-template-generation":"1"},"annotations":{"prometheus.io/port":"7070","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube2iam","uid":"d5b4183b-2d71-11ea-98f1-16c576d8665d","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"kube2iam-token-qdd4v","secret":{"secretName":"kube2iam-token-qdd4v","defaultMode":420}}],"containers":[{"name":"kube2iam","image":"jtblin/kube2iam:0.10.8","args":["--app-port=8181","--metrics-port=7070","--host-interface=eni+","--host-ip=$(HOST_IP)","--iptables=true","--auto-discover-base-arn=true","--use-regional-sts-endpoint=true"],"ports":[{"name":"http","hostPort":8181,"containerPort":8181,"protocol":"TCP"},{"name":"metrics","hostPort":7070,"containerPort":7070,"protocol":"TCP"}],"env":[{"name":"HOST_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}},{"name":"AWS_REGION","value":"eu-central-1"}],"resources":{"limits":{"cpu":"50m","memory":"64Mi"},"requests":{"cpu":"25m","memory":"32Mi"}},"volumeMounts":[{"name":"kube2iam-token-qdd4v","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"privileged":true,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"kube2iam","serviceAccount":"kube2iam","nodeName":"ip-10-40-45-241.ec2.internal","hostNetwork":true,"securityContext":{},"affinity":{"nodeAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":{"nodeSelectorTerms":[{"matchFields":[{"key":"metadata.name","operator":"In","values":["ip-10-40-45-241.ec2.internal"]}]}]}}},"schedulerName":"default-scheduler","tolerations":[{"operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/disk-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/memory-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/pid-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/unschedulable","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/network-unavailable","operator":"Exists","effect":"NoSchedule"}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:06:42Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:06:53Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:06:53Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:06:42Z"}],"hostIP":"10.40.45.241","podIP":"10.40.45.241","startTime":"2020-11-04T12:06:42Z","containerStatuses":[{"name":"kube2iam","state":{"running":{"startedAt":"2020-11-04T12:06:53Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"jtblin/kube2iam:0.10.8","imageID":"docker-pullable://jtblin/kube2iam@sha256:92363f1c52fe5f433487b35c3f9c242e4733717ef7ac88c7137fc3824cfad4d3","containerID":"docker://f13e568b75c489942f6707ac2e6ec808beb48c604c5e5965efcc43fb02e17d45"}],"qosClass":"Burstable"}},{"metadata":{"name":"kube2iam-csnxv","generateName":"kube2iam-","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/kube2iam-csnxv","uid":"21d700e0-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45476294","creationTimestamp":"2020-11-04T12:42:00Z","labels":{"app.kubernetes.io/name":"kube2iam","app.kubernetes.io/part-of":"kube2iam","controller-revision-hash":"6bb8d8748d","pod-template-generation":"1"},"annotations":{"prometheus.io/port":"7070","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube2iam","uid":"d5b4183b-2d71-11ea-98f1-16c576d8665d","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"kube2iam-token-qdd4v","secret":{"secretName":"kube2iam-token-qdd4v","defaultMode":420}}],"containers":[{"name":"kube2iam","image":"jtblin/kube2iam:0.10.8","args":["--app-port=8181","--metrics-port=7070","--host-interface=eni+","--host-ip=$(HOST_IP)","--iptables=true","--auto-discover-base-arn=true","--use-regional-sts-endpoint=true"],"ports":[{"name":"http","hostPort":8181,"containerPort":8181,"protocol":"TCP"},{"name":"metrics","hostPort":7070,"containerPort":7070,"protocol":"TCP"}],"env":[{"name":"HOST_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}},{"name":"AWS_REGION","value":"eu-central-1"}],"resources":{"limits":{"cpu":"50m","memory":"64Mi"},"requests":{"cpu":"25m","memory":"32Mi"}},"volumeMounts":[{"name":"kube2iam-token-qdd4v","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"privileged":true,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"kube2iam","serviceAccount":"kube2iam","nodeName":"ip-10-40-56-27.ec2.internal","hostNetwork":true,"securityContext":{},"affinity":{"nodeAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":{"nodeSelectorTerms":[{"matchFields":[{"key":"metadata.name","operator":"In","values":["ip-10-40-56-27.ec2.internal"]}]}]}}},"schedulerName":"default-scheduler","tolerations":[{"operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/disk-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/memory-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/pid-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/unschedulable","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/network-unavailable","operator":"Exists","effect":"NoSchedule"}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:42:00Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:42:13Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:42:13Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:42:00Z"}],"hostIP":"10.40.56.27","podIP":"10.40.56.27","startTime":"2020-11-04T12:42:00Z","containerStatuses":[{"name":"kube2iam","state":{"running":{"startedAt":"2020-11-04T12:42:13Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"jtblin/kube2iam:0.10.8","imageID":"docker-pullable://jtblin/kube2iam@sha256:92363f1c52fe5f433487b35c3f9c242e4733717ef7ac88c7137fc3824cfad4d3","containerID":"docker://ee74847317e14536bd6918d5673b01b2a54c9f02b26403d78e0332a58909fdac"}],"qosClass":"Burstable"}},{"metadata":{"name":"kube2iam-h7mc8","generateName":"kube2iam-","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/kube2iam-h7mc8","uid":"507f4b79-1ea0-11eb-9aff-16da7cad7b07","resourceVersion":"45483048","creationTimestamp":"2020-11-04T13:19:05Z","labels":{"app.kubernetes.io/name":"kube2iam","app.kubernetes.io/part-of":"kube2iam","controller-revision-hash":"6bb8d8748d","pod-template-generation":"1"},"annotations":{"prometheus.io/port":"7070","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube2iam","uid":"d5b4183b-2d71-11ea-98f1-16c576d8665d","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"kube2iam-token-qdd4v","secret":{"secretName":"kube2iam-token-qdd4v","defaultMode":420}}],"containers":[{"name":"kube2iam","image":"jtblin/kube2iam:0.10.8","args":["--app-port=8181","--metrics-port=7070","--host-interface=eni+","--host-ip=$(HOST_IP)","--iptables=true","--auto-discover-base-arn=true","--use-regional-sts-endpoint=true"],"ports":[{"name":"http","hostPort":8181,"containerPort":8181,"protocol":"TCP"},{"name":"metrics","hostPort":7070,"containerPort":7070,"protocol":"TCP"}],"env":[{"name":"HOST_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}},{"name":"AWS_REGION","value":"eu-central-1"}],"resources":{"limits":{"cpu":"50m","memory":"64Mi"},"requests":{"cpu":"25m","memory":"32Mi"}},"volumeMounts":[{"name":"kube2iam-token-qdd4v","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"privileged":true,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"kube2iam","serviceAccount":"kube2iam","nodeName":"ip-10-40-41-169.ec2.internal","hostNetwork":true,"securityContext":{},"affinity":{"nodeAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":{"nodeSelectorTerms":[{"matchFields":[{"key":"metadata.name","operator":"In","values":["ip-10-40-41-169.ec2.internal"]}]}]}}},"schedulerName":"default-scheduler","tolerations":[{"operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/disk-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/memory-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/pid-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/unschedulable","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/network-unavailable","operator":"Exists","effect":"NoSchedule"}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:19:06Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:19:19Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:19:19Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:19:05Z"}],"hostIP":"10.40.41.169","podIP":"10.40.41.169","startTime":"2020-11-04T13:19:06Z","containerStatuses":[{"name":"kube2iam","state":{"running":{"startedAt":"2020-11-04T13:19:19Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"jtblin/kube2iam:0.10.8","imageID":"docker-pullable://jtblin/kube2iam@sha256:92363f1c52fe5f433487b35c3f9c242e4733717ef7ac88c7137fc3824cfad4d3","containerID":"docker://1d86927e3786f1a0a4a3b1e3569ee85718b7ec1550a107f83d1c064873cedd51"}],"qosClass":"Burstable"}},{"metadata":{"name":"kube2iam-vzbfx","generateName":"kube2iam-","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/kube2iam-vzbfx","uid":"55617ce5-1ea0-11eb-9aff-16da7cad7b07","resourceVersion":"45483081","creationTimestamp":"2020-11-04T13:19:14Z","labels":{"app.kubernetes.io/name":"kube2iam","app.kubernetes.io/part-of":"kube2iam","controller-revision-hash":"6bb8d8748d","pod-template-generation":"1"},"annotations":{"prometheus.io/port":"7070","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube2iam","uid":"d5b4183b-2d71-11ea-98f1-16c576d8665d","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"kube2iam-token-qdd4v","secret":{"secretName":"kube2iam-token-qdd4v","defaultMode":420}}],"containers":[{"name":"kube2iam","image":"jtblin/kube2iam:0.10.8","args":["--app-port=8181","--metrics-port=7070","--host-interface=eni+","--host-ip=$(HOST_IP)","--iptables=true","--auto-discover-base-arn=true","--use-regional-sts-endpoint=true"],"ports":[{"name":"http","hostPort":8181,"containerPort":8181,"protocol":"TCP"},{"name":"metrics","hostPort":7070,"containerPort":7070,"protocol":"TCP"}],"env":[{"name":"HOST_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}},{"name":"AWS_REGION","value":"eu-central-1"}],"resources":{"limits":{"cpu":"50m","memory":"64Mi"},"requests":{"cpu":"25m","memory":"32Mi"}},"volumeMounts":[{"name":"kube2iam-token-qdd4v","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"privileged":true,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"kube2iam","serviceAccount":"kube2iam","nodeName":"ip-10-40-59-224.ec2.internal","hostNetwork":true,"securityContext":{},"affinity":{"nodeAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":{"nodeSelectorTerms":[{"matchFields":[{"key":"metadata.name","operator":"In","values":["ip-10-40-59-224.ec2.internal"]}]}]}}},"schedulerName":"default-scheduler","tolerations":[{"operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/disk-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/memory-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/pid-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/unschedulable","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/network-unavailable","operator":"Exists","effect":"NoSchedule"}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:19:14Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:19:27Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:19:27Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:19:14Z"}],"hostIP":"10.40.59.224","podIP":"10.40.59.224","startTime":"2020-11-04T13:19:14Z","containerStatuses":[{"name":"kube2iam","state":{"running":{"startedAt":"2020-11-04T13:19:27Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"jtblin/kube2iam:0.10.8","imageID":"docker-pullable://jtblin/kube2iam@sha256:92363f1c52fe5f433487b35c3f9c242e4733717ef7ac88c7137fc3824cfad4d3","containerID":"docker://deee1301a3fc42eb07cf2a3c293dc9ffd7f58b6c09b7b0e89e00b873c82ed6c2"}],"qosClass":"Burstable"}},{"metadata":{"name":"metrics-server-5c4dc47585-wkldh","generateName":"metrics-server-5c4dc47585-","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/metrics-server-5c4dc47585-wkldh","uid":"f4b64824-1e7d-11eb-9aff-16da7cad7b07","resourceVersion":"45439926","creationTimestamp":"2020-11-04T09:13:09Z","labels":{"k8s-app":"metrics-server","pod-template-hash":"5c4dc47585"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"metrics-server-5c4dc47585","uid":"064c0536-306a-11ea-98f1-16c576d8665d","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"tmp-dir","emptyDir":{}},{"name":"metrics-server-token-lmdkm","secret":{"secretName":"metrics-server-token-lmdkm","defaultMode":420}}],"containers":[{"name":"metrics-server","image":"k8s.gcr.io/metrics-server-amd64:v0.3.6","args":["--cert-dir=/tmp","--secure-port=4443","--kubelet-insecure-tls","--metric-resolution=10s","--enable-swagger-ui=false"],"ports":[{"name":"main-port","containerPort":4443,"protocol":"TCP"}],"resources":{},"volumeMounts":[{"name":"tmp-dir","mountPath":"/tmp"},{"name":"metrics-server-token-lmdkm","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always","securityContext":{"runAsUser":1000,"runAsNonRoot":true,"readOnlyRootFilesystem":true,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","nodeSelector":{"beta.kubernetes.io/os":"linux"},"serviceAccountName":"metrics-server","serviceAccount":"metrics-server","nodeName":"ip-10-40-51-35.ec2.internal","securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T09:13:09Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T09:13:12Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T09:13:12Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T09:13:09Z"}],"hostIP":"10.40.51.35","podIP":"10.40.46.215","startTime":"2020-11-04T09:13:09Z","containerStatuses":[{"name":"metrics-server","state":{"running":{"startedAt":"2020-11-04T09:13:11Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"k8s.gcr.io/metrics-server-amd64:v0.3.6","imageID":"docker-pullable://k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b","containerID":"docker://4b426cba609f8c3e32359fe598ed61cca221a3500b9fe597a51eecca236ca76f"}],"qosClass":"BestEffort"}},{"metadata":{"name":"nginx-ingress-59b8f694c8-sbr4j","generateName":"nginx-ingress-59b8f694c8-","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/nginx-ingress-59b8f694c8-sbr4j","uid":"4d2686ad-1e01-11eb-9aff-16da7cad7b07","resourceVersion":"45301584","creationTimestamp":"2020-11-03T18:20:50Z","labels":{"app.kubernetes.io/name":"nginx-ingress","app.kubernetes.io/part-of":"nginx-ingress","component":"controller","pod-template-hash":"59b8f694c8"},"annotations":{"prometheus.io/port":"10254","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"nginx-ingress-59b8f694c8","uid":"8f63019a-2fa7-11ea-98f1-16c576d8665d","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"nginx-ingress-token-p2k64","secret":{"secretName":"nginx-ingress-token-p2k64","defaultMode":420}}],"containers":[{"name":"controller","image":"quay.io/kubernetes-ingress-controller/nginx-ingress-controller:0.21.0","args":["/nginx-ingress-controller","--default-backend-service=$(POD_NAMESPACE)/nginx-ingress-default-backend","--configmap=$(POD_NAMESPACE)/nginx-ingress","--publish-service=$(POD_NAMESPACE)/nginx-ingress","--annotations-prefix=ingress.kubernetes.io"],"ports":[{"name":"http","containerPort":80,"protocol":"TCP"},{"name":"http-workaround","containerPort":8080,"protocol":"TCP"},{"name":"health","containerPort":10254,"protocol":"TCP"}],"env":[{"name":"POD_NAME","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.name"}}},{"name":"POD_NAMESPACE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}}],"resources":{"limits":{"cpu":"500m","memory":"512Mi"},"requests":{"cpu":"200m","memory":"128Mi"}},"volumeMounts":[{"name":"nginx-ingress-token-p2k64","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/healthz","port":"health","scheme":"HTTP"},"initialDelaySeconds":10,"timeoutSeconds":5,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/healthz","port":"health","scheme":"HTTP"},"initialDelaySeconds":10,"timeoutSeconds":5,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"capabilities":{"add":["NET_BIND_SERVICE"],"drop":["ALL"]},"runAsUser":33,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":60,"dnsPolicy":"ClusterFirst","serviceAccountName":"nginx-ingress","serviceAccount":"nginx-ingress","nodeName":"ip-10-40-51-35.ec2.internal","securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priorityClassName":"system-cluster-critical","priority":2000000000,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-03T18:20:50Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-03T18:21:22Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-03T18:21:22Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-03T18:20:50Z"}],"hostIP":"10.40.51.35","podIP":"10.40.53.51","startTime":"2020-11-03T18:20:50Z","containerStatuses":[{"name":"controller","state":{"running":{"startedAt":"2020-11-03T18:21:03Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"quay.io/kubernetes-ingress-controller/nginx-ingress-controller:0.21.0","imageID":"docker-pullable://quay.io/kubernetes-ingress-controller/nginx-ingress-controller@sha256:617076c3e3d4d0638a4927702530d8456bda64c67194f6daed272a59e93b992f","containerID":"docker://934a0bf7ca7b59d52ccc1ba9a5b76f5eccf4d2e9f88f9470086c63a913bd85e4"}],"qosClass":"Burstable"}},{"metadata":{"name":"nginx-ingress-default-backend-855548df69-l8tsd","generateName":"nginx-ingress-default-backend-855548df69-","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/nginx-ingress-default-backend-855548df69-l8tsd","uid":"03043292-1e7e-11eb-9aff-16da7cad7b07","resourceVersion":"45439987","creationTimestamp":"2020-11-04T09:13:33Z","labels":{"app.kubernetes.io/name":"nginx-ingress","app.kubernetes.io/part-of":"nginx-ingress","component":"default-backend","pod-template-hash":"855548df69"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"nginx-ingress-default-backend-855548df69","uid":"8f60b81f-2fa7-11ea-98f1-16c576d8665d","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-hdds9","secret":{"secretName":"default-token-hdds9","defaultMode":420}}],"containers":[{"name":"default-backend","image":"example/default-backend:latest","ports":[{"name":"http","containerPort":9090,"protocol":"TCP"}],"resources":{"limits":{"cpu":"10m","memory":"20Mi"},"requests":{"cpu":"10m","memory":"20Mi"}},"volumeMounts":[{"name":"default-token-hdds9","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/healthz","port":"http","scheme":"HTTP"},"timeoutSeconds":2,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"ip-10-40-51-35.ec2.internal","securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T09:13:33Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T09:13:39Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T09:13:39Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T09:13:33Z"}],"hostIP":"10.40.51.35","podIP":"10.40.32.46","startTime":"2020-11-04T09:13:33Z","containerStatuses":[{"name":"default-backend","state":{"running":{"startedAt":"2020-11-04T09:13:38Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"example/default-backend:latest","imageID":"docker-pullable://example/default-backend@sha256:14f15b1c7b037f32cc816e37259ffa386f2b0fdab5e48058b61323a389450f11","containerID":"docker://82de02b4fb3ae755612f3b887215f532ca8cd184c90b9f133d70b6a832952a18"}],"qosClass":"Guaranteed"}},{"metadata":{"name":"spotinst-kubernetes-cluster-controller-678b8c78f9-m7g68","generateName":"spotinst-kubernetes-cluster-controller-678b8c78f9-","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/spotinst-kubernetes-cluster-controller-678b8c78f9-m7g68","uid":"bbf95b6b-16ac-11eb-9aff-16da7cad7b07","resourceVersion":"43454384","creationTimestamp":"2020-10-25T10:27:50Z","labels":{"k8s-addon":"spotinst-kubernetes-cluster-controller.addons.k8s.io","pod-template-hash":"678b8c78f9"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"spotinst-kubernetes-cluster-controller-678b8c78f9","uid":"bbf68a50-16ac-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"spotinst-kubernetes-cluster-controller-token-4wsfd","secret":{"secretName":"spotinst-kubernetes-cluster-controller-token-4wsfd","defaultMode":420}}],"containers":[{"name":"spotinst-kubernetes-cluster-controller","image":"spotinst/kubernetes-cluster-controller:1.0.68","env":[{"name":"SPOTINST_TOKEN","valueFrom":{"secretKeyRef":{"name":"spotinst-kubernetes-cluster-controller","key":"token","optional":true}}},{"name":"SPOTINST_ACCOUNT","valueFrom":{"secretKeyRef":{"name":"spotinst-kubernetes-cluster-controller","key":"account","optional":true}}},{"name":"SPOTINST_TOKEN_LEGACY","valueFrom":{"configMapKeyRef":{"name":"spotinst-kubernetes-cluster-controller-config","key":"spotinst.token","optional":true}}},{"name":"SPOTINST_ACCOUNT_LEGACY","valueFrom":{"configMapKeyRef":{"name":"spotinst-kubernetes-cluster-controller-config","key":"spotinst.account","optional":true}}},{"name":"CLUSTER_IDENTIFIER","valueFrom":{"configMapKeyRef":{"name":"spotinst-kubernetes-cluster-controller-config","key":"spotinst.cluster-identifier"}}},{"name":"DISABLE_AUTO_UPDATE","valueFrom":{"configMapKeyRef":{"name":"spotinst-kubernetes-cluster-controller-config","key":"disable-auto-update","optional":true}}},{"name":"ENABLE_CSR_APPROVAL","valueFrom":{"configMapKeyRef":{"name":"spotinst-kubernetes-cluster-controller-config","key":"enable-csr-approval","optional":true}}},{"name":"PROXY_URL","valueFrom":{"configMapKeyRef":{"name":"spotinst-kubernetes-cluster-controller-config","key":"proxy-url","optional":true}}},{"name":"BASE_SPOTINST_URL","valueFrom":{"configMapKeyRef":{"name":"spotinst-kubernetes-cluster-controller-config","key":"base-url","optional":true}}},{"name":"POD_ID","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.uid"}}},{"name":"POD_NAME","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.name"}}},{"name":"POD_NAMESPACE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}}],"resources":{},"volumeMounts":[{"name":"spotinst-kubernetes-cluster-controller-token-4wsfd","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/healthcheck","port":4401,"scheme":"HTTP"},"initialDelaySeconds":300,"timeoutSeconds":2,"periodSeconds":20,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/healthcheck","port":4401,"scheme":"HTTP"},"initialDelaySeconds":20,"timeoutSeconds":2,"periodSeconds":20,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"Default","serviceAccountName":"spotinst-kubernetes-cluster-controller","serviceAccount":"spotinst-kubernetes-cluster-controller","nodeName":"ip-10-40-54-156.ec2.internal","securityContext":{},"affinity":{"nodeAffinity":{"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":100,"preference":{"matchExpressions":[{"key":"node-role.kubernetes.io/master","operator":"Exists"}]}}]},"podAntiAffinity":{"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":50,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"k8s-addon","operator":"In","values":["spotinst-kubernetes-cluster-controller.addons.k8s.io"]}]},"topologyKey":"kubernetes.io/hostname"}}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":150},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":150},{"key":"node-role.kubernetes.io/master","operator":"Exists"}],"priorityClassName":"system-cluster-critical","priority":2000000000,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-25T10:27:50Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-25T10:28:15Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-25T10:28:15Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-10-25T10:27:50Z"}],"hostIP":"10.40.54.156","podIP":"10.40.47.228","startTime":"2020-10-25T10:27:50Z","containerStatuses":[{"name":"spotinst-kubernetes-cluster-controller","state":{"running":{"startedAt":"2020-10-25T10:27:54Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"spotinst/kubernetes-cluster-controller:1.0.68","imageID":"docker-pullable://spotinst/kubernetes-cluster-controller@sha256:f82c58b3e5374331ace6bf988987e2f0b390abedad313a31e5c8aaede3c580c2","containerID":"docker://acbb43e287cabc17f132174f18335756a66359277a3c1ad3fb2acea1b81d4fea"}],"qosClass":"BestEffort"}},{"metadata":{"name":"tiller-deploy-5bb5cbbc4f-z2s4q","generateName":"tiller-deploy-5bb5cbbc4f-","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/tiller-deploy-5bb5cbbc4f-z2s4q","uid":"115335e5-1e7e-11eb-9aff-16da7cad7b07","resourceVersion":"45440041","creationTimestamp":"2020-11-04T09:13:57Z","labels":{"app":"helm","name":"tiller","pod-template-hash":"5bb5cbbc4f"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"tiller-deploy-5bb5cbbc4f","uid":"8bb68f12-eba1-11ea-a94a-16fe0b2265bd","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"tiller-certs","secret":{"secretName":"tiller-secret","defaultMode":420}},{"name":"tiller-token-p8bth","secret":{"secretName":"tiller-token-p8bth","defaultMode":420}}],"containers":[{"name":"tiller","image":"gcr.io/kubernetes-helm/tiller:v2.14.1","ports":[{"name":"tiller","hostPort":44134,"containerPort":44134,"protocol":"TCP"},{"name":"http","hostPort":44135,"containerPort":44135,"protocol":"TCP"}],"env":[{"name":"TILLER_NAMESPACE","value":"kube-system"},{"name":"TILLER_HISTORY_MAX","value":"0"},{"name":"TILLER_TLS_VERIFY","value":"1"},{"name":"TILLER_TLS_ENABLE","value":"1"},{"name":"TILLER_TLS_CERTS","value":"/etc/certs"}],"resources":{},"volumeMounts":[{"name":"tiller-certs","readOnly":true,"mountPath":"/etc/certs"},{"name":"tiller-token-p8bth","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/liveness","port":44135,"scheme":"HTTP"},"initialDelaySeconds":1,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/readiness","port":44135,"scheme":"HTTP"},"initialDelaySeconds":1,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"tiller","serviceAccount":"tiller","automountServiceAccountToken":true,"nodeName":"ip-10-40-51-35.ec2.internal","hostNetwork":true,"securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T09:13:57Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T09:14:03Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T09:14:03Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T09:13:57Z"}],"hostIP":"10.40.51.35","podIP":"10.40.51.35","startTime":"2020-11-04T09:13:57Z","containerStatuses":[{"name":"tiller","state":{"running":{"startedAt":"2020-11-04T09:14:00Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"gcr.io/kubernetes-helm/tiller:v2.14.1","imageID":"docker-pullable://gcr.io/kubernetes-helm/tiller@sha256:f8002b91997fdc2c15a9c2aa994bea117b5b1683933f3144369862f0883c3c42","containerID":"docker://098da6e22aa3f257a14c745a7942c4c763ee9bf74fee4fc2cf9057298d7495aa"}],"qosClass":"BestEffort"}},{"metadata":{"name":"connect-operator-6d9566bb88-vmxx9","generateName":"connect-operator-6d9566bb88-","namespace":"operators","selfLink":"/api/v1/namespaces/operators/pods/connect-operator-6d9566bb88-vmxx9","uid":"5db66d00-1e82-11eb-9aff-16da7cad7b07","resourceVersion":"45442862","creationTimestamp":"2020-11-04T09:44:43Z","labels":{"app.kubernetes.io/name":"connect-operator","app.kubernetes.io/part-of":"test-connect-operator","pod-template-hash":"6d9566bb88"},"annotations":{"prometheus.io/port":"9506","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"connect-operator-6d9566bb88","uid":"5db3abc8-1e82-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"connect-operator-token-kktks","secret":{"secretName":"connect-operator-token-kktks","defaultMode":420}}],"containers":[{"name":"manager","image":"registry.example.com/ce/middleware/connect-operator:0.2.6","command":["/manager"],"args":["--enable-leader-election","--develop=true","--metrics-addr=:9506","--sync=30s"],"ports":[{"name":"metrics","containerPort":9506,"protocol":"TCP"}],"env":[{"name":"POD_NAMESPACE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}}],"resources":{"limits":{"cpu":"100m","memory":"40Mi"},"requests":{"cpu":"50m","memory":"20Mi"}},"volumeMounts":[{"name":"connect-operator-token-kktks","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"connect-operator","serviceAccount":"connect-operator","nodeName":"ip-10-40-51-35.ec2.internal","securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T09:44:43Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T09:44:46Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T09:44:46Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T09:44:43Z"}],"hostIP":"10.40.51.35","podIP":"10.40.38.199","startTime":"2020-11-04T09:44:43Z","containerStatuses":[{"name":"manager","state":{"running":{"startedAt":"2020-11-04T09:44:45Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/middleware/connect-operator:0.2.6","imageID":"docker-pullable://registry.example.com/ce/middleware/connect-operator@sha256:7e5df82e5a2fc470d4f647d42b6849477ac712799868c87db99bdb88c778746f","containerID":"docker://654d254294a3d7ba0fc7de954bddac51f07da2bb49851ea81775f35872c40f55"}],"qosClass":"Burstable"}}]}
I1104 15:55:00.035648 12586 instancegroups.go:416] Cluster validated.
I1104 15:55:00.035673 12586 instancegroups.go:282] Tainting 6 nodes in "nodes" instancegroup.
I1104 15:55:00.036946 12586 request.go:1068] Request Body: {"spec":{"taints":[{"effect":"PreferNoSchedule","key":"kops.k8s.io/scheduled-for-update"}]}}
I1104 15:55:00.037017 12586 round_trippers.go:423] curl -k -v -XPATCH -H "Content-Type: application/strategic-merge-patch+json" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" -H "Accept: application/json, */*" 'https://api.example.com/api/v1/nodes/ip-10-40-56-27.ec2.internal'
I1104 15:55:00.187562 12586 round_trippers.go:443] PATCH https://api.example.com/api/v1/nodes/ip-10-40-56-27.ec2.internal 200 OK in 150 milliseconds
I1104 15:55:00.187585 12586 round_trippers.go:449] Response Headers:
I1104 15:55:00.187596 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:00.187601 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:00 GMT
I1104 15:55:00.187605 12586 round_trippers.go:452] Audit-Id: 1e7a2026-6a39-4a9d-aec1-e1640811b948
I1104 15:55:00.187651 12586 request.go:1068] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"ip-10-40-56-27.ec2.internal","selfLink":"/api/v1/nodes/ip-10-40-56-27.ec2.internal","uid":"21d0f8a8-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45489064","creationTimestamp":"2020-11-04T12:42:00Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/instance-type":"t3a.xlarge","beta.kubernetes.io/os":"linux","failure-domain.beta.kubernetes.io/region":"us-east-1","failure-domain.beta.kubernetes.io/zone":"us-east-1f","kops.k8s.io/instancegroup":"nodes","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"ip-10-40-56-27.ec2.internal","kubernetes.io/os":"linux","kubernetes.io/role":"node","node-role.kubernetes.io/node":"","spotinst.io/node-lifecycle":"spot"},"annotations":{"node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"}},"spec":{"podCIDR":"100.96.112.0/24","providerID":"aws:///us-east-1f/i-036e06b204f56f316","taints":[{"key":"kops.k8s.io/scheduled-for-update","effect":"PreferNoSchedule"}]},"status":{"capacity":{"attachable-volumes-aws-ebs":"25","cpu":"4","ephemeral-storage":"130045936Ki","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"16280568Ki","pods":"58"},"allocatable":{"attachable-volumes-aws-ebs":"25","cpu":"4","ephemeral-storage":"119850334420","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"16178168Ki","pods":"58"},"conditions":[{"type":"MemoryPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:03Z","lastTransitionTime":"2020-11-04T12:42:00Z","reason":"KubeletHasSufficientMemory","message":"kubelet has sufficient memory available"},{"type":"DiskPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:03Z","lastTransitionTime":"2020-11-04T12:42:00Z","reason":"KubeletHasNoDiskPressure","message":"kubelet has no disk pressure"},{"type":"PIDPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:03Z","lastTransitionTime":"2020-11-04T12:42:00Z","reason":"KubeletHasSufficientPID","message":"kubelet has sufficient PID available"},{"type":"Ready","status":"True","lastHeartbeatTime":"2020-11-04T13:54:03Z","lastTransitionTime":"2020-11-04T12:42:50Z","reason":"KubeletReady","message":"kubelet is posting ready status. AppArmor enabled"}],"addresses":[{"type":"InternalIP","address":"10.40.56.27"},{"type":"InternalDNS","address":"ip-10-40-56-27.ec2.internal"},{"type":"Hostname","address":"ip-10-40-56-27.ec2.internal"}],"daemonEndpoints":{"kubeletEndpoint":{"Port":10250}},"nodeInfo":{"machineID":"ec2fa63e40c54f665cbfe09ae4ec16d9","systemUUID":"EC2FA63E-40C5-4F66-5CBF-E09AE4EC16D9","bootID":"f2e9e82a-9b29-4591-a662-9fe3f838585e","kernelVersion":"4.15.0-1039-aws","osImage":"Ubuntu 18.04.2 LTS","containerRuntimeVersion":"docker://18.6.3","kubeletVersion":"v1.14.2","kubeProxyVersion":"v1.14.2","operatingSystem":"linux","architecture":"amd64"},"images":[{"names":["confluentinc/cp-schema-registry@sha256:0d7a84d486477a0c203ae21d5d52c40d26e810f5b5cfa27a56274692b70949f5","confluentinc/cp-schema-registry:5.2.2"],"sizeBytes":746078624},{"names":["registry.example.com/cybervision/invu-kafka-connect-sinks/kafka-connect@sha256:6a584826ecf0bbdf654fbe27201e2ed07d5586bd6f0c414c13be40ac3f6cc62f","registry.example.com/cybervision/invu-kafka-connect-sinks/kafka-connect:2.0.0-37698"],"sizeBytes":643296613},{"names":["confluentinc/cp-ksql-server@sha256:a0b75d2f9926ac31139b2bebff3ac95a24e9f08465176aef16ed3c481b39a297","confluentinc/cp-ksql-server:5.2.2"],"sizeBytes":524657779},{"names":["registry.example.com/ce/middleware/mariadb@sha256:b4c12c27093137dbf047773d4ddb99676bedd32c8606bfa1e3c50876d5ce659f","registry.example.com/ce/middleware/mariadb:0.6.56"],"sizeBytes":373763438},{"names":["registry.example.com/cybervision/invu-infrastructure-service@sha256:00f75459b2ee50deb47884131608f73108158d4faa085d1a5cc237aacd3f2112","registry.example.com/cybervision/invu-infrastructure-service:2.0.0-37566"],"sizeBytes":312358195},{"names":["example/jmx-prometheus-httpserver@sha256:725e8a9bfec05f432b931edc11b1ee8bac3895e408bb91af58266dc88ee4e63b","example/jmx-prometheus-httpserver:0.11.0"],"sizeBytes":273954021},{"names":["registry.example.com/ce/middleware/kafka@sha256:5a13ea153f26ac29e73fd3a0ed67c701f33ea761a0b10a03870fdda51e3975cc","registry.example.com/ce/middleware/kafka:0.6.33"],"sizeBytes":269199283},{"names":["602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni@sha256:a6d23b9fb3d4ba549321e32a28c42d8e79da203897072e93874472ab9e80b768","602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5"],"sizeBytes":263850871},{"names":["emqx/emqx@sha256:3f31ee2793b4446e98183659b4493992355e2b0d8603df946c641b47f29ced78","emqx/emqx:v3.2.7"],"sizeBytes":89389623},{"names":["k8s.gcr.io/kube-proxy@sha256:c91687ff6145f7fcdc7d8b3da3c530a9a9b50f0734c7a945a0d9c18fc3790dbc","k8s.gcr.io/kube-proxy:v1.14.2"],"sizeBytes":82106236},{"names":["registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","registry.example.com/ce/utilities/mysql-client:latest"],"sizeBytes":38388577},{"names":["jtblin/kube2iam@sha256:92363f1c52fe5f433487b35c3f9c242e4733717ef7ac88c7137fc3824cfad4d3","jtblin/kube2iam:0.10.8"],"sizeBytes":34303129},{"names":["registry.example.com/ce/utilities/kt@sha256:a52550f941a9449ea205201f2c42d0352da5f70bf281d1d638944352781851b2","registry.example.com/ce/utilities/kt:latest"],"sizeBytes":22871156},{"names":["prom/mysqld-exporter@sha256:9f4fb61cca309cb4a8c1b9ed9fb4aa75af0f7a21f36d3954667db37c062a0172","prom/mysqld-exporter:v0.11.0"],"sizeBytes":17003848},{"names":["example/emq_exporter@sha256:1526c0476c1e5d740dfc4df36f3295ea27f87b41becf274c760fbd0a51011233","example/emq_exporter:v0.4.1"],"sizeBytes":11467840},{"names":["busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","busybox:latest"],"sizeBytes":1231733},{"names":["k8s.gcr.io/pause-amd64@sha256:4a1c4b21597c1b4415bdbecb28a3296c6b5e23ca4f9feeb599860a1dac6a0108","k8s.gcr.io/pause-amd64:3.2"],"sizeBytes":682696}],"volumesInUse":["kubernetes.io/aws-ebs/aws://us-east-1f/vol-0153f8347ff8a2cd1","kubernetes.io/aws-ebs/aws://us-east-1f/vol-0cb2890c3adac40d4"],"volumesAttached":[{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-0153f8347ff8a2cd1","devicePath":"/dev/xvdbj"},{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-0cb2890c3adac40d4","devicePath":"/dev/xvdcd"}]}}
I1104 15:55:00.189018 12586 request.go:1068] Request Body: {"spec":{"taints":[{"effect":"PreferNoSchedule","key":"kops.k8s.io/scheduled-for-update"}]}}
I1104 15:55:00.189090 12586 round_trippers.go:423] curl -k -v -XPATCH -H "Authorization: Basic ******" -H "Accept: application/json, */*" -H "Content-Type: application/strategic-merge-patch+json" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" 'https://api.example.com/api/v1/nodes/ip-10-40-51-35.ec2.internal'
I1104 15:55:00.345727 12586 round_trippers.go:443] PATCH https://api.example.com/api/v1/nodes/ip-10-40-51-35.ec2.internal 200 OK in 156 milliseconds
I1104 15:55:00.345749 12586 round_trippers.go:449] Response Headers:
I1104 15:55:00.345754 12586 round_trippers.go:452] Audit-Id: d3b95bc2-ea3c-4595-8531-22006fbb89e7
I1104 15:55:00.345757 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:00.345760 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:00 GMT
I1104 15:55:00.345833 12586 request.go:1068] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"ip-10-40-51-35.ec2.internal","selfLink":"/api/v1/nodes/ip-10-40-51-35.ec2.internal","uid":"1066fa28-1dfc-11eb-9aff-16da7cad7b07","resourceVersion":"45489065","creationTimestamp":"2020-11-03T17:43:20Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/instance-type":"r5.large","beta.kubernetes.io/os":"linux","failure-domain.beta.kubernetes.io/region":"us-east-1","failure-domain.beta.kubernetes.io/zone":"us-east-1f","kops.k8s.io/instancegroup":"nodes","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"ip-10-40-51-35.ec2.internal","kubernetes.io/os":"linux","kubernetes.io/role":"node","node-role.kubernetes.io/node":""},"annotations":{"node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"}},"spec":{"podCIDR":"100.96.79.0/24","providerID":"aws:///us-east-1f/i-0e4fb331463f91e5b","taints":[{"key":"kops.k8s.io/scheduled-for-update","effect":"PreferNoSchedule"}]},"status":{"capacity":{"attachable-volumes-aws-ebs":"25","cpu":"2","ephemeral-storage":"130045936Ki","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"16123244Ki","pods":"29"},"allocatable":{"attachable-volumes-aws-ebs":"25","cpu":"2","ephemeral-storage":"119850334420","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"16020844Ki","pods":"29"},"conditions":[{"type":"MemoryPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:06Z","lastTransitionTime":"2020-11-03T17:43:20Z","reason":"KubeletHasSufficientMemory","message":"kubelet has sufficient memory available"},{"type":"DiskPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:06Z","lastTransitionTime":"2020-11-03T17:43:20Z","reason":"KubeletHasNoDiskPressure","message":"kubelet has no disk pressure"},{"type":"PIDPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:06Z","lastTransitionTime":"2020-11-03T17:43:20Z","reason":"KubeletHasSufficientPID","message":"kubelet has sufficient PID available"},{"type":"Ready","status":"True","lastHeartbeatTime":"2020-11-04T13:54:06Z","lastTransitionTime":"2020-11-03T17:43:41Z","reason":"KubeletReady","message":"kubelet is posting ready status. AppArmor enabled"}],"addresses":[{"type":"InternalIP","address":"10.40.51.35"},{"type":"InternalDNS","address":"ip-10-40-51-35.ec2.internal"},{"type":"Hostname","address":"ip-10-40-51-35.ec2.internal"}],"daemonEndpoints":{"kubeletEndpoint":{"Port":10250}},"nodeInfo":{"machineID":"ec21be1b38ff213ea283c19838e97f88","systemUUID":"EC21BE1B-38FF-213E-A283-C19838E97F88","bootID":"d7cb4873-93f4-4022-b59b-70fb30031938","kernelVersion":"4.15.0-1039-aws","osImage":"Ubuntu 18.04.2 LTS","containerRuntimeVersion":"docker://18.6.3","kubeletVersion":"v1.14.2","kubeProxyVersion":"v1.14.2","operatingSystem":"linux","architecture":"amd64"},"images":[{"names":["registry.example.com/ce/utilities/kafka-shell@sha256:8a8a80dfaae72664413657ee2ea2bd4543f08163035bdefcb163456af9a8e316","registry.example.com/ce/utilities/kafka-shell:latest"],"sizeBytes":697357066},{"names":["quay.io/kubernetes-ingress-controller/nginx-ingress-controller@sha256:617076c3e3d4d0638a4927702530d8456bda64c67194f6daed272a59e93b992f","quay.io/kubernetes-ingress-controller/nginx-ingress-controller:0.21.0"],"sizeBytes":568075227},{"names":["registry.example.com/ce/utilities/kafka-manager@sha256:c04a2fcec27aca7a0e8c70105ebd4c5f960ca81d6d867d4d584bcab9b7173fbc","registry.example.com/ce/utilities/kafka-manager:2.0.0.2"],"sizeBytes":547394080},{"names":["registry.example.com/ce/middleware/cassandra@sha256:29ff685aae75edaae14d052e723a66fabbd8e6e9ede068bb4a901776ada3b493","registry.example.com/ce/middleware/cassandra:0.6.40"],"sizeBytes":384610888},{"names":["registry.example.com/ce/middleware/mariadb@sha256:b4c12c27093137dbf047773d4ddb99676bedd32c8606bfa1e3c50876d5ce659f","registry.example.com/ce/middleware/mariadb:0.6.56"],"sizeBytes":373763438},{"names":["registry.example.com/cybervision/pregsense-mobile-device-service@sha256:057469801785596922de4ad1866a4d2f7e26271d925889f1533fe8cf06b0db51","registry.example.com/cybervision/pregsense-mobile-device-service:2.0.0-37577"],"sizeBytes":367804418},{"names":["registry.example.com/cybervision/pregsense-scheduler-service@sha256:7ad590d9311407a5c36583316cd79b66906db26085e56b5c37d9d3125d522fc2","registry.example.com/cybervision/pregsense-scheduler-service:1.1.0-37581"],"sizeBytes":327939018},{"names":["registry.example.com/cybervision/pregsense-medex-service@sha256:a6a38353b3b4ee41627606873b884cabf0a37bd0d6afb9b5f823b0e64d988d5b","registry.example.com/cybervision/pregsense-medex-service:2.0.0-37573"],"sizeBytes":302750971},{"names":["602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni@sha256:a6d23b9fb3d4ba549321e32a28c42d8e79da203897072e93874472ab9e80b768","602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5"],"sizeBytes":263850871},{"names":["zookeeper@sha256:b7a76ec06f68fd9c801b72dfd283701bc7d8a8b0609277a0d570e8e6768e4ad9","zookeeper:3.5.5"],"sizeBytes":225210868},{"names":["registry.example.com/ce/utilities/kubectl-in-pod@sha256:8b9d9dcedcc1eb0a3fa81971787469527333f0ee9aaf1eb296affba1da64a0e5","registry.example.com/ce/utilities/kubectl-in-pod:0.0.4"],"sizeBytes":188973770},{"names":["registry.example.com/cybervision/invu-web/support@sha256:de25604e5609c81e2d180b86126f00441671ab242555bda54a0b4e56d6a9b374","registry.example.com/cybervision/invu-web/support:2.0.0-38041"],"sizeBytes":107592777},{"names":["gcr.io/kubernetes-helm/tiller@sha256:f8002b91997fdc2c15a9c2aa994bea117b5b1683933f3144369862f0883c3c42","gcr.io/kubernetes-helm/tiller:v2.14.1"],"sizeBytes":94194761},{"names":["emqx/emqx@sha256:3f31ee2793b4446e98183659b4493992355e2b0d8603df946c641b47f29ced78","emqx/emqx:v3.2.7"],"sizeBytes":89389623},{"names":["k8s.gcr.io/kube-proxy@sha256:c91687ff6145f7fcdc7d8b3da3c530a9a9b50f0734c7a945a0d9c18fc3790dbc","k8s.gcr.io/kube-proxy:v1.14.2"],"sizeBytes":82106236},{"names":["registry.example.com/ce/utilities/cqlsh@sha256:36818e33bb74a5570efb254a468136d84f8520719e966927d0797ea512d9b073","registry.example.com/ce/utilities/cqlsh:latest"],"sizeBytes":74739843},{"names":["example/kube-tasks@sha256:713a62fab6a3075227d6a53681e548bc7cdaa39143bb135c939cc9573fd66965","example/kube-tasks:latest"],"sizeBytes":47161417},{"names":["k8s.gcr.io/coredns@sha256:2c8d61c46f484d881db43b34d13ca47a269336e576c81cf007ca740fa9ec0800","k8s.gcr.io/coredns:1.6.7"],"sizeBytes":43794147},{"names":["k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:be8875e5584750b7a490244ee56a121a714aa3d124164a5090cd8b3570c5650f","k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.8.1"],"sizeBytes":40684734},{"names":["k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b","k8s.gcr.io/metrics-server-amd64:v0.3.6"],"sizeBytes":39944451},{"names":["registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","registry.example.com/ce/utilities/mysql-client:latest"],"sizeBytes":38388577},{"names":["jtblin/kube2iam@sha256:92363f1c52fe5f433487b35c3f9c242e4733717ef7ac88c7137fc3824cfad4d3","jtblin/kube2iam:0.10.8"],"sizeBytes":34303129},{"names":["registry.example.com/ce/middleware/connect-operator@sha256:7e5df82e5a2fc470d4f647d42b6849477ac712799868c87db99bdb88c778746f","registry.example.com/ce/middleware/connect-operator:0.2.6"],"sizeBytes":32127859},{"names":["registry.example.com/ce/observability/kafka-minion@sha256:34e6a52c9cef9b5d01f704c07913bd13b37a3465ae50d3adf56dd9a0ffd1aea5","registry.example.com/ce/observability/kafka-minion:1.0.1"],"sizeBytes":19445889},{"names":["prom/mysqld-exporter@sha256:9f4fb61cca309cb4a8c1b9ed9fb4aa75af0f7a21f36d3954667db37c062a0172","prom/mysqld-exporter:v0.11.0"],"sizeBytes":17003848},{"names":["example/emq_exporter@sha256:1526c0476c1e5d740dfc4df36f3295ea27f87b41becf274c760fbd0a51011233","example/emq_exporter:v0.4.1"],"sizeBytes":11467840},{"names":["example/default-backend@sha256:14f15b1c7b037f32cc816e37259ffa386f2b0fdab5e48058b61323a389450f11","example/default-backend:latest"],"sizeBytes":5447342},{"names":["busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","busybox:latest"],"sizeBytes":1231733},{"names":["busybox@sha256:7964ad52e396a6e045c39b5a44438424ac52e12e4d5a25d94895f2058cb863a0","busybox:1.30.0"],"sizeBytes":1199417},{"names":["busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47","busybox:1.28.4"],"sizeBytes":1146369},{"names":["k8s.gcr.io/pause-amd64@sha256:4a1c4b21597c1b4415bdbecb28a3296c6b5e23ca4f9feeb599860a1dac6a0108","k8s.gcr.io/pause-amd64:3.2"],"sizeBytes":682696}],"volumesInUse":["kubernetes.io/aws-ebs/aws://us-east-1f/vol-069646aaf149403ec","kubernetes.io/aws-ebs/aws://us-east-1f/vol-09a7d97ad0391bab1","kubernetes.io/aws-ebs/aws://us-east-1f/vol-0ebef74c040715d7b"],"volumesAttached":[{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-069646aaf149403ec","devicePath":"/dev/xvdch"},{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-0ebef74c040715d7b","devicePath":"/dev/xvdce"},{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-09a7d97ad0391bab1","devicePath":"/dev/xvdcg"}]}}
I1104 15:55:00.346420 12586 request.go:1068] Request Body: {"spec":{"taints":[{"effect":"PreferNoSchedule","key":"kops.k8s.io/scheduled-for-update"}]}}
I1104 15:55:00.346453 12586 round_trippers.go:423] curl -k -v -XPATCH -H "Accept: application/json, */*" -H "Content-Type: application/strategic-merge-patch+json" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" 'https://api.example.com/api/v1/nodes/ip-10-40-45-241.ec2.internal'
I1104 15:55:00.520331 12586 round_trippers.go:443] PATCH https://api.example.com/api/v1/nodes/ip-10-40-45-241.ec2.internal 200 OK in 173 milliseconds
I1104 15:55:00.520360 12586 round_trippers.go:449] Response Headers:
I1104 15:55:00.520366 12586 round_trippers.go:452] Audit-Id: 0d712866-4e0f-4f93-aeca-65e40514d891
I1104 15:55:00.520372 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:00.520377 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:00 GMT
I1104 15:55:00.520469 12586 request.go:1068] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"ip-10-40-45-241.ec2.internal","selfLink":"/api/v1/nodes/ip-10-40-45-241.ec2.internal","uid":"33bf1cf2-1e96-11eb-9aff-16da7cad7b07","resourceVersion":"45489066","creationTimestamp":"2020-11-04T12:06:42Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/instance-type":"c5.xlarge","beta.kubernetes.io/os":"linux","failure-domain.beta.kubernetes.io/region":"us-east-1","failure-domain.beta.kubernetes.io/zone":"us-east-1f","kops.k8s.io/instancegroup":"nodes","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"ip-10-40-45-241.ec2.internal","kubernetes.io/os":"linux","kubernetes.io/role":"node","node-role.kubernetes.io/node":"","spotinst.io/node-lifecycle":"spot"},"annotations":{"node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"}},"spec":{"podCIDR":"100.96.111.0/24","providerID":"aws:///us-east-1f/i-091d1b1a0cf8a3486","taints":[{"key":"kops.k8s.io/scheduled-for-update","effect":"PreferNoSchedule"}]},"status":{"capacity":{"attachable-volumes-aws-ebs":"25","cpu":"4","ephemeral-storage":"130045936Ki","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"7807996Ki","pods":"58"},"allocatable":{"attachable-volumes-aws-ebs":"25","cpu":"4","ephemeral-storage":"119850334420","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"7705596Ki","pods":"58"},"conditions":[{"type":"MemoryPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:16Z","lastTransitionTime":"2020-11-04T12:06:42Z","reason":"KubeletHasSufficientMemory","message":"kubelet has sufficient memory available"},{"type":"DiskPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:16Z","lastTransitionTime":"2020-11-04T12:06:42Z","reason":"KubeletHasNoDiskPressure","message":"kubelet has no disk pressure"},{"type":"PIDPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:16Z","lastTransitionTime":"2020-11-04T12:06:42Z","reason":"KubeletHasSufficientPID","message":"kubelet has sufficient PID available"},{"type":"Ready","status":"True","lastHeartbeatTime":"2020-11-04T13:54:16Z","lastTransitionTime":"2020-11-04T12:07:22Z","reason":"KubeletReady","message":"kubelet is posting ready status. AppArmor enabled"}],"addresses":[{"type":"InternalIP","address":"10.40.45.241"},{"type":"InternalDNS","address":"ip-10-40-45-241.ec2.internal"},{"type":"Hostname","address":"ip-10-40-45-241.ec2.internal"}],"daemonEndpoints":{"kubeletEndpoint":{"Port":10250}},"nodeInfo":{"machineID":"ec24bda60e4af050185e3f297f0861eb","systemUUID":"EC24BDA6-0E4A-F050-185E-3F297F0861EB","bootID":"ce4d0187-9021-48d6-b39f-ea9771db9035","kernelVersion":"4.15.0-1039-aws","osImage":"Ubuntu 18.04.2 LTS","containerRuntimeVersion":"docker://18.6.3","kubeletVersion":"v1.14.2","kubeProxyVersion":"v1.14.2","operatingSystem":"linux","architecture":"amd64"},"images":[{"names":["registry.example.com/cybervision/pregsense-user-management-service@sha256:e487a407cfaa96fa00f4d40a71e2792d26db1ad72843d9302588d18b0fb23326","registry.example.com/cybervision/pregsense-user-management-service:2.0.0-37765"],"sizeBytes":1268651197},{"names":["registry.example.com/ce/utilities/kafka-manager@sha256:c04a2fcec27aca7a0e8c70105ebd4c5f960ca81d6d867d4d584bcab9b7173fbc","registry.example.com/ce/utilities/kafka-manager:2.0.0.2"],"sizeBytes":547394080},{"names":["registry.example.com/ce/middleware/cassandra@sha256:29ff685aae75edaae14d052e723a66fabbd8e6e9ede068bb4a901776ada3b493","registry.example.com/ce/middleware/cassandra:0.6.40"],"sizeBytes":384610888},{"names":["registry.example.com/cybervision/pregsense-mobile-device-service@sha256:057469801785596922de4ad1866a4d2f7e26271d925889f1533fe8cf06b0db51","registry.example.com/cybervision/pregsense-mobile-device-service:2.0.0-37577"],"sizeBytes":367804418},{"names":["registry.example.com/cybervision/usability-data-extractor-service@sha256:e22df292989e525a9339b690d6d6a8e14134bb5ea6a06235691c019e11135f51","registry.example.com/cybervision/usability-data-extractor-service:2.0.0-38072"],"sizeBytes":310003340},{"names":["registry.example.com/cybervision/pregsense-medex-service@sha256:a6a38353b3b4ee41627606873b884cabf0a37bd0d6afb9b5f823b0e64d988d5b","registry.example.com/cybervision/pregsense-medex-service:2.0.0-37573"],"sizeBytes":302750971},{"names":["602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni@sha256:a6d23b9fb3d4ba549321e32a28c42d8e79da203897072e93874472ab9e80b768","602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5"],"sizeBytes":263850871},{"names":["zookeeper@sha256:b7a76ec06f68fd9c801b72dfd283701bc7d8a8b0609277a0d570e8e6768e4ad9","zookeeper:3.5.5"],"sizeBytes":225210868},{"names":["k8s.gcr.io/kube-proxy@sha256:c91687ff6145f7fcdc7d8b3da3c530a9a9b50f0734c7a945a0d9c18fc3790dbc","k8s.gcr.io/kube-proxy:v1.14.2"],"sizeBytes":82106236},{"names":["registry.example.com/ce/utilities/cqlsh@sha256:36818e33bb74a5570efb254a468136d84f8520719e966927d0797ea512d9b073","registry.example.com/ce/utilities/cqlsh:latest"],"sizeBytes":74739843},{"names":["redis@sha256:f8c22abc77f3f9cc1c2516062e4a2a71375859d7922da3faf9e4160e6ba4c3c2","redis:5.0.3-alpine"],"sizeBytes":50831292},{"names":["example/kube-tasks@sha256:713a62fab6a3075227d6a53681e548bc7cdaa39143bb135c939cc9573fd66965","example/kube-tasks:latest"],"sizeBytes":47161417},{"names":["registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","registry.example.com/ce/utilities/mysql-client:latest"],"sizeBytes":38388577},{"names":["jtblin/kube2iam@sha256:92363f1c52fe5f433487b35c3f9c242e4733717ef7ac88c7137fc3824cfad4d3","jtblin/kube2iam:0.10.8"],"sizeBytes":34303129},{"names":["registry.example.com/ce/utilities/kt@sha256:a52550f941a9449ea205201f2c42d0352da5f70bf281d1d638944352781851b2","registry.example.com/ce/utilities/kt:latest"],"sizeBytes":22871156},{"names":["registry.example.com/ce/observability/kafka-minion@sha256:34e6a52c9cef9b5d01f704c07913bd13b37a3465ae50d3adf56dd9a0ffd1aea5","registry.example.com/ce/observability/kafka-minion:1.0.1"],"sizeBytes":19445889},{"names":["busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","busybox:latest"],"sizeBytes":1231733},{"names":["busybox@sha256:7964ad52e396a6e045c39b5a44438424ac52e12e4d5a25d94895f2058cb863a0","busybox:1.30.0"],"sizeBytes":1199417},{"names":["busybox@sha256:141c253bc4c3fd0a201d32dc1f493bcf3fff003b6df416dea4f41046e0f37d47","busybox:1.28.4"],"sizeBytes":1146369},{"names":["k8s.gcr.io/pause-amd64@sha256:4a1c4b21597c1b4415bdbecb28a3296c6b5e23ca4f9feeb599860a1dac6a0108","k8s.gcr.io/pause-amd64:3.2"],"sizeBytes":682696}],"volumesInUse":["kubernetes.io/aws-ebs/aws://us-east-1f/vol-05a535855fa31264f","kubernetes.io/aws-ebs/aws://us-east-1f/vol-05f9ce80197f24f96","kubernetes.io/aws-ebs/aws://us-east-1f/vol-0b17552f50ccb204e"],"volumesAttached":[{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-0b17552f50ccb204e","devicePath":"/dev/xvdca"},{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-05a535855fa31264f","devicePath":"/dev/xvdch"},{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-05f9ce80197f24f96","devicePath":"/dev/xvdce"}]}}
I1104 15:55:00.521278 12586 request.go:1068] Request Body: {"spec":{"taints":[{"effect":"PreferNoSchedule","key":"kops.k8s.io/scheduled-for-update"}]}}
I1104 15:55:00.521328 12586 round_trippers.go:423] curl -k -v -XPATCH -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Accept: application/json, */*" -H "Content-Type: application/strategic-merge-patch+json" -H "Authorization: Basic ******" 'https://api.example.com/api/v1/nodes/ip-10-40-42-110.ec2.internal'
I1104 15:55:00.726277 12586 round_trippers.go:443] PATCH https://api.example.com/api/v1/nodes/ip-10-40-42-110.ec2.internal 200 OK in 204 milliseconds
I1104 15:55:00.726308 12586 round_trippers.go:449] Response Headers:
I1104 15:55:00.726312 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:00 GMT
I1104 15:55:00.726316 12586 round_trippers.go:452] Audit-Id: 4a97f861-c6a5-4486-9317-35cc643aa23f
I1104 15:55:00.726320 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:00.726391 12586 request.go:1068] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"ip-10-40-42-110.ec2.internal","selfLink":"/api/v1/nodes/ip-10-40-42-110.ec2.internal","uid":"3d99698f-1e9c-11eb-9aff-16da7cad7b07","resourceVersion":"45489068","creationTimestamp":"2020-11-04T12:49:56Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/instance-type":"m5a.xlarge","beta.kubernetes.io/os":"linux","failure-domain.beta.kubernetes.io/region":"us-east-1","failure-domain.beta.kubernetes.io/zone":"us-east-1f","kops.k8s.io/instancegroup":"nodes","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"ip-10-40-42-110.ec2.internal","kubernetes.io/os":"linux","kubernetes.io/role":"node","node-role.kubernetes.io/node":"","spotinst.io/node-lifecycle":"spot"},"annotations":{"node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"}},"spec":{"podCIDR":"100.96.114.0/24","providerID":"aws:///us-east-1f/i-0b738537410c47ce9","taints":[{"key":"kops.k8s.io/scheduled-for-update","effect":"PreferNoSchedule"}]},"status":{"capacity":{"attachable-volumes-aws-ebs":"25","cpu":"4","ephemeral-storage":"130045936Ki","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"16038900Ki","pods":"58"},"allocatable":{"attachable-volumes-aws-ebs":"25","cpu":"4","ephemeral-storage":"119850334420","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"15936500Ki","pods":"58"},"conditions":[{"type":"MemoryPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:28Z","lastTransitionTime":"2020-11-04T12:49:56Z","reason":"KubeletHasSufficientMemory","message":"kubelet has sufficient memory available"},{"type":"DiskPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:28Z","lastTransitionTime":"2020-11-04T12:49:56Z","reason":"KubeletHasNoDiskPressure","message":"kubelet has no disk pressure"},{"type":"PIDPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:28Z","lastTransitionTime":"2020-11-04T12:49:56Z","reason":"KubeletHasSufficientPID","message":"kubelet has sufficient PID available"},{"type":"Ready","status":"True","lastHeartbeatTime":"2020-11-04T13:54:28Z","lastTransitionTime":"2020-11-04T12:50:16Z","reason":"KubeletReady","message":"kubelet is posting ready status. AppArmor enabled"}],"addresses":[{"type":"InternalIP","address":"10.40.42.110"},{"type":"InternalDNS","address":"ip-10-40-42-110.ec2.internal"},{"type":"Hostname","address":"ip-10-40-42-110.ec2.internal"}],"daemonEndpoints":{"kubeletEndpoint":{"Port":10250}},"nodeInfo":{"machineID":"ec2b9b820e177da80fbd1e4c85bbf31a","systemUUID":"EC2B9B82-0E17-7DA8-0FBD-1E4C85BBF31A","bootID":"ffffbb68-1815-42b8-bf09-86fce9b807c5","kernelVersion":"4.15.0-1039-aws","osImage":"Ubuntu 18.04.2 LTS","containerRuntimeVersion":"docker://18.6.3","kubeletVersion":"v1.14.2","kubeProxyVersion":"v1.14.2","operatingSystem":"linux","architecture":"amd64"},"images":[{"names":["registry.example.com/cybervision/pregsense-monitoring-session-service@sha256:eedc23e0c6848e90c6725ea2e0f821a9911a8651cdf964b48a818526c6154d99","registry.example.com/cybervision/pregsense-monitoring-session-service:2.0.0-37729"],"sizeBytes":916680232},{"names":["confluentinc/cp-ksql-server@sha256:a0b75d2f9926ac31139b2bebff3ac95a24e9f08465176aef16ed3c481b39a297","confluentinc/cp-ksql-server:5.2.2"],"sizeBytes":524657779},{"names":["registry.example.com/cybervision/pregsense-mail-service@sha256:633a2b3faf69477dfd745b83def6689077641309c1092121edb215bcfec06d8d","registry.example.com/cybervision/pregsense-mail-service:1.1.0-38167"],"sizeBytes":331982846},{"names":["registry.example.com/cybervision/pregsense-geo-service@sha256:9e44ea04116b0dad47c7774c04666e6a74de49e252ebd2b3f3d562ce63bf9bbc","registry.example.com/cybervision/pregsense-geo-service:2.0.0-37561"],"sizeBytes":298502628},{"names":["example/jmx-prometheus-httpserver@sha256:725e8a9bfec05f432b931edc11b1ee8bac3895e408bb91af58266dc88ee4e63b","example/jmx-prometheus-httpserver:0.11.0"],"sizeBytes":273954021},{"names":["registry.example.com/ce/middleware/kafka@sha256:5a13ea153f26ac29e73fd3a0ed67c701f33ea761a0b10a03870fdda51e3975cc","registry.example.com/ce/middleware/kafka:0.6.33"],"sizeBytes":269199283},{"names":["602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni@sha256:a6d23b9fb3d4ba549321e32a28c42d8e79da203897072e93874472ab9e80b768","602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5"],"sizeBytes":263850871},{"names":["registry.example.com/cybervision/invu-web/pro@sha256:4a75e40bc1774e59e805ff68e713542d6c839e54e550b21688f9b23ec401de28","registry.example.com/cybervision/invu-web/pro:2.0.0-38041"],"sizeBytes":107688818},{"names":["k8s.gcr.io/kube-proxy@sha256:c91687ff6145f7fcdc7d8b3da3c530a9a9b50f0734c7a945a0d9c18fc3790dbc","k8s.gcr.io/kube-proxy:v1.14.2"],"sizeBytes":82106236},{"names":["registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","registry.example.com/ce/utilities/mysql-client:latest"],"sizeBytes":38388577},{"names":["jtblin/kube2iam@sha256:92363f1c52fe5f433487b35c3f9c242e4733717ef7ac88c7137fc3824cfad4d3","jtblin/kube2iam:0.10.8"],"sizeBytes":34303129},{"names":["registry.example.com/ce/utilities/kt@sha256:a52550f941a9449ea205201f2c42d0352da5f70bf281d1d638944352781851b2","registry.example.com/ce/utilities/kt:latest"],"sizeBytes":22871156},{"names":["busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","busybox:latest"],"sizeBytes":1231733},{"names":["k8s.gcr.io/pause-amd64@sha256:4a1c4b21597c1b4415bdbecb28a3296c6b5e23ca4f9feeb599860a1dac6a0108","k8s.gcr.io/pause-amd64:3.2"],"sizeBytes":682696}],"volumesInUse":["kubernetes.io/aws-ebs/aws://us-east-1f/vol-04eda9d82d6dabadd"],"volumesAttached":[{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-04eda9d82d6dabadd","devicePath":"/dev/xvdbn"}]}}
I1104 15:55:00.726933 12586 request.go:1068] Request Body: {"spec":{"taints":[{"effect":"PreferNoSchedule","key":"kops.k8s.io/scheduled-for-update"}]}}
I1104 15:55:00.726970 12586 round_trippers.go:423] curl -k -v -XPATCH -H "Accept: application/json, */*" -H "Content-Type: application/strategic-merge-patch+json" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" 'https://api.example.com/api/v1/nodes/ip-10-40-55-41.ec2.internal'
I1104 15:55:00.929926 12586 round_trippers.go:443] PATCH https://api.example.com/api/v1/nodes/ip-10-40-55-41.ec2.internal 200 OK in 202 milliseconds
I1104 15:55:00.929958 12586 round_trippers.go:449] Response Headers:
I1104 15:55:00.929964 12586 round_trippers.go:452] Audit-Id: 1af59736-af89-4d78-9217-fb982a619047
I1104 15:55:00.929968 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:00.929972 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:00 GMT
I1104 15:55:00.930034 12586 request.go:1068] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"ip-10-40-55-41.ec2.internal","selfLink":"/api/v1/nodes/ip-10-40-55-41.ec2.internal","uid":"b4f79ec1-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45489069","creationTimestamp":"2020-11-04T12:46:06Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/instance-type":"t3.xlarge","beta.kubernetes.io/os":"linux","failure-domain.beta.kubernetes.io/region":"us-east-1","failure-domain.beta.kubernetes.io/zone":"us-east-1f","kops.k8s.io/instancegroup":"nodes","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"ip-10-40-55-41.ec2.internal","kubernetes.io/os":"linux","kubernetes.io/role":"node","node-role.kubernetes.io/node":"","spotinst.io/node-lifecycle":"spot"},"annotations":{"node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"}},"spec":{"podCIDR":"100.96.113.0/24","providerID":"aws:///us-east-1f/i-07759285ebe2a969d","taints":[{"key":"kops.k8s.io/scheduled-for-update","effect":"PreferNoSchedule"}]},"status":{"capacity":{"attachable-volumes-aws-ebs":"25","cpu":"4","ephemeral-storage":"130045936Ki","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"16235512Ki","pods":"58"},"allocatable":{"attachable-volumes-aws-ebs":"25","cpu":"4","ephemeral-storage":"119850334420","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"16133112Ki","pods":"58"},"conditions":[{"type":"MemoryPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:09Z","lastTransitionTime":"2020-11-04T12:46:06Z","reason":"KubeletHasSufficientMemory","message":"kubelet has sufficient memory available"},{"type":"DiskPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:09Z","lastTransitionTime":"2020-11-04T12:46:06Z","reason":"KubeletHasNoDiskPressure","message":"kubelet has no disk pressure"},{"type":"PIDPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:09Z","lastTransitionTime":"2020-11-04T12:46:06Z","reason":"KubeletHasSufficientPID","message":"kubelet has sufficient PID available"},{"type":"Ready","status":"True","lastHeartbeatTime":"2020-11-04T13:54:09Z","lastTransitionTime":"2020-11-04T12:46:27Z","reason":"KubeletReady","message":"kubelet is posting ready status. AppArmor enabled"}],"addresses":[{"type":"InternalIP","address":"10.40.55.41"},{"type":"InternalDNS","address":"ip-10-40-55-41.ec2.internal"},{"type":"Hostname","address":"ip-10-40-55-41.ec2.internal"}],"daemonEndpoints":{"kubeletEndpoint":{"Port":10250}},"nodeInfo":{"machineID":"ec21154ae839a2204770777d165a898f","systemUUID":"EC21154A-E839-A220-4770-777D165A898F","bootID":"f2e8e581-1789-4138-bd5c-7c60dfa26880","kernelVersion":"4.15.0-1039-aws","osImage":"Ubuntu 18.04.2 LTS","containerRuntimeVersion":"docker://18.6.3","kubeletVersion":"v1.14.2","kubeProxyVersion":"v1.14.2","operatingSystem":"linux","architecture":"amd64"},"images":[{"names":["registry.example.com/cybervision/invu-kafka-connect-sinks/kafka-connect@sha256:6a584826ecf0bbdf654fbe27201e2ed07d5586bd6f0c414c13be40ac3f6cc62f","registry.example.com/cybervision/invu-kafka-connect-sinks/kafka-connect:2.0.0-37698"],"sizeBytes":643296613},{"names":["registry.example.com/ce/middleware/cassandra@sha256:29ff685aae75edaae14d052e723a66fabbd8e6e9ede068bb4a901776ada3b493","registry.example.com/ce/middleware/cassandra:0.6.40"],"sizeBytes":384610888},{"names":["registry.example.com/cybervision/pregsense-device-service@sha256:ccdcd8bec0cc02d64da785a6ae863b31e335e28f089a92f071affaee5ec1a2cb","registry.example.com/cybervision/pregsense-device-service:2.0.0-37554"],"sizeBytes":321951523},{"names":["registry.example.com/ce/middleware/kafka@sha256:5a13ea153f26ac29e73fd3a0ed67c701f33ea761a0b10a03870fdda51e3975cc","registry.example.com/ce/middleware/kafka:0.6.33"],"sizeBytes":269199283},{"names":["602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni@sha256:a6d23b9fb3d4ba549321e32a28c42d8e79da203897072e93874472ab9e80b768","602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5"],"sizeBytes":263850871},{"names":["k8s.gcr.io/kube-proxy@sha256:c91687ff6145f7fcdc7d8b3da3c530a9a9b50f0734c7a945a0d9c18fc3790dbc","k8s.gcr.io/kube-proxy:v1.14.2"],"sizeBytes":82106236},{"names":["registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","registry.example.com/ce/utilities/mysql-client:latest"],"sizeBytes":38388577},{"names":["jtblin/kube2iam@sha256:92363f1c52fe5f433487b35c3f9c242e4733717ef7ac88c7137fc3824cfad4d3","jtblin/kube2iam:0.10.8"],"sizeBytes":34303129},{"names":["busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","busybox:latest"],"sizeBytes":1231733},{"names":["busybox@sha256:7964ad52e396a6e045c39b5a44438424ac52e12e4d5a25d94895f2058cb863a0","busybox:1.30.0"],"sizeBytes":1199417},{"names":["k8s.gcr.io/pause-amd64@sha256:4a1c4b21597c1b4415bdbecb28a3296c6b5e23ca4f9feeb599860a1dac6a0108","k8s.gcr.io/pause-amd64:3.2"],"sizeBytes":682696}],"volumesInUse":["kubernetes.io/aws-ebs/aws://us-east-1f/vol-093bc9911e6b69ad5","kubernetes.io/aws-ebs/aws://us-east-1f/vol-0aa3e57d85128ef60"],"volumesAttached":[{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-093bc9911e6b69ad5","devicePath":"/dev/xvdbp"},{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-0aa3e57d85128ef60","devicePath":"/dev/xvdcc"}]}}
I1104 15:55:00.930551 12586 request.go:1068] Request Body: {"spec":{"taints":[{"effect":"PreferNoSchedule","key":"kops.k8s.io/scheduled-for-update"}]}}
I1104 15:55:00.930582 12586 round_trippers.go:423] curl -k -v -XPATCH -H "Accept: application/json, */*" -H "Content-Type: application/strategic-merge-patch+json" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" 'https://api.example.com/api/v1/nodes/ip-10-40-57-245.ec2.internal'
I1104 15:55:01.080805 12586 round_trippers.go:443] PATCH https://api.example.com/api/v1/nodes/ip-10-40-57-245.ec2.internal 200 OK in 150 milliseconds
I1104 15:55:01.080830 12586 round_trippers.go:449] Response Headers:
I1104 15:55:01.080834 12586 round_trippers.go:452] Audit-Id: 0be967d9-1f00-44a9-b2d2-8a6bbaed31ad
I1104 15:55:01.080837 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:01.080840 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:00 GMT
I1104 15:55:01.082722 12586 request.go:1068] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"ip-10-40-57-245.ec2.internal","selfLink":"/api/v1/nodes/ip-10-40-57-245.ec2.internal","uid":"b7917ff0-1e95-11eb-9aff-16da7cad7b07","resourceVersion":"45489070","creationTimestamp":"2020-11-04T12:03:14Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/instance-type":"t3a.medium","beta.kubernetes.io/os":"linux","failure-domain.beta.kubernetes.io/region":"us-east-1","failure-domain.beta.kubernetes.io/zone":"us-east-1f","kops.k8s.io/instancegroup":"nodes","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"ip-10-40-57-245.ec2.internal","kubernetes.io/os":"linux","kubernetes.io/role":"node","node-role.kubernetes.io/node":"","spotinst.io/node-lifecycle":"spot"},"annotations":{"node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"}},"spec":{"podCIDR":"100.96.107.0/24","providerID":"aws:///us-east-1f/i-0deead86f7d952607","taints":[{"key":"kops.k8s.io/scheduled-for-update","effect":"PreferNoSchedule"}]},"status":{"capacity":{"attachable-volumes-aws-ebs":"25","cpu":"2","ephemeral-storage":"130045936Ki","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"3990892Ki","pods":"17"},"allocatable":{"attachable-volumes-aws-ebs":"25","cpu":"2","ephemeral-storage":"119850334420","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"3888492Ki","pods":"17"},"conditions":[{"type":"MemoryPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:49Z","lastTransitionTime":"2020-11-04T12:03:14Z","reason":"KubeletHasSufficientMemory","message":"kubelet has sufficient memory available"},{"type":"DiskPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:49Z","lastTransitionTime":"2020-11-04T12:03:14Z","reason":"KubeletHasNoDiskPressure","message":"kubelet has no disk pressure"},{"type":"PIDPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:49Z","lastTransitionTime":"2020-11-04T12:03:14Z","reason":"KubeletHasSufficientPID","message":"kubelet has sufficient PID available"},{"type":"Ready","status":"True","lastHeartbeatTime":"2020-11-04T13:54:49Z","lastTransitionTime":"2020-11-04T12:03:34Z","reason":"KubeletReady","message":"kubelet is posting ready status. AppArmor enabled"}],"addresses":[{"type":"InternalIP","address":"10.40.57.245"},{"type":"InternalDNS","address":"ip-10-40-57-245.ec2.internal"},{"type":"Hostname","address":"ip-10-40-57-245.ec2.internal"}],"daemonEndpoints":{"kubeletEndpoint":{"Port":10250}},"nodeInfo":{"machineID":"ec2d967bf15437edf65a244bceea6ecc","systemUUID":"EC2D967B-F154-37ED-F65A-244BCEEA6ECC","bootID":"924eea63-f8c3-4e69-8932-c2622c6c300d","kernelVersion":"4.15.0-1039-aws","osImage":"Ubuntu 18.04.2 LTS","containerRuntimeVersion":"docker://18.6.3","kubeletVersion":"v1.14.2","kubeProxyVersion":"v1.14.2","operatingSystem":"linux","architecture":"amd64"},"images":[{"names":["registry.example.com/cybervision/pregsense-gateway-service@sha256:ba2b7c16fd295c73ab75edee8808ffd8758c01ad0bd74d394aa7b3395f61d4ad","registry.example.com/cybervision/pregsense-gateway-service:2.0.0-38164"],"sizeBytes":339009338},{"names":["registry.example.com/cybervision/pregsense-auth-service@sha256:96526bbbd74cffab866d7cdf38ccc23cc59228a95d6d6c10d28f4ee056f7f4d0","registry.example.com/cybervision/pregsense-auth-service:2.0.0-37888"],"sizeBytes":333981635},{"names":["registry.example.com/cybervision/pregsense-activity-service@sha256:52a50e96512249156c779d18a5aecc8082e2829221ecd3bc635401bf76ab9c61","registry.example.com/cybervision/pregsense-activity-service:2.0.0-37549"],"sizeBytes":325759251},{"names":["registry.example.com/cybervision/pregsense-geo-service@sha256:9e44ea04116b0dad47c7774c04666e6a74de49e252ebd2b3f3d562ce63bf9bbc","registry.example.com/cybervision/pregsense-geo-service:2.0.0-37561"],"sizeBytes":298502628},{"names":["602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni@sha256:a6d23b9fb3d4ba549321e32a28c42d8e79da203897072e93874472ab9e80b768","602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5"],"sizeBytes":263850871},{"names":["zookeeper@sha256:b7a76ec06f68fd9c801b72dfd283701bc7d8a8b0609277a0d570e8e6768e4ad9","zookeeper:3.5.5"],"sizeBytes":225210868},{"names":["emqx/emqx@sha256:3f31ee2793b4446e98183659b4493992355e2b0d8603df946c641b47f29ced78","emqx/emqx:v3.2.7"],"sizeBytes":89389623},{"names":["k8s.gcr.io/kube-proxy@sha256:c91687ff6145f7fcdc7d8b3da3c530a9a9b50f0734c7a945a0d9c18fc3790dbc","k8s.gcr.io/kube-proxy:v1.14.2"],"sizeBytes":82106236},{"names":["registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","registry.example.com/ce/utilities/mysql-client:latest"],"sizeBytes":38388577},{"names":["jtblin/kube2iam@sha256:92363f1c52fe5f433487b35c3f9c242e4733717ef7ac88c7137fc3824cfad4d3","jtblin/kube2iam:0.10.8"],"sizeBytes":34303129},{"names":["example/emq_exporter@sha256:1526c0476c1e5d740dfc4df36f3295ea27f87b41becf274c760fbd0a51011233","example/emq_exporter:v0.4.1"],"sizeBytes":11467840},{"names":["busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","busybox:latest"],"sizeBytes":1231733},{"names":["k8s.gcr.io/pause-amd64@sha256:4a1c4b21597c1b4415bdbecb28a3296c6b5e23ca4f9feeb599860a1dac6a0108","k8s.gcr.io/pause-amd64:3.2"],"sizeBytes":682696}],"volumesInUse":["kubernetes.io/aws-ebs/aws://us-east-1f/vol-032d1079efa034f3c"],"volumesAttached":[{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-032d1079efa034f3c","devicePath":"/dev/xvdcx"}]}}
I1104 15:55:01.082885 12586 instancegroups.go:340] Draining the node: "ip-10-40-56-27.ec2.internal".
I1104 15:55:01.083293 12586 request.go:1068] Request Body: {"spec":{"unschedulable":true}}
I1104 15:55:01.083326 12586 round_trippers.go:423] curl -k -v -XPATCH -H "Authorization: Basic ******" -H "Accept: application/json, */*" -H "Content-Type: application/strategic-merge-patch+json" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" 'https://api.example.com/api/v1/nodes/ip-10-40-56-27.ec2.internal'
I1104 15:55:01.235602 12586 round_trippers.go:443] PATCH https://api.example.com/api/v1/nodes/ip-10-40-56-27.ec2.internal 200 OK in 152 milliseconds
I1104 15:55:01.235630 12586 round_trippers.go:449] Response Headers:
I1104 15:55:01.235636 12586 round_trippers.go:452] Audit-Id: 5442fbc8-c434-4040-8ecf-49c99b998811
I1104 15:55:01.235641 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:01.235645 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:01 GMT
I1104 15:55:01.235719 12586 request.go:1068] Response Body: {"kind":"Node","apiVersion":"v1","metadata":{"name":"ip-10-40-56-27.ec2.internal","selfLink":"/api/v1/nodes/ip-10-40-56-27.ec2.internal","uid":"21d0f8a8-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45489071","creationTimestamp":"2020-11-04T12:42:00Z","labels":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/instance-type":"t3a.xlarge","beta.kubernetes.io/os":"linux","failure-domain.beta.kubernetes.io/region":"us-east-1","failure-domain.beta.kubernetes.io/zone":"us-east-1f","kops.k8s.io/instancegroup":"nodes","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"ip-10-40-56-27.ec2.internal","kubernetes.io/os":"linux","kubernetes.io/role":"node","node-role.kubernetes.io/node":"","spotinst.io/node-lifecycle":"spot"},"annotations":{"node.alpha.kubernetes.io/ttl":"0","volumes.kubernetes.io/controller-managed-attach-detach":"true"}},"spec":{"podCIDR":"100.96.112.0/24","providerID":"aws:///us-east-1f/i-036e06b204f56f316","unschedulable":true,"taints":[{"key":"kops.k8s.io/scheduled-for-update","effect":"PreferNoSchedule"}]},"status":{"capacity":{"attachable-volumes-aws-ebs":"25","cpu":"4","ephemeral-storage":"130045936Ki","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"16280568Ki","pods":"58"},"allocatable":{"attachable-volumes-aws-ebs":"25","cpu":"4","ephemeral-storage":"119850334420","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"16178168Ki","pods":"58"},"conditions":[{"type":"MemoryPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:03Z","lastTransitionTime":"2020-11-04T12:42:00Z","reason":"KubeletHasSufficientMemory","message":"kubelet has sufficient memory available"},{"type":"DiskPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:03Z","lastTransitionTime":"2020-11-04T12:42:00Z","reason":"KubeletHasNoDiskPressure","message":"kubelet has no disk pressure"},{"type":"PIDPressure","status":"False","lastHeartbeatTime":"2020-11-04T13:54:03Z","lastTransitionTime":"2020-11-04T12:42:00Z","reason":"KubeletHasSufficientPID","message":"kubelet has sufficient PID available"},{"type":"Ready","status":"True","lastHeartbeatTime":"2020-11-04T13:54:03Z","lastTransitionTime":"2020-11-04T12:42:50Z","reason":"KubeletReady","message":"kubelet is posting ready status. AppArmor enabled"}],"addresses":[{"type":"InternalIP","address":"10.40.56.27"},{"type":"InternalDNS","address":"ip-10-40-56-27.ec2.internal"},{"type":"Hostname","address":"ip-10-40-56-27.ec2.internal"}],"daemonEndpoints":{"kubeletEndpoint":{"Port":10250}},"nodeInfo":{"machineID":"ec2fa63e40c54f665cbfe09ae4ec16d9","systemUUID":"EC2FA63E-40C5-4F66-5CBF-E09AE4EC16D9","bootID":"f2e9e82a-9b29-4591-a662-9fe3f838585e","kernelVersion":"4.15.0-1039-aws","osImage":"Ubuntu 18.04.2 LTS","containerRuntimeVersion":"docker://18.6.3","kubeletVersion":"v1.14.2","kubeProxyVersion":"v1.14.2","operatingSystem":"linux","architecture":"amd64"},"images":[{"names":["confluentinc/cp-schema-registry@sha256:0d7a84d486477a0c203ae21d5d52c40d26e810f5b5cfa27a56274692b70949f5","confluentinc/cp-schema-registry:5.2.2"],"sizeBytes":746078624},{"names":["registry.example.com/cybervision/invu-kafka-connect-sinks/kafka-connect@sha256:6a584826ecf0bbdf654fbe27201e2ed07d5586bd6f0c414c13be40ac3f6cc62f","registry.example.com/cybervision/invu-kafka-connect-sinks/kafka-connect:2.0.0-37698"],"sizeBytes":643296613},{"names":["confluentinc/cp-ksql-server@sha256:a0b75d2f9926ac31139b2bebff3ac95a24e9f08465176aef16ed3c481b39a297","confluentinc/cp-ksql-server:5.2.2"],"sizeBytes":524657779},{"names":["registry.example.com/ce/middleware/mariadb@sha256:b4c12c27093137dbf047773d4ddb99676bedd32c8606bfa1e3c50876d5ce659f","registry.example.com/ce/middleware/mariadb:0.6.56"],"sizeBytes":373763438},{"names":["registry.example.com/cybervision/invu-infrastructure-service@sha256:00f75459b2ee50deb47884131608f73108158d4faa085d1a5cc237aacd3f2112","registry.example.com/cybervision/invu-infrastructure-service:2.0.0-37566"],"sizeBytes":312358195},{"names":["example/jmx-prometheus-httpserver@sha256:725e8a9bfec05f432b931edc11b1ee8bac3895e408bb91af58266dc88ee4e63b","example/jmx-prometheus-httpserver:0.11.0"],"sizeBytes":273954021},{"names":["registry.example.com/ce/middleware/kafka@sha256:5a13ea153f26ac29e73fd3a0ed67c701f33ea761a0b10a03870fdda51e3975cc","registry.example.com/ce/middleware/kafka:0.6.33"],"sizeBytes":269199283},{"names":["602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni@sha256:a6d23b9fb3d4ba549321e32a28c42d8e79da203897072e93874472ab9e80b768","602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5"],"sizeBytes":263850871},{"names":["emqx/emqx@sha256:3f31ee2793b4446e98183659b4493992355e2b0d8603df946c641b47f29ced78","emqx/emqx:v3.2.7"],"sizeBytes":89389623},{"names":["k8s.gcr.io/kube-proxy@sha256:c91687ff6145f7fcdc7d8b3da3c530a9a9b50f0734c7a945a0d9c18fc3790dbc","k8s.gcr.io/kube-proxy:v1.14.2"],"sizeBytes":82106236},{"names":["registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","registry.example.com/ce/utilities/mysql-client:latest"],"sizeBytes":38388577},{"names":["jtblin/kube2iam@sha256:92363f1c52fe5f433487b35c3f9c242e4733717ef7ac88c7137fc3824cfad4d3","jtblin/kube2iam:0.10.8"],"sizeBytes":34303129},{"names":["registry.example.com/ce/utilities/kt@sha256:a52550f941a9449ea205201f2c42d0352da5f70bf281d1d638944352781851b2","registry.example.com/ce/utilities/kt:latest"],"sizeBytes":22871156},{"names":["prom/mysqld-exporter@sha256:9f4fb61cca309cb4a8c1b9ed9fb4aa75af0f7a21f36d3954667db37c062a0172","prom/mysqld-exporter:v0.11.0"],"sizeBytes":17003848},{"names":["example/emq_exporter@sha256:1526c0476c1e5d740dfc4df36f3295ea27f87b41becf274c760fbd0a51011233","example/emq_exporter:v0.4.1"],"sizeBytes":11467840},{"names":["busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","busybox:latest"],"sizeBytes":1231733},{"names":["k8s.gcr.io/pause-amd64@sha256:4a1c4b21597c1b4415bdbecb28a3296c6b5e23ca4f9feeb599860a1dac6a0108","k8s.gcr.io/pause-amd64:3.2"],"sizeBytes":682696}],"volumesInUse":["kubernetes.io/aws-ebs/aws://us-east-1f/vol-0153f8347ff8a2cd1","kubernetes.io/aws-ebs/aws://us-east-1f/vol-0cb2890c3adac40d4"],"volumesAttached":[{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-0153f8347ff8a2cd1","devicePath":"/dev/xvdbj"},{"name":"kubernetes.io/aws-ebs/aws://us-east-1f/vol-0cb2890c3adac40d4","devicePath":"/dev/xvdcd"}]}}
I1104 15:55:01.236039 12586 round_trippers.go:423] curl -k -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" 'https://api.example.com/api/v1/pods?fieldSelector=spec.nodeName%3Dip-10-40-56-27.ec2.internal'
I1104 15:55:01.443087 12586 round_trippers.go:443] GET https://api.example.com/api/v1/pods?fieldSelector=spec.nodeName%3Dip-10-40-56-27.ec2.internal 200 OK in 207 milliseconds
I1104 15:55:01.443137 12586 round_trippers.go:449] Response Headers:
I1104 15:55:01.443164 12586 round_trippers.go:452] Audit-Id: 033ede1c-5cf8-4782-86fc-e75263eac2c3
I1104 15:55:01.443174 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:01.443184 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:01 GMT
I1104 15:55:01.443749 12586 request.go:1068] Response Body: {"kind":"PodList","apiVersion":"v1","metadata":{"selfLink":"/api/v1/pods","resourceVersion":"45489072"},"items":[{"metadata":{"name":"emqx-758448bfd5-h7s9j","generateName":"emqx-758448bfd5-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/emqx-758448bfd5-h7s9j","uid":"7540f9d4-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45477000","creationTimestamp":"2020-11-04T12:44:20Z","labels":{"app.kubernetes.io/name":"emqx","app.kubernetes.io/part-of":"invu-sre-emqx","pod-template-hash":"758448bfd5"},"annotations":{"prometheus.io/port":"9540","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"emqx-758448bfd5","uid":"753f9db6-1e9b-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"data","configMap":{"name":"emqx","items":[{"key":"loaded_plugins","path":"loaded_plugins"}],"defaultMode":420}},{"name":"plugins","configMap":{"name":"emqx","items":[{"key":"emqx_auth_username.conf","path":"emqx_auth_username.conf"},{"key":"emqx_auth_jwt.conf","path":"emqx_auth_jwt.conf"}],"defaultMode":420}},{"name":"certs","configMap":{"name":"emqx","items":[{"key":"jwt_public_key.pem","path":"jwt_public_key.pem"}],"defaultMode":420}},{"name":"emqx-token-nf8kx","secret":{"secretName":"emqx-token-nf8kx","defaultMode":420}}],"containers":[{"name":"exporter","image":"example/emq_exporter:v0.4.1","args":["--emq.node=emqx@$(POD_IP)","--emq.api-version=v3"],"ports":[{"name":"metrics","containerPort":9540,"protocol":"TCP"}],"env":[{"name":"EMQ_USERNAME","value":"admin"},{"name":"EMQ_PASSWORD","valueFrom":{"secretKeyRef":{"name":"emqx","key":"admin_password"}}},{"name":"POD_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}}],"resources":{"limits":{"cpu":"50m","memory":"64Mi"},"requests":{"cpu":"15m","memory":"32Mi"}},"volumeMounts":[{"name":"emqx-token-nf8kx","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"},{"name":"emqx","image":"emqx/emqx:v3.2.7","ports":[{"name":"mqtt","containerPort":1883,"protocol":"TCP"},{"name":"websocket","containerPort":8083,"protocol":"TCP"},{"name":"mgmt","containerPort":8080,"protocol":"TCP"},{"name":"dashboard","containerPort":18083,"protocol":"TCP"}],"env":[{"name":"EMQ_NODE__COOKIE","valueFrom":{"secretKeyRef":{"name":"emqx","key":"node_cookie"}}},{"name":"EMQX_DASHBOARD__DEFAULT_USER__PASSWORD","valueFrom":{"secretKeyRef":{"name":"emqx","key":"admin_password"}}},{"name":"EMQX_ALLOW_ANONYMOUS","value":"false"},{"name":"EMQX_CLUSTER__AUTOCLEAN","value":"5m"},{"name":"EMQX_CLUSTER__AUTOHEAL","value":"on"},{"name":"EMQX_CLUSTER__DISCOVERY","value":"k8s"},{"name":"EMQX_CLUSTER__K8S__ADDRESS_TYPE","value":"ip"},{"name":"EMQX_CLUSTER__K8S__APISERVER","value":"https://kubernetes.default.svc.cluster.local:443"},{"name":"EMQX_CLUSTER__K8S__APP_NAME","value":"emqx"},{"name":"EMQX_CLUSTER__K8S__NAMESPACE","value":"invu-sre"},{"name":"EMQX_CLUSTER__K8S__SERVICE_NAME","value":"emqx"},{"name":"EMQX_CLUSTER__NAME","value":"emqx_cluster"},{"name":"EMQX_MQTT__MAX_PACKET_SIZE","value":"10MB"},{"name":"EMQX_NAME","value":"emqx"}],"resources":{"limits":{"cpu":"500m","memory":"512Mi"},"requests":{"cpu":"200m","memory":"256Mi"}},"volumeMounts":[{"name":"data","mountPath":"/opt/emqx/data/loaded_plugins","subPath":"loaded_plugins"},{"name":"plugins","mountPath":"/opt/emqx/etc/plugins/emqx_auth_username.conf","subPath":"emqx_auth_username.conf"},{"name":"plugins","mountPath":"/opt/emqx/etc/plugins/emqx_auth_jwt.conf","subPath":"emqx_auth_jwt.conf"},{"name":"certs","mountPath":"/opt/emqx/etc/certs/jwt_public_key.pem","subPath":"jwt_public_key.pem"},{"name":"emqx-token-nf8kx","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"exec":{"command":["/bin/sh","-c","emqx_ctl status | grep 'is running'"]},"initialDelaySeconds":45,"timeoutSeconds":1,"periodSeconds":15,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"exec":{"command":["/bin/sh","-c","emqx_ctl status | grep 'is running'"]},"initialDelaySeconds":45,"timeoutSeconds":1,"periodSeconds":15,"successThreshold":1,"failureThreshold":3},"lifecycle":{"preStop":{"exec":{"command":["/bin/sh","-c","emqx stop"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"runAsUser":1000,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"emqx","serviceAccount":"emqx","nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}],"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":100,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"kubernetes.io/hostname"}}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["emqx"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:20Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:45:16Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:45:16Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:20Z"}],"hostIP":"10.40.56.27","podIP":"10.40.32.131","startTime":"2020-11-04T12:44:20Z","containerStatuses":[{"name":"emqx","state":{"running":{"startedAt":"2020-11-04T12:44:26Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"emqx/emqx:v3.2.7","imageID":"docker-pullable://emqx/emqx@sha256:3f31ee2793b4446e98183659b4493992355e2b0d8603df946c641b47f29ced78","containerID":"docker://974f27ae72445d1d6506dd99933c36122005477e60125d19123b9c633295a6e6"},{"name":"exporter","state":{"running":{"startedAt":"2020-11-04T12:44:23Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"example/emq_exporter:v0.4.1","imageID":"docker-pullable://example/emq_exporter@sha256:1526c0476c1e5d740dfc4df36f3295ea27f87b41becf274c760fbd0a51011233","containerID":"docker://f3270342707cf0eb993e24680050991e5bb867a885b32fddd01c81db07c7ab54"}],"qosClass":"Burstable"}},{"metadata":{"name":"infrastructure-service-5b8746775c-v98mn","generateName":"infrastructure-service-5b8746775c-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/infrastructure-service-5b8746775c-v98mn","uid":"fc2f3532-1e9f-11eb-9aff-16da7cad7b07","resourceVersion":"45482822","creationTimestamp":"2020-11-04T13:16:44Z","labels":{"app":"infrastructure-service","pod-template-hash":"5b8746775c","release":"invu-sre-infrastructure-service"},"annotations":{"iam.amazonaws.com/role":"invu-sre-objects-access"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"infrastructure-service-5b8746775c","uid":"fc2d93cc-1e9f-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-kvb6j","secret":{"secretName":"default-token-kvb6j","defaultMode":420}}],"initContainers":[{"name":"mysql-client","image":"registry.example.com/ce/utilities/mysql-client","env":[{"name":"DATABASE_NAME","value":"invu_infrastructure_service"},{"name":"MYSQL_USER","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MYSQL_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}}],"resources":{},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"infrastructure-service","image":"registry.example.com/cybervision/invu-infrastructure-service:2.0.0-37566","ports":[{"name":"http","containerPort":80,"protocol":"TCP"}],"env":[{"name":"S3_BUCKET_NAME","value":"invu-sre-objects"},{"name":"LOG_LEVEL_example","value":"DEBUG"},{"name":"S3_BUCKET_REGION","value":"us-east-1"},{"name":"ZOOKEEPER_CONNECT_STRING","value":"kafka-zookeeper:2181"},{"name":"BOOTSTRAP_SERVERS","value":"kafka:9092"},{"name":"DEBUG","value":"false"},{"name":"JAVA_OPTS","value":"-Xmx512M"},{"name":"MARIADB_HOST","value":"mariadb"},{"name":"MARIADB_USERNAME","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MARIADB_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}},{"name":"INSTANCE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.name"}}}],"resources":{"limits":{"cpu":"500m","memory":"1Gi"},"requests":{"cpu":"500m","memory":"750Mi"}},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":240,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":5,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app","operator":"In","values":["infrastructure-service"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:47Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:18:25Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:18:25Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:44Z"}],"hostIP":"10.40.56.27","podIP":"10.40.44.73","startTime":"2020-11-04T13:16:44Z","initContainerStatuses":[{"name":"mysql-client","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T13:16:47Z","finishedAt":"2020-11-04T13:16:47Z","containerID":"docker://bd524fa563b598c44d93acb77f9abfc0891e9c8b3fedce934ddd7d06bc699b91"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/utilities/mysql-client:latest","imageID":"docker-pullable://registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","containerID":"docker://bd524fa563b598c44d93acb77f9abfc0891e9c8b3fedce934ddd7d06bc699b91"}],"containerStatuses":[{"name":"infrastructure-service","state":{"running":{"startedAt":"2020-11-04T13:16:53Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/cybervision/invu-infrastructure-service:2.0.0-37566","imageID":"docker-pullable://registry.example.com/cybervision/invu-infrastructure-service@sha256:00f75459b2ee50deb47884131608f73108158d4faa085d1a5cc237aacd3f2112","containerID":"docker://05675f6f5f5781c38c509dcea0f48266dc9836bedfbdd15df1092499788fa2f4"}],"qosClass":"Burstable"}},{"metadata":{"name":"kafka-0","generateName":"kafka-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/kafka-0","uid":"bf92b223-1e9a-11eb-9aff-16da7cad7b07","resourceVersion":"45476504","creationTimestamp":"2020-11-04T12:39:15Z","labels":{"app.kubernetes.io/name":"kafka","app.kubernetes.io/part-of":"invu-sre-kafka","controller-revision-hash":"kafka-7874665d8f","statefulset.kubernetes.io/pod-name":"kafka-0"},"annotations":{"checksum/config":"daad60db589e4fb5a1e13238ca6a87b4e363dc0a8a47c039efb620b65e86d9b9","prometheus.io/port":"9020","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"StatefulSet","name":"kafka","uid":"bf66bc4b-1e9a-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"data","persistentVolumeClaim":{"claimName":"data-kafka-0"}},{"name":"config","configMap":{"name":"kafka","defaultMode":420}}],"initContainers":[{"name":"delete-lost-found","image":"busybox","command":["/bin/sh","-c","rm -rf /dst/lost+found"],"resources":{},"volumeMounts":[{"name":"data","mountPath":"/dst"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"},{"name":"wait-for-zookeeper","image":"busybox","command":["/bin/sh","-c","until echo srvr | nc -w 5 kafka-zookeeper 2181 | grep Mode \u0026\u0026 echo zookeeper ok; do sleep 5; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"broker","image":"registry.example.com/ce/middleware/kafka:0.6.33","command":["/bin/bash","-c","exec ./bin/kafka-server-start.sh /etc/kafka/server.properties --override broker.id=${HOSTNAME##*-} --override advertised.host.name=${HOSTNAME}.kafka-headless.invu-sre.svc.cluster.local "],"ports":[{"name":"client","containerPort":9092,"protocol":"TCP"},{"name":"jmx","containerPort":9999,"protocol":"TCP"},{"name":"agent","containerPort":9020,"protocol":"TCP"}],"env":[{"name":"DNS_NAME","value":"example.com"},{"name":"KAFKA_HEAP_OPTS","value":"-Xmx7g -Xms7g"}],"resources":{"limits":{"cpu":"2","memory":"8Gi"},"requests":{"cpu":"2","memory":"8Gi"}},"volumeMounts":[{"name":"data","mountPath":"/var/lib/kafka"},{"name":"config","mountPath":"/etc/kafka"}],"lifecycle":{"preStop":{"exec":{"command":["/bin/bash","-c","exec ./bin/kafka-server-stop.sh"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"runAsUser":1001,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":180,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{"fsGroup":1001},"hostname":"kafka-0","subdomain":"kafka-headless","affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["zookeeper"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}],"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":100,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["zookeeper"]}]},"topologyKey":"kubernetes.io/hostname"}}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:43:09Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:43:15Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:43:15Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:42:54Z"}],"hostIP":"10.40.56.27","podIP":"10.40.44.88","startTime":"2020-11-04T12:42:54Z","initContainerStatuses":[{"name":"delete-lost-found","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T12:43:07Z","finishedAt":"2020-11-04T12:43:07Z","containerID":"docker://2774295ea860555b7db14d5bdd827b40b3971976f8af9e5c3ff0eef8ff491b2c"}},"lastState":{},"ready":true,"restartCount":0,"image":"busybox:latest","imageID":"docker-pullable://busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","containerID":"docker://2774295ea860555b7db14d5bdd827b40b3971976f8af9e5c3ff0eef8ff491b2c"},{"name":"wait-for-zookeeper","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T12:43:09Z","finishedAt":"2020-11-04T12:43:09Z","containerID":"docker://1d6f11662dce2bdbfe8c27a73383f62f7a9adb72323fd786a91e5c62b106e19e"}},"lastState":{},"ready":true,"restartCount":0,"image":"busybox:latest","imageID":"docker-pullable://busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","containerID":"docker://1d6f11662dce2bdbfe8c27a73383f62f7a9adb72323fd786a91e5c62b106e19e"}],"containerStatuses":[{"name":"broker","state":{"running":{"startedAt":"2020-11-04T12:43:15Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/middleware/kafka:0.6.33","imageID":"docker-pullable://registry.example.com/ce/middleware/kafka@sha256:5a13ea153f26ac29e73fd3a0ed67c701f33ea761a0b10a03870fdda51e3975cc","containerID":"docker://aab562c6506685007f59fc42f95492910f41f3e3a4106afc8c1c4803eaf3a61c"}],"qosClass":"Guaranteed"}},{"metadata":{"name":"kafka-connect-6c5dfdbfb4-2hdbw","generateName":"kafka-connect-6c5dfdbfb4-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/kafka-connect-6c5dfdbfb4-2hdbw","uid":"f328eda8-1e9f-11eb-9aff-16da7cad7b07","resourceVersion":"45482621","creationTimestamp":"2020-11-04T13:16:29Z","labels":{"app.kubernetes.io/instance":"kafka-connect","app.kubernetes.io/name":"kafka-connect","pod-template-hash":"6c5dfdbfb4"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"kafka-connect-6c5dfdbfb4","uid":"f323a896-1e9f-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"config","configMap":{"name":"kafka-connect","defaultMode":420}}],"containers":[{"name":"kafka-connect","image":"registry.example.com/cybervision/invu-kafka-connect-sinks/kafka-connect:2.0.0-37698","command":["/bin/sh","-c","$KAFKA_HOME/bin/connect-distributed.sh /etc/connect/connect-distributed.properties"],"ports":[{"name":"http","containerPort":8083,"protocol":"TCP"},{"name":"jmx","containerPort":9999,"protocol":"TCP"}],"env":[{"name":"KAFKA_HEAP_OPTS","value":"-Xmx750m -Xms750m"},{"name":"JMXPORT","value":"9999"}],"resources":{"limits":{"cpu":"1","memory":"1500Mi"},"requests":{"cpu":"750m","memory":"1000Mi"}},"volumeMounts":[{"name":"config","mountPath":"/etc/connect/"}],"livenessProbe":{"httpGet":{"path":"/","port":8083,"scheme":"HTTP"},"initialDelaySeconds":45,"timeoutSeconds":10,"periodSeconds":10,"successThreshold":1,"failureThreshold":6},"readinessProbe":{"httpGet":{"path":"/connector-plugins","port":8083,"scheme":"HTTP"},"initialDelaySeconds":30,"timeoutSeconds":10,"periodSeconds":10,"successThreshold":1,"failureThreshold":5},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{"runAsUser":1001,"runAsNonRoot":true},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}],"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":100,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"kubernetes.io/hostname"}}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka-connect"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:29Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:17:15Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:17:15Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:29Z"}],"hostIP":"10.40.56.27","podIP":"10.40.45.113","startTime":"2020-11-04T13:16:29Z","containerStatuses":[{"name":"kafka-connect","state":{"running":{"startedAt":"2020-11-04T13:16:44Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/cybervision/invu-kafka-connect-sinks/kafka-connect:2.0.0-37698","imageID":"docker-pullable://registry.example.com/cybervision/invu-kafka-connect-sinks/kafka-connect@sha256:6a584826ecf0bbdf654fbe27201e2ed07d5586bd6f0c414c13be40ac3f6cc62f","containerID":"docker://3431c9748539e0095632c7c7f336a4b6c2ca51420e0ab614aebcc7d2263c625d"}],"qosClass":"Burstable"}},{"metadata":{"name":"mariadb-0","generateName":"mariadb-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/mariadb-0","uid":"8427b17b-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45477237","creationTimestamp":"2020-11-04T12:44:45Z","labels":{"app.kubernetes.io/name":"mariadb","app.kubernetes.io/part-of":"invu-sre-mariadb","controller-revision-hash":"mariadb-b5b65b86c","statefulset.kubernetes.io/pod-name":"mariadb-0"},"annotations":{"checksum/config":"dc020dcc29b6f60d457b31746cd171c10007bd02dc2efc5284aed55dd9e790f0","prometheus.io/port":"9104","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"StatefulSet","name":"mariadb","uid":"8421568d-1e9b-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"data","persistentVolumeClaim":{"claimName":"data-mariadb-0"}},{"name":"init","configMap":{"name":"mariadb-init","defaultMode":420}},{"name":"config-dir","emptyDir":{}},{"name":"config","configMap":{"name":"mariadb-config","defaultMode":420}}],"initContainers":[{"name":"init","image":"busybox","command":["/bin/sh","-c","cp /src/*.cnf /dist"],"resources":{},"volumeMounts":[{"name":"config-dir","mountPath":"/dist"},{"name":"config","mountPath":"/src"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"mariadb","image":"registry.example.com/ce/middleware/mariadb:0.6.56","ports":[{"name":"ist","containerPort":4568,"protocol":"TCP"},{"name":"mysql","containerPort":3306,"protocol":"TCP"},{"name":"replication","containerPort":4567,"protocol":"TCP"},{"name":"sst","containerPort":4444,"protocol":"TCP"}],"env":[{"name":"POD_NAMESPACE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}},{"name":"MYSQL_ROOT_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb","key":"mysql_root_password"}}},{"name":"MYSQL_CLIENT_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}},{"name":"GALERA_SERVICE","value":"mariadb-headless"},{"name":"TRACE","value":"1"}],"resources":{"limits":{"cpu":"500m","memory":"1717986918400m"},"requests":{"cpu":"125m","memory":"1717986918400m"}},"volumeMounts":[{"name":"config-dir","mountPath":"/etc/mysql/conf.d"},{"name":"data","mountPath":"/var/lib/mysql"},{"name":"init","mountPath":"/docker-entrypoint-initdb.d"}],"livenessProbe":{"exec":{"command":["/bin/sh","-c","mysqladmin ping -p${MYSQL_ROOT_PASSWORD}"]},"initialDelaySeconds":3000,"timeoutSeconds":5,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"exec":{"command":["/bin/sh","-c","mysql -p${MYSQL_ROOT_PASSWORD} -e 'SELECT 1';"]},"initialDelaySeconds":30,"timeoutSeconds":5,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"},{"name":"metrics","image":"prom/mysqld-exporter:v0.11.0","ports":[{"name":"metrics","containerPort":9104,"protocol":"TCP"}],"env":[{"name":"DATA_SOURCE_NAME","value":"exporter:zeefah9Tei3he0@(localhost:3306)/"}],"resources":{"limits":{"cpu":"100m","memory":"64Mi"},"requests":{"cpu":"50m","memory":"32Mi"}},"livenessProbe":{"httpGet":{"path":"/","port":"metrics","scheme":"HTTP"},"initialDelaySeconds":30,"timeoutSeconds":5,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/","port":"metrics","scheme":"HTTP"},"initialDelaySeconds":30,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{},"hostname":"mariadb-0","subdomain":"mariadb-headless","affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["mariadb"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:45:19Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:46:23Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:46:23Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:49Z"}],"hostIP":"10.40.56.27","podIP":"10.40.59.179","startTime":"2020-11-04T12:44:49Z","initContainerStatuses":[{"name":"init","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T12:45:19Z","finishedAt":"2020-11-04T12:45:19Z","containerID":"docker://7a827ee7a851ff3e7d4a398feb3d9c3902404ea0ec1a7a208caeb664157ba2cc"}},"lastState":{},"ready":true,"restartCount":0,"image":"busybox:latest","imageID":"docker-pullable://busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","containerID":"docker://7a827ee7a851ff3e7d4a398feb3d9c3902404ea0ec1a7a208caeb664157ba2cc"}],"containerStatuses":[{"name":"mariadb","state":{"running":{"startedAt":"2020-11-04T12:45:29Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/middleware/mariadb:0.6.56","imageID":"docker-pullable://registry.example.com/ce/middleware/mariadb@sha256:b4c12c27093137dbf047773d4ddb99676bedd32c8606bfa1e3c50876d5ce659f","containerID":"docker://07539803833e2d16998d3db0256858cbb47fcf88bef3c0a0ca658ebd249b133d"},{"name":"metrics","state":{"running":{"startedAt":"2020-11-04T12:45:30Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"prom/mysqld-exporter:v0.11.0","imageID":"docker-pullable://prom/mysqld-exporter@sha256:9f4fb61cca309cb4a8c1b9ed9fb4aa75af0f7a21f36d3954667db37c062a0172","containerID":"docker://95101d440115a7b6c4b74e38717130e649cf0753b0eb3f8007b056f14c2cff63"}],"qosClass":"Burstable"}},{"metadata":{"name":"schema-registry-7c97c65ddf-dtrwh","generateName":"schema-registry-7c97c65ddf-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/schema-registry-7c97c65ddf-dtrwh","uid":"82f8c4bb-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45477468","creationTimestamp":"2020-11-04T12:44:43Z","labels":{"app.kubernetes.io/name":"schema-registry","app.kubernetes.io/part-of":"invu-sre-ksql-server","pod-template-hash":"7c97c65ddf"},"annotations":{"prometheus.io/port":"5556","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"schema-registry-7c97c65ddf","uid":"82f1e9b2-1e9b-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"jmx-config","configMap":{"name":"schema-registry-jmx-config","defaultMode":420}}],"containers":[{"name":"exporter","image":"example/jmx-prometheus-httpserver:0.11.0","args":["5556","/etc/jmx-schema-registry/jmx-schema-registry-prometheus.yml"],"ports":[{"name":"exporter","containerPort":5556,"protocol":"TCP"}],"resources":{"limits":{"cpu":"25m","memory":"128Mi"},"requests":{"cpu":"10m","memory":"64Mi"}},"volumeMounts":[{"name":"jmx-config","mountPath":"/etc/jmx-schema-registry"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"},{"name":"schema-registry","image":"confluentinc/cp-schema-registry:5.2.2","ports":[{"name":"http","containerPort":8081,"protocol":"TCP"},{"name":"jmx","containerPort":5555,"protocol":"TCP"}],"env":[{"name":"SCHEMA_REGISTRY_KAFKASTORE_BOOTSTRAP_SERVERS","value":"PLAINTEXT://kafka:9092"},{"name":"SCHEMA_REGISTRY_HOST_NAME","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}},{"name":"SCHEMA_REGISTRY_KAFKASTORE_GROUP_ID","value":"invu-sre-ksql-server"},{"name":"SCHEMA_REGISTRY_LISTENERS","value":"http://0.0.0.0:8081"},{"name":"JMX_PORT","value":"5555"}],"resources":{"limits":{"cpu":"500m","memory":"2Gi"},"requests":{"cpu":"200m","memory":"1Gi"}},"livenessProbe":{"httpGet":{"path":"/","port":"http","scheme":"HTTP"},"initialDelaySeconds":45,"timeoutSeconds":1,"periodSeconds":15,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/","port":"http","scheme":"HTTP"},"initialDelaySeconds":45,"timeoutSeconds":1,"periodSeconds":15,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}],"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":100,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"kubernetes.io/hostname"}}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["schema-registry"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:43Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:47:22Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:47:22Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:43Z"}],"hostIP":"10.40.56.27","podIP":"10.40.48.113","startTime":"2020-11-04T12:44:43Z","containerStatuses":[{"name":"exporter","state":{"running":{"startedAt":"2020-11-04T12:44:50Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"example/jmx-prometheus-httpserver:0.11.0","imageID":"docker-pullable://example/jmx-prometheus-httpserver@sha256:725e8a9bfec05f432b931edc11b1ee8bac3895e408bb91af58266dc88ee4e63b","containerID":"docker://c14b0899acd56fa6dbcf478acb6ca6ad50b729ed4fc5484fc331ed704ee29c84"},{"name":"schema-registry","state":{"running":{"startedAt":"2020-11-04T12:46:25Z"}},"lastState":{"terminated":{"exitCode":1,"reason":"Error","startedAt":"2020-11-04T12:45:05Z","finishedAt":"2020-11-04T12:46:25Z","containerID":"docker://46b2bb766b699eca062c6a48dc429c7d4af432b005712b338c5deb9e848de146"}},"ready":true,"restartCount":1,"image":"confluentinc/cp-schema-registry:5.2.2","imageID":"docker-pullable://confluentinc/cp-schema-registry@sha256:0d7a84d486477a0c203ae21d5d52c40d26e810f5b5cfa27a56274692b70949f5","containerID":"docker://7d4a1500d2c48880f43b6b3b657cdd5b4171cad147467607fdef274b694a9592"}],"qosClass":"Burstable"}},{"metadata":{"name":"aws-node-gqbkl","generateName":"aws-node-","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/aws-node-gqbkl","uid":"21d6fe2e-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45476291","creationTimestamp":"2020-11-04T12:42:00Z","labels":{"controller-revision-hash":"bfff688fb","k8s-app":"aws-node","pod-template-generation":"2"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"aws-node","uid":"602ab1b3-0aed-11ea-98f1-16c576d8665d","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"cni-bin-dir","hostPath":{"path":"/opt/cni/bin","type":""}},{"name":"cni-net-dir","hostPath":{"path":"/etc/cni/net.d","type":""}},{"name":"log-dir","hostPath":{"path":"/var/log","type":""}},{"name":"dockersock","hostPath":{"path":"/var/run/docker.sock","type":""}},{"name":"aws-node-token-wrj7h","secret":{"secretName":"aws-node-token-wrj7h","defaultMode":420}}],"containers":[{"name":"aws-node","image":"602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5","ports":[{"name":"metrics","hostPort":61678,"containerPort":61678,"protocol":"TCP"}],"env":[{"name":"CLUSTER_NAME","value":"example.com"},{"name":"AWS_VPC_K8S_CNI_LOGLEVEL","value":"DEBUG"},{"name":"MY_NODE_NAME","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"spec.nodeName"}}},{"name":"WATCH_NAMESPACE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}}],"resources":{"requests":{"cpu":"10m"}},"volumeMounts":[{"name":"cni-bin-dir","mountPath":"/host/opt/cni/bin"},{"name":"cni-net-dir","mountPath":"/host/etc/cni/net.d"},{"name":"log-dir","mountPath":"/host/var/log"},{"name":"dockersock","mountPath":"/var/run/docker.sock"},{"name":"aws-node-token-wrj7h","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always","securityContext":{"privileged":true,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"aws-node","serviceAccount":"aws-node","nodeName":"ip-10-40-56-27.ec2.internal","hostNetwork":true,"securityContext":{},"affinity":{"nodeAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":{"nodeSelectorTerms":[{"matchFields":[{"key":"metadata.name","operator":"In","values":["ip-10-40-56-27.ec2.internal"]}]}]}}},"schedulerName":"default-scheduler","tolerations":[{"operator":"Exists"},{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/disk-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/memory-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/pid-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/unschedulable","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/network-unavailable","operator":"Exists","effect":"NoSchedule"}],"priorityClassName":"system-node-critical","priority":2000001000,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:42:00Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:42:12Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:42:12Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:42:00Z"}],"hostIP":"10.40.56.27","podIP":"10.40.56.27","startTime":"2020-11-04T12:42:00Z","containerStatuses":[{"name":"aws-node","state":{"running":{"startedAt":"2020-11-04T12:42:11Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5","imageID":"docker-pullable://602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni@sha256:a6d23b9fb3d4ba549321e32a28c42d8e79da203897072e93874472ab9e80b768","containerID":"docker://6558951b77e098fa30a31c8c9b0eee11a1ce75fee84709e6e25c5d4e29fd790f"}],"qosClass":"Burstable"}},{"metadata":{"name":"kube-proxy-ip-10-40-56-27.ec2.internal","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/kube-proxy-ip-10-40-56-27.ec2.internal","uid":"21f0ab63-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45476290","creationTimestamp":"2020-11-04T12:42:00Z","labels":{"k8s-app":"kube-proxy","tier":"node"},"annotations":{"kubernetes.io/config.hash":"408295f4302c6a748085190f1d44270d","kubernetes.io/config.mirror":"408295f4302c6a748085190f1d44270d","kubernetes.io/config.seen":"2020-11-04T12:41:59.977858709Z","kubernetes.io/config.source":"file","scheduler.alpha.kubernetes.io/critical-pod":""}},"spec":{"volumes":[{"name":"logfile","hostPath":{"path":"/var/log/kube-proxy.log","type":""}},{"name":"kubeconfig","hostPath":{"path":"/var/lib/kube-proxy/kubeconfig","type":""}},{"name":"modules","hostPath":{"path":"/lib/modules","type":""}},{"name":"ssl-certs-hosts","hostPath":{"path":"/usr/share/ca-certificates","type":""}},{"name":"iptableslock","hostPath":{"path":"/run/xtables.lock","type":"FileOrCreate"}}],"containers":[{"name":"kube-proxy","image":"k8s.gcr.io/kube-proxy:v1.14.2","command":["/bin/sh","-c","mkfifo /tmp/pipe; (tee -a /var/log/kube-proxy.log \u003c /tmp/pipe \u0026 ) ; exec /usr/local/bin/kube-proxy --conntrack-max-per-core=131072 --hostname-override=ip-10-40-56-27.ec2.internal --kubeconfig=/var/lib/kube-proxy/kubeconfig --master=https://api.internal.example.com --oom-score-adj=-998 --resource-container=\"\" --v=2 \u003e /tmp/pipe 2\u003e\u00261"],"resources":{"requests":{"cpu":"100m"}},"volumeMounts":[{"name":"logfile","mountPath":"/var/log/kube-proxy.log"},{"name":"kubeconfig","readOnly":true,"mountPath":"/var/lib/kube-proxy/kubeconfig"},{"name":"modules","readOnly":true,"mountPath":"/lib/modules"},{"name":"ssl-certs-hosts","readOnly":true,"mountPath":"/etc/ssl/certs"},{"name":"iptableslock","mountPath":"/run/xtables.lock"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"privileged":true,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","nodeName":"ip-10-40-56-27.ec2.internal","hostNetwork":true,"securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"CriticalAddonsOnly","operator":"Exists"},{"operator":"Exists","effect":"NoExecute"}],"priorityClassName":"system-node-critical","priority":2000001000,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:42:00Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:42:12Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:42:12Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:42:00Z"}],"hostIP":"10.40.56.27","podIP":"10.40.56.27","startTime":"2020-11-04T12:42:00Z","containerStatuses":[{"name":"kube-proxy","state":{"running":{"startedAt":"2020-11-04T12:42:11Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"k8s.gcr.io/kube-proxy:v1.14.2","imageID":"docker-pullable://k8s.gcr.io/kube-proxy@sha256:c91687ff6145f7fcdc7d8b3da3c530a9a9b50f0734c7a945a0d9c18fc3790dbc","containerID":"docker://e89bb9fcfa7102d3b40a35cee45b991689a1328350c2118acba3ca896525c75d"}],"qosClass":"Burstable"}},{"metadata":{"name":"kube2iam-csnxv","generateName":"kube2iam-","namespace":"kube-system","selfLink":"/api/v1/namespaces/kube-system/pods/kube2iam-csnxv","uid":"21d700e0-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45476294","creationTimestamp":"2020-11-04T12:42:00Z","labels":{"app.kubernetes.io/name":"kube2iam","app.kubernetes.io/part-of":"kube2iam","controller-revision-hash":"6bb8d8748d","pod-template-generation":"1"},"annotations":{"prometheus.io/port":"7070","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"DaemonSet","name":"kube2iam","uid":"d5b4183b-2d71-11ea-98f1-16c576d8665d","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"kube2iam-token-qdd4v","secret":{"secretName":"kube2iam-token-qdd4v","defaultMode":420}}],"containers":[{"name":"kube2iam","image":"jtblin/kube2iam:0.10.8","args":["--app-port=8181","--metrics-port=7070","--host-interface=eni+","--host-ip=$(HOST_IP)","--iptables=true","--auto-discover-base-arn=true","--use-regional-sts-endpoint=true"],"ports":[{"name":"http","hostPort":8181,"containerPort":8181,"protocol":"TCP"},{"name":"metrics","hostPort":7070,"containerPort":7070,"protocol":"TCP"}],"env":[{"name":"HOST_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}},{"name":"AWS_REGION","value":"eu-central-1"}],"resources":{"limits":{"cpu":"50m","memory":"64Mi"},"requests":{"cpu":"25m","memory":"32Mi"}},"volumeMounts":[{"name":"kube2iam-token-qdd4v","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"privileged":true,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"kube2iam","serviceAccount":"kube2iam","nodeName":"ip-10-40-56-27.ec2.internal","hostNetwork":true,"securityContext":{},"affinity":{"nodeAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":{"nodeSelectorTerms":[{"matchFields":[{"key":"metadata.name","operator":"In","values":["ip-10-40-56-27.ec2.internal"]}]}]}}},"schedulerName":"default-scheduler","tolerations":[{"operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute"},{"key":"node.kubernetes.io/disk-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/memory-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/pid-pressure","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/unschedulable","operator":"Exists","effect":"NoSchedule"},{"key":"node.kubernetes.io/network-unavailable","operator":"Exists","effect":"NoSchedule"}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:42:00Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:42:13Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:42:13Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:42:00Z"}],"hostIP":"10.40.56.27","podIP":"10.40.56.27","startTime":"2020-11-04T12:42:00Z","containerStatuses":[{"name":"kube2iam","state":{"running":{"startedAt":"2020-11-04T12:42:13Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"jtblin/kube2iam:0.10.8","imageID":"docker-pullable://jtblin/kube2iam@sha256:92363f1c52fe5f433487b35c3f9c242e4733717ef7ac88c7137fc3824cfad4d3","containerID":"docker://ee74847317e14536bd6918d5673b01b2a54c9f02b26403d78e0332a58909fdac"}],"qosClass":"Burstable"}}]}
I1104 15:55:01.446258 12586 round_trippers.go:423] curl -k -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" 'https://api.example.com/apis/apps/v1/namespaces/kube-system/daemonsets/aws-node'
I1104 15:55:01.646832 12586 round_trippers.go:443] GET https://api.example.com/apis/apps/v1/namespaces/kube-system/daemonsets/aws-node 200 OK in 200 milliseconds
I1104 15:55:01.646873 12586 round_trippers.go:449] Response Headers:
I1104 15:55:01.646882 12586 round_trippers.go:452] Audit-Id: ba22ecfc-8d3c-4492-994c-1ea300052412
I1104 15:55:01.646892 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:01.646899 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:01 GMT
I1104 15:55:01.647012 12586 request.go:1068] Response Body: {"kind":"DaemonSet","apiVersion":"apps/v1","metadata":{"name":"aws-node","namespace":"kube-system","selfLink":"/apis/apps/v1/namespaces/kube-system/daemonsets/aws-node","uid":"602ab1b3-0aed-11ea-98f1-16c576d8665d","resourceVersion":"45483071","generation":2,"creationTimestamp":"2019-11-19T16:55:22Z","labels":{"k8s-app":"aws-node"},"annotations":{"deprecated.daemonset.template.generation":"2","kubectl.kubernetes.io/last-applied-configuration":"{\"apiVersion\":\"apps/v1\",\"kind\":\"DaemonSet\",\"metadata\":{\"annotations\":{},\"labels\":{\"k8s-app\":\"aws-node\"},\"name\":\"aws-node\",\"namespace\":\"kube-system\"},\"spec\":{\"selector\":{\"matchLabels\":{\"k8s-app\":\"aws-node\"}},\"template\":{\"metadata\":{\"labels\":{\"k8s-app\":\"aws-node\"}},\"spec\":{\"affinity\":{\"nodeAffinity\":{\"requiredDuringSchedulingIgnoredDuringExecution\":{\"nodeSelectorTerms\":[{\"matchExpressions\":[{\"key\":\"beta.kubernetes.io/os\",\"operator\":\"In\",\"values\":[\"linux\"]},{\"key\":\"beta.kubernetes.io/arch\",\"operator\":\"In\",\"values\":[\"amd64\"]}]}]}}},\"containers\":[{\"env\":[{\"name\":\"CLUSTER_NAME\",\"value\":\"example.com\"},{\"name\":\"AWS_VPC_K8S_CNI_LOGLEVEL\",\"value\":\"DEBUG\"},{\"name\":\"MY_NODE_NAME\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"spec.nodeName\"}}},{\"name\":\"WATCH_NAMESPACE\",\"valueFrom\":{\"fieldRef\":{\"fieldPath\":\"metadata.namespace\"}}}],\"image\":\"602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5\",\"imagePullPolicy\":\"Always\",\"name\":\"aws-node\",\"ports\":[{\"containerPort\":61678,\"name\":\"metrics\"}],\"resources\":{\"requests\":{\"cpu\":\"10m\"}},\"securityContext\":{\"privileged\":true},\"volumeMounts\":[{\"mountPath\":\"/host/opt/cni/bin\",\"name\":\"cni-bin-dir\"},{\"mountPath\":\"/host/etc/cni/net.d\",\"name\":\"cni-net-dir\"},{\"mountPath\":\"/host/var/log\",\"name\":\"log-dir\"},{\"mountPath\":\"/var/run/docker.sock\",\"name\":\"dockersock\"}]}],\"hostNetwork\":true,\"priorityClassName\":\"system-node-critical\",\"serviceAccountName\":\"aws-node\",\"tolerations\":[{\"operator\":\"Exists\"}],\"volumes\":[{\"hostPath\":{\"path\":\"/opt/cni/bin\"},\"name\":\"cni-bin-dir\"},{\"hostPath\":{\"path\":\"/etc/cni/net.d\"},\"name\":\"cni-net-dir\"},{\"hostPath\":{\"path\":\"/var/log\"},\"name\":\"log-dir\"},{\"hostPath\":{\"path\":\"/var/run/docker.sock\"},\"name\":\"dockersock\"}]}},\"updateStrategy\":{\"type\":\"RollingUpdate\"}}}\n"}},"spec":{"selector":{"matchLabels":{"k8s-app":"aws-node"}},"template":{"metadata":{"creationTimestamp":null,"labels":{"k8s-app":"aws-node"}},"spec":{"volumes":[{"name":"cni-bin-dir","hostPath":{"path":"/opt/cni/bin","type":""}},{"name":"cni-net-dir","hostPath":{"path":"/etc/cni/net.d","type":""}},{"name":"log-dir","hostPath":{"path":"/var/log","type":""}},{"name":"dockersock","hostPath":{"path":"/var/run/docker.sock","type":""}}],"containers":[{"name":"aws-node","image":"602401143452.dkr.ecr.us-west-2.amazonaws.com/amazon-k8s-cni:v1.5.5","ports":[{"name":"metrics","hostPort":61678,"containerPort":61678,"protocol":"TCP"}],"env":[{"name":"CLUSTER_NAME","value":"example.com"},{"name":"AWS_VPC_K8S_CNI_LOGLEVEL","value":"DEBUG"},{"name":"MY_NODE_NAME","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"spec.nodeName"}}},{"name":"WATCH_NAMESPACE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}}],"resources":{"requests":{"cpu":"10m"}},"volumeMounts":[{"name":"cni-bin-dir","mountPath":"/host/opt/cni/bin"},{"name":"cni-net-dir","mountPath":"/host/etc/cni/net.d"},{"name":"log-dir","mountPath":"/host/var/log"},{"name":"dockersock","mountPath":"/var/run/docker.sock"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always","securityContext":{"privileged":true,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"aws-node","serviceAccount":"aws-node","hostNetwork":true,"securityContext":{},"affinity":{"nodeAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":{"nodeSelectorTerms":[{"matchExpressions":[{"key":"beta.kubernetes.io/os","operator":"In","values":["linux"]},{"key":"beta.kubernetes.io/arch","operator":"In","values":["amd64"]}]}]}}},"schedulerName":"default-scheduler","tolerations":[{"operator":"Exists"}],"priorityClassName":"system-node-critical"}},"updateStrategy":{"type":"RollingUpdate","rollingUpdate":{"maxUnavailable":1}},"revisionHistoryLimit":10},"status":{"currentNumberScheduled":9,"numberMisscheduled":0,"desiredNumberScheduled":9,"numberReady":9,"observedGeneration":2,"updatedNumberScheduled":9,"numberAvailable":9}}
I1104 15:55:01.653386 12586 round_trippers.go:423] curl -k -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" 'https://api.example.com/apis/apps/v1/namespaces/kube-system/daemonsets/kube2iam'
I1104 15:55:01.851575 12586 round_trippers.go:443] GET https://api.example.com/apis/apps/v1/namespaces/kube-system/daemonsets/kube2iam 200 OK in 198 milliseconds
I1104 15:55:01.851640 12586 round_trippers.go:449] Response Headers:
I1104 15:55:01.851655 12586 round_trippers.go:452] Content-Length: 2247
I1104 15:55:01.851666 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:01 GMT
I1104 15:55:01.851675 12586 round_trippers.go:452] Audit-Id: ea7d5715-1553-4b04-9aa5-92c9469e2ee3
I1104 15:55:01.851685 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:01.851756 12586 request.go:1068] Response Body: {"kind":"DaemonSet","apiVersion":"apps/v1","metadata":{"name":"kube2iam","namespace":"kube-system","selfLink":"/apis/apps/v1/namespaces/kube-system/daemonsets/kube2iam","uid":"d5b4183b-2d71-11ea-98f1-16c576d8665d","resourceVersion":"45483082","generation":1,"creationTimestamp":"2020-01-02T15:09:12Z","labels":{"app.kubernetes.io/managed-by":"Tiller","app.kubernetes.io/name":"kube2iam","app.kubernetes.io/part-of":"kube2iam","app.kubernetes.io/version":"kube2iam-0.6.6"},"annotations":{"deprecated.daemonset.template.generation":"1"}},"spec":{"selector":{"matchLabels":{"app.kubernetes.io/name":"kube2iam","app.kubernetes.io/part-of":"kube2iam"}},"template":{"metadata":{"creationTimestamp":null,"labels":{"app.kubernetes.io/name":"kube2iam","app.kubernetes.io/part-of":"kube2iam"},"annotations":{"prometheus.io/port":"7070","prometheus.io/scrape":"true"}},"spec":{"containers":[{"name":"kube2iam","image":"jtblin/kube2iam:0.10.8","args":["--app-port=8181","--metrics-port=7070","--host-interface=eni+","--host-ip=$(HOST_IP)","--iptables=true","--auto-discover-base-arn=true","--use-regional-sts-endpoint=true"],"ports":[{"name":"http","hostPort":8181,"containerPort":8181,"protocol":"TCP"},{"name":"metrics","hostPort":7070,"containerPort":7070,"protocol":"TCP"}],"env":[{"name":"HOST_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}},{"name":"AWS_REGION","value":"eu-central-1"}],"resources":{"limits":{"cpu":"50m","memory":"64Mi"},"requests":{"cpu":"25m","memory":"32Mi"}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"privileged":true,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"kube2iam","serviceAccount":"kube2iam","hostNetwork":true,"securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"operator":"Exists","effect":"NoSchedule"}]}},"updateStrategy":{"type":"RollingUpdate","rollingUpdate":{"maxUnavailable":1}},"revisionHistoryLimit":10},"status":{"currentNumberScheduled":9,"numberMisscheduled":0,"desiredNumberScheduled":9,"numberReady":9,"observedGeneration":1,"updatedNumberScheduled":9,"numberAvailable":9}}
WARNING: ignoring DaemonSet-managed Pods: kube-system/aws-node-gqbkl, kube-system/kube2iam-csnxv
I1104 15:55:01.852168 12586 round_trippers.go:423] curl -k -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" 'https://api.example.com/api?timeout=32s'
I1104 15:55:02.056456 12586 round_trippers.go:443] GET https://api.example.com/api?timeout=32s 200 OK in 204 milliseconds
I1104 15:55:02.056510 12586 round_trippers.go:449] Response Headers:
I1104 15:55:02.056525 12586 round_trippers.go:452] Audit-Id: c258c728-0ea2-4b29-a6b5-e7d13ff2837a
I1104 15:55:02.056541 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:02.056556 12586 round_trippers.go:452] Content-Length: 134
I1104 15:55:02.056572 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:01 GMT
I1104 15:55:02.056635 12586 request.go:1068] Response Body: {"kind":"APIVersions","versions":["v1"],"serverAddressByClientCIDRs":[{"clientCIDR":"0.0.0.0/0","serverAddress":"10.40.54.156:443"}]}
I1104 15:55:02.057196 12586 round_trippers.go:423] curl -k -v -XGET -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" -H "Accept: application/json, */*" 'https://api.example.com/apis?timeout=32s'
I1104 15:55:02.208439 12586 round_trippers.go:443] GET https://api.example.com/apis?timeout=32s 200 OK in 151 milliseconds
I1104 15:55:02.208473 12586 round_trippers.go:449] Response Headers:
I1104 15:55:02.208482 12586 round_trippers.go:452] Audit-Id: 2bf5d272-fb46-40ea-b495-c433465b3126
I1104 15:55:02.208491 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:02.208508 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:02 GMT
I1104 15:55:02.208628 12586 request.go:1068] Response Body: {"kind":"APIGroupList","apiVersion":"v1","groups":[{"name":"apiregistration.k8s.io","versions":[{"groupVersion":"apiregistration.k8s.io/v1","version":"v1"},{"groupVersion":"apiregistration.k8s.io/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"apiregistration.k8s.io/v1","version":"v1"}},{"name":"extensions","versions":[{"groupVersion":"extensions/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"extensions/v1beta1","version":"v1beta1"}},{"name":"apps","versions":[{"groupVersion":"apps/v1","version":"v1"},{"groupVersion":"apps/v1beta2","version":"v1beta2"},{"groupVersion":"apps/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"apps/v1","version":"v1"}},{"name":"events.k8s.io","versions":[{"groupVersion":"events.k8s.io/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"events.k8s.io/v1beta1","version":"v1beta1"}},{"name":"authentication.k8s.io","versions":[{"groupVersion":"authentication.k8s.io/v1","version":"v1"},{"groupVersion":"authentication.k8s.io/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"authentication.k8s.io/v1","version":"v1"}},{"name":"authorization.k8s.io","versions":[{"groupVersion":"authorization.k8s.io/v1","version":"v1"},{"groupVersion":"authorization.k8s.io/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"authorization.k8s.io/v1","version":"v1"}},{"name":"autoscaling","versions":[{"groupVersion":"autoscaling/v1","version":"v1"},{"groupVersion":"autoscaling/v2beta1","version":"v2beta1"},{"groupVersion":"autoscaling/v2beta2","version":"v2beta2"}],"preferredVersion":{"groupVersion":"autoscaling/v1","version":"v1"}},{"name":"batch","versions":[{"groupVersion":"batch/v1","version":"v1"},{"groupVersion":"batch/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"batch/v1","version":"v1"}},{"name":"certificates.k8s.io","versions":[{"groupVersion":"certificates.k8s.io/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"certificates.k8s.io/v1beta1","version":"v1beta1"}},{"name":"networking.k8s.io","versions":[{"groupVersion":"networking.k8s.io/v1","version":"v1"},{"groupVersion":"networking.k8s.io/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"networking.k8s.io/v1","version":"v1"}},{"name":"policy","versions":[{"groupVersion":"policy/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"policy/v1beta1","version":"v1beta1"}},{"name":"rbac.authorization.k8s.io","versions":[{"groupVersion":"rbac.authorization.k8s.io/v1","version":"v1"},{"groupVersion":"rbac.authorization.k8s.io/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"rbac.authorization.k8s.io/v1","version":"v1"}},{"name":"storage.k8s.io","versions":[{"groupVersion":"storage.k8s.io/v1","version":"v1"},{"groupVersion":"storage.k8s.io/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"storage.k8s.io/v1","version":"v1"}},{"name":"admissionregistration.k8s.io","versions":[{"groupVersion":"admissionregistration.k8s.io/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"admissionregistration.k8s.io/v1beta1","version":"v1beta1"}},{"name":"apiextensions.k8s.io","versions":[{"groupVersion":"apiextensions.k8s.io/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"apiextensions.k8s.io/v1beta1","version":"v1beta1"}},{"name":"scheduling.k8s.io","versions":[{"groupVersion":"scheduling.k8s.io/v1","version":"v1"},{"groupVersion":"scheduling.k8s.io/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"scheduling.k8s.io/v1","version":"v1"}},{"name":"coordination.k8s.io","versions":[{"groupVersion":"coordination.k8s.io/v1","version":"v1"},{"groupVersion":"coordination.k8s.io/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"coordination.k8s.io/v1","version":"v1"}},{"name":"node.k8s.io","versions":[{"groupVersion":"node.k8s.io/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"node.k8s.io/v1beta1","version":"v1beta1"}},{"name":"getambassador.io","versions":[{"groupVersion":"getambassador.io/v2","version":"v2"},{"groupVersion":"getambassador.io/v1","version":"v1"},{"groupVersion":"getambassador.io/v1beta2","version":"v1beta2"},{"groupVersion":"getambassador.io/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"getambassador.io/v2","version":"v2"}},{"name":"cache.example.com","versions":[{"groupVersion":"cache.example.com/v1alpha1","version":"v1alpha1"}],"preferredVersion":{"groupVersion":"cache.example.com/v1alpha1","version":"v1alpha1"}},{"name":"crd.k8s.amazonaws.com","versions":[{"groupVersion":"crd.k8s.amazonaws.com/v1alpha1","version":"v1alpha1"}],"preferredVersion":{"groupVersion":"crd.k8s.amazonaws.com/v1alpha1","version":"v1alpha1"}},{"name":"mariadb.example.com","versions":[{"groupVersion":"mariadb.example.com/v1alpha1","version":"v1alpha1"}],"preferredVersion":{"groupVersion":"mariadb.example.com/v1alpha1","version":"v1alpha1"}},{"name":"connect.examplecares.com","versions":[{"groupVersion":"connect.examplecares.com/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"connect.examplecares.com/v1beta1","version":"v1beta1"}},{"name":"metrics.k8s.io","versions":[{"groupVersion":"metrics.k8s.io/v1beta1","version":"v1beta1"}],"preferredVersion":{"groupVersion":"metrics.k8s.io/v1beta1","version":"v1beta1"}}]}
I1104 15:55:02.209187 12586 round_trippers.go:423] curl -k -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" 'https://api.example.com/api/v1?timeout=32s'
I1104 15:55:02.415341 12586 round_trippers.go:443] GET https://api.example.com/api/v1?timeout=32s 200 OK in 206 milliseconds
I1104 15:55:02.415401 12586 round_trippers.go:449] Response Headers:
I1104 15:55:02.415416 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:02.415426 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:02 GMT
I1104 15:55:02.415435 12586 round_trippers.go:452] Audit-Id: f10d47f4-221f-4aa7-b141-5a71dc6aa06c
I1104 15:55:02.415584 12586 request.go:1068] Response Body: {"kind":"APIResourceList","groupVersion":"v1","resources":[{"name":"bindings","singularName":"","namespaced":true,"kind":"Binding","verbs":["create"]},{"name":"componentstatuses","singularName":"","namespaced":false,"kind":"ComponentStatus","verbs":["get","list"],"shortNames":["cs"]},{"name":"configmaps","singularName":"","namespaced":true,"kind":"ConfigMap","verbs":["create","delete","deletecollection","get","list","patch","update","watch"],"shortNames":["cm"]},{"name":"endpoints","singularName":"","namespaced":true,"kind":"Endpoints","verbs":["create","delete","deletecollection","get","list","patch","update","watch"],"shortNames":["ep"]},{"name":"events","singularName":"","namespaced":true,"kind":"Event","verbs":["create","delete","deletecollection","get","list","patch","update","watch"],"shortNames":["ev"]},{"name":"limitranges","singularName":"","namespaced":true,"kind":"LimitRange","verbs":["create","delete","deletecollection","get","list","patch","update","watch"],"shortNames":["limits"]},{"name":"namespaces","singularName":"","namespaced":false,"kind":"Namespace","verbs":["create","delete","get","list","patch","update","watch"],"shortNames":["ns"]},{"name":"namespaces/finalize","singularName":"","namespaced":false,"kind":"Namespace","verbs":["update"]},{"name":"namespaces/status","singularName":"","namespaced":false,"kind":"Namespace","verbs":["get","patch","update"]},{"name":"nodes","singularName":"","namespaced":false,"kind":"Node","verbs":["create","delete","deletecollection","get","list","patch","update","watch"],"shortNames":["no"]},{"name":"nodes/proxy","singularName":"","namespaced":false,"kind":"NodeProxyOptions","verbs":["create","delete","get","patch","update"]},{"name":"nodes/status","singularName":"","namespaced":false,"kind":"Node","verbs":["get","patch","update"]},{"name":"persistentvolumeclaims","singularName":"","namespaced":true,"kind":"PersistentVolumeClaim","verbs":["create","delete","deletecollection","get","list","patch","update","watch"],"shortNames":["pvc"]},{"name":"persistentvolumeclaims/status","singularName":"","namespaced":true,"kind":"PersistentVolumeClaim","verbs":["get","patch","update"]},{"name":"persistentvolumes","singularName":"","namespaced":false,"kind":"PersistentVolume","verbs":["create","delete","deletecollection","get","list","patch","update","watch"],"shortNames":["pv"]},{"name":"persistentvolumes/status","singularName":"","namespaced":false,"kind":"PersistentVolume","verbs":["get","patch","update"]},{"name":"pods","singularName":"","namespaced":true,"kind":"Pod","verbs":["create","delete","deletecollection","get","list","patch","update","watch"],"shortNames":["po"],"categories":["all"]},{"name":"pods/attach","singularName":"","namespaced":true,"kind":"PodAttachOptions","verbs":["create","get"]},{"name":"pods/binding","singularName":"","namespaced":true,"kind":"Binding","verbs":["create"]},{"name":"pods/eviction","singularName":"","namespaced":true,"group":"policy","version":"v1beta1","kind":"Eviction","verbs":["create"]},{"name":"pods/exec","singularName":"","namespaced":true,"kind":"PodExecOptions","verbs":["create","get"]},{"name":"pods/log","singularName":"","namespaced":true,"kind":"Pod","verbs":["get"]},{"name":"pods/portforward","singularName":"","namespaced":true,"kind":"PodPortForwardOptions","verbs":["create","get"]},{"name":"pods/proxy","singularName":"","namespaced":true,"kind":"PodProxyOptions","verbs":["create","delete","get","patch","update"]},{"name":"pods/status","singularName":"","namespaced":true,"kind":"Pod","verbs":["get","patch","update"]},{"name":"podtemplates","singularName":"","namespaced":true,"kind":"PodTemplate","verbs":["create","delete","deletecollection","get","list","patch","update","watch"]},{"name":"replicationcontrollers","singularName":"","namespaced":true,"kind":"ReplicationController","verbs":["create","delete","deletecollection","get","list","patch","update","watch"],"shortNames":["rc"],"categories":["all"]},{"name":"replicationcontrollers/scale","singularName":"","namespaced":true,"group":"autoscaling","version":"v1","kind":"Scale","verbs":["get","patch","update"]},{"name":"replicationcontrollers/status","singularName":"","namespaced":true,"kind":"ReplicationController","verbs":["get","patch","update"]},{"name":"resourcequotas","singularName":"","namespaced":true,"kind":"ResourceQuota","verbs":["create","delete","deletecollection","get","list","patch","update","watch"],"shortNames":["quota"]},{"name":"resourcequotas/status","singularName":"","namespaced":true,"kind":"ResourceQuota","verbs":["get","patch","update"]},{"name":"secrets","singularName":"","namespaced":true,"kind":"Secret","verbs":["create","delete","deletecollection","get","list","patch","update","watch"]},{"name":"serviceaccounts","singularName":"","namespaced":true,"kind":"ServiceAccount","verbs":["create","delete","deletecollection","get","list","patch","update","watch"],"shortNames":["sa"]},{"name":"services","singularName":"","namespaced":true,"kind":"Service","verbs":["create","delete","get","list","patch","update","watch"],"shortNames":["svc"],"categories":["all"]},{"name":"services/proxy","singularName":"","namespaced":true,"kind":"ServiceProxyOptions","verbs":["create","delete","get","patch","update"]},{"name":"services/status","singularName":"","namespaced":true,"kind":"Service","verbs":["get","patch","update"]}]}
evicting pod invu-sre/infrastructure-service-5b8746775c-v98mn
evicting pod invu-sre/kafka-0
evicting pod invu-sre/mariadb-0
evicting pod invu-sre/emqx-758448bfd5-h7s9j
evicting pod invu-sre/kafka-connect-6c5dfdbfb4-2hdbw
evicting pod invu-sre/schema-registry-7c97c65ddf-dtrwh
I1104 15:55:02.416786 12586 request.go:1068] Request Body: {"kind":"Eviction","apiVersion":"policy/v1beta1","metadata":{"name":"infrastructure-service-5b8746775c-v98mn","namespace":"invu-sre","creationTimestamp":null},"deleteOptions":{}}
I1104 15:55:02.416813 12586 request.go:1068] Request Body: {"kind":"Eviction","apiVersion":"policy/v1beta1","metadata":{"name":"emqx-758448bfd5-h7s9j","namespace":"invu-sre","creationTimestamp":null},"deleteOptions":{}}
I1104 15:55:02.416840 12586 request.go:1068] Request Body: {"kind":"Eviction","apiVersion":"policy/v1beta1","metadata":{"name":"kafka-0","namespace":"invu-sre","creationTimestamp":null},"deleteOptions":{}}
I1104 15:55:02.416884 12586 request.go:1068] Request Body: {"kind":"Eviction","apiVersion":"policy/v1beta1","metadata":{"name":"kafka-connect-6c5dfdbfb4-2hdbw","namespace":"invu-sre","creationTimestamp":null},"deleteOptions":{}}
I1104 15:55:02.416905 12586 request.go:1068] Request Body: {"kind":"Eviction","apiVersion":"policy/v1beta1","metadata":{"name":"schema-registry-7c97c65ddf-dtrwh","namespace":"invu-sre","creationTimestamp":null},"deleteOptions":{}}
I1104 15:55:02.416823 12586 request.go:1068] Request Body: {"kind":"Eviction","apiVersion":"policy/v1beta1","metadata":{"name":"mariadb-0","namespace":"invu-sre","creationTimestamp":null},"deleteOptions":{}}
I1104 15:55:02.416958 12586 round_trippers.go:423] curl -k -v -XPOST -H "Accept: application/json, */*" -H "Content-Type: application/json" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" 'https://api.example.com/api/v1/namespaces/invu-sre/pods/infrastructure-service-5b8746775c-v98mn/eviction'
I1104 15:55:02.416998 12586 round_trippers.go:423] curl -k -v -XPOST -H "Accept: application/json, */*" -H "Content-Type: application/json" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" 'https://api.example.com/api/v1/namespaces/invu-sre/pods/emqx-758448bfd5-h7s9j/eviction'
I1104 15:55:02.417044 12586 round_trippers.go:423] curl -k -v -XPOST -H "Content-Type: application/json" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" -H "Accept: application/json, */*" 'https://api.example.com/api/v1/namespaces/invu-sre/pods/kafka-0/eviction'
I1104 15:55:02.417050 12586 round_trippers.go:423] curl -k -v -XPOST -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" -H "Accept: application/json, */*" -H "Content-Type: application/json" 'https://api.example.com/api/v1/namespaces/invu-sre/pods/kafka-connect-6c5dfdbfb4-2hdbw/eviction'
I1104 15:55:02.417069 12586 round_trippers.go:423] curl -k -v -XPOST -H "Accept: application/json, */*" -H "Content-Type: application/json" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" 'https://api.example.com/api/v1/namespaces/invu-sre/pods/schema-registry-7c97c65ddf-dtrwh/eviction'
I1104 15:55:02.417148 12586 round_trippers.go:423] curl -k -v -XPOST -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Accept: application/json, */*" -H "Content-Type: application/json" -H "Authorization: Basic ******" 'https://api.example.com/api/v1/namespaces/invu-sre/pods/mariadb-0/eviction'
I1104 15:55:02.578725 12586 round_trippers.go:443] POST https://api.example.com/api/v1/namespaces/invu-sre/pods/infrastructure-service-5b8746775c-v98mn/eviction 201 Created in 161 milliseconds
I1104 15:55:02.578759 12586 round_trippers.go:449] Response Headers:
I1104 15:55:02.578763 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:02 GMT
I1104 15:55:02.578766 12586 round_trippers.go:452] Audit-Id: 5d2f2d72-33d5-4f65-88de-b7afca3c3cd8
I1104 15:55:02.578769 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:02.578771 12586 round_trippers.go:452] Content-Length: 80
I1104 15:55:02.590709 12586 round_trippers.go:443] POST https://api.example.com/api/v1/namespaces/invu-sre/pods/kafka-connect-6c5dfdbfb4-2hdbw/eviction 201 Created in 173 milliseconds
I1104 15:55:02.590920 12586 round_trippers.go:449] Response Headers:
I1104 15:55:02.590947 12586 round_trippers.go:452] Audit-Id: dd34b58b-eb75-4f41-9eb4-66040fed19b8
I1104 15:55:02.590967 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:02.590974 12586 round_trippers.go:452] Content-Length: 80
I1104 15:55:02.590979 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:02 GMT
I1104 15:55:02.590718 12586 request.go:1068] Response Body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","code":201}
I1104 15:55:02.591158 12586 round_trippers.go:423] curl -k -v -XGET -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Accept: application/json, */*" -H "Authorization: Basic ******" 'https://api.example.com/api/v1/namespaces/invu-sre/pods/infrastructure-service-5b8746775c-v98mn'
I1104 15:55:02.591203 12586 round_trippers.go:443] POST https://api.example.com/api/v1/namespaces/invu-sre/pods/emqx-758448bfd5-h7s9j/eviction 201 Created in 174 milliseconds
I1104 15:55:02.591217 12586 round_trippers.go:449] Response Headers:
I1104 15:55:02.591222 12586 round_trippers.go:452] Content-Length: 80
I1104 15:55:02.591226 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:02 GMT
I1104 15:55:02.591230 12586 round_trippers.go:452] Audit-Id: 41a4c83c-67c5-4fa3-ba3c-31392595002d
I1104 15:55:02.591234 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:02.591289 12586 request.go:1068] Response Body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","code":201}
I1104 15:55:02.591343 12586 round_trippers.go:423] curl -k -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" 'https://api.example.com/api/v1/namespaces/invu-sre/pods/emqx-758448bfd5-h7s9j'
I1104 15:55:02.591346 12586 request.go:1068] Response Body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","code":201}
I1104 15:55:02.591439 12586 round_trippers.go:423] curl -k -v -XGET -H "Authorization: Basic ******" -H "Accept: application/json, */*" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" 'https://api.example.com/api/v1/namespaces/invu-sre/pods/kafka-connect-6c5dfdbfb4-2hdbw'
I1104 15:55:02.601044 12586 round_trippers.go:443] POST https://api.example.com/api/v1/namespaces/invu-sre/pods/schema-registry-7c97c65ddf-dtrwh/eviction 201 Created in 183 milliseconds
I1104 15:55:02.601094 12586 round_trippers.go:449] Response Headers:
I1104 15:55:02.601100 12586 round_trippers.go:452] Content-Length: 80
I1104 15:55:02.601103 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:02 GMT
I1104 15:55:02.601106 12586 round_trippers.go:452] Audit-Id: 63ffdf17-a167-4dbf-b244-e5397d1ca85f
I1104 15:55:02.601109 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:02.601134 12586 request.go:1068] Response Body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","code":201}
I1104 15:55:02.601044 12586 round_trippers.go:443] POST https://api.example.com/api/v1/namespaces/invu-sre/pods/mariadb-0/eviction 201 Created in 183 milliseconds
I1104 15:55:02.601156 12586 round_trippers.go:449] Response Headers:
I1104 15:55:02.601162 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:02.601166 12586 round_trippers.go:452] Content-Length: 80
I1104 15:55:02.601171 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:02 GMT
I1104 15:55:02.601175 12586 round_trippers.go:452] Audit-Id: 02ebe2c3-8577-48d9-bf28-1def35881c3c
I1104 15:55:02.601193 12586 request.go:1068] Response Body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","code":201}
I1104 15:55:02.601266 12586 round_trippers.go:423] curl -k -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" 'https://api.example.com/api/v1/namespaces/invu-sre/pods/schema-registry-7c97c65ddf-dtrwh'
I1104 15:55:02.601283 12586 round_trippers.go:423] curl -k -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" 'https://api.example.com/api/v1/namespaces/invu-sre/pods/mariadb-0'
I1104 15:55:02.613676 12586 round_trippers.go:443] POST https://api.example.com/api/v1/namespaces/invu-sre/pods/kafka-0/eviction 201 Created in 196 milliseconds
I1104 15:55:02.613716 12586 round_trippers.go:449] Response Headers:
I1104 15:55:02.613723 12586 round_trippers.go:452] Audit-Id: adad13e0-9f3a-4f6c-aee6-d89c86adc890
I1104 15:55:02.613754 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:02.613761 12586 round_trippers.go:452] Content-Length: 80
I1104 15:55:02.613766 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:02 GMT
I1104 15:55:02.617925 12586 request.go:1068] Response Body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Success","code":201}
I1104 15:55:02.618050 12586 round_trippers.go:423] curl -k -v -XGET -H "Authorization: Basic ******" -H "Accept: application/json, */*" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" 'https://api.example.com/api/v1/namespaces/invu-sre/pods/kafka-0'
I1104 15:55:02.766694 12586 round_trippers.go:443] GET https://api.example.com/api/v1/namespaces/invu-sre/pods/schema-registry-7c97c65ddf-dtrwh 200 OK in 165 milliseconds
I1104 15:55:02.766739 12586 round_trippers.go:449] Response Headers:
I1104 15:55:02.766747 12586 round_trippers.go:452] Audit-Id: ac946bd4-9057-4712-bbb8-626b47e623da
I1104 15:55:02.766754 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:02.766760 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:02 GMT
I1104 15:55:02.769068 12586 round_trippers.go:443] GET https://api.example.com/api/v1/namespaces/invu-sre/pods/infrastructure-service-5b8746775c-v98mn 200 OK in 177 milliseconds
I1104 15:55:02.769112 12586 round_trippers.go:449] Response Headers:
I1104 15:55:02.769122 12586 round_trippers.go:452] Audit-Id: 6fc8b9bc-7dc9-45e0-8db9-4c9311c39e5b
I1104 15:55:02.769128 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:02.769134 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:02 GMT
I1104 15:55:02.769068 12586 round_trippers.go:443] GET https://api.example.com/api/v1/namespaces/invu-sre/pods/kafka-connect-6c5dfdbfb4-2hdbw 200 OK in 177 milliseconds
I1104 15:55:02.769171 12586 round_trippers.go:449] Response Headers:
I1104 15:55:02.769177 12586 round_trippers.go:452] Audit-Id: 92895bb5-ed2d-4962-bb99-8be0ee6f607e
I1104 15:55:02.769183 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:02.769188 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:02 GMT
I1104 15:55:02.770710 12586 round_trippers.go:443] GET https://api.example.com/api/v1/namespaces/invu-sre/pods/emqx-758448bfd5-h7s9j 200 OK in 179 milliseconds
I1104 15:55:02.770757 12586 round_trippers.go:449] Response Headers:
I1104 15:55:02.770766 12586 round_trippers.go:452] Audit-Id: ca7d3c33-fe36-48e5-a17d-371fd9334918
I1104 15:55:02.770773 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:02.770779 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:02 GMT
I1104 15:55:02.770710 12586 round_trippers.go:443] GET https://api.example.com/api/v1/namespaces/invu-sre/pods/mariadb-0 200 OK in 169 milliseconds
I1104 15:55:02.770851 12586 round_trippers.go:449] Response Headers:
I1104 15:55:02.770865 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:02.770891 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:02 GMT
I1104 15:55:02.770898 12586 round_trippers.go:452] Audit-Id: 2769b6fb-8050-4393-bb7b-defc98d3d4ba
I1104 15:55:02.774213 12586 request.go:1068] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kafka-connect-6c5dfdbfb4-2hdbw","generateName":"kafka-connect-6c5dfdbfb4-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/kafka-connect-6c5dfdbfb4-2hdbw","uid":"f328eda8-1e9f-11eb-9aff-16da7cad7b07","resourceVersion":"45489079","creationTimestamp":"2020-11-04T13:16:29Z","deletionTimestamp":"2020-11-04T13:55:32Z","deletionGracePeriodSeconds":30,"labels":{"app.kubernetes.io/instance":"kafka-connect","app.kubernetes.io/name":"kafka-connect","pod-template-hash":"6c5dfdbfb4"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"kafka-connect-6c5dfdbfb4","uid":"f323a896-1e9f-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"config","configMap":{"name":"kafka-connect","defaultMode":420}}],"containers":[{"name":"kafka-connect","image":"registry.example.com/cybervision/invu-kafka-connect-sinks/kafka-connect:2.0.0-37698","command":["/bin/sh","-c","$KAFKA_HOME/bin/connect-distributed.sh /etc/connect/connect-distributed.properties"],"ports":[{"name":"http","containerPort":8083,"protocol":"TCP"},{"name":"jmx","containerPort":9999,"protocol":"TCP"}],"env":[{"name":"KAFKA_HEAP_OPTS","value":"-Xmx750m -Xms750m"},{"name":"JMXPORT","value":"9999"}],"resources":{"limits":{"cpu":"1","memory":"1500Mi"},"requests":{"cpu":"750m","memory":"1000Mi"}},"volumeMounts":[{"name":"config","mountPath":"/etc/connect/"}],"livenessProbe":{"httpGet":{"path":"/","port":8083,"scheme":"HTTP"},"initialDelaySeconds":45,"timeoutSeconds":10,"periodSeconds":10,"successThreshold":1,"failureThreshold":6},"readinessProbe":{"httpGet":{"path":"/connector-plugins","port":8083,"scheme":"HTTP"},"initialDelaySeconds":30,"timeoutSeconds":10,"periodSeconds":10,"successThreshold":1,"failureThreshold":5},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{"runAsUser":1001,"runAsNonRoot":true},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}],"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":100,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"kubernetes.io/hostname"}}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka-connect"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:29Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:17:15Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:17:15Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:29Z"}],"hostIP":"10.40.56.27","podIP":"10.40.45.113","startTime":"2020-11-04T13:16:29Z","containerStatuses":[{"name":"kafka-connect","state":{"running":{"startedAt":"2020-11-04T13:16:44Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/cybervision/invu-kafka-connect-sinks/kafka-connect:2.0.0-37698","imageID":"docker-pullable://registry.example.com/cybervision/invu-kafka-connect-sinks/kafka-connect@sha256:6a584826ecf0bbdf654fbe27201e2ed07d5586bd6f0c414c13be40ac3f6cc62f","containerID":"docker://3431c9748539e0095632c7c7f336a4b6c2ca51420e0ab614aebcc7d2263c625d"}],"qosClass":"Burstable"}}
I1104 15:55:02.774515 12586 request.go:1068] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"mariadb-0","generateName":"mariadb-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/mariadb-0","uid":"8427b17b-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45489082","creationTimestamp":"2020-11-04T12:44:45Z","deletionTimestamp":"2020-11-04T13:55:32Z","deletionGracePeriodSeconds":30,"labels":{"app.kubernetes.io/name":"mariadb","app.kubernetes.io/part-of":"invu-sre-mariadb","controller-revision-hash":"mariadb-b5b65b86c","statefulset.kubernetes.io/pod-name":"mariadb-0"},"annotations":{"checksum/config":"dc020dcc29b6f60d457b31746cd171c10007bd02dc2efc5284aed55dd9e790f0","prometheus.io/port":"9104","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"StatefulSet","name":"mariadb","uid":"8421568d-1e9b-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"data","persistentVolumeClaim":{"claimName":"data-mariadb-0"}},{"name":"init","configMap":{"name":"mariadb-init","defaultMode":420}},{"name":"config-dir","emptyDir":{}},{"name":"config","configMap":{"name":"mariadb-config","defaultMode":420}}],"initContainers":[{"name":"init","image":"busybox","command":["/bin/sh","-c","cp /src/*.cnf /dist"],"resources":{},"volumeMounts":[{"name":"config-dir","mountPath":"/dist"},{"name":"config","mountPath":"/src"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"mariadb","image":"registry.example.com/ce/middleware/mariadb:0.6.56","ports":[{"name":"ist","containerPort":4568,"protocol":"TCP"},{"name":"mysql","containerPort":3306,"protocol":"TCP"},{"name":"replication","containerPort":4567,"protocol":"TCP"},{"name":"sst","containerPort":4444,"protocol":"TCP"}],"env":[{"name":"POD_NAMESPACE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}},{"name":"MYSQL_ROOT_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb","key":"mysql_root_password"}}},{"name":"MYSQL_CLIENT_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}},{"name":"GALERA_SERVICE","value":"mariadb-headless"},{"name":"TRACE","value":"1"}],"resources":{"limits":{"cpu":"500m","memory":"1717986918400m"},"requests":{"cpu":"125m","memory":"1717986918400m"}},"volumeMounts":[{"name":"config-dir","mountPath":"/etc/mysql/conf.d"},{"name":"data","mountPath":"/var/lib/mysql"},{"name":"init","mountPath":"/docker-entrypoint-initdb.d"}],"livenessProbe":{"exec":{"command":["/bin/sh","-c","mysqladmin ping -p${MYSQL_ROOT_PASSWORD}"]},"initialDelaySeconds":3000,"timeoutSeconds":5,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"exec":{"command":["/bin/sh","-c","mysql -p${MYSQL_ROOT_PASSWORD} -e 'SELECT 1';"]},"initialDelaySeconds":30,"timeoutSeconds":5,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"},{"name":"metrics","image":"prom/mysqld-exporter:v0.11.0","ports":[{"name":"metrics","containerPort":9104,"protocol":"TCP"}],"env":[{"name":"DATA_SOURCE_NAME","value":"exporter:zeefah9Tei3he0@(localhost:3306)/"}],"resources":{"limits":{"cpu":"100m","memory":"64Mi"},"requests":{"cpu":"50m","memory":"32Mi"}},"livenessProbe":{"httpGet":{"path":"/","port":"metrics","scheme":"HTTP"},"initialDelaySeconds":30,"timeoutSeconds":5,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/","port":"metrics","scheme":"HTTP"},"initialDelaySeconds":30,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{},"hostname":"mariadb-0","subdomain":"mariadb-headless","affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["mariadb"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:45:19Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:46:23Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:46:23Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:49Z"}],"hostIP":"10.40.56.27","podIP":"10.40.59.179","startTime":"2020-11-04T12:44:49Z","initContainerStatuses":[{"name":"init","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T12:45:19Z","finishedAt":"2020-11-04T12:45:19Z","containerID":"docker://7a827ee7a851ff3e7d4a398feb3d9c3902404ea0ec1a7a208caeb664157ba2cc"}},"lastState":{},"ready":true,"restartCount":0,"image":"busybox:latest","imageID":"docker-pullable://busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","containerID":"docker://7a827ee7a851ff3e7d4a398feb3d9c3902404ea0ec1a7a208caeb664157ba2cc"}],"containerStatuses":[{"name":"mariadb","state":{"running":{"startedAt":"2020-11-04T12:45:29Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/middleware/mariadb:0.6.56","imageID":"docker-pullable://registry.example.com/ce/middleware/mariadb@sha256:b4c12c27093137dbf047773d4ddb99676bedd32c8606bfa1e3c50876d5ce659f","containerID":"docker://07539803833e2d16998d3db0256858cbb47fcf88bef3c0a0ca658ebd249b133d"},{"name":"metrics","state":{"running":{"startedAt":"2020-11-04T12:45:30Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"prom/mysqld-exporter:v0.11.0","imageID":"docker-pullable://prom/mysqld-exporter@sha256:9f4fb61cca309cb4a8c1b9ed9fb4aa75af0f7a21f36d3954667db37c062a0172","containerID":"docker://95101d440115a7b6c4b74e38717130e649cf0753b0eb3f8007b056f14c2cff63"}],"qosClass":"Burstable"}}
I1104 15:55:02.774370 12586 request.go:1068] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"emqx-758448bfd5-h7s9j","generateName":"emqx-758448bfd5-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/emqx-758448bfd5-h7s9j","uid":"7540f9d4-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45489078","creationTimestamp":"2020-11-04T12:44:20Z","deletionTimestamp":"2020-11-04T13:55:32Z","deletionGracePeriodSeconds":30,"labels":{"app.kubernetes.io/name":"emqx","app.kubernetes.io/part-of":"invu-sre-emqx","pod-template-hash":"758448bfd5"},"annotations":{"prometheus.io/port":"9540","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"emqx-758448bfd5","uid":"753f9db6-1e9b-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"data","configMap":{"name":"emqx","items":[{"key":"loaded_plugins","path":"loaded_plugins"}],"defaultMode":420}},{"name":"plugins","configMap":{"name":"emqx","items":[{"key":"emqx_auth_username.conf","path":"emqx_auth_username.conf"},{"key":"emqx_auth_jwt.conf","path":"emqx_auth_jwt.conf"}],"defaultMode":420}},{"name":"certs","configMap":{"name":"emqx","items":[{"key":"jwt_public_key.pem","path":"jwt_public_key.pem"}],"defaultMode":420}},{"name":"emqx-token-nf8kx","secret":{"secretName":"emqx-token-nf8kx","defaultMode":420}}],"containers":[{"name":"exporter","image":"example/emq_exporter:v0.4.1","args":["--emq.node=emqx@$(POD_IP)","--emq.api-version=v3"],"ports":[{"name":"metrics","containerPort":9540,"protocol":"TCP"}],"env":[{"name":"EMQ_USERNAME","value":"admin"},{"name":"EMQ_PASSWORD","valueFrom":{"secretKeyRef":{"name":"emqx","key":"admin_password"}}},{"name":"POD_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}}],"resources":{"limits":{"cpu":"50m","memory":"64Mi"},"requests":{"cpu":"15m","memory":"32Mi"}},"volumeMounts":[{"name":"emqx-token-nf8kx","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"},{"name":"emqx","image":"emqx/emqx:v3.2.7","ports":[{"name":"mqtt","containerPort":1883,"protocol":"TCP"},{"name":"websocket","containerPort":8083,"protocol":"TCP"},{"name":"mgmt","containerPort":8080,"protocol":"TCP"},{"name":"dashboard","containerPort":18083,"protocol":"TCP"}],"env":[{"name":"EMQ_NODE__COOKIE","valueFrom":{"secretKeyRef":{"name":"emqx","key":"node_cookie"}}},{"name":"EMQX_DASHBOARD__DEFAULT_USER__PASSWORD","valueFrom":{"secretKeyRef":{"name":"emqx","key":"admin_password"}}},{"name":"EMQX_ALLOW_ANONYMOUS","value":"false"},{"name":"EMQX_CLUSTER__AUTOCLEAN","value":"5m"},{"name":"EMQX_CLUSTER__AUTOHEAL","value":"on"},{"name":"EMQX_CLUSTER__DISCOVERY","value":"k8s"},{"name":"EMQX_CLUSTER__K8S__ADDRESS_TYPE","value":"ip"},{"name":"EMQX_CLUSTER__K8S__APISERVER","value":"https://kubernetes.default.svc.cluster.local:443"},{"name":"EMQX_CLUSTER__K8S__APP_NAME","value":"emqx"},{"name":"EMQX_CLUSTER__K8S__NAMESPACE","value":"invu-sre"},{"name":"EMQX_CLUSTER__K8S__SERVICE_NAME","value":"emqx"},{"name":"EMQX_CLUSTER__NAME","value":"emqx_cluster"},{"name":"EMQX_MQTT__MAX_PACKET_SIZE","value":"10MB"},{"name":"EMQX_NAME","value":"emqx"}],"resources":{"limits":{"cpu":"500m","memory":"512Mi"},"requests":{"cpu":"200m","memory":"256Mi"}},"volumeMounts":[{"name":"data","mountPath":"/opt/emqx/data/loaded_plugins","subPath":"loaded_plugins"},{"name":"plugins","mountPath":"/opt/emqx/etc/plugins/emqx_auth_username.conf","subPath":"emqx_auth_username.conf"},{"name":"plugins","mountPath":"/opt/emqx/etc/plugins/emqx_auth_jwt.conf","subPath":"emqx_auth_jwt.conf"},{"name":"certs","mountPath":"/opt/emqx/etc/certs/jwt_public_key.pem","subPath":"jwt_public_key.pem"},{"name":"emqx-token-nf8kx","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"exec":{"command":["/bin/sh","-c","emqx_ctl status | grep 'is running'"]},"initialDelaySeconds":45,"timeoutSeconds":1,"periodSeconds":15,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"exec":{"command":["/bin/sh","-c","emqx_ctl status | grep 'is running'"]},"initialDelaySeconds":45,"timeoutSeconds":1,"periodSeconds":15,"successThreshold":1,"failureThreshold":3},"lifecycle":{"preStop":{"exec":{"command":["/bin/sh","-c","emqx stop"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"runAsUser":1000,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"emqx","serviceAccount":"emqx","nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}],"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":100,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"kubernetes.io/hostname"}}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["emqx"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:20Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:45:16Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:45:16Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:20Z"}],"hostIP":"10.40.56.27","podIP":"10.40.32.131","startTime":"2020-11-04T12:44:20Z","containerStatuses":[{"name":"emqx","state":{"running":{"startedAt":"2020-11-04T12:44:26Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"emqx/emqx:v3.2.7","imageID":"docker-pullable://emqx/emqx@sha256:3f31ee2793b4446e98183659b4493992355e2b0d8603df946c641b47f29ced78","containerID":"docker://974f27ae72445d1d6506dd99933c36122005477e60125d19123b9c633295a6e6"},{"name":"exporter","state":{"running":{"startedAt":"2020-11-04T12:44:23Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"example/emq_exporter:v0.4.1","imageID":"docker-pullable://example/emq_exporter@sha256:1526c0476c1e5d740dfc4df36f3295ea27f87b41becf274c760fbd0a51011233","containerID":"docker://f3270342707cf0eb993e24680050991e5bb867a885b32fddd01c81db07c7ab54"}],"qosClass":"Burstable"}}
I1104 15:55:02.777945 12586 request.go:1068] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"schema-registry-7c97c65ddf-dtrwh","generateName":"schema-registry-7c97c65ddf-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/schema-registry-7c97c65ddf-dtrwh","uid":"82f8c4bb-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45489081","creationTimestamp":"2020-11-04T12:44:43Z","deletionTimestamp":"2020-11-04T13:55:32Z","deletionGracePeriodSeconds":30,"labels":{"app.kubernetes.io/name":"schema-registry","app.kubernetes.io/part-of":"invu-sre-ksql-server","pod-template-hash":"7c97c65ddf"},"annotations":{"prometheus.io/port":"5556","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"schema-registry-7c97c65ddf","uid":"82f1e9b2-1e9b-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"jmx-config","configMap":{"name":"schema-registry-jmx-config","defaultMode":420}}],"containers":[{"name":"exporter","image":"example/jmx-prometheus-httpserver:0.11.0","args":["5556","/etc/jmx-schema-registry/jmx-schema-registry-prometheus.yml"],"ports":[{"name":"exporter","containerPort":5556,"protocol":"TCP"}],"resources":{"limits":{"cpu":"25m","memory":"128Mi"},"requests":{"cpu":"10m","memory":"64Mi"}},"volumeMounts":[{"name":"jmx-config","mountPath":"/etc/jmx-schema-registry"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"},{"name":"schema-registry","image":"confluentinc/cp-schema-registry:5.2.2","ports":[{"name":"http","containerPort":8081,"protocol":"TCP"},{"name":"jmx","containerPort":5555,"protocol":"TCP"}],"env":[{"name":"SCHEMA_REGISTRY_KAFKASTORE_BOOTSTRAP_SERVERS","value":"PLAINTEXT://kafka:9092"},{"name":"SCHEMA_REGISTRY_HOST_NAME","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}},{"name":"SCHEMA_REGISTRY_KAFKASTORE_GROUP_ID","value":"invu-sre-ksql-server"},{"name":"SCHEMA_REGISTRY_LISTENERS","value":"http://0.0.0.0:8081"},{"name":"JMX_PORT","value":"5555"}],"resources":{"limits":{"cpu":"500m","memory":"2Gi"},"requests":{"cpu":"200m","memory":"1Gi"}},"livenessProbe":{"httpGet":{"path":"/","port":"http","scheme":"HTTP"},"initialDelaySeconds":45,"timeoutSeconds":1,"periodSeconds":15,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/","port":"http","scheme":"HTTP"},"initialDelaySeconds":45,"timeoutSeconds":1,"periodSeconds":15,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}],"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":100,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"kubernetes.io/hostname"}}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["schema-registry"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:43Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:47:22Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:47:22Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:43Z"}],"hostIP":"10.40.56.27","podIP":"10.40.48.113","startTime":"2020-11-04T12:44:43Z","containerStatuses":[{"name":"exporter","state":{"running":{"startedAt":"2020-11-04T12:44:50Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"example/jmx-prometheus-httpserver:0.11.0","imageID":"docker-pullable://example/jmx-prometheus-httpserver@sha256:725e8a9bfec05f432b931edc11b1ee8bac3895e408bb91af58266dc88ee4e63b","containerID":"docker://c14b0899acd56fa6dbcf478acb6ca6ad50b729ed4fc5484fc331ed704ee29c84"},{"name":"schema-registry","state":{"running":{"startedAt":"2020-11-04T12:46:25Z"}},"lastState":{"terminated":{"exitCode":1,"reason":"Error","startedAt":"2020-11-04T12:45:05Z","finishedAt":"2020-11-04T12:46:25Z","containerID":"docker://46b2bb766b699eca062c6a48dc429c7d4af432b005712b338c5deb9e848de146"}},"ready":true,"restartCount":1,"image":"confluentinc/cp-schema-registry:5.2.2","imageID":"docker-pullable://confluentinc/cp-schema-registry@sha256:0d7a84d486477a0c203ae21d5d52c40d26e810f5b5cfa27a56274692b70949f5","containerID":"docker://7d4a1500d2c48880f43b6b3b657cdd5b4171cad147467607fdef274b694a9592"}],"qosClass":"Burstable"}}
I1104 15:55:02.780269 12586 request.go:1068] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"infrastructure-service-5b8746775c-v98mn","generateName":"infrastructure-service-5b8746775c-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/infrastructure-service-5b8746775c-v98mn","uid":"fc2f3532-1e9f-11eb-9aff-16da7cad7b07","resourceVersion":"45489077","creationTimestamp":"2020-11-04T13:16:44Z","deletionTimestamp":"2020-11-04T13:55:32Z","deletionGracePeriodSeconds":30,"labels":{"app":"infrastructure-service","pod-template-hash":"5b8746775c","release":"invu-sre-infrastructure-service"},"annotations":{"iam.amazonaws.com/role":"invu-sre-objects-access"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"infrastructure-service-5b8746775c","uid":"fc2d93cc-1e9f-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-kvb6j","secret":{"secretName":"default-token-kvb6j","defaultMode":420}}],"initContainers":[{"name":"mysql-client","image":"registry.example.com/ce/utilities/mysql-client","env":[{"name":"DATABASE_NAME","value":"invu_infrastructure_service"},{"name":"MYSQL_USER","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MYSQL_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}}],"resources":{},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"infrastructure-service","image":"registry.example.com/cybervision/invu-infrastructure-service:2.0.0-37566","ports":[{"name":"http","containerPort":80,"protocol":"TCP"}],"env":[{"name":"S3_BUCKET_NAME","value":"invu-sre-objects"},{"name":"LOG_LEVEL_example","value":"DEBUG"},{"name":"S3_BUCKET_REGION","value":"us-east-1"},{"name":"ZOOKEEPER_CONNECT_STRING","value":"kafka-zookeeper:2181"},{"name":"BOOTSTRAP_SERVERS","value":"kafka:9092"},{"name":"DEBUG","value":"false"},{"name":"JAVA_OPTS","value":"-Xmx512M"},{"name":"MARIADB_HOST","value":"mariadb"},{"name":"MARIADB_USERNAME","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MARIADB_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}},{"name":"INSTANCE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.name"}}}],"resources":{"limits":{"cpu":"500m","memory":"1Gi"},"requests":{"cpu":"500m","memory":"750Mi"}},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":240,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":5,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app","operator":"In","values":["infrastructure-service"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:47Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:18:25Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:18:25Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:44Z"}],"hostIP":"10.40.56.27","podIP":"10.40.44.73","startTime":"2020-11-04T13:16:44Z","initContainerStatuses":[{"name":"mysql-client","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T13:16:47Z","finishedAt":"2020-11-04T13:16:47Z","containerID":"docker://bd524fa563b598c44d93acb77f9abfc0891e9c8b3fedce934ddd7d06bc699b91"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/utilities/mysql-client:latest","imageID":"docker-pullable://registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","containerID":"docker://bd524fa563b598c44d93acb77f9abfc0891e9c8b3fedce934ddd7d06bc699b91"}],"containerStatuses":[{"name":"infrastructure-service","state":{"running":{"startedAt":"2020-11-04T13:16:53Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/cybervision/invu-infrastructure-service:2.0.0-37566","imageID":"docker-pullable://registry.example.com/cybervision/invu-infrastructure-service@sha256:00f75459b2ee50deb47884131608f73108158d4faa085d1a5cc237aacd3f2112","containerID":"docker://05675f6f5f5781c38c509dcea0f48266dc9836bedfbdd15df1092499788fa2f4"}],"qosClass":"Burstable"}}
I1104 15:55:02.786682 12586 round_trippers.go:443] GET https://api.example.com/api/v1/namespaces/invu-sre/pods/kafka-0 200 OK in 168 milliseconds
I1104 15:55:02.786709 12586 round_trippers.go:449] Response Headers:
I1104 15:55:02.786716 12586 round_trippers.go:452] Audit-Id: 223c2ec4-3c68-4ad9-aa20-3dc64d537614
I1104 15:55:02.786723 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:02.786729 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:02 GMT
I1104 15:55:02.789909 12586 request.go:1068] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kafka-0","generateName":"kafka-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/kafka-0","uid":"bf92b223-1e9a-11eb-9aff-16da7cad7b07","resourceVersion":"45489084","creationTimestamp":"2020-11-04T12:39:15Z","deletionTimestamp":"2020-11-04T13:58:02Z","deletionGracePeriodSeconds":180,"labels":{"app.kubernetes.io/name":"kafka","app.kubernetes.io/part-of":"invu-sre-kafka","controller-revision-hash":"kafka-7874665d8f","statefulset.kubernetes.io/pod-name":"kafka-0"},"annotations":{"checksum/config":"daad60db589e4fb5a1e13238ca6a87b4e363dc0a8a47c039efb620b65e86d9b9","prometheus.io/port":"9020","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"StatefulSet","name":"kafka","uid":"bf66bc4b-1e9a-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"data","persistentVolumeClaim":{"claimName":"data-kafka-0"}},{"name":"config","configMap":{"name":"kafka","defaultMode":420}}],"initContainers":[{"name":"delete-lost-found","image":"busybox","command":["/bin/sh","-c","rm -rf /dst/lost+found"],"resources":{},"volumeMounts":[{"name":"data","mountPath":"/dst"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"},{"name":"wait-for-zookeeper","image":"busybox","command":["/bin/sh","-c","until echo srvr | nc -w 5 kafka-zookeeper 2181 | grep Mode \u0026\u0026 echo zookeeper ok; do sleep 5; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"broker","image":"registry.example.com/ce/middleware/kafka:0.6.33","command":["/bin/bash","-c","exec ./bin/kafka-server-start.sh /etc/kafka/server.properties --override broker.id=${HOSTNAME##*-} --override advertised.host.name=${HOSTNAME}.kafka-headless.invu-sre.svc.cluster.local "],"ports":[{"name":"client","containerPort":9092,"protocol":"TCP"},{"name":"jmx","containerPort":9999,"protocol":"TCP"},{"name":"agent","containerPort":9020,"protocol":"TCP"}],"env":[{"name":"DNS_NAME","value":"example.com"},{"name":"KAFKA_HEAP_OPTS","value":"-Xmx7g -Xms7g"}],"resources":{"limits":{"cpu":"2","memory":"8Gi"},"requests":{"cpu":"2","memory":"8Gi"}},"volumeMounts":[{"name":"data","mountPath":"/var/lib/kafka"},{"name":"config","mountPath":"/etc/kafka"}],"lifecycle":{"preStop":{"exec":{"command":["/bin/bash","-c","exec ./bin/kafka-server-stop.sh"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"runAsUser":1001,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":180,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{"fsGroup":1001},"hostname":"kafka-0","subdomain":"kafka-headless","affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["zookeeper"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}],"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":100,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["zookeeper"]}]},"topologyKey":"kubernetes.io/hostname"}}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:43:09Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:43:15Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:43:15Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:42:54Z"}],"hostIP":"10.40.56.27","podIP":"10.40.44.88","startTime":"2020-11-04T12:42:54Z","initContainerStatuses":[{"name":"delete-lost-found","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T12:43:07Z","finishedAt":"2020-11-04T12:43:07Z","containerID":"docker://2774295ea860555b7db14d5bdd827b40b3971976f8af9e5c3ff0eef8ff491b2c"}},"lastState":{},"ready":true,"restartCount":0,"image":"busybox:latest","imageID":"docker-pullable://busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","containerID":"docker://2774295ea860555b7db14d5bdd827b40b3971976f8af9e5c3ff0eef8ff491b2c"},{"name":"wait-for-zookeeper","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T12:43:09Z","finishedAt":"2020-11-04T12:43:09Z","containerID":"docker://1d6f11662dce2bdbfe8c27a73383f62f7a9adb72323fd786a91e5c62b106e19e"}},"lastState":{},"ready":true,"restartCount":0,"image":"busybox:latest","imageID":"docker-pullable://busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","containerID":"docker://1d6f11662dce2bdbfe8c27a73383f62f7a9adb72323fd786a91e5c62b106e19e"}],"containerStatuses":[{"name":"broker","state":{"running":{"startedAt":"2020-11-04T12:43:15Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/middleware/kafka:0.6.33","imageID":"docker-pullable://registry.example.com/ce/middleware/kafka@sha256:5a13ea153f26ac29e73fd3a0ed67c701f33ea761a0b10a03870fdda51e3975cc","containerID":"docker://aab562c6506685007f59fc42f95492910f41f3e3a4106afc8c1c4803eaf3a61c"}],"qosClass":"Guaranteed"}}
I1104 15:55:03.785615 12586 round_trippers.go:423] curl -k -v -XGET -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" -H "Accept: application/json, */*" 'https://api.example.com/api/v1/namespaces/invu-sre/pods/mariadb-0'
I1104 15:55:03.785954 12586 round_trippers.go:423] curl -k -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" 'https://api.example.com/api/v1/namespaces/invu-sre/pods/emqx-758448bfd5-h7s9j'
I1104 15:55:03.787549 12586 round_trippers.go:423] curl -k -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" 'https://api.example.com/api/v1/namespaces/invu-sre/pods/kafka-connect-6c5dfdbfb4-2hdbw'
I1104 15:55:03.787606 12586 round_trippers.go:423] curl -k -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" 'https://api.example.com/api/v1/namespaces/invu-sre/pods/schema-registry-7c97c65ddf-dtrwh'
I1104 15:55:03.787739 12586 round_trippers.go:423] curl -k -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" 'https://api.example.com/api/v1/namespaces/invu-sre/pods/infrastructure-service-5b8746775c-v98mn'
I1104 15:55:03.790671 12586 round_trippers.go:423] curl -k -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" 'https://api.example.com/api/v1/namespaces/invu-sre/pods/kafka-0'
I1104 15:55:03.951527 12586 round_trippers.go:443] GET https://api.example.com/api/v1/namespaces/invu-sre/pods/emqx-758448bfd5-h7s9j 200 OK in 165 milliseconds
I1104 15:55:03.951554 12586 round_trippers.go:443] GET https://api.example.com/api/v1/namespaces/invu-sre/pods/infrastructure-service-5b8746775c-v98mn 200 OK in 163 milliseconds
I1104 15:55:03.951562 12586 round_trippers.go:449] Response Headers:
I1104 15:55:03.951566 12586 round_trippers.go:452] Audit-Id: f7e0b3d1-1595-4977-955e-20934394ad0b
I1104 15:55:03.951569 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:03.951571 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:03 GMT
I1104 15:55:03.951622 12586 request.go:1068] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"infrastructure-service-5b8746775c-v98mn","generateName":"infrastructure-service-5b8746775c-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/infrastructure-service-5b8746775c-v98mn","uid":"fc2f3532-1e9f-11eb-9aff-16da7cad7b07","resourceVersion":"45489077","creationTimestamp":"2020-11-04T13:16:44Z","deletionTimestamp":"2020-11-04T13:55:32Z","deletionGracePeriodSeconds":30,"labels":{"app":"infrastructure-service","pod-template-hash":"5b8746775c","release":"invu-sre-infrastructure-service"},"annotations":{"iam.amazonaws.com/role":"invu-sre-objects-access"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"infrastructure-service-5b8746775c","uid":"fc2d93cc-1e9f-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-kvb6j","secret":{"secretName":"default-token-kvb6j","defaultMode":420}}],"initContainers":[{"name":"mysql-client","image":"registry.example.com/ce/utilities/mysql-client","env":[{"name":"DATABASE_NAME","value":"invu_infrastructure_service"},{"name":"MYSQL_USER","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MYSQL_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}}],"resources":{},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"infrastructure-service","image":"registry.example.com/cybervision/invu-infrastructure-service:2.0.0-37566","ports":[{"name":"http","containerPort":80,"protocol":"TCP"}],"env":[{"name":"S3_BUCKET_NAME","value":"invu-sre-objects"},{"name":"LOG_LEVEL_example","value":"DEBUG"},{"name":"S3_BUCKET_REGION","value":"us-east-1"},{"name":"ZOOKEEPER_CONNECT_STRING","value":"kafka-zookeeper:2181"},{"name":"BOOTSTRAP_SERVERS","value":"kafka:9092"},{"name":"DEBUG","value":"false"},{"name":"JAVA_OPTS","value":"-Xmx512M"},{"name":"MARIADB_HOST","value":"mariadb"},{"name":"MARIADB_USERNAME","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MARIADB_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}},{"name":"INSTANCE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.name"}}}],"resources":{"limits":{"cpu":"500m","memory":"1Gi"},"requests":{"cpu":"500m","memory":"750Mi"}},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":240,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":5,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app","operator":"In","values":["infrastructure-service"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:47Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:18:25Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:18:25Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:44Z"}],"hostIP":"10.40.56.27","podIP":"10.40.44.73","startTime":"2020-11-04T13:16:44Z","initContainerStatuses":[{"name":"mysql-client","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T13:16:47Z","finishedAt":"2020-11-04T13:16:47Z","containerID":"docker://bd524fa563b598c44d93acb77f9abfc0891e9c8b3fedce934ddd7d06bc699b91"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/utilities/mysql-client:latest","imageID":"docker-pullable://registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","containerID":"docker://bd524fa563b598c44d93acb77f9abfc0891e9c8b3fedce934ddd7d06bc699b91"}],"containerStatuses":[{"name":"infrastructure-service","state":{"running":{"startedAt":"2020-11-04T13:16:53Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/cybervision/invu-infrastructure-service:2.0.0-37566","imageID":"docker-pullable://registry.example.com/cybervision/invu-infrastructure-service@sha256:00f75459b2ee50deb47884131608f73108158d4faa085d1a5cc237aacd3f2112","containerID":"docker://05675f6f5f5781c38c509dcea0f48266dc9836bedfbdd15df1092499788fa2f4"}],"qosClass":"Burstable"}}
I1104 15:55:03.951554 12586 round_trippers.go:449] Response Headers:
I1104 15:55:03.951653 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:03 GMT
I1104 15:55:03.951659 12586 round_trippers.go:452] Audit-Id: 0455b692-79a6-4866-bdb8-552bcf2b933c
I1104 15:55:03.951664 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:03.951549 12586 round_trippers.go:443] GET https://api.example.com/api/v1/namespaces/invu-sre/pods/mariadb-0 200 OK in 165 milliseconds
I1104 15:55:03.951715 12586 round_trippers.go:449] Response Headers:
I1104 15:55:03.951721 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:03.951726 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:03 GMT
I1104 15:55:03.951725 12586 request.go:1068] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"emqx-758448bfd5-h7s9j","generateName":"emqx-758448bfd5-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/emqx-758448bfd5-h7s9j","uid":"7540f9d4-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45489078","creationTimestamp":"2020-11-04T12:44:20Z","deletionTimestamp":"2020-11-04T13:55:32Z","deletionGracePeriodSeconds":30,"labels":{"app.kubernetes.io/name":"emqx","app.kubernetes.io/part-of":"invu-sre-emqx","pod-template-hash":"758448bfd5"},"annotations":{"prometheus.io/port":"9540","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"emqx-758448bfd5","uid":"753f9db6-1e9b-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"data","configMap":{"name":"emqx","items":[{"key":"loaded_plugins","path":"loaded_plugins"}],"defaultMode":420}},{"name":"plugins","configMap":{"name":"emqx","items":[{"key":"emqx_auth_username.conf","path":"emqx_auth_username.conf"},{"key":"emqx_auth_jwt.conf","path":"emqx_auth_jwt.conf"}],"defaultMode":420}},{"name":"certs","configMap":{"name":"emqx","items":[{"key":"jwt_public_key.pem","path":"jwt_public_key.pem"}],"defaultMode":420}},{"name":"emqx-token-nf8kx","secret":{"secretName":"emqx-token-nf8kx","defaultMode":420}}],"containers":[{"name":"exporter","image":"example/emq_exporter:v0.4.1","args":["--emq.node=emqx@$(POD_IP)","--emq.api-version=v3"],"ports":[{"name":"metrics","containerPort":9540,"protocol":"TCP"}],"env":[{"name":"EMQ_USERNAME","value":"admin"},{"name":"EMQ_PASSWORD","valueFrom":{"secretKeyRef":{"name":"emqx","key":"admin_password"}}},{"name":"POD_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}}],"resources":{"limits":{"cpu":"50m","memory":"64Mi"},"requests":{"cpu":"15m","memory":"32Mi"}},"volumeMounts":[{"name":"emqx-token-nf8kx","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"},{"name":"emqx","image":"emqx/emqx:v3.2.7","ports":[{"name":"mqtt","containerPort":1883,"protocol":"TCP"},{"name":"websocket","containerPort":8083,"protocol":"TCP"},{"name":"mgmt","containerPort":8080,"protocol":"TCP"},{"name":"dashboard","containerPort":18083,"protocol":"TCP"}],"env":[{"name":"EMQ_NODE__COOKIE","valueFrom":{"secretKeyRef":{"name":"emqx","key":"node_cookie"}}},{"name":"EMQX_DASHBOARD__DEFAULT_USER__PASSWORD","valueFrom":{"secretKeyRef":{"name":"emqx","key":"admin_password"}}},{"name":"EMQX_ALLOW_ANONYMOUS","value":"false"},{"name":"EMQX_CLUSTER__AUTOCLEAN","value":"5m"},{"name":"EMQX_CLUSTER__AUTOHEAL","value":"on"},{"name":"EMQX_CLUSTER__DISCOVERY","value":"k8s"},{"name":"EMQX_CLUSTER__K8S__ADDRESS_TYPE","value":"ip"},{"name":"EMQX_CLUSTER__K8S__APISERVER","value":"https://kubernetes.default.svc.cluster.local:443"},{"name":"EMQX_CLUSTER__K8S__APP_NAME","value":"emqx"},{"name":"EMQX_CLUSTER__K8S__NAMESPACE","value":"invu-sre"},{"name":"EMQX_CLUSTER__K8S__SERVICE_NAME","value":"emqx"},{"name":"EMQX_CLUSTER__NAME","value":"emqx_cluster"},{"name":"EMQX_MQTT__MAX_PACKET_SIZE","value":"10MB"},{"name":"EMQX_NAME","value":"emqx"}],"resources":{"limits":{"cpu":"500m","memory":"512Mi"},"requests":{"cpu":"200m","memory":"256Mi"}},"volumeMounts":[{"name":"data","mountPath":"/opt/emqx/data/loaded_plugins","subPath":"loaded_plugins"},{"name":"plugins","mountPath":"/opt/emqx/etc/plugins/emqx_auth_username.conf","subPath":"emqx_auth_username.conf"},{"name":"plugins","mountPath":"/opt/emqx/etc/plugins/emqx_auth_jwt.conf","subPath":"emqx_auth_jwt.conf"},{"name":"certs","mountPath":"/opt/emqx/etc/certs/jwt_public_key.pem","subPath":"jwt_public_key.pem"},{"name":"emqx-token-nf8kx","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"exec":{"command":["/bin/sh","-c","emqx_ctl status | grep 'is running'"]},"initialDelaySeconds":45,"timeoutSeconds":1,"periodSeconds":15,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"exec":{"command":["/bin/sh","-c","emqx_ctl status | grep 'is running'"]},"initialDelaySeconds":45,"timeoutSeconds":1,"periodSeconds":15,"successThreshold":1,"failureThreshold":3},"lifecycle":{"preStop":{"exec":{"command":["/bin/sh","-c","emqx stop"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"runAsUser":1000,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"emqx","serviceAccount":"emqx","nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}],"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":100,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"kubernetes.io/hostname"}}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["emqx"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:20Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:45:16Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:45:16Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:20Z"}],"hostIP":"10.40.56.27","podIP":"10.40.32.131","startTime":"2020-11-04T12:44:20Z","containerStatuses":[{"name":"emqx","state":{"running":{"startedAt":"2020-11-04T12:44:26Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"emqx/emqx:v3.2.7","imageID":"docker-pullable://emqx/emqx@sha256:3f31ee2793b4446e98183659b4493992355e2b0d8603df946c641b47f29ced78","containerID":"docker://974f27ae72445d1d6506dd99933c36122005477e60125d19123b9c633295a6e6"},{"name":"exporter","state":{"running":{"startedAt":"2020-11-04T12:44:23Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"example/emq_exporter:v0.4.1","imageID":"docker-pullable://example/emq_exporter@sha256:1526c0476c1e5d740dfc4df36f3295ea27f87b41becf274c760fbd0a51011233","containerID":"docker://f3270342707cf0eb993e24680050991e5bb867a885b32fddd01c81db07c7ab54"}],"qosClass":"Burstable"}}
I1104 15:55:03.951730 12586 round_trippers.go:452] Audit-Id: 31ebae9b-593b-4bae-aafa-012867a6f573
I1104 15:55:03.951845 12586 request.go:1068] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"mariadb-0","generateName":"mariadb-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/mariadb-0","uid":"8427b17b-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45489082","creationTimestamp":"2020-11-04T12:44:45Z","deletionTimestamp":"2020-11-04T13:55:32Z","deletionGracePeriodSeconds":30,"labels":{"app.kubernetes.io/name":"mariadb","app.kubernetes.io/part-of":"invu-sre-mariadb","controller-revision-hash":"mariadb-b5b65b86c","statefulset.kubernetes.io/pod-name":"mariadb-0"},"annotations":{"checksum/config":"dc020dcc29b6f60d457b31746cd171c10007bd02dc2efc5284aed55dd9e790f0","prometheus.io/port":"9104","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"StatefulSet","name":"mariadb","uid":"8421568d-1e9b-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"data","persistentVolumeClaim":{"claimName":"data-mariadb-0"}},{"name":"init","configMap":{"name":"mariadb-init","defaultMode":420}},{"name":"config-dir","emptyDir":{}},{"name":"config","configMap":{"name":"mariadb-config","defaultMode":420}}],"initContainers":[{"name":"init","image":"busybox","command":["/bin/sh","-c","cp /src/*.cnf /dist"],"resources":{},"volumeMounts":[{"name":"config-dir","mountPath":"/dist"},{"name":"config","mountPath":"/src"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"mariadb","image":"registry.example.com/ce/middleware/mariadb:0.6.56","ports":[{"name":"ist","containerPort":4568,"protocol":"TCP"},{"name":"mysql","containerPort":3306,"protocol":"TCP"},{"name":"replication","containerPort":4567,"protocol":"TCP"},{"name":"sst","containerPort":4444,"protocol":"TCP"}],"env":[{"name":"POD_NAMESPACE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}},{"name":"MYSQL_ROOT_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb","key":"mysql_root_password"}}},{"name":"MYSQL_CLIENT_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}},{"name":"GALERA_SERVICE","value":"mariadb-headless"},{"name":"TRACE","value":"1"}],"resources":{"limits":{"cpu":"500m","memory":"1717986918400m"},"requests":{"cpu":"125m","memory":"1717986918400m"}},"volumeMounts":[{"name":"config-dir","mountPath":"/etc/mysql/conf.d"},{"name":"data","mountPath":"/var/lib/mysql"},{"name":"init","mountPath":"/docker-entrypoint-initdb.d"}],"livenessProbe":{"exec":{"command":["/bin/sh","-c","mysqladmin ping -p${MYSQL_ROOT_PASSWORD}"]},"initialDelaySeconds":3000,"timeoutSeconds":5,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"exec":{"command":["/bin/sh","-c","mysql -p${MYSQL_ROOT_PASSWORD} -e 'SELECT 1';"]},"initialDelaySeconds":30,"timeoutSeconds":5,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"},{"name":"metrics","image":"prom/mysqld-exporter:v0.11.0","ports":[{"name":"metrics","containerPort":9104,"protocol":"TCP"}],"env":[{"name":"DATA_SOURCE_NAME","value":"exporter:zeefah9Tei3he0@(localhost:3306)/"}],"resources":{"limits":{"cpu":"100m","memory":"64Mi"},"requests":{"cpu":"50m","memory":"32Mi"}},"livenessProbe":{"httpGet":{"path":"/","port":"metrics","scheme":"HTTP"},"initialDelaySeconds":30,"timeoutSeconds":5,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/","port":"metrics","scheme":"HTTP"},"initialDelaySeconds":30,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{},"hostname":"mariadb-0","subdomain":"mariadb-headless","affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["mariadb"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:45:19Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:46:23Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:46:23Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:49Z"}],"hostIP":"10.40.56.27","podIP":"10.40.59.179","startTime":"2020-11-04T12:44:49Z","initContainerStatuses":[{"name":"init","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T12:45:19Z","finishedAt":"2020-11-04T12:45:19Z","containerID":"docker://7a827ee7a851ff3e7d4a398feb3d9c3902404ea0ec1a7a208caeb664157ba2cc"}},"lastState":{},"ready":true,"restartCount":0,"image":"busybox:latest","imageID":"docker-pullable://busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","containerID":"docker://7a827ee7a851ff3e7d4a398feb3d9c3902404ea0ec1a7a208caeb664157ba2cc"}],"containerStatuses":[{"name":"mariadb","state":{"running":{"startedAt":"2020-11-04T12:45:29Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/middleware/mariadb:0.6.56","imageID":"docker-pullable://registry.example.com/ce/middleware/mariadb@sha256:b4c12c27093137dbf047773d4ddb99676bedd32c8606bfa1e3c50876d5ce659f","containerID":"docker://07539803833e2d16998d3db0256858cbb47fcf88bef3c0a0ca658ebd249b133d"},{"name":"metrics","state":{"running":{"startedAt":"2020-11-04T12:45:30Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"prom/mysqld-exporter:v0.11.0","imageID":"docker-pullable://prom/mysqld-exporter@sha256:9f4fb61cca309cb4a8c1b9ed9fb4aa75af0f7a21f36d3954667db37c062a0172","containerID":"docker://95101d440115a7b6c4b74e38717130e649cf0753b0eb3f8007b056f14c2cff63"}],"qosClass":"Burstable"}}
I1104 15:55:03.951556 12586 round_trippers.go:443] GET https://api.example.com/api/v1/namespaces/invu-sre/pods/kafka-connect-6c5dfdbfb4-2hdbw 200 OK in 163 milliseconds
I1104 15:55:03.951873 12586 round_trippers.go:449] Response Headers:
I1104 15:55:03.951878 12586 round_trippers.go:452] Audit-Id: f833be20-3bac-4434-948f-caeaffbbc4ab
I1104 15:55:03.951882 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:03.951886 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:03 GMT
I1104 15:55:03.951940 12586 request.go:1068] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kafka-connect-6c5dfdbfb4-2hdbw","generateName":"kafka-connect-6c5dfdbfb4-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/kafka-connect-6c5dfdbfb4-2hdbw","uid":"f328eda8-1e9f-11eb-9aff-16da7cad7b07","resourceVersion":"45489079","creationTimestamp":"2020-11-04T13:16:29Z","deletionTimestamp":"2020-11-04T13:55:32Z","deletionGracePeriodSeconds":30,"labels":{"app.kubernetes.io/instance":"kafka-connect","app.kubernetes.io/name":"kafka-connect","pod-template-hash":"6c5dfdbfb4"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"kafka-connect-6c5dfdbfb4","uid":"f323a896-1e9f-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"config","configMap":{"name":"kafka-connect","defaultMode":420}}],"containers":[{"name":"kafka-connect","image":"registry.example.com/cybervision/invu-kafka-connect-sinks/kafka-connect:2.0.0-37698","command":["/bin/sh","-c","$KAFKA_HOME/bin/connect-distributed.sh /etc/connect/connect-distributed.properties"],"ports":[{"name":"http","containerPort":8083,"protocol":"TCP"},{"name":"jmx","containerPort":9999,"protocol":"TCP"}],"env":[{"name":"KAFKA_HEAP_OPTS","value":"-Xmx750m -Xms750m"},{"name":"JMXPORT","value":"9999"}],"resources":{"limits":{"cpu":"1","memory":"1500Mi"},"requests":{"cpu":"750m","memory":"1000Mi"}},"volumeMounts":[{"name":"config","mountPath":"/etc/connect/"}],"livenessProbe":{"httpGet":{"path":"/","port":8083,"scheme":"HTTP"},"initialDelaySeconds":45,"timeoutSeconds":10,"periodSeconds":10,"successThreshold":1,"failureThreshold":6},"readinessProbe":{"httpGet":{"path":"/connector-plugins","port":8083,"scheme":"HTTP"},"initialDelaySeconds":30,"timeoutSeconds":10,"periodSeconds":10,"successThreshold":1,"failureThreshold":5},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{"runAsUser":1001,"runAsNonRoot":true},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}],"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":100,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"kubernetes.io/hostname"}}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka-connect"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:29Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:17:15Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:17:15Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:29Z"}],"hostIP":"10.40.56.27","podIP":"10.40.45.113","startTime":"2020-11-04T13:16:29Z","containerStatuses":[{"name":"kafka-connect","state":{"running":{"startedAt":"2020-11-04T13:16:44Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/cybervision/invu-kafka-connect-sinks/kafka-connect:2.0.0-37698","imageID":"docker-pullable://registry.example.com/cybervision/invu-kafka-connect-sinks/kafka-connect@sha256:6a584826ecf0bbdf654fbe27201e2ed07d5586bd6f0c414c13be40ac3f6cc62f","containerID":"docker://3431c9748539e0095632c7c7f336a4b6c2ca51420e0ab614aebcc7d2263c625d"}],"qosClass":"Burstable"}}
I1104 15:55:03.951543 12586 round_trippers.go:443] GET https://api.example.com/api/v1/namespaces/invu-sre/pods/kafka-0 200 OK in 160 milliseconds
I1104 15:55:03.951960 12586 round_trippers.go:449] Response Headers:
I1104 15:55:03.951964 12586 round_trippers.go:452] Audit-Id: 5658bbc5-6b41-49d9-b2e7-170da28f3d5e
I1104 15:55:03.951968 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:03.951547 12586 round_trippers.go:443] GET https://api.example.com/api/v1/namespaces/invu-sre/pods/schema-registry-7c97c65ddf-dtrwh 200 OK in 163 milliseconds
I1104 15:55:03.951979 12586 round_trippers.go:449] Response Headers:
I1104 15:55:03.951985 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:03 GMT
I1104 15:55:03.951994 12586 round_trippers.go:452] Audit-Id: aa148305-9611-4d78-9d66-b339bf3e2990
I1104 15:55:03.951999 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:03.951970 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:03 GMT
I1104 15:55:03.952036 12586 request.go:1068] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kafka-0","generateName":"kafka-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/kafka-0","uid":"bf92b223-1e9a-11eb-9aff-16da7cad7b07","resourceVersion":"45489084","creationTimestamp":"2020-11-04T12:39:15Z","deletionTimestamp":"2020-11-04T13:58:02Z","deletionGracePeriodSeconds":180,"labels":{"app.kubernetes.io/name":"kafka","app.kubernetes.io/part-of":"invu-sre-kafka","controller-revision-hash":"kafka-7874665d8f","statefulset.kubernetes.io/pod-name":"kafka-0"},"annotations":{"checksum/config":"daad60db589e4fb5a1e13238ca6a87b4e363dc0a8a47c039efb620b65e86d9b9","prometheus.io/port":"9020","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"StatefulSet","name":"kafka","uid":"bf66bc4b-1e9a-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"data","persistentVolumeClaim":{"claimName":"data-kafka-0"}},{"name":"config","configMap":{"name":"kafka","defaultMode":420}}],"initContainers":[{"name":"delete-lost-found","image":"busybox","command":["/bin/sh","-c","rm -rf /dst/lost+found"],"resources":{},"volumeMounts":[{"name":"data","mountPath":"/dst"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"},{"name":"wait-for-zookeeper","image":"busybox","command":["/bin/sh","-c","until echo srvr | nc -w 5 kafka-zookeeper 2181 | grep Mode \u0026\u0026 echo zookeeper ok; do sleep 5; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"broker","image":"registry.example.com/ce/middleware/kafka:0.6.33","command":["/bin/bash","-c","exec ./bin/kafka-server-start.sh /etc/kafka/server.properties --override broker.id=${HOSTNAME##*-} --override advertised.host.name=${HOSTNAME}.kafka-headless.invu-sre.svc.cluster.local "],"ports":[{"name":"client","containerPort":9092,"protocol":"TCP"},{"name":"jmx","containerPort":9999,"protocol":"TCP"},{"name":"agent","containerPort":9020,"protocol":"TCP"}],"env":[{"name":"DNS_NAME","value":"example.com"},{"name":"KAFKA_HEAP_OPTS","value":"-Xmx7g -Xms7g"}],"resources":{"limits":{"cpu":"2","memory":"8Gi"},"requests":{"cpu":"2","memory":"8Gi"}},"volumeMounts":[{"name":"data","mountPath":"/var/lib/kafka"},{"name":"config","mountPath":"/etc/kafka"}],"lifecycle":{"preStop":{"exec":{"command":["/bin/bash","-c","exec ./bin/kafka-server-stop.sh"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"runAsUser":1001,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":180,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{"fsGroup":1001},"hostname":"kafka-0","subdomain":"kafka-headless","affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["zookeeper"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}],"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":100,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["zookeeper"]}]},"topologyKey":"kubernetes.io/hostname"}}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:43:09Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:43:15Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:43:15Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:42:54Z"}],"hostIP":"10.40.56.27","podIP":"10.40.44.88","startTime":"2020-11-04T12:42:54Z","initContainerStatuses":[{"name":"delete-lost-found","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T12:43:07Z","finishedAt":"2020-11-04T12:43:07Z","containerID":"docker://2774295ea860555b7db14d5bdd827b40b3971976f8af9e5c3ff0eef8ff491b2c"}},"lastState":{},"ready":true,"restartCount":0,"image":"busybox:latest","imageID":"docker-pullable://busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","containerID":"docker://2774295ea860555b7db14d5bdd827b40b3971976f8af9e5c3ff0eef8ff491b2c"},{"name":"wait-for-zookeeper","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T12:43:09Z","finishedAt":"2020-11-04T12:43:09Z","containerID":"docker://1d6f11662dce2bdbfe8c27a73383f62f7a9adb72323fd786a91e5c62b106e19e"}},"lastState":{},"ready":true,"restartCount":0,"image":"busybox:latest","imageID":"docker-pullable://busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","containerID":"docker://1d6f11662dce2bdbfe8c27a73383f62f7a9adb72323fd786a91e5c62b106e19e"}],"containerStatuses":[{"name":"broker","state":{"running":{"startedAt":"2020-11-04T12:43:15Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/middleware/kafka:0.6.33","imageID":"docker-pullable://registry.example.com/ce/middleware/kafka@sha256:5a13ea153f26ac29e73fd3a0ed67c701f33ea761a0b10a03870fdda51e3975cc","containerID":"docker://aab562c6506685007f59fc42f95492910f41f3e3a4106afc8c1c4803eaf3a61c"}],"qosClass":"Guaranteed"}}
I1104 15:55:03.952048 12586 request.go:1068] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"schema-registry-7c97c65ddf-dtrwh","generateName":"schema-registry-7c97c65ddf-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/schema-registry-7c97c65ddf-dtrwh","uid":"82f8c4bb-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45489081","creationTimestamp":"2020-11-04T12:44:43Z","deletionTimestamp":"2020-11-04T13:55:32Z","deletionGracePeriodSeconds":30,"labels":{"app.kubernetes.io/name":"schema-registry","app.kubernetes.io/part-of":"invu-sre-ksql-server","pod-template-hash":"7c97c65ddf"},"annotations":{"prometheus.io/port":"5556","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"schema-registry-7c97c65ddf","uid":"82f1e9b2-1e9b-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"jmx-config","configMap":{"name":"schema-registry-jmx-config","defaultMode":420}}],"containers":[{"name":"exporter","image":"example/jmx-prometheus-httpserver:0.11.0","args":["5556","/etc/jmx-schema-registry/jmx-schema-registry-prometheus.yml"],"ports":[{"name":"exporter","containerPort":5556,"protocol":"TCP"}],"resources":{"limits":{"cpu":"25m","memory":"128Mi"},"requests":{"cpu":"10m","memory":"64Mi"}},"volumeMounts":[{"name":"jmx-config","mountPath":"/etc/jmx-schema-registry"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"},{"name":"schema-registry","image":"confluentinc/cp-schema-registry:5.2.2","ports":[{"name":"http","containerPort":8081,"protocol":"TCP"},{"name":"jmx","containerPort":5555,"protocol":"TCP"}],"env":[{"name":"SCHEMA_REGISTRY_KAFKASTORE_BOOTSTRAP_SERVERS","value":"PLAINTEXT://kafka:9092"},{"name":"SCHEMA_REGISTRY_HOST_NAME","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}},{"name":"SCHEMA_REGISTRY_KAFKASTORE_GROUP_ID","value":"invu-sre-ksql-server"},{"name":"SCHEMA_REGISTRY_LISTENERS","value":"http://0.0.0.0:8081"},{"name":"JMX_PORT","value":"5555"}],"resources":{"limits":{"cpu":"500m","memory":"2Gi"},"requests":{"cpu":"200m","memory":"1Gi"}},"livenessProbe":{"httpGet":{"path":"/","port":"http","scheme":"HTTP"},"initialDelaySeconds":45,"timeoutSeconds":1,"periodSeconds":15,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/","port":"http","scheme":"HTTP"},"initialDelaySeconds":45,"timeoutSeconds":1,"periodSeconds":15,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}],"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":100,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"kubernetes.io/hostname"}}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["schema-registry"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:43Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:47:22Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:47:22Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:43Z"}],"hostIP":"10.40.56.27","podIP":"10.40.48.113","startTime":"2020-11-04T12:44:43Z","containerStatuses":[{"name":"exporter","state":{"running":{"startedAt":"2020-11-04T12:44:50Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"example/jmx-prometheus-httpserver:0.11.0","imageID":"docker-pullable://example/jmx-prometheus-httpserver@sha256:725e8a9bfec05f432b931edc11b1ee8bac3895e408bb91af58266dc88ee4e63b","containerID":"docker://c14b0899acd56fa6dbcf478acb6ca6ad50b729ed4fc5484fc331ed704ee29c84"},{"name":"schema-registry","state":{"running":{"startedAt":"2020-11-04T12:46:25Z"}},"lastState":{"terminated":{"exitCode":1,"reason":"Error","startedAt":"2020-11-04T12:45:05Z","finishedAt":"2020-11-04T12:46:25Z","containerID":"docker://46b2bb766b699eca062c6a48dc429c7d4af432b005712b338c5deb9e848de146"}},"ready":true,"restartCount":1,"image":"confluentinc/cp-schema-registry:5.2.2","imageID":"docker-pullable://confluentinc/cp-schema-registry@sha256:0d7a84d486477a0c203ae21d5d52c40d26e810f5b5cfa27a56274692b70949f5","containerID":"docker://7d4a1500d2c48880f43b6b3b657cdd5b4171cad147467607fdef274b694a9592"}],"qosClass":"Burstable"}}
I1104 15:55:04.785524 12586 round_trippers.go:423] curl -k -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" 'https://api.example.com/api/v1/namespaces/invu-sre/pods/mariadb-0'
I1104 15:55:04.785920 12586 round_trippers.go:423] curl -k -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" 'https://api.example.com/api/v1/namespaces/invu-sre/pods/emqx-758448bfd5-h7s9j'
I1104 15:55:04.787556 12586 round_trippers.go:423] curl -k -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" 'https://api.example.com/api/v1/namespaces/invu-sre/pods/kafka-connect-6c5dfdbfb4-2hdbw'
I1104 15:55:04.787638 12586 round_trippers.go:423] curl -k -v -XGET -H "Authorization: Basic ******" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Accept: application/json, */*" 'https://api.example.com/api/v1/namespaces/invu-sre/pods/schema-registry-7c97c65ddf-dtrwh'
I1104 15:55:04.787762 12586 round_trippers.go:423] curl -k -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" 'https://api.example.com/api/v1/namespaces/invu-sre/pods/infrastructure-service-5b8746775c-v98mn'
I1104 15:55:04.790440 12586 round_trippers.go:423] curl -k -v -XGET -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" -H "Accept: application/json, */*" 'https://api.example.com/api/v1/namespaces/invu-sre/pods/kafka-0'
I1104 15:55:04.935628 12586 round_trippers.go:443] GET https://api.example.com/api/v1/namespaces/invu-sre/pods/schema-registry-7c97c65ddf-dtrwh 200 OK in 147 milliseconds
I1104 15:55:04.935650 12586 round_trippers.go:449] Response Headers:
I1104 15:55:04.935654 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:04 GMT
I1104 15:55:04.935628 12586 round_trippers.go:443] GET https://api.example.com/api/v1/namespaces/invu-sre/pods/mariadb-0 200 OK in 150 milliseconds
I1104 15:55:04.935671 12586 round_trippers.go:449] Response Headers:
I1104 15:55:04.935678 12586 round_trippers.go:452] Audit-Id: 0fa835eb-1d75-4d4f-ad3c-1938c7025eb0
I1104 15:55:04.935683 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:04.935687 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:04 GMT
I1104 15:55:04.935657 12586 round_trippers.go:452] Audit-Id: 3611a13e-5cae-4f63-a900-f61296c7063e
I1104 15:55:04.935736 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:04.935773 12586 request.go:1068] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"mariadb-0","generateName":"mariadb-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/mariadb-0","uid":"8427b17b-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45489082","creationTimestamp":"2020-11-04T12:44:45Z","deletionTimestamp":"2020-11-04T13:55:32Z","deletionGracePeriodSeconds":30,"labels":{"app.kubernetes.io/name":"mariadb","app.kubernetes.io/part-of":"invu-sre-mariadb","controller-revision-hash":"mariadb-b5b65b86c","statefulset.kubernetes.io/pod-name":"mariadb-0"},"annotations":{"checksum/config":"dc020dcc29b6f60d457b31746cd171c10007bd02dc2efc5284aed55dd9e790f0","prometheus.io/port":"9104","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"StatefulSet","name":"mariadb","uid":"8421568d-1e9b-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"data","persistentVolumeClaim":{"claimName":"data-mariadb-0"}},{"name":"init","configMap":{"name":"mariadb-init","defaultMode":420}},{"name":"config-dir","emptyDir":{}},{"name":"config","configMap":{"name":"mariadb-config","defaultMode":420}}],"initContainers":[{"name":"init","image":"busybox","command":["/bin/sh","-c","cp /src/*.cnf /dist"],"resources":{},"volumeMounts":[{"name":"config-dir","mountPath":"/dist"},{"name":"config","mountPath":"/src"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"mariadb","image":"registry.example.com/ce/middleware/mariadb:0.6.56","ports":[{"name":"ist","containerPort":4568,"protocol":"TCP"},{"name":"mysql","containerPort":3306,"protocol":"TCP"},{"name":"replication","containerPort":4567,"protocol":"TCP"},{"name":"sst","containerPort":4444,"protocol":"TCP"}],"env":[{"name":"POD_NAMESPACE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}},{"name":"MYSQL_ROOT_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb","key":"mysql_root_password"}}},{"name":"MYSQL_CLIENT_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}},{"name":"GALERA_SERVICE","value":"mariadb-headless"},{"name":"TRACE","value":"1"}],"resources":{"limits":{"cpu":"500m","memory":"1717986918400m"},"requests":{"cpu":"125m","memory":"1717986918400m"}},"volumeMounts":[{"name":"config-dir","mountPath":"/etc/mysql/conf.d"},{"name":"data","mountPath":"/var/lib/mysql"},{"name":"init","mountPath":"/docker-entrypoint-initdb.d"}],"livenessProbe":{"exec":{"command":["/bin/sh","-c","mysqladmin ping -p${MYSQL_ROOT_PASSWORD}"]},"initialDelaySeconds":3000,"timeoutSeconds":5,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"exec":{"command":["/bin/sh","-c","mysql -p${MYSQL_ROOT_PASSWORD} -e 'SELECT 1';"]},"initialDelaySeconds":30,"timeoutSeconds":5,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"},{"name":"metrics","image":"prom/mysqld-exporter:v0.11.0","ports":[{"name":"metrics","containerPort":9104,"protocol":"TCP"}],"env":[{"name":"DATA_SOURCE_NAME","value":"exporter:zeefah9Tei3he0@(localhost:3306)/"}],"resources":{"limits":{"cpu":"100m","memory":"64Mi"},"requests":{"cpu":"50m","memory":"32Mi"}},"livenessProbe":{"httpGet":{"path":"/","port":"metrics","scheme":"HTTP"},"initialDelaySeconds":30,"timeoutSeconds":5,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/","port":"metrics","scheme":"HTTP"},"initialDelaySeconds":30,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{},"hostname":"mariadb-0","subdomain":"mariadb-headless","affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["mariadb"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:45:19Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:46:23Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:46:23Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:49Z"}],"hostIP":"10.40.56.27","podIP":"10.40.59.179","startTime":"2020-11-04T12:44:49Z","initContainerStatuses":[{"name":"init","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T12:45:19Z","finishedAt":"2020-11-04T12:45:19Z","containerID":"docker://7a827ee7a851ff3e7d4a398feb3d9c3902404ea0ec1a7a208caeb664157ba2cc"}},"lastState":{},"ready":true,"restartCount":0,"image":"busybox:latest","imageID":"docker-pullable://busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","containerID":"docker://7a827ee7a851ff3e7d4a398feb3d9c3902404ea0ec1a7a208caeb664157ba2cc"}],"containerStatuses":[{"name":"mariadb","state":{"running":{"startedAt":"2020-11-04T12:45:29Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/middleware/mariadb:0.6.56","imageID":"docker-pullable://registry.example.com/ce/middleware/mariadb@sha256:b4c12c27093137dbf047773d4ddb99676bedd32c8606bfa1e3c50876d5ce659f","containerID":"docker://07539803833e2d16998d3db0256858cbb47fcf88bef3c0a0ca658ebd249b133d"},{"name":"metrics","state":{"running":{"startedAt":"2020-11-04T12:45:30Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"prom/mysqld-exporter:v0.11.0","imageID":"docker-pullable://prom/mysqld-exporter@sha256:9f4fb61cca309cb4a8c1b9ed9fb4aa75af0f7a21f36d3954667db37c062a0172","containerID":"docker://95101d440115a7b6c4b74e38717130e649cf0753b0eb3f8007b056f14c2cff63"}],"qosClass":"Burstable"}}
I1104 15:55:04.936652 12586 round_trippers.go:443] GET https://api.example.com/api/v1/namespaces/invu-sre/pods/kafka-connect-6c5dfdbfb4-2hdbw 200 OK in 149 milliseconds
I1104 15:55:04.936662 12586 round_trippers.go:449] Response Headers:
I1104 15:55:04.936665 12586 round_trippers.go:452] Audit-Id: 21909da8-7757-4ec4-93fe-01f488f12ff1
I1104 15:55:04.936668 12586 round_trippers.go:443] GET https://api.example.com/api/v1/namespaces/invu-sre/pods/infrastructure-service-5b8746775c-v98mn 200 OK in 148 milliseconds
I1104 15:55:04.936678 12586 round_trippers.go:449] Response Headers:
I1104 15:55:04.936683 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:04 GMT
I1104 15:55:04.936687 12586 round_trippers.go:452] Audit-Id: 4797618e-9296-4c7a-9668-853281048048
I1104 15:55:04.936692 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:04.936669 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:04.936702 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:04 GMT
I1104 15:55:04.939572 12586 round_trippers.go:443] GET https://api.example.com/api/v1/namespaces/invu-sre/pods/kafka-0 200 OK in 149 milliseconds
I1104 15:55:04.939584 12586 round_trippers.go:449] Response Headers:
I1104 15:55:04.939587 12586 round_trippers.go:452] Audit-Id: 2dcbf069-77e3-463f-a61a-653245d8b23e
I1104 15:55:04.939590 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:04.939593 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:04 GMT
I1104 15:55:04.939613 12586 request.go:1068] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"schema-registry-7c97c65ddf-dtrwh","generateName":"schema-registry-7c97c65ddf-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/schema-registry-7c97c65ddf-dtrwh","uid":"82f8c4bb-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45489081","creationTimestamp":"2020-11-04T12:44:43Z","deletionTimestamp":"2020-11-04T13:55:32Z","deletionGracePeriodSeconds":30,"labels":{"app.kubernetes.io/name":"schema-registry","app.kubernetes.io/part-of":"invu-sre-ksql-server","pod-template-hash":"7c97c65ddf"},"annotations":{"prometheus.io/port":"5556","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"schema-registry-7c97c65ddf","uid":"82f1e9b2-1e9b-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"jmx-config","configMap":{"name":"schema-registry-jmx-config","defaultMode":420}}],"containers":[{"name":"exporter","image":"example/jmx-prometheus-httpserver:0.11.0","args":["5556","/etc/jmx-schema-registry/jmx-schema-registry-prometheus.yml"],"ports":[{"name":"exporter","containerPort":5556,"protocol":"TCP"}],"resources":{"limits":{"cpu":"25m","memory":"128Mi"},"requests":{"cpu":"10m","memory":"64Mi"}},"volumeMounts":[{"name":"jmx-config","mountPath":"/etc/jmx-schema-registry"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"},{"name":"schema-registry","image":"confluentinc/cp-schema-registry:5.2.2","ports":[{"name":"http","containerPort":8081,"protocol":"TCP"},{"name":"jmx","containerPort":5555,"protocol":"TCP"}],"env":[{"name":"SCHEMA_REGISTRY_KAFKASTORE_BOOTSTRAP_SERVERS","value":"PLAINTEXT://kafka:9092"},{"name":"SCHEMA_REGISTRY_HOST_NAME","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}},{"name":"SCHEMA_REGISTRY_KAFKASTORE_GROUP_ID","value":"invu-sre-ksql-server"},{"name":"SCHEMA_REGISTRY_LISTENERS","value":"http://0.0.0.0:8081"},{"name":"JMX_PORT","value":"5555"}],"resources":{"limits":{"cpu":"500m","memory":"2Gi"},"requests":{"cpu":"200m","memory":"1Gi"}},"livenessProbe":{"httpGet":{"path":"/","port":"http","scheme":"HTTP"},"initialDelaySeconds":45,"timeoutSeconds":1,"periodSeconds":15,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/","port":"http","scheme":"HTTP"},"initialDelaySeconds":45,"timeoutSeconds":1,"periodSeconds":15,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}],"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":100,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"kubernetes.io/hostname"}}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["schema-registry"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:43Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:47:22Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:47:22Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:43Z"}],"hostIP":"10.40.56.27","podIP":"10.40.48.113","startTime":"2020-11-04T12:44:43Z","containerStatuses":[{"name":"exporter","state":{"running":{"startedAt":"2020-11-04T12:44:50Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"example/jmx-prometheus-httpserver:0.11.0","imageID":"docker-pullable://example/jmx-prometheus-httpserver@sha256:725e8a9bfec05f432b931edc11b1ee8bac3895e408bb91af58266dc88ee4e63b","containerID":"docker://c14b0899acd56fa6dbcf478acb6ca6ad50b729ed4fc5484fc331ed704ee29c84"},{"name":"schema-registry","state":{"running":{"startedAt":"2020-11-04T12:46:25Z"}},"lastState":{"terminated":{"exitCode":1,"reason":"Error","startedAt":"2020-11-04T12:45:05Z","finishedAt":"2020-11-04T12:46:25Z","containerID":"docker://46b2bb766b699eca062c6a48dc429c7d4af432b005712b338c5deb9e848de146"}},"ready":true,"restartCount":1,"image":"confluentinc/cp-schema-registry:5.2.2","imageID":"docker-pullable://confluentinc/cp-schema-registry@sha256:0d7a84d486477a0c203ae21d5d52c40d26e810f5b5cfa27a56274692b70949f5","containerID":"docker://7d4a1500d2c48880f43b6b3b657cdd5b4171cad147467607fdef274b694a9592"}],"qosClass":"Burstable"}}
I1104 15:55:04.939625 12586 round_trippers.go:443] GET https://api.example.com/api/v1/namespaces/invu-sre/pods/emqx-758448bfd5-h7s9j 200 OK in 153 milliseconds
I1104 15:55:04.939630 12586 request.go:1068] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kafka-0","generateName":"kafka-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/kafka-0","uid":"bf92b223-1e9a-11eb-9aff-16da7cad7b07","resourceVersion":"45489084","creationTimestamp":"2020-11-04T12:39:15Z","deletionTimestamp":"2020-11-04T13:58:02Z","deletionGracePeriodSeconds":180,"labels":{"app.kubernetes.io/name":"kafka","app.kubernetes.io/part-of":"invu-sre-kafka","controller-revision-hash":"kafka-7874665d8f","statefulset.kubernetes.io/pod-name":"kafka-0"},"annotations":{"checksum/config":"daad60db589e4fb5a1e13238ca6a87b4e363dc0a8a47c039efb620b65e86d9b9","prometheus.io/port":"9020","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"StatefulSet","name":"kafka","uid":"bf66bc4b-1e9a-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"data","persistentVolumeClaim":{"claimName":"data-kafka-0"}},{"name":"config","configMap":{"name":"kafka","defaultMode":420}}],"initContainers":[{"name":"delete-lost-found","image":"busybox","command":["/bin/sh","-c","rm -rf /dst/lost+found"],"resources":{},"volumeMounts":[{"name":"data","mountPath":"/dst"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"},{"name":"wait-for-zookeeper","image":"busybox","command":["/bin/sh","-c","until echo srvr | nc -w 5 kafka-zookeeper 2181 | grep Mode \u0026\u0026 echo zookeeper ok; do sleep 5; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"broker","image":"registry.example.com/ce/middleware/kafka:0.6.33","command":["/bin/bash","-c","exec ./bin/kafka-server-start.sh /etc/kafka/server.properties --override broker.id=${HOSTNAME##*-} --override advertised.host.name=${HOSTNAME}.kafka-headless.invu-sre.svc.cluster.local "],"ports":[{"name":"client","containerPort":9092,"protocol":"TCP"},{"name":"jmx","containerPort":9999,"protocol":"TCP"},{"name":"agent","containerPort":9020,"protocol":"TCP"}],"env":[{"name":"DNS_NAME","value":"example.com"},{"name":"KAFKA_HEAP_OPTS","value":"-Xmx7g -Xms7g"}],"resources":{"limits":{"cpu":"2","memory":"8Gi"},"requests":{"cpu":"2","memory":"8Gi"}},"volumeMounts":[{"name":"data","mountPath":"/var/lib/kafka"},{"name":"config","mountPath":"/etc/kafka"}],"lifecycle":{"preStop":{"exec":{"command":["/bin/bash","-c","exec ./bin/kafka-server-stop.sh"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"runAsUser":1001,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":180,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{"fsGroup":1001},"hostname":"kafka-0","subdomain":"kafka-headless","affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["zookeeper"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}],"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":100,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["zookeeper"]}]},"topologyKey":"kubernetes.io/hostname"}}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:43:09Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:43:15Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:43:15Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:42:54Z"}],"hostIP":"10.40.56.27","podIP":"10.40.44.88","startTime":"2020-11-04T12:42:54Z","initContainerStatuses":[{"name":"delete-lost-found","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T12:43:07Z","finishedAt":"2020-11-04T12:43:07Z","containerID":"docker://2774295ea860555b7db14d5bdd827b40b3971976f8af9e5c3ff0eef8ff491b2c"}},"lastState":{},"ready":true,"restartCount":0,"image":"busybox:latest","imageID":"docker-pullable://busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","containerID":"docker://2774295ea860555b7db14d5bdd827b40b3971976f8af9e5c3ff0eef8ff491b2c"},{"name":"wait-for-zookeeper","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T12:43:09Z","finishedAt":"2020-11-04T12:43:09Z","containerID":"docker://1d6f11662dce2bdbfe8c27a73383f62f7a9adb72323fd786a91e5c62b106e19e"}},"lastState":{},"ready":true,"restartCount":0,"image":"busybox:latest","imageID":"docker-pullable://busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","containerID":"docker://1d6f11662dce2bdbfe8c27a73383f62f7a9adb72323fd786a91e5c62b106e19e"}],"containerStatuses":[{"name":"broker","state":{"running":{"startedAt":"2020-11-04T12:43:15Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/middleware/kafka:0.6.33","imageID":"docker-pullable://registry.example.com/ce/middleware/kafka@sha256:5a13ea153f26ac29e73fd3a0ed67c701f33ea761a0b10a03870fdda51e3975cc","containerID":"docker://aab562c6506685007f59fc42f95492910f41f3e3a4106afc8c1c4803eaf3a61c"}],"qosClass":"Guaranteed"}}
I1104 15:55:04.939636 12586 round_trippers.go:449] Response Headers:
I1104 15:55:04.939646 12586 round_trippers.go:452] Audit-Id: f8953334-4208-41e1-9c5d-b6a958e0aed4
I1104 15:55:04.939649 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:04.939647 12586 request.go:1068] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kafka-connect-6c5dfdbfb4-2hdbw","generateName":"kafka-connect-6c5dfdbfb4-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/kafka-connect-6c5dfdbfb4-2hdbw","uid":"f328eda8-1e9f-11eb-9aff-16da7cad7b07","resourceVersion":"45489079","creationTimestamp":"2020-11-04T13:16:29Z","deletionTimestamp":"2020-11-04T13:55:32Z","deletionGracePeriodSeconds":30,"labels":{"app.kubernetes.io/instance":"kafka-connect","app.kubernetes.io/name":"kafka-connect","pod-template-hash":"6c5dfdbfb4"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"kafka-connect-6c5dfdbfb4","uid":"f323a896-1e9f-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"config","configMap":{"name":"kafka-connect","defaultMode":420}}],"containers":[{"name":"kafka-connect","image":"registry.example.com/cybervision/invu-kafka-connect-sinks/kafka-connect:2.0.0-37698","command":["/bin/sh","-c","$KAFKA_HOME/bin/connect-distributed.sh /etc/connect/connect-distributed.properties"],"ports":[{"name":"http","containerPort":8083,"protocol":"TCP"},{"name":"jmx","containerPort":9999,"protocol":"TCP"}],"env":[{"name":"KAFKA_HEAP_OPTS","value":"-Xmx750m -Xms750m"},{"name":"JMXPORT","value":"9999"}],"resources":{"limits":{"cpu":"1","memory":"1500Mi"},"requests":{"cpu":"750m","memory":"1000Mi"}},"volumeMounts":[{"name":"config","mountPath":"/etc/connect/"}],"livenessProbe":{"httpGet":{"path":"/","port":8083,"scheme":"HTTP"},"initialDelaySeconds":45,"timeoutSeconds":10,"periodSeconds":10,"successThreshold":1,"failureThreshold":6},"readinessProbe":{"httpGet":{"path":"/connector-plugins","port":8083,"scheme":"HTTP"},"initialDelaySeconds":30,"timeoutSeconds":10,"periodSeconds":10,"successThreshold":1,"failureThreshold":5},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{"runAsUser":1001,"runAsNonRoot":true},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}],"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":100,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"kubernetes.io/hostname"}}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka-connect"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:29Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:17:15Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:17:15Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:29Z"}],"hostIP":"10.40.56.27","podIP":"10.40.45.113","startTime":"2020-11-04T13:16:29Z","containerStatuses":[{"name":"kafka-connect","state":{"running":{"startedAt":"2020-11-04T13:16:44Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/cybervision/invu-kafka-connect-sinks/kafka-connect:2.0.0-37698","imageID":"docker-pullable://registry.example.com/cybervision/invu-kafka-connect-sinks/kafka-connect@sha256:6a584826ecf0bbdf654fbe27201e2ed07d5586bd6f0c414c13be40ac3f6cc62f","containerID":"docker://3431c9748539e0095632c7c7f336a4b6c2ca51420e0ab614aebcc7d2263c625d"}],"qosClass":"Burstable"}}
I1104 15:55:04.939619 12586 request.go:1068] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"infrastructure-service-5b8746775c-v98mn","generateName":"infrastructure-service-5b8746775c-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/infrastructure-service-5b8746775c-v98mn","uid":"fc2f3532-1e9f-11eb-9aff-16da7cad7b07","resourceVersion":"45489077","creationTimestamp":"2020-11-04T13:16:44Z","deletionTimestamp":"2020-11-04T13:55:32Z","deletionGracePeriodSeconds":30,"labels":{"app":"infrastructure-service","pod-template-hash":"5b8746775c","release":"invu-sre-infrastructure-service"},"annotations":{"iam.amazonaws.com/role":"invu-sre-objects-access"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"infrastructure-service-5b8746775c","uid":"fc2d93cc-1e9f-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-kvb6j","secret":{"secretName":"default-token-kvb6j","defaultMode":420}}],"initContainers":[{"name":"mysql-client","image":"registry.example.com/ce/utilities/mysql-client","env":[{"name":"DATABASE_NAME","value":"invu_infrastructure_service"},{"name":"MYSQL_USER","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MYSQL_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}}],"resources":{},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"infrastructure-service","image":"registry.example.com/cybervision/invu-infrastructure-service:2.0.0-37566","ports":[{"name":"http","containerPort":80,"protocol":"TCP"}],"env":[{"name":"S3_BUCKET_NAME","value":"invu-sre-objects"},{"name":"LOG_LEVEL_example","value":"DEBUG"},{"name":"S3_BUCKET_REGION","value":"us-east-1"},{"name":"ZOOKEEPER_CONNECT_STRING","value":"kafka-zookeeper:2181"},{"name":"BOOTSTRAP_SERVERS","value":"kafka:9092"},{"name":"DEBUG","value":"false"},{"name":"JAVA_OPTS","value":"-Xmx512M"},{"name":"MARIADB_HOST","value":"mariadb"},{"name":"MARIADB_USERNAME","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MARIADB_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}},{"name":"INSTANCE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.name"}}}],"resources":{"limits":{"cpu":"500m","memory":"1Gi"},"requests":{"cpu":"500m","memory":"750Mi"}},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":240,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":5,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app","operator":"In","values":["infrastructure-service"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:47Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:18:25Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:18:25Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:44Z"}],"hostIP":"10.40.56.27","podIP":"10.40.44.73","startTime":"2020-11-04T13:16:44Z","initContainerStatuses":[{"name":"mysql-client","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T13:16:47Z","finishedAt":"2020-11-04T13:16:47Z","containerID":"docker://bd524fa563b598c44d93acb77f9abfc0891e9c8b3fedce934ddd7d06bc699b91"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/utilities/mysql-client:latest","imageID":"docker-pullable://registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","containerID":"docker://bd524fa563b598c44d93acb77f9abfc0891e9c8b3fedce934ddd7d06bc699b91"}],"containerStatuses":[{"name":"infrastructure-service","state":{"running":{"startedAt":"2020-11-04T13:16:53Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/cybervision/invu-infrastructure-service:2.0.0-37566","imageID":"docker-pullable://registry.example.com/cybervision/invu-infrastructure-service@sha256:00f75459b2ee50deb47884131608f73108158d4faa085d1a5cc237aacd3f2112","containerID":"docker://05675f6f5f5781c38c509dcea0f48266dc9836bedfbdd15df1092499788fa2f4"}],"qosClass":"Burstable"}}
I1104 15:55:04.939652 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:04 GMT
I1104 15:55:04.939817 12586 request.go:1068] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"emqx-758448bfd5-h7s9j","generateName":"emqx-758448bfd5-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/emqx-758448bfd5-h7s9j","uid":"7540f9d4-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45489078","creationTimestamp":"2020-11-04T12:44:20Z","deletionTimestamp":"2020-11-04T13:55:32Z","deletionGracePeriodSeconds":30,"labels":{"app.kubernetes.io/name":"emqx","app.kubernetes.io/part-of":"invu-sre-emqx","pod-template-hash":"758448bfd5"},"annotations":{"prometheus.io/port":"9540","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"emqx-758448bfd5","uid":"753f9db6-1e9b-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"data","configMap":{"name":"emqx","items":[{"key":"loaded_plugins","path":"loaded_plugins"}],"defaultMode":420}},{"name":"plugins","configMap":{"name":"emqx","items":[{"key":"emqx_auth_username.conf","path":"emqx_auth_username.conf"},{"key":"emqx_auth_jwt.conf","path":"emqx_auth_jwt.conf"}],"defaultMode":420}},{"name":"certs","configMap":{"name":"emqx","items":[{"key":"jwt_public_key.pem","path":"jwt_public_key.pem"}],"defaultMode":420}},{"name":"emqx-token-nf8kx","secret":{"secretName":"emqx-token-nf8kx","defaultMode":420}}],"containers":[{"name":"exporter","image":"example/emq_exporter:v0.4.1","args":["--emq.node=emqx@$(POD_IP)","--emq.api-version=v3"],"ports":[{"name":"metrics","containerPort":9540,"protocol":"TCP"}],"env":[{"name":"EMQ_USERNAME","value":"admin"},{"name":"EMQ_PASSWORD","valueFrom":{"secretKeyRef":{"name":"emqx","key":"admin_password"}}},{"name":"POD_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}}],"resources":{"limits":{"cpu":"50m","memory":"64Mi"},"requests":{"cpu":"15m","memory":"32Mi"}},"volumeMounts":[{"name":"emqx-token-nf8kx","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"},{"name":"emqx","image":"emqx/emqx:v3.2.7","ports":[{"name":"mqtt","containerPort":1883,"protocol":"TCP"},{"name":"websocket","containerPort":8083,"protocol":"TCP"},{"name":"mgmt","containerPort":8080,"protocol":"TCP"},{"name":"dashboard","containerPort":18083,"protocol":"TCP"}],"env":[{"name":"EMQ_NODE__COOKIE","valueFrom":{"secretKeyRef":{"name":"emqx","key":"node_cookie"}}},{"name":"EMQX_DASHBOARD__DEFAULT_USER__PASSWORD","valueFrom":{"secretKeyRef":{"name":"emqx","key":"admin_password"}}},{"name":"EMQX_ALLOW_ANONYMOUS","value":"false"},{"name":"EMQX_CLUSTER__AUTOCLEAN","value":"5m"},{"name":"EMQX_CLUSTER__AUTOHEAL","value":"on"},{"name":"EMQX_CLUSTER__DISCOVERY","value":"k8s"},{"name":"EMQX_CLUSTER__K8S__ADDRESS_TYPE","value":"ip"},{"name":"EMQX_CLUSTER__K8S__APISERVER","value":"https://kubernetes.default.svc.cluster.local:443"},{"name":"EMQX_CLUSTER__K8S__APP_NAME","value":"emqx"},{"name":"EMQX_CLUSTER__K8S__NAMESPACE","value":"invu-sre"},{"name":"EMQX_CLUSTER__K8S__SERVICE_NAME","value":"emqx"},{"name":"EMQX_CLUSTER__NAME","value":"emqx_cluster"},{"name":"EMQX_MQTT__MAX_PACKET_SIZE","value":"10MB"},{"name":"EMQX_NAME","value":"emqx"}],"resources":{"limits":{"cpu":"500m","memory":"512Mi"},"requests":{"cpu":"200m","memory":"256Mi"}},"volumeMounts":[{"name":"data","mountPath":"/opt/emqx/data/loaded_plugins","subPath":"loaded_plugins"},{"name":"plugins","mountPath":"/opt/emqx/etc/plugins/emqx_auth_username.conf","subPath":"emqx_auth_username.conf"},{"name":"plugins","mountPath":"/opt/emqx/etc/plugins/emqx_auth_jwt.conf","subPath":"emqx_auth_jwt.conf"},{"name":"certs","mountPath":"/opt/emqx/etc/certs/jwt_public_key.pem","subPath":"jwt_public_key.pem"},{"name":"emqx-token-nf8kx","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"exec":{"command":["/bin/sh","-c","emqx_ctl status | grep 'is running'"]},"initialDelaySeconds":45,"timeoutSeconds":1,"periodSeconds":15,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"exec":{"command":["/bin/sh","-c","emqx_ctl status | grep 'is running'"]},"initialDelaySeconds":45,"timeoutSeconds":1,"periodSeconds":15,"successThreshold":1,"failureThreshold":3},"lifecycle":{"preStop":{"exec":{"command":["/bin/sh","-c","emqx stop"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"runAsUser":1000,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"emqx","serviceAccount":"emqx","nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}],"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":100,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"kubernetes.io/hostname"}}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["emqx"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:20Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:45:16Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:45:16Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:20Z"}],"hostIP":"10.40.56.27","podIP":"10.40.32.131","startTime":"2020-11-04T12:44:20Z","containerStatuses":[{"name":"emqx","state":{"running":{"startedAt":"2020-11-04T12:44:26Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"emqx/emqx:v3.2.7","imageID":"docker-pullable://emqx/emqx@sha256:3f31ee2793b4446e98183659b4493992355e2b0d8603df946c641b47f29ced78","containerID":"docker://974f27ae72445d1d6506dd99933c36122005477e60125d19123b9c633295a6e6"},{"name":"exporter","state":{"running":{"startedAt":"2020-11-04T12:44:23Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"example/emq_exporter:v0.4.1","imageID":"docker-pullable://example/emq_exporter@sha256:1526c0476c1e5d740dfc4df36f3295ea27f87b41becf274c760fbd0a51011233","containerID":"docker://f3270342707cf0eb993e24680050991e5bb867a885b32fddd01c81db07c7ab54"}],"qosClass":"Burstable"}}
I1104 15:55:05.785539 12586 round_trippers.go:423] curl -k -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" 'https://api.example.com/api/v1/namespaces/invu-sre/pods/mariadb-0'
I1104 15:55:05.785972 12586 round_trippers.go:423] curl -k -v -XGET -H "Authorization: Basic ******" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Accept: application/json, */*" 'https://api.example.com/api/v1/namespaces/invu-sre/pods/emqx-758448bfd5-h7s9j'
I1104 15:55:05.787555 12586 round_trippers.go:423] curl -k -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" 'https://api.example.com/api/v1/namespaces/invu-sre/pods/kafka-connect-6c5dfdbfb4-2hdbw'
I1104 15:55:05.787625 12586 round_trippers.go:423] curl -k -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" 'https://api.example.com/api/v1/namespaces/invu-sre/pods/schema-registry-7c97c65ddf-dtrwh'
I1104 15:55:05.787732 12586 round_trippers.go:423] curl -k -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" 'https://api.example.com/api/v1/namespaces/invu-sre/pods/infrastructure-service-5b8746775c-v98mn'
I1104 15:55:05.790452 12586 round_trippers.go:423] curl -k -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" 'https://api.example.com/api/v1/namespaces/invu-sre/pods/kafka-0'
I1104 15:55:05.948382 12586 round_trippers.go:443] GET https://api.example.com/api/v1/namespaces/invu-sre/pods/mariadb-0 200 OK in 162 milliseconds
I1104 15:55:05.948420 12586 round_trippers.go:443] GET https://api.example.com/api/v1/namespaces/invu-sre/pods/emqx-758448bfd5-h7s9j 200 OK in 162 milliseconds
I1104 15:55:05.948427 12586 round_trippers.go:443] GET https://api.example.com/api/v1/namespaces/invu-sre/pods/schema-registry-7c97c65ddf-dtrwh 200 OK in 160 milliseconds
I1104 15:55:05.948431 12586 round_trippers.go:449] Response Headers:
I1104 15:55:05.948434 12586 round_trippers.go:449] Response Headers:
I1104 15:55:05.948439 12586 round_trippers.go:452] Audit-Id: b5e8f0a1-d887-456f-bf6b-213a1f94ac58
I1104 15:55:05.948445 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:05.948449 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:05 GMT
I1104 15:55:05.948532 12586 request.go:1068] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"emqx-758448bfd5-h7s9j","generateName":"emqx-758448bfd5-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/emqx-758448bfd5-h7s9j","uid":"7540f9d4-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45489078","creationTimestamp":"2020-11-04T12:44:20Z","deletionTimestamp":"2020-11-04T13:55:32Z","deletionGracePeriodSeconds":30,"labels":{"app.kubernetes.io/name":"emqx","app.kubernetes.io/part-of":"invu-sre-emqx","pod-template-hash":"758448bfd5"},"annotations":{"prometheus.io/port":"9540","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"emqx-758448bfd5","uid":"753f9db6-1e9b-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"data","configMap":{"name":"emqx","items":[{"key":"loaded_plugins","path":"loaded_plugins"}],"defaultMode":420}},{"name":"plugins","configMap":{"name":"emqx","items":[{"key":"emqx_auth_username.conf","path":"emqx_auth_username.conf"},{"key":"emqx_auth_jwt.conf","path":"emqx_auth_jwt.conf"}],"defaultMode":420}},{"name":"certs","configMap":{"name":"emqx","items":[{"key":"jwt_public_key.pem","path":"jwt_public_key.pem"}],"defaultMode":420}},{"name":"emqx-token-nf8kx","secret":{"secretName":"emqx-token-nf8kx","defaultMode":420}}],"containers":[{"name":"exporter","image":"example/emq_exporter:v0.4.1","args":["--emq.node=emqx@$(POD_IP)","--emq.api-version=v3"],"ports":[{"name":"metrics","containerPort":9540,"protocol":"TCP"}],"env":[{"name":"EMQ_USERNAME","value":"admin"},{"name":"EMQ_PASSWORD","valueFrom":{"secretKeyRef":{"name":"emqx","key":"admin_password"}}},{"name":"POD_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}}],"resources":{"limits":{"cpu":"50m","memory":"64Mi"},"requests":{"cpu":"15m","memory":"32Mi"}},"volumeMounts":[{"name":"emqx-token-nf8kx","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"},{"name":"emqx","image":"emqx/emqx:v3.2.7","ports":[{"name":"mqtt","containerPort":1883,"protocol":"TCP"},{"name":"websocket","containerPort":8083,"protocol":"TCP"},{"name":"mgmt","containerPort":8080,"protocol":"TCP"},{"name":"dashboard","containerPort":18083,"protocol":"TCP"}],"env":[{"name":"EMQ_NODE__COOKIE","valueFrom":{"secretKeyRef":{"name":"emqx","key":"node_cookie"}}},{"name":"EMQX_DASHBOARD__DEFAULT_USER__PASSWORD","valueFrom":{"secretKeyRef":{"name":"emqx","key":"admin_password"}}},{"name":"EMQX_ALLOW_ANONYMOUS","value":"false"},{"name":"EMQX_CLUSTER__AUTOCLEAN","value":"5m"},{"name":"EMQX_CLUSTER__AUTOHEAL","value":"on"},{"name":"EMQX_CLUSTER__DISCOVERY","value":"k8s"},{"name":"EMQX_CLUSTER__K8S__ADDRESS_TYPE","value":"ip"},{"name":"EMQX_CLUSTER__K8S__APISERVER","value":"https://kubernetes.default.svc.cluster.local:443"},{"name":"EMQX_CLUSTER__K8S__APP_NAME","value":"emqx"},{"name":"EMQX_CLUSTER__K8S__NAMESPACE","value":"invu-sre"},{"name":"EMQX_CLUSTER__K8S__SERVICE_NAME","value":"emqx"},{"name":"EMQX_CLUSTER__NAME","value":"emqx_cluster"},{"name":"EMQX_MQTT__MAX_PACKET_SIZE","value":"10MB"},{"name":"EMQX_NAME","value":"emqx"}],"resources":{"limits":{"cpu":"500m","memory":"512Mi"},"requests":{"cpu":"200m","memory":"256Mi"}},"volumeMounts":[{"name":"data","mountPath":"/opt/emqx/data/loaded_plugins","subPath":"loaded_plugins"},{"name":"plugins","mountPath":"/opt/emqx/etc/plugins/emqx_auth_username.conf","subPath":"emqx_auth_username.conf"},{"name":"plugins","mountPath":"/opt/emqx/etc/plugins/emqx_auth_jwt.conf","subPath":"emqx_auth_jwt.conf"},{"name":"certs","mountPath":"/opt/emqx/etc/certs/jwt_public_key.pem","subPath":"jwt_public_key.pem"},{"name":"emqx-token-nf8kx","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"exec":{"command":["/bin/sh","-c","emqx_ctl status | grep 'is running'"]},"initialDelaySeconds":45,"timeoutSeconds":1,"periodSeconds":15,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"exec":{"command":["/bin/sh","-c","emqx_ctl status | grep 'is running'"]},"initialDelaySeconds":45,"timeoutSeconds":1,"periodSeconds":15,"successThreshold":1,"failureThreshold":3},"lifecycle":{"preStop":{"exec":{"command":["/bin/sh","-c","emqx stop"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"runAsUser":1000,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"emqx","serviceAccount":"emqx","nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}],"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":100,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"kubernetes.io/hostname"}}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["emqx"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:20Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:45:16Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:45:16Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:20Z"}],"hostIP":"10.40.56.27","podIP":"10.40.32.131","startTime":"2020-11-04T12:44:20Z","containerStatuses":[{"name":"emqx","state":{"running":{"startedAt":"2020-11-04T12:44:26Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"emqx/emqx:v3.2.7","imageID":"docker-pullable://emqx/emqx@sha256:3f31ee2793b4446e98183659b4493992355e2b0d8603df946c641b47f29ced78","containerID":"docker://974f27ae72445d1d6506dd99933c36122005477e60125d19123b9c633295a6e6"},{"name":"exporter","state":{"running":{"startedAt":"2020-11-04T12:44:23Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"example/emq_exporter:v0.4.1","imageID":"docker-pullable://example/emq_exporter@sha256:1526c0476c1e5d740dfc4df36f3295ea27f87b41becf274c760fbd0a51011233","containerID":"docker://f3270342707cf0eb993e24680050991e5bb867a885b32fddd01c81db07c7ab54"}],"qosClass":"Burstable"}}
I1104 15:55:05.948420 12586 round_trippers.go:449] Response Headers:
I1104 15:55:05.948566 12586 round_trippers.go:452] Audit-Id: 1a0eeaf0-24b6-4bc1-b36b-071e65026c56
I1104 15:55:05.948571 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:05.948574 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:05 GMT
I1104 15:55:05.948613 12586 request.go:1068] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"mariadb-0","generateName":"mariadb-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/mariadb-0","uid":"8427b17b-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45489082","creationTimestamp":"2020-11-04T12:44:45Z","deletionTimestamp":"2020-11-04T13:55:32Z","deletionGracePeriodSeconds":30,"labels":{"app.kubernetes.io/name":"mariadb","app.kubernetes.io/part-of":"invu-sre-mariadb","controller-revision-hash":"mariadb-b5b65b86c","statefulset.kubernetes.io/pod-name":"mariadb-0"},"annotations":{"checksum/config":"dc020dcc29b6f60d457b31746cd171c10007bd02dc2efc5284aed55dd9e790f0","prometheus.io/port":"9104","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"StatefulSet","name":"mariadb","uid":"8421568d-1e9b-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"data","persistentVolumeClaim":{"claimName":"data-mariadb-0"}},{"name":"init","configMap":{"name":"mariadb-init","defaultMode":420}},{"name":"config-dir","emptyDir":{}},{"name":"config","configMap":{"name":"mariadb-config","defaultMode":420}}],"initContainers":[{"name":"init","image":"busybox","command":["/bin/sh","-c","cp /src/*.cnf /dist"],"resources":{},"volumeMounts":[{"name":"config-dir","mountPath":"/dist"},{"name":"config","mountPath":"/src"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"mariadb","image":"registry.example.com/ce/middleware/mariadb:0.6.56","ports":[{"name":"ist","containerPort":4568,"protocol":"TCP"},{"name":"mysql","containerPort":3306,"protocol":"TCP"},{"name":"replication","containerPort":4567,"protocol":"TCP"},{"name":"sst","containerPort":4444,"protocol":"TCP"}],"env":[{"name":"POD_NAMESPACE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.namespace"}}},{"name":"MYSQL_ROOT_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb","key":"mysql_root_password"}}},{"name":"MYSQL_CLIENT_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}},{"name":"GALERA_SERVICE","value":"mariadb-headless"},{"name":"TRACE","value":"1"}],"resources":{"limits":{"cpu":"500m","memory":"1717986918400m"},"requests":{"cpu":"125m","memory":"1717986918400m"}},"volumeMounts":[{"name":"config-dir","mountPath":"/etc/mysql/conf.d"},{"name":"data","mountPath":"/var/lib/mysql"},{"name":"init","mountPath":"/docker-entrypoint-initdb.d"}],"livenessProbe":{"exec":{"command":["/bin/sh","-c","mysqladmin ping -p${MYSQL_ROOT_PASSWORD}"]},"initialDelaySeconds":3000,"timeoutSeconds":5,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"exec":{"command":["/bin/sh","-c","mysql -p${MYSQL_ROOT_PASSWORD} -e 'SELECT 1';"]},"initialDelaySeconds":30,"timeoutSeconds":5,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"},{"name":"metrics","image":"prom/mysqld-exporter:v0.11.0","ports":[{"name":"metrics","containerPort":9104,"protocol":"TCP"}],"env":[{"name":"DATA_SOURCE_NAME","value":"exporter:zeefah9Tei3he0@(localhost:3306)/"}],"resources":{"limits":{"cpu":"100m","memory":"64Mi"},"requests":{"cpu":"50m","memory":"32Mi"}},"livenessProbe":{"httpGet":{"path":"/","port":"metrics","scheme":"HTTP"},"initialDelaySeconds":30,"timeoutSeconds":5,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/","port":"metrics","scheme":"HTTP"},"initialDelaySeconds":30,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{},"hostname":"mariadb-0","subdomain":"mariadb-headless","affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["mariadb"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:45:19Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:46:23Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:46:23Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:49Z"}],"hostIP":"10.40.56.27","podIP":"10.40.59.179","startTime":"2020-11-04T12:44:49Z","initContainerStatuses":[{"name":"init","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T12:45:19Z","finishedAt":"2020-11-04T12:45:19Z","containerID":"docker://7a827ee7a851ff3e7d4a398feb3d9c3902404ea0ec1a7a208caeb664157ba2cc"}},"lastState":{},"ready":true,"restartCount":0,"image":"busybox:latest","imageID":"docker-pullable://busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","containerID":"docker://7a827ee7a851ff3e7d4a398feb3d9c3902404ea0ec1a7a208caeb664157ba2cc"}],"containerStatuses":[{"name":"mariadb","state":{"running":{"startedAt":"2020-11-04T12:45:29Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/middleware/mariadb:0.6.56","imageID":"docker-pullable://registry.example.com/ce/middleware/mariadb@sha256:b4c12c27093137dbf047773d4ddb99676bedd32c8606bfa1e3c50876d5ce659f","containerID":"docker://07539803833e2d16998d3db0256858cbb47fcf88bef3c0a0ca658ebd249b133d"},{"name":"metrics","state":{"running":{"startedAt":"2020-11-04T12:45:30Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"prom/mysqld-exporter:v0.11.0","imageID":"docker-pullable://prom/mysqld-exporter@sha256:9f4fb61cca309cb4a8c1b9ed9fb4aa75af0f7a21f36d3954667db37c062a0172","containerID":"docker://95101d440115a7b6c4b74e38717130e649cf0753b0eb3f8007b056f14c2cff63"}],"qosClass":"Burstable"}}
I1104 15:55:05.948444 12586 round_trippers.go:452] Audit-Id: 7263fa50-cdcd-45eb-a93f-a80af7b2ba09
I1104 15:55:05.948635 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:05.948641 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:05 GMT
I1104 15:55:05.948398 12586 round_trippers.go:443] GET https://api.example.com/api/v1/namespaces/invu-sre/pods/kafka-connect-6c5dfdbfb4-2hdbw 200 OK in 160 milliseconds
I1104 15:55:05.948698 12586 request.go:1068] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"schema-registry-7c97c65ddf-dtrwh","generateName":"schema-registry-7c97c65ddf-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/schema-registry-7c97c65ddf-dtrwh","uid":"82f8c4bb-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45489081","creationTimestamp":"2020-11-04T12:44:43Z","deletionTimestamp":"2020-11-04T13:55:32Z","deletionGracePeriodSeconds":30,"labels":{"app.kubernetes.io/name":"schema-registry","app.kubernetes.io/part-of":"invu-sre-ksql-server","pod-template-hash":"7c97c65ddf"},"annotations":{"prometheus.io/port":"5556","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"schema-registry-7c97c65ddf","uid":"82f1e9b2-1e9b-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"jmx-config","configMap":{"name":"schema-registry-jmx-config","defaultMode":420}}],"containers":[{"name":"exporter","image":"example/jmx-prometheus-httpserver:0.11.0","args":["5556","/etc/jmx-schema-registry/jmx-schema-registry-prometheus.yml"],"ports":[{"name":"exporter","containerPort":5556,"protocol":"TCP"}],"resources":{"limits":{"cpu":"25m","memory":"128Mi"},"requests":{"cpu":"10m","memory":"64Mi"}},"volumeMounts":[{"name":"jmx-config","mountPath":"/etc/jmx-schema-registry"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"},{"name":"schema-registry","image":"confluentinc/cp-schema-registry:5.2.2","ports":[{"name":"http","containerPort":8081,"protocol":"TCP"},{"name":"jmx","containerPort":5555,"protocol":"TCP"}],"env":[{"name":"SCHEMA_REGISTRY_KAFKASTORE_BOOTSTRAP_SERVERS","value":"PLAINTEXT://kafka:9092"},{"name":"SCHEMA_REGISTRY_HOST_NAME","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}},{"name":"SCHEMA_REGISTRY_KAFKASTORE_GROUP_ID","value":"invu-sre-ksql-server"},{"name":"SCHEMA_REGISTRY_LISTENERS","value":"http://0.0.0.0:8081"},{"name":"JMX_PORT","value":"5555"}],"resources":{"limits":{"cpu":"500m","memory":"2Gi"},"requests":{"cpu":"200m","memory":"1Gi"}},"livenessProbe":{"httpGet":{"path":"/","port":"http","scheme":"HTTP"},"initialDelaySeconds":45,"timeoutSeconds":1,"periodSeconds":15,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/","port":"http","scheme":"HTTP"},"initialDelaySeconds":45,"timeoutSeconds":1,"periodSeconds":15,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}],"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":100,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"kubernetes.io/hostname"}}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["schema-registry"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:43Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:47:22Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:47:22Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:43Z"}],"hostIP":"10.40.56.27","podIP":"10.40.48.113","startTime":"2020-11-04T12:44:43Z","containerStatuses":[{"name":"exporter","state":{"running":{"startedAt":"2020-11-04T12:44:50Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"example/jmx-prometheus-httpserver:0.11.0","imageID":"docker-pullable://example/jmx-prometheus-httpserver@sha256:725e8a9bfec05f432b931edc11b1ee8bac3895e408bb91af58266dc88ee4e63b","containerID":"docker://c14b0899acd56fa6dbcf478acb6ca6ad50b729ed4fc5484fc331ed704ee29c84"},{"name":"schema-registry","state":{"running":{"startedAt":"2020-11-04T12:46:25Z"}},"lastState":{"terminated":{"exitCode":1,"reason":"Error","startedAt":"2020-11-04T12:45:05Z","finishedAt":"2020-11-04T12:46:25Z","containerID":"docker://46b2bb766b699eca062c6a48dc429c7d4af432b005712b338c5deb9e848de146"}},"ready":true,"restartCount":1,"image":"confluentinc/cp-schema-registry:5.2.2","imageID":"docker-pullable://confluentinc/cp-schema-registry@sha256:0d7a84d486477a0c203ae21d5d52c40d26e810f5b5cfa27a56274692b70949f5","containerID":"docker://7d4a1500d2c48880f43b6b3b657cdd5b4171cad147467607fdef274b694a9592"}],"qosClass":"Burstable"}}
I1104 15:55:05.948707 12586 round_trippers.go:449] Response Headers:
I1104 15:55:05.948798 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:05.948803 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:05 GMT
I1104 15:55:05.948806 12586 round_trippers.go:452] Audit-Id: 5ea5e748-54ba-431c-8511-8508d297cf0c
I1104 15:55:05.948847 12586 request.go:1068] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kafka-connect-6c5dfdbfb4-2hdbw","generateName":"kafka-connect-6c5dfdbfb4-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/kafka-connect-6c5dfdbfb4-2hdbw","uid":"f328eda8-1e9f-11eb-9aff-16da7cad7b07","resourceVersion":"45489079","creationTimestamp":"2020-11-04T13:16:29Z","deletionTimestamp":"2020-11-04T13:55:32Z","deletionGracePeriodSeconds":30,"labels":{"app.kubernetes.io/instance":"kafka-connect","app.kubernetes.io/name":"kafka-connect","pod-template-hash":"6c5dfdbfb4"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"kafka-connect-6c5dfdbfb4","uid":"f323a896-1e9f-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"config","configMap":{"name":"kafka-connect","defaultMode":420}}],"containers":[{"name":"kafka-connect","image":"registry.example.com/cybervision/invu-kafka-connect-sinks/kafka-connect:2.0.0-37698","command":["/bin/sh","-c","$KAFKA_HOME/bin/connect-distributed.sh /etc/connect/connect-distributed.properties"],"ports":[{"name":"http","containerPort":8083,"protocol":"TCP"},{"name":"jmx","containerPort":9999,"protocol":"TCP"}],"env":[{"name":"KAFKA_HEAP_OPTS","value":"-Xmx750m -Xms750m"},{"name":"JMXPORT","value":"9999"}],"resources":{"limits":{"cpu":"1","memory":"1500Mi"},"requests":{"cpu":"750m","memory":"1000Mi"}},"volumeMounts":[{"name":"config","mountPath":"/etc/connect/"}],"livenessProbe":{"httpGet":{"path":"/","port":8083,"scheme":"HTTP"},"initialDelaySeconds":45,"timeoutSeconds":10,"periodSeconds":10,"successThreshold":1,"failureThreshold":6},"readinessProbe":{"httpGet":{"path":"/connector-plugins","port":8083,"scheme":"HTTP"},"initialDelaySeconds":30,"timeoutSeconds":10,"periodSeconds":10,"successThreshold":1,"failureThreshold":5},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{"runAsUser":1001,"runAsNonRoot":true},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}],"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":100,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"kubernetes.io/hostname"}}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka-connect"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:29Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:17:15Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:17:15Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:29Z"}],"hostIP":"10.40.56.27","podIP":"10.40.45.113","startTime":"2020-11-04T13:16:29Z","containerStatuses":[{"name":"kafka-connect","state":{"running":{"startedAt":"2020-11-04T13:16:44Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/cybervision/invu-kafka-connect-sinks/kafka-connect:2.0.0-37698","imageID":"docker-pullable://registry.example.com/cybervision/invu-kafka-connect-sinks/kafka-connect@sha256:6a584826ecf0bbdf654fbe27201e2ed07d5586bd6f0c414c13be40ac3f6cc62f","containerID":"docker://3431c9748539e0095632c7c7f336a4b6c2ca51420e0ab614aebcc7d2263c625d"}],"qosClass":"Burstable"}}
I1104 15:55:05.948427 12586 round_trippers.go:443] GET https://api.example.com/api/v1/namespaces/invu-sre/pods/kafka-0 200 OK in 157 milliseconds
I1104 15:55:05.948864 12586 round_trippers.go:449] Response Headers:
I1104 15:55:05.948870 12586 round_trippers.go:452] Audit-Id: 35e99daf-2d3b-4dd0-a7df-0117a7fc6fe8
I1104 15:55:05.948875 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:05.948879 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:05 GMT
I1104 15:55:05.948910 12586 request.go:1068] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kafka-0","generateName":"kafka-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/kafka-0","uid":"bf92b223-1e9a-11eb-9aff-16da7cad7b07","resourceVersion":"45489084","creationTimestamp":"2020-11-04T12:39:15Z","deletionTimestamp":"2020-11-04T13:58:02Z","deletionGracePeriodSeconds":180,"labels":{"app.kubernetes.io/name":"kafka","app.kubernetes.io/part-of":"invu-sre-kafka","controller-revision-hash":"kafka-7874665d8f","statefulset.kubernetes.io/pod-name":"kafka-0"},"annotations":{"checksum/config":"daad60db589e4fb5a1e13238ca6a87b4e363dc0a8a47c039efb620b65e86d9b9","prometheus.io/port":"9020","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"StatefulSet","name":"kafka","uid":"bf66bc4b-1e9a-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"data","persistentVolumeClaim":{"claimName":"data-kafka-0"}},{"name":"config","configMap":{"name":"kafka","defaultMode":420}}],"initContainers":[{"name":"delete-lost-found","image":"busybox","command":["/bin/sh","-c","rm -rf /dst/lost+found"],"resources":{},"volumeMounts":[{"name":"data","mountPath":"/dst"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"},{"name":"wait-for-zookeeper","image":"busybox","command":["/bin/sh","-c","until echo srvr | nc -w 5 kafka-zookeeper 2181 | grep Mode \u0026\u0026 echo zookeeper ok; do sleep 5; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"broker","image":"registry.example.com/ce/middleware/kafka:0.6.33","command":["/bin/bash","-c","exec ./bin/kafka-server-start.sh /etc/kafka/server.properties --override broker.id=${HOSTNAME##*-} --override advertised.host.name=${HOSTNAME}.kafka-headless.invu-sre.svc.cluster.local "],"ports":[{"name":"client","containerPort":9092,"protocol":"TCP"},{"name":"jmx","containerPort":9999,"protocol":"TCP"},{"name":"agent","containerPort":9020,"protocol":"TCP"}],"env":[{"name":"DNS_NAME","value":"example.com"},{"name":"KAFKA_HEAP_OPTS","value":"-Xmx7g -Xms7g"}],"resources":{"limits":{"cpu":"2","memory":"8Gi"},"requests":{"cpu":"2","memory":"8Gi"}},"volumeMounts":[{"name":"data","mountPath":"/var/lib/kafka"},{"name":"config","mountPath":"/etc/kafka"}],"lifecycle":{"preStop":{"exec":{"command":["/bin/bash","-c","exec ./bin/kafka-server-stop.sh"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"runAsUser":1001,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":180,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{"fsGroup":1001},"hostname":"kafka-0","subdomain":"kafka-headless","affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["zookeeper"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}],"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":100,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["zookeeper"]}]},"topologyKey":"kubernetes.io/hostname"}}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:43:09Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:43:15Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:43:15Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:42:54Z"}],"hostIP":"10.40.56.27","podIP":"10.40.44.88","startTime":"2020-11-04T12:42:54Z","initContainerStatuses":[{"name":"delete-lost-found","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T12:43:07Z","finishedAt":"2020-11-04T12:43:07Z","containerID":"docker://2774295ea860555b7db14d5bdd827b40b3971976f8af9e5c3ff0eef8ff491b2c"}},"lastState":{},"ready":true,"restartCount":0,"image":"busybox:latest","imageID":"docker-pullable://busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","containerID":"docker://2774295ea860555b7db14d5bdd827b40b3971976f8af9e5c3ff0eef8ff491b2c"},{"name":"wait-for-zookeeper","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T12:43:09Z","finishedAt":"2020-11-04T12:43:09Z","containerID":"docker://1d6f11662dce2bdbfe8c27a73383f62f7a9adb72323fd786a91e5c62b106e19e"}},"lastState":{},"ready":true,"restartCount":0,"image":"busybox:latest","imageID":"docker-pullable://busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","containerID":"docker://1d6f11662dce2bdbfe8c27a73383f62f7a9adb72323fd786a91e5c62b106e19e"}],"containerStatuses":[{"name":"broker","state":{"running":{"startedAt":"2020-11-04T12:43:15Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/middleware/kafka:0.6.33","imageID":"docker-pullable://registry.example.com/ce/middleware/kafka@sha256:5a13ea153f26ac29e73fd3a0ed67c701f33ea761a0b10a03870fdda51e3975cc","containerID":"docker://aab562c6506685007f59fc42f95492910f41f3e3a4106afc8c1c4803eaf3a61c"}],"qosClass":"Guaranteed"}}
I1104 15:55:05.948420 12586 round_trippers.go:443] GET https://api.example.com/api/v1/namespaces/invu-sre/pods/infrastructure-service-5b8746775c-v98mn 200 OK in 160 milliseconds
I1104 15:55:05.948948 12586 round_trippers.go:449] Response Headers:
I1104 15:55:05.948953 12586 round_trippers.go:452] Audit-Id: 9cdf2017-5cd5-46ed-b0f7-5ced5ee5ff0b
I1104 15:55:05.948957 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:05.948964 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:05 GMT
I1104 15:55:05.949017 12586 request.go:1068] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"infrastructure-service-5b8746775c-v98mn","generateName":"infrastructure-service-5b8746775c-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/infrastructure-service-5b8746775c-v98mn","uid":"fc2f3532-1e9f-11eb-9aff-16da7cad7b07","resourceVersion":"45489077","creationTimestamp":"2020-11-04T13:16:44Z","deletionTimestamp":"2020-11-04T13:55:32Z","deletionGracePeriodSeconds":30,"labels":{"app":"infrastructure-service","pod-template-hash":"5b8746775c","release":"invu-sre-infrastructure-service"},"annotations":{"iam.amazonaws.com/role":"invu-sre-objects-access"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"infrastructure-service-5b8746775c","uid":"fc2d93cc-1e9f-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-kvb6j","secret":{"secretName":"default-token-kvb6j","defaultMode":420}}],"initContainers":[{"name":"mysql-client","image":"registry.example.com/ce/utilities/mysql-client","env":[{"name":"DATABASE_NAME","value":"invu_infrastructure_service"},{"name":"MYSQL_USER","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MYSQL_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}}],"resources":{},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"infrastructure-service","image":"registry.example.com/cybervision/invu-infrastructure-service:2.0.0-37566","ports":[{"name":"http","containerPort":80,"protocol":"TCP"}],"env":[{"name":"S3_BUCKET_NAME","value":"invu-sre-objects"},{"name":"LOG_LEVEL_example","value":"DEBUG"},{"name":"S3_BUCKET_REGION","value":"us-east-1"},{"name":"ZOOKEEPER_CONNECT_STRING","value":"kafka-zookeeper:2181"},{"name":"BOOTSTRAP_SERVERS","value":"kafka:9092"},{"name":"DEBUG","value":"false"},{"name":"JAVA_OPTS","value":"-Xmx512M"},{"name":"MARIADB_HOST","value":"mariadb"},{"name":"MARIADB_USERNAME","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MARIADB_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}},{"name":"INSTANCE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.name"}}}],"resources":{"limits":{"cpu":"500m","memory":"1Gi"},"requests":{"cpu":"500m","memory":"750Mi"}},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":240,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":5,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app","operator":"In","values":["infrastructure-service"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:47Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:18:25Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:18:25Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:44Z"}],"hostIP":"10.40.56.27","podIP":"10.40.44.73","startTime":"2020-11-04T13:16:44Z","initContainerStatuses":[{"name":"mysql-client","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T13:16:47Z","finishedAt":"2020-11-04T13:16:47Z","containerID":"docker://bd524fa563b598c44d93acb77f9abfc0891e9c8b3fedce934ddd7d06bc699b91"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/utilities/mysql-client:latest","imageID":"docker-pullable://registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","containerID":"docker://bd524fa563b598c44d93acb77f9abfc0891e9c8b3fedce934ddd7d06bc699b91"}],"containerStatuses":[{"name":"infrastructure-service","state":{"running":{"startedAt":"2020-11-04T13:16:53Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/cybervision/invu-infrastructure-service:2.0.0-37566","imageID":"docker-pullable://registry.example.com/cybervision/invu-infrastructure-service@sha256:00f75459b2ee50deb47884131608f73108158d4faa085d1a5cc237aacd3f2112","containerID":"docker://05675f6f5f5781c38c509dcea0f48266dc9836bedfbdd15df1092499788fa2f4"}],"qosClass":"Burstable"}}
I1104 15:55:06.785597 12586 round_trippers.go:423] curl -k -v -XGET -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" -H "Accept: application/json, */*" 'https://api.example.com/api/v1/namespaces/invu-sre/pods/mariadb-0'
I1104 15:55:06.785968 12586 round_trippers.go:423] curl -k -v -XGET -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" -H "Accept: application/json, */*" 'https://api.example.com/api/v1/namespaces/invu-sre/pods/emqx-758448bfd5-h7s9j'
I1104 15:55:06.787614 12586 round_trippers.go:423] curl -k -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" 'https://api.example.com/api/v1/namespaces/invu-sre/pods/schema-registry-7c97c65ddf-dtrwh'
I1104 15:55:06.787614 12586 round_trippers.go:423] curl -k -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" 'https://api.example.com/api/v1/namespaces/invu-sre/pods/kafka-connect-6c5dfdbfb4-2hdbw'
I1104 15:55:06.787798 12586 round_trippers.go:423] curl -k -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" 'https://api.example.com/api/v1/namespaces/invu-sre/pods/infrastructure-service-5b8746775c-v98mn'
I1104 15:55:06.790450 12586 round_trippers.go:423] curl -k -v -XGET -H "Accept: application/json, */*" -H "User-Agent: kops/v0.0.0 (linux/amd64) kubernetes/$Format" -H "Authorization: Basic ******" 'https://api.example.com/api/v1/namespaces/invu-sre/pods/kafka-0'
I1104 15:55:06.972310 12586 round_trippers.go:443] GET https://api.example.com/api/v1/namespaces/invu-sre/pods/infrastructure-service-5b8746775c-v98mn 200 OK in 184 milliseconds
I1104 15:55:06.972336 12586 round_trippers.go:443] GET https://api.example.com/api/v1/namespaces/invu-sre/pods/schema-registry-7c97c65ddf-dtrwh 200 OK in 184 milliseconds
I1104 15:55:06.972347 12586 round_trippers.go:449] Response Headers:
I1104 15:55:06.972351 12586 round_trippers.go:452] Audit-Id: c6ae35ba-1cc8-4c04-ab48-9cf04bb3d6d1
I1104 15:55:06.972353 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:06.972356 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:06 GMT
I1104 15:55:06.972339 12586 round_trippers.go:449] Response Headers:
I1104 15:55:06.972391 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:06.972396 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:06 GMT
I1104 15:55:06.972400 12586 round_trippers.go:452] Audit-Id: 923749ea-5486-4ce2-a8e6-dd4431c34b84
I1104 15:55:06.972406 12586 request.go:1068] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"schema-registry-7c97c65ddf-dtrwh","generateName":"schema-registry-7c97c65ddf-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/schema-registry-7c97c65ddf-dtrwh","uid":"82f8c4bb-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45489140","creationTimestamp":"2020-11-04T12:44:43Z","deletionTimestamp":"2020-11-04T13:55:32Z","deletionGracePeriodSeconds":30,"labels":{"app.kubernetes.io/name":"schema-registry","app.kubernetes.io/part-of":"invu-sre-ksql-server","pod-template-hash":"7c97c65ddf"},"annotations":{"prometheus.io/port":"5556","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"schema-registry-7c97c65ddf","uid":"82f1e9b2-1e9b-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"jmx-config","configMap":{"name":"schema-registry-jmx-config","defaultMode":420}}],"containers":[{"name":"exporter","image":"example/jmx-prometheus-httpserver:0.11.0","args":["5556","/etc/jmx-schema-registry/jmx-schema-registry-prometheus.yml"],"ports":[{"name":"exporter","containerPort":5556,"protocol":"TCP"}],"resources":{"limits":{"cpu":"25m","memory":"128Mi"},"requests":{"cpu":"10m","memory":"64Mi"}},"volumeMounts":[{"name":"jmx-config","mountPath":"/etc/jmx-schema-registry"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"},{"name":"schema-registry","image":"confluentinc/cp-schema-registry:5.2.2","ports":[{"name":"http","containerPort":8081,"protocol":"TCP"},{"name":"jmx","containerPort":5555,"protocol":"TCP"}],"env":[{"name":"SCHEMA_REGISTRY_KAFKASTORE_BOOTSTRAP_SERVERS","value":"PLAINTEXT://kafka:9092"},{"name":"SCHEMA_REGISTRY_HOST_NAME","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}},{"name":"SCHEMA_REGISTRY_KAFKASTORE_GROUP_ID","value":"invu-sre-ksql-server"},{"name":"SCHEMA_REGISTRY_LISTENERS","value":"http://0.0.0.0:8081"},{"name":"JMX_PORT","value":"5555"}],"resources":{"limits":{"cpu":"500m","memory":"2Gi"},"requests":{"cpu":"200m","memory":"1Gi"}},"livenessProbe":{"httpGet":{"path":"/","port":"http","scheme":"HTTP"},"initialDelaySeconds":45,"timeoutSeconds":1,"periodSeconds":15,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/","port":"http","scheme":"HTTP"},"initialDelaySeconds":45,"timeoutSeconds":1,"periodSeconds":15,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}],"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":100,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"kubernetes.io/hostname"}}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["schema-registry"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Pending","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:43Z"},{"type":"Ready","status":"False","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:55:06Z","reason":"ContainersNotReady","message":"containers with unready status: [exporter schema-registry]"},{"type":"ContainersReady","status":"False","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:55:06Z","reason":"ContainersNotReady","message":"containers with unready status: [exporter schema-registry]"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:43Z"}],"hostIP":"10.40.56.27","startTime":"2020-11-04T12:44:43Z","containerStatuses":[{"name":"exporter","state":{"terminated":{"exitCode":0,"startedAt":null,"finishedAt":null}},"lastState":{},"ready":false,"restartCount":0,"image":"example/jmx-prometheus-httpserver:0.11.0","imageID":""},{"name":"schema-registry","state":{"terminated":{"exitCode":0,"startedAt":null,"finishedAt":null}},"lastState":{"terminated":{"exitCode":1,"reason":"Error","startedAt":"2020-11-04T12:45:05Z","finishedAt":"2020-11-04T12:46:25Z","containerID":"docker://46b2bb766b699eca062c6a48dc429c7d4af432b005712b338c5deb9e848de146"}},"ready":false,"restartCount":1,"image":"confluentinc/cp-schema-registry:5.2.2","imageID":""}],"qosClass":"Burstable"}}
I1104 15:55:06.972479 12586 request.go:1068] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"infrastructure-service-5b8746775c-v98mn","generateName":"infrastructure-service-5b8746775c-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/infrastructure-service-5b8746775c-v98mn","uid":"fc2f3532-1e9f-11eb-9aff-16da7cad7b07","resourceVersion":"45489141","creationTimestamp":"2020-11-04T13:16:44Z","deletionTimestamp":"2020-11-04T13:55:32Z","deletionGracePeriodSeconds":30,"labels":{"app":"infrastructure-service","pod-template-hash":"5b8746775c","release":"invu-sre-infrastructure-service"},"annotations":{"iam.amazonaws.com/role":"invu-sre-objects-access"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"infrastructure-service-5b8746775c","uid":"fc2d93cc-1e9f-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-kvb6j","secret":{"secretName":"default-token-kvb6j","defaultMode":420}}],"initContainers":[{"name":"mysql-client","image":"registry.example.com/ce/utilities/mysql-client","env":[{"name":"DATABASE_NAME","value":"invu_infrastructure_service"},{"name":"MYSQL_USER","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MYSQL_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}}],"resources":{},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"infrastructure-service","image":"registry.example.com/cybervision/invu-infrastructure-service:2.0.0-37566","ports":[{"name":"http","containerPort":80,"protocol":"TCP"}],"env":[{"name":"S3_BUCKET_NAME","value":"invu-sre-objects"},{"name":"LOG_LEVEL_example","value":"DEBUG"},{"name":"S3_BUCKET_REGION","value":"us-east-1"},{"name":"ZOOKEEPER_CONNECT_STRING","value":"kafka-zookeeper:2181"},{"name":"BOOTSTRAP_SERVERS","value":"kafka:9092"},{"name":"DEBUG","value":"false"},{"name":"JAVA_OPTS","value":"-Xmx512M"},{"name":"MARIADB_HOST","value":"mariadb"},{"name":"MARIADB_USERNAME","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"username"}}},{"name":"MARIADB_PASSWORD","valueFrom":{"secretKeyRef":{"name":"mariadb-credentials","key":"password"}}},{"name":"INSTANCE","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"metadata.name"}}}],"resources":{"limits":{"cpu":"500m","memory":"1Gi"},"requests":{"cpu":"500m","memory":"750Mi"}},"volumeMounts":[{"name":"default-token-kvb6j","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":240,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"httpGet":{"path":"/actuator/health","port":"http","scheme":"HTTP"},"initialDelaySeconds":5,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":3},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app","operator":"In","values":["infrastructure-service"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Pending","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:47Z"},{"type":"Ready","status":"False","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:55:06Z","reason":"ContainersNotReady","message":"containers with unready status: [infrastructure-service]"},{"type":"ContainersReady","status":"False","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:55:06Z","reason":"ContainersNotReady","message":"containers with unready status: [infrastructure-service]"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T13:16:44Z"}],"hostIP":"10.40.56.27","podIP":"10.40.44.73","startTime":"2020-11-04T13:16:44Z","initContainerStatuses":[{"name":"mysql-client","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T13:16:47Z","finishedAt":"2020-11-04T13:16:47Z","containerID":"docker://bd524fa563b598c44d93acb77f9abfc0891e9c8b3fedce934ddd7d06bc699b91"}},"lastState":{},"ready":true,"restartCount":0,"image":"registry.example.com/ce/utilities/mysql-client:latest","imageID":"docker-pullable://registry.example.com/ce/utilities/mysql-client@sha256:a748d356fc0b118b7a2cec5839fc73d473cfc9f8294c6ac8e07064c310e22ec9","containerID":"docker://bd524fa563b598c44d93acb77f9abfc0891e9c8b3fedce934ddd7d06bc699b91"}],"containerStatuses":[{"name":"infrastructure-service","state":{"waiting":{"reason":"PodInitializing"}},"lastState":{},"ready":false,"restartCount":0,"image":"registry.example.com/cybervision/invu-infrastructure-service:2.0.0-37566","imageID":""}],"qosClass":"Burstable"}}
I1104 15:55:06.972308 12586 round_trippers.go:443] GET https://api.example.com/api/v1/namespaces/invu-sre/pods/emqx-758448bfd5-h7s9j 200 OK in 186 milliseconds
I1104 15:55:06.972505 12586 round_trippers.go:449] Response Headers:
I1104 15:55:06.972511 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:06 GMT
I1104 15:55:06.972514 12586 round_trippers.go:452] Audit-Id: 4902deee-bfdf-4811-a20c-6ca12238230b
I1104 15:55:06.972517 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:06.972322 12586 round_trippers.go:443] GET https://api.example.com/api/v1/namespaces/invu-sre/pods/kafka-connect-6c5dfdbfb4-2hdbw 200 OK in 184 milliseconds
I1104 15:55:06.972566 12586 request.go:1068] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"emqx-758448bfd5-h7s9j","generateName":"emqx-758448bfd5-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/emqx-758448bfd5-h7s9j","uid":"7540f9d4-1e9b-11eb-9aff-16da7cad7b07","resourceVersion":"45489078","creationTimestamp":"2020-11-04T12:44:20Z","deletionTimestamp":"2020-11-04T13:55:32Z","deletionGracePeriodSeconds":30,"labels":{"app.kubernetes.io/name":"emqx","app.kubernetes.io/part-of":"invu-sre-emqx","pod-template-hash":"758448bfd5"},"annotations":{"prometheus.io/port":"9540","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"emqx-758448bfd5","uid":"753f9db6-1e9b-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"data","configMap":{"name":"emqx","items":[{"key":"loaded_plugins","path":"loaded_plugins"}],"defaultMode":420}},{"name":"plugins","configMap":{"name":"emqx","items":[{"key":"emqx_auth_username.conf","path":"emqx_auth_username.conf"},{"key":"emqx_auth_jwt.conf","path":"emqx_auth_jwt.conf"}],"defaultMode":420}},{"name":"certs","configMap":{"name":"emqx","items":[{"key":"jwt_public_key.pem","path":"jwt_public_key.pem"}],"defaultMode":420}},{"name":"emqx-token-nf8kx","secret":{"secretName":"emqx-token-nf8kx","defaultMode":420}}],"containers":[{"name":"exporter","image":"example/emq_exporter:v0.4.1","args":["--emq.node=emqx@$(POD_IP)","--emq.api-version=v3"],"ports":[{"name":"metrics","containerPort":9540,"protocol":"TCP"}],"env":[{"name":"EMQ_USERNAME","value":"admin"},{"name":"EMQ_PASSWORD","valueFrom":{"secretKeyRef":{"name":"emqx","key":"admin_password"}}},{"name":"POD_IP","valueFrom":{"fieldRef":{"apiVersion":"v1","fieldPath":"status.podIP"}}}],"resources":{"limits":{"cpu":"50m","memory":"64Mi"},"requests":{"cpu":"15m","memory":"32Mi"}},"volumeMounts":[{"name":"emqx-token-nf8kx","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent"},{"name":"emqx","image":"emqx/emqx:v3.2.7","ports":[{"name":"mqtt","containerPort":1883,"protocol":"TCP"},{"name":"websocket","containerPort":8083,"protocol":"TCP"},{"name":"mgmt","containerPort":8080,"protocol":"TCP"},{"name":"dashboard","containerPort":18083,"protocol":"TCP"}],"env":[{"name":"EMQ_NODE__COOKIE","valueFrom":{"secretKeyRef":{"name":"emqx","key":"node_cookie"}}},{"name":"EMQX_DASHBOARD__DEFAULT_USER__PASSWORD","valueFrom":{"secretKeyRef":{"name":"emqx","key":"admin_password"}}},{"name":"EMQX_ALLOW_ANONYMOUS","value":"false"},{"name":"EMQX_CLUSTER__AUTOCLEAN","value":"5m"},{"name":"EMQX_CLUSTER__AUTOHEAL","value":"on"},{"name":"EMQX_CLUSTER__DISCOVERY","value":"k8s"},{"name":"EMQX_CLUSTER__K8S__ADDRESS_TYPE","value":"ip"},{"name":"EMQX_CLUSTER__K8S__APISERVER","value":"https://kubernetes.default.svc.cluster.local:443"},{"name":"EMQX_CLUSTER__K8S__APP_NAME","value":"emqx"},{"name":"EMQX_CLUSTER__K8S__NAMESPACE","value":"invu-sre"},{"name":"EMQX_CLUSTER__K8S__SERVICE_NAME","value":"emqx"},{"name":"EMQX_CLUSTER__NAME","value":"emqx_cluster"},{"name":"EMQX_MQTT__MAX_PACKET_SIZE","value":"10MB"},{"name":"EMQX_NAME","value":"emqx"}],"resources":{"limits":{"cpu":"500m","memory":"512Mi"},"requests":{"cpu":"200m","memory":"256Mi"}},"volumeMounts":[{"name":"data","mountPath":"/opt/emqx/data/loaded_plugins","subPath":"loaded_plugins"},{"name":"plugins","mountPath":"/opt/emqx/etc/plugins/emqx_auth_username.conf","subPath":"emqx_auth_username.conf"},{"name":"plugins","mountPath":"/opt/emqx/etc/plugins/emqx_auth_jwt.conf","subPath":"emqx_auth_jwt.conf"},{"name":"certs","mountPath":"/opt/emqx/etc/certs/jwt_public_key.pem","subPath":"jwt_public_key.pem"},{"name":"emqx-token-nf8kx","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"exec":{"command":["/bin/sh","-c","emqx_ctl status | grep 'is running'"]},"initialDelaySeconds":45,"timeoutSeconds":1,"periodSeconds":15,"successThreshold":1,"failureThreshold":3},"readinessProbe":{"exec":{"command":["/bin/sh","-c","emqx_ctl status | grep 'is running'"]},"initialDelaySeconds":45,"timeoutSeconds":1,"periodSeconds":15,"successThreshold":1,"failureThreshold":3},"lifecycle":{"preStop":{"exec":{"command":["/bin/sh","-c","emqx stop"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"runAsUser":1000,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"emqx","serviceAccount":"emqx","nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{},"affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}],"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":100,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"kubernetes.io/hostname"}}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["emqx"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:20Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:45:16Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:45:16Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:44:20Z"}],"hostIP":"10.40.56.27","podIP":"10.40.32.131","startTime":"2020-11-04T12:44:20Z","containerStatuses":[{"name":"emqx","state":{"running":{"startedAt":"2020-11-04T12:44:26Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"emqx/emqx:v3.2.7","imageID":"docker-pullable://emqx/emqx@sha256:3f31ee2793b4446e98183659b4493992355e2b0d8603df946c641b47f29ced78","containerID":"docker://974f27ae72445d1d6506dd99933c36122005477e60125d19123b9c633295a6e6"},{"name":"exporter","state":{"running":{"startedAt":"2020-11-04T12:44:23Z"}},"lastState":{},"ready":true,"restartCount":0,"image":"example/emq_exporter:v0.4.1","imageID":"docker-pullable://example/emq_exporter@sha256:1526c0476c1e5d740dfc4df36f3295ea27f87b41becf274c760fbd0a51011233","containerID":"docker://f3270342707cf0eb993e24680050991e5bb867a885b32fddd01c81db07c7ab54"}],"qosClass":"Burstable"}}
I1104 15:55:06.972320 12586 round_trippers.go:443] GET https://api.example.com/api/v1/namespaces/invu-sre/pods/kafka-0 200 OK in 181 milliseconds
I1104 15:55:06.972651 12586 round_trippers.go:449] Response Headers:
I1104 15:55:06.972656 12586 round_trippers.go:452] Audit-Id: a4d958f1-89a0-48fa-abc9-e58ae6bb5a23
I1104 15:55:06.972661 12586 round_trippers.go:452] Content-Type: application/json
I1104 15:55:06.972665 12586 round_trippers.go:452] Date: Wed, 04 Nov 2020 13:55:06 GMT
I1104 15:55:06.972713 12586 request.go:1068] Response Body: {"kind":"Pod","apiVersion":"v1","metadata":{"name":"kafka-0","generateName":"kafka-","namespace":"invu-sre","selfLink":"/api/v1/namespaces/invu-sre/pods/kafka-0","uid":"bf92b223-1e9a-11eb-9aff-16da7cad7b07","resourceVersion":"45489084","creationTimestamp":"2020-11-04T12:39:15Z","deletionTimestamp":"2020-11-04T13:58:02Z","deletionGracePeriodSeconds":180,"labels":{"app.kubernetes.io/name":"kafka","app.kubernetes.io/part-of":"invu-sre-kafka","controller-revision-hash":"kafka-7874665d8f","statefulset.kubernetes.io/pod-name":"kafka-0"},"annotations":{"checksum/config":"daad60db589e4fb5a1e13238ca6a87b4e363dc0a8a47c039efb620b65e86d9b9","prometheus.io/port":"9020","prometheus.io/scrape":"true"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"StatefulSet","name":"kafka","uid":"bf66bc4b-1e9a-11eb-9aff-16da7cad7b07","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"data","persistentVolumeClaim":{"claimName":"data-kafka-0"}},{"name":"config","configMap":{"name":"kafka","defaultMode":420}}],"initContainers":[{"name":"delete-lost-found","image":"busybox","command":["/bin/sh","-c","rm -rf /dst/lost+found"],"resources":{},"volumeMounts":[{"name":"data","mountPath":"/dst"}],"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"},{"name":"wait-for-zookeeper","image":"busybox","command":["/bin/sh","-c","until echo srvr | nc -w 5 kafka-zookeeper 2181 | grep Mode \u0026\u0026 echo zookeeper ok; do sleep 5; done"],"resources":{},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Always"}],"containers":[{"name":"broker","image":"registry.example.com/ce/middleware/kafka:0.6.33","command":["/bin/bash","-c","exec ./bin/kafka-server-start.sh /etc/kafka/server.properties --override broker.id=${HOSTNAME##*-} --override advertised.host.name=${HOSTNAME}.kafka-headless.invu-sre.svc.cluster.local "],"ports":[{"name":"client","containerPort":9092,"protocol":"TCP"},{"name":"jmx","containerPort":9999,"protocol":"TCP"},{"name":"agent","containerPort":9020,"protocol":"TCP"}],"env":[{"name":"DNS_NAME","value":"example.com"},{"name":"KAFKA_HEAP_OPTS","value":"-Xmx7g -Xms7g"}],"resources":{"limits":{"cpu":"2","memory":"8Gi"},"requests":{"cpu":"2","memory":"8Gi"}},"volumeMounts":[{"name":"data","mountPath":"/var/lib/kafka"},{"name":"config","mountPath":"/etc/kafka"}],"lifecycle":{"preStop":{"exec":{"command":["/bin/bash","-c","exec ./bin/kafka-server-stop.sh"]}}},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"IfNotPresent","securityContext":{"runAsUser":1001,"procMount":"Default"}}],"restartPolicy":"Always","terminationGracePeriodSeconds":180,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","automountServiceAccountToken":false,"nodeName":"ip-10-40-56-27.ec2.internal","securityContext":{"fsGroup":1001},"hostname":"kafka-0","subdomain":"kafka-headless","affinity":{"podAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["zookeeper"]}]},"topologyKey":"failure-domain.beta.kubernetes.io/zone"}],"preferredDuringSchedulingIgnoredDuringExecution":[{"weight":100,"podAffinityTerm":{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["zookeeper"]}]},"topologyKey":"kubernetes.io/hostname"}}]},"podAntiAffinity":{"requiredDuringSchedulingIgnoredDuringExecution":[{"labelSelector":{"matchExpressions":[{"key":"app.kubernetes.io/name","operator":"In","values":["kafka"]}]},"topologyKey":"kubernetes.io/hostname"}]}},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:43:09Z"},{"type":"Ready","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:43:15Z"},{"type":"ContainersReady","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:43:15Z"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2020-11-04T12:42:54Z"}],"hostIP":"10.40.56.27","podIP":"10.40.44.88","startTime":"2020-11-04T12:42:54Z","initContainerStatuses":[{"name":"delete-lost-found","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T12:43:07Z","finishedAt":"2020-11-04T12:43:07Z","containerID":"docker://2774295ea860555b7db14d5bdd827b40b3971976f8af9e5c3ff0eef8ff491b2c"}},"lastState":{},"ready":true,"restartCount":0,"image":"busybox:latest","imageID":"docker-pullable://busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","containerID":"docker://2774295ea860555b7db14d5bdd827b40b3971976f8af9e5c3ff0eef8ff491b2c"},{"name":"wait-for-zookeeper","state":{"terminated":{"exitCode":0,"reason":"Completed","startedAt":"2020-11-04T12:43:09Z","finishedAt":"2020-11-04T12:43:09Z","containerID":"docker://1d6f11662dce2bdbfe8c27a73383f62f7a9adb72323fd786a91e5c62b106e19e"}},"lastState":{},"ready":true,"restartCount":0,"image":"busybox:latest","imageID":"docker-pullable://busybox@sha256:a9286defaba7b3a519d585ba0e37d0b2cbee74ebfe590960b0b1d6a5e97d1e1d","containerID":"docker://1d6f11662dce2bdbfe8c27a73383f62f7a9adb72323fd786a91e5c62b106e19e"}],"containerStatuses":[{"name":"broker","state":{"running":{"startedAt":"2020-11-04T12:43:15Z"}},"lastState
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment