Skip to content

Instantly share code, notes, and snippets.

@danehans

danehans/00_notes.md

Last active June 19, 2020 22:09
Show Gist options
  • Save danehans/3b075e36cf65184ffacc0569103e25d1 to your computer and use it in GitHub Desktop.
Save danehans/3b075e36cf65184ffacc0569103e25d1 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
00_notes.md

References:

ocp template docs

monitoring docs

network-check insights

network-check repo

Reproducer Environment Setup

Create the template:

$ oc create -f https://raw.githubusercontent.com/RedHatInsights/network-check/master/template.yml

Note: One of two user workload monitoring pods failed to start due to this BZ. TO work around the BZ, make master nodes schedulable:

$ oc edit scheduler/cluster

Create the deployment from the template (note the image tag from this repo. Update the env vars as needed:

$ oc process network-check -p HTTP_URL=http://www.google.com -p GETENT_HOST=koku-stage.cm3mmfyi8atf.us-east-1.rds.amazonaws.com -p IMAGE_TAG=1f8af1d | oc create -f -

Setup workload metrics:

Enable the workload metrics feature by creating the following configmap:

$ oc -n openshift-monitoring create configmap cluster-monitoring-config

and add the data:

$ oc -n openshift-monitoring edit configmap cluster-monitoring-config
data:
  config.yaml: |
    techPreviewUserWorkload:
      enabled: true

Verify all pods are running:

$ oc -n openshift-user-workload-monitoring get pod

Setup RBAC to access metrics.

$ cat custom-metrics-rbac.yaml 
kind: ClusterRole
apiVersion: rbac.authorization.k8s.io/v1
metadata:
  name: monitor-crd-edit
rules:
- apiGroups: ["monitoring.coreos.com"]
  resources: ["prometheusrules", "servicemonitors", "podmonitors"]
  verbs: ["get", "list", "watch", "create", "update", "patch", "delete"]
---
kind: ClusterRoleBinding
apiVersion: rbac.authorization.k8s.io/v1
metadata:
  name: monitor-crd-edit
subjects:
  - kind: User
    apiGroup: rbac.authorization.k8s.io
    name: kubeadmin
roleRef:
  apiGroup: rbac.authorization.k8s.io
  kind: ClusterRole
  name: monitor-crd-edit

Setup mertrics collection:

apiVersion: monitoring.coreos.com/v1
kind: ServiceMonitor
metadata:
  labels:
    k8s-app: prometheus-network-check-monitor
  name: prometheus-network-check-monitor
  namespace: default
spec:
  endpoints:
  - interval: 30s
    targetPort: 9000
    scheme: http
  selector:
    matchLabels:
      name: network-check

Run a query from the Web UI: (rate(netcheck_getent_failures_total[12h]) / rate(netcheck_getent_total[12h])) * 100

Note: If the metrics Web UI is showing "No datapoints found." when running the query, you can scrape metrics by curl'ing the network-check pod's /metrics endpoint. For example:

$ oc exec -it router-default-64d6bfff6b-hd85v -n openshift-ingress -- /bin/bash
bash-4.2$ curl http://172.30.172.49:9000/metrics
# HELP python_gc_objects_collected_total Objects collected during gc
# TYPE python_gc_objects_collected_total counter
python_gc_objects_collected_total{generation="0"} 160.0
python_gc_objects_collected_total{generation="1"} 158.0
python_gc_objects_collected_total{generation="2"} 0.0
# HELP python_gc_objects_uncollectable_total Uncollectable object found during GC
# TYPE python_gc_objects_uncollectable_total counter
python_gc_objects_uncollectable_total{generation="0"} 0.0
python_gc_objects_uncollectable_total{generation="1"} 0.0
python_gc_objects_uncollectable_total{generation="2"} 0.0
# HELP python_gc_collections_total Number of times this generation was collected
# TYPE python_gc_collections_total counter
python_gc_collections_total{generation="0"} 54.0
python_gc_collections_total{generation="1"} 4.0
python_gc_collections_total{generation="2"} 0.0
# HELP python_info Python platform information
# TYPE python_info gauge
python_info{implementation="CPython",major="3",minor="8",patchlevel="0",version="3.8.0"} 1.0
# HELP process_virtual_memory_bytes Virtual memory size in bytes.
# TYPE process_virtual_memory_bytes gauge
process_virtual_memory_bytes 2.660352e+08
# HELP process_resident_memory_bytes Resident memory size in bytes.
# TYPE process_resident_memory_bytes gauge
process_resident_memory_bytes 2.4817664e+07
# HELP process_start_time_seconds Start time of the process since unix epoch in seconds.
# TYPE process_start_time_seconds gauge
process_start_time_seconds 1.59252087797e+09
# HELP process_cpu_seconds_total Total user and system CPU time spent in seconds.
# TYPE process_cpu_seconds_total counter
process_cpu_seconds_total 23.14
# HELP process_open_fds Number of open file descriptors.
# TYPE process_open_fds gauge
process_open_fds 6.0
# HELP process_max_fds Maximum number of open file descriptors.
# TYPE process_max_fds gauge
process_max_fds 1.048576e+06
# HELP netcheck_getent_total Total getent calls
# TYPE netcheck_getent_total counter
netcheck_getent_total{host="kubernetes.default.svc.cluster.local"} 3743.0
# HELP netcheck_getent_created Total getent calls
# TYPE netcheck_getent_created gauge
netcheck_getent_created{host="kubernetes.default.svc.cluster.local"} 1.5925208789037127e+09
# HELP netcheck_getent_failures_total Failed getent calls
# TYPE netcheck_getent_failures_total counter
netcheck_getent_failures_total{host="kubernetes.default.svc.cluster.local"} 0.0
# HELP netcheck_getent_failures_created Failed getent calls
# TYPE netcheck_getent_failures_created gauge
netcheck_getent_failures_created{host="kubernetes.default.svc.cluster.local"} 1.5925208788816779e+09
# HELP netcheck_http_total Total http calls
# TYPE netcheck_http_total counter
netcheck_http_total{url="http://www.google.com"} 3743.0
# HELP netcheck_http_created Total http calls
# TYPE netcheck_http_created gauge
netcheck_http_created{url="http://www.google.com"} 1.592520878974379e+09
# HELP netcheck_http_failures_total Failed http calls
# TYPE netcheck_http_failures_total counter
netcheck_http_failures_total{url="http://www.google.com"} 0.0
# HELP netcheck_http_failures_created Failed http calls
# TYPE netcheck_http_failures_created gauge
netcheck_http_failures_created{url="http://www.google.com"} 1.592520878881692e+09

Note: The above metrics show no getent or http failures after several hours.

Raw
02_worker_node_details
$ oc get nodes
NAME STATUS ROLES AGE VERSION
ip-10-0-141-185.us-west-2.compute.internal Ready worker 8h v1.16.2
ip-10-0-141-191.us-west-2.compute.internal Ready master 8h v1.16.2
ip-10-0-156-148.us-west-2.compute.internal Ready master 8h v1.16.2
ip-10-0-159-58.us-west-2.compute.internal Ready worker 8h v1.16.2
ip-10-0-165-193.us-west-2.compute.internal Ready worker 8h v1.16.2
ip-10-0-165-20.us-west-2.compute.internal Ready master 8h v1.16.2
$ oc describe node/ip-10-0-141-185.us-west-2.compute.internal
Name: ip-10-0-141-185.us-west-2.compute.internal
Roles: worker
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/instance-type=m5.large
beta.kubernetes.io/os=linux
failure-domain.beta.kubernetes.io/region=us-west-2
failure-domain.beta.kubernetes.io/zone=us-west-2a
kubernetes.io/arch=amd64
kubernetes.io/hostname=ip-10-0-141-185
kubernetes.io/os=linux
node-role.kubernetes.io/worker=
node.openshift.io/os_id=rhcos
Annotations: machine.openshift.io/machine: openshift-machine-api/dhansen4319-v6zb2-worker-us-west-2a-dffvf
machineconfiguration.openshift.io/currentConfig: rendered-worker-f45dfb50d90a2c4803923493d4fa9971
machineconfiguration.openshift.io/desiredConfig: rendered-worker-f45dfb50d90a2c4803923493d4fa9971
machineconfiguration.openshift.io/reason:
machineconfiguration.openshift.io/state: Done
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Thu, 18 Jun 2020 12:31:20 -0700
Taints: <none>
Unschedulable: false
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Thu, 18 Jun 2020 20:53:15 -0700 Thu, 18 Jun 2020 12:31:20 -0700 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Thu, 18 Jun 2020 20:53:15 -0700 Thu, 18 Jun 2020 12:31:20 -0700 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Thu, 18 Jun 2020 20:53:15 -0700 Thu, 18 Jun 2020 12:31:20 -0700 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Thu, 18 Jun 2020 20:53:15 -0700 Thu, 18 Jun 2020 12:32:31 -0700 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 10.0.141.185
Hostname: ip-10-0-141-185.us-west-2.compute.internal
InternalDNS: ip-10-0-141-185.us-west-2.compute.internal
Capacity:
attachable-volumes-aws-ebs: 25
cpu: 2
ephemeral-storage: 125277164Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 7861164Ki
pods: 250
Allocatable:
attachable-volumes-aws-ebs: 25
cpu: 1500m
ephemeral-storage: 114381692328
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 6710188Ki
pods: 250
System Info:
Machine ID: ec29836902685f7ab8ef904d54a4990f
System UUID: ec298369-0268-5f7a-b8ef-904d54a4990f
Boot ID: df4fc60a-6774-4161-a429-11144103f369
Kernel Version: 4.18.0-147.8.1.el8_1.x86_64
OS Image: Red Hat Enterprise Linux CoreOS 43.81.202005071438.0 (Ootpa)
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.16.6-14.dev.rhaos4.3.git24e5f4e.el8
Kubelet Version: v1.16.2
Kube-Proxy Version: v1.16.2
ProviderID: aws:///us-west-2a/i-04c7f3b0e8d5dadbc
Non-terminated Pods: (14 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
openshift-cluster-node-tuning-operator tuned-8bmpm 10m (0%) 0 (0%) 50Mi (0%) 0 (0%) 8h
openshift-dns dns-default-w847s 110m (7%) 0 (0%) 70Mi (1%) 512Mi (7%) 8h
openshift-image-registry node-ca-s2f4t 10m (0%) 0 (0%) 10Mi (0%) 0 (0%) 8h
openshift-ingress router-default-64d6bfff6b-hd85v 100m (6%) 0 (0%) 256Mi (3%) 0 (0%) 8h
openshift-machine-config-operator machine-config-daemon-mthbn 40m (2%) 0 (0%) 100Mi (1%) 0 (0%) 8h
openshift-marketplace redhat-operators-7fb8bf8f54-kz4gf 10m (0%) 0 (0%) 100Mi (1%) 0 (0%) 21m
openshift-monitoring alertmanager-main-1 110m (7%) 100m (6%) 245Mi (3%) 25Mi (0%) 8h
openshift-monitoring grafana-84b87cb67b-wl6c2 110m (7%) 0 (0%) 120Mi (1%) 0 (0%) 8h
openshift-monitoring node-exporter-8j999 112m (7%) 0 (0%) 200Mi (3%) 0 (0%) 8h
openshift-monitoring prometheus-adapter-7c4d459f9f-q7g6w 10m (0%) 0 (0%) 20Mi (0%) 0 (0%) 8h
openshift-monitoring prometheus-k8s-1 480m (32%) 200m (13%) 1234Mi (18%) 50Mi (0%) 8h
openshift-multus multus-swqwj 10m (0%) 0 (0%) 150Mi (2%) 0 (0%) 8h
openshift-sdn ovs-2s59p 200m (13%) 0 (0%) 400Mi (6%) 0 (0%) 8h
openshift-sdn sdn-jtgp8 100m (6%) 0 (0%) 200Mi (3%) 0 (0%) 8h
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 1412m (94%) 300m (20%)
memory 3155Mi (48%) 587Mi (8%)
ephemeral-storage 0 (0%) 0 (0%)
attachable-volumes-aws-ebs 0 0
Events: <none>
$ oc describe node/ip-10-0-159-58.us-west-2.compute.internal
Name: ip-10-0-159-58.us-west-2.compute.internal
Roles: worker
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/instance-type=m5.large
beta.kubernetes.io/os=linux
failure-domain.beta.kubernetes.io/region=us-west-2
failure-domain.beta.kubernetes.io/zone=us-west-2b
kubernetes.io/arch=amd64
kubernetes.io/hostname=ip-10-0-159-58
kubernetes.io/os=linux
node-role.kubernetes.io/worker=
node.openshift.io/os_id=rhcos
Annotations: machine.openshift.io/machine: openshift-machine-api/dhansen4319-v6zb2-worker-us-west-2b-w994w
machineconfiguration.openshift.io/currentConfig: rendered-worker-f45dfb50d90a2c4803923493d4fa9971
machineconfiguration.openshift.io/desiredConfig: rendered-worker-f45dfb50d90a2c4803923493d4fa9971
machineconfiguration.openshift.io/reason:
machineconfiguration.openshift.io/state: Done
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Thu, 18 Jun 2020 12:31:10 -0700
Taints: <none>
Unschedulable: false
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Thu, 18 Jun 2020 20:53:58 -0700 Thu, 18 Jun 2020 12:31:10 -0700 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Thu, 18 Jun 2020 20:53:58 -0700 Thu, 18 Jun 2020 12:31:10 -0700 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Thu, 18 Jun 2020 20:53:58 -0700 Thu, 18 Jun 2020 12:31:10 -0700 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Thu, 18 Jun 2020 20:53:58 -0700 Thu, 18 Jun 2020 12:32:20 -0700 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 10.0.159.58
Hostname: ip-10-0-159-58.us-west-2.compute.internal
InternalDNS: ip-10-0-159-58.us-west-2.compute.internal
Capacity:
attachable-volumes-aws-ebs: 25
cpu: 2
ephemeral-storage: 125277164Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 7861164Ki
pods: 250
Allocatable:
attachable-volumes-aws-ebs: 25
cpu: 1500m
ephemeral-storage: 114381692328
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 6710188Ki
pods: 250
System Info:
Machine ID: ec28946dbf6704c945998474d9fef77c
System UUID: ec28946d-bf67-04c9-4599-8474d9fef77c
Boot ID: af187c39-ff91-4d80-8a9d-3061dd3e9387
Kernel Version: 4.18.0-147.8.1.el8_1.x86_64
OS Image: Red Hat Enterprise Linux CoreOS 43.81.202005071438.0 (Ootpa)
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.16.6-14.dev.rhaos4.3.git24e5f4e.el8
Kubelet Version: v1.16.2
Kube-Proxy Version: v1.16.2
ProviderID: aws:///us-west-2b/i-0d3549f149999ee0f
Non-terminated Pods: (17 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
default network-check-9ffbdd476-8lp96 50m (3%) 300m (20%) 256Mi (3%) 500Mi (7%) 5h
openshift-cluster-node-tuning-operator tuned-whgnf 10m (0%) 0 (0%) 50Mi (0%) 0 (0%) 8h
openshift-dns dns-default-w2wsp 110m (7%) 0 (0%) 70Mi (1%) 512Mi (7%) 8h
openshift-image-registry image-registry-7b7b8c7494-9c555 100m (6%) 0 (0%) 256Mi (3%) 0 (0%) 8h
openshift-image-registry node-ca-fr6q2 10m (0%) 0 (0%) 10Mi (0%) 0 (0%) 8h
openshift-ingress router-default-64d6bfff6b-vt5k9 100m (6%) 0 (0%) 256Mi (3%) 0 (0%) 8h
openshift-machine-config-operator machine-config-daemon-v2rjk 40m (2%) 0 (0%) 100Mi (1%) 0 (0%) 8h
openshift-marketplace certified-operators-6df88f764c-t6dcx 10m (0%) 0 (0%) 100Mi (1%) 0 (0%) 8h
openshift-marketplace community-operators-984b4986-t6gnd 10m (0%) 0 (0%) 100Mi (1%) 0 (0%) 8h
openshift-monitoring alertmanager-main-2 110m (7%) 100m (6%) 245Mi (3%) 25Mi (0%) 8h
openshift-monitoring kube-state-metrics-7498bc479d-tlw6w 30m (2%) 0 (0%) 120Mi (1%) 0 (0%) 8h
openshift-monitoring node-exporter-xzkk9 112m (7%) 0 (0%) 200Mi (3%) 0 (0%) 8h
openshift-monitoring openshift-state-metrics-74997686f-h6644 120m (8%) 0 (0%) 190Mi (2%) 0 (0%) 8h
openshift-multus multus-dpvcm 10m (0%) 0 (0%) 150Mi (2%) 0 (0%) 8h
openshift-sdn ovs-xs29j 200m (13%) 0 (0%) 400Mi (6%) 0 (0%) 8h
openshift-sdn sdn-kqdrq 100m (6%) 0 (0%) 200Mi (3%) 0 (0%) 8h
openshift-user-workload-monitoring prometheus-user-workload-1 360m (24%) 200m (13%) 1194Mi (18%) 50Mi (0%) 4h34m
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 1482m (98%) 600m (40%)
memory 3897Mi (59%) 1087Mi (16%)
ephemeral-storage 0 (0%) 0 (0%)
attachable-volumes-aws-ebs 0 0
Events: <none>
$ oc describe node/ip-10-0-165-193.us-west-2.compute.internal
Name: ip-10-0-165-193.us-west-2.compute.internal
Roles: worker
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/instance-type=m5.large
beta.kubernetes.io/os=linux
failure-domain.beta.kubernetes.io/region=us-west-2
failure-domain.beta.kubernetes.io/zone=us-west-2c
kubernetes.io/arch=amd64
kubernetes.io/hostname=ip-10-0-165-193
kubernetes.io/os=linux
node-role.kubernetes.io/worker=
node.openshift.io/os_id=rhcos
Annotations: machine.openshift.io/machine: openshift-machine-api/dhansen4319-v6zb2-worker-us-west-2c-fjdb6
machineconfiguration.openshift.io/currentConfig: rendered-worker-f45dfb50d90a2c4803923493d4fa9971
machineconfiguration.openshift.io/desiredConfig: rendered-worker-f45dfb50d90a2c4803923493d4fa9971
machineconfiguration.openshift.io/reason:
machineconfiguration.openshift.io/state: Done
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Thu, 18 Jun 2020 12:31:30 -0700
Taints: <none>
Unschedulable: false
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Thu, 18 Jun 2020 20:54:35 -0700 Thu, 18 Jun 2020 12:31:30 -0700 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Thu, 18 Jun 2020 20:54:35 -0700 Thu, 18 Jun 2020 12:31:30 -0700 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Thu, 18 Jun 2020 20:54:35 -0700 Thu, 18 Jun 2020 12:31:30 -0700 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Thu, 18 Jun 2020 20:54:35 -0700 Thu, 18 Jun 2020 12:32:40 -0700 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 10.0.165.193
Hostname: ip-10-0-165-193.us-west-2.compute.internal
InternalDNS: ip-10-0-165-193.us-west-2.compute.internal
Capacity:
attachable-volumes-aws-ebs: 25
cpu: 2
ephemeral-storage: 125277164Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 7861180Ki
pods: 250
Allocatable:
attachable-volumes-aws-ebs: 25
cpu: 1500m
ephemeral-storage: 114381692328
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 6710204Ki
pods: 250
System Info:
Machine ID: ec2c7e84bd51928a5156ea8c50f7b5a5
System UUID: ec2c7e84-bd51-928a-5156-ea8c50f7b5a5
Boot ID: d38cb1e7-8cb4-4074-812b-616bde0a52c2
Kernel Version: 4.18.0-147.8.1.el8_1.x86_64
OS Image: Red Hat Enterprise Linux CoreOS 43.81.202005071438.0 (Ootpa)
Operating System: linux
Architecture: amd64
Container Runtime Version: cri-o://1.16.6-14.dev.rhaos4.3.git24e5f4e.el8
Kubelet Version: v1.16.2
Kube-Proxy Version: v1.16.2
ProviderID: aws:///us-west-2c/i-0366989207af75f1b
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits AGE
--------- ---- ------------ ---------- --------------- ------------- ---
openshift-cluster-node-tuning-operator tuned-qnm8m 10m (0%) 0 (0%) 50Mi (0%) 0 (0%) 8h
openshift-dns dns-default-nm2f8 110m (7%) 0 (0%) 70Mi (1%) 512Mi (7%) 8h
openshift-image-registry node-ca-tkd4x 10m (0%) 0 (0%) 10Mi (0%) 0 (0%) 8h
openshift-machine-config-operator machine-config-daemon-dsfw6 40m (2%) 0 (0%) 100Mi (1%) 0 (0%) 8h
openshift-monitoring alertmanager-main-0 110m (7%) 100m (6%) 245Mi (3%) 25Mi (0%) 8h
openshift-monitoring node-exporter-4nmxr 112m (7%) 0 (0%) 200Mi (3%) 0 (0%) 8h
openshift-monitoring prometheus-adapter-7c4d459f9f-nv7ks 10m (0%) 0 (0%) 20Mi (0%) 0 (0%) 8h
openshift-monitoring prometheus-k8s-0 480m (32%) 200m (13%) 1234Mi (18%) 50Mi (0%) 8h
openshift-monitoring telemeter-client-c655b6d69-tsk7z 10m (0%) 0 (0%) 20Mi (0%) 0 (0%) 8h
openshift-multus multus-rwxxz 10m (0%) 0 (0%) 150Mi (2%) 0 (0%) 8h
openshift-sdn ovs-dtwng 200m (13%) 0 (0%) 400Mi (6%) 0 (0%) 8h
openshift-sdn sdn-84nq4 100m (6%) 0 (0%) 200Mi (3%) 0 (0%) 8h
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 1202m (80%) 300m (20%)
memory 2699Mi (41%) 587Mi (8%)
ephemeral-storage 0 (0%) 0 (0%)
attachable-volumes-aws-ebs 0 0
Events: <none>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment