Skip to content

Instantly share code, notes, and snippets.

@billimek

billimek/descheduler.yaml

Created June 5, 2020 16:21
Show Gist options
  • Save billimek/1725d129e6018cdd3151befb31320374 to your computer and use it in GitHub Desktop.
Save billimek/1725d129e6018cdd3151befb31320374 to your computer and use it in GitHub Desktop.
Download ZIP
descheduler POST latency debugging
Raw
descheduler.yaml
apiVersion: apps/v1
kind: Deployment
metadata:
name: descheduler
namespace: kube-system
labels:
app: descheduler
spec:
replicas: 1
selector:
matchLabels:
name: descheduler
strategy:
type: Recreate
template:
metadata:
labels:
name: descheduler
spec:
priorityClassName: system-cluster-critical
containers:
- name: descheduler
image: us.gcr.io/k8s-artifacts-prod/descheduler/descheduler:v0.18.0
volumeMounts:
- mountPath: /policy-dir
name: policy-volume
command:
- "/bin/descheduler"
args:
- "--policy-config-file"
- "/policy-dir/policy.yaml"
- "--v"
- "8"
- "--descheduling-interval"
- "2m"
serviceAccountName: descheduler-sa
volumes:
- name: policy-volume
configMap:
name: descheduler-policy-configmap
Raw
k -n kube-system logs descheduler-95cdd8f8b-zhfwp
➜ k -n kube-system logs descheduler-95cdd8f8b-zhfwp
I0605 16:16:03.771743 1 round_trippers.go:443] GET https://10.43.0.1:443/api?timeout=32s 200 OK in 23 milliseconds
I0605 16:16:03.772985 1 round_trippers.go:443] GET https://10.43.0.1:443/apis?timeout=32s 200 OK in 0 milliseconds
I0605 16:16:03.774384 1 round_trippers.go:443] GET https://10.43.0.1:443/api/v1?timeout=32s 200 OK in 0 milliseconds
I0605 16:16:03.774914 1 node.go:45] node lister returned empty list, now fetch directly
I0605 16:16:03.778385 1 round_trippers.go:443] GET https://10.43.0.1:443/api/v1/nodes 200 OK in 3 milliseconds
I0605 16:16:03.784690 1 node_affinity.go:34] Executing for nodeAffinityType: requiredDuringSchedulingIgnoredDuringExecution
I0605 16:16:03.784732 1 node_affinity.go:39] Processing node: "k3s-0"
I0605 16:16:03.799336 1 round_trippers.go:443] GET https://10.43.0.1:443/api/v1/pods?fieldSelector=spec.nodeName%3Dk3s-0%2Cstatus.phase%21%3DFailed%2Cstatus.phase%21%3DSucceeded 200 OK in 14 milliseconds
I0605 16:16:03.816254 1 node_affinity.go:39] Processing node: "k3s-d"
I0605 16:16:03.828324 1 round_trippers.go:443] GET https://10.43.0.1:443/api/v1/pods?fieldSelector=spec.nodeName%3Dk3s-d%2Cstatus.phase%21%3DFailed%2Cstatus.phase%21%3DSucceeded 200 OK in 11 milliseconds
I0605 16:16:03.833091 1 node_affinity.go:39] Processing node: "k3s-b"
I0605 16:16:03.855001 1 round_trippers.go:443] GET https://10.43.0.1:443/api/v1/pods?fieldSelector=spec.nodeName%3Dk3s-b%2Cstatus.phase%21%3DFailed%2Cstatus.phase%21%3DSucceeded 200 OK in 21 milliseconds
I0605 16:16:03.869664 1 node_affinity.go:39] Processing node: "k3s-pi4-a"
I0605 16:16:03.886286 1 round_trippers.go:443] GET https://10.43.0.1:443/api/v1/pods?fieldSelector=spec.nodeName%3Dk3s-pi4-a%2Cstatus.phase%21%3DFailed%2Cstatus.phase%21%3DSucceeded 200 OK in 16 milliseconds
I0605 16:16:03.890304 1 node_affinity.go:39] Processing node: "k3s-pi4-b"
I0605 16:16:03.902503 1 round_trippers.go:443] GET https://10.43.0.1:443/api/v1/pods?fieldSelector=spec.nodeName%3Dk3s-pi4-b%2Cstatus.phase%21%3DFailed%2Cstatus.phase%21%3DSucceeded 200 OK in 11 milliseconds
I0605 16:16:03.907023 1 node_affinity.go:39] Processing node: "k3s-pi4-c"
I0605 16:16:03.920712 1 round_trippers.go:443] GET https://10.43.0.1:443/api/v1/pods?fieldSelector=spec.nodeName%3Dk3s-pi4-c%2Cstatus.phase%21%3DFailed%2Cstatus.phase%21%3DSucceeded 200 OK in 13 milliseconds
I0605 16:16:03.924116 1 node_affinity.go:39] Processing node: "k3s-c"
I0605 16:16:03.944202 1 round_trippers.go:443] GET https://10.43.0.1:443/api/v1/pods?fieldSelector=spec.nodeName%3Dk3s-c%2Cstatus.phase%21%3DFailed%2Cstatus.phase%21%3DSucceeded 200 OK in 19 milliseconds
I0605 16:16:03.971232 1 node_affinity.go:62] Evicted 0 pods
I0605 16:16:03.971455 1 node.go:45] node lister returned empty list, now fetch directly
I0605 16:16:03.976215 1 round_trippers.go:443] GET https://10.43.0.1:443/api/v1/nodes 200 OK in 4 milliseconds
I0605 16:16:03.978760 1 node_affinity.go:34] Executing for nodeAffinityType: requiredDuringSchedulingIgnoredDuringExecution
I0605 16:16:03.978794 1 node_affinity.go:39] Processing node: "k3s-0"
I0605 16:16:03.997940 1 round_trippers.go:443] GET https://10.43.0.1:443/api/v1/pods?fieldSelector=spec.nodeName%3Dk3s-0%2Cstatus.phase%21%3DFailed%2Cstatus.phase%21%3DSucceeded 200 OK in 19 milliseconds
I0605 16:16:04.008494 1 node_affinity.go:39] Processing node: "k3s-d"
I0605 16:16:04.022860 1 round_trippers.go:443] GET https://10.43.0.1:443/api/v1/pods?fieldSelector=spec.nodeName%3Dk3s-d%2Cstatus.phase%21%3DFailed%2Cstatus.phase%21%3DSucceeded 200 OK in 14 milliseconds
I0605 16:16:04.027764 1 node_affinity.go:39] Processing node: "k3s-b"
I0605 16:16:04.175124 1 request.go:557] Throttling request took 147.249748ms, request: GET:https://10.43.0.1:443/api/v1/pods?fieldSelector=spec.nodeName%3Dk3s-b%2Cstatus.phase%21%3DFailed%2Cstatus.phase%21%3DSucceeded
I0605 16:16:04.190361 1 round_trippers.go:443] GET https://10.43.0.1:443/api/v1/pods?fieldSelector=spec.nodeName%3Dk3s-b%2Cstatus.phase%21%3DFailed%2Cstatus.phase%21%3DSucceeded 200 OK in 15 milliseconds
I0605 16:16:04.202733 1 node_affinity.go:39] Processing node: "k3s-pi4-a"
I0605 16:16:04.375211 1 request.go:557] Throttling request took 172.343707ms, request: GET:https://10.43.0.1:443/api/v1/pods?fieldSelector=spec.nodeName%3Dk3s-pi4-a%2Cstatus.phase%21%3DFailed%2Cstatus.phase%21%3DSucceeded
I0605 16:16:04.390945 1 round_trippers.go:443] GET https://10.43.0.1:443/api/v1/pods?fieldSelector=spec.nodeName%3Dk3s-pi4-a%2Cstatus.phase%21%3DFailed%2Cstatus.phase%21%3DSucceeded 200 OK in 15 milliseconds
I0605 16:16:04.394500 1 node_affinity.go:39] Processing node: "k3s-pi4-b"
I0605 16:16:04.575103 1 request.go:557] Throttling request took 180.498849ms, request: GET:https://10.43.0.1:443/api/v1/pods?fieldSelector=spec.nodeName%3Dk3s-pi4-b%2Cstatus.phase%21%3DFailed%2Cstatus.phase%21%3DSucceeded
I0605 16:16:04.589241 1 round_trippers.go:443] GET https://10.43.0.1:443/api/v1/pods?fieldSelector=spec.nodeName%3Dk3s-pi4-b%2Cstatus.phase%21%3DFailed%2Cstatus.phase%21%3DSucceeded 200 OK in 13 milliseconds
I0605 16:16:04.592430 1 node_affinity.go:39] Processing node: "k3s-pi4-c"
I0605 16:16:04.775163 1 request.go:557] Throttling request took 182.570499ms, request: GET:https://10.43.0.1:443/api/v1/pods?fieldSelector=spec.nodeName%3Dk3s-pi4-c%2Cstatus.phase%21%3DFailed%2Cstatus.phase%21%3DSucceeded
I0605 16:16:04.788239 1 round_trippers.go:443] GET https://10.43.0.1:443/api/v1/pods?fieldSelector=spec.nodeName%3Dk3s-pi4-c%2Cstatus.phase%21%3DFailed%2Cstatus.phase%21%3DSucceeded 200 OK in 12 milliseconds
I0605 16:16:04.795355 1 node_affinity.go:39] Processing node: "k3s-c"
I0605 16:16:04.975173 1 request.go:557] Throttling request took 179.653094ms, request: GET:https://10.43.0.1:443/api/v1/pods?fieldSelector=spec.nodeName%3Dk3s-c%2Cstatus.phase%21%3DFailed%2Cstatus.phase%21%3DSucceeded
I0605 16:16:04.993507 1 round_trippers.go:443] GET https://10.43.0.1:443/api/v1/pods?fieldSelector=spec.nodeName%3Dk3s-c%2Cstatus.phase%21%3DFailed%2Cstatus.phase%21%3DSucceeded 200 OK in 18 milliseconds
I0605 16:16:05.008293 1 node_affinity.go:62] Evicted 0 pods
I0605 16:18:05.008620 1 node.go:45] node lister returned empty list, now fetch directly
I0605 16:18:05.016430 1 round_trippers.go:443] GET https://10.43.0.1:443/api/v1/nodes 200 OK in 6 milliseconds
I0605 16:18:05.019164 1 node_affinity.go:34] Executing for nodeAffinityType: requiredDuringSchedulingIgnoredDuringExecution
I0605 16:18:05.019195 1 node_affinity.go:39] Processing node: "k3s-d"
I0605 16:18:05.031083 1 round_trippers.go:443] GET https://10.43.0.1:443/api/v1/pods?fieldSelector=spec.nodeName%3Dk3s-d%2Cstatus.phase%21%3DFailed%2Cstatus.phase%21%3DSucceeded 200 OK in 11 milliseconds
I0605 16:18:05.035430 1 node_affinity.go:39] Processing node: "k3s-b"
I0605 16:18:05.050221 1 round_trippers.go:443] GET https://10.43.0.1:443/api/v1/pods?fieldSelector=spec.nodeName%3Dk3s-b%2Cstatus.phase%21%3DFailed%2Cstatus.phase%21%3DSucceeded 200 OK in 14 milliseconds
I0605 16:18:05.062412 1 node_affinity.go:39] Processing node: "k3s-pi4-a"
I0605 16:18:05.074932 1 round_trippers.go:443] GET https://10.43.0.1:443/api/v1/pods?fieldSelector=spec.nodeName%3Dk3s-pi4-a%2Cstatus.phase%21%3DFailed%2Cstatus.phase%21%3DSucceeded 200 OK in 12 milliseconds
I0605 16:18:05.078677 1 node_affinity.go:39] Processing node: "k3s-pi4-b"
I0605 16:18:05.090754 1 round_trippers.go:443] GET https://10.43.0.1:443/api/v1/pods?fieldSelector=spec.nodeName%3Dk3s-pi4-b%2Cstatus.phase%21%3DFailed%2Cstatus.phase%21%3DSucceeded 200 OK in 11 milliseconds
I0605 16:18:05.095801 1 node_affinity.go:39] Processing node: "k3s-pi4-c"
I0605 16:18:05.107573 1 round_trippers.go:443] GET https://10.43.0.1:443/api/v1/pods?fieldSelector=spec.nodeName%3Dk3s-pi4-c%2Cstatus.phase%21%3DFailed%2Cstatus.phase%21%3DSucceeded 200 OK in 11 milliseconds
I0605 16:18:05.110537 1 node_affinity.go:39] Processing node: "k3s-c"
I0605 16:18:05.126416 1 round_trippers.go:443] GET https://10.43.0.1:443/api/v1/pods?fieldSelector=spec.nodeName%3Dk3s-c%2Cstatus.phase%21%3DFailed%2Cstatus.phase%21%3DSucceeded 200 OK in 15 milliseconds
I0605 16:18:05.140270 1 node_affinity.go:39] Processing node: "k3s-0"
I0605 16:18:05.153865 1 round_trippers.go:443] GET https://10.43.0.1:443/api/v1/pods?fieldSelector=spec.nodeName%3Dk3s-0%2Cstatus.phase%21%3DFailed%2Cstatus.phase%21%3DSucceeded 200 OK in 13 milliseconds
I0605 16:18:05.166012 1 node_affinity.go:62] Evicted 0 pods
I0605 16:20:05.167943 1 node.go:45] node lister returned empty list, now fetch directly
I0605 16:20:05.174410 1 round_trippers.go:443] GET https://10.43.0.1:443/api/v1/nodes 200 OK in 5 milliseconds
I0605 16:20:05.177198 1 node_affinity.go:34] Executing for nodeAffinityType: requiredDuringSchedulingIgnoredDuringExecution
I0605 16:20:05.177223 1 node_affinity.go:39] Processing node: "k3s-0"
I0605 16:20:05.192530 1 round_trippers.go:443] GET https://10.43.0.1:443/api/v1/pods?fieldSelector=spec.nodeName%3Dk3s-0%2Cstatus.phase%21%3DFailed%2Cstatus.phase%21%3DSucceeded 200 OK in 15 milliseconds
I0605 16:20:05.200916 1 node_affinity.go:39] Processing node: "k3s-d"
I0605 16:20:05.213116 1 round_trippers.go:443] GET https://10.43.0.1:443/api/v1/pods?fieldSelector=spec.nodeName%3Dk3s-d%2Cstatus.phase%21%3DFailed%2Cstatus.phase%21%3DSucceeded 200 OK in 12 milliseconds
I0605 16:20:05.217496 1 node_affinity.go:39] Processing node: "k3s-b"
I0605 16:20:05.247620 1 round_trippers.go:443] GET https://10.43.0.1:443/api/v1/pods?fieldSelector=spec.nodeName%3Dk3s-b%2Cstatus.phase%21%3DFailed%2Cstatus.phase%21%3DSucceeded 200 OK in 30 milliseconds
I0605 16:20:05.258083 1 node_affinity.go:39] Processing node: "k3s-pi4-a"
I0605 16:20:05.270134 1 round_trippers.go:443] GET https://10.43.0.1:443/api/v1/pods?fieldSelector=spec.nodeName%3Dk3s-pi4-a%2Cstatus.phase%21%3DFailed%2Cstatus.phase%21%3DSucceeded 200 OK in 11 milliseconds
I0605 16:20:05.273144 1 node_affinity.go:39] Processing node: "k3s-pi4-b"
I0605 16:20:05.285516 1 round_trippers.go:443] GET https://10.43.0.1:443/api/v1/pods?fieldSelector=spec.nodeName%3Dk3s-pi4-b%2Cstatus.phase%21%3DFailed%2Cstatus.phase%21%3DSucceeded 200 OK in 12 milliseconds
I0605 16:20:05.289166 1 node_affinity.go:39] Processing node: "k3s-pi4-c"
I0605 16:20:05.300695 1 round_trippers.go:443] GET https://10.43.0.1:443/api/v1/pods?fieldSelector=spec.nodeName%3Dk3s-pi4-c%2Cstatus.phase%21%3DFailed%2Cstatus.phase%21%3DSucceeded 200 OK in 11 milliseconds
I0605 16:20:05.303563 1 node_affinity.go:39] Processing node: "k3s-c"
I0605 16:20:05.319398 1 round_trippers.go:443] GET https://10.43.0.1:443/api/v1/pods?fieldSelector=spec.nodeName%3Dk3s-c%2Cstatus.phase%21%3DFailed%2Cstatus.phase%21%3DSucceeded 200 OK in 15 milliseconds
I0605 16:20:05.332771 1 node_affinity.go:62] Evicted 0 pods
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment