Skip to content

Instantly share code, notes, and snippets.

@vadasambar
Created December 5, 2023 17:51
Show Gist options
  • Save vadasambar/56ac07f2eedbd97e5d8aaa1424df3481 to your computer and use it in GitHub Desktop.
Save vadasambar/56ac07f2eedbd97e5d8aaa1424df3481 to your computer and use it in GitHub Desktop.
reproduce `fix panic when scale down node group`: https://github.com/kubernetes/autoscaler/pull/6336
I1205 23:15:15.096093 116597 main.go:565] Cluster Autoscaler 1.28.0
I1205 23:15:15.096363 116597 client.go:47] Using kubeconfig file: /home/suraj/.kube/config
I1205 23:15:15.141556 116597 cloud_provider_builder.go:30] Building kwok cloud provider.
I1205 23:15:15.142714 116597 kwok_config.go:64] env variable 'KWOK_PROVIDER_CONFIGMAP' is empty (defaulting to 'kwok-provider-config')
I1205 23:15:15.142721 116597 kwok_config.go:56] got current pod namespace 'default'
I1205 23:15:15.144251 116597 kwok_config.go:56] got current pod namespace 'default'
I1205 23:15:15.147230 116597 reflector.go:289] Starting reflector *v1.StorageClass (0s) from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.147233 116597 reflector.go:289] Starting reflector *v1.PersistentVolume (0s) from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.147241 116597 reflector.go:325] Listing and watching *v1.StorageClass from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.147241 116597 reflector.go:325] Listing and watching *v1.PersistentVolume from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.147248 116597 reflector.go:289] Starting reflector *v1.PodDisruptionBudget (0s) from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.147266 116597 reflector.go:325] Listing and watching *v1.PodDisruptionBudget from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.147269 116597 reflector.go:289] Starting reflector *v1.CSIDriver (0s) from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.147286 116597 reflector.go:325] Listing and watching *v1.CSIDriver from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.147286 116597 reflector.go:289] Starting reflector *v1.ReplicationController (0s) from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.147301 116597 reflector.go:325] Listing and watching *v1.ReplicationController from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.147296 116597 reflector.go:289] Starting reflector *v1.ReplicaSet (0s) from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.147308 116597 reflector.go:325] Listing and watching *v1.ReplicaSet from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.147560 116597 reflector.go:289] Starting reflector *v1.StatefulSet (0s) from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.147571 116597 reflector.go:325] Listing and watching *v1.StatefulSet from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.147563 116597 reflector.go:289] Starting reflector *v1.CSIStorageCapacity (0s) from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.147583 116597 main.go:399] Registered cleanup signal handler
I1205 23:15:15.147587 116597 reflector.go:325] Listing and watching *v1.CSIStorageCapacity from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.147612 116597 node_instances_cache.go:156] Start refreshing cloud provider node instances cache
I1205 23:15:15.147603 116597 reflector.go:289] Starting reflector *v1.DaemonSet (0s) from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.147622 116597 reflector.go:325] Listing and watching *v1.DaemonSet from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.147610 116597 reflector.go:289] Starting reflector *v1.Namespace (0s) from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.147630 116597 reflector.go:325] Listing and watching *v1.Namespace from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.147621 116597 reflector.go:289] Starting reflector *v1.PersistentVolumeClaim (0s) from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.147648 116597 reflector.go:325] Listing and watching *v1.PersistentVolumeClaim from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.147691 116597 reflector.go:289] Starting reflector *v1.Pod (0s) from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.147700 116597 reflector.go:325] Listing and watching *v1.Pod from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.147560 116597 reflector.go:289] Starting reflector *v1.Job (0s) from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.147717 116597 reflector.go:325] Listing and watching *v1.Job from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.147731 116597 reflector.go:289] Starting reflector *v1.Node (0s) from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.147738 116597 reflector.go:325] Listing and watching *v1.Node from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.147622 116597 node_instances_cache.go:168] Refresh cloud provider node instances cache finished, refresh took 4.921µs
I1205 23:15:15.147881 116597 reflector.go:289] Starting reflector *v1.CSINode (0s) from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.147887 116597 reflector.go:325] Listing and watching *v1.CSINode from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.147953 116597 reflector.go:289] Starting reflector *v1.Service (0s) from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.147960 116597 reflector.go:325] Listing and watching *v1.Service from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.148629 116597 reflector.go:351] Caches populated for *v1.StorageClass from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.149955 116597 reflector.go:351] Caches populated for *v1.ReplicationController from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.150201 116597 reflector.go:351] Caches populated for *v1.CSIStorageCapacity from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.150783 116597 reflector.go:351] Caches populated for *v1.StatefulSet from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.150903 116597 reflector.go:351] Caches populated for *v1.PersistentVolumeClaim from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.150924 116597 reflector.go:351] Caches populated for *v1.Namespace from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.151023 116597 reflector.go:351] Caches populated for *v1.Service from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.151142 116597 reflector.go:351] Caches populated for *v1.Job from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.151174 116597 reflector.go:351] Caches populated for *v1.PodDisruptionBudget from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.151289 116597 reflector.go:351] Caches populated for *v1.CSINode from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.151433 116597 reflector.go:351] Caches populated for *v1.DaemonSet from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.151455 116597 reflector.go:351] Caches populated for *v1.PersistentVolume from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.151500 116597 reflector.go:351] Caches populated for *v1.ReplicaSet from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.151899 116597 reflector.go:351] Caches populated for *v1.Pod from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.151945 116597 reflector.go:351] Caches populated for *v1.CSIDriver from k8s.io/client-go/informers/factory.go:159
I1205 23:15:15.153040 116597 reflector.go:351] Caches populated for *v1.Node from k8s.io/client-go/informers/factory.go:159
I1205 23:15:18.148432 116597 static_autoscaler.go:290] Starting main loop
I1205 23:15:18.148562 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
W1205 23:15:18.148642 116597 clusterstate.go:454] AcceptableRanges have not been populated yet. Skip checking
I1205 23:15:18.148648 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:18.148692 116597 filter_out_schedulable.go:63] Filtering out schedulables
I1205 23:15:18.148699 116597 filter_out_schedulable.go:120] 0 pods marked as unschedulable can be scheduled.
I1205 23:15:18.148740 116597 filter_out_schedulable.go:83] No schedulable pods
I1205 23:15:18.148744 116597 filter_out_daemon_sets.go:40] Filtering out daemon set pods
I1205 23:15:18.148748 116597 filter_out_daemon_sets.go:49] Filtered out 0 daemon set pods, 0 unschedulable pods left
I1205 23:15:18.148766 116597 static_autoscaler.go:547] No unschedulable pods
I1205 23:15:18.148784 116597 static_autoscaler.go:570] Calculating unneeded nodes
I1205 23:15:18.148790 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:18.148803 116597 pre_filtering_processor.go:57] Node kind-control-plane should not be processed by cluster autoscaler (no node group config)
I1205 23:15:18.148852 116597 static_autoscaler.go:617] Scale down status: lastScaleUpTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownDeleteTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownFailTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 scaleDownForbidden=false scaleDownInCooldown=false
I1205 23:15:18.148887 116597 static_autoscaler.go:642] Starting scale down
I1205 23:15:21.199779 116597 static_autoscaler.go:290] Starting main loop
I1205 23:15:21.199908 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:21.199997 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:21.200021 116597 filter_out_schedulable.go:63] Filtering out schedulables
I1205 23:15:21.200027 116597 filter_out_schedulable.go:120] 0 pods marked as unschedulable can be scheduled.
I1205 23:15:21.200033 116597 filter_out_schedulable.go:83] No schedulable pods
I1205 23:15:21.200037 116597 filter_out_daemon_sets.go:40] Filtering out daemon set pods
I1205 23:15:21.200040 116597 filter_out_daemon_sets.go:49] Filtered out 0 daemon set pods, 0 unschedulable pods left
I1205 23:15:21.200057 116597 static_autoscaler.go:547] No unschedulable pods
I1205 23:15:21.200073 116597 static_autoscaler.go:570] Calculating unneeded nodes
I1205 23:15:21.200077 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:21.200082 116597 pre_filtering_processor.go:57] Node kind-control-plane should not be processed by cluster autoscaler (no node group config)
I1205 23:15:21.200110 116597 static_autoscaler.go:617] Scale down status: lastScaleUpTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownDeleteTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownFailTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 scaleDownForbidden=false scaleDownInCooldown=false
I1205 23:15:21.200139 116597 static_autoscaler.go:642] Starting scale down
I1205 23:15:24.276932 116597 static_autoscaler.go:290] Starting main loop
I1205 23:15:24.277164 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:24.277337 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:24.277376 116597 filter_out_schedulable.go:63] Filtering out schedulables
I1205 23:15:24.277386 116597 filter_out_schedulable.go:120] 0 pods marked as unschedulable can be scheduled.
I1205 23:15:24.277397 116597 filter_out_schedulable.go:83] No schedulable pods
I1205 23:15:24.277402 116597 filter_out_daemon_sets.go:40] Filtering out daemon set pods
I1205 23:15:24.277407 116597 filter_out_daemon_sets.go:49] Filtered out 0 daemon set pods, 0 unschedulable pods left
I1205 23:15:24.277437 116597 static_autoscaler.go:547] No unschedulable pods
I1205 23:15:24.277466 116597 static_autoscaler.go:570] Calculating unneeded nodes
I1205 23:15:24.277474 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:24.277482 116597 pre_filtering_processor.go:57] Node kind-control-plane should not be processed by cluster autoscaler (no node group config)
I1205 23:15:24.277533 116597 static_autoscaler.go:617] Scale down status: lastScaleUpTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownDeleteTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownFailTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 scaleDownForbidden=false scaleDownInCooldown=false
I1205 23:15:24.277583 116597 static_autoscaler.go:642] Starting scale down
I1205 23:15:27.294219 116597 static_autoscaler.go:290] Starting main loop
I1205 23:15:27.294570 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:27.294817 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:27.294896 116597 filter_out_schedulable.go:63] Filtering out schedulables
I1205 23:15:27.294913 116597 filter_out_schedulable.go:120] 0 pods marked as unschedulable can be scheduled.
I1205 23:15:27.294932 116597 filter_out_schedulable.go:83] No schedulable pods
I1205 23:15:27.294942 116597 filter_out_daemon_sets.go:40] Filtering out daemon set pods
I1205 23:15:27.294953 116597 filter_out_daemon_sets.go:49] Filtered out 0 daemon set pods, 0 unschedulable pods left
I1205 23:15:27.295012 116597 static_autoscaler.go:547] No unschedulable pods
I1205 23:15:27.295068 116597 static_autoscaler.go:570] Calculating unneeded nodes
I1205 23:15:27.295083 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:27.295104 116597 pre_filtering_processor.go:57] Node kind-control-plane should not be processed by cluster autoscaler (no node group config)
I1205 23:15:27.295196 116597 static_autoscaler.go:617] Scale down status: lastScaleUpTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownDeleteTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownFailTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 scaleDownForbidden=false scaleDownInCooldown=false
I1205 23:15:27.295285 116597 static_autoscaler.go:642] Starting scale down
I1205 23:15:30.346183 116597 static_autoscaler.go:290] Starting main loop
I1205 23:15:30.346354 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:30.346451 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:30.346480 116597 filter_out_schedulable.go:63] Filtering out schedulables
I1205 23:15:30.346487 116597 filter_out_schedulable.go:120] 0 pods marked as unschedulable can be scheduled.
I1205 23:15:30.346494 116597 filter_out_schedulable.go:83] No schedulable pods
I1205 23:15:30.346498 116597 filter_out_daemon_sets.go:40] Filtering out daemon set pods
I1205 23:15:30.346501 116597 filter_out_daemon_sets.go:49] Filtered out 0 daemon set pods, 0 unschedulable pods left
I1205 23:15:30.346521 116597 static_autoscaler.go:547] No unschedulable pods
I1205 23:15:30.346541 116597 static_autoscaler.go:570] Calculating unneeded nodes
I1205 23:15:30.346546 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:30.346553 116597 pre_filtering_processor.go:57] Node kind-control-plane should not be processed by cluster autoscaler (no node group config)
I1205 23:15:30.346586 116597 static_autoscaler.go:617] Scale down status: lastScaleUpTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownDeleteTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownFailTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 scaleDownForbidden=false scaleDownInCooldown=false
I1205 23:15:30.346621 116597 static_autoscaler.go:642] Starting scale down
I1205 23:15:33.412067 116597 static_autoscaler.go:290] Starting main loop
I1205 23:15:33.412329 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:33.412624 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:33.412692 116597 filter_out_schedulable.go:63] Filtering out schedulables
I1205 23:15:33.412711 116597 filter_out_schedulable.go:120] 0 pods marked as unschedulable can be scheduled.
I1205 23:15:33.412730 116597 filter_out_schedulable.go:83] No schedulable pods
I1205 23:15:33.412740 116597 filter_out_daemon_sets.go:40] Filtering out daemon set pods
I1205 23:15:33.412751 116597 filter_out_daemon_sets.go:49] Filtered out 0 daemon set pods, 0 unschedulable pods left
I1205 23:15:33.412812 116597 static_autoscaler.go:547] No unschedulable pods
I1205 23:15:33.412869 116597 static_autoscaler.go:570] Calculating unneeded nodes
I1205 23:15:33.412882 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:33.412897 116597 pre_filtering_processor.go:57] Node kind-control-plane should not be processed by cluster autoscaler (no node group config)
I1205 23:15:33.412989 116597 static_autoscaler.go:617] Scale down status: lastScaleUpTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownDeleteTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownFailTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 scaleDownForbidden=false scaleDownInCooldown=false
I1205 23:15:33.413077 116597 static_autoscaler.go:642] Starting scale down
I1205 23:15:36.430290 116597 static_autoscaler.go:290] Starting main loop
I1205 23:15:36.430440 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:36.430553 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:36.430602 116597 filter_out_schedulable.go:63] Filtering out schedulables
I1205 23:15:36.430614 116597 filter_out_schedulable.go:120] 0 pods marked as unschedulable can be scheduled.
I1205 23:15:36.430623 116597 filter_out_schedulable.go:83] No schedulable pods
I1205 23:15:36.430630 116597 filter_out_daemon_sets.go:40] Filtering out daemon set pods
I1205 23:15:36.430635 116597 filter_out_daemon_sets.go:49] Filtered out 0 daemon set pods, 0 unschedulable pods left
I1205 23:15:36.430658 116597 static_autoscaler.go:547] No unschedulable pods
I1205 23:15:36.430680 116597 static_autoscaler.go:570] Calculating unneeded nodes
I1205 23:15:36.430686 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:36.430692 116597 pre_filtering_processor.go:57] Node kind-control-plane should not be processed by cluster autoscaler (no node group config)
I1205 23:15:36.430731 116597 static_autoscaler.go:617] Scale down status: lastScaleUpTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownDeleteTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownFailTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 scaleDownForbidden=false scaleDownInCooldown=false
I1205 23:15:36.430766 116597 static_autoscaler.go:642] Starting scale down
I1205 23:15:39.521724 116597 static_autoscaler.go:290] Starting main loop
I1205 23:15:39.522124 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:39.522520 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:39.522626 116597 filter_out_schedulable.go:63] Filtering out schedulables
I1205 23:15:39.522653 116597 filter_out_schedulable.go:120] 0 pods marked as unschedulable can be scheduled.
I1205 23:15:39.522683 116597 filter_out_schedulable.go:83] No schedulable pods
I1205 23:15:39.522710 116597 filter_out_daemon_sets.go:40] Filtering out daemon set pods
I1205 23:15:39.522728 116597 filter_out_daemon_sets.go:49] Filtered out 0 daemon set pods, 0 unschedulable pods left
I1205 23:15:39.522829 116597 static_autoscaler.go:547] No unschedulable pods
I1205 23:15:39.522927 116597 static_autoscaler.go:570] Calculating unneeded nodes
I1205 23:15:39.522952 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:39.522977 116597 pre_filtering_processor.go:57] Node kind-control-plane should not be processed by cluster autoscaler (no node group config)
I1205 23:15:39.523119 116597 static_autoscaler.go:617] Scale down status: lastScaleUpTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownDeleteTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownFailTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 scaleDownForbidden=false scaleDownInCooldown=false
I1205 23:15:39.523259 116597 static_autoscaler.go:642] Starting scale down
I1205 23:15:42.584934 116597 static_autoscaler.go:290] Starting main loop
I1205 23:15:42.585065 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:42.585167 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:42.585195 116597 filter_out_schedulable.go:63] Filtering out schedulables
I1205 23:15:42.585201 116597 filter_out_schedulable.go:120] 0 pods marked as unschedulable can be scheduled.
I1205 23:15:42.585208 116597 filter_out_schedulable.go:83] No schedulable pods
I1205 23:15:42.585213 116597 filter_out_daemon_sets.go:40] Filtering out daemon set pods
I1205 23:15:42.585217 116597 filter_out_daemon_sets.go:49] Filtered out 0 daemon set pods, 0 unschedulable pods left
I1205 23:15:42.585236 116597 static_autoscaler.go:547] No unschedulable pods
I1205 23:15:42.585255 116597 static_autoscaler.go:570] Calculating unneeded nodes
I1205 23:15:42.585260 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:42.585265 116597 pre_filtering_processor.go:57] Node kind-control-plane should not be processed by cluster autoscaler (no node group config)
I1205 23:15:42.585298 116597 static_autoscaler.go:617] Scale down status: lastScaleUpTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownDeleteTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownFailTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 scaleDownForbidden=false scaleDownInCooldown=false
I1205 23:15:42.585336 116597 static_autoscaler.go:642] Starting scale down
I1205 23:15:45.653762 116597 static_autoscaler.go:290] Starting main loop
I1205 23:15:45.654037 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:45.654306 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:45.654373 116597 filter_out_schedulable.go:63] Filtering out schedulables
I1205 23:15:45.654391 116597 filter_out_schedulable.go:120] 0 pods marked as unschedulable can be scheduled.
I1205 23:15:45.654410 116597 filter_out_schedulable.go:83] No schedulable pods
I1205 23:15:45.654427 116597 filter_out_daemon_sets.go:40] Filtering out daemon set pods
I1205 23:15:45.654437 116597 filter_out_daemon_sets.go:49] Filtered out 0 daemon set pods, 0 unschedulable pods left
I1205 23:15:45.654497 116597 static_autoscaler.go:547] No unschedulable pods
I1205 23:15:45.654554 116597 static_autoscaler.go:570] Calculating unneeded nodes
I1205 23:15:45.654569 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:45.654584 116597 pre_filtering_processor.go:57] Node kind-control-plane should not be processed by cluster autoscaler (no node group config)
I1205 23:15:45.654674 116597 static_autoscaler.go:617] Scale down status: lastScaleUpTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownDeleteTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownFailTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 scaleDownForbidden=false scaleDownInCooldown=false
I1205 23:15:45.654763 116597 static_autoscaler.go:642] Starting scale down
I1205 23:15:48.683780 116597 static_autoscaler.go:290] Starting main loop
I1205 23:15:48.684537 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:48.685069 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:48.685221 116597 filter_out_schedulable.go:63] Filtering out schedulables
I1205 23:15:48.685251 116597 filter_out_schedulable.go:120] 0 pods marked as unschedulable can be scheduled.
I1205 23:15:48.685279 116597 filter_out_schedulable.go:83] No schedulable pods
I1205 23:15:48.685294 116597 filter_out_daemon_sets.go:40] Filtering out daemon set pods
I1205 23:15:48.685299 116597 filter_out_daemon_sets.go:49] Filtered out 0 daemon set pods, 0 unschedulable pods left
I1205 23:15:48.685349 116597 static_autoscaler.go:547] No unschedulable pods
I1205 23:15:48.685365 116597 static_autoscaler.go:570] Calculating unneeded nodes
I1205 23:15:48.685385 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:48.685402 116597 pre_filtering_processor.go:57] Node kind-control-plane should not be processed by cluster autoscaler (no node group config)
I1205 23:15:48.685508 116597 static_autoscaler.go:617] Scale down status: lastScaleUpTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownDeleteTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownFailTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 scaleDownForbidden=false scaleDownInCooldown=false
I1205 23:15:48.685569 116597 static_autoscaler.go:642] Starting scale down
I1205 23:15:51.784900 116597 static_autoscaler.go:290] Starting main loop
I1205 23:15:51.785196 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:51.785465 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:51.785533 116597 filter_out_schedulable.go:63] Filtering out schedulables
I1205 23:15:51.785550 116597 filter_out_schedulable.go:120] 0 pods marked as unschedulable can be scheduled.
I1205 23:15:51.785578 116597 filter_out_schedulable.go:83] No schedulable pods
I1205 23:15:51.785589 116597 filter_out_daemon_sets.go:40] Filtering out daemon set pods
I1205 23:15:51.785599 116597 filter_out_daemon_sets.go:49] Filtered out 0 daemon set pods, 0 unschedulable pods left
I1205 23:15:51.785684 116597 static_autoscaler.go:547] No unschedulable pods
I1205 23:15:51.785742 116597 static_autoscaler.go:570] Calculating unneeded nodes
I1205 23:15:51.785758 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:51.785775 116597 pre_filtering_processor.go:57] Node kind-control-plane should not be processed by cluster autoscaler (no node group config)
I1205 23:15:51.785868 116597 static_autoscaler.go:617] Scale down status: lastScaleUpTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownDeleteTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownFailTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 scaleDownForbidden=false scaleDownInCooldown=false
I1205 23:15:51.785958 116597 static_autoscaler.go:642] Starting scale down
I1205 23:15:54.840072 116597 static_autoscaler.go:290] Starting main loop
I1205 23:15:54.840384 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:54.840629 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:54.840705 116597 filter_out_schedulable.go:63] Filtering out schedulables
I1205 23:15:54.840724 116597 filter_out_schedulable.go:120] 0 pods marked as unschedulable can be scheduled.
I1205 23:15:54.840743 116597 filter_out_schedulable.go:83] No schedulable pods
I1205 23:15:54.840755 116597 filter_out_daemon_sets.go:40] Filtering out daemon set pods
I1205 23:15:54.840766 116597 filter_out_daemon_sets.go:49] Filtered out 0 daemon set pods, 0 unschedulable pods left
I1205 23:15:54.840825 116597 static_autoscaler.go:547] No unschedulable pods
I1205 23:15:54.840882 116597 static_autoscaler.go:570] Calculating unneeded nodes
I1205 23:15:54.840898 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:54.840913 116597 pre_filtering_processor.go:57] Node kind-control-plane should not be processed by cluster autoscaler (no node group config)
I1205 23:15:54.841004 116597 static_autoscaler.go:617] Scale down status: lastScaleUpTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownDeleteTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownFailTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 scaleDownForbidden=false scaleDownInCooldown=false
I1205 23:15:54.841102 116597 static_autoscaler.go:642] Starting scale down
I1205 23:15:57.862149 116597 static_autoscaler.go:290] Starting main loop
I1205 23:15:57.862474 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:57.862696 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:57.862752 116597 filter_out_schedulable.go:63] Filtering out schedulables
I1205 23:15:57.862766 116597 filter_out_schedulable.go:120] 0 pods marked as unschedulable can be scheduled.
I1205 23:15:57.862782 116597 filter_out_schedulable.go:83] No schedulable pods
I1205 23:15:57.862790 116597 filter_out_daemon_sets.go:40] Filtering out daemon set pods
I1205 23:15:57.862797 116597 filter_out_daemon_sets.go:49] Filtered out 0 daemon set pods, 0 unschedulable pods left
I1205 23:15:57.862841 116597 static_autoscaler.go:547] No unschedulable pods
I1205 23:15:57.862883 116597 static_autoscaler.go:570] Calculating unneeded nodes
I1205 23:15:57.862894 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:15:57.862906 116597 pre_filtering_processor.go:57] Node kind-control-plane should not be processed by cluster autoscaler (no node group config)
I1205 23:15:57.862976 116597 static_autoscaler.go:617] Scale down status: lastScaleUpTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownDeleteTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownFailTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 scaleDownForbidden=false scaleDownInCooldown=false
I1205 23:15:57.863045 116597 static_autoscaler.go:642] Starting scale down
I1205 23:16:00.890446 116597 static_autoscaler.go:290] Starting main loop
I1205 23:16:00.890775 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:00.891111 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:00.891190 116597 filter_out_schedulable.go:63] Filtering out schedulables
I1205 23:16:00.891210 116597 filter_out_schedulable.go:120] 0 pods marked as unschedulable can be scheduled.
I1205 23:16:00.891231 116597 filter_out_schedulable.go:83] No schedulable pods
I1205 23:16:00.891241 116597 filter_out_daemon_sets.go:40] Filtering out daemon set pods
I1205 23:16:00.891254 116597 filter_out_daemon_sets.go:49] Filtered out 0 daemon set pods, 0 unschedulable pods left
I1205 23:16:00.891313 116597 static_autoscaler.go:547] No unschedulable pods
I1205 23:16:00.891371 116597 static_autoscaler.go:570] Calculating unneeded nodes
I1205 23:16:00.891386 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:00.891401 116597 pre_filtering_processor.go:57] Node kind-control-plane should not be processed by cluster autoscaler (no node group config)
I1205 23:16:00.891494 116597 static_autoscaler.go:617] Scale down status: lastScaleUpTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownDeleteTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownFailTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 scaleDownForbidden=false scaleDownInCooldown=false
I1205 23:16:00.891583 116597 static_autoscaler.go:642] Starting scale down
I1205 23:16:03.904737 116597 static_autoscaler.go:290] Starting main loop
I1205 23:16:03.904839 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:03.904905 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:03.904929 116597 filter_out_schedulable.go:63] Filtering out schedulables
I1205 23:16:03.904935 116597 filter_out_schedulable.go:120] 0 pods marked as unschedulable can be scheduled.
I1205 23:16:03.904939 116597 filter_out_schedulable.go:83] No schedulable pods
I1205 23:16:03.904942 116597 filter_out_daemon_sets.go:40] Filtering out daemon set pods
I1205 23:16:03.904944 116597 filter_out_daemon_sets.go:49] Filtered out 0 daemon set pods, 0 unschedulable pods left
I1205 23:16:03.904957 116597 static_autoscaler.go:547] No unschedulable pods
I1205 23:16:03.904970 116597 static_autoscaler.go:570] Calculating unneeded nodes
I1205 23:16:03.904973 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:03.904977 116597 pre_filtering_processor.go:57] Node kind-control-plane should not be processed by cluster autoscaler (no node group config)
I1205 23:16:03.904999 116597 static_autoscaler.go:617] Scale down status: lastScaleUpTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownDeleteTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownFailTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 scaleDownForbidden=false scaleDownInCooldown=false
I1205 23:16:03.905021 116597 static_autoscaler.go:642] Starting scale down
I1205 23:16:06.943992 116597 static_autoscaler.go:290] Starting main loop
I1205 23:16:06.944317 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:06.944611 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:06.944704 116597 filter_out_schedulable.go:63] Filtering out schedulables
I1205 23:16:06.944725 116597 filter_out_schedulable.go:120] 0 pods marked as unschedulable can be scheduled.
I1205 23:16:06.944751 116597 filter_out_schedulable.go:83] No schedulable pods
I1205 23:16:06.944762 116597 filter_out_daemon_sets.go:40] Filtering out daemon set pods
I1205 23:16:06.944772 116597 filter_out_daemon_sets.go:49] Filtered out 0 daemon set pods, 0 unschedulable pods left
I1205 23:16:06.944832 116597 static_autoscaler.go:547] No unschedulable pods
I1205 23:16:06.944913 116597 static_autoscaler.go:570] Calculating unneeded nodes
I1205 23:16:06.944940 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:06.944964 116597 pre_filtering_processor.go:57] Node kind-control-plane should not be processed by cluster autoscaler (no node group config)
I1205 23:16:06.945062 116597 static_autoscaler.go:617] Scale down status: lastScaleUpTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownDeleteTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownFailTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 scaleDownForbidden=false scaleDownInCooldown=false
I1205 23:16:06.945155 116597 static_autoscaler.go:642] Starting scale down
I1205 23:16:09.979132 116597 static_autoscaler.go:290] Starting main loop
I1205 23:16:09.979362 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:09.979561 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:09.979616 116597 filter_out_schedulable.go:63] Filtering out schedulables
I1205 23:16:09.979630 116597 filter_out_schedulable.go:120] 0 pods marked as unschedulable can be scheduled.
I1205 23:16:09.979645 116597 filter_out_schedulable.go:83] No schedulable pods
I1205 23:16:09.979653 116597 filter_out_daemon_sets.go:40] Filtering out daemon set pods
I1205 23:16:09.979660 116597 filter_out_daemon_sets.go:49] Filtered out 0 daemon set pods, 0 unschedulable pods left
I1205 23:16:09.979704 116597 static_autoscaler.go:547] No unschedulable pods
I1205 23:16:09.979745 116597 static_autoscaler.go:570] Calculating unneeded nodes
I1205 23:16:09.979757 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:09.979769 116597 pre_filtering_processor.go:57] Node kind-control-plane should not be processed by cluster autoscaler (no node group config)
I1205 23:16:09.979839 116597 static_autoscaler.go:617] Scale down status: lastScaleUpTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownDeleteTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownFailTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 scaleDownForbidden=false scaleDownInCooldown=false
I1205 23:16:09.979905 116597 static_autoscaler.go:642] Starting scale down
I1205 23:16:13.033452 116597 static_autoscaler.go:290] Starting main loop
I1205 23:16:13.033550 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:13.033618 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:13.033638 116597 filter_out_schedulable.go:63] Filtering out schedulables
I1205 23:16:13.033643 116597 filter_out_schedulable.go:120] 0 pods marked as unschedulable can be scheduled.
I1205 23:16:13.033648 116597 filter_out_schedulable.go:83] No schedulable pods
I1205 23:16:13.033651 116597 filter_out_daemon_sets.go:40] Filtering out daemon set pods
I1205 23:16:13.033653 116597 filter_out_daemon_sets.go:49] Filtered out 0 daemon set pods, 0 unschedulable pods left
I1205 23:16:13.033666 116597 static_autoscaler.go:547] No unschedulable pods
I1205 23:16:13.033677 116597 static_autoscaler.go:570] Calculating unneeded nodes
I1205 23:16:13.033683 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:13.033687 116597 pre_filtering_processor.go:57] Node kind-control-plane should not be processed by cluster autoscaler (no node group config)
I1205 23:16:13.033715 116597 static_autoscaler.go:617] Scale down status: lastScaleUpTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownDeleteTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownFailTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 scaleDownForbidden=false scaleDownInCooldown=false
I1205 23:16:13.033735 116597 static_autoscaler.go:642] Starting scale down
I1205 23:16:16.090653 116597 static_autoscaler.go:290] Starting main loop
I1205 23:16:16.091002 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:16.091425 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:16.091508 116597 filter_out_schedulable.go:63] Filtering out schedulables
I1205 23:16:16.091527 116597 filter_out_schedulable.go:120] 0 pods marked as unschedulable can be scheduled.
I1205 23:16:16.091567 116597 filter_out_schedulable.go:83] No schedulable pods
I1205 23:16:16.091583 116597 filter_out_daemon_sets.go:40] Filtering out daemon set pods
I1205 23:16:16.091599 116597 filter_out_daemon_sets.go:49] Filtered out 0 daemon set pods, 0 unschedulable pods left
I1205 23:16:16.091664 116597 static_autoscaler.go:547] No unschedulable pods
I1205 23:16:16.091726 116597 static_autoscaler.go:570] Calculating unneeded nodes
I1205 23:16:16.091748 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:16.091769 116597 pre_filtering_processor.go:57] Node kind-control-plane should not be processed by cluster autoscaler (no node group config)
I1205 23:16:16.091882 116597 static_autoscaler.go:617] Scale down status: lastScaleUpTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownDeleteTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownFailTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 scaleDownForbidden=false scaleDownInCooldown=false
I1205 23:16:16.091982 116597 static_autoscaler.go:642] Starting scale down
I1205 23:16:19.134673 116597 static_autoscaler.go:290] Starting main loop
I1205 23:16:19.134945 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:19.135240 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:19.135311 116597 filter_out_schedulable.go:63] Filtering out schedulables
I1205 23:16:19.135328 116597 filter_out_schedulable.go:120] 0 pods marked as unschedulable can be scheduled.
I1205 23:16:19.135356 116597 filter_out_schedulable.go:83] No schedulable pods
I1205 23:16:19.135367 116597 filter_out_daemon_sets.go:40] Filtering out daemon set pods
I1205 23:16:19.135377 116597 filter_out_daemon_sets.go:49] Filtered out 0 daemon set pods, 0 unschedulable pods left
I1205 23:16:19.135441 116597 static_autoscaler.go:547] No unschedulable pods
I1205 23:16:19.135497 116597 static_autoscaler.go:570] Calculating unneeded nodes
I1205 23:16:19.135512 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:19.135528 116597 pre_filtering_processor.go:57] Node kind-control-plane should not be processed by cluster autoscaler (no node group config)
I1205 23:16:19.135621 116597 static_autoscaler.go:617] Scale down status: lastScaleUpTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownDeleteTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownFailTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 scaleDownForbidden=false scaleDownInCooldown=false
I1205 23:16:19.135709 116597 static_autoscaler.go:642] Starting scale down
I1205 23:16:22.192843 116597 static_autoscaler.go:290] Starting main loop
I1205 23:16:22.193162 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:22.193438 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:22.193527 116597 filter_out_schedulable.go:63] Filtering out schedulables
I1205 23:16:22.193554 116597 filter_out_schedulable.go:120] 0 pods marked as unschedulable can be scheduled.
I1205 23:16:22.193579 116597 filter_out_schedulable.go:83] No schedulable pods
I1205 23:16:22.193589 116597 filter_out_daemon_sets.go:40] Filtering out daemon set pods
I1205 23:16:22.193600 116597 filter_out_daemon_sets.go:49] Filtered out 0 daemon set pods, 0 unschedulable pods left
I1205 23:16:22.193683 116597 static_autoscaler.go:547] No unschedulable pods
I1205 23:16:22.193762 116597 static_autoscaler.go:570] Calculating unneeded nodes
I1205 23:16:22.193787 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:22.193812 116597 pre_filtering_processor.go:57] Node kind-control-plane should not be processed by cluster autoscaler (no node group config)
I1205 23:16:22.193915 116597 static_autoscaler.go:617] Scale down status: lastScaleUpTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownDeleteTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownFailTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 scaleDownForbidden=false scaleDownInCooldown=false
I1205 23:16:22.194006 116597 static_autoscaler.go:642] Starting scale down
I1205 23:16:25.243799 116597 static_autoscaler.go:290] Starting main loop
I1205 23:16:25.244098 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:25.244360 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:25.244426 116597 filter_out_schedulable.go:63] Filtering out schedulables
I1205 23:16:25.244444 116597 filter_out_schedulable.go:120] 0 pods marked as unschedulable can be scheduled.
I1205 23:16:25.244463 116597 filter_out_schedulable.go:83] No schedulable pods
I1205 23:16:25.244473 116597 filter_out_daemon_sets.go:40] Filtering out daemon set pods
I1205 23:16:25.244488 116597 filter_out_daemon_sets.go:49] Filtered out 0 daemon set pods, 0 unschedulable pods left
I1205 23:16:25.244560 116597 static_autoscaler.go:547] No unschedulable pods
I1205 23:16:25.244622 116597 static_autoscaler.go:570] Calculating unneeded nodes
I1205 23:16:25.244638 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:25.244654 116597 pre_filtering_processor.go:57] Node kind-control-plane should not be processed by cluster autoscaler (no node group config)
I1205 23:16:25.244766 116597 static_autoscaler.go:617] Scale down status: lastScaleUpTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownDeleteTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownFailTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 scaleDownForbidden=false scaleDownInCooldown=false
I1205 23:16:25.244856 116597 static_autoscaler.go:642] Starting scale down
I1205 23:16:28.262383 116597 static_autoscaler.go:290] Starting main loop
I1205 23:16:28.262726 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:28.263024 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:28.263114 116597 filter_out_schedulable.go:63] Filtering out schedulables
I1205 23:16:28.263134 116597 filter_out_schedulable.go:120] 0 pods marked as unschedulable can be scheduled.
I1205 23:16:28.263154 116597 filter_out_schedulable.go:83] No schedulable pods
I1205 23:16:28.263164 116597 filter_out_daemon_sets.go:40] Filtering out daemon set pods
I1205 23:16:28.263186 116597 filter_out_daemon_sets.go:49] Filtered out 0 daemon set pods, 0 unschedulable pods left
I1205 23:16:28.263245 116597 static_autoscaler.go:547] No unschedulable pods
I1205 23:16:28.263302 116597 static_autoscaler.go:570] Calculating unneeded nodes
I1205 23:16:28.263316 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:28.263331 116597 pre_filtering_processor.go:57] Node kind-control-plane should not be processed by cluster autoscaler (no node group config)
I1205 23:16:28.263429 116597 static_autoscaler.go:617] Scale down status: lastScaleUpTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownDeleteTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownFailTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 scaleDownForbidden=false scaleDownInCooldown=false
I1205 23:16:28.263518 116597 static_autoscaler.go:642] Starting scale down
I1205 23:16:31.321648 116597 static_autoscaler.go:290] Starting main loop
I1205 23:16:31.322026 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:31.322474 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:31.322599 116597 filter_out_schedulable.go:63] Filtering out schedulables
I1205 23:16:31.322626 116597 filter_out_schedulable.go:120] 0 pods marked as unschedulable can be scheduled.
I1205 23:16:31.322659 116597 filter_out_schedulable.go:83] No schedulable pods
I1205 23:16:31.322676 116597 filter_out_daemon_sets.go:40] Filtering out daemon set pods
I1205 23:16:31.322691 116597 filter_out_daemon_sets.go:49] Filtered out 0 daemon set pods, 0 unschedulable pods left
I1205 23:16:31.322783 116597 static_autoscaler.go:547] No unschedulable pods
I1205 23:16:31.322870 116597 static_autoscaler.go:570] Calculating unneeded nodes
I1205 23:16:31.322897 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:31.322922 116597 pre_filtering_processor.go:57] Node kind-control-plane should not be processed by cluster autoscaler (no node group config)
I1205 23:16:31.323062 116597 static_autoscaler.go:617] Scale down status: lastScaleUpTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownDeleteTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownFailTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 scaleDownForbidden=false scaleDownInCooldown=false
I1205 23:16:31.323198 116597 static_autoscaler.go:642] Starting scale down
I1205 23:16:34.380538 116597 static_autoscaler.go:290] Starting main loop
I1205 23:16:34.380865 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:34.381153 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:34.381219 116597 filter_out_schedulable.go:63] Filtering out schedulables
I1205 23:16:34.381236 116597 filter_out_schedulable.go:120] 0 pods marked as unschedulable can be scheduled.
I1205 23:16:34.381291 116597 filter_out_schedulable.go:83] No schedulable pods
I1205 23:16:34.381303 116597 filter_out_daemon_sets.go:40] Filtering out daemon set pods
I1205 23:16:34.381313 116597 filter_out_daemon_sets.go:49] Filtered out 0 daemon set pods, 0 unschedulable pods left
I1205 23:16:34.381372 116597 static_autoscaler.go:547] No unschedulable pods
I1205 23:16:34.381429 116597 static_autoscaler.go:570] Calculating unneeded nodes
I1205 23:16:34.381445 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:34.381461 116597 pre_filtering_processor.go:57] Node kind-control-plane should not be processed by cluster autoscaler (no node group config)
I1205 23:16:34.381553 116597 static_autoscaler.go:617] Scale down status: lastScaleUpTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownDeleteTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownFailTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 scaleDownForbidden=false scaleDownInCooldown=false
I1205 23:16:34.381669 116597 static_autoscaler.go:642] Starting scale down
I1205 23:16:37.422914 116597 static_autoscaler.go:290] Starting main loop
I1205 23:16:37.423278 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:37.423642 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:37.423737 116597 filter_out_schedulable.go:63] Filtering out schedulables
I1205 23:16:37.423971 116597 klogx.go:87] failed to find place for default/deployments-simple-deployment-deployment-59994f79f6-l8h8x: cannot put pod deployments-simple-deployment-deployment-59994f79f6-l8h8x on any node
I1205 23:16:37.424196 116597 klogx.go:87] failed to find place for default/deployments-simple-deployment-deployment-59994f79f6-76x4b based on similar pods scheduling
I1205 23:16:37.424216 116597 filter_out_schedulable.go:120] 0 pods marked as unschedulable can be scheduled.
I1205 23:16:37.424240 116597 filter_out_schedulable.go:83] No schedulable pods
I1205 23:16:37.424250 116597 filter_out_daemon_sets.go:40] Filtering out daemon set pods
I1205 23:16:37.424262 116597 filter_out_daemon_sets.go:49] Filtered out 0 daemon set pods, 2 unschedulable pods left
I1205 23:16:37.424293 116597 klogx.go:87] Pod default/deployments-simple-deployment-deployment-59994f79f6-l8h8x is unschedulable
I1205 23:16:37.424302 116597 klogx.go:87] Pod default/deployments-simple-deployment-deployment-59994f79f6-76x4b is unschedulable
I1205 23:16:37.424612 116597 orchestrator.go:108] Upcoming 0 nodes
I1205 23:16:37.424642 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:37.425510 116597 orchestrator.go:181] Best option to resize: cluster-autoscaler-1701798315
I1205 23:16:37.425564 116597 orchestrator.go:185] Estimated 2 nodes needed in cluster-autoscaler-1701798315
I1205 23:16:37.425677 116597 orchestrator.go:291] Final scale-up plan: [{cluster-autoscaler-1701798315 0->2 (max: 200)}]
I1205 23:16:37.425739 116597 executor.go:147] Scale-up: setting group cluster-autoscaler-1701798315 size to 2
I1205 23:16:37.426028 116597 event_sink_logging_wrapper.go:48] Event(v1.ObjectReference{Kind:"ConfigMap", Namespace:"default", Name:"cluster-autoscaler-status", UID:"cce60746-c790-4347-b87c-61a35b6d0c34", APIVersion:"v1", ResourceVersion:"69064", FieldPath:""}): type: 'Normal' reason: 'ScaledUpGroup' Scale-up: setting group cluster-autoscaler-1701798315 size to 2 instead of 0 (max: 200)
I1205 23:16:37.599660 116597 eventing_scale_up_processor.go:47] Skipping event processing for unschedulable pods since there is a ScaleUp attempt this loop
I1205 23:16:37.599811 116597 event_sink_logging_wrapper.go:48] Event(v1.ObjectReference{Kind:"Pod", Namespace:"default", Name:"deployments-simple-deployment-deployment-59994f79f6-l8h8x", UID:"c124e47d-aa1f-4716-b163-81998a925ad3", APIVersion:"v1", ResourceVersion:"69073", FieldPath:""}): type: 'Normal' reason: 'TriggeredScaleUp' pod triggered scale-up: [{cluster-autoscaler-1701798315 0->2 (max: 200)}]
I1205 23:16:37.674588 116597 event_sink_logging_wrapper.go:48] Event(v1.ObjectReference{Kind:"Pod", Namespace:"default", Name:"deployments-simple-deployment-deployment-59994f79f6-76x4b", UID:"7af275f6-bc77-4b72-99bd-7bc180ff97c0", APIVersion:"v1", ResourceVersion:"69078", FieldPath:""}): type: 'Normal' reason: 'TriggeredScaleUp' pod triggered scale-up: [{cluster-autoscaler-1701798315 0->2 (max: 200)}]
I1205 23:16:40.834341 116597 static_autoscaler.go:290] Starting main loop
I1205 23:16:40.834690 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:40.835071 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:40.835122 116597 clusterstate.go:260] Scale up in group cluster-autoscaler-1701798315 finished successfully in 3.23476028s
I1205 23:16:40.835205 116597 filter_out_schedulable.go:63] Filtering out schedulables
I1205 23:16:40.835349 116597 klogx.go:87] Pod default/deployments-simple-deployment-deployment-59994f79f6-76x4b can be moved to cluster-autoscaler-1701798315-55gh7
I1205 23:16:40.835372 116597 filter_out_schedulable.go:120] 1 pods marked as unschedulable can be scheduled.
I1205 23:16:40.835389 116597 filter_out_schedulable.go:75] Schedulable pods present
I1205 23:16:40.835398 116597 filter_out_daemon_sets.go:40] Filtering out daemon set pods
I1205 23:16:40.835406 116597 filter_out_daemon_sets.go:49] Filtered out 0 daemon set pods, 0 unschedulable pods left
I1205 23:16:40.835451 116597 static_autoscaler.go:547] No unschedulable pods
I1205 23:16:40.835493 116597 static_autoscaler.go:570] Calculating unneeded nodes
I1205 23:16:40.835506 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:40.835518 116597 pre_filtering_processor.go:57] Node kind-control-plane should not be processed by cluster autoscaler (no node group config)
I1205 23:16:40.835608 116597 eligibility.go:162] Node cluster-autoscaler-1701798315-296wg unremovable: cpu requested (97.1875% of allocatable) is above the scale-down utilization threshold
I1205 23:16:40.835665 116597 eligibility.go:162] Node cluster-autoscaler-1701798315-55gh7 unremovable: cpu requested (97.1875% of allocatable) is above the scale-down utilization threshold
I1205 23:16:40.835740 116597 static_autoscaler.go:617] Scale down status: lastScaleUpTime=2023-12-05 23:16:37.422869619 +0530 IST m=+82.373799265 lastScaleDownDeleteTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownFailTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 scaleDownForbidden=false scaleDownInCooldown=true
I1205 23:16:43.987003 116597 static_autoscaler.go:290] Starting main loop
I1205 23:16:43.987133 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:43.987217 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:43.987246 116597 filter_out_schedulable.go:63] Filtering out schedulables
I1205 23:16:43.987251 116597 filter_out_schedulable.go:120] 0 pods marked as unschedulable can be scheduled.
I1205 23:16:43.987258 116597 filter_out_schedulable.go:83] No schedulable pods
I1205 23:16:43.987262 116597 filter_out_daemon_sets.go:40] Filtering out daemon set pods
I1205 23:16:43.987266 116597 filter_out_daemon_sets.go:49] Filtered out 0 daemon set pods, 0 unschedulable pods left
I1205 23:16:43.987287 116597 static_autoscaler.go:547] No unschedulable pods
I1205 23:16:43.987305 116597 static_autoscaler.go:570] Calculating unneeded nodes
I1205 23:16:43.987311 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:43.987317 116597 pre_filtering_processor.go:57] Node kind-control-plane should not be processed by cluster autoscaler (no node group config)
I1205 23:16:43.987350 116597 eligibility.go:162] Node cluster-autoscaler-1701798315-55gh7 unremovable: cpu requested (97.1875% of allocatable) is above the scale-down utilization threshold
I1205 23:16:43.987365 116597 eligibility.go:162] Node cluster-autoscaler-1701798315-296wg unremovable: cpu requested (97.1875% of allocatable) is above the scale-down utilization threshold
I1205 23:16:43.987387 116597 static_autoscaler.go:617] Scale down status: lastScaleUpTime=2023-12-05 23:16:37.422869619 +0530 IST m=+82.373799265 lastScaleDownDeleteTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownFailTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 scaleDownForbidden=false scaleDownInCooldown=true
I1205 23:16:47.030884 116597 static_autoscaler.go:290] Starting main loop
I1205 23:16:47.031309 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:47.031547 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:47.031610 116597 filter_out_schedulable.go:63] Filtering out schedulables
I1205 23:16:47.031619 116597 filter_out_schedulable.go:120] 0 pods marked as unschedulable can be scheduled.
I1205 23:16:47.031628 116597 filter_out_schedulable.go:83] No schedulable pods
I1205 23:16:47.031635 116597 filter_out_daemon_sets.go:40] Filtering out daemon set pods
I1205 23:16:47.031647 116597 filter_out_daemon_sets.go:49] Filtered out 0 daemon set pods, 0 unschedulable pods left
I1205 23:16:47.031677 116597 static_autoscaler.go:547] No unschedulable pods
I1205 23:16:47.031705 116597 static_autoscaler.go:570] Calculating unneeded nodes
I1205 23:16:47.031712 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:47.031720 116597 pre_filtering_processor.go:57] Node kind-control-plane should not be processed by cluster autoscaler (no node group config)
I1205 23:16:47.031775 116597 eligibility.go:162] Node cluster-autoscaler-1701798315-55gh7 unremovable: cpu requested (97.1875% of allocatable) is above the scale-down utilization threshold
I1205 23:16:47.031810 116597 eligibility.go:162] Node cluster-autoscaler-1701798315-296wg unremovable: cpu requested (97.1875% of allocatable) is above the scale-down utilization threshold
I1205 23:16:47.031852 116597 static_autoscaler.go:617] Scale down status: lastScaleUpTime=2023-12-05 23:16:37.422869619 +0530 IST m=+82.373799265 lastScaleDownDeleteTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownFailTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 scaleDownForbidden=false scaleDownInCooldown=true
I1205 23:16:50.053738 116597 static_autoscaler.go:290] Starting main loop
I1205 23:16:50.054012 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:50.054180 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:50.054234 116597 filter_out_schedulable.go:63] Filtering out schedulables
I1205 23:16:50.054245 116597 filter_out_schedulable.go:120] 0 pods marked as unschedulable can be scheduled.
I1205 23:16:50.054259 116597 filter_out_schedulable.go:83] No schedulable pods
I1205 23:16:50.054265 116597 filter_out_daemon_sets.go:40] Filtering out daemon set pods
I1205 23:16:50.054271 116597 filter_out_daemon_sets.go:49] Filtered out 0 daemon set pods, 0 unschedulable pods left
I1205 23:16:50.054306 116597 static_autoscaler.go:547] No unschedulable pods
I1205 23:16:50.054339 116597 static_autoscaler.go:570] Calculating unneeded nodes
I1205 23:16:50.054348 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:50.054357 116597 pre_filtering_processor.go:57] Node kind-control-plane should not be processed by cluster autoscaler (no node group config)
I1205 23:16:50.054421 116597 eligibility.go:162] Node cluster-autoscaler-1701798315-55gh7 unremovable: cpu requested (97.1875% of allocatable) is above the scale-down utilization threshold
I1205 23:16:50.054463 116597 eligibility.go:162] Node cluster-autoscaler-1701798315-296wg unremovable: cpu requested (97.1875% of allocatable) is above the scale-down utilization threshold
I1205 23:16:50.054517 116597 static_autoscaler.go:617] Scale down status: lastScaleUpTime=2023-12-05 23:16:37.422869619 +0530 IST m=+82.373799265 lastScaleDownDeleteTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownFailTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 scaleDownForbidden=false scaleDownInCooldown=false
I1205 23:16:50.054573 116597 static_autoscaler.go:642] Starting scale down
I1205 23:16:53.091839 116597 static_autoscaler.go:290] Starting main loop
I1205 23:16:53.092231 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:53.092485 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:53.092566 116597 filter_out_schedulable.go:63] Filtering out schedulables
I1205 23:16:53.092584 116597 filter_out_schedulable.go:120] 0 pods marked as unschedulable can be scheduled.
I1205 23:16:53.092604 116597 filter_out_schedulable.go:83] No schedulable pods
I1205 23:16:53.092614 116597 filter_out_daemon_sets.go:40] Filtering out daemon set pods
I1205 23:16:53.092625 116597 filter_out_daemon_sets.go:49] Filtered out 0 daemon set pods, 0 unschedulable pods left
I1205 23:16:53.092714 116597 static_autoscaler.go:547] No unschedulable pods
I1205 23:16:53.092808 116597 static_autoscaler.go:570] Calculating unneeded nodes
I1205 23:16:53.092831 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:53.092847 116597 pre_filtering_processor.go:57] Node kind-control-plane should not be processed by cluster autoscaler (no node group config)
I1205 23:16:53.092948 116597 eligibility.go:162] Node cluster-autoscaler-1701798315-55gh7 unremovable: cpu requested (97.1875% of allocatable) is above the scale-down utilization threshold
I1205 23:16:53.092999 116597 eligibility.go:162] Node cluster-autoscaler-1701798315-296wg unremovable: cpu requested (97.1875% of allocatable) is above the scale-down utilization threshold
I1205 23:16:53.093086 116597 static_autoscaler.go:617] Scale down status: lastScaleUpTime=2023-12-05 23:16:37.422869619 +0530 IST m=+82.373799265 lastScaleDownDeleteTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownFailTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 scaleDownForbidden=false scaleDownInCooldown=false
I1205 23:16:53.093174 116597 static_autoscaler.go:642] Starting scale down
I1205 23:16:56.161550 116597 static_autoscaler.go:290] Starting main loop
I1205 23:16:56.161926 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:56.162177 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:56.162256 116597 filter_out_schedulable.go:63] Filtering out schedulables
I1205 23:16:56.162274 116597 filter_out_schedulable.go:120] 0 pods marked as unschedulable can be scheduled.
I1205 23:16:56.162293 116597 filter_out_schedulable.go:83] No schedulable pods
I1205 23:16:56.162305 116597 filter_out_daemon_sets.go:40] Filtering out daemon set pods
I1205 23:16:56.162316 116597 filter_out_daemon_sets.go:49] Filtered out 0 daemon set pods, 0 unschedulable pods left
I1205 23:16:56.162376 116597 static_autoscaler.go:547] No unschedulable pods
I1205 23:16:56.162452 116597 static_autoscaler.go:570] Calculating unneeded nodes
I1205 23:16:56.162476 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:56.162500 116597 pre_filtering_processor.go:57] Node kind-control-plane should not be processed by cluster autoscaler (no node group config)
I1205 23:16:56.162623 116597 eligibility.go:162] Node cluster-autoscaler-1701798315-55gh7 unremovable: cpu requested (97.1875% of allocatable) is above the scale-down utilization threshold
I1205 23:16:56.162694 116597 eligibility.go:162] Node cluster-autoscaler-1701798315-296wg unremovable: cpu requested (97.1875% of allocatable) is above the scale-down utilization threshold
I1205 23:16:56.162784 116597 static_autoscaler.go:617] Scale down status: lastScaleUpTime=2023-12-05 23:16:37.422869619 +0530 IST m=+82.373799265 lastScaleDownDeleteTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownFailTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 scaleDownForbidden=false scaleDownInCooldown=false
I1205 23:16:56.162883 116597 static_autoscaler.go:642] Starting scale down
I1205 23:16:59.264669 116597 static_autoscaler.go:290] Starting main loop
I1205 23:16:59.264981 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:59.265243 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:59.265317 116597 filter_out_schedulable.go:63] Filtering out schedulables
I1205 23:16:59.265335 116597 filter_out_schedulable.go:120] 0 pods marked as unschedulable can be scheduled.
I1205 23:16:59.265354 116597 filter_out_schedulable.go:83] No schedulable pods
I1205 23:16:59.265364 116597 filter_out_daemon_sets.go:40] Filtering out daemon set pods
I1205 23:16:59.265373 116597 filter_out_daemon_sets.go:49] Filtered out 0 daemon set pods, 0 unschedulable pods left
I1205 23:16:59.265419 116597 static_autoscaler.go:547] No unschedulable pods
I1205 23:16:59.265470 116597 static_autoscaler.go:570] Calculating unneeded nodes
I1205 23:16:59.265484 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:16:59.265499 116597 pre_filtering_processor.go:57] Node kind-control-plane should not be processed by cluster autoscaler (no node group config)
I1205 23:16:59.265559 116597 klogx.go:87] Node cluster-autoscaler-1701798315-55gh7 - cpu requested is 0.3125% of allocatable
I1205 23:16:59.265590 116597 klogx.go:87] Node cluster-autoscaler-1701798315-296wg - cpu requested is 0.3125% of allocatable
I1205 23:16:59.265628 116597 cluster.go:156] Simulating node cluster-autoscaler-1701798315-55gh7 removal
I1205 23:16:59.265659 116597 cluster.go:174] node cluster-autoscaler-1701798315-55gh7 may be removed
I1205 23:16:59.265673 116597 cluster.go:156] Simulating node cluster-autoscaler-1701798315-296wg removal
I1205 23:16:59.265693 116597 cluster.go:174] node cluster-autoscaler-1701798315-296wg may be removed
I1205 23:16:59.265709 116597 nodes.go:84] cluster-autoscaler-1701798315-55gh7 is unneeded since 2023-12-05 23:16:59.264639102 +0530 IST m=+104.215568721 duration 0s
I1205 23:16:59.265730 116597 nodes.go:84] cluster-autoscaler-1701798315-296wg is unneeded since 2023-12-05 23:16:59.264639102 +0530 IST m=+104.215568721 duration 0s
I1205 23:16:59.265801 116597 static_autoscaler.go:617] Scale down status: lastScaleUpTime=2023-12-05 23:16:37.422869619 +0530 IST m=+82.373799265 lastScaleDownDeleteTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownFailTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 scaleDownForbidden=false scaleDownInCooldown=false
I1205 23:16:59.265881 116597 static_autoscaler.go:642] Starting scale down
I1205 23:16:59.265917 116597 nodes.go:126] cluster-autoscaler-1701798315-55gh7 was unneeded for 0s
I1205 23:16:59.265935 116597 nodes.go:126] cluster-autoscaler-1701798315-296wg was unneeded for 0s
I1205 23:16:59.290865 116597 taints.go:221] Successfully added DeletionCandidateTaint on node cluster-autoscaler-1701798315-55gh7
I1205 23:16:59.321938 116597 taints.go:221] Successfully added DeletionCandidateTaint on node cluster-autoscaler-1701798315-296wg
I1205 23:17:02.447876 116597 static_autoscaler.go:290] Starting main loop
I1205 23:17:02.448258 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:17:02.448538 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:17:02.448648 116597 filter_out_schedulable.go:63] Filtering out schedulables
I1205 23:17:02.448674 116597 filter_out_schedulable.go:120] 0 pods marked as unschedulable can be scheduled.
I1205 23:17:02.448696 116597 filter_out_schedulable.go:83] No schedulable pods
I1205 23:17:02.448706 116597 filter_out_daemon_sets.go:40] Filtering out daemon set pods
I1205 23:17:02.448716 116597 filter_out_daemon_sets.go:49] Filtered out 0 daemon set pods, 0 unschedulable pods left
I1205 23:17:02.448786 116597 static_autoscaler.go:547] No unschedulable pods
I1205 23:17:02.448855 116597 static_autoscaler.go:570] Calculating unneeded nodes
I1205 23:17:02.448872 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:17:02.448888 116597 pre_filtering_processor.go:57] Node kind-control-plane should not be processed by cluster autoscaler (no node group config)
I1205 23:17:02.448983 116597 klogx.go:87] Node cluster-autoscaler-1701798315-55gh7 - cpu requested is 0.3125% of allocatable
I1205 23:17:02.449037 116597 klogx.go:87] Node cluster-autoscaler-1701798315-296wg - cpu requested is 0.3125% of allocatable
I1205 23:17:02.449081 116597 cluster.go:156] Simulating node cluster-autoscaler-1701798315-55gh7 removal
I1205 23:17:02.449116 116597 cluster.go:174] node cluster-autoscaler-1701798315-55gh7 may be removed
I1205 23:17:02.449129 116597 cluster.go:156] Simulating node cluster-autoscaler-1701798315-296wg removal
I1205 23:17:02.449151 116597 cluster.go:174] node cluster-autoscaler-1701798315-296wg may be removed
I1205 23:17:02.449167 116597 nodes.go:84] cluster-autoscaler-1701798315-55gh7 is unneeded since 2023-12-05 23:16:59.264639102 +0530 IST m=+104.215568721 duration 3.183180333s
I1205 23:17:02.449192 116597 nodes.go:84] cluster-autoscaler-1701798315-296wg is unneeded since 2023-12-05 23:16:59.264639102 +0530 IST m=+104.215568721 duration 3.183180333s
I1205 23:17:02.449280 116597 static_autoscaler.go:617] Scale down status: lastScaleUpTime=2023-12-05 23:16:37.422869619 +0530 IST m=+82.373799265 lastScaleDownDeleteTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 lastScaleDownFailTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 scaleDownForbidden=false scaleDownInCooldown=false
I1205 23:17:02.449362 116597 static_autoscaler.go:642] Starting scale down
I1205 23:17:02.449404 116597 nodes.go:126] cluster-autoscaler-1701798315-55gh7 was unneeded for 3.183180333s
I1205 23:17:02.449428 116597 nodes.go:126] cluster-autoscaler-1701798315-296wg was unneeded for 3.183180333s
I1205 23:17:02.449454 116597 scale_down_set_processor.go:103] Considering node cluster-autoscaler-1701798315-55gh7 for standard scale down
I1205 23:17:02.449478 116597 scale_down_set_processor.go:103] Considering node cluster-autoscaler-1701798315-296wg for standard scale down
I1205 23:17:02.613104 116597 taints.go:221] Successfully added ToBeDeletedTaint on node cluster-autoscaler-1701798315-55gh7
I1205 23:17:02.613212 116597 event_sink_logging_wrapper.go:48] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"cluster-autoscaler-1701798315-55gh7", UID:"dde9438d-3681-454e-b7bc-354a5250053e", APIVersion:"v1", ResourceVersion:"69192", FieldPath:""}): type: 'Normal' reason: 'ScaleDown' marked the node as toBeDeleted/unschedulable
I1205 23:17:02.658210 116597 taints.go:221] Successfully added ToBeDeletedTaint on node cluster-autoscaler-1701798315-296wg
I1205 23:17:02.658231 116597 actuator.go:143] Scale-down: removing empty node "cluster-autoscaler-1701798315-55gh7"
I1205 23:17:02.658248 116597 actuator.go:143] Scale-down: removing empty node "cluster-autoscaler-1701798315-296wg"
I1205 23:17:02.658327 116597 event_sink_logging_wrapper.go:48] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"cluster-autoscaler-1701798315-296wg", UID:"de582a94-b216-4a16-b4ea-c9a316f4fbd5", APIVersion:"v1", ResourceVersion:"69193", FieldPath:""}): type: 'Normal' reason: 'ScaleDown' marked the node as toBeDeleted/unschedulable
I1205 23:17:02.658378 116597 actuator.go:238] Scale-down: waiting 5s before trying to delete nodes
I1205 23:17:02.862964 116597 event_sink_logging_wrapper.go:48] Event(v1.ObjectReference{Kind:"ConfigMap", Namespace:"default", Name:"cluster-autoscaler-status", UID:"cce60746-c790-4347-b87c-61a35b6d0c34", APIVersion:"v1", ResourceVersion:"69194", FieldPath:""}): type: 'Normal' reason: 'ScaleDownEmpty' Scale-down: removing empty node "cluster-autoscaler-1701798315-55gh7"
I1205 23:17:05.864053 116597 static_autoscaler.go:290] Starting main loop
I1205 23:17:05.864414 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:17:05.864653 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:17:05.864742 116597 filter_out_schedulable.go:63] Filtering out schedulables
I1205 23:17:05.864761 116597 filter_out_schedulable.go:120] 0 pods marked as unschedulable can be scheduled.
I1205 23:17:05.864781 116597 filter_out_schedulable.go:83] No schedulable pods
I1205 23:17:05.864791 116597 filter_out_daemon_sets.go:40] Filtering out daemon set pods
I1205 23:17:05.864801 116597 filter_out_daemon_sets.go:49] Filtered out 0 daemon set pods, 0 unschedulable pods left
I1205 23:17:05.864860 116597 static_autoscaler.go:547] No unschedulable pods
I1205 23:17:05.864918 116597 static_autoscaler.go:570] Calculating unneeded nodes
I1205 23:17:05.864933 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:17:05.864949 116597 pre_filtering_processor.go:57] Node kind-control-plane should not be processed by cluster autoscaler (no node group config)
I1205 23:17:05.865063 116597 static_autoscaler.go:617] Scale down status: lastScaleUpTime=2023-12-05 23:16:37.422869619 +0530 IST m=+82.373799265 lastScaleDownDeleteTime=2023-12-05 23:17:02.447819428 +0530 IST m=+107.398749054 lastScaleDownFailTime=2023-12-05 22:15:15.147107099 +0530 IST m=-3599.901963314 scaleDownForbidden=false scaleDownInCooldown=false
I1205 23:17:05.865155 116597 static_autoscaler.go:642] Starting scale down
I1205 23:17:08.901798 116597 static_autoscaler.go:290] Starting main loop
I1205 23:17:08.902345 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
I1205 23:17:08.902731 116597 kwok_provider.go:58] ignoring node 'kind-control-plane' because it is not managed by kwok
F1205 23:17:08.902773 116597 kwok_helpers.go:270] label 'kwok-nodegroup' for node 'kwok:cluster-autoscaler-1701798315-296wg' not present in the manifest
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment