Skip to content

Instantly share code, notes, and snippets.

@drewp

drewp/gist:e381498de3b1cf8c51f26e74bc08625d Secret

Created August 20, 2022 21:41
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save drewp/e381498de3b1cf8c51f26e74bc08625d to your computer and use it in GitHub Desktop.
Save drewp/e381498de3b1cf8c51f26e74bc08625d to your computer and use it in GitHub Desktop.
Download ZIP
k3s setup
Raw
gistfile1.txt
drewp@slash:~$ head -999 /etc/systemd/system/k3s.service /etc/k3s_config.yaml
==> /etc/systemd/system/k3s.service <==
# written by pyinfra
[Unit]
Description=Lightweight Kubernetes
Documentation=https://k3s.io
After=network-online.target
[Service]
Type=notify
ExecStartPre=-/sbin/modprobe br_netfilter
ExecStartPre=-/sbin/modprobe overlay
ExecStart=/usr/local/bin/k3s server --config /etc/k3s_config.yaml
KillMode=process
Delegate=yes
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=1048576
LimitNPROC=infinity
LimitCORE=infinity
TasksMax=infinity
TimeoutStartSec=0
Restart=always
RestartSec=5s
[Install]
WantedBy=multi-user.target
==> /etc/k3s_config.yaml <==
write-kubeconfig-mode: '640'
node-ip: 10.2.0.84
disable:
- traefik
flannel-backend: host-gw
% k3s kubectl run hello --image crccheck/hello-world
% k3s kubectl get pod -o wide
NAME READY STATUS RESTARTS AGE IP NODE NOMINATED NODE READINESS GATES
hello 1/1 Running 0 6m35s 10.42.0.5 slash <none> <none>
drewp@slash:~$ curl -m 3 http://10.42.0.5:8000/
curl: (28) Connection timed out after 3000 milliseconds
Aug 20 21:28:33 slash systemd[1]: Starting Lightweight Kubernetes...
Aug 20 21:28:33 slash k3s[231897]: time="2022-08-20T21:28:33Z" level=info msg="Starting k3s v1.24.3+k3s1 (990ba0e8)"
Aug 20 21:28:33 slash k3s[231897]: time="2022-08-20T21:28:33Z" level=info msg="Configuring sqlite3 database connection pooling: maxIdleConns=2, maxOpenConns=0, connMaxLifetime=0s"
Aug 20 21:28:33 slash k3s[231897]: time="2022-08-20T21:28:33Z" level=info msg="Configuring database table schema and indexes, this may take a moment..."
Aug 20 21:28:33 slash k3s[231897]: time="2022-08-20T21:28:33Z" level=info msg="Database tables and indexes are up to date"
Aug 20 21:28:33 slash k3s[231897]: time="2022-08-20T21:28:33Z" level=info msg="Kine available at unix://kine.sock"
Aug 20 21:28:33 slash k3s[231897]: time="2022-08-20T21:28:33Z" level=info msg="Reconciling bootstrap data between datastore and disk"
Aug 20 21:28:33 slash k3s[231897]: time="2022-08-20T21:28:33Z" level=info msg="Tunnel server egress proxy mode: agent"
Aug 20 21:28:33 slash k3s[231897]: time="2022-08-20T21:28:33Z" level=info msg="Tunnel server egress proxy waiting for runtime core to become available"
Aug 20 21:28:33 slash k3s[231897]: time="2022-08-20T21:28:33Z" level=info msg="Running kube-apiserver --advertise-address=10.2.0.84 --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=https://kubernetes.default.svc.cluster.local,k3s --authorization-mode=Node,RBAC --bind-address=127.0.0.1 --cert-dir=/var/lib/rancher/k3s/server/tls/temporary-certs --client-ca-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --egress-selector-config-file=/var/lib/rancher/k3s/server/etc/egress-selector-config.yaml --enable-admission-plugins=NodeRestriction --enable-aggregator-routing=true --etcd-servers=unix://kine.sock --feature-gates=JobTrackingWithFinalizers=true --kubelet-certificate-authority=/var/lib/rancher/k3s/server/tls/server-ca.crt --kubelet-client-certificate=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.crt --kubelet-client-key=/var/lib/rancher/k3s/server/tls/client-kube-apiserver.key --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --profiling=false --proxy-client-cert-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt --proxy-client-key-file=/var/lib/rancher/k3s/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/var/lib/rancher/k3s/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6444 --service-account-issuer=https://kubernetes.default.svc.cluster.local --service-account-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-account-signing-key-file=/var/lib/rancher/k3s/server/tls/service.key --service-cluster-ip-range=10.43.0.0/16 --service-node-port-range=30000-32767 --storage-backend=etcd3 --tls-cert-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt --tls-private-key-file=/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key"
Aug 20 21:28:33 slash k3s[231897]: time="2022-08-20T21:28:33Z" level=info msg="Running kube-scheduler --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --bind-address=127.0.0.1 --kubeconfig=/var/lib/rancher/k3s/server/cred/scheduler.kubeconfig --leader-elect=false --profiling=false --secure-port=10259"
Aug 20 21:28:33 slash k3s[231897]: time="2022-08-20T21:28:33Z" level=info msg="Waiting for API server to become available"
Aug 20 21:28:33 slash k3s[231897]: I0820 21:28:33.601559 231897 server.go:576] external host was not specified, using 10.2.0.84
Aug 20 21:28:33 slash k3s[231897]: time="2022-08-20T21:28:33Z" level=info msg="Running kube-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --bind-address=127.0.0.1 --cluster-cidr=10.42.0.0/16 --cluster-signing-kube-apiserver-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --cluster-signing-kube-apiserver-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-client-cert-file=/var/lib/rancher/k3s/server/tls/client-ca.crt --cluster-signing-kubelet-client-key-file=/var/lib/rancher/k3s/server/tls/client-ca.key --cluster-signing-kubelet-serving-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --cluster-signing-kubelet-serving-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --cluster-signing-legacy-unknown-cert-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --cluster-signing-legacy-unknown-key-file=/var/lib/rancher/k3s/server/tls/server-ca.key --configure-cloud-routes=false --controllers=*,-service,-route,-cloud-node-lifecycle --feature-gates=JobTrackingWithFinalizers=true --kubeconfig=/var/lib/rancher/k3s/server/cred/controller.kubeconfig --leader-elect=false --profiling=false --root-ca-file=/var/lib/rancher/k3s/server/tls/server-ca.crt --secure-port=10257 --service-account-private-key-file=/var/lib/rancher/k3s/server/tls/service.key --use-service-account-credentials=true"
Aug 20 21:28:33 slash k3s[231897]: I0820 21:28:33.601858 231897 server.go:168] Version: v1.24.3+k3s1
Aug 20 21:28:33 slash k3s[231897]: I0820 21:28:33.601881 231897 server.go:170] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 20 21:28:33 slash k3s[231897]: time="2022-08-20T21:28:33Z" level=info msg="Running cloud-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --authorization-kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --bind-address=127.0.0.1 --cloud-provider=k3s --cluster-cidr=10.42.0.0/16 --configure-cloud-routes=false --kubeconfig=/var/lib/rancher/k3s/server/cred/cloud-controller.kubeconfig --leader-elect=false --node-status-update-frequency=1m0s --profiling=false"
Aug 20 21:28:33 slash k3s[231897]: time="2022-08-20T21:28:33Z" level=info msg="Node token is available at /var/lib/rancher/k3s/server/token"
Aug 20 21:28:33 slash k3s[231897]: time="2022-08-20T21:28:33Z" level=info msg="To join node to cluster: k3s agent -s https://10.2.0.84:6443 -t ${NODE_TOKEN}"
Aug 20 21:28:33 slash k3s[231897]: time="2022-08-20T21:28:33Z" level=info msg="Wrote kubeconfig /etc/rancher/k3s/k3s.yaml"
Aug 20 21:28:33 slash k3s[231897]: time="2022-08-20T21:28:33Z" level=info msg="Run: k3s kubectl"
Aug 20 21:28:33 slash k3s[231897]: I0820 21:28:33.620759 231897 shared_informer.go:255] Waiting for caches to sync for node_authorizer
Aug 20 21:28:33 slash k3s[231897]: I0820 21:28:33.621927 231897 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook.
Aug 20 21:28:33 slash k3s[231897]: I0820 21:28:33.621952 231897 plugins.go:161] Loaded 11 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,CertificateSubjectRestriction,ValidatingAdmissionWebhook,ResourceQuota.
Aug 20 21:28:33 slash k3s[231897]: I0820 21:28:33.623237 231897 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook.
Aug 20 21:28:33 slash k3s[231897]: I0820 21:28:33.623254 231897 plugins.go:161] Loaded 11 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,CertificateSubjectRestriction,ValidatingAdmissionWebhook,ResourceQuota.
Aug 20 21:28:33 slash k3s[231897]: time="2022-08-20T21:28:33Z" level=info msg="certificate CN=slash signed by CN=k3s-server-ca@1661030906: notBefore=2022-08-20 21:28:26 +0000 UTC notAfter=2023-08-20 21:28:33 +0000 UTC"
Aug 20 21:28:33 slash k3s[231897]: time="2022-08-20T21:28:33Z" level=info msg="certificate CN=system:node:slash,O=system:nodes signed by CN=k3s-client-ca@1661030906: notBefore=2022-08-20 21:28:26 +0000 UTC notAfter=2023-08-20 21:28:33 +0000 UTC"
Aug 20 21:28:33 slash k3s[231897]: W0820 21:28:33.655085 231897 genericapiserver.go:557] Skipping API apiextensions.k8s.io/v1beta1 because it has no resources.
Aug 20 21:28:33 slash k3s[231897]: I0820 21:28:33.657548 231897 instance.go:274] Using reconciler: lease
Aug 20 21:28:33 slash k3s[231897]: time="2022-08-20T21:28:33Z" level=info msg="Module overlay was already loaded"
Aug 20 21:28:33 slash k3s[231897]: time="2022-08-20T21:28:33Z" level=info msg="Module nf_conntrack was already loaded"
Aug 20 21:28:33 slash k3s[231897]: time="2022-08-20T21:28:33Z" level=info msg="Module br_netfilter was already loaded"
Aug 20 21:28:33 slash k3s[231897]: time="2022-08-20T21:28:33Z" level=info msg="Module iptable_nat was already loaded"
Aug 20 21:28:33 slash k3s[231897]: time="2022-08-20T21:28:33Z" level=info msg="Using private registry config file at /etc/rancher/k3s/registries.yaml"
Aug 20 21:28:33 slash k3s[231897]: time="2022-08-20T21:28:33Z" level=info msg="Logging containerd to /var/lib/rancher/k3s/agent/containerd/containerd.log"
Aug 20 21:28:33 slash k3s[231897]: time="2022-08-20T21:28:33Z" level=info msg="Running containerd -c /var/lib/rancher/k3s/agent/etc/containerd/config.toml -a /run/k3s/containerd/containerd.sock --state /run/k3s/containerd --root /var/lib/rancher/k3s/agent/containerd"
Aug 20 21:28:33 slash k3s[231897]: I0820 21:28:33.799285 231897 instance.go:586] API group "internal.apiserver.k8s.io" is not enabled, skipping.
Aug 20 21:28:34 slash k3s[231897]: W0820 21:28:34.007178 231897 genericapiserver.go:557] Skipping API authentication.k8s.io/v1beta1 because it has no resources.
Aug 20 21:28:34 slash k3s[231897]: W0820 21:28:34.008810 231897 genericapiserver.go:557] Skipping API authorization.k8s.io/v1beta1 because it has no resources.
Aug 20 21:28:34 slash k3s[231897]: W0820 21:28:34.022069 231897 genericapiserver.go:557] Skipping API certificates.k8s.io/v1beta1 because it has no resources.
Aug 20 21:28:34 slash k3s[231897]: W0820 21:28:34.023793 231897 genericapiserver.go:557] Skipping API coordination.k8s.io/v1beta1 because it has no resources.
Aug 20 21:28:34 slash k3s[231897]: W0820 21:28:34.030426 231897 genericapiserver.go:557] Skipping API networking.k8s.io/v1beta1 because it has no resources.
Aug 20 21:28:34 slash k3s[231897]: W0820 21:28:34.035749 231897 genericapiserver.go:557] Skipping API node.k8s.io/v1alpha1 because it has no resources.
Aug 20 21:28:34 slash k3s[231897]: W0820 21:28:34.043789 231897 genericapiserver.go:557] Skipping API rbac.authorization.k8s.io/v1beta1 because it has no resources.
Aug 20 21:28:34 slash k3s[231897]: W0820 21:28:34.043813 231897 genericapiserver.go:557] Skipping API rbac.authorization.k8s.io/v1alpha1 because it has no resources.
Aug 20 21:28:34 slash k3s[231897]: W0820 21:28:34.045754 231897 genericapiserver.go:557] Skipping API scheduling.k8s.io/v1beta1 because it has no resources.
Aug 20 21:28:34 slash k3s[231897]: W0820 21:28:34.045769 231897 genericapiserver.go:557] Skipping API scheduling.k8s.io/v1alpha1 because it has no resources.
Aug 20 21:28:34 slash k3s[231897]: W0820 21:28:34.051547 231897 genericapiserver.go:557] Skipping API storage.k8s.io/v1alpha1 because it has no resources.
Aug 20 21:28:34 slash k3s[231897]: W0820 21:28:34.056992 231897 genericapiserver.go:557] Skipping API flowcontrol.apiserver.k8s.io/v1alpha1 because it has no resources.
Aug 20 21:28:34 slash k3s[231897]: W0820 21:28:34.062502 231897 genericapiserver.go:557] Skipping API apps/v1beta2 because it has no resources.
Aug 20 21:28:34 slash k3s[231897]: W0820 21:28:34.062524 231897 genericapiserver.go:557] Skipping API apps/v1beta1 because it has no resources.
Aug 20 21:28:34 slash k3s[231897]: W0820 21:28:34.065133 231897 genericapiserver.go:557] Skipping API admissionregistration.k8s.io/v1beta1 because it has no resources.
Aug 20 21:28:34 slash k3s[231897]: I0820 21:28:34.070068 231897 plugins.go:158] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook.
Aug 20 21:28:34 slash k3s[231897]: I0820 21:28:34.070099 231897 plugins.go:161] Loaded 11 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,CertificateSubjectRestriction,ValidatingAdmissionWebhook,ResourceQuota.
Aug 20 21:28:34 slash k3s[231897]: W0820 21:28:34.095808 231897 genericapiserver.go:557] Skipping API apiregistration.k8s.io/v1beta1 because it has no resources.
Aug 20 21:28:34 slash k3s[231897]: time="2022-08-20T21:28:34Z" level=info msg="Containerd is now running"
Aug 20 21:28:34 slash k3s[231897]: time="2022-08-20T21:28:34Z" level=info msg="Connecting to proxy" url="wss://127.0.0.1:6443/v1-k3s/connect"
Aug 20 21:28:34 slash k3s[231897]: time="2022-08-20T21:28:34Z" level=info msg="Running kubelet --address=0.0.0.0 --anonymous-auth=false --authentication-token-webhook=true --authorization-mode=Webhook --cgroup-driver=cgroupfs --client-ca-file=/var/lib/rancher/k3s/agent/client-ca.crt --cloud-provider=external --cluster-dns=10.43.0.10 --cluster-domain=cluster.local --container-runtime-endpoint=unix:///run/k3s/containerd/containerd.sock --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=imagefs.available<5%,nodefs.available<5% --eviction-minimum-reclaim=imagefs.available=10%,nodefs.available=10% --fail-swap-on=false --healthz-bind-address=127.0.0.1 --hostname-override=slash --kubeconfig=/var/lib/rancher/k3s/agent/kubelet.kubeconfig --node-labels= --pod-infra-container-image=rancher/mirrored-pause:3.6 --pod-manifest-path=/var/lib/rancher/k3s/agent/pod-manifests --read-only-port=0 --resolv-conf=/run/systemd/resolve/resolv.conf --serialize-image-pulls=false --tls-cert-file=/var/lib/rancher/k3s/agent/serving-kubelet.crt --tls-private-key-file=/var/lib/rancher/k3s/agent/serving-kubelet.key"
Aug 20 21:28:34 slash k3s[231897]: time="2022-08-20T21:28:34Z" level=info msg="Handling backend connection request [slash]"
Aug 20 21:28:34 slash k3s[231897]: time="2022-08-20T21:28:34Z" level=info msg="Waiting to retrieve kube-proxy configuration; server is not ready: https://127.0.0.1:6443/v1-k3s/readyz: 500 Internal Server Error"
Aug 20 21:28:35 slash k3s[231897]: I0820 21:28:35.707446 231897 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt"
Aug 20 21:28:35 slash k3s[231897]: I0820 21:28:35.707472 231897 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt"
Aug 20 21:28:35 slash k3s[231897]: I0820 21:28:35.707728 231897 dynamic_serving_content.go:132] "Starting controller" name="serving-cert::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.crt::/var/lib/rancher/k3s/server/tls/serving-kube-apiserver.key"
Aug 20 21:28:35 slash k3s[231897]: I0820 21:28:35.707918 231897 secure_serving.go:210] Serving securely on 127.0.0.1:6444
Aug 20 21:28:35 slash k3s[231897]: I0820 21:28:35.707967 231897 tlsconfig.go:240] "Starting DynamicServingCertificateController"
Aug 20 21:28:35 slash k3s[231897]: I0820 21:28:35.711956 231897 customresource_discovery_controller.go:209] Starting DiscoveryController
Aug 20 21:28:35 slash k3s[231897]: I0820 21:28:35.711994 231897 dynamic_serving_content.go:132] "Starting controller" name="aggregator-proxy-cert::/var/lib/rancher/k3s/server/tls/client-auth-proxy.crt::/var/lib/rancher/k3s/server/tls/client-auth-proxy.key"
Aug 20 21:28:35 slash k3s[231897]: I0820 21:28:35.725515 231897 autoregister_controller.go:141] Starting autoregister controller
Aug 20 21:28:35 slash k3s[231897]: I0820 21:28:35.725559 231897 cache.go:32] Waiting for caches to sync for autoregister controller
Aug 20 21:28:35 slash k3s[231897]: I0820 21:28:35.725585 231897 apf_controller.go:317] Starting API Priority and Fairness config controller
Aug 20 21:28:35 slash k3s[231897]: I0820 21:28:35.726208 231897 cluster_authentication_trust_controller.go:440] Starting cluster_authentication_trust_controller controller
Aug 20 21:28:35 slash k3s[231897]: I0820 21:28:35.726230 231897 shared_informer.go:255] Waiting for caches to sync for cluster_authentication_trust_controller
Aug 20 21:28:35 slash k3s[231897]: I0820 21:28:35.726275 231897 controller.go:83] Starting OpenAPI AggregationController
Aug 20 21:28:35 slash k3s[231897]: I0820 21:28:35.726300 231897 controller.go:80] Starting OpenAPI V3 AggregationController
Aug 20 21:28:35 slash k3s[231897]: I0820 21:28:35.726355 231897 apiservice_controller.go:97] Starting APIServiceRegistrationController
Aug 20 21:28:35 slash k3s[231897]: I0820 21:28:35.726363 231897 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller
Aug 20 21:28:35 slash k3s[231897]: I0820 21:28:35.726578 231897 available_controller.go:491] Starting AvailableConditionController
Aug 20 21:28:35 slash k3s[231897]: I0820 21:28:35.726588 231897 cache.go:32] Waiting for caches to sync for AvailableConditionController controller
Aug 20 21:28:35 slash k3s[231897]: I0820 21:28:35.728955 231897 controller.go:85] Starting OpenAPI controller
Aug 20 21:28:35 slash k3s[231897]: I0820 21:28:35.729132 231897 controller.go:85] Starting OpenAPI V3 controller
Aug 20 21:28:35 slash k3s[231897]: I0820 21:28:35.729273 231897 naming_controller.go:291] Starting NamingConditionController
Aug 20 21:28:35 slash k3s[231897]: I0820 21:28:35.729403 231897 establishing_controller.go:76] Starting EstablishingController
Aug 20 21:28:35 slash k3s[231897]: I0820 21:28:35.729524 231897 nonstructuralschema_controller.go:192] Starting NonStructuralSchemaConditionController
Aug 20 21:28:35 slash k3s[231897]: I0820 21:28:35.729650 231897 apiapproval_controller.go:186] Starting KubernetesAPIApprovalPolicyConformantConditionController
Aug 20 21:28:35 slash k3s[231897]: I0820 21:28:35.729766 231897 crd_finalizer.go:266] Starting CRDFinalizer
Aug 20 21:28:35 slash k3s[231897]: I0820 21:28:35.730080 231897 crdregistration_controller.go:111] Starting crd-autoregister controller
Aug 20 21:28:35 slash k3s[231897]: I0820 21:28:35.730184 231897 shared_informer.go:255] Waiting for caches to sync for crd-autoregister
Aug 20 21:28:35 slash k3s[231897]: I0820 21:28:35.730424 231897 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/server/tls/client-ca.crt"
Aug 20 21:28:35 slash k3s[231897]: I0820 21:28:35.730610 231897 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/var/lib/rancher/k3s/server/tls/request-header-ca.crt"
Aug 20 21:28:35 slash k3s[231897]: E0820 21:28:35.784002 231897 controller.go:173] Error removing old endpoints from kubernetes service: no master IPs were listed in storage, refusing to erase all endpoints for the kubernetes service
Aug 20 21:28:35 slash k3s[231897]: I0820 21:28:35.821871 231897 shared_informer.go:262] Caches are synced for node_authorizer
Aug 20 21:28:35 slash k3s[231897]: I0820 21:28:35.826254 231897 apf_controller.go:322] Running API Priority and Fairness config worker
Aug 20 21:28:35 slash k3s[231897]: I0820 21:28:35.826310 231897 cache.go:39] Caches are synced for autoregister controller
Aug 20 21:28:35 slash k3s[231897]: I0820 21:28:35.826487 231897 cache.go:39] Caches are synced for APIServiceRegistrationController controller
Aug 20 21:28:35 slash k3s[231897]: I0820 21:28:35.826782 231897 shared_informer.go:262] Caches are synced for cluster_authentication_trust_controller
Aug 20 21:28:35 slash k3s[231897]: I0820 21:28:35.827317 231897 cache.go:39] Caches are synced for AvailableConditionController controller
Aug 20 21:28:35 slash k3s[231897]: I0820 21:28:35.830433 231897 shared_informer.go:262] Caches are synced for crd-autoregister
Aug 20 21:28:36 slash k3s[231897]: I0820 21:28:36.355854 231897 controller.go:132] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
Aug 20 21:28:36 slash k3s[231897]: I0820 21:28:36.732164 231897 storage_scheduling.go:111] all system priority classes are created successfully or already exist.
Aug 20 21:28:37 slash k3s[231897]: Flag --cloud-provider has been deprecated, will be removed in 1.24 or later, in favor of removing cloud provider code from Kubelet.
Aug 20 21:28:37 slash k3s[231897]: Flag --containerd has been deprecated, This is a cadvisor flag that was mistakenly registered with the Kubelet. Due to legacy concerns, it will follow the standard CLI deprecation timeline before being removed.
Aug 20 21:28:37 slash k3s[231897]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.27. Image garbage collector will get sandbox image information from CRI.
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.744286 231897 server.go:192] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Aug 20 21:28:37 slash k3s[231897]: time="2022-08-20T21:28:37Z" level=info msg="Kube API server is now running"
Aug 20 21:28:37 slash k3s[231897]: time="2022-08-20T21:28:37Z" level=info msg="ETCD server is now running"
Aug 20 21:28:37 slash k3s[231897]: time="2022-08-20T21:28:37Z" level=info msg="k3s is up and running"
Aug 20 21:28:37 slash systemd[1]: Started Lightweight Kubernetes.
Aug 20 21:28:37 slash k3s[231897]: time="2022-08-20T21:28:37Z" level=info msg="Waiting for cloud-controller-manager privileges to become available"
Aug 20 21:28:37 slash k3s[231897]: time="2022-08-20T21:28:37Z" level=info msg="Annotations and labels have already set on node: slash"
Aug 20 21:28:37 slash k3s[231897]: W0820 21:28:37.761639 231897 reflector.go:324] k8s.io/client-go@v1.24.3-k3s1/tools/cache/reflector.go:167: failed to list *v1.Endpoints: endpoints "kubernetes" is forbidden: User "system:k3s-controller" cannot list resource "endpoints" in API group "" in the namespace "default"
Aug 20 21:28:37 slash k3s[231897]: E0820 21:28:37.761661 231897 reflector.go:138] k8s.io/client-go@v1.24.3-k3s1/tools/cache/reflector.go:167: Failed to watch *v1.Endpoints: failed to list *v1.Endpoints: endpoints "kubernetes" is forbidden: User "system:k3s-controller" cannot list resource "endpoints" in API group "" in the namespace "default"
Aug 20 21:28:37 slash k3s[231897]: time="2022-08-20T21:28:37Z" level=info msg="Starting flannel with backend host-gw"
Aug 20 21:28:37 slash k3s[231897]: time="2022-08-20T21:28:37Z" level=info msg="Applying CRD addons.k3s.cattle.io"
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.773431 231897 server.go:395] "Kubelet version" kubeletVersion="v1.24.3+k3s1"
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.773454 231897 server.go:397] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.774826 231897 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/var/lib/rancher/k3s/agent/client-ca.crt"
Aug 20 21:28:37 slash k3s[231897]: W0820 21:28:37.774868 231897 manager.go:159] Cannot detect current cgroup on cgroup v2
Aug 20 21:28:37 slash k3s[231897]: time="2022-08-20T21:28:37Z" level=info msg="Applying CRD helmcharts.helm.cattle.io"
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.798559 231897 server.go:644] "--cgroups-per-qos enabled, but --cgroup-root was not specified. defaulting to /"
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.799082 231897 container_manager_linux.go:262] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.799284 231897 container_manager_linux.go:267] "Creating Container Manager object based on Node Config" nodeConfig={RuntimeCgroupsName: SystemCgroupsName: KubeletCgroupsName: KubeletOOMScoreAdj:-999 ContainerRuntime: CgroupsPerQOS:true CgroupRoot:/ CgroupDriver:cgroupfs KubeletRootDir:/var/lib/kubelet ProtectKernelDefaults:false NodeAllocatableConfig:{KubeReservedCgroupName: SystemReservedCgroupName: ReservedSystemCPUs: EnforceNodeAllocatable:map[pods:{}] KubeReserved:map[] SystemReserved:map[] HardEvictionThresholds:[{Signal:imagefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.05} GracePeriod:0s MinReclaim:<nil>} {Signal:nodefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.05} GracePeriod:0s MinReclaim:<nil>}]} QOSReserved:map[] ExperimentalCPUManagerPolicy:none ExperimentalCPUManagerPolicyOptions:map[] ExperimentalTopologyManagerScope:container ExperimentalCPUManagerReconcilePeriod:10s ExperimentalMemoryManagerPolicy:None ExperimentalMemoryManagerReservedMemory:[] ExperimentalPodPidsLimit:-1 EnforceCPULimits:true CPUCFSQuotaPeriod:100ms ExperimentalTopologyManagerPolicy:none}
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.799497 231897 topology_manager.go:133] "Creating topology manager with policy per scope" topologyPolicyName="none" topologyScopeName="container"
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.799637 231897 container_manager_linux.go:302] "Creating device plugin manager" devicePluginEnabled=true
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.799789 231897 state_mem.go:36] "Initialized new in-memory state store"
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.809408 231897 kubelet.go:376] "Attempting to sync node with API server"
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.809650 231897 kubelet.go:267] "Adding static pod path" path="/var/lib/rancher/k3s/agent/pod-manifests"
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.809790 231897 kubelet.go:278] "Adding apiserver pod source"
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.809914 231897 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.815360 231897 kuberuntime_manager.go:239] "Container runtime initialized" containerRuntime="containerd" version="v1.6.6-k3s1" apiVersion="v1"
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.816364 231897 server.go:1177] "Started kubelet"
Aug 20 21:28:37 slash k3s[231897]: time="2022-08-20T21:28:37Z" level=info msg="Applying CRD helmchartconfigs.helm.cattle.io"
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.847940 231897 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.852532 231897 server.go:150] "Starting to listen" address="0.0.0.0" port=10250
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.854000 231897 volume_manager.go:289] "Starting Kubelet Volume Manager"
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.854649 231897 server.go:410] "Adding debug handlers to kubelet server"
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.855728 231897 desired_state_of_world_populator.go:145] "Desired state populator starts to run"
Aug 20 21:28:37 slash k3s[231897]: E0820 21:28:37.859561 231897 cri_stats_provider.go:455] "Failed to get the info of the filesystem with mountpoint" err="unable to find data in memory cache" mountpoint="/var/lib/rancher/k3s/agent/containerd/io.containerd.snapshotter.v1.overlayfs"
Aug 20 21:28:37 slash k3s[231897]: E0820 21:28:37.859596 231897 kubelet.go:1298] "Image garbage collection failed once. Stats initialization may not have completed yet" err="invalid capacity 0 on image filesystem"
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.870583 231897 kubelet_network_linux.go:76] "Initialized protocol iptables rules." protocol=IPv4
Aug 20 21:28:37 slash k3s[231897]: time="2022-08-20T21:28:37Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-crd-10.19.300.tgz"
Aug 20 21:28:37 slash k3s[231897]: time="2022-08-20T21:28:37Z" level=info msg="Writing static file: /var/lib/rancher/k3s/server/static/charts/traefik-10.19.300.tgz"
Aug 20 21:28:37 slash k3s[231897]: time="2022-08-20T21:28:37Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/rolebindings.yaml"
Aug 20 21:28:37 slash k3s[231897]: time="2022-08-20T21:28:37Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/ccm.yaml"
Aug 20 21:28:37 slash k3s[231897]: time="2022-08-20T21:28:37Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml"
Aug 20 21:28:37 slash k3s[231897]: time="2022-08-20T21:28:37Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml"
Aug 20 21:28:37 slash k3s[231897]: time="2022-08-20T21:28:37Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml"
Aug 20 21:28:37 slash k3s[231897]: time="2022-08-20T21:28:37Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml"
Aug 20 21:28:37 slash k3s[231897]: time="2022-08-20T21:28:37Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml"
Aug 20 21:28:37 slash k3s[231897]: time="2022-08-20T21:28:37Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/coredns.yaml"
Aug 20 21:28:37 slash k3s[231897]: time="2022-08-20T21:28:37Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/local-storage.yaml"
Aug 20 21:28:37 slash k3s[231897]: time="2022-08-20T21:28:37Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml"
Aug 20 21:28:37 slash k3s[231897]: time="2022-08-20T21:28:37Z" level=info msg="Writing manifest: /var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml"
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.899039 231897 controller.go:611] quota admission added evaluator for: leases.coordination.k8s.io
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.913729 231897 kubelet_network_linux.go:76] "Initialized protocol iptables rules." protocol=IPv6
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.913751 231897 cpu_manager.go:213] "Starting CPU manager" policy="none"
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.913768 231897 cpu_manager.go:214] "Reconciling" reconcilePeriod="10s"
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.913787 231897 state_mem.go:36] "Initialized new in-memory state store"
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.913961 231897 state_mem.go:88] "Updated default CPUSet" cpuSet=""
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.913979 231897 state_mem.go:96] "Updated CPUSet assignments" assignments=map[]
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.913989 231897 policy_none.go:49] "None policy: Start"
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.913754 231897 status_manager.go:161] "Starting to sync pod status with apiserver"
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.914042 231897 kubelet.go:1986] "Starting kubelet main sync loop"
Aug 20 21:28:37 slash k3s[231897]: E0820 21:28:37.914092 231897 kubelet.go:2010] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.919049 231897 memory_manager.go:168] "Starting memorymanager" policy="None"
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.919079 231897 state_mem.go:35] "Initializing new in-memory state store"
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.919242 231897 state_mem.go:75] "Updated machine memory state"
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.919978 231897 manager.go:610] "Failed to read data from checkpoint" checkpoint="kubelet_internal_checkpoint" err="checkpoint is not found"
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.920249 231897 plugin_manager.go:114] "Starting Kubelet Plugin Manager"
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.954901 231897 kubelet_node_status.go:70] "Attempting to register node" node="slash"
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.962226 231897 kubelet_node_status.go:108] "Node was previously registered" node="slash"
Aug 20 21:28:37 slash k3s[231897]: I0820 21:28:37.962326 231897 kubelet_node_status.go:73] "Successfully registered node" node="slash"
Aug 20 21:28:38 slash k3s[231897]: time="2022-08-20T21:28:37Z" level=info msg="Starting k3s.cattle.io/v1, Kind=Addon controller"
Aug 20 21:28:38 slash k3s[231897]: time="2022-08-20T21:28:37Z" level=info msg="Creating deploy event broadcaster"
Aug 20 21:28:38 slash k3s[231897]: I0820 21:28:37.998853 231897 controller.go:611] quota admission added evaluator for: addons.k3s.cattle.io
Aug 20 21:28:38 slash k3s[231897]: time="2022-08-20T21:28:38Z" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"82db2140-3021-4b88-8223-7c717740bdb4\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"242\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\""
Aug 20 21:28:38 slash k3s[231897]: time="2022-08-20T21:28:38Z" level=info msg="Creating svccontroller event broadcaster"
Aug 20 21:28:38 slash k3s[231897]: time="2022-08-20T21:28:38Z" level=info msg="Cluster dns configmap already exists"
Aug 20 21:28:38 slash k3s[231897]: I0820 21:28:38.079177 231897 controller.go:611] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
Aug 20 21:28:38 slash k3s[231897]: time="2022-08-20T21:28:38Z" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"ccm\", UID:\"82db2140-3021-4b88-8223-7c717740bdb4\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"242\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/ccm.yaml\""
Aug 20 21:28:38 slash k3s[231897]: time="2022-08-20T21:28:38Z" level=info msg="Labels and annotations have been set successfully on node: slash"
Aug 20 21:28:38 slash k3s[231897]: time="2022-08-20T21:28:38Z" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"ad7e0642-cf94-427e-b008-d8507297c2dc\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\""
Aug 20 21:28:38 slash k3s[231897]: I0820 21:28:38.109175 231897 controller.go:611] quota admission added evaluator for: serviceaccounts
Aug 20 21:28:38 slash k3s[231897]: I0820 21:28:38.143069 231897 controller.go:611] quota admission added evaluator for: deployments.apps
Aug 20 21:28:38 slash k3s[231897]: time="2022-08-20T21:28:38Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChartConfig controller"
Aug 20 21:28:38 slash k3s[231897]: time="2022-08-20T21:28:38Z" level=info msg="Starting helm.cattle.io/v1, Kind=HelmChart controller"
Aug 20 21:28:38 slash k3s[231897]: I0820 21:28:38.163798 231897 alloc.go:327] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs=map[IPv4:10.43.0.10]
Aug 20 21:28:38 slash k3s[231897]: time="2022-08-20T21:28:38Z" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"coredns\", UID:\"ad7e0642-cf94-427e-b008-d8507297c2dc\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"251\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/coredns.yaml\""
Aug 20 21:28:38 slash k3s[231897]: time="2022-08-20T21:28:38Z" level=info msg="Starting apps/v1, Kind=DaemonSet controller"
Aug 20 21:28:38 slash k3s[231897]: time="2022-08-20T21:28:38Z" level=info msg="Starting apps/v1, Kind=Deployment controller"
Aug 20 21:28:38 slash k3s[231897]: time="2022-08-20T21:28:38Z" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"43f99a2e-1aea-4b5e-b823-8f5376f1bf72\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"262\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\""
Aug 20 21:28:38 slash k3s[231897]: time="2022-08-20T21:28:38Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller"
Aug 20 21:28:38 slash k3s[231897]: time="2022-08-20T21:28:38Z" level=info msg="Starting batch/v1, Kind=Job controller"
Aug 20 21:28:38 slash k3s[231897]: time="2022-08-20T21:28:38Z" level=info msg="Starting /v1, Kind=Endpoints controller"
Aug 20 21:28:38 slash k3s[231897]: time="2022-08-20T21:28:38Z" level=info msg="Starting /v1, Kind=Node controller"
Aug 20 21:28:38 slash k3s[231897]: time="2022-08-20T21:28:38Z" level=info msg="Starting /v1, Kind=ConfigMap controller"
Aug 20 21:28:38 slash k3s[231897]: time="2022-08-20T21:28:38Z" level=info msg="Starting /v1, Kind=Pod controller"
Aug 20 21:28:38 slash k3s[231897]: time="2022-08-20T21:28:38Z" level=info msg="Starting /v1, Kind=Service controller"
Aug 20 21:28:38 slash k3s[231897]: time="2022-08-20T21:28:38Z" level=info msg="Starting /v1, Kind=ServiceAccount controller"
Aug 20 21:28:38 slash k3s[231897]: time="2022-08-20T21:28:38Z" level=info msg="Updated coredns node hosts entry [10.2.0.84 slash]"
Aug 20 21:28:38 slash k3s[231897]: time="2022-08-20T21:28:38Z" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"local-storage\", UID:\"43f99a2e-1aea-4b5e-b823-8f5376f1bf72\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"262\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/local-storage.yaml\""
Aug 20 21:28:38 slash k3s[231897]: time="2022-08-20T21:28:38Z" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"6ac11a27-ff53-45eb-92eb-8b066e101374\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"273\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\""
Aug 20 21:28:38 slash k3s[231897]: time="2022-08-20T21:28:38Z" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"aggregated-metrics-reader\", UID:\"6ac11a27-ff53-45eb-92eb-8b066e101374\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"273\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/aggregated-metrics-reader.yaml\""
Aug 20 21:28:38 slash k3s[231897]: time="2022-08-20T21:28:38Z" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"be937ad7-cecc-4a8f-922f-dfdaf33101ef\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"278\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\""
Aug 20 21:28:38 slash k3s[231897]: time="2022-08-20T21:28:38Z" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-delegator\", UID:\"be937ad7-cecc-4a8f-922f-dfdaf33101ef\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"278\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-delegator.yaml\""
Aug 20 21:28:38 slash k3s[231897]: I0820 21:28:38.394971 231897 serving.go:355] Generated self-signed cert in-memory
Aug 20 21:28:38 slash k3s[231897]: time="2022-08-20T21:28:38Z" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"6b5203ee-cf55-4008-af0c-abae8d8337f3\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"284\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\""
Aug 20 21:28:38 slash k3s[231897]: time="2022-08-20T21:28:38Z" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"auth-reader\", UID:\"6b5203ee-cf55-4008-af0c-abae8d8337f3\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"284\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/auth-reader.yaml\""
Aug 20 21:28:38 slash k3s[231897]: W0820 21:28:38.641203 231897 reflector.go:324] k8s.io/client-go@v1.24.3-k3s1/tools/cache/reflector.go:167: failed to list *v1.Endpoints: endpoints "kubernetes" is forbidden: User "system:k3s-controller" cannot list resource "endpoints" in API group "" in the namespace "default"
Aug 20 21:28:38 slash k3s[231897]: E0820 21:28:38.641246 231897 reflector.go:138] k8s.io/client-go@v1.24.3-k3s1/tools/cache/reflector.go:167: Failed to watch *v1.Endpoints: failed to list *v1.Endpoints: endpoints "kubernetes" is forbidden: User "system:k3s-controller" cannot list resource "endpoints" in API group "" in the namespace "default"
Aug 20 21:28:38 slash k3s[231897]: time="2022-08-20T21:28:38Z" level=info msg="Starting /v1, Kind=Secret controller"
Aug 20 21:28:38 slash k3s[231897]: I0820 21:28:38.829505 231897 apiserver.go:52] "Watching apiserver"
Aug 20 21:28:38 slash k3s[231897]: I0820 21:28:38.861512 231897 reconciler.go:157] "Reconciler: start to sync state"
Aug 20 21:28:38 slash k3s[231897]: time="2022-08-20T21:28:38Z" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"33808b81-aaf0-429e-9c08-e1183e8440b0\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"289\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\""
Aug 20 21:28:38 slash k3s[231897]: time="2022-08-20T21:28:38Z" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-apiservice\", UID:\"33808b81-aaf0-429e-9c08-e1183e8440b0\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"289\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-apiservice.yaml\""
Aug 20 21:28:39 slash k3s[231897]: time="2022-08-20T21:28:39Z" level=info msg="Updating TLS secret for kube-system/k3s-serving (count: 10): map[listener.cattle.io/cn-10.2.0.84:10.2.0.84 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-slash:slash listener.cattle.io/fingerprint:SHA1=AFBB1E5D10DA38D1CCEC531F537207C143EBCAEC]"
Aug 20 21:28:39 slash k3s[231897]: I0820 21:28:39.132269 231897 controllermanager.go:180] Version: v1.24.3+k3s1
Aug 20 21:28:39 slash k3s[231897]: I0820 21:28:39.132300 231897 controllermanager.go:182] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 20 21:28:39 slash k3s[231897]: I0820 21:28:39.135542 231897 requestheader_controller.go:169] Starting RequestHeaderAuthRequestController
Aug 20 21:28:39 slash k3s[231897]: I0820 21:28:39.135562 231897 shared_informer.go:255] Waiting for caches to sync for RequestHeaderAuthRequestController
Aug 20 21:28:39 slash k3s[231897]: I0820 21:28:39.135596 231897 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
Aug 20 21:28:39 slash k3s[231897]: I0820 21:28:39.135606 231897 shared_informer.go:255] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
Aug 20 21:28:39 slash k3s[231897]: I0820 21:28:39.135814 231897 secure_serving.go:210] Serving securely on 127.0.0.1:10257
Aug 20 21:28:39 slash k3s[231897]: I0820 21:28:39.136009 231897 tlsconfig.go:240] "Starting DynamicServingCertificateController"
Aug 20 21:28:39 slash k3s[231897]: I0820 21:28:39.136123 231897 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
Aug 20 21:28:39 slash k3s[231897]: I0820 21:28:39.136227 231897 shared_informer.go:255] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
Aug 20 21:28:39 slash k3s[231897]: I0820 21:28:39.236027 231897 shared_informer.go:262] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
Aug 20 21:28:39 slash k3s[231897]: I0820 21:28:39.236027 231897 shared_informer.go:262] Caches are synced for RequestHeaderAuthRequestController
Aug 20 21:28:39 slash k3s[231897]: I0820 21:28:39.236457 231897 shared_informer.go:262] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
Aug 20 21:28:39 slash k3s[231897]: time="2022-08-20T21:28:39Z" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"b356e706-fa1d-43b0-b93a-38cdeb1d53f5\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"296\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\""
Aug 20 21:28:39 slash k3s[231897]: time="2022-08-20T21:28:39Z" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-deployment\", UID:\"b356e706-fa1d-43b0-b93a-38cdeb1d53f5\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"296\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-deployment.yaml\""
Aug 20 21:28:39 slash k3s[231897]: I0820 21:28:39.592523 231897 serving.go:355] Generated self-signed cert in-memory
Aug 20 21:28:39 slash k3s[231897]: time="2022-08-20T21:28:39Z" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"0ed6a8f4-bfa6-43da-97c6-20847fe52c5d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"302\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\""
Aug 20 21:28:39 slash k3s[231897]: I0820 21:28:39.687948 231897 alloc.go:327] "allocated clusterIPs" service="kube-system/metrics-server" clusterIPs=map[IPv4:10.43.129.3]
Aug 20 21:28:39 slash k3s[231897]: time="2022-08-20T21:28:39Z" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"metrics-server-service\", UID:\"0ed6a8f4-bfa6-43da-97c6-20847fe52c5d\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"302\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/metrics-server-service.yaml\""
Aug 20 21:28:39 slash k3s[231897]: I0820 21:28:39.921924 231897 kubelet_getters.go:300] "Path does not exist" path="/var/lib/kubelet/pods/d6b71dc0-c3bb-4a36-98a6-a5be7a36ab90/volumes"
Aug 20 21:28:39 slash k3s[231897]: I0820 21:28:39.921964 231897 kubelet_getters.go:300] "Path does not exist" path="/var/lib/kubelet/pods/f95f955a-f781-4f3e-8fbe-563a98b64417/volumes"
Aug 20 21:28:39 slash k3s[231897]: I0820 21:28:39.921987 231897 kubelet_getters.go:300] "Path does not exist" path="/var/lib/kubelet/pods/99207ef0-bacf-42be-abb2-736036f2bc20/volumes"
Aug 20 21:28:39 slash k3s[231897]: I0820 21:28:39.922009 231897 kubelet_getters.go:300] "Path does not exist" path="/var/lib/kubelet/pods/b9824a1b-9a3d-4ba5-9c6b-ce50010f6b71/volumes"
Aug 20 21:28:39 slash k3s[231897]: W0820 21:28:39.939847 231897 handler_proxy.go:102] no RequestInfo found in the context
Aug 20 21:28:39 slash k3s[231897]: E0820 21:28:39.939885 231897 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService
Aug 20 21:28:39 slash k3s[231897]: I0820 21:28:39.939897 231897 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
Aug 20 21:28:39 slash k3s[231897]: W0820 21:28:39.939974 231897 handler_proxy.go:102] no RequestInfo found in the context
Aug 20 21:28:39 slash k3s[231897]: E0820 21:28:39.940011 231897 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
Aug 20 21:28:39 slash k3s[231897]: , Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
Aug 20 21:28:39 slash k3s[231897]: I0820 21:28:39.941231 231897 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
Aug 20 21:28:40 slash k3s[231897]: time="2022-08-20T21:28:40Z" level=info msg="Active TLS secret kube-system/k3s-serving (ver=215) (count 10): map[listener.cattle.io/cn-10.2.0.84:10.2.0.84 listener.cattle.io/cn-10.43.0.1:10.43.0.1 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-slash:slash listener.cattle.io/fingerprint:SHA1=AFBB1E5D10DA38D1CCEC531F537207C143EBCAEC]"
Aug 20 21:28:40 slash k3s[231897]: time="2022-08-20T21:28:40Z" level=info msg="Running kube-proxy --cluster-cidr=10.42.0.0/16 --conntrack-max-per-core=0 --conntrack-tcp-timeout-close-wait=0s --conntrack-tcp-timeout-established=0s --healthz-bind-address=127.0.0.1 --hostname-override=slash --kubeconfig=/var/lib/rancher/k3s/agent/kubeproxy.kubeconfig --proxy-mode=iptables"
Aug 20 21:28:40 slash k3s[231897]: I0820 21:28:40.040684 231897 server.go:231] "Warning, all flags other than --config, --write-config-to, and --cleanup are deprecated, please begin using a config file ASAP"
Aug 20 21:28:40 slash k3s[231897]: I0820 21:28:40.061351 231897 node.go:163] Successfully retrieved node IP: 10.2.0.84
Aug 20 21:28:40 slash k3s[231897]: I0820 21:28:40.061388 231897 server_others.go:138] "Detected node IP" address="10.2.0.84"
Aug 20 21:28:40 slash k3s[231897]: I0820 21:28:40.065374 231897 server_others.go:206] "Using iptables Proxier"
Aug 20 21:28:40 slash k3s[231897]: I0820 21:28:40.065400 231897 server_others.go:213] "kube-proxy running in dual-stack mode" ipFamily=IPv4
Aug 20 21:28:40 slash k3s[231897]: I0820 21:28:40.065414 231897 server_others.go:214] "Creating dualStackProxier for iptables"
Aug 20 21:28:40 slash k3s[231897]: I0820 21:28:40.065430 231897 server_others.go:501] "Detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6"
Aug 20 21:28:40 slash k3s[231897]: I0820 21:28:40.065443 231897 proxier.go:259] "Setting route_localnet=1, use nodePortAddresses to filter loopback addresses for NodePorts to skip it https://issues.k8s.io/90259"
Aug 20 21:28:40 slash k3s[231897]: I0820 21:28:40.065543 231897 proxier.go:259] "Setting route_localnet=1, use nodePortAddresses to filter loopback addresses for NodePorts to skip it https://issues.k8s.io/90259"
Aug 20 21:28:40 slash k3s[231897]: I0820 21:28:40.065719 231897 server.go:661] "Version info" version="v1.24.3+k3s1"
Aug 20 21:28:40 slash k3s[231897]: I0820 21:28:40.065735 231897 server.go:663] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 20 21:28:40 slash k3s[231897]: I0820 21:28:40.066169 231897 config.go:317] "Starting service config controller"
Aug 20 21:28:40 slash k3s[231897]: I0820 21:28:40.066186 231897 shared_informer.go:255] Waiting for caches to sync for service config
Aug 20 21:28:40 slash k3s[231897]: I0820 21:28:40.066208 231897 config.go:226] "Starting endpoint slice config controller"
Aug 20 21:28:40 slash k3s[231897]: I0820 21:28:40.066215 231897 shared_informer.go:255] Waiting for caches to sync for endpoint slice config
Aug 20 21:28:40 slash k3s[231897]: I0820 21:28:40.066607 231897 config.go:444] "Starting node config controller"
Aug 20 21:28:40 slash k3s[231897]: I0820 21:28:40.066622 231897 shared_informer.go:255] Waiting for caches to sync for node config
Aug 20 21:28:40 slash k3s[231897]: I0820 21:28:40.071783 231897 controller.go:611] quota admission added evaluator for: events.events.k8s.io
Aug 20 21:28:40 slash k3s[231897]: time="2022-08-20T21:28:40Z" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"394da394-402d-46ec-9c72-8c0a03533a88\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"310\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\""
Aug 20 21:28:40 slash k3s[231897]: time="2022-08-20T21:28:40Z" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"resource-reader\", UID:\"394da394-402d-46ec-9c72-8c0a03533a88\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"310\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/metrics-server/resource-reader.yaml\""
Aug 20 21:28:40 slash k3s[231897]: I0820 21:28:40.166610 231897 shared_informer.go:262] Caches are synced for endpoint slice config
Aug 20 21:28:40 slash k3s[231897]: I0820 21:28:40.166645 231897 shared_informer.go:262] Caches are synced for service config
Aug 20 21:28:40 slash k3s[231897]: I0820 21:28:40.166660 231897 shared_informer.go:262] Caches are synced for node config
Aug 20 21:28:40 slash k3s[231897]: I0820 21:28:40.472425 231897 controllermanager.go:143] Version: v1.24.3+k3s1
Aug 20 21:28:40 slash k3s[231897]: I0820 21:28:40.476050 231897 requestheader_controller.go:169] Starting RequestHeaderAuthRequestController
Aug 20 21:28:40 slash k3s[231897]: I0820 21:28:40.476055 231897 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
Aug 20 21:28:40 slash k3s[231897]: I0820 21:28:40.476231 231897 shared_informer.go:255] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
Aug 20 21:28:40 slash k3s[231897]: I0820 21:28:40.476237 231897 secure_serving.go:210] Serving securely on 127.0.0.1:10258
Aug 20 21:28:40 slash k3s[231897]: I0820 21:28:40.476073 231897 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
Aug 20 21:28:40 slash k3s[231897]: I0820 21:28:40.476452 231897 shared_informer.go:255] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
Aug 20 21:28:40 slash k3s[231897]: I0820 21:28:40.476476 231897 tlsconfig.go:240] "Starting DynamicServingCertificateController"
Aug 20 21:28:40 slash k3s[231897]: I0820 21:28:40.476218 231897 shared_informer.go:255] Waiting for caches to sync for RequestHeaderAuthRequestController
Aug 20 21:28:40 slash k3s[231897]: time="2022-08-20T21:28:40Z" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"5ca11fa6-1ab1-4439-8066-72a4346133ff\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"316\", FieldPath:\"\"}): type: 'Normal' reason: 'ApplyingManifest' Applying manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\""
Aug 20 21:28:40 slash k3s[231897]: time="2022-08-20T21:28:40Z" level=info msg="Event(v1.ObjectReference{Kind:\"Addon\", Namespace:\"kube-system\", Name:\"rolebindings\", UID:\"5ca11fa6-1ab1-4439-8066-72a4346133ff\", APIVersion:\"k3s.cattle.io/v1\", ResourceVersion:\"316\", FieldPath:\"\"}): type: 'Normal' reason: 'AppliedManifest' Applied manifest at \"/var/lib/rancher/k3s/server/manifests/rolebindings.yaml\""
Aug 20 21:28:40 slash k3s[231897]: I0820 21:28:40.541373 231897 request.go:601] Waited for 1.047956277s due to client-side throttling, not priority and fairness, request: GET:https://127.0.0.1:6444/apis/autoscaling/v2beta1
Aug 20 21:28:40 slash k3s[231897]: I0820 21:28:40.576592 231897 shared_informer.go:262] Caches are synced for RequestHeaderAuthRequestController
Aug 20 21:28:40 slash k3s[231897]: I0820 21:28:40.576638 231897 shared_informer.go:262] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
Aug 20 21:28:40 slash k3s[231897]: I0820 21:28:40.576695 231897 shared_informer.go:262] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
Aug 20 21:28:40 slash k3s[231897]: time="2022-08-20T21:28:40Z" level=info msg="Stopped tunnel to 127.0.0.1:6443"
Aug 20 21:28:40 slash k3s[231897]: time="2022-08-20T21:28:40Z" level=info msg="Proxy done" err="context canceled" url="wss://127.0.0.1:6443/v1-k3s/connect"
Aug 20 21:28:40 slash k3s[231897]: time="2022-08-20T21:28:40Z" level=info msg="Connecting to proxy" url="wss://10.2.0.84:6443/v1-k3s/connect"
Aug 20 21:28:40 slash k3s[231897]: time="2022-08-20T21:28:40Z" level=info msg="error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF"
Aug 20 21:28:40 slash k3s[231897]: time="2022-08-20T21:28:40Z" level=info msg="Handling backend connection request [slash]"
Aug 20 21:28:41 slash k3s[231897]: E0820 21:28:41.143839 231897 controllermanager.go:467] unable to get all supported resources from server: unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
Aug 20 21:28:41 slash k3s[231897]: I0820 21:28:41.144753 231897 shared_informer.go:255] Waiting for caches to sync for tokens
Aug 20 21:28:41 slash k3s[231897]: I0820 21:28:41.158387 231897 controllermanager.go:593] Started "endpointslicemirroring"
Aug 20 21:28:41 slash k3s[231897]: I0820 21:28:41.158436 231897 endpointslicemirroring_controller.go:212] Starting EndpointSliceMirroring controller
Aug 20 21:28:41 slash k3s[231897]: I0820 21:28:41.158461 231897 shared_informer.go:255] Waiting for caches to sync for endpoint_slice_mirroring
Aug 20 21:28:41 slash k3s[231897]: I0820 21:28:41.169908 231897 node_ipam_controller.go:91] Sending events to api server.
Aug 20 21:28:41 slash k3s[231897]: I0820 21:28:41.244941 231897 shared_informer.go:262] Caches are synced for tokens
Aug 20 21:28:42 slash k3s[231897]: E0820 21:28:42.484791 231897 controllermanager.go:463] unable to get all supported resources from server: unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
Aug 20 21:28:42 slash k3s[231897]: I0820 21:28:42.485273 231897 node_controller.go:118] Sending events to api server.
Aug 20 21:28:42 slash k3s[231897]: I0820 21:28:42.485384 231897 controllermanager.go:291] Started "cloud-node"
Aug 20 21:28:42 slash k3s[231897]: I0820 21:28:42.485437 231897 node_controller.go:157] Waiting for informer caches to sync
Aug 20 21:28:42 slash k3s[231897]: I0820 21:28:42.485677 231897 node_lifecycle_controller.go:77] Sending events to api server
Aug 20 21:28:42 slash k3s[231897]: I0820 21:28:42.485722 231897 controllermanager.go:291] Started "cloud-node-lifecycle"
Aug 20 21:28:42 slash k3s[231897]: I0820 21:28:42.585849 231897 node_controller.go:406] Initializing node slash with cloud provider
Aug 20 21:28:42 slash k3s[231897]: I0820 21:28:42.597084 231897 node_controller.go:470] Successfully initialized node slash with cloud provider
Aug 20 21:28:42 slash k3s[231897]: I0820 21:28:42.597423 231897 event.go:294] "Event occurred" object="slash" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="Synced" message="Node synced successfully"
Aug 20 21:28:42 slash k3s[231897]: I0820 21:28:42.965978 231897 serving.go:355] Generated self-signed cert in-memory
Aug 20 21:28:43 slash k3s[231897]: I0820 21:28:43.509192 231897 server.go:147] "Starting Kubernetes Scheduler" version="v1.24.3+k3s1"
Aug 20 21:28:43 slash k3s[231897]: I0820 21:28:43.509231 231897 server.go:149] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 20 21:28:43 slash k3s[231897]: I0820 21:28:43.513041 231897 requestheader_controller.go:169] Starting RequestHeaderAuthRequestController
Aug 20 21:28:43 slash k3s[231897]: I0820 21:28:43.513202 231897 shared_informer.go:255] Waiting for caches to sync for RequestHeaderAuthRequestController
Aug 20 21:28:43 slash k3s[231897]: I0820 21:28:43.513204 231897 secure_serving.go:210] Serving securely on 127.0.0.1:10259
Aug 20 21:28:43 slash k3s[231897]: I0820 21:28:43.513067 231897 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
Aug 20 21:28:43 slash k3s[231897]: I0820 21:28:43.513670 231897 shared_informer.go:255] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
Aug 20 21:28:43 slash k3s[231897]: I0820 21:28:43.513047 231897 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
Aug 20 21:28:43 slash k3s[231897]: I0820 21:28:43.513925 231897 shared_informer.go:255] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
Aug 20 21:28:43 slash k3s[231897]: I0820 21:28:43.513221 231897 tlsconfig.go:240] "Starting DynamicServingCertificateController"
Aug 20 21:28:43 slash k3s[231897]: I0820 21:28:43.614327 231897 shared_informer.go:262] Caches are synced for RequestHeaderAuthRequestController
Aug 20 21:28:43 slash k3s[231897]: I0820 21:28:43.614372 231897 shared_informer.go:262] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
Aug 20 21:28:43 slash k3s[231897]: I0820 21:28:43.614721 231897 shared_informer.go:262] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.222591 231897 range_allocator.go:83] Sending events to api server.
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.222806 231897 range_allocator.go:111] No Service CIDR provided. Skipping filtering out service addresses.
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.222825 231897 range_allocator.go:117] No Secondary Service CIDR provided. Skipping filtering out secondary service addresses.
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.222890 231897 controllermanager.go:593] Started "nodeipam"
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.223012 231897 node_ipam_controller.go:154] Starting ipam controller
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.223037 231897 shared_informer.go:255] Waiting for caches to sync for node
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.234325 231897 controllermanager.go:593] Started "endpoint"
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.234355 231897 endpoints_controller.go:178] Starting endpoint controller
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.234375 231897 shared_informer.go:255] Waiting for caches to sync for endpoint
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.245651 231897 controllermanager.go:593] Started "endpointslice"
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.245685 231897 endpointslice_controller.go:257] Starting endpoint slice controller
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.245705 231897 shared_informer.go:255] Waiting for caches to sync for endpoint_slice
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.256981 231897 controllermanager.go:593] Started "replicationcontroller"
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.257075 231897 replica_set.go:205] Starting replicationcontroller controller
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.257096 231897 shared_informer.go:255] Waiting for caches to sync for ReplicationController
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.260639 231897 node_lifecycle_controller.go:377] Sending events to api server.
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.260829 231897 taint_manager.go:163] "Sending events to api server"
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.260929 231897 node_lifecycle_controller.go:505] Controller will reconcile labels.
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.260983 231897 controllermanager.go:593] Started "nodelifecycle"
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.261171 231897 node_lifecycle_controller.go:539] Starting node controller
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.261190 231897 shared_informer.go:255] Waiting for caches to sync for taint
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.272192 231897 controllermanager.go:593] Started "job"
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.272296 231897 job_controller.go:184] Starting job controller
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.272318 231897 shared_informer.go:255] Waiting for caches to sync for job
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.283330 231897 controllermanager.go:593] Started "root-ca-cert-publisher"
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.283405 231897 publisher.go:107] Starting root CA certificate configmap publisher
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.283425 231897 shared_informer.go:255] Waiting for caches to sync for crt configmap
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.294211 231897 controllermanager.go:593] Started "deployment"
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.294352 231897 deployment_controller.go:153] "Starting controller" controller="deployment"
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.294374 231897 shared_informer.go:255] Waiting for caches to sync for deployment
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.304935 231897 controllermanager.go:593] Started "replicaset"
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.304967 231897 replica_set.go:205] Starting replicaset controller
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.304993 231897 shared_informer.go:255] Waiting for caches to sync for ReplicaSet
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.341589 231897 controllermanager.go:593] Started "ttl"
Aug 20 21:28:51 slash k3s[231897]: W0820 21:28:51.341618 231897 controllermanager.go:558] "bootstrapsigner" is disabled
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.341701 231897 ttl_controller.go:121] Starting TTL controller
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.341715 231897 shared_informer.go:255] Waiting for caches to sync for TTL
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.352012 231897 controllermanager.go:593] Started "pvc-protection"
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.352111 231897 pvc_protection_controller.go:103] "Starting PVC protection controller"
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.352126 231897 shared_informer.go:255] Waiting for caches to sync for PVC protection
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.360678 231897 controllermanager.go:593] Started "ttl-after-finished"
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.360748 231897 ttlafterfinished_controller.go:109] Starting TTL after finished controller
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.360759 231897 shared_informer.go:255] Waiting for caches to sync for TTL after finished
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.475968 231897 controllermanager.go:593] Started "podgc"
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.476006 231897 gc_controller.go:92] Starting GC controller
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.476038 231897 shared_informer.go:255] Waiting for caches to sync for GC
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.775349 231897 controllermanager.go:593] Started "horizontalpodautoscaling"
Aug 20 21:28:51 slash k3s[231897]: W0820 21:28:51.775384 231897 controllermanager.go:558] "service" is disabled
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.775453 231897 horizontal.go:168] Starting HPA controller
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.775478 231897 shared_informer.go:255] Waiting for caches to sync for HPA
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.926959 231897 controllermanager.go:593] Started "attachdetach"
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.927040 231897 attach_detach_controller.go:328] Starting attach detach controller
Aug 20 21:28:51 slash k3s[231897]: I0820 21:28:51.927057 231897 shared_informer.go:255] Waiting for caches to sync for attach detach
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.076849 231897 controllermanager.go:593] Started "pv-protection"
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.076920 231897 pv_protection_controller.go:79] Starting PV protection controller
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.076935 231897 shared_informer.go:255] Waiting for caches to sync for PV protection
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.225094 231897 controllermanager.go:593] Started "ephemeral-volume"
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.225151 231897 controller.go:170] Starting ephemeral volume controller
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.225162 231897 shared_informer.go:255] Waiting for caches to sync for ephemeral
Aug 20 21:28:52 slash k3s[231897]: E0820 21:28:52.541034 231897 resource_quota_controller.go:162] initial discovery check failure, continuing and counting on future sync update: unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.541133 231897 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for ingresses.networking.k8s.io
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.541229 231897 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for controllerrevisions.apps
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.541271 231897 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for cronjobs.batch
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.541304 231897 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for leases.coordination.k8s.io
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.541357 231897 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for addons.k3s.cattle.io
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.541431 231897 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for horizontalpodautoscalers.autoscaling
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.541475 231897 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for rolebindings.rbac.authorization.k8s.io
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.541544 231897 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for daemonsets.apps
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.541577 231897 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for deployments.apps
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.541617 231897 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for endpointslices.discovery.k8s.io
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.541659 231897 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for helmchartconfigs.helm.cattle.io
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.541732 231897 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for serviceaccounts
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.541775 231897 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for podtemplates
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.541814 231897 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for events.events.k8s.io
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.541847 231897 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for jobs.batch
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.541887 231897 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for helmcharts.helm.cattle.io
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.541925 231897 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for limitranges
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.541995 231897 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for csistoragecapacities.storage.k8s.io
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.542044 231897 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for replicasets.apps
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.542088 231897 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for statefulsets.apps
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.542134 231897 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for networkpolicies.networking.k8s.io
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.542174 231897 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for poddisruptionbudgets.policy
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.542214 231897 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for roles.rbac.authorization.k8s.io
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.542246 231897 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for endpoints
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.542277 231897 controllermanager.go:593] Started "resourcequota"
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.542293 231897 resource_quota_controller.go:273] Starting resource quota controller
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.542319 231897 shared_informer.go:255] Waiting for caches to sync for resource quota
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.542353 231897 resource_quota_monitor.go:308] QuotaMonitor running
Aug 20 21:28:52 slash k3s[231897]: E0820 21:28:52.552604 231897 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.724866 231897 controllermanager.go:593] Started "disruption"
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.724936 231897 disruption.go:363] Starting disruption controller
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.724952 231897 shared_informer.go:255] Waiting for caches to sync for disruption
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.876685 231897 controllermanager.go:593] Started "persistentvolume-expander"
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.876724 231897 expand_controller.go:341] Starting expand controller
Aug 20 21:28:52 slash k3s[231897]: I0820 21:28:52.876745 231897 shared_informer.go:255] Waiting for caches to sync for expand
Aug 20 21:28:53 slash k3s[231897]: I0820 21:28:53.025750 231897 controllermanager.go:593] Started "clusterrole-aggregation"
Aug 20 21:28:53 slash k3s[231897]: I0820 21:28:53.025782 231897 clusterroleaggregation_controller.go:194] Starting ClusterRoleAggregator
Aug 20 21:28:53 slash k3s[231897]: I0820 21:28:53.025803 231897 shared_informer.go:255] Waiting for caches to sync for ClusterRoleAggregator
Aug 20 21:28:53 slash k3s[231897]: E0820 21:28:53.290520 231897 namespaced_resources_deleter.go:161] unable to get all supported resources from server: unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
Aug 20 21:28:53 slash k3s[231897]: I0820 21:28:53.290661 231897 controllermanager.go:593] Started "namespace"
Aug 20 21:28:53 slash k3s[231897]: I0820 21:28:53.290724 231897 namespace_controller.go:200] Starting namespace controller
Aug 20 21:28:53 slash k3s[231897]: I0820 21:28:53.290742 231897 shared_informer.go:255] Waiting for caches to sync for namespace
Aug 20 21:28:53 slash k3s[231897]: I0820 21:28:53.524979 231897 garbagecollector.go:149] Starting garbage collector controller
Aug 20 21:28:53 slash k3s[231897]: I0820 21:28:53.525014 231897 shared_informer.go:255] Waiting for caches to sync for garbage collector
Aug 20 21:28:53 slash k3s[231897]: I0820 21:28:53.525047 231897 graph_builder.go:289] GraphBuilder running
Aug 20 21:28:53 slash k3s[231897]: I0820 21:28:53.525212 231897 controllermanager.go:593] Started "garbagecollector"
Aug 20 21:28:53 slash k3s[231897]: W0820 21:28:53.700172 231897 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
Aug 20 21:28:53 slash k3s[231897]: I0820 21:28:53.776865 231897 controllermanager.go:593] Started "daemonset"
Aug 20 21:28:53 slash k3s[231897]: I0820 21:28:53.776938 231897 daemon_controller.go:284] Starting daemon sets controller
Aug 20 21:28:53 slash k3s[231897]: I0820 21:28:53.776961 231897 shared_informer.go:255] Waiting for caches to sync for daemon sets
Aug 20 21:28:53 slash k3s[231897]: I0820 21:28:53.927223 231897 certificate_controller.go:119] Starting certificate controller "csrsigning-kubelet-serving"
Aug 20 21:28:53 slash k3s[231897]: I0820 21:28:53.927264 231897 shared_informer.go:255] Waiting for caches to sync for certificate-csrsigning-kubelet-serving
Aug 20 21:28:53 slash k3s[231897]: I0820 21:28:53.927313 231897 dynamic_serving_content.go:132] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.crt::/var/lib/rancher/k3s/server/tls/server-ca.key"
Aug 20 21:28:53 slash k3s[231897]: I0820 21:28:53.928059 231897 certificate_controller.go:119] Starting certificate controller "csrsigning-kubelet-client"
Aug 20 21:28:53 slash k3s[231897]: I0820 21:28:53.928094 231897 shared_informer.go:255] Waiting for caches to sync for certificate-csrsigning-kubelet-client
Aug 20 21:28:53 slash k3s[231897]: I0820 21:28:53.928126 231897 dynamic_serving_content.go:132] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.crt::/var/lib/rancher/k3s/server/tls/client-ca.key"
Aug 20 21:28:53 slash k3s[231897]: I0820 21:28:53.928652 231897 certificate_controller.go:119] Starting certificate controller "csrsigning-kube-apiserver-client"
Aug 20 21:28:53 slash k3s[231897]: I0820 21:28:53.928676 231897 shared_informer.go:255] Waiting for caches to sync for certificate-csrsigning-kube-apiserver-client
Aug 20 21:28:53 slash k3s[231897]: I0820 21:28:53.928717 231897 dynamic_serving_content.go:132] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/client-ca.crt::/var/lib/rancher/k3s/server/tls/client-ca.key"
Aug 20 21:28:53 slash k3s[231897]: I0820 21:28:53.928760 231897 controllermanager.go:593] Started "csrsigning"
Aug 20 21:28:53 slash k3s[231897]: W0820 21:28:53.928785 231897 controllermanager.go:558] "tokencleaner" is disabled
Aug 20 21:28:53 slash k3s[231897]: W0820 21:28:53.928798 231897 controllermanager.go:558] "route" is disabled
Aug 20 21:28:53 slash k3s[231897]: I0820 21:28:53.928866 231897 certificate_controller.go:119] Starting certificate controller "csrsigning-legacy-unknown"
Aug 20 21:28:53 slash k3s[231897]: I0820 21:28:53.928883 231897 shared_informer.go:255] Waiting for caches to sync for certificate-csrsigning-legacy-unknown
Aug 20 21:28:53 slash k3s[231897]: I0820 21:28:53.928930 231897 dynamic_serving_content.go:132] "Starting controller" name="csr-controller::/var/lib/rancher/k3s/server/tls/server-ca.crt::/var/lib/rancher/k3s/server/tls/server-ca.key"
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.076090 231897 controllermanager.go:593] Started "persistentvolume-binder"
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.076133 231897 pv_controller_base.go:311] Starting persistent volume controller
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.076161 231897 shared_informer.go:255] Waiting for caches to sync for persistent volume
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.226233 231897 controllermanager.go:593] Started "serviceaccount"
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.226327 231897 serviceaccounts_controller.go:117] Starting service account controller
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.226343 231897 shared_informer.go:255] Waiting for caches to sync for service account
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.375188 231897 controllermanager.go:593] Started "statefulset"
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.375212 231897 stateful_set.go:147] Starting stateful set controller
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.375225 231897 shared_informer.go:255] Waiting for caches to sync for stateful set
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.526372 231897 controllermanager.go:593] Started "cronjob"
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.526418 231897 cronjob_controllerv2.go:135] "Starting cronjob controller v2"
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.526446 231897 shared_informer.go:255] Waiting for caches to sync for cronjob
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.575773 231897 controllermanager.go:593] Started "csrapproving"
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.575844 231897 certificate_controller.go:119] Starting certificate controller "csrapproving"
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.575862 231897 shared_informer.go:255] Waiting for caches to sync for certificate-csrapproving
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.625119 231897 controllermanager.go:593] Started "csrcleaner"
Aug 20 21:28:54 slash k3s[231897]: W0820 21:28:54.625149 231897 controllermanager.go:558] "cloud-node-lifecycle" is disabled
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.625250 231897 cleaner.go:82] Starting CSR cleaner controller
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.631335 231897 shared_informer.go:255] Waiting for caches to sync for resource quota
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.660917 231897 shared_informer.go:262] Caches are synced for TTL after finished
Aug 20 21:28:54 slash k3s[231897]: W0820 21:28:54.662596 231897 actual_state_of_world.go:541] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true, because nodeName="slash" does not exist
Aug 20 21:28:54 slash k3s[231897]: E0820 21:28:54.674804 231897 memcache.go:206] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.676272 231897 shared_informer.go:262] Caches are synced for certificate-csrapproving
Aug 20 21:28:54 slash k3s[231897]: E0820 21:28:54.676525 231897 memcache.go:104] couldn't get resource list for metrics.k8s.io/v1beta1: the server is currently unable to handle the request
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.677287 231897 shared_informer.go:262] Caches are synced for PV protection
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.677303 231897 shared_informer.go:262] Caches are synced for expand
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.679362 231897 shared_informer.go:255] Waiting for caches to sync for garbage collector
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.683769 231897 shared_informer.go:262] Caches are synced for crt configmap
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.691655 231897 shared_informer.go:262] Caches are synced for namespace
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.723705 231897 shared_informer.go:262] Caches are synced for node
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.723945 231897 range_allocator.go:173] Starting range CIDR allocator
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.723971 231897 shared_informer.go:255] Waiting for caches to sync for cidrallocator
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.723996 231897 shared_informer.go:262] Caches are synced for cidrallocator
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.726583 231897 shared_informer.go:262] Caches are synced for cronjob
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.726644 231897 shared_informer.go:262] Caches are synced for service account
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.726891 231897 shared_informer.go:262] Caches are synced for ClusterRoleAggregator
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.727467 231897 shared_informer.go:262] Caches are synced for certificate-csrsigning-kubelet-serving
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.728166 231897 shared_informer.go:262] Caches are synced for certificate-csrsigning-kubelet-client
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.729264 231897 shared_informer.go:262] Caches are synced for certificate-csrsigning-kube-apiserver-client
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.729395 231897 shared_informer.go:262] Caches are synced for certificate-csrsigning-legacy-unknown
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.730678 231897 range_allocator.go:374] Set node slash PodCIDR to [10.42.0.0/24]
Aug 20 21:28:54 slash k3s[231897]: time="2022-08-20T21:28:54Z" level=info msg="Flannel found PodCIDR assigned for node slash"
Aug 20 21:28:54 slash k3s[231897]: time="2022-08-20T21:28:54Z" level=info msg="The interface enp3s0 with ipv4 address 10.2.0.84 will be used by flannel"
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.736571 231897 kube.go:121] Waiting 10m0s for node controller to sync
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.736814 231897 kube.go:402] Starting kube subnet manager
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.742388 231897 shared_informer.go:262] Caches are synced for TTL
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.751957 231897 kuberuntime_manager.go:1095] "Updating runtime config through cri with podcidr" CIDR="10.42.0.0/24"
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.752256 231897 shared_informer.go:262] Caches are synced for PVC protection
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.753060 231897 kubelet_network.go:60] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.42.0.0/24"
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.757935 231897 shared_informer.go:262] Caches are synced for ReplicationController
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.772752 231897 shared_informer.go:262] Caches are synced for job
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.775282 231897 shared_informer.go:262] Caches are synced for stateful set
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.775649 231897 shared_informer.go:262] Caches are synced for HPA
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.776135 231897 shared_informer.go:262] Caches are synced for GC
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.776307 231897 shared_informer.go:262] Caches are synced for persistent volume
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.795012 231897 shared_informer.go:262] Caches are synced for deployment
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.805875 231897 shared_informer.go:262] Caches are synced for ReplicaSet
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.825346 231897 shared_informer.go:262] Caches are synced for ephemeral
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.825399 231897 shared_informer.go:262] Caches are synced for disruption
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.825433 231897 disruption.go:371] Sending events to api server.
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.827523 231897 shared_informer.go:262] Caches are synced for attach detach
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.835094 231897 shared_informer.go:262] Caches are synced for endpoint
Aug 20 21:28:54 slash k3s[231897]: time="2022-08-20T21:28:54Z" level=info msg="Starting the netpol controller"
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.841821 231897 network_policy_controller.go:151] Starting network policy controller
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.845954 231897 shared_informer.go:262] Caches are synced for endpoint_slice
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.858618 231897 shared_informer.go:262] Caches are synced for endpoint_slice_mirroring
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.861534 231897 shared_informer.go:262] Caches are synced for taint
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.861617 231897 node_lifecycle_controller.go:1399] Initializing eviction metric for zone:
Aug 20 21:28:54 slash k3s[231897]: W0820 21:28:54.861676 231897 node_lifecycle_controller.go:1014] Missing timestamp for Node slash. Assuming now as a timestamp.
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.861706 231897 node_lifecycle_controller.go:1215] Controller detected that zone is now in state Normal.
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.861862 231897 event.go:294] "Event occurred" object="slash" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node slash event: Registered Node slash in Controller"
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.861937 231897 taint_manager.go:187] "Starting NoExecuteTaintManager"
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.877435 231897 shared_informer.go:262] Caches are synced for daemon sets
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.877690 231897 network_policy_controller.go:162] Starting network policy controller full sync goroutine
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.931470 231897 shared_informer.go:262] Caches are synced for resource quota
Aug 20 21:28:54 slash k3s[231897]: I0820 21:28:54.942683 231897 shared_informer.go:262] Caches are synced for resource quota
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.233310 231897 controller.go:611] quota admission added evaluator for: replicasets.apps
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.237371 231897 event.go:294] "Event occurred" object="kube-system/local-path-provisioner" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set local-path-provisioner-7b7dc8d6f5 to 1"
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.237649 231897 event.go:294] "Event occurred" object="kube-system/metrics-server" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set metrics-server-668d979685 to 1"
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.240612 231897 event.go:294] "Event occurred" object="kube-system/coredns" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-b96499967 to 1"
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.280240 231897 controller.go:611] quota admission added evaluator for: endpoints
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.332969 231897 controller.go:611] quota admission added evaluator for: endpointslices.discovery.k8s.io
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.379651 231897 shared_informer.go:262] Caches are synced for garbage collector
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.426124 231897 shared_informer.go:262] Caches are synced for garbage collector
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.426154 231897 garbagecollector.go:158] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.436699 231897 event.go:294] "Event occurred" object="kube-system/metrics-server-668d979685" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: metrics-server-668d979685-w7jdx"
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.441896 231897 event.go:294] "Event occurred" object="kube-system/local-path-provisioner-7b7dc8d6f5" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: local-path-provisioner-7b7dc8d6f5-6nbgf"
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.441928 231897 event.go:294] "Event occurred" object="kube-system/coredns-b96499967" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-b96499967-zkh7n"
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.442729 231897 topology_manager.go:200] "Topology Admit Handler"
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.445918 231897 topology_manager.go:200] "Topology Admit Handler"
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.451224 231897 topology_manager.go:200] "Topology Admit Handler"
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.462031 231897 reconciler.go:270] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9j7b\" (UniqueName: \"kubernetes.io/projected/60531e72-7a95-407a-8869-4a1bf11cd780-kube-api-access-p9j7b\") pod \"coredns-b96499967-zkh7n\" (UID: \"60531e72-7a95-407a-8869-4a1bf11cd780\") " pod="kube-system/coredns-b96499967-zkh7n"
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.462088 231897 reconciler.go:270] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/778d86ee-dbd0-4011-af8e-e3445593e4bb-tmp-dir\") pod \"metrics-server-668d979685-w7jdx\" (UID: \"778d86ee-dbd0-4011-af8e-e3445593e4bb\") " pod="kube-system/metrics-server-668d979685-w7jdx"
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.462123 231897 reconciler.go:270] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg25t\" (UniqueName: \"kubernetes.io/projected/778d86ee-dbd0-4011-af8e-e3445593e4bb-kube-api-access-cg25t\") pod \"metrics-server-668d979685-w7jdx\" (UID: \"778d86ee-dbd0-4011-af8e-e3445593e4bb\") " pod="kube-system/metrics-server-668d979685-w7jdx"
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.462155 231897 reconciler.go:270] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/92dbfc92-27c1-49bf-9ef5-a3b72bd48f7d-config-volume\") pod \"local-path-provisioner-7b7dc8d6f5-6nbgf\" (UID: \"92dbfc92-27c1-49bf-9ef5-a3b72bd48f7d\") " pod="kube-system/local-path-provisioner-7b7dc8d6f5-6nbgf"
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.462192 231897 reconciler.go:270] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkwdt\" (UniqueName: \"kubernetes.io/projected/92dbfc92-27c1-49bf-9ef5-a3b72bd48f7d-kube-api-access-pkwdt\") pod \"local-path-provisioner-7b7dc8d6f5-6nbgf\" (UID: \"92dbfc92-27c1-49bf-9ef5-a3b72bd48f7d\") " pod="kube-system/local-path-provisioner-7b7dc8d6f5-6nbgf"
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.462224 231897 reconciler.go:270] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/60531e72-7a95-407a-8869-4a1bf11cd780-config-volume\") pod \"coredns-b96499967-zkh7n\" (UID: \"60531e72-7a95-407a-8869-4a1bf11cd780\") " pod="kube-system/coredns-b96499967-zkh7n"
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.462256 231897 reconciler.go:270] "operationExecutor.VerifyControllerAttachedVolume started for volume \"custom-config-volume\" (UniqueName: \"kubernetes.io/configmap/60531e72-7a95-407a-8869-4a1bf11cd780-custom-config-volume\") pod \"coredns-b96499967-zkh7n\" (UID: \"60531e72-7a95-407a-8869-4a1bf11cd780\") " pod="kube-system/coredns-b96499967-zkh7n"
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.737207 231897 kube.go:128] Node controller sync successful
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.750650 231897 kube.go:357] Skip setting NodeNetworkUnavailable
Aug 20 21:28:55 slash k3s[231897]: time="2022-08-20T21:28:55Z" level=info msg="Wrote flannel subnet file to /run/flannel/subnet.env"
Aug 20 21:28:55 slash k3s[231897]: time="2022-08-20T21:28:55Z" level=info msg="Running flannel backend."
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.752522 231897 route_network.go:55] Watching for new subnet leases
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.755149 231897 iptables.go:231] Some iptables rules are missing; deleting and recreating rules
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.755172 231897 iptables.go:255] Deleting iptables rule: -s 10.42.0.0/16 -d 10.42.0.0/16 -m comment --comment flanneld masq -j RETURN
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.755400 231897 iptables.go:231] Some iptables rules are missing; deleting and recreating rules
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.755421 231897 iptables.go:255] Deleting iptables rule: -s 10.42.0.0/16 -m comment --comment flanneld forward -j ACCEPT
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.756567 231897 iptables.go:255] Deleting iptables rule: -s 10.42.0.0/16 ! -d 224.0.0.0/4 -m comment --comment flanneld masq -j MASQUERADE --random-fully
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.756910 231897 iptables.go:255] Deleting iptables rule: -d 10.42.0.0/16 -m comment --comment flanneld forward -j ACCEPT
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.757930 231897 iptables.go:255] Deleting iptables rule: ! -s 10.42.0.0/16 -d 10.42.0.0/24 -m comment --comment flanneld masq -j RETURN
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.758157 231897 iptables.go:243] Adding iptables rule: -s 10.42.0.0/16 -m comment --comment flanneld forward -j ACCEPT
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.759128 231897 iptables.go:255] Deleting iptables rule: ! -s 10.42.0.0/16 -d 10.42.0.0/16 -m comment --comment flanneld masq -j MASQUERADE --random-fully
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.760300 231897 iptables.go:243] Adding iptables rule: -s 10.42.0.0/16 -d 10.42.0.0/16 -m comment --comment flanneld masq -j RETURN
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.760664 231897 iptables.go:243] Adding iptables rule: -d 10.42.0.0/16 -m comment --comment flanneld forward -j ACCEPT
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.762714 231897 iptables.go:243] Adding iptables rule: -s 10.42.0.0/16 ! -d 224.0.0.0/4 -m comment --comment flanneld masq -j MASQUERADE --random-fully
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.765296 231897 iptables.go:243] Adding iptables rule: ! -s 10.42.0.0/16 -d 10.42.0.0/24 -m comment --comment flanneld masq -j RETURN
Aug 20 21:28:55 slash k3s[231897]: I0820 21:28:55.767509 231897 iptables.go:243] Adding iptables rule: ! -s 10.42.0.0/16 -d 10.42.0.0/16 -m comment --comment flanneld masq -j MASQUERADE --random-fully
Aug 20 21:28:56 slash k3s[231897]: W0820 21:28:56.288547 231897 handler_proxy.go:102] no RequestInfo found in the context
Aug 20 21:28:56 slash k3s[231897]: W0820 21:28:56.288585 231897 handler_proxy.go:102] no RequestInfo found in the context
Aug 20 21:28:56 slash k3s[231897]: E0820 21:28:56.288618 231897 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
Aug 20 21:28:56 slash k3s[231897]: , Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
Aug 20 21:28:56 slash k3s[231897]: E0820 21:28:56.288631 231897 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService
Aug 20 21:28:56 slash k3s[231897]: I0820 21:28:56.288641 231897 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
Aug 20 21:28:56 slash k3s[231897]: I0820 21:28:56.289806 231897 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
Aug 20 21:28:57 slash k3s[231897]: I0820 21:28:57.293188 231897 topology_manager.go:200] "Topology Admit Handler"
Aug 20 21:28:57 slash k3s[231897]: I0820 21:28:57.473305 231897 reconciler.go:270] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn9sm\" (UniqueName: \"kubernetes.io/projected/e990799b-4869-4b5e-976e-edfe7a6c5d49-kube-api-access-pn9sm\") pod \"hello\" (UID: \"e990799b-4869-4b5e-976e-edfe7a6c5d49\") " pod="default/hello"
Aug 20 21:29:24 slash k3s[231897]: E0820 21:29:24.974248 231897 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
Aug 20 21:29:25 slash k3s[231897]: W0820 21:29:25.400028 231897 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
Aug 20 21:29:36 slash k3s[231897]: I0820 21:29:36.079024 231897 scope.go:110] "RemoveContainer" containerID="486c8eabf77f29a454e71bb17dca84894f3167cbc8c52ae03a94b62513b651cf"
Aug 20 21:29:37 slash k3s[231897]: I0820 21:29:37.085443 231897 scope.go:110] "RemoveContainer" containerID="225ec32d2eedf48e638a5c5b6b5e9d8886ceda5d71b8960c192e2de48d355af6"
Aug 20 21:29:37 slash k3s[231897]: E0820 21:29:37.837753 231897 remote_runtime.go:604] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"922a74db106146befd002ff829f54f4980c47da94d368f29defc5e4628bcc635\": not found" containerID="922a74db106146befd002ff829f54f4980c47da94d368f29defc5e4628bcc635"
Aug 20 21:29:37 slash k3s[231897]: I0820 21:29:37.837797 231897 kuberuntime_gc.go:361] "Error getting ContainerStatus for containerID" containerID="922a74db106146befd002ff829f54f4980c47da94d368f29defc5e4628bcc635" err="rpc error: code = NotFound desc = an error occurred when try to find container \"922a74db106146befd002ff829f54f4980c47da94d368f29defc5e4628bcc635\": not found"
Aug 20 21:29:37 slash k3s[231897]: E0820 21:29:37.838304 231897 remote_runtime.go:604] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"fe50fb1ff588a79e0954a4b6862a9f9faf90150ce9e5989b5e563a208584b788\": not found" containerID="fe50fb1ff588a79e0954a4b6862a9f9faf90150ce9e5989b5e563a208584b788"
Aug 20 21:29:37 slash k3s[231897]: I0820 21:29:37.838335 231897 kuberuntime_gc.go:361] "Error getting ContainerStatus for containerID" containerID="fe50fb1ff588a79e0954a4b6862a9f9faf90150ce9e5989b5e563a208584b788" err="rpc error: code = NotFound desc = an error occurred when try to find container \"fe50fb1ff588a79e0954a4b6862a9f9faf90150ce9e5989b5e563a208584b788\": not found"
Aug 20 21:29:37 slash k3s[231897]: E0820 21:29:37.838695 231897 remote_runtime.go:604] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"d4559a8edc5ac9ca627a581fedf5a8277b3bc0505c4b32be4036d8b650e1fff5\": not found" containerID="d4559a8edc5ac9ca627a581fedf5a8277b3bc0505c4b32be4036d8b650e1fff5"
Aug 20 21:29:37 slash k3s[231897]: I0820 21:29:37.838727 231897 kuberuntime_gc.go:361] "Error getting ContainerStatus for containerID" containerID="d4559a8edc5ac9ca627a581fedf5a8277b3bc0505c4b32be4036d8b650e1fff5" err="rpc error: code = NotFound desc = an error occurred when try to find container \"d4559a8edc5ac9ca627a581fedf5a8277b3bc0505c4b32be4036d8b650e1fff5\": not found"
Aug 20 21:29:37 slash k3s[231897]: E0820 21:29:37.839122 231897 remote_runtime.go:604] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"cc17118f192ecaa856855eaa99ceae03a5678bebdd368bba33c297c5335db95e\": not found" containerID="cc17118f192ecaa856855eaa99ceae03a5678bebdd368bba33c297c5335db95e"
Aug 20 21:29:37 slash k3s[231897]: I0820 21:29:37.839153 231897 kuberuntime_gc.go:361] "Error getting ContainerStatus for containerID" containerID="cc17118f192ecaa856855eaa99ceae03a5678bebdd368bba33c297c5335db95e" err="rpc error: code = NotFound desc = an error occurred when try to find container \"cc17118f192ecaa856855eaa99ceae03a5678bebdd368bba33c297c5335db95e\": not found"
Aug 20 21:29:37 slash k3s[231897]: E0820 21:29:37.839517 231897 remote_runtime.go:604] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"5b155d6a156ed2e2f661a0cbf907f55dec06a1aaa19d41eb14c4c56c8b8383c2\": not found" containerID="5b155d6a156ed2e2f661a0cbf907f55dec06a1aaa19d41eb14c4c56c8b8383c2"
Aug 20 21:29:37 slash k3s[231897]: I0820 21:29:37.839548 231897 kuberuntime_gc.go:361] "Error getting ContainerStatus for containerID" containerID="5b155d6a156ed2e2f661a0cbf907f55dec06a1aaa19d41eb14c4c56c8b8383c2" err="rpc error: code = NotFound desc = an error occurred when try to find container \"5b155d6a156ed2e2f661a0cbf907f55dec06a1aaa19d41eb14c4c56c8b8383c2\": not found"
Aug 20 21:29:37 slash k3s[231897]: E0820 21:29:37.839872 231897 remote_runtime.go:604] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = an error occurred when try to find container \"bdbabb47d62a506d3b3ca89db54784d01a10626b179447ce5cb6a6da1b99de5d\": not found" containerID="bdbabb47d62a506d3b3ca89db54784d01a10626b179447ce5cb6a6da1b99de5d"
Aug 20 21:29:37 slash k3s[231897]: I0820 21:29:37.839902 231897 kuberuntime_gc.go:361] "Error getting ContainerStatus for containerID" containerID="bdbabb47d62a506d3b3ca89db54784d01a10626b179447ce5cb6a6da1b99de5d" err="rpc error: code = NotFound desc = an error occurred when try to find container \"bdbabb47d62a506d3b3ca89db54784d01a10626b179447ce5cb6a6da1b99de5d\": not found"
Aug 20 21:29:55 slash k3s[231897]: E0820 21:29:55.005559 231897 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
Aug 20 21:29:55 slash k3s[231897]: W0820 21:29:55.421568 231897 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
Aug 20 21:29:56 slash k3s[231897]: W0820 21:29:56.289628 231897 handler_proxy.go:102] no RequestInfo found in the context
Aug 20 21:29:56 slash k3s[231897]: E0820 21:29:56.289729 231897 controller.go:116] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
Aug 20 21:29:56 slash k3s[231897]: , Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
Aug 20 21:29:56 slash k3s[231897]: I0820 21:29:56.289754 231897 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
Aug 20 21:29:56 slash k3s[231897]: W0820 21:29:56.290746 231897 handler_proxy.go:102] no RequestInfo found in the context
Aug 20 21:29:56 slash k3s[231897]: E0820 21:29:56.290793 231897 controller.go:113] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: Error, could not get list of group versions for APIService
Aug 20 21:29:56 slash k3s[231897]: I0820 21:29:56.290813 231897 controller.go:126] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
Aug 20 21:30:07 slash k3s[231897]: I0820 21:30:07.139170 231897 scope.go:110] "RemoveContainer" containerID="486c8eabf77f29a454e71bb17dca84894f3167cbc8c52ae03a94b62513b651cf"
Aug 20 21:30:07 slash k3s[231897]: I0820 21:30:07.139526 231897 scope.go:110] "RemoveContainer" containerID="a34bd7b71a24bb7dbad8eaf33ad7edfd586f7f817b191470e6d338ad59ee1623"
Aug 20 21:30:07 slash k3s[231897]: E0820 21:30:07.139863 231897 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"local-path-provisioner\" with CrashLoopBackOff: \"back-off 10s restarting failed container=local-path-provisioner pod=local-path-provisioner-7b7dc8d6f5-6nbgf_kube-system(92dbfc92-27c1-49bf-9ef5-a3b72bd48f7d)\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-6nbgf" podUID=92dbfc92-27c1-49bf-9ef5-a3b72bd48f7d
Aug 20 21:30:08 slash k3s[231897]: I0820 21:30:08.142798 231897 scope.go:110] "RemoveContainer" containerID="225ec32d2eedf48e638a5c5b6b5e9d8886ceda5d71b8960c192e2de48d355af6"
Aug 20 21:30:08 slash k3s[231897]: I0820 21:30:08.143088 231897 scope.go:110] "RemoveContainer" containerID="714055076e659d1059c6fc1bc6e37c97370e90887b8b9633b9f5afbffdebf9a2"
Aug 20 21:30:08 slash k3s[231897]: E0820 21:30:08.143414 231897 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with CrashLoopBackOff: \"back-off 10s restarting failed container=metrics-server pod=metrics-server-668d979685-w7jdx_kube-system(778d86ee-dbd0-4011-af8e-e3445593e4bb)\"" pod="kube-system/metrics-server-668d979685-w7jdx" podUID=778d86ee-dbd0-4011-af8e-e3445593e4bb
Aug 20 21:30:16 slash k3s[231897]: I0820 21:30:16.372195 231897 scope.go:110] "RemoveContainer" containerID="714055076e659d1059c6fc1bc6e37c97370e90887b8b9633b9f5afbffdebf9a2"
Aug 20 21:30:16 slash k3s[231897]: E0820 21:30:16.372687 231897 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with CrashLoopBackOff: \"back-off 10s restarting failed container=metrics-server pod=metrics-server-668d979685-w7jdx_kube-system(778d86ee-dbd0-4011-af8e-e3445593e4bb)\"" pod="kube-system/metrics-server-668d979685-w7jdx" podUID=778d86ee-dbd0-4011-af8e-e3445593e4bb
Aug 20 21:30:21 slash k3s[231897]: I0820 21:30:21.915151 231897 scope.go:110] "RemoveContainer" containerID="a34bd7b71a24bb7dbad8eaf33ad7edfd586f7f817b191470e6d338ad59ee1623"
Aug 20 21:30:25 slash k3s[231897]: E0820 21:30:25.029592 231897 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
Aug 20 21:30:25 slash k3s[231897]: W0820 21:30:25.442125 231897 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
Aug 20 21:30:31 slash k3s[231897]: I0820 21:30:31.914800 231897 scope.go:110] "RemoveContainer" containerID="714055076e659d1059c6fc1bc6e37c97370e90887b8b9633b9f5afbffdebf9a2"
Aug 20 21:30:53 slash k3s[231897]: I0820 21:30:53.233054 231897 scope.go:110] "RemoveContainer" containerID="a34bd7b71a24bb7dbad8eaf33ad7edfd586f7f817b191470e6d338ad59ee1623"
Aug 20 21:30:53 slash k3s[231897]: I0820 21:30:53.233377 231897 scope.go:110] "RemoveContainer" containerID="405e12c0aa34c93476bcbd1f6f7de6b39b61801eb1037f8b78aa74346ff5f3ce"
Aug 20 21:30:53 slash k3s[231897]: E0820 21:30:53.233728 231897 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"local-path-provisioner\" with CrashLoopBackOff: \"back-off 20s restarting failed container=local-path-provisioner pod=local-path-provisioner-7b7dc8d6f5-6nbgf_kube-system(92dbfc92-27c1-49bf-9ef5-a3b72bd48f7d)\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-6nbgf" podUID=92dbfc92-27c1-49bf-9ef5-a3b72bd48f7d
Aug 20 21:30:55 slash k3s[231897]: E0820 21:30:55.049670 231897 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
Aug 20 21:30:55 slash k3s[231897]: W0820 21:30:55.462676 231897 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
Aug 20 21:31:00 slash k3s[231897]: I0820 21:31:00.251300 231897 prober_manager.go:274] "Failed to trigger a manual run" probe="Readiness"
Aug 20 21:31:03 slash k3s[231897]: I0820 21:31:03.258658 231897 scope.go:110] "RemoveContainer" containerID="714055076e659d1059c6fc1bc6e37c97370e90887b8b9633b9f5afbffdebf9a2"
Aug 20 21:31:03 slash k3s[231897]: I0820 21:31:03.259081 231897 scope.go:110] "RemoveContainer" containerID="40380daa1a17a43aea8d6436a1fd9580a7ddd6ef9f02fa471c2fe51aca764a49"
Aug 20 21:31:03 slash k3s[231897]: E0820 21:31:03.259620 231897 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with CrashLoopBackOff: \"back-off 20s restarting failed container=metrics-server pod=metrics-server-668d979685-w7jdx_kube-system(778d86ee-dbd0-4011-af8e-e3445593e4bb)\"" pod="kube-system/metrics-server-668d979685-w7jdx" podUID=778d86ee-dbd0-4011-af8e-e3445593e4bb
Aug 20 21:31:06 slash k3s[231897]: I0820 21:31:06.373031 231897 scope.go:110] "RemoveContainer" containerID="40380daa1a17a43aea8d6436a1fd9580a7ddd6ef9f02fa471c2fe51aca764a49"
Aug 20 21:31:06 slash k3s[231897]: E0820 21:31:06.373530 231897 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with CrashLoopBackOff: \"back-off 20s restarting failed container=metrics-server pod=metrics-server-668d979685-w7jdx_kube-system(778d86ee-dbd0-4011-af8e-e3445593e4bb)\"" pod="kube-system/metrics-server-668d979685-w7jdx" podUID=778d86ee-dbd0-4011-af8e-e3445593e4bb
Aug 20 21:31:07 slash k3s[231897]: I0820 21:31:07.915143 231897 scope.go:110] "RemoveContainer" containerID="405e12c0aa34c93476bcbd1f6f7de6b39b61801eb1037f8b78aa74346ff5f3ce"
Aug 20 21:31:07 slash k3s[231897]: E0820 21:31:07.915520 231897 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"local-path-provisioner\" with CrashLoopBackOff: \"back-off 20s restarting failed container=local-path-provisioner pod=local-path-provisioner-7b7dc8d6f5-6nbgf_kube-system(92dbfc92-27c1-49bf-9ef5-a3b72bd48f7d)\"" pod="kube-system/local-path-provisioner-7b7dc8d6f5-6nbgf" podUID=92dbfc92-27c1-49bf-9ef5-a3b72bd48f7d
Aug 20 21:31:18 slash k3s[231897]: I0820 21:31:18.915399 231897 scope.go:110] "RemoveContainer" containerID="405e12c0aa34c93476bcbd1f6f7de6b39b61801eb1037f8b78aa74346ff5f3ce"
Aug 20 21:31:18 slash k3s[231897]: I0820 21:31:18.915532 231897 scope.go:110] "RemoveContainer" containerID="40380daa1a17a43aea8d6436a1fd9580a7ddd6ef9f02fa471c2fe51aca764a49"
Aug 20 21:31:18 slash k3s[231897]: E0820 21:31:18.915999 231897 pod_workers.go:951] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"metrics-server\" with CrashLoopBackOff: \"back-off 20s restarting failed container=metrics-server pod=metrics-server-668d979685-w7jdx_kube-system(778d86ee-dbd0-4011-af8e-e3445593e4bb)\"" pod="kube-system/metrics-server-668d979685-w7jdx" podUID=778d86ee-dbd0-4011-af8e-e3445593e4bb
Aug 20 21:31:25 slash k3s[231897]: E0820 21:31:25.087248 231897 resource_quota_controller.go:413] unable to retrieve the complete list of server APIs: metrics.k8s.io/v1beta1: the server is currently unable to handle the request
Aug 20 21:31:25 slash k3s[231897]: W0820 21:31:25.482928 231897 garbagecollector.go:747] failed to discover some groups: map[metrics.k8s.io/v1beta1:the server is currently unable to handle the request]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment