Skip to content

Instantly share code, notes, and snippets.

@oxr463
Created April 13, 2022 16:58
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save oxr463/ce9bf42060350b1b202ca0e9db259b9d to your computer and use it in GitHub Desktop.
Save oxr463/ce9bf42060350b1b202ca0e9db259b9d to your computer and use it in GitHub Desktop.
Rancher v2.6.4 - cattle-cluster-agent error

Rancher v2.6.4 - cattle-cluster-agent error

kubectl get pods -n cattle-system
NAME                                    READY   STATUS             RESTARTS   AGE
cattle-cluster-agent-5d576c8868-kw4g5   0/1     CrashLoopBackOff   39         3h31m
cattle-cluster-agent-5d576c8868-zntln   0/1     CrashLoopBackOff   39         3h30m
lramage@srq-wrk-005:~$ kubectl logs cattle-cluster-agent-5d576c8868-zntln -n cattle-system
INFO: Environment: CATTLE_ADDRESS=10.30.59.102 CATTLE_CA_CHECKSUM= CATTLE_CLUSTER=true CATTLE_CLUSTER_AGENT_PORT=tcp://172.20.114.59:80 CATTLE_CLUSTER_AGENT_PORT_443_TCP=tcp://172.20.114.59:443 CATTLE_CLUSTER_AGENT_PORT_443_TCP_ADDR=172.20.114.59 CATTLE_CLUSTER_AGENT_PORT_443_TCP_PORT=443 CATTLE_CLUSTER_AGENT_PORT_443_TCP_PROTO=tcp CATTLE_CLUSTER_AGENT_PORT_80_TCP=tcp://172.20.114.59:80 CATTLE_CLUSTER_AGENT_PORT_80_TCP_ADDR=172.20.114.59 CATTLE_CLUSTER_AGENT_PORT_80_TCP_PORT=80 CATTLE_CLUSTER_AGENT_PORT_80_TCP_PROTO=tcp CATTLE_CLUSTER_AGENT_SERVICE_HOST=172.20.114.59 CATTLE_CLUSTER_AGENT_SERVICE_PORT=80 CATTLE_CLUSTER_AGENT_SERVICE_PORT_HTTP=80 CATTLE_CLUSTER_AGENT_SERVICE_PORT_HTTPS_INTERNAL=443 CATTLE_CLUSTER_REGISTRY= CATTLE_FEATURES=embedded-cluster-api=false,fleet=false,monitoringv1=false,multi-cluster-management=false,multi-cluster-management-agent=true,provisioningv2=false,rke2=false CATTLE_INGRESS_IP_DOMAIN=sslip.io CATTLE_INSTALL_UUID=c7ea0e56-9bf8-40eb-9490-252158a50b76 CATTLE_INTERNAL_ADDRESS= CATTLE_IS_RKE=false CATTLE_K8S_MANAGED=true CATTLE_NODE_NAME=cattle-cluster-agent-5d576c8868-zntln CATTLE_SERVER=https://rancher-new.sv.star2star.net CATTLE_SERVER_VERSION=v2.6.4
INFO: Using resolv.conf: nameserver 172.20.0.10 search cattle-system.svc.cluster.local svc.cluster.local cluster.local ec2.internal options ndots:5
INFO: https://rancher-new.sv.star2star.net/ping is accessible
INFO: rancher-new.sv.star2star.net resolves to 54.208.115.8 52.70.255.41 3.212.241.105 54.84.130.30 3.210.32.165 34.197.145.130
time="2022-04-13T16:50:15Z" level=info msg="Listening on /tmp/log.sock"
time="2022-04-13T16:50:15Z" level=info msg="Rancher agent version v2.6.4 is starting"
time="2022-04-13T16:50:15Z" level=info msg="Connecting to wss://rancher-new.sv.star2star.net/v3/connect/register with token starting with t8qtrvjt5bgw7zrlm5qv29l47cf"
time="2022-04-13T16:50:15Z" level=info msg="Connecting to proxy" url="wss://rancher-new.sv.star2star.net/v3/connect/register"
time="2022-04-13T16:50:15Z" level=info msg="Starting /v1, Kind=Service controller"
time="2022-04-13T16:50:15Z" level=info msg="Running in single server mode, will not peer connections"
time="2022-04-13T16:50:15Z" level=info msg="Applying CRD features.management.cattle.io"
time="2022-04-13T16:50:16Z" level=info msg="Applying CRD navlinks.ui.cattle.io"
time="2022-04-13T16:50:16Z" level=info msg="Applying CRD clusters.management.cattle.io"
time="2022-04-13T16:50:16Z" level=info msg="Applying CRD apiservices.management.cattle.io"
time="2022-04-13T16:50:16Z" level=info msg="Applying CRD clusterregistrationtokens.management.cattle.io"
time="2022-04-13T16:50:16Z" level=info msg="Applying CRD settings.management.cattle.io"
time="2022-04-13T16:50:16Z" level=info msg="Applying CRD preferences.management.cattle.io"
time="2022-04-13T16:50:16Z" level=info msg="Applying CRD features.management.cattle.io"
time="2022-04-13T16:50:16Z" level=info msg="Applying CRD clusterrepos.catalog.cattle.io"
time="2022-04-13T16:50:16Z" level=info msg="Applying CRD operations.catalog.cattle.io"
time="2022-04-13T16:50:16Z" level=info msg="Applying CRD apps.catalog.cattle.io"
time="2022-04-13T16:50:18Z" level=info msg="Starting API controllers"
time="2022-04-13T16:50:18Z" level=info msg="Starting management.cattle.io/v3, Kind=Token controller"
time="2022-04-13T16:50:18Z" level=info msg="Starting management.cattle.io/v3, Kind=Group controller"
time="2022-04-13T16:50:18Z" level=info msg="Starting management.cattle.io/v3, Kind=Cluster controller"
time="2022-04-13T16:50:18Z" level=info msg="Starting management.cattle.io/v3, Kind=UserAttribute controller"
time="2022-04-13T16:50:18Z" level=info msg="Starting management.cattle.io/v3, Kind=User controller"
time="2022-04-13T16:50:18Z" level=info msg="Starting /v1, Kind=Secret controller"
time="2022-04-13T16:50:18Z" level=info msg="Starting management.cattle.io/v3, Kind=GroupMember controller"
time="2022-04-13T16:50:18Z" level=info msg="Starting management.cattle.io/v3, Kind=ClusterRegistrationToken controller"
time="2022-04-13T16:50:18Z" level=info msg="Starting /v1, Kind=ServiceAccount controller"
time="2022-04-13T16:50:18Z" level=info msg="Starting apiextensions.k8s.io/v1, Kind=CustomResourceDefinition controller"
time="2022-04-13T16:50:18Z" level=info msg="Starting management.cattle.io/v3, Kind=Setting controller"
time="2022-04-13T16:50:18Z" level=info msg="Starting management.cattle.io/v3, Kind=Feature controller"
time="2022-04-13T16:50:18Z" level=info msg="Starting management.cattle.io/v3, Kind=Cluster controller"
time="2022-04-13T16:50:18Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRole controller"
time="2022-04-13T16:50:18Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=Role controller"
time="2022-04-13T16:50:18Z" level=info msg="Starting management.cattle.io/v3, Kind=APIService controller"
time="2022-04-13T16:50:18Z" level=info msg="Starting /v1, Kind=ConfigMap controller"
time="2022-04-13T16:50:18Z" level=info msg="Starting management.cattle.io/v3, Kind=Preference controller"
time="2022-04-13T16:50:18Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller"
time="2022-04-13T16:50:18Z" level=info msg="Starting catalog.cattle.io/v1, Kind=ClusterRepo controller"
time="2022-04-13T16:50:18Z" level=info msg="Starting apiregistration.k8s.io/v1, Kind=APIService controller"
time="2022-04-13T16:50:18Z" level=info msg="Starting /v1, Kind=Secret controller"
time="2022-04-13T16:50:18Z" level=info msg="Starting rbac.authorization.k8s.io/v1, Kind=RoleBinding controller"
I0413 16:50:18.472314      39 leaderelection.go:248] attempting to acquire leader lease kube-system/cattle-controllers...
time="2022-04-13T16:50:18Z" level=info msg="Starting steve aggregation client"
time="2022-04-13T16:50:18Z" level=info msg="Listening on :443"
time="2022-04-13T16:50:18Z" level=info msg="Listening on :80"
time="2022-04-13T16:50:18Z" level=info msg="certificate CN=dynamic,O=dynamic signed by CN=dynamiclistener-ca,O=dynamiclistener-org: notBefore=2022-04-08 15:35:11 +0000 UTC notAfter=2023-04-13 16:50:18 +0000 UTC"
time="2022-04-13T16:50:18Z" level=info msg="certificate CN=dynamic,O=dynamic signed by CN=dynamiclistener-ca,O=dynamiclistener-org: notBefore=2022-04-08 15:35:11 +0000 UTC notAfter=2023-04-13 16:50:18 +0000 UTC"
time="2022-04-13T16:50:18Z" level=info msg="Updating TLS secret for serving-cert (count: 4): map[listener.cattle.io/cn-10.30.59.102:10.30.59.102 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-rancher.cattle-system:rancher.cattle-system listener.cattle.io/fingerprint:SHA1=12BB2458DA609D7BA2A03DAA3091CDDC71A15B20]"
time="2022-04-13T16:50:18Z" level=info msg="Active TLS secret serving-cert (ver=60265923) (count 4): map[listener.cattle.io/cn-10.30.59.102:10.30.59.102 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-rancher.cattle-system:rancher.cattle-system listener.cattle.io/fingerprint:SHA1=12BB2458DA609D7BA2A03DAA3091CDDC71A15B20]"
time="2022-04-13T16:50:18Z" level=info msg="Listening on :444"
time="2022-04-13T16:50:18Z" level=info msg="Starting /v1, Kind=Secret controller"
W0413 16:50:19.489556      39 warnings.go:80] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for storage.k8s.io/v1, Kind=CSINode"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for /v1, Kind=Service"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for networking.k8s.io/v1, Kind=Ingress"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for rbac.authorization.k8s.io/v1, Kind=Role"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for policy/v1, Kind=PodDisruptionBudget"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for apps/v1, Kind=DaemonSet"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for management.cattle.io/v3, Kind=GroupMember"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for /v1, Kind=Node"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for /v1, Kind=ConfigMap"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for /v1, Kind=Pod"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for rbac.authorization.k8s.io/v1, Kind=ClusterRole"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for kafka.strimzi.io/v1beta2, Kind=KafkaConnector"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for ui.cattle.io/v1, Kind=NavLink"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for rbac.authorization.k8s.io/v1, Kind=RoleBinding"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for batch/v1, Kind=Job"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for admissionregistration.k8s.io/v1, Kind=MutatingWebhookConfiguration"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for velero.io/v1, Kind=DownloadRequest"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for management.cattle.io/v3, Kind=Cluster"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for /v1, Kind=ServiceAccount"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for management.cattle.io/v3, Kind=Feature"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for management.cattle.io/v3, Kind=Group"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for /v1, Kind=ReplicationController"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for install.istio.io/v1alpha1, Kind=IstioOperator"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for management.cattle.io/v3, Kind=Preference"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for security.istio.io/v1beta1, Kind=RequestAuthentication"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for node.k8s.io/v1, Kind=RuntimeClass"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for networking.istio.io/v1beta1, Kind=ServiceEntry"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for elbv2.k8s.aws/v1beta1, Kind=TargetGroupBinding"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for catalog.cattle.io/v1, Kind=ClusterRepo"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for storage.k8s.io/v1, Kind=StorageClass"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for monitoring.coreos.com/v1, Kind=PrometheusRule"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for velero.io/v1, Kind=Backup"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for security.istio.io/v1beta1, Kind=AuthorizationPolicy"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for networking.istio.io/v1beta1, Kind=Gateway"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for vpcresources.k8s.aws/v1beta1, Kind=SecurityGroupPolicy"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for networking.k8s.io/v1, Kind=NetworkPolicy"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for policy/v1beta1, Kind=PodSecurityPolicy"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for velero.io/v1, Kind=BackupStorageLocation"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for /v1, Kind=Secret"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for admissionregistration.k8s.io/v1, Kind=ValidatingWebhookConfiguration"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for velero.io/v1, Kind=Restore"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for apiregistration.k8s.io/v1, Kind=APIService"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for networking.istio.io/v1alpha3, Kind=EnvoyFilter"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for /v1, Kind=LimitRange"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for batch/v1, Kind=CronJob"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for coordination.k8s.io/v1, Kind=Lease"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for /v1, Kind=ResourceQuota"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for velero.io/v1, Kind=PodVolumeBackup"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for autoscaling/v2beta2, Kind=HorizontalPodAutoscaler"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for /v1, Kind=Namespace"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for velero.io/v1, Kind=VolumeSnapshotLocation"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for storage.k8s.io/v1, Kind=CSIDriver"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for networking.istio.io/v1beta1, Kind=Sidecar"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for certificates.k8s.io/v1, Kind=CertificateSigningRequest"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for apps/v1, Kind=Deployment"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for storage.k8s.io/v1, Kind=VolumeAttachment"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for telemetry.istio.io/v1alpha1, Kind=Telemetry"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for velero.io/v1, Kind=DeleteBackupRequest"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for catalog.cattle.io/v1, Kind=App"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for management.cattle.io/v3, Kind=AuthConfig"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for velero.io/v1, Kind=Schedule"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for apps/v1, Kind=ControllerRevision"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for management.cattle.io/v3, Kind=ClusterRegistrationToken"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for catalog.cattle.io/v1, Kind=Operation"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for management.cattle.io/v3, Kind=Setting"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for /v1, Kind=Endpoints"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for networking.k8s.io/v1, Kind=IngressClass"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for networking.istio.io/v1beta1, Kind=WorkloadEntry"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for velero.io/v1, Kind=ResticRepository"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for kafka.strimzi.io/v1beta2, Kind=KafkaConnectS2I"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for kafka.strimzi.io/v1beta2, Kind=KafkaMirrorMaker2"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for networking.istio.io/v1beta1, Kind=DestinationRule"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for kafka.strimzi.io/v1beta2, Kind=KafkaRebalance"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for elbv2.k8s.aws/v1beta1, Kind=IngressClassParams"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for flowcontrol.apiserver.k8s.io/v1beta1, Kind=PriorityLevelConfiguration"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for kafka.strimzi.io/v1beta2, Kind=KafkaConnect"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for networking.istio.io/v1beta1, Kind=VirtualService"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for apps/v1, Kind=StatefulSet"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for monitoring.coreos.com/v1, Kind=ServiceMonitor"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for events.k8s.io/v1, Kind=Event"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for /v1, Kind=Event"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for management.cattle.io/v3, Kind=User"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for kafka.strimzi.io/v1beta2, Kind=KafkaUser"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for kafka.strimzi.io/v1beta2, Kind=KafkaTopic"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for kafka.strimzi.io/v1beta2, Kind=KafkaBridge"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for management.cattle.io/v3, Kind=APIService"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for management.cattle.io/v3, Kind=UserAttribute"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for networking.istio.io/v1alpha3, Kind=WorkloadGroup"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for kafka.strimzi.io/v1beta2, Kind=KafkaMirrorMaker"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for scheduling.k8s.io/v1, Kind=PriorityClass"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for /v1, Kind=PodTemplate"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for flowcontrol.apiserver.k8s.io/v1beta1, Kind=FlowSchema"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for kafka.strimzi.io/v1beta2, Kind=Kafka"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for apiextensions.k8s.io/v1, Kind=CustomResourceDefinition"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for management.cattle.io/v3, Kind=Token"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for /v1, Kind=PersistentVolumeClaim"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for monitoring.coreos.com/v1, Kind=Prometheus"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for crd.k8s.amazonaws.com/v1alpha1, Kind=ENIConfig"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for apps/v1, Kind=ReplicaSet"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for security.istio.io/v1beta1, Kind=PeerAuthentication"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for storage.k8s.io/v1beta1, Kind=CSIStorageCapacity"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for /v1, Kind=PersistentVolume"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for monitoring.coreos.com/v1, Kind=Alertmanager"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for velero.io/v1, Kind=ServerStatusRequest"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for velero.io/v1, Kind=PodVolumeRestore"
time="2022-04-13T16:50:19Z" level=info msg="Watching metadata for discovery.k8s.io/v1, Kind=EndpointSlice"
W0413 16:50:19.606534      39 warnings.go:80] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
W0413 16:50:19.768236      39 warnings.go:80] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
I0413 16:51:04.211715      39 leaderelection.go:258] successfully acquired lease kube-system/cattle-controllers
time="2022-04-13T16:51:04Z" level=info msg="Registering namespaceHandler for adding labels "
W0413 16:51:04.350665      39 warnings.go:80] batch/v1beta1 CronJob is deprecated in v1.21+, unavailable in v1.25+; use batch/v1 CronJob
W0413 16:51:04.354466      39 warnings.go:80] batch/v1beta1 CronJob is deprecated in v1.21+, unavailable in v1.25+; use batch/v1 CronJob
time="2022-04-13T16:51:04Z" level=info msg="Steve auth startup complete"
time="2022-04-13T16:51:04Z" level=info msg="Starting /v1, Kind=Pod controller"
E0413 16:51:04.465069      39 runtime.go:78] Observed a panic: runtime.boundsError{x:3, y:0, signed:true, code:0x2} (runtime error: slice bounds out of range [:3] with capacity 0)
goroutine 2735 [running]:
k8s.io/apimachinery/pkg/util/runtime.logPanic({0x3cda0e0, 0xc0044a5440})
	/go/src/github.com/rancher/rancher/go/pkg/mod/k8s.io/apimachinery@v0.23.3/pkg/util/runtime/runtime.go:74 +0x7d
k8s.io/apimachinery/pkg/util/runtime.HandleCrash({0x0, 0x0, 0xc0098db390})
	/go/src/github.com/rancher/rancher/go/pkg/mod/k8s.io/apimachinery@v0.23.3/pkg/util/runtime/runtime.go:48 +0x75
panic({0x3cda0e0, 0xc0044a5440})
	/usr/lib64/go/1.17/src/runtime/panic.go:1038 +0x215
github.com/rancher/rancher/pkg/catalogv2/helm.decodeHelm2({0x0, 0xc8268d})
	/go/src/github.com/rancher/rancher/pkg/catalogv2/helm/helm2.go:147 +0x1b1
github.com/rancher/rancher/pkg/catalogv2/helm.fromHelm2Data({0x0, 0xc002372750}, 0x3faf399)
	/go/src/github.com/rancher/rancher/pkg/catalogv2/helm/helm2.go:44 +0x25
github.com/rancher/rancher/pkg/catalogv2/helm.ToRelease({0x4796930, 0xc002372750}, 0x7165722e0a05fc01)
	/go/src/github.com/rancher/rancher/pkg/catalogv2/helm/release.go:76 +0x3cd
github.com/rancher/rancher/pkg/controllers/dashboard/helm.(*appHandler).OnConfigMapChange(0xc0071dbb80, {0xc0025ab200, 0x21}, 0xc002372750)
	/go/src/github.com/rancher/rancher/pkg/controllers/dashboard/helm/apps.go:136 +0xa5
github.com/rancher/wrangler/pkg/generated/controllers/core/v1.FromConfigMapHandlerToHandler.func1({0xc0025ab200, 0x21}, {0x4796930, 0xc002372750})
	/go/src/github.com/rancher/rancher/go/pkg/mod/github.com/rancher/wrangler@v0.8.11-0.20220217210408-3ecd23dfea3b/pkg/generated/controllers/core/v1/configmap.go:102 +0x44
github.com/rancher/lasso/pkg/controller.SharedControllerHandlerFunc.OnChange(0x2a9042ba1510cd11, {0xc0025ab200, 0x74cf06c9da2afd12}, {0x4796930, 0xc002372750})
	/go/src/github.com/rancher/rancher/go/pkg/mod/github.com/rancher/lasso@v0.0.0-20220303220250-a429cb5cb9c9/pkg/controller/sharedcontroller.go:29 +0x38
github.com/rancher/lasso/pkg/controller.(*SharedHandler).OnChange(0xc000baef00, {0xc0025ab200, 0x21}, {0x4796930, 0xc002372750})
	/go/src/github.com/rancher/rancher/go/pkg/mod/github.com/rancher/lasso@v0.0.0-20220303220250-a429cb5cb9c9/pkg/controller/sharedhandler.go:75 +0x23f
github.com/rancher/lasso/pkg/controller.(*controller).syncHandler(0xc0007a1e40, {0xc0025ab200, 0x21})
	/go/src/github.com/rancher/rancher/go/pkg/mod/github.com/rancher/lasso@v0.0.0-20220303220250-a429cb5cb9c9/pkg/controller/controller.go:220 +0x93
github.com/rancher/lasso/pkg/controller.(*controller).processSingleItem(0xc0007a1e40, {0x359f420, 0xc0098db390})
	/go/src/github.com/rancher/rancher/go/pkg/mod/github.com/rancher/lasso@v0.0.0-20220303220250-a429cb5cb9c9/pkg/controller/controller.go:201 +0x10e
github.com/rancher/lasso/pkg/controller.(*controller).processNextWorkItem(0xc0007a1e40)
	/go/src/github.com/rancher/rancher/go/pkg/mod/github.com/rancher/lasso@v0.0.0-20220303220250-a429cb5cb9c9/pkg/controller/controller.go:178 +0x46
github.com/rancher/lasso/pkg/controller.(*controller).runWorker(...)
	/go/src/github.com/rancher/rancher/go/pkg/mod/github.com/rancher/lasso@v0.0.0-20220303220250-a429cb5cb9c9/pkg/controller/controller.go:167
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x7f873e6c4898)
	/go/src/github.com/rancher/rancher/go/pkg/mod/k8s.io/apimachinery@v0.23.3/pkg/util/wait/wait.go:155 +0x67
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xe4f539c322f35eda, {0x4765140, 0xc002fe3dd0}, 0x1, 0xc001af5d40)
	/go/src/github.com/rancher/rancher/go/pkg/mod/k8s.io/apimachinery@v0.23.3/pkg/util/wait/wait.go:156 +0xb6
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc620cde4bb990b35, 0x3b9aca00, 0x0, 0xb1, 0x6a1e87cf084d71fa)
	/go/src/github.com/rancher/rancher/go/pkg/mod/k8s.io/apimachinery@v0.23.3/pkg/util/wait/wait.go:133 +0x89
k8s.io/apimachinery/pkg/util/wait.Until(0x6e80e98f28a38576, 0xf948b85f6da55381, 0xb8ff492ea636f9c2)
	/go/src/github.com/rancher/rancher/go/pkg/mod/k8s.io/apimachinery@v0.23.3/pkg/util/wait/wait.go:90 +0x25
created by github.com/rancher/lasso/pkg/controller.(*controller).run
	/go/src/github.com/rancher/rancher/go/pkg/mod/github.com/rancher/lasso@v0.0.0-20220303220250-a429cb5cb9c9/pkg/controller/controller.go:135 +0x2c6
panic: runtime error: slice bounds out of range [:3] with capacity 0 [recovered]
	panic: runtime error: slice bounds out of range [:3] with capacity 0

goroutine 2735 [running]:
k8s.io/apimachinery/pkg/util/runtime.HandleCrash({0x0, 0x0, 0xc0098db390})
	/go/src/github.com/rancher/rancher/go/pkg/mod/k8s.io/apimachinery@v0.23.3/pkg/util/runtime/runtime.go:55 +0xd8
panic({0x3cda0e0, 0xc0044a5440})
	/usr/lib64/go/1.17/src/runtime/panic.go:1038 +0x215
github.com/rancher/rancher/pkg/catalogv2/helm.decodeHelm2({0x0, 0xc8268d})
	/go/src/github.com/rancher/rancher/pkg/catalogv2/helm/helm2.go:147 +0x1b1
github.com/rancher/rancher/pkg/catalogv2/helm.fromHelm2Data({0x0, 0xc002372750}, 0x3faf399)
	/go/src/github.com/rancher/rancher/pkg/catalogv2/helm/helm2.go:44 +0x25
github.com/rancher/rancher/pkg/catalogv2/helm.ToRelease({0x4796930, 0xc002372750}, 0x7165722e0a05fc01)
	/go/src/github.com/rancher/rancher/pkg/catalogv2/helm/release.go:76 +0x3cd
github.com/rancher/rancher/pkg/controllers/dashboard/helm.(*appHandler).OnConfigMapChange(0xc0071dbb80, {0xc0025ab200, 0x21}, 0xc002372750)
	/go/src/github.com/rancher/rancher/pkg/controllers/dashboard/helm/apps.go:136 +0xa5
github.com/rancher/wrangler/pkg/generated/controllers/core/v1.FromConfigMapHandlerToHandler.func1({0xc0025ab200, 0x21}, {0x4796930, 0xc002372750})
	/go/src/github.com/rancher/rancher/go/pkg/mod/github.com/rancher/wrangler@v0.8.11-0.20220217210408-3ecd23dfea3b/pkg/generated/controllers/core/v1/configmap.go:102 +0x44
github.com/rancher/lasso/pkg/controller.SharedControllerHandlerFunc.OnChange(0x2a9042ba1510cd11, {0xc0025ab200, 0x74cf06c9da2afd12}, {0x4796930, 0xc002372750})
	/go/src/github.com/rancher/rancher/go/pkg/mod/github.com/rancher/lasso@v0.0.0-20220303220250-a429cb5cb9c9/pkg/controller/sharedcontroller.go:29 +0x38
github.com/rancher/lasso/pkg/controller.(*SharedHandler).OnChange(0xc000baef00, {0xc0025ab200, 0x21}, {0x4796930, 0xc002372750})
	/go/src/github.com/rancher/rancher/go/pkg/mod/github.com/rancher/lasso@v0.0.0-20220303220250-a429cb5cb9c9/pkg/controller/sharedhandler.go:75 +0x23f
github.com/rancher/lasso/pkg/controller.(*controller).syncHandler(0xc0007a1e40, {0xc0025ab200, 0x21})
	/go/src/github.com/rancher/rancher/go/pkg/mod/github.com/rancher/lasso@v0.0.0-20220303220250-a429cb5cb9c9/pkg/controller/controller.go:220 +0x93
github.com/rancher/lasso/pkg/controller.(*controller).processSingleItem(0xc0007a1e40, {0x359f420, 0xc0098db390})
	/go/src/github.com/rancher/rancher/go/pkg/mod/github.com/rancher/lasso@v0.0.0-20220303220250-a429cb5cb9c9/pkg/controller/controller.go:201 +0x10e
github.com/rancher/lasso/pkg/controller.(*controller).processNextWorkItem(0xc0007a1e40)
	/go/src/github.com/rancher/rancher/go/pkg/mod/github.com/rancher/lasso@v0.0.0-20220303220250-a429cb5cb9c9/pkg/controller/controller.go:178 +0x46
github.com/rancher/lasso/pkg/controller.(*controller).runWorker(...)
	/go/src/github.com/rancher/rancher/go/pkg/mod/github.com/rancher/lasso@v0.0.0-20220303220250-a429cb5cb9c9/pkg/controller/controller.go:167
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0x7f873e6c4898)
	/go/src/github.com/rancher/rancher/go/pkg/mod/k8s.io/apimachinery@v0.23.3/pkg/util/wait/wait.go:155 +0x67
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xe4f539c322f35eda, {0x4765140, 0xc002fe3dd0}, 0x1, 0xc001af5d40)
	/go/src/github.com/rancher/rancher/go/pkg/mod/k8s.io/apimachinery@v0.23.3/pkg/util/wait/wait.go:156 +0xb6
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc620cde4bb990b35, 0x3b9aca00, 0x0, 0xb1, 0x6a1e87cf084d71fa)
	/go/src/github.com/rancher/rancher/go/pkg/mod/k8s.io/apimachinery@v0.23.3/pkg/util/wait/wait.go:133 +0x89
k8s.io/apimachinery/pkg/util/wait.Until(0x6e80e98f28a38576, 0xf948b85f6da55381, 0xb8ff492ea636f9c2)
	/go/src/github.com/rancher/rancher/go/pkg/mod/k8s.io/apimachinery@v0.23.3/pkg/util/wait/wait.go:90 +0x25
created by github.com/rancher/lasso/pkg/controller.(*controller).run
	/go/src/github.com/rancher/rancher/go/pkg/mod/github.com/rancher/lasso@v0.0.0-20220303220250-a429cb5cb9c9/pkg/controller/controller.go:135 +0x2c6
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment