Skip to content

Instantly share code, notes, and snippets.

@EliiseS

EliiseS/secrets-store-csi-driver-provider-azure.txt

Created July 29, 2022 16:35
Show Gist options
  • Save EliiseS/dab2821dd860e9e0402e7843b71dae82 to your computer and use it in GitHub Desktop.
Save EliiseS/dab2821dd860e9e0402e7843b71dae82 to your computer and use it in GitHub Desktop.
Download ZIP
secrets-store-csi-driver error logs when deployed via Azure ARC onto a K3S cluster
Raw
secrets-store-csi-driver-provider-azure.txt
$ k logs secrets-store-csi-driver-5kskv -n kube-system
{"ts":1659105244858.7698,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659105296077.944,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659105296077.9941,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
# sync as Kubernetes secret clusterrole
$ kubectl get clusterrole/secretprovidersyncing-role
Error from server (NotFound): clusterroles.rbac.authorization.k8s.io "secretprovidersyncing-role" not found
# sync as Kubernetes secret clusterrolebinding
$ kubectl get clusterrolebinding/secretprovidersyncing-rolebinding
Error from server (NotFound): clusterrolebindings.rbac.authorization.k8s.io "secretprovidersyncing-rolebinding" not found
$ kubectl get pods -l app=secrets-store-csi-driver -o wide -n kube-system
secrets-store-csi-driver-5kskv
$ kubectl logs secrets-store-csi-driver-5kskv --since=1h -n kube-system
{"ts":1659106657982.223,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659106657982.27,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659106703460.8137,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659106703460.8623,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659106761405.3408,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659106761405.693,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659106811312.6555,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659106811312.7222,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659106841822.4778,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659106841822.5247,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659106883073.1013,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659106883073.1494,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659106922994.46,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659106922998.2664,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659106973769.586,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659106973769.6255,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107014375.1433,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107014375.1868,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107051832.6843,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107051832.7273,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107091671.7979,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107091671.8442,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107132698.98,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107132699.3057,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107166331.1265,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107166331.1702,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107211934.0808,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107211934.12,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107249847.042,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107249847.0798,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107290572.7998,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107290572.8442,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107349654.9006,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107349654.9443,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107403041.3193,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107403041.3674,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107459746.9001,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107459746.944,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107498020.8508,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107498020.8943,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107539240.9175,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107539240.9597,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107594102.441,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107594102.4863,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107645751.498,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107645751.5447,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107691431.9797,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107691432.0183,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107736603.9272,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107736603.9766,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107781117.102,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107781117.1482,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107830353.6765,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107830353.7244,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107866224.0806,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107866224.1318,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107903522.0513,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107903522.1023,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107951219.9678,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107951220.0117,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107988135.6353,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107988135.679,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659108045050.6318,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659108045050.6755,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659108086885.909,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659108086885.9592,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659108138040.8525,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659108138040.9016,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659108169132.2876,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659108169132.3357,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659108215403.4814,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659108215403.7468,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659108259297.0771,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659108259297.1301,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659108293253.0542,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659108293253.0957,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659108344296.5469,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659108344296.5945,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659108396829.059,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659108396829.1248,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659108449535.4436,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659108449535.484,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659108482502.5522,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659108482502.602,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659108538205.5608,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659108538205.6233,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659108592039.2454,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659108592039.2903,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659108628383.9028,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659108628383.9597,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659108665136.366,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659108665136.7239,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659108697896.2563,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659108697896.3003,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659108754225.177,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659108754225.2292,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659108808666.7546,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659108808666.7954,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659108865955.053,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659108865955.104,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659108914587.4172,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659108914587.4614,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659108962704.0293,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659108962704.086,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659109018600.2693,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659109018600.3157,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659109065683.1357,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659109065683.5605,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659109109389.9797,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659109109390.0305,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659109161564.584,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659109161564.627,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659109196780.5588,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659109196780.605,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659109235121.4568,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659109235121.5134,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659109280350.8325,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659109280350.8765,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659109331993.0627,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659109331993.1152,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659109372997.543,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659109372997.6824,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659109422427.5967,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659109422427.6409,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659109468415.5906,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659109468415.6333,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659109508863.8877,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659109508863.926,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659109550817.6182,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659109550817.665,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659109601158.4817,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659109601158.5244,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659109640411.348,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659109640411.6506,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659109688837.7178,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659109688837.7615,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
$ kubectl get pods -l app=secrets-store-csi-driver -o wide -n kube-system
NAME READY STATUS RESTARTS AGE IP NODE NOMINATED NODE READINESS GATES
secrets-store-csi-driver-5kskv 3/3 Running 0 2d6h 10.42.0.31 device-1 <none> <none>
$ kubectl logs secrets-store-csi-driver-5kskv --since=1h -n kube-system
{"ts":1659106657982.223,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659106657982.27,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659106703460.8137,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659106703460.8623,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659106761405.3408,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659106761405.693,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659106811312.6555,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659106811312.7222,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659106841822.4778,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659106841822.5247,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659106883073.1013,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659106883073.1494,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659106922994.46,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659106922998.2664,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659106973769.586,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659106973769.6255,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107014375.1433,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107014375.1868,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107051832.6843,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107051832.7273,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107091671.7979,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107091671.8442,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107132698.98,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107132699.3057,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107166331.1265,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107166331.1702,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107211934.0808,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107211934.12,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107249847.042,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107249847.0798,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107290572.7998,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107290572.8442,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107349654.9006,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107349654.9443,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107403041.3193,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107403041.3674,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107459746.9001,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107459746.944,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107498020.8508,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107498020.8943,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107539240.9175,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107539240.9597,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107594102.441,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107594102.4863,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107645751.498,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107645751.5447,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107691431.9797,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107691432.0183,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107736603.9272,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107736603.9766,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107781117.102,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107781117.1482,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107830353.6765,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107830353.7244,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107866224.0806,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107866224.1318,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107903522.0513,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107903522.1023,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107951219.9678,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107951220.0117,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659107988135.6353,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659107988135.679,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659108045050.6318,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659108045050.6755,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659108086885.909,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659108086885.9592,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659108138040.8525,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659108138040.9016,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659108169132.2876,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659108169132.3357,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659108215403.4814,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659108215403.7468,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659108259297.0771,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
{"ts":1659108259297.1301,"caller":"cache/reflector.go:138","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: Failed to watch *v1.Secret: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n"}
{"ts":1659108293253.0542,"caller":"cache/reflector.go:324","msg":"pkg/mod/k8s.io/client-go@v0.23.0/tools/cache/reflector.go:167: failed to list *v1.Secret: secrets is forbidden: User \"system:serviceaccount:kube-system:secrets-store-csi-driver\" cannot list resource \"secrets\" in API group \"\" at the cluster scope\n","v":0}
$ az k8s-extension list -g $POC_RG -c $CLUSTER -t connectedClusters
[
{
"aksAssignedIdentity": null,
"autoUpgradeMinorVersion": false,
"configurationProtectedSettings": {
"omsagent.secret.key": "",
"omsagent.secret.wsid": ""
},
"configurationSettings": {
"logAnalyticsWorkspaceResourceID": "/subscriptions/19b90cba-b368-4869-8408-5756739802cd/resourceGroups/le2-poc-rg/providers/Microsoft.OperationalInsights/workspaces/laubjvwrmyyxfny",
"omsagent.domain": "opinsights.azure.com"
},
"customLocationSettings": null,
"errorInfo": null,
"extensionType": "Microsoft.AzureMonitor.Containers",
"id": "/subscriptions/19b90cba-b368-4869-8408-5756739802cd/resourceGroups/le2-poc-rg/providers/Microsoft.Kubernetes/connectedClusters/device-1/providers/Microsoft.KubernetesConfiguration/extensions/azuremonitor-containers",
"identity": null,
"name": "azuremonitor-containers",
"packageUri": null,
"provisioningState": "Succeeded",
"releaseTrain": "stable",
"resourceGroup": "le2-poc-rg",
"scope": {
"cluster": {
"releaseNamespace": "azuremonitor-containers"
},
"namespace": null
},
"statuses": [],
"systemData": {
"createdAt": "2022-07-27T09:28:57.203671+00:00",
"createdBy": null,
"createdByType": null,
"lastModifiedAt": "2022-07-27T09:28:57.203671+00:00",
"lastModifiedBy": null,
"lastModifiedByType": null
},
"type": "Microsoft.KubernetesConfiguration/extensions",
"version": "2.9.3"
},
{
"aksAssignedIdentity": null,
"autoUpgradeMinorVersion": false,
"configurationProtectedSettings": {},
"configurationSettings": {},
"customLocationSettings": null,
"errorInfo": null,
"extensionType": "microsoft.flux",
"id": "/subscriptions/19b90cba-b368-4869-8408-5756739802cd/resourceGroups/le2-poc-rg/providers/Microsoft.Kubernetes/connectedClusters/device-1/providers/Microsoft.KubernetesConfiguration/extensions/flux",
"identity": {
"principalId": "4c340cf6-55b9-471e-a53e-7caf687fc978",
"tenantId": null,
"type": "SystemAssigned"
},
"name": "flux",
"packageUri": null,
"provisioningState": "Succeeded",
"releaseTrain": "stable",
"resourceGroup": "le2-poc-rg",
"scope": {
"cluster": {
"releaseNamespace": "flux-system"
},
"namespace": null
},
"statuses": [],
"systemData": {
"createdAt": "2022-07-25T13:24:12.460020+00:00",
"createdBy": null,
"createdByType": null,
"lastModifiedAt": "2022-07-27T09:28:39.363509+00:00",
"lastModifiedBy": null,
"lastModifiedByType": null
},
"type": "Microsoft.KubernetesConfiguration/extensions",
"version": "1.4.0"
},
{
"aksAssignedIdentity": null,
"autoUpgradeMinorVersion": false,
"configurationProtectedSettings": {},
"configurationSettings": {
"enableSecretRotation": "true",
"rotationPollInterval": "2m",
"syncSecret.enabled": "true"
},
"customLocationSettings": null,
"errorInfo": null,
"extensionType": "Microsoft.AzureKeyVaultSecretsProvider",
"id": "/subscriptions/19b90cba-b368-4869-8408-5756739802cd/resourceGroups/le2-poc-rg/providers/Microsoft.Kubernetes/connectedClusters/device-1/providers/Microsoft.KubernetesConfiguration/extensions/akvsecretsprovider",
"identity": null,
"name": "akvsecretsprovider",
"packageUri": null,
"provisioningState": "Succeeded",
"releaseTrain": "stable",
"resourceGroup": "le2-poc-rg",
"scope": {
"cluster": {
"releaseNamespace": "kube-system"
},
"namespace": null
},
"statuses": [],
"systemData": {
"createdAt": "2022-07-27T09:28:33.615226+00:00",
"createdBy": null,
"createdByType": null,
"lastModifiedAt": "2022-07-27T09:28:33.615226+00:00",
"lastModifiedBy": null,
"lastModifiedByType": null
},
"type": "Microsoft.KubernetesConfiguration/extensions",
"version": "1.1.3"
}
]
$ k describe po secrets-store-csi-driver-5kskv -n kube-system
Name: secrets-store-csi-driver-5kskv
Namespace: kube-system
Priority: 0
Node: device-1/172.16.128.4
Start Time: Wed, 27 Jul 2022 09:30:06 +0000
Labels: app=secrets-store-csi-driver
app.kubernetes.io/instance=akvsecretsprovider
app.kubernetes.io/managed-by=Helm
app.kubernetes.io/name=secrets-store-csi-driver
app.kubernetes.io/version=1.1.2
controller-revision-hash=5f7b9b87bc
helm.sh/chart=secrets-store-csi-driver-1.1.2
pod-template-generation=1
Annotations: kubectl.kubernetes.io/default-container: secrets-store
prometheus.io/port: 8080
prometheus.io/scrape: true
Status: Running
IP: 10.42.0.31
IPs:
IP: 10.42.0.31
Controlled By: DaemonSet/secrets-store-csi-driver
Containers:
node-driver-registrar:
Container ID: containerd://d4de77306a44c006df4a9a1a9e3d1fe7889d6e425f81a10b2ee053d9dd5dc18b
Image: mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar:v2.5.0
Image ID: mcr.microsoft.com/oss/kubernetes-csi/csi-node-driver-registrar@sha256:348b2d4eebc8da38687755a69b6c21035be232325a6bcde54e5ec4e04689fd93
Port: <none>
Host Port: <none>
Args:
--v=5
--csi-address=/csi/csi.sock
--kubelet-registration-path=/var/lib/kubelet/plugins/csi-secrets-store/csi.sock
State: Running
Started: Wed, 27 Jul 2022 09:30:09 +0000
Ready: True
Restart Count: 0
Limits:
cpu: 100m
memory: 100Mi
Requests:
cpu: 10m
memory: 20Mi
Liveness: exec [/csi-node-driver-registrar --kubelet-registration-path=/var/lib/kubelet/plugins/csi-secrets-store/csi.sock --mode=kubelet-registration-probe] delay=30s timeout=15s period=10s #success=1 #failure=3
Environment:
KUBE_NODE_NAME: (v1:spec.nodeName)
Mounts:
/csi from plugin-dir (rw)
/registration from registration-dir (rw)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-qbx8k (ro)
secrets-store:
Container ID: containerd://94d35943845f2be166361bd1e8180f6230af9f4869316adc70444621d526d9d8
Image: mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver:v1.1.2
Image ID: mcr.microsoft.com/oss/kubernetes-csi/secrets-store/driver@sha256:3fc4d1e87199aea6e770e63f557aac04afecd3b32f650493319a47be88505004
Ports: 9808/TCP, 8080/TCP
Host Ports: 0/TCP, 0/TCP
Args:
--log-format-json=true
--endpoint=$(CSI_ENDPOINT)
--nodeid=$(KUBE_NODE_NAME)
--provider-volume=/etc/kubernetes/secrets-store-csi-providers
--additional-provider-volume-paths=/var/run/secrets-store-csi-providers
--rotation-poll-interval=2m
--metrics-addr=:8080
--provider-health-check-interval=2m
--max-call-recv-msg-size=4194304
State: Running
Started: Wed, 27 Jul 2022 09:30:15 +0000
Ready: True
Restart Count: 0
Limits:
cpu: 200m
memory: 200Mi
Requests:
cpu: 50m
memory: 100Mi
Liveness: http-get http://:healthz/healthz delay=30s timeout=10s period=15s #success=1 #failure=5
Environment:
CSI_ENDPOINT: unix:///csi/csi.sock
KUBE_NODE_NAME: (v1:spec.nodeName)
Mounts:
/csi from plugin-dir (rw)
/etc/kubernetes/secrets-store-csi-providers from providers-dir (rw)
/var/lib/kubelet/pods from mountpoint-dir (rw)
/var/run/secrets-store-csi-providers from providers-dir-0 (rw)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-qbx8k (ro)
liveness-probe:
Container ID: containerd://0968bac9610123f1d006ebddaf2e3d60dc6004041677da6de189090e4a838511
Image: mcr.microsoft.com/oss/kubernetes-csi/livenessprobe:v2.6.0
Image ID: mcr.microsoft.com/oss/kubernetes-csi/livenessprobe@sha256:e01f5dae19d7e1be536606fe5deb893417429486b628b816d80ffa0e441eeae8
Port: <none>
Host Port: <none>
Args:
--csi-address=/csi/csi.sock
--probe-timeout=3s
--http-endpoint=0.0.0.0:9808
-v=2
State: Running
Started: Wed, 27 Jul 2022 09:30:16 +0000
Ready: True
Restart Count: 0
Limits:
cpu: 100m
memory: 100Mi
Requests:
cpu: 10m
memory: 20Mi
Environment: <none>
Mounts:
/csi from plugin-dir (rw)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-qbx8k (ro)
Conditions:
Type Status
Initialized True
Ready True
ContainersReady True
PodScheduled True
Volumes:
mountpoint-dir:
Type: HostPath (bare host directory volume)
Path: /var/lib/kubelet/pods
HostPathType: DirectoryOrCreate
registration-dir:
Type: HostPath (bare host directory volume)
Path: /var/lib/kubelet/plugins_registry/
HostPathType: Directory
plugin-dir:
Type: HostPath (bare host directory volume)
Path: /var/lib/kubelet/plugins/csi-secrets-store/
HostPathType: DirectoryOrCreate
providers-dir:
Type: HostPath (bare host directory volume)
Path: /etc/kubernetes/secrets-store-csi-providers
HostPathType: DirectoryOrCreate
providers-dir-0:
Type: HostPath (bare host directory volume)
Path: /var/run/secrets-store-csi-providers
HostPathType: DirectoryOrCreate
kube-api-access-qbx8k:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
QoS Class: Burstable
Node-Selectors: kubernetes.io/os=linux
Tolerations: node.kubernetes.io/disk-pressure:NoSchedule op=Exists
node.kubernetes.io/memory-pressure:NoSchedule op=Exists
node.kubernetes.io/not-ready:NoExecute op=Exists
node.kubernetes.io/pid-pressure:NoSchedule op=Exists
node.kubernetes.io/unreachable:NoExecute op=Exists
node.kubernetes.io/unschedulable:NoSchedule op=Exists
Events: <none>
$ kubectl logs -n kube-system arc-monitoring-85d99f94d5-dvmsr fluentd
2022-07-28 11:09:06 +0000 [info]: parsing config file is succeeded path="/etc/fluentd/fluentd.conf"
2022-07-28 11:09:07 +0000 [info]: gem 'fluent-plugin-azureeventhubs' version '0.0.7'
2022-07-28 11:09:07 +0000 [info]: gem 'fluent-plugin-colomanager-heartbeat' version '0.1.0'
2022-07-28 11:09:07 +0000 [info]: gem 'fluent-plugin-concat' version '2.4.0'
2022-07-28 11:09:07 +0000 [info]: gem 'fluent-plugin-elasticsearch' version '5.0.3'
2022-07-28 11:09:07 +0000 [info]: gem 'fluent-plugin-filter_redfishmetric' version '0.0.3'
2022-07-28 11:09:07 +0000 [info]: gem 'fluent-plugin-flatten-hash' version '0.5.1'
2022-07-28 11:09:07 +0000 [info]: gem 'fluent-plugin-flowcounter-simple' version '0.1.0'
2022-07-28 11:09:07 +0000 [info]: gem 'fluent-plugin-hanarp-message' version '0.1.0'
2022-07-28 11:09:07 +0000 [info]: gem 'fluent-plugin-json-transform' version '0.0.1'
2022-07-28 11:09:07 +0000 [info]: gem 'fluent-plugin-kafka' version '0.16.1'
2022-07-28 11:09:07 +0000 [info]: gem 'fluent-plugin-kubernetes_metadata_filter' version '2.5.3'
2022-07-28 11:09:07 +0000 [info]: gem 'fluent-plugin-mdm' version '0.1.0'
2022-07-28 11:09:07 +0000 [info]: gem 'fluent-plugin-mdsd' version '0.1.9.pre.build.dev'
2022-07-28 11:09:07 +0000 [info]: gem 'fluent-plugin-multi-format-parser' version '1.0.0'
2022-07-28 11:09:07 +0000 [info]: gem 'fluent-plugin-process-redfishalert' version '0.1.0'
2022-07-28 11:09:07 +0000 [info]: gem 'fluent-plugin-process-snmptrap' version '0.1.0'
2022-07-28 11:09:07 +0000 [info]: gem 'fluent-plugin-process-ucs-syslog' version '0.1.0'
2022-07-28 11:09:07 +0000 [info]: gem 'fluent-plugin-prometheus' version '2.0.1'
2022-07-28 11:09:07 +0000 [info]: gem 'fluent-plugin-prometheus' version '1.8.5'
2022-07-28 11:09:07 +0000 [info]: gem 'fluent-plugin-prometheus_pushgateway' version '0.0.2'
2022-07-28 11:09:07 +0000 [info]: gem 'fluent-plugin-record-modifier' version '2.1.0'
2022-07-28 11:09:07 +0000 [info]: gem 'fluent-plugin-rewrite-tag-filter' version '2.4.0'
2022-07-28 11:09:07 +0000 [info]: gem 'fluent-plugin-route' version '1.0.0'
2022-07-28 11:09:07 +0000 [info]: gem 'fluent-plugin-s3' version '1.6.0'
2022-07-28 11:09:07 +0000 [info]: gem 'fluent-plugin-sd-dns' version '0.1.0'
2022-07-28 11:09:07 +0000 [info]: gem 'fluent-plugin-servicebus-queue' version '0.1.0'
2022-07-28 11:09:07 +0000 [info]: gem 'fluent-plugin-snmptrapalert' version '0.1.0'
2022-07-28 11:09:07 +0000 [info]: gem 'fluent-plugin-systemd' version '1.0.2'
2022-07-28 11:09:07 +0000 [info]: gem 'fluent-plugin-systemd' version '0.3.1'
2022-07-28 11:09:07 +0000 [info]: gem 'fluent-plugin-td' version '1.1.0'
2022-07-28 11:09:07 +0000 [info]: gem 'fluent-plugin-throttle' version '0.0.3'
2022-07-28 11:09:07 +0000 [info]: gem 'fluent-plugin-utmpx' version '0.5.0'
2022-07-28 11:09:07 +0000 [info]: gem 'fluent-plugin-webhdfs' version '1.4.0'
2022-07-28 11:09:07 +0000 [info]: gem 'fluentd' version '1.12.4'
2022-07-28 11:09:07 +0000 [info]: gem 'fluentd' version '1.11.5'
2022-07-28 11:09:07 +0000 [info]: gem 'fluentd' version '0.12.43'
#<Thread:0x0000564491f875d8 /opt/td-agent/lib/ruby/gems/2.7.0/gems/fluent-plugin-kubernetes_metadata_filter-2.5.3/lib/fluent/plugin/filter_kubernetes_metadata.rb:254 run> terminated with exception (report_on_exception is true):
/opt/td-agent/lib/ruby/gems/2.7.0/gems/fluent-plugin-kubernetes_metadata_filter-2.5.3/lib/fluent/plugin/kubernetes_metadata_watch_namespaces.rb:86:in `rescue in start_namespace_watch': start_namespace_watch: Exception encountered setting up namespace watch from Kubernetes API v1 endpoint https://10.43.0.1:443/api: namespaces is forbidden: User "system:serviceaccount:kube-system:csi-secrets-store-provider-azure" cannot list resource "namespaces" in API group "" at the cluster scope ({"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"namespaces is forbidden: User \\"system:serviceaccount:kube-system:csi-secrets-store-provider-azure\\" cannot list resource \\"namespaces\\" in API group \\"\\" at the cluster scope","reason":"Forbidden","details":{"kind":"namespaces"},"code":403} (Fluent::ConfigError)
)
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/fluent-plugin-kubernetes_metadata_filter-2.5.3/lib/fluent/plugin/kubernetes_metadata_watch_namespaces.rb:77:in `start_namespace_watch'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/fluent-plugin-kubernetes_metadata_filter-2.5.3/lib/fluent/plugin/kubernetes_metadata_watch_namespaces.rb:31:in `set_up_namespace_thread'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/fluent-plugin-kubernetes_metadata_filter-2.5.3/lib/fluent/plugin/filter_kubernetes_metadata.rb:254:in `block in configure'
/opt/td-agent/lib/ruby/gems/2.7.0/gems/kubeclient-4.9.3/lib/kubeclient/common.rb:130:in `rescue in handle_exception': namespaces is forbidden: User "system:serviceaccount:kube-system:csi-secrets-store-provider-azure" cannot list resource "namespaces" in API group "" at the cluster scope (Kubeclient::HttpError)
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/kubeclient-4.9.3/lib/kubeclient/common.rb:120:in `handle_exception'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/kubeclient-4.9.3/lib/kubeclient/common.rb:350:in `get_entities'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/kubeclient-4.9.3/lib/kubeclient/common.rb:224:in `block (2 levels) in define_entity_methods'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/kubeclient-4.9.3/lib/kubeclient/common.rb:101:in `method_missing'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/fluent-plugin-kubernetes_metadata_filter-2.5.3/lib/fluent/plugin/kubernetes_metadata_watch_namespaces.rb:95:in `get_namespaces_and_start_watcher'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/fluent-plugin-kubernetes_metadata_filter-2.5.3/lib/fluent/plugin/kubernetes_metadata_watch_namespaces.rb:78:in `start_namespace_watch'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/fluent-plugin-kubernetes_metadata_filter-2.5.3/lib/fluent/plugin/kubernetes_metadata_watch_namespaces.rb:31:in `set_up_namespace_thread'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/fluent-plugin-kubernetes_metadata_filter-2.5.3/lib/fluent/plugin/filter_kubernetes_metadata.rb:254:in `block in configure'
/opt/td-agent/lib/ruby/gems/2.7.0/gems/rest-client-2.1.0/lib/restclient/abstract_response.rb:249:in `exception_with_response': 403 Forbidden (RestClient::Forbidden)
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/rest-client-2.1.0/lib/restclient/abstract_response.rb:129:in `return!'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/rest-client-2.1.0/lib/restclient/request.rb:836:in `process_result'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/rest-client-2.1.0/lib/restclient/request.rb:743:in `block in transmit'
from /opt/td-agent/lib/ruby/2.7.0/net/http.rb:933:in `start'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/rest-client-2.1.0/lib/restclient/request.rb:727:in `transmit'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/rest-client-2.1.0/lib/restclient/request.rb:163:in `execute'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/rest-client-2.1.0/lib/restclient/request.rb:63:in `execute'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/rest-client-2.1.0/lib/restclient/resource.rb:51:in `get'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/kubeclient-4.9.3/lib/kubeclient/common.rb:352:in `block in get_entities'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/kubeclient-4.9.3/lib/kubeclient/common.rb:121:in `handle_exception'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/kubeclient-4.9.3/lib/kubeclient/common.rb:350:in `get_entities'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/kubeclient-4.9.3/lib/kubeclient/common.rb:224:in `block (2 levels) in define_entity_methods'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/kubeclient-4.9.3/lib/kubeclient/common.rb:101:in `method_missing'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/fluent-plugin-kubernetes_metadata_filter-2.5.3/lib/fluent/plugin/kubernetes_metadata_watch_namespaces.rb:95:in `get_namespaces_and_start_watcher'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/fluent-plugin-kubernetes_metadata_filter-2.5.3/lib/fluent/plugin/kubernetes_metadata_watch_namespaces.rb:78:in `start_namespace_watch'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/fluent-plugin-kubernetes_metadata_filter-2.5.3/lib/fluent/plugin/kubernetes_metadata_watch_namespaces.rb:31:in `set_up_namespace_thread'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/fluent-plugin-kubernetes_metadata_filter-2.5.3/lib/fluent/plugin/filter_kubernetes_metadata.rb:254:in `block in configure'
2022-07-28 11:09:22 +0000 [error]: config error file="/etc/fluentd/fluentd.conf" error_class=Fluent::ConfigError error="start_namespace_watch: Exception encountered setting up namespace watch from Kubernetes API v1 endpoint https://10.43.0.1:443/api: namespaces is forbidden: User \"system:serviceaccount:kube-system:csi-secrets-store-provider-azure\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope ({\"kind\":\"Status\",\"apiVersion\":\"v1\",\"metadata\":{},\"status\":\"Failure\",\"message\":\"namespaces is forbidden: User \\\"system:serviceaccount:kube-system:csi-secrets-store-provider-azure\\\" cannot list resource \\\"namespaces\\\" in API group \\\"\\\" at the cluster scope\",\"reason\":\"Forbidden\",\"details\":{\"kind\":\"namespaces\"},\"code\":403}\n)"
#<Thread:0x0000564491f876c8 /opt/td-agent/lib/ruby/gems/2.7.0/gems/fluent-plugin-kubernetes_metadata_filter-2.5.3/lib/fluent/plugin/filter_kubernetes_metadata.rb:251 run> terminated with exception (report_on_exception is true):
/opt/td-agent/lib/ruby/gems/2.7.0/gems/fluent-plugin-kubernetes_metadata_filter-2.5.3/lib/fluent/plugin/kubernetes_metadata_watch_pods.rb:88:in `rescue in start_pod_watch': start_pod_watch: Exception encountered setting up pod watch from Kubernetes API v1 endpoint https://10.43.0.1:443/api: pods is forbidden: User "system:serviceaccount:kube-system:csi-secrets-store-provider-azure" cannot list resource "pods" in API group "" at the cluster scope ({"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"pods is forbidden: User \\"system:serviceaccount:kube-system:csi-secrets-store-provider-azure\\" cannot list resource \\"pods\\" in API group \\"\\" at the cluster scope","reason":"Forbidden","details":{"kind":"pods"},"code":403} (Fluent::ConfigError)
)
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/fluent-plugin-kubernetes_metadata_filter-2.5.3/lib/fluent/plugin/kubernetes_metadata_watch_pods.rb:79:in `start_pod_watch'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/fluent-plugin-kubernetes_metadata_filter-2.5.3/lib/fluent/plugin/kubernetes_metadata_watch_pods.rb:32:in `set_up_pod_thread'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/fluent-plugin-kubernetes_metadata_filter-2.5.3/lib/fluent/plugin/filter_kubernetes_metadata.rb:251:in `block in configure'
/opt/td-agent/lib/ruby/gems/2.7.0/gems/kubeclient-4.9.3/lib/kubeclient/common.rb:130:in `rescue in handle_exception': pods is forbidden: User "system:serviceaccount:kube-system:csi-secrets-store-provider-azure" cannot list resource "pods" in API group "" at the cluster scope (Kubeclient::HttpError)
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/kubeclient-4.9.3/lib/kubeclient/common.rb:120:in `handle_exception'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/kubeclient-4.9.3/lib/kubeclient/common.rb:350:in `get_entities'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/kubeclient-4.9.3/lib/kubeclient/common.rb:224:in `block (2 levels) in define_entity_methods'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/kubeclient-4.9.3/lib/kubeclient/common.rb:101:in `method_missing'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/fluent-plugin-kubernetes_metadata_filter-2.5.3/lib/fluent/plugin/kubernetes_metadata_watch_pods.rb:103:in `get_pods_and_start_watcher'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/fluent-plugin-kubernetes_metadata_filter-2.5.3/lib/fluent/plugin/kubernetes_metadata_watch_pods.rb:80:in `start_pod_watch'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/fluent-plugin-kubernetes_metadata_filter-2.5.3/lib/fluent/plugin/kubernetes_metadata_watch_pods.rb:32:in `set_up_pod_thread'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/fluent-plugin-kubernetes_metadata_filter-2.5.3/lib/fluent/plugin/filter_kubernetes_metadata.rb:251:in `block in configure'
/opt/td-agent/lib/ruby/gems/2.7.0/gems/rest-client-2.1.0/lib/restclient/abstract_response.rb:249:in `exception_with_response': 403 Forbidden (RestClient::Forbidden)
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/rest-client-2.1.0/lib/restclient/abstract_response.rb:129:in `return!'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/rest-client-2.1.0/lib/restclient/request.rb:836:in `process_result'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/rest-client-2.1.0/lib/restclient/request.rb:743:in `block in transmit'
from /opt/td-agent/lib/ruby/2.7.0/net/http.rb:933:in `start'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/rest-client-2.1.0/lib/restclient/request.rb:727:in `transmit'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/rest-client-2.1.0/lib/restclient/request.rb:163:in `execute'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/rest-client-2.1.0/lib/restclient/request.rb:63:in `execute'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/rest-client-2.1.0/lib/restclient/resource.rb:51:in `get'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/kubeclient-4.9.3/lib/kubeclient/common.rb:352:in `block in get_entities'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/kubeclient-4.9.3/lib/kubeclient/common.rb:121:in `handle_exception'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/kubeclient-4.9.3/lib/kubeclient/common.rb:350:in `get_entities'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/kubeclient-4.9.3/lib/kubeclient/common.rb:224:in `block (2 levels) in define_entity_methods'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/kubeclient-4.9.3/lib/kubeclient/common.rb:101:in `method_missing'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/fluent-plugin-kubernetes_metadata_filter-2.5.3/lib/fluent/plugin/kubernetes_metadata_watch_pods.rb:103:in `get_pods_and_start_watcher'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/fluent-plugin-kubernetes_metadata_filter-2.5.3/lib/fluent/plugin/kubernetes_metadata_watch_pods.rb:80:in `start_pod_watch'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/fluent-plugin-kubernetes_metadata_filter-2.5.3/lib/fluent/plugin/kubernetes_metadata_watch_pods.rb:32:in `set_up_pod_thread'
from /opt/td-agent/lib/ruby/gems/2.7.0/gems/fluent-plugin-kubernetes_metadata_filter-2.5.3/lib/fluent/plugin/filter_kubernetes_metadata.rb:251:in `block in configure'
$ kubectl describe deployment -n kube-system arc-monitoring
Name: arc-monitoring
Namespace: kube-system
CreationTimestamp: Wed, 27 Jul 2022 09:30:06 +0000
Labels: app=arc-monitoring
app.kubernetes.io/instance=akvsecretsprovider
app.kubernetes.io/managed-by=Helm
app.kubernetes.io/name=arc-akvsecretsprovider-csi-secrets-store-provider-azure
app.kubernetes.io/version=1.1.0
helm.sh/chart=csi-secrets-store-provider-azure-1.1.3
Annotations: deployment.kubernetes.io/revision: 1
meta.helm.sh/release-name: akvsecretsprovider
meta.helm.sh/release-namespace: kube-system
Selector: app=arc-monitoring
Replicas: 1 desired | 1 updated | 1 total | 0 available | 1 unavailable
StrategyType: RollingUpdate
MinReadySeconds: 0
RollingUpdateStrategy: 25% max unavailable, 25% max surge
Pod Template:
Labels: app=arc-monitoring
app.kubernetes.io/instance=akvsecretsprovider
app.kubernetes.io/managed-by=Helm
app.kubernetes.io/name=arc-akvsecretsprovider-csi-secrets-store-provider-azure
app.kubernetes.io/version=1.1.0
helm.sh/chart=csi-secrets-store-provider-azure-1.1.3
Service Account: csi-secrets-store-provider-azure
Containers:
prom-mdm-converter:
Image: upstreamarc.azurecr.io/prom-mdm-converter:v1.0.0
Port: <none>
Host Port: <none>
Limits:
cpu: 50m
memory: 100Mi
Requests:
cpu: 50m
memory: 100Mi
Environment:
SERVER_PORT: 8090
EXTENSION_RESOURCE_ID: /subscriptions/19b90cba-b368-4869-8408-5756739802cd/resourceGroups/le2-poc-rg/providers/Microsoft.Kubernetes/ConnectedClusters/device-1/providers/Microsoft.KubernetesConfiguration/extensions/akvsecretsprovider
Mounts: <none>
mdm:
Image: linuxgeneva-microsoft.azurecr.io/genevamdm:master_20220401.1
Port: <none>
Host Port: <none>
Limits:
cpu: 50m
memory: 100Mi
Requests:
cpu: 50m
memory: 100Mi
Environment:
ROLEINSTANCE: (v1:spec.nodeName)
CONFIG_OVERRIDES_FILE: /tmp/geneva_mdm/mdmconfig.json
MDM_INPUT: statsd_udp,statsd_tcp
MDM_LOG_LEVEL: Info
Mounts:
/tmp/geneva_mdm from mdm-config (rw)
msi-adapter:
Image: mcr.microsoft.com/azurearck8s/msi-adapter:1.0.0
Port: <none>
Host Port: <none>
Limits:
cpu: 50m
memory: 100Mi
Requests:
cpu: 50m
memory: 100Mi
Environment:
TOKEN_NAMESPACE: kube-system
EXTENSION_ARMID: /subscriptions/19b90cba-b368-4869-8408-5756739802cd/resourceGroups/le2-poc-rg/providers/Microsoft.Kubernetes/ConnectedClusters/device-1/providers/Microsoft.KubernetesConfiguration/extensions/akvsecretsprovider
EXTENSION_NAME: akvsecretsprovider
CLUSTER_TYPE: ConnectedClusters
CLUSTER_IDENTITY: false
MANAGED_IDENTITY_AUTH: true
TEST_MODE: false
Mounts: <none>
telegraf:
Image: mcr.microsoft.com/oss/mirror/docker.io/library/telegraf:1.21
Port: <none>
Host Port: <none>
Limits:
cpu: 50m
memory: 100Mi
Requests:
cpu: 50m
memory: 100Mi
Environment: <none>
Mounts:
/etc/telegraf/telegraf.conf from telegraf-conf (rw,path="telegraf.conf")
amacoreagent:
Image: pipelineagent.azurecr.io/amacoreagent:3.0
Port: <none>
Host Port: <none>
Limits:
cpu: 50m
memory: 100Mi
Requests:
cpu: 50m
memory: 100Mi
Environment:
MONITORING_GCS_AUTH_ID_TYPE: AuthMSIToken
PA_TENANTS_DIR: /etc/tenants
PA_GIG_BRIDGE_MODE: 1
PA_FLUENT_SOCKET_PORT: 15000
PA_TRACEFLAGS: 4
OTLP_DEBUG_VERBOSE: 1
FLUENTD_PORT: 8130
MDSD_DEBUG_LOG_FLAGS: -T 0x2002
TENANT: westus2
ROLE: akvsecretsprovider
ROLEINSTANCE: (v1:spec.nodeName)
MONITORING_TENANT: westus2
MONITORING_ROLE: akvsecretsprovider
MONITORING_ROLE_INSTANCE: (v1:spec.nodeName)
MONITORING_GCS_ENVIRONMENT: DiagnosticsPROD
MONITORING_GCS_ACCOUNT: akvsecretsprovider
MONITORING_GCS_REGION: westus2
MONITORING_GCS_NAMESPACE: akvsecretsprovider
MONITORING_CONFIG_VERSION: 1.0
MDSD_CONFIG_DIR: /tmp
DOCKER_LOGGING: true
Mounts:
/etc/tenants from tenants-conf-vol (rw)
/geneva/geneva_logs from var-log-vol (rw)
/var/run/mdsd from mdsd-run-vol (rw)
fluentd:
Image: linuxgeneva-microsoft.azurecr.io/genevafluentd_td-agent:master_20220403.1
Port: <none>
Host Port: <none>
Limits:
cpu: 50m
memory: 100Mi
Requests:
cpu: 50m
memory: 100Mi
Environment:
FLUENTD_CONF: /etc/fluentd/fluentd.conf
Mounts:
/etc/fluentd from fluentd-conf-vol (rw)
/run/log/journal from run-journal-vol (ro)
/var/lib/docker/containers from docker-log-vol (ro)
/var/log from var-log-vol (rw)
/var/log/td-agent from fluentd-buffer-vol (rw)
/var/run/mdsd from mdsd-run-vol (rw)
Volumes:
telegraf-conf:
Type: ConfigMap (a volume populated by a ConfigMap)
Name: arc-telegraf-config
Optional: false
mdm-config:
Type: ConfigMap (a volume populated by a ConfigMap)
Name: arc-mdm-config
Optional: false
mdsd-run-vol:
Type: EmptyDir (a temporary directory that shares a pod's lifetime)
Medium:
SizeLimit: <unset>
var-log-vol:
Type: HostPath (bare host directory volume)
Path: /var/log
HostPathType:
run-journal-vol:
Type: HostPath (bare host directory volume)
Path: /run/log/journal
HostPathType:
fluentd-buffer-vol:
Type: EmptyDir (a temporary directory that shares a pod's lifetime)
Medium:
SizeLimit: <unset>
docker-log-vol:
Type: HostPath (bare host directory volume)
Path: /var/lib/docker/containers
HostPathType:
fluentd-conf-vol:
Type: ConfigMap (a volume populated by a ConfigMap)
Name: arc-fluentd-conf
Optional: false
tenants-conf-vol:
Type: ConfigMap (a volume populated by a ConfigMap)
Name: arc-gcstenant-conf
Optional: false
Conditions:
Type Status Reason
---- ------ ------
Progressing True NewReplicaSetAvailable
Available False MinimumReplicasUnavailable
OldReplicaSets: <none>
NewReplicaSet: arc-monitoring-85d99f94d5 (1/1 replicas created)
Events: <none>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment