Skip to content

Instantly share code, notes, and snippets.

@divyenpatel
Created July 14, 2022 15:18
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save divyenpatel/f8e7afe6c67068b008de2f6bbd8c82f9 to your computer and use it in GitHub Desktop.
Save divyenpatel/f8e7afe6c67068b008de2f6bbd8c82f9 to your computer and use it in GitHub Desktop.
July-4th-2022-VCP-CSI-Migration-Tests-Result
This file has been truncated, but you can view the full file.
make: Entering directory `/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver'
hack/run-e2e-test.sh
Jul 4 03:31:20.705: INFO: The --provider flag is not set. Continuing as if --provider=skeleton had been used.
W0704 03:31:20.705021 10911 test_context.go:461] Unable to find in-cluster config, using default host : https://127.0.0.1:6443
Running Suite: CNS CSI Driver End-to-End Tests
==============================================
Random Seed: 1656930610 - Will randomize all specs
Will run 18 of 613 specs
SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[csi-vcp-mig] VCP to CSI migration create/delete tests
Create volumes using VCP SC with parameters supported by CSI before and after migration
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_create_delete.go:190
[BeforeEach] [csi-vcp-mig] VCP to CSI migration create/delete tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/go/pkg/mod/k8s.io/kubernetes@v1.24.2/test/e2e/framework/framework.go:187
STEP: Creating a kubernetes client
Jul 4 03:31:20.897: INFO: >>> kubeConfig: /home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config
STEP: Building a namespace api object, basename csi-vcp-mig-create-del
W0704 03:31:20.984250 10911 warnings.go:70] policy/v1beta1 PodSecurityPolicy is deprecated in v1.21+, unavailable in v1.25+
Jul 4 03:31:20.984: INFO: Found PodSecurityPolicies; testing pod creation to see if PodSecurityPolicy is enabled
Jul 4 03:31:21.004: INFO: No PSP annotation exists on dry run pod; assuming PodSecurityPolicy is disabled
STEP: Waiting for a default service account to be provisioned in namespace
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[BeforeEach] [csi-vcp-mig] VCP to CSI migration create/delete tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_create_delete.go:64
Jul 4 03:31:21.133: INFO: Search candidates vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 03:31:21.133: INFO: Searching for node with UUID: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 03:31:21.133: INFO: Searching for node with UUID: 4201f777-84d8-9463-c37d-868274d333cb
Jul 4 03:31:21.133: INFO: Searching for node with UUID: 42019a83-8fab-0ed3-6745-5980c88e61be
Jul 4 03:31:21.133: INFO: Searching for node with UUID: 42019292-0601-e6cc-cf83-9e7ad2ff1147
Jul 4 03:31:21.133: INFO: Searching for node with UUID: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:31:21.133: INFO: Searching for node with UUID: 4201c124-84e2-596b-a670-ef0e99be85a5
Jul 4 03:31:22.324: INFO: Found node k8s-control-292-1656928177 as vm=VirtualMachine:vm-50 placed on host=HostSystem:host-22 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 03:31:22.332: INFO: Found node k8s-node-236-1656928234 as vm=VirtualMachine:vm-52 placed on host=HostSystem:host-34 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 03:31:22.583: INFO: Found node k8s-node-990-1656928220 as vm=VirtualMachine:vm-53 placed on host=HostSystem:host-16 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 03:31:22.608: INFO: Found node k8s-control-280-1656928192 as vm=VirtualMachine:vm-54 placed on host=HostSystem:host-28 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 03:31:22.650: INFO: Found node k8s-node-148-1656928247 as vm=VirtualMachine:vm-51 placed on host=HostSystem:host-28 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 03:31:22.681: INFO: Found node k8s-control-468-1656928206 as vm=VirtualMachine:vm-55 placed on host=HostSystem:host-34 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 03:31:22.693: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.43.70
Jul 4 03:31:24.642: INFO: host: 10.185.43.70, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 1, stdout: , stderr:
[It] Create volumes using VCP SC with parameters supported by CSI before and after migration
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_create_delete.go:190
STEP: Creating VCP SCs
STEP: Creating StorageClass with scParameters: map[datastore:vsanDatastore] and zones: [] and ReclaimPolicy: and allowVolumeExpansion: false
STEP: Creating StorageClass with scParameters: map[storagePolicyName:vSAN Default Storage Policy] and zones: [] and ReclaimPolicy: and allowVolumeExpansion: false
STEP: Creating StorageClass with scParameters: map[fstype:ext3 storagePolicyName:vSAN Default Storage Policy] and zones: [] and ReclaimPolicy: and allowVolumeExpansion: false
STEP: Creating VCP PVCs before migration
STEP: Creating PVC using the Storage Class vcp-sc-g6v47 with disk size and labels: map[] accessMode:
Jul 4 03:31:24.718: INFO: PVC created: pvc-bqgws in namespace: csi-vcp-mig-create-del-8081
STEP: Creating PVC using the Storage Class vcp-sc-vh58j with disk size and labels: map[] accessMode:
Jul 4 03:31:24.732: INFO: PVC created: pvc-tn7pj in namespace: csi-vcp-mig-create-del-8081
STEP: Creating PVC using the Storage Class vcp-sc-qr2sz with disk size and labels: map[] accessMode:
Jul 4 03:31:24.743: INFO: PVC created: pvc-grk7k in namespace: csi-vcp-mig-create-del-8081
STEP: Waiting for all claims created before migration to be in bound state
Jul 4 03:31:24.744: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-bqgws] to have phase Bound
Jul 4 03:31:24.772: INFO: PersistentVolumeClaim pvc-bqgws found but phase is Pending instead of Bound.
Jul 4 03:31:26.782: INFO: PersistentVolumeClaim pvc-bqgws found but phase is Pending instead of Bound.
Jul 4 03:31:28.792: INFO: PersistentVolumeClaim pvc-bqgws found and phase=Bound (4.048159964s)
Jul 4 03:31:28.806: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-tn7pj] to have phase Bound
Jul 4 03:31:28.812: INFO: PersistentVolumeClaim pvc-tn7pj found but phase is Pending instead of Bound.
Jul 4 03:31:30.822: INFO: PersistentVolumeClaim pvc-tn7pj found but phase is Pending instead of Bound.
Jul 4 03:31:32.841: INFO: PersistentVolumeClaim pvc-tn7pj found but phase is Pending instead of Bound.
Jul 4 03:31:34.853: INFO: PersistentVolumeClaim pvc-tn7pj found but phase is Pending instead of Bound.
Jul 4 03:31:36.867: INFO: PersistentVolumeClaim pvc-tn7pj found but phase is Pending instead of Bound.
Jul 4 03:31:38.879: INFO: PersistentVolumeClaim pvc-tn7pj found but phase is Pending instead of Bound.
Jul 4 03:31:40.892: INFO: PersistentVolumeClaim pvc-tn7pj found but phase is Pending instead of Bound.
Jul 4 03:31:42.904: INFO: PersistentVolumeClaim pvc-tn7pj found and phase=Bound (14.098082147s)
Jul 4 03:31:42.919: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-grk7k] to have phase Bound
Jul 4 03:31:42.926: INFO: PersistentVolumeClaim pvc-grk7k found and phase=Bound (6.972417ms)
STEP: Enabling CSIMigration and CSIMigrationvSphere feature gates on kube-controller-manager
Jul 4 03:31:42.953: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.43.70
Jul 4 03:31:43.949: INFO: host: 10.185.43.70, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 1, stdout: , stderr:
Jul 4 03:31:43.949: INFO: Invoking command gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.43.70
Jul 4 03:31:44.665: INFO: host: 10.185.43.70, command: gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 03:31:44.665: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.43.70
Jul 4 03:31:45.514: INFO: host: 10.185.43.70, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 03:31:45.514: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.45.237
Jul 4 03:31:46.664: INFO: host: 10.185.45.237, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 1, stdout: , stderr:
Jul 4 03:31:46.664: INFO: Invoking command gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.45.237
Jul 4 03:31:47.541: INFO: host: 10.185.45.237, command: gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 03:31:47.541: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.45.237
Jul 4 03:31:48.485: INFO: host: 10.185.45.237, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 03:31:48.485: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.32.9
Jul 4 03:31:50.703: INFO: host: 10.185.32.9, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 1, stdout: , stderr:
Jul 4 03:31:50.703: INFO: Invoking command gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.32.9
Jul 4 03:31:51.624: INFO: host: 10.185.32.9, command: gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 03:31:51.625: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.32.9
Jul 4 03:31:52.484: INFO: host: 10.185.32.9, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 03:31:54.484: INFO: Waiting for 'kube-controller-manager' controller pod to come up within 10m0s seconds
Jul 4 03:31:56.504: INFO: Got 1 pods running and ready, expect: 3
Jul 4 03:31:58.508: INFO: Got 0 pods running and ready, expect: 3
Jul 4 03:32:00.504: INFO: Got 1 pods running and ready, expect: 3
Jul 4 03:32:02.505: INFO: Got 1 pods running and ready, expect: 3
Jul 4 03:32:04.508: INFO: Got 2 pods running and ready, expect: 3
Jul 4 03:32:06.507: INFO: Got 2 pods running and ready, expect: 3
Jul 4 03:32:08.501: INFO: Got 2 pods running and ready, expect: 3
Jul 4 03:32:10.517: INFO: 'kube-controller-manager' controller pod is up and ready within 10m0s seconds
STEP: Waiting for migration related annotations on PV/PVCs created before migration
Jul 4 03:32:10.517: INFO: Checking PVC pvc-bqgws
Jul 4 03:32:10.525: INFO: Annotations found on PVC: pvc-bqgws in namespace:csi-vcp-mig-create-del-8081 are,
(map[string]string) (len=4) {
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 03:32:12.537: INFO: Annotations found on PVC: pvc-bqgws in namespace:csi-vcp-mig-create-del-8081 are,
(map[string]string) (len=4) {
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes"
}
Jul 4 03:32:14.537: INFO: Annotations found on PVC: pvc-bqgws in namespace:csi-vcp-mig-create-del-8081 are,
(map[string]string) (len=4) {
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 03:32:16.538: INFO: Annotations found on PVC: pvc-bqgws in namespace:csi-vcp-mig-create-del-8081 are,
(map[string]string) (len=5) {
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes"
}
Jul 4 03:32:16.538: INFO: Checking PVC pvc-tn7pj
Jul 4 03:32:16.547: INFO: Annotations found on PVC: pvc-tn7pj in namespace:csi-vcp-mig-create-del-8081 are,
(map[string]string) (len=5) {
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes"
}
Jul 4 03:32:16.547: INFO: Checking PVC pvc-grk7k
Jul 4 03:32:16.554: INFO: Annotations found on PVC: pvc-grk7k in namespace:csi-vcp-mig-create-del-8081 are,
(map[string]string) (len=5) {
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 03:32:16.554: INFO: Checking PV pvc-7a72b44b-bd7e-4fe7-81c2-587ab9d80a5d
Jul 4 03:32:16.560: INFO: Annotations found on PV: pvc-7a72b44b-bd7e-4fe7-81c2-587ab9d80a5d are,
(map[string]string) (len=4) {
(string) (len=23) "kubernetes.io/createdby": (string) (len=34) "vsphere-volume-dynamic-provisioner",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=31) "pv.kubernetes.io/provisioned-by": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 03:32:16.560: INFO: Checking PV pvc-5667bbe8-b1e3-4372-83bf-e60c2de519d6
Jul 4 03:32:16.585: INFO: Annotations found on PV: pvc-5667bbe8-b1e3-4372-83bf-e60c2de519d6 are,
(map[string]string) (len=4) {
(string) (len=23) "kubernetes.io/createdby": (string) (len=34) "vsphere-volume-dynamic-provisioner",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=31) "pv.kubernetes.io/provisioned-by": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 03:32:16.585: INFO: Checking PV pvc-60bc1fae-0362-479e-9a5e-a1d7a47e4150
Jul 4 03:32:16.591: INFO: Annotations found on PV: pvc-60bc1fae-0362-479e-9a5e-a1d7a47e4150 are,
(map[string]string) (len=4) {
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=31) "pv.kubernetes.io/provisioned-by": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=23) "kubernetes.io/createdby": (string) (len=34) "vsphere-volume-dynamic-provisioner"
}
STEP: Creating VCP PVCs after migration
STEP: Creating PVC using the Storage Class vcp-sc-g6v47 with disk size and labels: map[] accessMode:
Jul 4 03:32:16.611: INFO: PVC created: pvc-dgs2g in namespace: csi-vcp-mig-create-del-8081
STEP: Creating PVC using the Storage Class vcp-sc-vh58j with disk size and labels: map[] accessMode:
Jul 4 03:32:16.630: INFO: PVC created: pvc-rwxpc in namespace: csi-vcp-mig-create-del-8081
STEP: Creating PVC using the Storage Class vcp-sc-qr2sz with disk size and labels: map[] accessMode:
Jul 4 03:32:16.652: INFO: PVC created: pvc-6hrnz in namespace: csi-vcp-mig-create-del-8081
STEP: Waiting for all claims created after migration to be in bound state
Jul 4 03:32:16.652: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-dgs2g] to have phase Bound
Jul 4 03:32:16.659: INFO: PersistentVolumeClaim pvc-dgs2g found but phase is Pending instead of Bound.
Jul 4 03:32:18.676: INFO: PersistentVolumeClaim pvc-dgs2g found but phase is Pending instead of Bound.
Jul 4 03:32:20.684: INFO: PersistentVolumeClaim pvc-dgs2g found but phase is Pending instead of Bound.
Jul 4 03:32:22.697: INFO: PersistentVolumeClaim pvc-dgs2g found but phase is Pending instead of Bound.
Jul 4 03:32:24.706: INFO: PersistentVolumeClaim pvc-dgs2g found but phase is Pending instead of Bound.
Jul 4 03:32:26.719: INFO: PersistentVolumeClaim pvc-dgs2g found but phase is Pending instead of Bound.
Jul 4 03:32:28.731: INFO: PersistentVolumeClaim pvc-dgs2g found but phase is Pending instead of Bound.
Jul 4 03:32:30.741: INFO: PersistentVolumeClaim pvc-dgs2g found but phase is Pending instead of Bound.
Jul 4 03:32:32.753: INFO: PersistentVolumeClaim pvc-dgs2g found but phase is Pending instead of Bound.
Jul 4 03:32:34.762: INFO: PersistentVolumeClaim pvc-dgs2g found but phase is Pending instead of Bound.
Jul 4 03:32:36.773: INFO: PersistentVolumeClaim pvc-dgs2g found but phase is Pending instead of Bound.
Jul 4 03:32:38.785: INFO: PersistentVolumeClaim pvc-dgs2g found but phase is Pending instead of Bound.
Jul 4 03:32:40.795: INFO: PersistentVolumeClaim pvc-dgs2g found but phase is Pending instead of Bound.
Jul 4 03:32:42.805: INFO: PersistentVolumeClaim pvc-dgs2g found but phase is Pending instead of Bound.
Jul 4 03:32:44.815: INFO: PersistentVolumeClaim pvc-dgs2g found but phase is Pending instead of Bound.
Jul 4 03:32:46.830: INFO: PersistentVolumeClaim pvc-dgs2g found and phase=Bound (30.177411089s)
Jul 4 03:32:46.845: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-rwxpc] to have phase Bound
Jul 4 03:32:46.853: INFO: PersistentVolumeClaim pvc-rwxpc found and phase=Bound (8.423787ms)
Jul 4 03:32:46.867: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-6hrnz] to have phase Bound
Jul 4 03:32:46.876: INFO: PersistentVolumeClaim pvc-6hrnz found and phase=Bound (8.684719ms)
STEP: Verify annotations on PV/PVCs created after migration
Jul 4 03:32:46.889: INFO: Checking PVC pvc-dgs2g
Jul 4 03:32:46.896: INFO: Annotations found on PVC: pvc-dgs2g in namespace:csi-vcp-mig-create-del-8081 are,
(map[string]string) (len=4) {
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes"
}
Jul 4 03:32:46.896: INFO: Checking PVC pvc-rwxpc
Jul 4 03:32:46.903: INFO: Annotations found on PVC: pvc-rwxpc in namespace:csi-vcp-mig-create-del-8081 are,
(map[string]string) (len=4) {
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=22) "csi.vsphere.vmware.com"
}
Jul 4 03:32:46.903: INFO: Checking PVC pvc-6hrnz
Jul 4 03:32:46.910: INFO: Annotations found on PVC: pvc-6hrnz in namespace:csi-vcp-mig-create-del-8081 are,
(map[string]string) (len=4) {
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes"
}
Jul 4 03:32:46.910: INFO: Checking PV pvc-9c4cf717-fa65-4cf3-a055-d214d2c99006
Jul 4 03:32:46.916: INFO: Annotations found on PV: pvc-9c4cf717-fa65-4cf3-a055-d214d2c99006 are,
(map[string]string) (len=2) {
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=31) "pv.kubernetes.io/provisioned-by": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 03:32:46.916: INFO: Checking PV pvc-3f951402-7d62-46eb-9bbc-34e1df8274db
Jul 4 03:32:46.933: INFO: Annotations found on PV: pvc-3f951402-7d62-46eb-9bbc-34e1df8274db are,
(map[string]string) (len=2) {
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=31) "pv.kubernetes.io/provisioned-by": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 03:32:46.933: INFO: Checking PV pvc-509627e1-e74a-4345-889c-06c30cacb27c
Jul 4 03:32:46.941: INFO: Annotations found on PV: pvc-509627e1-e74a-4345-889c-06c30cacb27c are,
(map[string]string) (len=2) {
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=31) "pv.kubernetes.io/provisioned-by": (string) (len=28) "kubernetes.io/vsphere-volume"
}
STEP: Verify CnsVSphereVolumeMigration crds and CNS volume metadata for all volumes created before and after migration
Jul 4 03:32:46.968: INFO: Processing PVC: pvc-bqgws
Jul 4 03:32:47.091: INFO: Found CNS volume with id 1615971d-3da5-4964-b4ce-4c6638f8f1af
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "1615971d-3da5-4964-b4ce-4c6638f8f1af"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "924e1908-fb84-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=2 cap=2) {
(*types.CnsKubernetesEntityMetadata)(0xc00062a280)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-7a72b44b-bd7e-4fe7-81c2-587ab9d80a5d",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc00062ab00)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-bqgws",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=27) "csi-vcp-mig-create-del-8081",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-7a72b44b-bd7e-4fe7-81c2-587ab9d80a5d",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc001595940)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "1615971d-3da5-4964-b4ce-4c6638f8f1af",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "7ec1c262-ea70-7ce5-a01b-0200883dcaf9"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=13) "notAccessible",
HealthStatus: (string) (len=7) "unknown"
}
Jul 4 03:32:47.091: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:false
Jul 4 03:32:47.123: INFO: Processing PVC: pvc-tn7pj
Jul 4 03:32:47.343: INFO: Found CNS volume with id b9e166a3-e841-438b-a5b6-1ca71cbf7d72
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "b9e166a3-e841-438b-a5b6-1ca71cbf7d72"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "9d4c4369-fb84-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) (len=36) "aa6d5a82-1c88-45da-85d3-3d74b91a5bad",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=2 cap=2) {
(*types.CnsKubernetesEntityMetadata)(0xc000ba4e80)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-5667bbe8-b1e3-4372-83bf-e60c2de519d6",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc000ba4f00)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-tn7pj",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=27) "csi-vcp-mig-create-del-8081",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-5667bbe8-b1e3-4372-83bf-e60c2de519d6",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc0015fe640)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "b9e166a3-e841-438b-a5b6-1ca71cbf7d72",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "8bc1c262-d2e4-ff7b-e2dd-02008803ef9f"
}),
ComplianceStatus: (string) (len=9) "compliant",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:32:47.344: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:false
Jul 4 03:32:47.376: INFO: Processing PVC: pvc-grk7k
Jul 4 03:32:47.519: INFO: Found CNS volume with id bfd5b687-e0c3-4c05-8539-a1b37003214f
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "bfd5b687-e0c3-4c05-8539-a1b37003214f"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "94c38682-fb84-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) (len=36) "aa6d5a82-1c88-45da-85d3-3d74b91a5bad",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=2 cap=2) {
(*types.CnsKubernetesEntityMetadata)(0xc0003b0580)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-60bc1fae-0362-479e-9a5e-a1d7a47e4150",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc0003b0600)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-grk7k",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=27) "csi-vcp-mig-create-del-8081",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-60bc1fae-0362-479e-9a5e-a1d7a47e4150",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc000dc5b00)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "bfd5b687-e0c3-4c05-8539-a1b37003214f",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "8ac1c262-e81f-24bb-4e51-020088cd1d5a"
}),
ComplianceStatus: (string) (len=9) "compliant",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:32:47.520: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:false
Jul 4 03:32:47.548: INFO: Processing PVC: pvc-dgs2g
Jul 4 03:32:47.698: INFO: Found CNS volume with id dbc3e8d9-00be-498d-875b-4c2b525fb7e0
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "dbc3e8d9-00be-498d-875b-4c2b525fb7e0"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=40) "pvc-9c4cf717-fa65-4cf3-a055-d214d2c99006",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) (len=36) "aa6d5a82-1c88-45da-85d3-3d74b91a5bad",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=2 cap=2) {
(*types.CnsKubernetesEntityMetadata)(0xc001216380)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-9c4cf717-fa65-4cf3-a055-d214d2c99006",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc001216b80)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-dgs2g",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=27) "csi-vcp-mig-create-del-8081",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-9c4cf717-fa65-4cf3-a055-d214d2c99006",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc0017ae500)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "dbc3e8d9-00be-498d-875b-4c2b525fb7e0",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "cac1c262-38f8-0538-3b11-0200883dcaf9"
}),
ComplianceStatus: (string) (len=9) "compliant",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:32:47.698: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:false
Jul 4 03:32:47.724: INFO: Processing PVC: pvc-rwxpc
Jul 4 03:32:47.862: INFO: Found CNS volume with id b1e8a39a-567c-4215-a933-b2c8adb4e499
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "b1e8a39a-567c-4215-a933-b2c8adb4e499"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=40) "pvc-3f951402-7d62-46eb-9bbc-34e1df8274db",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) (len=36) "aa6d5a82-1c88-45da-85d3-3d74b91a5bad",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=2 cap=2) {
(*types.CnsKubernetesEntityMetadata)(0xc00062b600)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-3f951402-7d62-46eb-9bbc-34e1df8274db",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc00062b680)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-rwxpc",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=27) "csi-vcp-mig-create-del-8081",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-3f951402-7d62-46eb-9bbc-34e1df8274db",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc0012a20c0)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "b1e8a39a-567c-4215-a933-b2c8adb4e499",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "cac1c262-ac3a-eb37-7f13-0200883dcaf9"
}),
ComplianceStatus: (string) (len=9) "compliant",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:32:47.862: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:false
Jul 4 03:32:47.901: INFO: Processing PVC: pvc-6hrnz
Jul 4 03:32:48.057: INFO: Found CNS volume with id a297f68c-c122-45b2-ba6a-d4855f743c7b
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "a297f68c-c122-45b2-ba6a-d4855f743c7b"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=40) "pvc-509627e1-e74a-4345-889c-06c30cacb27c",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) (len=36) "aa6d5a82-1c88-45da-85d3-3d74b91a5bad",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=2 cap=2) {
(*types.CnsKubernetesEntityMetadata)(0xc00062b780)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-509627e1-e74a-4345-889c-06c30cacb27c",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc00062b800)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-6hrnz",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=27) "csi-vcp-mig-create-del-8081",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-509627e1-e74a-4345-889c-06c30cacb27c",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc000621ec0)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "a297f68c-c122-45b2-ba6a-d4855f743c7b",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "c9c1c262-6a1a-38b4-db45-020088cd1d5a"
}),
ComplianceStatus: (string) (len=9) "compliant",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:32:48.057: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:false
[JustAfterEach] [csi-vcp-mig] VCP to CSI migration create/delete tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_create_delete.go:81
Jul 4 03:32:48.104: INFO: Deleting PVC pvc-bqgws
Jul 4 03:32:50.134: INFO: volume "1615971d-3da5-4964-b4ce-4c6638f8f1af" has successfully deleted
Jul 4 03:32:50.134: INFO: Waiting for vmdk [vsanDatastore] 7dc1c262-523a-ca6d-963a-020088cd1d5a/kubernetes-dynamic-pvc-7a72b44b-bd7e-4fe7-81c2-587ab9d80a5d.vmdk to be deleted
Jul 4 03:32:50.139: INFO: Looking for default datastore in DC: VSAN-DC
Jul 4 03:32:50.151: INFO: Datstore found for DS URL:ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/
Jul 4 03:32:50.317: INFO: Waiting for CnsVSphereVolumeMigration crds 1615971d-3da5-4964-b4ce-4c6638f8f1af to be deleted
Jul 4 03:32:50.398: INFO: Deleting PVC pvc-tn7pj
Jul 4 03:32:52.439: INFO: volume "b9e166a3-e841-438b-a5b6-1ca71cbf7d72" has successfully deleted
Jul 4 03:32:52.439: INFO: Waiting for vmdk [vsanDatastore] 7dc1c262-523a-ca6d-963a-020088cd1d5a/kubernetes-dynamic-pvc-5667bbe8-b1e3-4372-83bf-e60c2de519d6.vmdk to be deleted
Jul 4 03:32:52.444: INFO: Looking for default datastore in DC: VSAN-DC
Jul 4 03:32:52.455: INFO: Datstore found for DS URL:ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/
Jul 4 03:32:52.499: INFO: Waiting for CnsVSphereVolumeMigration crds b9e166a3-e841-438b-a5b6-1ca71cbf7d72 to be deleted
Jul 4 03:32:52.564: INFO: Deleting PVC pvc-grk7k
Jul 4 03:32:54.598: INFO: volume "bfd5b687-e0c3-4c05-8539-a1b37003214f" has successfully deleted
Jul 4 03:32:54.599: INFO: Waiting for vmdk [vsanDatastore] 7dc1c262-523a-ca6d-963a-020088cd1d5a/kubernetes-dynamic-pvc-60bc1fae-0362-479e-9a5e-a1d7a47e4150.vmdk to be deleted
Jul 4 03:32:54.605: INFO: Looking for default datastore in DC: VSAN-DC
Jul 4 03:32:54.619: INFO: Datstore found for DS URL:ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/
Jul 4 03:32:54.668: INFO: Waiting for CnsVSphereVolumeMigration crds bfd5b687-e0c3-4c05-8539-a1b37003214f to be deleted
Jul 4 03:32:54.736: INFO: Deleting PVC pvc-dgs2g
Jul 4 03:32:56.766: INFO: volume "dbc3e8d9-00be-498d-875b-4c2b525fb7e0" has successfully deleted
Jul 4 03:32:56.766: INFO: Waiting for vmdk [vsanDatastore] c6c1c262-54db-0944-9def-0200883dcaf9/ed4186dad3f44c71b88b1bd2a5cef69c.vmdk to be deleted
Jul 4 03:32:56.774: INFO: Looking for default datastore in DC: VSAN-DC
Jul 4 03:32:56.787: INFO: Datstore found for DS URL:ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/
Jul 4 03:32:57.015: INFO: Waiting for CnsVSphereVolumeMigration crds dbc3e8d9-00be-498d-875b-4c2b525fb7e0 to be deleted
Jul 4 03:32:57.081: INFO: Deleting PVC pvc-rwxpc
Jul 4 03:32:59.107: INFO: volume "b1e8a39a-567c-4215-a933-b2c8adb4e499" has successfully deleted
Jul 4 03:32:59.107: INFO: Waiting for vmdk [vsanDatastore] c6c1c262-54db-0944-9def-0200883dcaf9/81d7ad1156cc429cb9159a61976eb3e7.vmdk to be deleted
Jul 4 03:32:59.112: INFO: Looking for default datastore in DC: VSAN-DC
Jul 4 03:32:59.123: INFO: Datstore found for DS URL:ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/
Jul 4 03:32:59.161: INFO: Waiting for CnsVSphereVolumeMigration crds b1e8a39a-567c-4215-a933-b2c8adb4e499 to be deleted
Jul 4 03:32:59.229: INFO: Deleting PVC pvc-6hrnz
Jul 4 03:33:01.252: INFO: volume "a297f68c-c122-45b2-ba6a-d4855f743c7b" has successfully deleted
Jul 4 03:33:01.252: INFO: Waiting for vmdk [vsanDatastore] c6c1c262-54db-0944-9def-0200883dcaf9/562dadd8bb3e45549aba2140b14d2c73.vmdk to be deleted
Jul 4 03:33:01.258: INFO: Looking for default datastore in DC: VSAN-DC
Jul 4 03:33:01.269: INFO: Datstore found for DS URL:ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/
Jul 4 03:33:01.324: INFO: Waiting for CnsVSphereVolumeMigration crds a297f68c-c122-45b2-ba6a-d4855f743c7b to be deleted
Jul 4 03:33:03.397: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.43.70
Jul 4 03:33:05.337: INFO: host: 10.185.43.70, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true
, stderr:
Jul 4 03:33:05.337: INFO: Invoking command sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.43.70
Jul 4 03:33:06.199: INFO: host: 10.185.43.70, command: sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 03:33:06.199: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.43.70
Jul 4 03:33:07.143: INFO: host: 10.185.43.70, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 03:33:07.143: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.45.237
Jul 4 03:33:07.967: INFO: host: 10.185.45.237, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true
, stderr:
Jul 4 03:33:07.967: INFO: Invoking command sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.45.237
Jul 4 03:33:08.720: INFO: host: 10.185.45.237, command: sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 03:33:08.720: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.45.237
Jul 4 03:33:09.522: INFO: host: 10.185.45.237, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 03:33:09.523: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.32.9
Jul 4 03:33:11.112: INFO: host: 10.185.32.9, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true
, stderr:
Jul 4 03:33:11.112: INFO: Invoking command sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.32.9
Jul 4 03:33:11.887: INFO: host: 10.185.32.9, command: sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 03:33:11.887: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.32.9
Jul 4 03:33:12.729: INFO: host: 10.185.32.9, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 03:33:14.731: INFO: Waiting for 'kube-controller-manager' controller pod to come up within 10m0s seconds
Jul 4 03:33:16.757: INFO: Got 1 pods running and ready, expect: 3
Jul 4 03:33:18.744: INFO: Got 0 pods running and ready, expect: 3
Jul 4 03:33:20.742: INFO: Got 0 pods running and ready, expect: 3
Jul 4 03:33:22.750: INFO: Got 1 pods running and ready, expect: 3
Jul 4 03:33:24.749: INFO: Got 1 pods running and ready, expect: 3
Jul 4 03:33:26.748: INFO: Got 1 pods running and ready, expect: 3
Jul 4 03:33:28.752: INFO: 'kube-controller-manager' controller pod is up and ready within 10m0s seconds
[AfterEach] [csi-vcp-mig] VCP to CSI migration create/delete tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/go/pkg/mod/k8s.io/kubernetes@v1.24.2/test/e2e/framework/framework.go:188
Jul 4 03:33:28.809: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "csi-vcp-mig-create-del-8081" for this suite.
• [SLOW TEST:127.946 seconds]
[csi-vcp-mig] VCP to CSI migration create/delete tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_create_delete.go:47
Create volumes using VCP SC with parameters supported by CSI before and after migration
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_create_delete.go:190
------------------------------
SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[csi-vcp-mig] VCP to CSI migration attach, detach tests
Attach detach combined test
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_attach_detach.go:261
[BeforeEach] [csi-vcp-mig] VCP to CSI migration attach, detach tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/go/pkg/mod/k8s.io/kubernetes@v1.24.2/test/e2e/framework/framework.go:187
STEP: Creating a kubernetes client
Jul 4 03:33:28.843: INFO: >>> kubeConfig: /home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config
STEP: Building a namespace api object, basename vcp-2-csi-attach-detach
STEP: Waiting for a default service account to be provisioned in namespace
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[BeforeEach] [csi-vcp-mig] VCP to CSI migration attach, detach tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_attach_detach.go:66
Jul 4 03:33:39.036: INFO: Search candidates vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 03:33:39.037: INFO: Searching for node with UUID: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 03:33:39.037: INFO: Searching for node with UUID: 4201f777-84d8-9463-c37d-868274d333cb
Jul 4 03:33:39.037: INFO: Searching for node with UUID: 42019a83-8fab-0ed3-6745-5980c88e61be
Jul 4 03:33:39.037: INFO: Searching for node with UUID: 42019292-0601-e6cc-cf83-9e7ad2ff1147
Jul 4 03:33:39.037: INFO: Searching for node with UUID: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:33:39.037: INFO: Searching for node with UUID: 4201c124-84e2-596b-a670-ef0e99be85a5
Jul 4 03:33:39.930: INFO: Found node k8s-node-990-1656928220 as vm=VirtualMachine:vm-53 placed on host=HostSystem:host-16 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 03:33:39.986: INFO: Found node k8s-control-468-1656928206 as vm=VirtualMachine:vm-55 placed on host=HostSystem:host-34 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 03:33:40.300: INFO: Found node k8s-control-292-1656928177 as vm=VirtualMachine:vm-50 placed on host=HostSystem:host-22 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 03:33:40.478: INFO: Found node k8s-control-280-1656928192 as vm=VirtualMachine:vm-54 placed on host=HostSystem:host-28 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 03:33:40.485: INFO: Found node k8s-node-148-1656928247 as vm=VirtualMachine:vm-51 placed on host=HostSystem:host-28 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 03:33:40.504: INFO: Found node k8s-node-236-1656928234 as vm=VirtualMachine:vm-52 placed on host=HostSystem:host-34 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 03:33:40.524: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
Jul 4 03:33:40.530: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
Jul 4 03:33:40.538: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
Jul 4 03:33:40.543: INFO: Waiting up to 10m0s for all pods (need at least 0) in namespace 'vcp-2-csi-attach-detach-2540' to be running and ready
Jul 4 03:33:40.562: INFO: 0 / 0 pods in namespace 'vcp-2-csi-attach-detach-2540' are running and ready (0 seconds elapsed)
Jul 4 03:33:40.562: INFO: expected 0 pod replicas in namespace 'vcp-2-csi-attach-detach-2540', 0 are Running and Ready.
Jul 4 03:33:40.571: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.43.70
Jul 4 03:33:41.648: INFO: host: 10.185.43.70, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 1, stdout: , stderr:
[It] Attach detach combined test
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_attach_detach.go:261
STEP: Creating VCP SC
STEP: Creating StorageClass with scParameters: map[datastore:vsanDatastore] and zones: [] and ReclaimPolicy: and allowVolumeExpansion: false
STEP: Creating StorageClass with scParameters: map[datastore:vsanDatastore] and zones: [] and ReclaimPolicy: and allowVolumeExpansion: false
STEP: Creating static VCP PVCs before migration
Jul 4 03:33:41.678: INFO: Invoking command 'mkdir -p /vmfs/volumes/vsanDatastore/e2e' on ESX host 10.185.37.178
Jul 4 03:33:42.969: INFO: Invoking command 'vmkfstools -c 2g -d thin -W vsan /vmfs/volumes/vsanDatastore/e2e/test-1656930822969021125-728.vmdk' on ESX host 10.185.37.178
Jul 4 03:33:43.842: INFO: Waiting for PV vspherepv-w8wv5 to bind to PVC pvc-wq8xm
Jul 4 03:33:43.842: INFO: Waiting up to timeout=3m0s for PersistentVolumeClaims [pvc-wq8xm] to have phase Bound
Jul 4 03:33:43.848: INFO: PersistentVolumeClaim pvc-wq8xm found but phase is Pending instead of Bound.
Jul 4 03:33:45.860: INFO: PersistentVolumeClaim pvc-wq8xm found but phase is Pending instead of Bound.
Jul 4 03:33:47.874: INFO: PersistentVolumeClaim pvc-wq8xm found but phase is Pending instead of Bound.
Jul 4 03:33:49.883: INFO: PersistentVolumeClaim pvc-wq8xm found but phase is Pending instead of Bound.
Jul 4 03:33:51.893: INFO: PersistentVolumeClaim pvc-wq8xm found but phase is Pending instead of Bound.
Jul 4 03:33:53.914: INFO: PersistentVolumeClaim pvc-wq8xm found but phase is Pending instead of Bound.
Jul 4 03:33:55.925: INFO: PersistentVolumeClaim pvc-wq8xm found and phase=Bound (12.082680045s)
Jul 4 03:33:55.925: INFO: Waiting up to 3m0s for PersistentVolume vspherepv-w8wv5 to have phase Bound
Jul 4 03:33:55.932: INFO: PersistentVolume vspherepv-w8wv5 found and phase=Bound (7.133131ms)
Jul 4 03:33:55.950: INFO: Invoking command 'mkdir -p /vmfs/volumes/vsanDatastore/e2e' on ESX host 10.185.37.178
Jul 4 03:33:56.241: INFO: Invoking command 'vmkfstools -c 2g -d thin -W vsan /vmfs/volumes/vsanDatastore/e2e/test-1656930836241452390-274.vmdk' on ESX host 10.185.37.178
Jul 4 03:33:56.762: INFO: Waiting for PV vspherepv-khnpl to bind to PVC pvc-rlt68
Jul 4 03:33:56.762: INFO: Waiting up to timeout=3m0s for PersistentVolumeClaims [pvc-rlt68] to have phase Bound
Jul 4 03:33:56.772: INFO: PersistentVolumeClaim pvc-rlt68 found but phase is Pending instead of Bound.
Jul 4 03:33:58.782: INFO: PersistentVolumeClaim pvc-rlt68 found but phase is Pending instead of Bound.
Jul 4 03:34:00.792: INFO: PersistentVolumeClaim pvc-rlt68 found but phase is Pending instead of Bound.
Jul 4 03:34:02.804: INFO: PersistentVolumeClaim pvc-rlt68 found but phase is Pending instead of Bound.
Jul 4 03:34:04.816: INFO: PersistentVolumeClaim pvc-rlt68 found but phase is Pending instead of Bound.
Jul 4 03:34:06.824: INFO: PersistentVolumeClaim pvc-rlt68 found but phase is Pending instead of Bound.
Jul 4 03:34:08.832: INFO: PersistentVolumeClaim pvc-rlt68 found but phase is Pending instead of Bound.
Jul 4 03:34:10.842: INFO: PersistentVolumeClaim pvc-rlt68 found and phase=Bound (14.079580516s)
Jul 4 03:34:10.842: INFO: Waiting up to 3m0s for PersistentVolume vspherepv-khnpl to have phase Bound
Jul 4 03:34:10.848: INFO: PersistentVolume vspherepv-khnpl found and phase=Bound (6.211752ms)
Jul 4 03:34:10.860: INFO: Invoking command 'mkdir -p /vmfs/volumes/vsanDatastore/e2e' on ESX host 10.185.37.178
Jul 4 03:34:11.149: INFO: Invoking command 'vmkfstools -c 2g -d thin -W vsan /vmfs/volumes/vsanDatastore/e2e/test-1656930851149958043-211.vmdk' on ESX host 10.185.37.178
Jul 4 03:34:11.689: INFO: Waiting for PV vspherepv-klg8z to bind to PVC pvc-6qr5j
Jul 4 03:34:11.689: INFO: Waiting up to timeout=3m0s for PersistentVolumeClaims [pvc-6qr5j] to have phase Bound
Jul 4 03:34:11.696: INFO: PersistentVolumeClaim pvc-6qr5j found but phase is Pending instead of Bound.
Jul 4 03:34:13.706: INFO: PersistentVolumeClaim pvc-6qr5j found and phase=Bound (2.017116115s)
Jul 4 03:34:13.706: INFO: Waiting up to 3m0s for PersistentVolume vspherepv-klg8z to have phase Bound
Jul 4 03:34:13.713: INFO: PersistentVolume vspherepv-klg8z found and phase=Bound (6.949371ms)
STEP: Creating dynamic VCP PVCs before migration
STEP: Creating PVC using the Storage Class vcp-sc-scb5h with disk size and labels: map[] accessMode:
Jul 4 03:34:13.740: INFO: PVC created: pvc-kxw6c in namespace: vcp-2-csi-attach-detach-2540
STEP: Creating PVC using the Storage Class vcp-sc-scb5h with disk size and labels: map[] accessMode:
Jul 4 03:34:13.759: INFO: PVC created: pvc-wlsvt in namespace: vcp-2-csi-attach-detach-2540
STEP: Creating PVC using the Storage Class vcp-sc-scb5h with disk size and labels: map[] accessMode:
Jul 4 03:34:13.784: INFO: PVC created: pvc-x9cc4 in namespace: vcp-2-csi-attach-detach-2540
STEP: Creating PVC using the Storage Class vcp-sc-scb5h with disk size and labels: map[] accessMode:
Jul 4 03:34:13.801: INFO: PVC created: pvc-8m8f9 in namespace: vcp-2-csi-attach-detach-2540
STEP: Creating PVC using the Storage Class vcp-sc-scb5h with disk size and labels: map[] accessMode:
Jul 4 03:34:13.902: INFO: PVC created: pvc-s74cc in namespace: vcp-2-csi-attach-detach-1445
STEP: Creating PVC using the Storage Class vcp-sc-scb5h with disk size and labels: map[] accessMode:
Jul 4 03:34:13.914: INFO: PVC created: pvc-cs7jn in namespace: vcp-2-csi-attach-detach-1445
STEP: Creating PVC using the Storage Class vcp-sc-scb5h with disk size and labels: map[] accessMode:
Jul 4 03:34:13.927: INFO: PVC created: pvc-npwlr in namespace: vcp-2-csi-attach-detach-1445
STEP: Creating PVC using the Storage Class vcp-sc-scb5h with disk size and labels: map[] accessMode:
Jul 4 03:34:13.954: INFO: PVC created: pvc-wxmsb in namespace: vcp-2-csi-attach-detach-1445
STEP: Creating PVC using the Storage Class vcp-sc-scb5h with disk size and labels: map[] accessMode:
Jul 4 03:34:13.966: INFO: PVC created: pvc-j4m6t in namespace: vcp-2-csi-attach-detach-1445
STEP: Creating VCP SC with SPBM policy
STEP: Creating StorageClass with scParameters: map[storagePolicyName:vSAN Default Storage Policy] and zones: [] and ReclaimPolicy: and allowVolumeExpansion: false
STEP: Creating PVC using the Storage Class vcp-sc-zgtlt with disk size and labels: map[] accessMode:
Jul 4 03:34:14.011: INFO: PVC created: pvc-w64rk in namespace: vcp-2-csi-attach-detach-2540
STEP: Creating PVC using the Storage Class vcp-sc-scb5h with disk size and labels: map[] accessMode:
Jul 4 03:34:14.033: INFO: PVC created: pvc-wt4g9 in namespace: vcp-2-csi-attach-detach-2540
STEP: Creating PVC using the Storage Class vcp-sc-scb5h with disk size and labels: map[] accessMode:
Jul 4 03:34:14.047: INFO: PVC created: pvc-qqj9l in namespace: vcp-2-csi-attach-detach-2540
STEP: Creating PVC using the Storage Class vcp-sc-scb5h with disk size and labels: map[] accessMode:
Jul 4 03:34:14.059: INFO: PVC created: pvc-qhnfl in namespace: vcp-2-csi-attach-detach-2540
STEP: Waiting for all dynamic claims created before migration to be in bound state
Jul 4 03:34:14.059: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-wq8xm] to have phase Bound
Jul 4 03:34:14.100: INFO: PersistentVolumeClaim pvc-wq8xm found and phase=Bound (41.284098ms)
Jul 4 03:34:14.114: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-rlt68] to have phase Bound
Jul 4 03:34:14.125: INFO: PersistentVolumeClaim pvc-rlt68 found and phase=Bound (10.976264ms)
Jul 4 03:34:14.134: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-kxw6c] to have phase Bound
Jul 4 03:34:14.139: INFO: PersistentVolumeClaim pvc-kxw6c found but phase is Pending instead of Bound.
Jul 4 03:34:16.147: INFO: PersistentVolumeClaim pvc-kxw6c found but phase is Pending instead of Bound.
Jul 4 03:34:18.158: INFO: PersistentVolumeClaim pvc-kxw6c found and phase=Bound (4.024095524s)
Jul 4 03:34:18.173: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-wlsvt] to have phase Bound
Jul 4 03:34:18.180: INFO: PersistentVolumeClaim pvc-wlsvt found and phase=Bound (7.44681ms)
Jul 4 03:34:18.196: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-x9cc4] to have phase Bound
Jul 4 03:34:18.205: INFO: PersistentVolumeClaim pvc-x9cc4 found and phase=Bound (8.887895ms)
Jul 4 03:34:18.215: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-w64rk] to have phase Bound
Jul 4 03:34:18.224: INFO: PersistentVolumeClaim pvc-w64rk found but phase is Pending instead of Bound.
Jul 4 03:34:20.232: INFO: PersistentVolumeClaim pvc-w64rk found but phase is Pending instead of Bound.
Jul 4 03:34:22.241: INFO: PersistentVolumeClaim pvc-w64rk found and phase=Bound (4.025626375s)
Jul 4 03:34:22.253: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-wt4g9] to have phase Bound
Jul 4 03:34:22.262: INFO: PersistentVolumeClaim pvc-wt4g9 found and phase=Bound (8.162451ms)
Jul 4 03:34:22.274: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-s74cc] to have phase Bound
Jul 4 03:34:22.281: INFO: PersistentVolumeClaim pvc-s74cc found and phase=Bound (7.035416ms)
Jul 4 03:34:22.294: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-cs7jn] to have phase Bound
Jul 4 03:34:22.300: INFO: PersistentVolumeClaim pvc-cs7jn found and phase=Bound (5.898968ms)
Jul 4 03:34:22.312: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-npwlr] to have phase Bound
Jul 4 03:34:22.318: INFO: PersistentVolumeClaim pvc-npwlr found and phase=Bound (6.190403ms)
Jul 4 03:34:22.330: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-wxmsb] to have phase Bound
Jul 4 03:34:22.336: INFO: PersistentVolumeClaim pvc-wxmsb found and phase=Bound (5.996552ms)
Jul 4 03:34:22.349: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-j4m6t] to have phase Bound
Jul 4 03:34:22.355: INFO: PersistentVolumeClaim pvc-j4m6t found and phase=Bound (5.916442ms)
Jul 4 03:34:22.367: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-qqj9l] to have phase Bound
Jul 4 03:34:22.372: INFO: PersistentVolumeClaim pvc-qqj9l found and phase=Bound (5.81665ms)
Jul 4 03:34:22.386: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-qhnfl] to have phase Bound
Jul 4 03:34:22.393: INFO: PersistentVolumeClaim pvc-qhnfl found and phase=Bound (7.532594ms)
Jul 4 03:34:22.405: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-8m8f9] to have phase Bound
Jul 4 03:34:22.410: INFO: PersistentVolumeClaim pvc-8m8f9 found and phase=Bound (5.62084ms)
STEP: Creating standalone pods using VCP PVCs before migration
STEP: Verify the volume is accessible and filesystem type is as expected
Jul 4 03:34:58.947: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-attach-detach-2540 exec pvc-tester-c2fhf --namespace=vcp-2-csi-attach-detach-2540 -- /bin/cat /mnt/volume1/fstype'
Jul 4 03:34:59.891: INFO: stderr: ""
Jul 4 03:34:59.891: INFO: stdout: "ext4\n"
STEP: Verify the volume is accessible and filesystem type is as expected
Jul 4 03:34:59.913: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-attach-detach-2540 exec pvc-tester-sm2kn --namespace=vcp-2-csi-attach-detach-2540 -- /bin/cat /mnt/volume1/fstype'
Jul 4 03:35:00.217: INFO: stderr: ""
Jul 4 03:35:00.217: INFO: stdout: "ext4\n"
STEP: Verify the volume is accessible and filesystem type is as expected
Jul 4 03:35:00.231: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-attach-detach-2540 exec pvc-tester-pxx45 --namespace=vcp-2-csi-attach-detach-2540 -- /bin/cat /mnt/volume1/fstype'
Jul 4 03:35:00.590: INFO: stderr: ""
Jul 4 03:35:00.590: INFO: stdout: "ext4\n"
STEP: Verify the volume is accessible and filesystem type is as expected
Jul 4 03:35:00.607: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-attach-detach-2540 exec pvc-tester-5g7l4 --namespace=vcp-2-csi-attach-detach-2540 -- /bin/cat /mnt/volume1/fstype'
Jul 4 03:35:00.842: INFO: stderr: ""
Jul 4 03:35:00.842: INFO: stdout: "ext4\n"
STEP: Verify the volume is accessible and filesystem type is as expected
Jul 4 03:35:00.857: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-attach-detach-2540 exec pvc-tester-hp298 --namespace=vcp-2-csi-attach-detach-2540 -- /bin/cat /mnt/volume1/fstype'
Jul 4 03:35:01.110: INFO: stderr: ""
Jul 4 03:35:01.110: INFO: stdout: "ext4\n"
STEP: Verify the volume is accessible and filesystem type is as expected
Jul 4 03:35:01.128: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-attach-detach-1445 exec pvc-tester-6t4t6 --namespace=vcp-2-csi-attach-detach-1445 -- /bin/cat /mnt/volume1/fstype'
Jul 4 03:35:01.570: INFO: stderr: ""
Jul 4 03:35:01.570: INFO: stdout: "ext4\n"
STEP: Verify the volume is accessible and filesystem type is as expected
Jul 4 03:35:01.591: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-attach-detach-1445 exec pvc-tester-p2gfd --namespace=vcp-2-csi-attach-detach-1445 -- /bin/cat /mnt/volume1/fstype'
Jul 4 03:35:01.858: INFO: stderr: ""
Jul 4 03:35:01.858: INFO: stdout: "ext4\n"
STEP: Verify the volume is accessible and filesystem type is as expected
Jul 4 03:35:01.876: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-attach-detach-1445 exec pvc-tester-mtc62 --namespace=vcp-2-csi-attach-detach-1445 -- /bin/cat /mnt/volume1/fstype'
Jul 4 03:35:02.134: INFO: stderr: ""
Jul 4 03:35:02.134: INFO: stdout: "ext4\n"
STEP: Verify the volume is accessible and filesystem type is as expected
Jul 4 03:35:06.168: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-attach-detach-1445 exec pvc-tester-dljfq --namespace=vcp-2-csi-attach-detach-1445 -- /bin/cat /mnt/volume1/fstype'
Jul 4 03:35:06.433: INFO: stderr: ""
Jul 4 03:35:06.433: INFO: stdout: "ext4\n"
STEP: Verify the volume is accessible and filesystem type is as expected
Jul 4 03:35:06.452: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-attach-detach-1445 exec pvc-tester-bhr69 --namespace=vcp-2-csi-attach-detach-1445 -- /bin/cat /mnt/volume1/fstype'
Jul 4 03:35:06.674: INFO: stderr: ""
Jul 4 03:35:06.674: INFO: stdout: "ext4\n"
STEP: Verify CnsVSphereVolumeMigration crd is not created for pvc used in test13
STEP: Delete pod created for test13
Jul 4 03:36:06.762: INFO: Deleting pod "pvc-tester-slzzt" in namespace "vcp-2-csi-attach-detach-2540"
Jul 4 03:36:06.789: INFO: Wait up to 5m0s for pod "pvc-tester-slzzt" to be fully deleted
STEP: Delete pvc created for test13
Jul 4 03:36:38.848: INFO: Looking for default datastore in DC: VSAN-DC
Jul 4 03:36:38.859: INFO: Datstore found for DS URL:ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/
STEP: Enabling CSIMigration and CSIMigrationvSphere feature gates on kube-controller-manager
Jul 4 03:36:38.948: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.43.70
Jul 4 03:36:40.392: INFO: host: 10.185.43.70, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 1, stdout: , stderr:
Jul 4 03:36:40.392: INFO: Invoking command gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.43.70
Jul 4 03:36:41.192: INFO: host: 10.185.43.70, command: gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 03:36:41.193: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.43.70
Jul 4 03:36:42.126: INFO: host: 10.185.43.70, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 03:36:42.126: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.45.237
Jul 4 03:36:42.994: INFO: host: 10.185.45.237, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 1, stdout: , stderr:
Jul 4 03:36:42.995: INFO: Invoking command gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.45.237
Jul 4 03:36:43.685: INFO: host: 10.185.45.237, command: gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 03:36:43.685: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.45.237
Jul 4 03:36:44.497: INFO: host: 10.185.45.237, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 03:36:44.497: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.32.9
Jul 4 03:36:46.185: INFO: host: 10.185.32.9, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 1, stdout: , stderr:
Jul 4 03:36:46.185: INFO: Invoking command gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.32.9
Jul 4 03:36:46.991: INFO: host: 10.185.32.9, command: gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 03:36:46.991: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.32.9
Jul 4 03:36:47.913: INFO: host: 10.185.32.9, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 03:36:49.915: INFO: Waiting for 'kube-controller-manager' controller pod to come up within 10m0s seconds
Jul 4 03:36:51.932: INFO: Got 1 pods running and ready, expect: 3
Jul 4 03:36:53.934: INFO: Got 0 pods running and ready, expect: 3
Jul 4 03:36:55.935: INFO: Got 0 pods running and ready, expect: 3
Jul 4 03:36:57.933: INFO: Got 0 pods running and ready, expect: 3
Jul 4 03:36:59.933: INFO: Got 1 pods running and ready, expect: 3
Jul 4 03:37:01.938: INFO: Got 2 pods running and ready, expect: 3
Jul 4 03:37:03.941: INFO: Got 2 pods running and ready, expect: 3
Jul 4 03:37:05.953: INFO: Got 2 pods running and ready, expect: 3
Jul 4 03:37:07.937: INFO: 'kube-controller-manager' controller pod is up and ready within 10m0s seconds
STEP: Waiting for migration related annotations on PV/PVCs created before migration
Jul 4 03:37:07.938: INFO: Checking PVC pvc-wq8xm
Jul 4 03:37:07.946: INFO: Annotations found on PVC: pvc-wq8xm in namespace:vcp-2-csi-attach-detach-2540 are,
(map[string]string) (len=2) {
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 03:37:09.954: INFO: Annotations found on PVC: pvc-wq8xm in namespace:vcp-2-csi-attach-detach-2540 are,
(map[string]string) (len=2) {
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 03:37:11.966: INFO: Annotations found on PVC: pvc-wq8xm in namespace:vcp-2-csi-attach-detach-2540 are,
(map[string]string) (len=2) {
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 03:37:13.956: INFO: Annotations found on PVC: pvc-wq8xm in namespace:vcp-2-csi-attach-detach-2540 are,
(map[string]string) (len=2) {
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 03:37:15.955: INFO: Annotations found on PVC: pvc-wq8xm in namespace:vcp-2-csi-attach-detach-2540 are,
(map[string]string) (len=3) {
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 03:37:15.955: INFO: Checking PVC pvc-rlt68
Jul 4 03:37:15.960: INFO: Annotations found on PVC: pvc-rlt68 in namespace:vcp-2-csi-attach-detach-2540 are,
(map[string]string) (len=3) {
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com"
}
Jul 4 03:37:15.960: INFO: Checking PVC pvc-kxw6c
Jul 4 03:37:15.965: INFO: Annotations found on PVC: pvc-kxw6c in namespace:vcp-2-csi-attach-detach-2540 are,
(map[string]string) (len=5) {
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com"
}
Jul 4 03:37:15.965: INFO: Checking PVC pvc-wlsvt
Jul 4 03:37:15.972: INFO: Annotations found on PVC: pvc-wlsvt in namespace:vcp-2-csi-attach-detach-2540 are,
(map[string]string) (len=5) {
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes"
}
Jul 4 03:37:15.972: INFO: Checking PVC pvc-x9cc4
Jul 4 03:37:15.976: INFO: Annotations found on PVC: pvc-x9cc4 in namespace:vcp-2-csi-attach-detach-2540 are,
(map[string]string) (len=5) {
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes"
}
Jul 4 03:37:15.976: INFO: Checking PVC pvc-w64rk
Jul 4 03:37:15.980: INFO: Annotations found on PVC: pvc-w64rk in namespace:vcp-2-csi-attach-detach-2540 are,
(map[string]string) (len=5) {
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes"
}
Jul 4 03:37:15.981: INFO: Checking PVC pvc-wt4g9
Jul 4 03:37:16.305: INFO: Annotations found on PVC: pvc-wt4g9 in namespace:vcp-2-csi-attach-detach-2540 are,
(map[string]string) (len=5) {
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com"
}
Jul 4 03:37:16.305: INFO: Checking PVC pvc-s74cc
Jul 4 03:37:16.317: INFO: Annotations found on PVC: pvc-s74cc in namespace:vcp-2-csi-attach-detach-1445 are,
(map[string]string) (len=5) {
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes"
}
Jul 4 03:37:16.317: INFO: Checking PVC pvc-cs7jn
Jul 4 03:37:16.325: INFO: Annotations found on PVC: pvc-cs7jn in namespace:vcp-2-csi-attach-detach-1445 are,
(map[string]string) (len=5) {
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com"
}
Jul 4 03:37:16.325: INFO: Checking PVC pvc-npwlr
Jul 4 03:37:16.329: INFO: Annotations found on PVC: pvc-npwlr in namespace:vcp-2-csi-attach-detach-1445 are,
(map[string]string) (len=5) {
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes"
}
Jul 4 03:37:16.329: INFO: Checking PVC pvc-wxmsb
Jul 4 03:37:16.334: INFO: Annotations found on PVC: pvc-wxmsb in namespace:vcp-2-csi-attach-detach-1445 are,
(map[string]string) (len=5) {
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 03:37:16.334: INFO: Checking PVC pvc-j4m6t
Jul 4 03:37:16.339: INFO: Annotations found on PVC: pvc-j4m6t in namespace:vcp-2-csi-attach-detach-1445 are,
(map[string]string) (len=5) {
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 03:37:16.340: INFO: Checking PVC pvc-qqj9l
Jul 4 03:37:16.344: INFO: Annotations found on PVC: pvc-qqj9l in namespace:vcp-2-csi-attach-detach-2540 are,
(map[string]string) (len=5) {
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com"
}
Jul 4 03:37:16.344: INFO: Checking PVC pvc-qhnfl
Jul 4 03:37:16.349: INFO: Annotations found on PVC: pvc-qhnfl in namespace:vcp-2-csi-attach-detach-2540 are,
(map[string]string) (len=5) {
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 03:37:16.349: INFO: Checking PV vspherepv-w8wv5
Jul 4 03:37:16.357: INFO: Annotations found on PV: vspherepv-w8wv5 are,
(map[string]string) (len=3) {
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=31) "pv.kubernetes.io/provisioned-by": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 03:37:16.357: INFO: Checking PV vspherepv-khnpl
Jul 4 03:37:16.364: INFO: Annotations found on PV: vspherepv-khnpl are,
(map[string]string) (len=3) {
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=31) "pv.kubernetes.io/provisioned-by": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 03:37:16.364: INFO: Checking PV pvc-19419533-9395-4614-8d66-7adcf6e8024c
Jul 4 03:37:16.370: INFO: Annotations found on PV: pvc-19419533-9395-4614-8d66-7adcf6e8024c are,
(map[string]string) (len=4) {
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=31) "pv.kubernetes.io/provisioned-by": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=23) "kubernetes.io/createdby": (string) (len=34) "vsphere-volume-dynamic-provisioner",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes"
}
Jul 4 03:37:16.370: INFO: Checking PV pvc-0a8fe646-fee8-4506-aa19-21f8da4b3479
Jul 4 03:37:16.383: INFO: Annotations found on PV: pvc-0a8fe646-fee8-4506-aa19-21f8da4b3479 are,
(map[string]string) (len=4) {
(string) (len=23) "kubernetes.io/createdby": (string) (len=34) "vsphere-volume-dynamic-provisioner",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=31) "pv.kubernetes.io/provisioned-by": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 03:37:16.383: INFO: Checking PV pvc-ef64f55f-50b3-41b7-b572-ead72fa03a03
Jul 4 03:37:16.390: INFO: Annotations found on PV: pvc-ef64f55f-50b3-41b7-b572-ead72fa03a03 are,
(map[string]string) (len=4) {
(string) (len=31) "pv.kubernetes.io/provisioned-by": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=23) "kubernetes.io/createdby": (string) (len=34) "vsphere-volume-dynamic-provisioner",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com"
}
Jul 4 03:37:16.390: INFO: Checking PV pvc-fe4f7c74-6617-4b31-b774-a7612581c13f
Jul 4 03:37:16.396: INFO: Annotations found on PV: pvc-fe4f7c74-6617-4b31-b774-a7612581c13f are,
(map[string]string) (len=4) {
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=31) "pv.kubernetes.io/provisioned-by": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=23) "kubernetes.io/createdby": (string) (len=34) "vsphere-volume-dynamic-provisioner"
}
Jul 4 03:37:16.396: INFO: Checking PV pvc-b33657c8-79d0-424f-a1bf-926f8f86a074
Jul 4 03:37:16.420: INFO: Annotations found on PV: pvc-b33657c8-79d0-424f-a1bf-926f8f86a074 are,
(map[string]string) (len=4) {
(string) (len=23) "kubernetes.io/createdby": (string) (len=34) "vsphere-volume-dynamic-provisioner",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=31) "pv.kubernetes.io/provisioned-by": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 03:37:16.420: INFO: Checking PV pvc-78cab45d-c584-4c99-9898-65e25227289c
Jul 4 03:37:16.426: INFO: Annotations found on PV: pvc-78cab45d-c584-4c99-9898-65e25227289c are,
(map[string]string) (len=4) {
(string) (len=23) "kubernetes.io/createdby": (string) (len=34) "vsphere-volume-dynamic-provisioner",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=31) "pv.kubernetes.io/provisioned-by": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 03:37:16.426: INFO: Checking PV pvc-8ee850fe-9e71-4901-aa03-53dfa0b5b098
Jul 4 03:37:16.432: INFO: Annotations found on PV: pvc-8ee850fe-9e71-4901-aa03-53dfa0b5b098 are,
(map[string]string) (len=4) {
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=31) "pv.kubernetes.io/provisioned-by": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=23) "kubernetes.io/createdby": (string) (len=34) "vsphere-volume-dynamic-provisioner",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes"
}
Jul 4 03:37:16.432: INFO: Checking PV pvc-76530b0d-9001-4c96-b2a5-4d2e06b06b37
Jul 4 03:37:16.437: INFO: Annotations found on PV: pvc-76530b0d-9001-4c96-b2a5-4d2e06b06b37 are,
(map[string]string) (len=4) {
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=31) "pv.kubernetes.io/provisioned-by": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=23) "kubernetes.io/createdby": (string) (len=34) "vsphere-volume-dynamic-provisioner",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes"
}
Jul 4 03:37:16.437: INFO: Checking PV pvc-776478c5-5d3f-4800-bc09-b9506f1a498d
Jul 4 03:37:16.444: INFO: Annotations found on PV: pvc-776478c5-5d3f-4800-bc09-b9506f1a498d are,
(map[string]string) (len=4) {
(string) (len=23) "kubernetes.io/createdby": (string) (len=34) "vsphere-volume-dynamic-provisioner",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=31) "pv.kubernetes.io/provisioned-by": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 03:37:16.444: INFO: Checking PV pvc-befe34b1-94db-4318-9e89-ed15a118d6b4
Jul 4 03:37:16.451: INFO: Annotations found on PV: pvc-befe34b1-94db-4318-9e89-ed15a118d6b4 are,
(map[string]string) (len=4) {
(string) (len=23) "kubernetes.io/createdby": (string) (len=34) "vsphere-volume-dynamic-provisioner",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=31) "pv.kubernetes.io/provisioned-by": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 03:37:16.451: INFO: Checking PV pvc-33031f22-7baf-4bcd-ada2-ac79f1775a21
Jul 4 03:37:16.457: INFO: Annotations found on PV: pvc-33031f22-7baf-4bcd-ada2-ac79f1775a21 are,
(map[string]string) (len=4) {
(string) (len=23) "kubernetes.io/createdby": (string) (len=34) "vsphere-volume-dynamic-provisioner",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=31) "pv.kubernetes.io/provisioned-by": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 03:37:16.457: INFO: Checking PV pvc-a6caf5c3-8f0a-4c1b-b5ea-fc06db3e082b
Jul 4 03:37:16.464: INFO: Annotations found on PV: pvc-a6caf5c3-8f0a-4c1b-b5ea-fc06db3e082b are,
(map[string]string) (len=4) {
(string) (len=23) "kubernetes.io/createdby": (string) (len=34) "vsphere-volume-dynamic-provisioner",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=31) "pv.kubernetes.io/provisioned-by": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 03:37:16.464: INFO: Checking PVC pvc-6qr5j
Jul 4 03:37:16.470: INFO: Annotations found on PVC: pvc-6qr5j in namespace:vcp-2-csi-attach-detach-2540 are,
(map[string]string) (len=3) {
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 03:37:16.470: INFO: Checking PV vspherepv-klg8z
Jul 4 03:37:16.476: INFO: Annotations found on PV: vspherepv-klg8z are,
(map[string]string) (len=3) {
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=31) "pv.kubernetes.io/provisioned-by": (string) (len=28) "kubernetes.io/vsphere-volume"
}
STEP: Verify CnsVSphereVolumeMigration crds and CNS volume metadata on pvc created before migration
Jul 4 03:37:16.476: INFO: Checking PVC pvc-wq8xm
Jul 4 03:37:16.487: INFO: Processing PVC: pvc-wq8xm
Jul 4 03:37:26.575: INFO: For pod 'pvc-tester-5g7l4', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-qqj9l,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-92n4b,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:37:26.575: INFO: For pod 'pvc-tester-c2fhf', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-wlsvt,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-tjpc5,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:37:26.575: INFO: For pod 'pvc-tester-hp298', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-qhnfl,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-g4glt,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:37:26.575: INFO: For pod 'pvc-tester-pxx45', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-wt4g9,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-zh24m,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:37:26.575: INFO: For pod 'pvc-tester-r2522', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-6qr5j,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-7td5q,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:37:26.575: INFO: For pod 'pvc-tester-sm2kn', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-rlt68,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-5222q,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:37:26.701: INFO: Found CNS volume with id 95a11459-1d2f-4a00-919b-a03c462f0a8d
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "95a11459-1d2f-4a00-919b-a03c462f0a8d"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "49ea8df6-fb85-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) <nil>,
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc001533fc0)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "95a11459-1d2f-4a00-919b-a03c462f0a8d",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "07c2c262-fc69-dec0-67e5-020088cd1d5a"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=13) "notAccessible",
HealthStatus: (string) (len=7) "unknown"
}
Jul 4 03:37:26.701: INFO: pvEntryFound:false, verifyPvEntry:true, pvcEntryFound:false, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:false
Jul 4 03:37:36.787: INFO: Found CNS volume with id 95a11459-1d2f-4a00-919b-a03c462f0a8d
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "95a11459-1d2f-4a00-919b-a03c462f0a8d"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "49ea8df6-fb85-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=2 cap=2) {
(*types.CnsKubernetesEntityMetadata)(0xc000ba4a80)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-wq8xm",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=15) "vspherepv-w8wv5",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc000ba4b00)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=15) "vspherepv-w8wv5",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc000620e80)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "95a11459-1d2f-4a00-919b-a03c462f0a8d",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "07c2c262-fc69-dec0-67e5-020088cd1d5a"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=13) "notAccessible",
HealthStatus: (string) (len=7) "unknown"
}
Jul 4 03:37:36.787: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:false
Jul 4 03:37:36.787: INFO: Checking PVC pvc-rlt68
Jul 4 03:37:36.801: INFO: Processing PVC: pvc-rlt68
Jul 4 03:37:36.853: INFO: For pod 'pvc-tester-5g7l4', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-qqj9l,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-92n4b,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:37:36.853: INFO: For pod 'pvc-tester-c2fhf', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-wlsvt,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-tjpc5,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:37:36.853: INFO: For pod 'pvc-tester-hp298', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-qhnfl,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-g4glt,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:37:36.853: INFO: For pod 'pvc-tester-pxx45', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-wt4g9,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-zh24m,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:37:36.853: INFO: For pod 'pvc-tester-r2522', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-6qr5j,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-7td5q,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:37:36.853: INFO: For pod 'pvc-tester-sm2kn', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-rlt68,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-5222q,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:37:37.326: INFO: Found CNS volume with id e89429ea-ddfa-42bf-9272-d543c69bf2fc
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "e89429ea-ddfa-42bf-9272-d543c69bf2fc"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "4522cd9d-fb85-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=1 cap=1) {
(*types.CnsKubernetesEntityMetadata)(0xc000074b00)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=15) "vspherepv-khnpl",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc00121d640)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "e89429ea-ddfa-42bf-9272-d543c69bf2fc",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "14c2c262-4a65-fdc0-13bf-020088cd1d5a"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:37:37.326: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:false, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:true
Jul 4 03:37:47.777: INFO: Found CNS volume with id e89429ea-ddfa-42bf-9272-d543c69bf2fc
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "e89429ea-ddfa-42bf-9272-d543c69bf2fc"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "4522cd9d-fb85-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=1 cap=1) {
(*types.CnsKubernetesEntityMetadata)(0xc000074c00)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=15) "vspherepv-khnpl",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc00127da00)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "e89429ea-ddfa-42bf-9272-d543c69bf2fc",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "14c2c262-4a65-fdc0-13bf-020088cd1d5a"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:37:47.777: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:false, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:true
Jul 4 03:37:57.790: INFO: Found CNS volume with id e89429ea-ddfa-42bf-9272-d543c69bf2fc
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "e89429ea-ddfa-42bf-9272-d543c69bf2fc"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "4522cd9d-fb85-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=2 cap=2) {
(*types.CnsKubernetesEntityMetadata)(0xc000074e00)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-rlt68",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=15) "vspherepv-khnpl",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc000074e80)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=15) "vspherepv-khnpl",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc00138e880)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "e89429ea-ddfa-42bf-9272-d543c69bf2fc",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "14c2c262-4a65-fdc0-13bf-020088cd1d5a"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:37:57.790: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:true
Jul 4 03:38:07.710: INFO: Found CNS volume with id e89429ea-ddfa-42bf-9272-d543c69bf2fc
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "e89429ea-ddfa-42bf-9272-d543c69bf2fc"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "4522cd9d-fb85-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=2 cap=2) {
(*types.CnsKubernetesEntityMetadata)(0xc0003b1a80)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-rlt68",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=15) "vspherepv-khnpl",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc0003b1c00)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=15) "vspherepv-khnpl",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc0012b0200)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "e89429ea-ddfa-42bf-9272-d543c69bf2fc",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "14c2c262-4a65-fdc0-13bf-020088cd1d5a"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:38:07.710: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:true
Jul 4 03:38:17.718: INFO: Found CNS volume with id e89429ea-ddfa-42bf-9272-d543c69bf2fc
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "e89429ea-ddfa-42bf-9272-d543c69bf2fc"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "4522cd9d-fb85-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=2 cap=2) {
(*types.CnsKubernetesEntityMetadata)(0xc000075080)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-rlt68",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=15) "vspherepv-khnpl",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc000075100)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=15) "vspherepv-khnpl",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc00143e940)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "e89429ea-ddfa-42bf-9272-d543c69bf2fc",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "14c2c262-4a65-fdc0-13bf-020088cd1d5a"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:38:17.718: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:true
Jul 4 03:38:27.713: INFO: Found CNS volume with id e89429ea-ddfa-42bf-9272-d543c69bf2fc
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "e89429ea-ddfa-42bf-9272-d543c69bf2fc"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "4522cd9d-fb85-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=2 cap=2) {
(*types.CnsKubernetesEntityMetadata)(0xc000075300)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-rlt68",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=15) "vspherepv-khnpl",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc000075380)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=15) "vspherepv-khnpl",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc0014657c0)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "e89429ea-ddfa-42bf-9272-d543c69bf2fc",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "14c2c262-4a65-fdc0-13bf-020088cd1d5a"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:38:27.713: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:true
Jul 4 03:38:37.740: INFO: Found CNS volume with id e89429ea-ddfa-42bf-9272-d543c69bf2fc
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "e89429ea-ddfa-42bf-9272-d543c69bf2fc"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "4522cd9d-fb85-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=3 cap=4) {
(*types.CnsKubernetesEntityMetadata)(0xc000075500)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-rlt68",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=15) "vspherepv-khnpl",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc000075580)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=16) "pvc-tester-sm2kn",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=3) "POD",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
EntityName: (string) (len=9) "pvc-rlt68",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc000075600)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=15) "vspherepv-khnpl",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc00147ccc0)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "e89429ea-ddfa-42bf-9272-d543c69bf2fc",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "14c2c262-4a65-fdc0-13bf-020088cd1d5a"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:38:37.740: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:true, verifyPodEntry:true
Jul 4 03:38:37.741: INFO: Checking PVC pvc-kxw6c
Jul 4 03:38:37.756: INFO: Processing PVC: pvc-kxw6c
Jul 4 03:38:37.804: INFO: For pod 'pvc-tester-5g7l4', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-qqj9l,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-92n4b,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:37.804: INFO: For pod 'pvc-tester-c2fhf', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-wlsvt,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-tjpc5,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:37.804: INFO: For pod 'pvc-tester-hp298', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-qhnfl,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-g4glt,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:37.804: INFO: For pod 'pvc-tester-pxx45', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-wt4g9,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-zh24m,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:37.805: INFO: For pod 'pvc-tester-r2522', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-6qr5j,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-7td5q,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:37.805: INFO: For pod 'pvc-tester-sm2kn', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-rlt68,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-5222q,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:37.870: INFO: Found CNS volume with id 941b2c3c-7e68-41e2-a24d-f764e64e6004
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "941b2c3c-7e68-41e2-a24d-f764e64e6004"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "495b9279-fb85-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=2 cap=2) {
(*types.CnsKubernetesEntityMetadata)(0xc001256180)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-19419533-9395-4614-8d66-7adcf6e8024c",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc001256200)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-kxw6c",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-19419533-9395-4614-8d66-7adcf6e8024c",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc001799f80)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "941b2c3c-7e68-41e2-a24d-f764e64e6004",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "26c2c262-641a-ae04-6e07-020088529ac5"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=13) "notAccessible",
HealthStatus: (string) (len=7) "unknown"
}
Jul 4 03:38:37.870: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:false
Jul 4 03:38:37.870: INFO: Checking PVC pvc-wlsvt
Jul 4 03:38:37.885: INFO: Processing PVC: pvc-wlsvt
Jul 4 03:38:37.931: INFO: For pod 'pvc-tester-5g7l4', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-qqj9l,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-92n4b,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:37.931: INFO: For pod 'pvc-tester-c2fhf', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-wlsvt,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-tjpc5,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:38.264: INFO: Found CNS volume with id 452b55a1-2b90-452e-add1-0e4d08f3d365
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "452b55a1-2b90-452e-add1-0e4d08f3d365"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "51a64e65-fb85-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=3 cap=4) {
(*types.CnsKubernetesEntityMetadata)(0xc000074480)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-0a8fe646-fee8-4506-aa19-21f8da4b3479",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc000074500)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=16) "pvc-tester-c2fhf",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=3) "POD",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
EntityName: (string) (len=9) "pvc-wlsvt",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc000074580)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-wlsvt",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-0a8fe646-fee8-4506-aa19-21f8da4b3479",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc001532e80)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "452b55a1-2b90-452e-add1-0e4d08f3d365",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "26c2c262-4a6f-5168-523c-02008803ef9f"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:38:38.264: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:true, verifyPodEntry:true
Jul 4 03:38:38.264: INFO: Checking PVC pvc-x9cc4
Jul 4 03:38:38.280: INFO: Processing PVC: pvc-x9cc4
Jul 4 03:38:38.341: INFO: For pod 'pvc-tester-5g7l4', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-qqj9l,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-92n4b,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:38.341: INFO: For pod 'pvc-tester-c2fhf', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-wlsvt,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-tjpc5,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:38.341: INFO: For pod 'pvc-tester-hp298', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-qhnfl,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-g4glt,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:38.341: INFO: For pod 'pvc-tester-pxx45', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-wt4g9,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-zh24m,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:38.342: INFO: For pod 'pvc-tester-r2522', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-6qr5j,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-7td5q,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:38.342: INFO: For pod 'pvc-tester-sm2kn', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-rlt68,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-5222q,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:38.397: INFO: Found CNS volume with id 9e9dad92-bf8c-4b96-a9f2-100fe0d92ed9
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "9e9dad92-bf8c-4b96-a9f2-100fe0d92ed9"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "4e454d7a-fb85-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=2 cap=2) {
(*types.CnsKubernetesEntityMetadata)(0xc000075f00)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-ef64f55f-50b3-41b7-b572-ead72fa03a03",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc000075f80)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-x9cc4",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-ef64f55f-50b3-41b7-b572-ead72fa03a03",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc000596a80)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "9e9dad92-bf8c-4b96-a9f2-100fe0d92ed9",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "26c2c262-58d9-a3f8-ea41-0200883dcaf9"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=13) "notAccessible",
HealthStatus: (string) (len=7) "unknown"
}
Jul 4 03:38:38.397: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:false
Jul 4 03:38:38.397: INFO: Checking PVC pvc-w64rk
Jul 4 03:38:38.413: INFO: Processing PVC: pvc-w64rk
Jul 4 03:38:38.464: INFO: For pod 'pvc-tester-5g7l4', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-qqj9l,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-92n4b,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:38.464: INFO: For pod 'pvc-tester-c2fhf', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-wlsvt,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-tjpc5,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:38.464: INFO: For pod 'pvc-tester-hp298', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-qhnfl,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-g4glt,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:38.464: INFO: For pod 'pvc-tester-pxx45', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-wt4g9,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-zh24m,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:38.464: INFO: For pod 'pvc-tester-r2522', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-6qr5j,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-7td5q,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:38.464: INFO: For pod 'pvc-tester-sm2kn', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-rlt68,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-5222q,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:38.566: INFO: Found CNS volume with id 686ff46a-4547-457a-ab8b-6c5c0e8cb526
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "686ff46a-4547-457a-ab8b-6c5c0e8cb526"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "4b2b0696-fb85-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) (len=36) "aa6d5a82-1c88-45da-85d3-3d74b91a5bad",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=2 cap=2) {
(*types.CnsKubernetesEntityMetadata)(0xc000459d80)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-fe4f7c74-6617-4b31-b774-a7612581c13f",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc000459e00)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-w64rk",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-fe4f7c74-6617-4b31-b774-a7612581c13f",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc001421940)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "686ff46a-4547-457a-ab8b-6c5c0e8cb526",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "2bc2c262-7afb-ad57-7a15-020088cd1d5a"
}),
ComplianceStatus: (string) (len=9) "compliant",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:38:38.566: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:false
Jul 4 03:38:38.566: INFO: Checking PVC pvc-wt4g9
Jul 4 03:38:38.581: INFO: Processing PVC: pvc-wt4g9
Jul 4 03:38:38.630: INFO: For pod 'pvc-tester-5g7l4', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-qqj9l,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-92n4b,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:38.630: INFO: For pod 'pvc-tester-c2fhf', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-wlsvt,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-tjpc5,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:38.631: INFO: For pod 'pvc-tester-hp298', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-qhnfl,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-g4glt,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:38.631: INFO: For pod 'pvc-tester-pxx45', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-wt4g9,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-zh24m,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:39.042: INFO: Found CNS volume with id 9280857a-e9c3-4b13-b90b-9f790b6fe696
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "9280857a-e9c3-4b13-b90b-9f790b6fe696"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "5a9f6c82-fb85-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=3 cap=4) {
(*types.CnsKubernetesEntityMetadata)(0xc001a1e500)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-b33657c8-79d0-424f-a1bf-926f8f86a074",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc001a1e580)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=16) "pvc-tester-pxx45",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=3) "POD",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
EntityName: (string) (len=9) "pvc-wt4g9",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc001a1e600)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-wt4g9",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-b33657c8-79d0-424f-a1bf-926f8f86a074",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc00180d1c0)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "9280857a-e9c3-4b13-b90b-9f790b6fe696",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "28c2c262-ea2e-df03-ca48-02008803ef9f"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:38:39.042: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:true, verifyPodEntry:true
Jul 4 03:38:39.042: INFO: Checking PVC pvc-s74cc
Jul 4 03:38:39.056: INFO: Processing PVC: pvc-s74cc
Jul 4 03:38:39.115: INFO: For pod 'pvc-tester-6t4t6', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-s74cc,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-sbwwz,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:39.478: INFO: Found CNS volume with id 9fc3a7be-3cda-4d2c-9365-c658af1fcb6f
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "9fc3a7be-3cda-4d2c-9365-c658af1fcb6f"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "552734da-fb85-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=3 cap=4) {
(*types.CnsKubernetesEntityMetadata)(0xc001217880)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-78cab45d-c584-4c99-9898-65e25227289c",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc001217980)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-s74cc",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-1445",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-78cab45d-c584-4c99-9898-65e25227289c",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc001217a80)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=16) "pvc-tester-6t4t6",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=3) "POD",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-1445",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
EntityName: (string) (len=9) "pvc-s74cc",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-1445",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc001533500)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "9fc3a7be-3cda-4d2c-9365-c658af1fcb6f",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "26c2c262-f6d0-7c80-730e-02008803ef9f"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:38:39.478: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:true, verifyPodEntry:true
Jul 4 03:38:39.478: INFO: Checking PVC pvc-cs7jn
Jul 4 03:38:39.496: INFO: Processing PVC: pvc-cs7jn
Jul 4 03:38:39.542: INFO: For pod 'pvc-tester-6t4t6', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-s74cc,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-sbwwz,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:39.542: INFO: For pod 'pvc-tester-bhr69', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-j4m6t,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-5tscl,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:39.542: INFO: For pod 'pvc-tester-dljfq', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-wxmsb,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-6rmg5,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:39.542: INFO: For pod 'pvc-tester-mtc62', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-npwlr,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-qkvs2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:39.542: INFO: For pod 'pvc-tester-p2gfd', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-cs7jn,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-md7g8,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:39.949: INFO: Found CNS volume with id 1c0a67af-16c9-48cc-ae74-4e13641fabe7
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "1c0a67af-16c9-48cc-ae74-4e13641fabe7"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "4f752448-fb85-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=3 cap=4) {
(*types.CnsKubernetesEntityMetadata)(0xc001217d80)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-8ee850fe-9e71-4901-aa03-53dfa0b5b098",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc001217e80)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-cs7jn",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-1445",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-8ee850fe-9e71-4901-aa03-53dfa0b5b098",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc001217f80)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=16) "pvc-tester-p2gfd",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=3) "POD",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-1445",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
EntityName: (string) (len=9) "pvc-cs7jn",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-1445",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc000774000)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "1c0a67af-16c9-48cc-ae74-4e13641fabe7",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "26c2c262-3869-0506-0982-020088529ac5"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:38:39.949: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:true, verifyPodEntry:true
Jul 4 03:38:39.949: INFO: Checking PVC pvc-npwlr
Jul 4 03:38:39.967: INFO: Processing PVC: pvc-npwlr
Jul 4 03:38:40.021: INFO: For pod 'pvc-tester-6t4t6', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-s74cc,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-sbwwz,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:40.021: INFO: For pod 'pvc-tester-bhr69', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-j4m6t,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-5tscl,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:40.021: INFO: For pod 'pvc-tester-dljfq', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-wxmsb,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-6rmg5,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:40.021: INFO: For pod 'pvc-tester-mtc62', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-npwlr,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-qkvs2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:40.411: INFO: Found CNS volume with id 2806d2b0-0bbd-48ce-9a86-def41e2d87e9
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "2806d2b0-0bbd-48ce-9a86-def41e2d87e9"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "57c101eb-fb85-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=3 cap=4) {
(*types.CnsKubernetesEntityMetadata)(0xc000074600)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-76530b0d-9001-4c96-b2a5-4d2e06b06b37",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc000074700)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-npwlr",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-1445",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-76530b0d-9001-4c96-b2a5-4d2e06b06b37",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc000074780)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=16) "pvc-tester-mtc62",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=3) "POD",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-1445",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
EntityName: (string) (len=9) "pvc-npwlr",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-1445",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc0012acb00)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "2806d2b0-0bbd-48ce-9a86-def41e2d87e9",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "27c2c262-1ab9-1763-25a1-020088529ac5"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:38:40.411: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:true, verifyPodEntry:true
Jul 4 03:38:40.411: INFO: Checking PVC pvc-wxmsb
Jul 4 03:38:40.432: INFO: Processing PVC: pvc-wxmsb
Jul 4 03:38:40.473: INFO: For pod 'pvc-tester-6t4t6', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-s74cc,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-sbwwz,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:40.474: INFO: For pod 'pvc-tester-bhr69', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-j4m6t,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-5tscl,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:40.474: INFO: For pod 'pvc-tester-dljfq', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-wxmsb,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-6rmg5,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:40.846: INFO: Found CNS volume with id 44befe11-354c-41a8-9a62-02941a98837e
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "44befe11-354c-41a8-9a62-02941a98837e"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "45290ce2-fb85-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=3 cap=4) {
(*types.CnsKubernetesEntityMetadata)(0xc00062b400)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-776478c5-5d3f-4800-bc09-b9506f1a498d",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc00062b480)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=16) "pvc-tester-dljfq",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=3) "POD",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-1445",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
EntityName: (string) (len=9) "pvc-wxmsb",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-1445",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc00062b500)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-wxmsb",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-1445",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-776478c5-5d3f-4800-bc09-b9506f1a498d",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc0017899c0)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "44befe11-354c-41a8-9a62-02941a98837e",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "27c2c262-066d-9b2b-4bc8-0200883dcaf9"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:38:40.846: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:true, verifyPodEntry:true
Jul 4 03:38:40.846: INFO: Checking PVC pvc-j4m6t
Jul 4 03:38:40.863: INFO: Processing PVC: pvc-j4m6t
Jul 4 03:38:40.918: INFO: For pod 'pvc-tester-6t4t6', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-s74cc,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-sbwwz,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:40.918: INFO: For pod 'pvc-tester-bhr69', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-j4m6t,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-5tscl,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:41.307: INFO: Found CNS volume with id b7e2a25b-b6d3-4457-bc0e-ad730052377e
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "b7e2a25b-b6d3-4457-bc0e-ad730052377e"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "4793f576-fb85-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=3 cap=4) {
(*types.CnsKubernetesEntityMetadata)(0xc0011b1680)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-befe34b1-94db-4318-9e89-ed15a118d6b4",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc0011b1780)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-j4m6t",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-1445",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-befe34b1-94db-4318-9e89-ed15a118d6b4",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc0011b1880)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=16) "pvc-tester-bhr69",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=3) "POD",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-1445",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
EntityName: (string) (len=9) "pvc-j4m6t",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-1445",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc00123af40)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "b7e2a25b-b6d3-4457-bc0e-ad730052377e",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "27c2c262-b664-5cc0-2a8f-02008803ef9f"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:38:41.307: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:true, verifyPodEntry:true
Jul 4 03:38:41.307: INFO: Checking PVC pvc-qqj9l
Jul 4 03:38:41.322: INFO: Processing PVC: pvc-qqj9l
Jul 4 03:38:41.376: INFO: For pod 'pvc-tester-5g7l4', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-qqj9l,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-92n4b,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:41.771: INFO: Found CNS volume with id 2de4fab8-4123-419c-8c4f-23210d6b14a8
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "2de4fab8-4123-419c-8c4f-23210d6b14a8"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "5b444fcf-fb85-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=3 cap=4) {
(*types.CnsKubernetesEntityMetadata)(0xc000554300)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-33031f22-7baf-4bcd-ada2-ac79f1775a21",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc000554400)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-qqj9l",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-33031f22-7baf-4bcd-ada2-ac79f1775a21",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc000554480)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=16) "pvc-tester-5g7l4",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=3) "POD",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
EntityName: (string) (len=9) "pvc-qqj9l",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc0006215c0)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "2de4fab8-4123-419c-8c4f-23210d6b14a8",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "27c2c262-e630-8265-e82c-020088529ac5"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:38:41.771: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:true, verifyPodEntry:true
Jul 4 03:38:41.771: INFO: Checking PVC pvc-qhnfl
Jul 4 03:38:41.787: INFO: Processing PVC: pvc-qhnfl
Jul 4 03:38:41.838: INFO: For pod 'pvc-tester-5g7l4', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-qqj9l,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-92n4b,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:41.838: INFO: For pod 'pvc-tester-c2fhf', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-wlsvt,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-tjpc5,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:41.838: INFO: For pod 'pvc-tester-hp298', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-qhnfl,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-g4glt,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:42.205: INFO: Found CNS volume with id cfd2023d-0844-43d3-9869-1ce34f57ce14
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "cfd2023d-0844-43d3-9869-1ce34f57ce14"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "55112454-fb85-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=3 cap=4) {
(*types.CnsKubernetesEntityMetadata)(0xc001217480)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-a6caf5c3-8f0a-4c1b-b5ea-fc06db3e082b",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc001217580)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-qhnfl",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-a6caf5c3-8f0a-4c1b-b5ea-fc06db3e082b",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc001217680)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=16) "pvc-tester-hp298",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=3) "POD",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
EntityName: (string) (len=9) "pvc-qhnfl",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc00144f500)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "cfd2023d-0844-43d3-9869-1ce34f57ce14",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "27c2c262-1aa5-d59e-4fe7-020088cd1d5a"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:38:42.205: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:true, verifyPodEntry:true
Jul 4 03:38:42.205: INFO: Checking PVC pvc-6qr5j
Jul 4 03:38:42.230: INFO: Processing PVC: pvc-6qr5j
Jul 4 03:38:42.277: INFO: For pod 'pvc-tester-5g7l4', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-qqj9l,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-92n4b,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:42.277: INFO: For pod 'pvc-tester-c2fhf', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-wlsvt,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-tjpc5,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:42.277: INFO: For pod 'pvc-tester-hp298', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-qhnfl,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-g4glt,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:42.277: INFO: For pod 'pvc-tester-pxx45', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-wt4g9,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-zh24m,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:42.277: INFO: For pod 'pvc-tester-r2522', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-6qr5j,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-7td5q,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:38:42.653: INFO: Found CNS volume with id cbc16a13-ffa9-46c8-acc9-4c74356de5ca
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "cbc16a13-ffa9-46c8-acc9-4c74356de5ca"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "4cb91c63-fb85-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=3 cap=4) {
(*types.CnsKubernetesEntityMetadata)(0xc000df4680)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-6qr5j",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=15) "vspherepv-klg8z",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc000df4700)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=16) "pvc-tester-r2522",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=3) "POD",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
EntityName: (string) (len=9) "pvc-6qr5j",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc000df4780)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=15) "vspherepv-klg8z",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc001768580)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "cbc16a13-ffa9-46c8-acc9-4c74356de5ca",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "23c2c262-546b-caae-b323-020088cd1d5a"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:38:42.653: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:true, verifyPodEntry:true
STEP: Delete pod created for test15
Jul 4 03:38:42.653: INFO: Deleting pod "pvc-tester-r2522" in namespace "vcp-2-csi-attach-detach-2540"
Jul 4 03:38:42.684: INFO: Wait up to 5m0s for pod "pvc-tester-r2522" to be fully deleted
STEP: Delete pvc created for test15
Jul 4 03:39:16.796: INFO: volume "cbc16a13-ffa9-46c8-acc9-4c74356de5ca" has successfully deleted
Jul 4 03:39:20.873: INFO: Looking for default datastore in DC: VSAN-DC
Jul 4 03:39:20.888: INFO: Datstore found for DS URL:ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/
STEP: Enable CSI migration feature gates on kublets on k8s nodes
Jul 4 03:39:21.167: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
STEP: Cordoning of node: k8s-node-148-1656928247
STEP: Draining of node: k8s-node-148-1656928247
WARNING: ignoring DaemonSet-managed Pods: kube-system/kube-flannel-ds-kbxvd, kube-system/kube-proxy-q9t45, vmware-system-csi/vsphere-csi-node-jkxkm; deleting Pods that declare no controller: vcp-2-csi-attach-detach-1445/pvc-tester-bhr69, vcp-2-csi-attach-detach-2540/pvc-tester-hp298, vcp-2-csi-attach-detach-2540/pvc-tester-sm2kn
evicting pod vcp-2-csi-attach-detach-2540/pvc-tester-sm2kn
evicting pod vcp-2-csi-attach-detach-1445/pvc-tester-bhr69
evicting pod vcp-2-csi-attach-detach-2540/pvc-tester-hp298
STEP: Modifying feature gates in kubelet config yaml of node: k8s-node-148-1656928247
Jul 4 03:39:21.367: INFO: Invoking command 'grep CSIMigration /var/lib/kubelet/config.yaml' on host 10.185.38.32
Jul 4 03:39:22.721: INFO: host: 10.185.38.32, command: grep CSIMigration /var/lib/kubelet/config.yaml, return code: 1, stdout: , stderr:
Jul 4 03:39:22.721: INFO: Invoking command 'echo "featureGates:
{
"CSIMigration": true,
"CSIMigrationvSphere": true
}" >>/var/lib/kubelet/config.yaml' on host 10.185.38.32
Jul 4 03:39:23.427: INFO: host: 10.185.38.32, command: echo "featureGates:
{
"CSIMigration": true,
"CSIMigrationvSphere": true
}" >>/var/lib/kubelet/config.yaml, return code: 0, stdout: , stderr:
Jul 4 03:39:23.428: INFO: Invoking command 'systemctl daemon-reload && systemctl restart kubelet' on host 10.185.38.32
Jul 4 03:39:25.247: INFO: host: 10.185.38.32, command: systemctl daemon-reload && systemctl restart kubelet, return code: 0, stdout: , stderr:
STEP: Wait for feature gates update on the k8s CSI node: k8s-node-148-1656928247
Jul 4 03:39:25.257: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
Jul 4 03:39:35.274: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
STEP: Uncordoning of node: k8s-node-148-1656928247
Jul 4 03:39:35.318: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
STEP: Cordoning of node: k8s-node-236-1656928234
STEP: Draining of node: k8s-node-236-1656928234
WARNING: ignoring DaemonSet-managed Pods: kube-system/kube-flannel-ds-jtklh, kube-system/kube-proxy-wtp4g, vmware-system-csi/vsphere-csi-node-8rswp; deleting Pods that declare no controller: vcp-2-csi-attach-detach-1445/pvc-tester-mtc62, vcp-2-csi-attach-detach-1445/pvc-tester-p2gfd, vcp-2-csi-attach-detach-2540/pvc-tester-pxx45
evicting pod vcp-2-csi-attach-detach-2540/pvc-tester-pxx45
evicting pod vcp-2-csi-attach-detach-1445/pvc-tester-mtc62
evicting pod vcp-2-csi-attach-detach-1445/pvc-tester-p2gfd
STEP: Modifying feature gates in kubelet config yaml of node: k8s-node-236-1656928234
Jul 4 03:39:35.545: INFO: Invoking command 'grep CSIMigration /var/lib/kubelet/config.yaml' on host 10.185.33.157
Jul 4 03:39:37.085: INFO: host: 10.185.33.157, command: grep CSIMigration /var/lib/kubelet/config.yaml, return code: 1, stdout: , stderr:
Jul 4 03:39:37.085: INFO: Invoking command 'echo "featureGates:
{
"CSIMigration": true,
"CSIMigrationvSphere": true
}" >>/var/lib/kubelet/config.yaml' on host 10.185.33.157
Jul 4 03:39:37.786: INFO: host: 10.185.33.157, command: echo "featureGates:
{
"CSIMigration": true,
"CSIMigrationvSphere": true
}" >>/var/lib/kubelet/config.yaml, return code: 0, stdout: , stderr:
Jul 4 03:39:37.786: INFO: Invoking command 'systemctl daemon-reload && systemctl restart kubelet' on host 10.185.33.157
Jul 4 03:39:39.502: INFO: host: 10.185.33.157, command: systemctl daemon-reload && systemctl restart kubelet, return code: 0, stdout: , stderr:
STEP: Wait for feature gates update on the k8s CSI node: k8s-node-236-1656928234
Jul 4 03:39:39.509: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
Jul 4 03:39:49.525: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
STEP: Uncordoning of node: k8s-node-236-1656928234
Jul 4 03:39:49.557: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
STEP: Cordoning of node: k8s-node-990-1656928220
STEP: Draining of node: k8s-node-990-1656928220
WARNING: ignoring DaemonSet-managed Pods: kube-system/kube-flannel-ds-jv5wm, kube-system/kube-proxy-62sc9, vmware-system-csi/vsphere-csi-node-xzpc9; deleting Pods that declare no controller: vcp-2-csi-attach-detach-1445/pvc-tester-6t4t6, vcp-2-csi-attach-detach-1445/pvc-tester-dljfq, vcp-2-csi-attach-detach-2540/pvc-tester-5g7l4, vcp-2-csi-attach-detach-2540/pvc-tester-c2fhf
evicting pod vcp-2-csi-attach-detach-2540/pvc-tester-c2fhf
evicting pod vcp-2-csi-attach-detach-1445/pvc-tester-6t4t6
evicting pod vcp-2-csi-attach-detach-1445/pvc-tester-dljfq
evicting pod vcp-2-csi-attach-detach-2540/pvc-tester-5g7l4
STEP: Modifying feature gates in kubelet config yaml of node: k8s-node-990-1656928220
Jul 4 03:39:49.770: INFO: Invoking command 'grep CSIMigration /var/lib/kubelet/config.yaml' on host 10.185.35.185
Jul 4 03:39:51.562: INFO: host: 10.185.35.185, command: grep CSIMigration /var/lib/kubelet/config.yaml, return code: 1, stdout: , stderr:
Jul 4 03:39:51.562: INFO: Invoking command 'echo "featureGates:
{
"CSIMigration": true,
"CSIMigrationvSphere": true
}" >>/var/lib/kubelet/config.yaml' on host 10.185.35.185
Jul 4 03:39:52.237: INFO: host: 10.185.35.185, command: echo "featureGates:
{
"CSIMigration": true,
"CSIMigrationvSphere": true
}" >>/var/lib/kubelet/config.yaml, return code: 0, stdout: , stderr:
Jul 4 03:39:52.238: INFO: Invoking command 'systemctl daemon-reload && systemctl restart kubelet' on host 10.185.35.185
Jul 4 03:39:53.989: INFO: host: 10.185.35.185, command: systemctl daemon-reload && systemctl restart kubelet, return code: 0, stdout: , stderr:
STEP: Wait for feature gates update on the k8s CSI node: k8s-node-990-1656928220
Jul 4 03:39:54.003: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
Jul 4 03:40:04.032: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
STEP: Uncordoning of node: k8s-node-990-1656928220
Jul 4 03:40:04.086: INFO: Waiting up to 10m0s for all pods (need at least 0) in namespace 'vcp-2-csi-attach-detach-2540' to be running and ready
Jul 4 03:40:04.121: INFO: 0 / 0 pods in namespace 'vcp-2-csi-attach-detach-2540' are running and ready (0 seconds elapsed)
Jul 4 03:40:04.121: INFO: expected 0 pod replicas in namespace 'vcp-2-csi-attach-detach-2540', 0 are Running and Ready.
STEP: Creating VCP SC post migration
STEP: Creating StorageClass with scParameters: map[datastore:vsanDatastore] and zones: [] and ReclaimPolicy: and allowVolumeExpansion: false
STEP: Creating VCP PVCs post migration
STEP: Creating PVC using the Storage Class vcp-sc-scb5h with disk size and labels: map[] accessMode:
Jul 4 03:40:04.166: INFO: PVC created: pvc-kchcp in namespace: vcp-2-csi-attach-detach-2540
STEP: Creating PVC using the Storage Class vcp-sc-4chpr with disk size and labels: map[] accessMode:
Jul 4 03:40:04.178: INFO: PVC created: pvc-8j5wl in namespace: vcp-2-csi-attach-detach-2540
STEP: Waiting for all claims created post migration to be in bound state
Jul 4 03:40:04.178: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-kchcp] to have phase Bound
Jul 4 03:40:04.192: INFO: PersistentVolumeClaim pvc-kchcp found but phase is Pending instead of Bound.
Jul 4 03:40:06.209: INFO: PersistentVolumeClaim pvc-kchcp found but phase is Pending instead of Bound.
Jul 4 03:40:08.220: INFO: PersistentVolumeClaim pvc-kchcp found and phase=Bound (4.041188591s)
Jul 4 03:40:08.235: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-8j5wl] to have phase Bound
Jul 4 03:40:08.243: INFO: PersistentVolumeClaim pvc-8j5wl found and phase=Bound (7.95857ms)
STEP: Verify annotations on PV/PVCs created post migration
Jul 4 03:40:08.257: INFO: Checking PVC pvc-kchcp
Jul 4 03:40:08.265: INFO: Annotations found on PVC: pvc-kchcp in namespace:vcp-2-csi-attach-detach-2540 are,
(map[string]string) (len=4) {
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes"
}
Jul 4 03:40:08.265: INFO: Checking PVC pvc-8j5wl
Jul 4 03:40:08.273: INFO: Annotations found on PVC: pvc-8j5wl in namespace:vcp-2-csi-attach-detach-2540 are,
(map[string]string) (len=4) {
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=22) "csi.vsphere.vmware.com"
}
Jul 4 03:40:08.274: INFO: Checking PV pvc-243d71a8-6c58-4b33-94e2-21b88ced71c9
Jul 4 03:40:08.280: INFO: Annotations found on PV: pvc-243d71a8-6c58-4b33-94e2-21b88ced71c9 are,
(map[string]string) (len=2) {
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=31) "pv.kubernetes.io/provisioned-by": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 03:40:08.280: INFO: Checking PV pvc-dac01e56-0677-4cc5-a4fd-09d5aa4082eb
Jul 4 03:40:08.286: INFO: Annotations found on PV: pvc-dac01e56-0677-4cc5-a4fd-09d5aa4082eb are,
(map[string]string) (len=2) {
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=31) "pv.kubernetes.io/provisioned-by": (string) (len=28) "kubernetes.io/vsphere-volume"
}
STEP: Wait and verify CNS entries for all CNS volumes created post migration along with their respective CnsVSphereVolumeMigration CRDs
Jul 4 03:40:08.286: INFO: Checking PVC pvc-kchcp
Jul 4 03:40:08.299: INFO: Processing PVC: pvc-kchcp
Jul 4 03:40:08.516: INFO: Found CNS volume with id 9c1051b9-ab74-41b4-a350-01c1a9fba472
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "9c1051b9-ab74-41b4-a350-01c1a9fba472"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=40) "pvc-243d71a8-6c58-4b33-94e2-21b88ced71c9",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) (len=36) "aa6d5a82-1c88-45da-85d3-3d74b91a5bad",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=1 cap=1) {
(*types.CnsKubernetesEntityMetadata)(0xc000ba4280)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-243d71a8-6c58-4b33-94e2-21b88ced71c9",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc000dc4bc0)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "9c1051b9-ab74-41b4-a350-01c1a9fba472",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "84c3c262-4253-5aa4-9c5c-020088529ac5"
}),
ComplianceStatus: (string) (len=9) "compliant",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:40:08.516: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:false, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:false
Jul 4 03:40:18.630: INFO: Found CNS volume with id 9c1051b9-ab74-41b4-a350-01c1a9fba472
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "9c1051b9-ab74-41b4-a350-01c1a9fba472"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=40) "pvc-243d71a8-6c58-4b33-94e2-21b88ced71c9",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) (len=36) "aa6d5a82-1c88-45da-85d3-3d74b91a5bad",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=2 cap=2) {
(*types.CnsKubernetesEntityMetadata)(0xc000df4d80)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-243d71a8-6c58-4b33-94e2-21b88ced71c9",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc000df4e00)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-kchcp",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-243d71a8-6c58-4b33-94e2-21b88ced71c9",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc0017ae400)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "9c1051b9-ab74-41b4-a350-01c1a9fba472",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "84c3c262-4253-5aa4-9c5c-020088529ac5"
}),
ComplianceStatus: (string) (len=9) "compliant",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:40:18.630: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:false
Jul 4 03:40:18.630: INFO: Checking PVC pvc-8j5wl
Jul 4 03:40:18.646: INFO: Processing PVC: pvc-8j5wl
Jul 4 03:40:18.800: INFO: Found CNS volume with id 76bdf10a-9728-4da6-a617-b58274e3259a
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "76bdf10a-9728-4da6-a617-b58274e3259a"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=40) "pvc-dac01e56-0677-4cc5-a4fd-09d5aa4082eb",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) (len=36) "aa6d5a82-1c88-45da-85d3-3d74b91a5bad",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=2 cap=2) {
(*types.CnsKubernetesEntityMetadata)(0xc000ba5700)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-8j5wl",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-dac01e56-0677-4cc5-a4fd-09d5aa4082eb",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc000ba5780)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-dac01e56-0677-4cc5-a4fd-09d5aa4082eb",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc0012a2e80)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "76bdf10a-9728-4da6-a617-b58274e3259a",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "84c3c262-e29b-68a4-7433-020088529ac5"
}),
ComplianceStatus: (string) (len=9) "compliant",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:40:18.800: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:false
STEP: Creating standalone pods using VCP PVCs post migration
STEP: VM UUID is: 4201c124-84e2-596b-a670-ef0e99be85a5 for node: k8s-node-236-1656928234
STEP: Verify volume: 941b2c3c-7e68-41e2-a24d-f764e64e6004 is attached to the node: k8s-node-236-1656928234, VMUUID : 4201c124-84e2-596b-a670-ef0e99be85a5
Jul 4 03:40:29.617: INFO: vmRef: VirtualMachine:vm-52 for the VM uuid: 4201c124-84e2-596b-a670-ef0e99be85a5
Jul 4 03:40:29.624: INFO: Found FCDID "941b2c3c-7e68-41e2-a24d-f764e64e6004" attached to VM "k8s-worker2"
Jul 4 03:40:29.624: INFO: Found the disk "941b2c3c-7e68-41e2-a24d-f764e64e6004" is attached to the VM with UUID: "4201c124-84e2-596b-a670-ef0e99be85a5"
STEP: Verify the volume is accessible and filesystem type is as expected
Jul 4 03:40:29.624: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-attach-detach-2540 exec pvc-tester-rz5pd --namespace=vcp-2-csi-attach-detach-2540 -- /bin/cat /mnt/volume1/fstype'
Jul 4 03:40:30.063: INFO: stderr: ""
Jul 4 03:40:30.063: INFO: stdout: "ext4\n"
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
STEP: Verify volume: 452b55a1-2b90-452e-add1-0e4d08f3d365 is attached to the node: k8s-node-148-1656928247, VMUUID : 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:40:34.184: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:40:34.193: INFO: Found FCDID "452b55a1-2b90-452e-add1-0e4d08f3d365" attached to VM "k8s-worker3"
Jul 4 03:40:34.193: INFO: Found the disk "452b55a1-2b90-452e-add1-0e4d08f3d365" is attached to the VM with UUID: "42012c70-2cfc-49b2-410d-e65427bd134c"
STEP: Verify the volume is accessible and filesystem type is as expected
Jul 4 03:40:34.193: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-attach-detach-2540 exec pvc-tester-hntc9 --namespace=vcp-2-csi-attach-detach-2540 -- /bin/cat /mnt/volume1/fstype'
Jul 4 03:40:34.719: INFO: stderr: ""
Jul 4 03:40:34.720: INFO: stdout: "ext4\n"
STEP: VM UUID is: 42012696-a5ac-0b47-440b-883314beee49 for node: k8s-node-990-1656928220
STEP: Verify volume: 95a11459-1d2f-4a00-919b-a03c462f0a8d is attached to the node: k8s-node-990-1656928220, VMUUID : 42012696-a5ac-0b47-440b-883314beee49
Jul 4 03:40:34.803: INFO: vmRef: VirtualMachine:vm-53 for the VM uuid: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 03:40:34.810: INFO: Found FCDID "95a11459-1d2f-4a00-919b-a03c462f0a8d" attached to VM "k8s-worker1"
Jul 4 03:40:34.810: INFO: Found the disk "95a11459-1d2f-4a00-919b-a03c462f0a8d" is attached to the VM with UUID: "42012696-a5ac-0b47-440b-883314beee49"
STEP: Verify the volume is accessible and filesystem type is as expected
Jul 4 03:40:34.810: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-attach-detach-2540 exec pvc-tester-rzs54 --namespace=vcp-2-csi-attach-detach-2540 -- /bin/cat /mnt/volume1/fstype'
Jul 4 03:40:35.038: INFO: stderr: ""
Jul 4 03:40:35.038: INFO: stdout: "ext4\n"
STEP: VM UUID is: 42012696-a5ac-0b47-440b-883314beee49 for node: k8s-node-990-1656928220
STEP: Verify volume: e89429ea-ddfa-42bf-9272-d543c69bf2fc is attached to the node: k8s-node-990-1656928220, VMUUID : 42012696-a5ac-0b47-440b-883314beee49
Jul 4 03:40:35.126: INFO: vmRef: VirtualMachine:vm-53 for the VM uuid: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 03:40:35.131: INFO: Found FCDID "e89429ea-ddfa-42bf-9272-d543c69bf2fc" attached to VM "k8s-worker1"
Jul 4 03:40:35.132: INFO: Found the disk "e89429ea-ddfa-42bf-9272-d543c69bf2fc" is attached to the VM with UUID: "42012696-a5ac-0b47-440b-883314beee49"
STEP: Verify the volume is accessible and filesystem type is as expected
Jul 4 03:40:35.132: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-attach-detach-2540 exec pvc-tester-r7fx7 --namespace=vcp-2-csi-attach-detach-2540 -- /bin/cat /mnt/volume1/fstype'
Jul 4 03:40:35.345: INFO: stderr: ""
Jul 4 03:40:35.345: INFO: stdout: "ext4\n"
STEP: VM UUID is: 4201c124-84e2-596b-a670-ef0e99be85a5 for node: k8s-node-236-1656928234
STEP: Verify volume: 9e9dad92-bf8c-4b96-a9f2-100fe0d92ed9 is attached to the node: k8s-node-236-1656928234, VMUUID : 4201c124-84e2-596b-a670-ef0e99be85a5
Jul 4 03:40:35.440: INFO: vmRef: VirtualMachine:vm-52 for the VM uuid: 4201c124-84e2-596b-a670-ef0e99be85a5
Jul 4 03:40:35.447: INFO: Found FCDID "9e9dad92-bf8c-4b96-a9f2-100fe0d92ed9" attached to VM "k8s-worker2"
Jul 4 03:40:35.447: INFO: Found the disk "9e9dad92-bf8c-4b96-a9f2-100fe0d92ed9" is attached to the VM with UUID: "4201c124-84e2-596b-a670-ef0e99be85a5"
STEP: Verify the volume is accessible and filesystem type is as expected
Jul 4 03:40:35.447: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-attach-detach-2540 exec pvc-tester-8wkjp --namespace=vcp-2-csi-attach-detach-2540 -- /bin/cat /mnt/volume1/fstype'
Jul 4 03:40:35.683: INFO: stderr: ""
Jul 4 03:40:35.683: INFO: stdout: "ext4\n"
STEP: VM UUID is: 4201c124-84e2-596b-a670-ef0e99be85a5 for node: k8s-node-236-1656928234
STEP: Verify volume: 9c1051b9-ab74-41b4-a350-01c1a9fba472 is attached to the node: k8s-node-236-1656928234, VMUUID : 4201c124-84e2-596b-a670-ef0e99be85a5
Jul 4 03:40:35.786: INFO: vmRef: VirtualMachine:vm-52 for the VM uuid: 4201c124-84e2-596b-a670-ef0e99be85a5
Jul 4 03:40:35.793: INFO: Found FCDID "9c1051b9-ab74-41b4-a350-01c1a9fba472" attached to VM "k8s-worker2"
Jul 4 03:40:35.793: INFO: Found the disk "9c1051b9-ab74-41b4-a350-01c1a9fba472" is attached to the VM with UUID: "4201c124-84e2-596b-a670-ef0e99be85a5"
STEP: Verify the volume is accessible and filesystem type is as expected
Jul 4 03:40:35.793: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-attach-detach-2540 exec pvc-tester-8wkjp --namespace=vcp-2-csi-attach-detach-2540 -- /bin/cat /mnt/volume1/fstype'
Jul 4 03:40:36.008: INFO: stderr: ""
Jul 4 03:40:36.008: INFO: stdout: "ext4\n"
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
STEP: Verify volume: 76bdf10a-9728-4da6-a617-b58274e3259a is attached to the node: k8s-node-148-1656928247, VMUUID : 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:40:36.089: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:40:36.100: INFO: Found FCDID "76bdf10a-9728-4da6-a617-b58274e3259a" attached to VM "k8s-worker3"
Jul 4 03:40:36.100: INFO: Found the disk "76bdf10a-9728-4da6-a617-b58274e3259a" is attached to the VM with UUID: "42012c70-2cfc-49b2-410d-e65427bd134c"
STEP: Verify the volume is accessible and filesystem type is as expected
Jul 4 03:40:36.100: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-attach-detach-2540 exec pvc-tester-8vb2r --namespace=vcp-2-csi-attach-detach-2540 -- /bin/cat /mnt/volume1/fstype'
Jul 4 03:40:36.331: INFO: stderr: ""
Jul 4 03:40:36.331: INFO: stdout: "ext4\n"
STEP: VM UUID is: 4201c124-84e2-596b-a670-ef0e99be85a5 for node: k8s-node-236-1656928234
STEP: Verify volume: 686ff46a-4547-457a-ab8b-6c5c0e8cb526 is attached to the node: k8s-node-236-1656928234, VMUUID : 4201c124-84e2-596b-a670-ef0e99be85a5
Jul 4 03:40:36.448: INFO: vmRef: VirtualMachine:vm-52 for the VM uuid: 4201c124-84e2-596b-a670-ef0e99be85a5
Jul 4 03:40:36.454: INFO: Found FCDID "686ff46a-4547-457a-ab8b-6c5c0e8cb526" attached to VM "k8s-worker2"
Jul 4 03:40:36.454: INFO: Found the disk "686ff46a-4547-457a-ab8b-6c5c0e8cb526" is attached to the VM with UUID: "4201c124-84e2-596b-a670-ef0e99be85a5"
STEP: Verify the volume is accessible and filesystem type is as expected
Jul 4 03:40:36.454: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-attach-detach-2540 exec pvc-tester-6r98m --namespace=vcp-2-csi-attach-detach-2540 -- /bin/cat /mnt/volume1/fstype'
Jul 4 03:40:36.709: INFO: stderr: ""
Jul 4 03:40:36.709: INFO: stdout: "ext4\n"
STEP: VM UUID is: 42012696-a5ac-0b47-440b-883314beee49 for node: k8s-node-990-1656928220
STEP: Verify volume: 2de4fab8-4123-419c-8c4f-23210d6b14a8 is attached to the node: k8s-node-990-1656928220, VMUUID : 42012696-a5ac-0b47-440b-883314beee49
Jul 4 03:40:36.789: INFO: vmRef: VirtualMachine:vm-53 for the VM uuid: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 03:40:36.796: INFO: Found FCDID "2de4fab8-4123-419c-8c4f-23210d6b14a8" attached to VM "k8s-worker1"
Jul 4 03:40:36.796: INFO: Found the disk "2de4fab8-4123-419c-8c4f-23210d6b14a8" is attached to the VM with UUID: "42012696-a5ac-0b47-440b-883314beee49"
STEP: Verify the volume is accessible and filesystem type is as expected
Jul 4 03:40:36.796: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-attach-detach-2540 exec pvc-tester-n565r --namespace=vcp-2-csi-attach-detach-2540 -- /bin/cat /mnt/volume1/fstype'
Jul 4 03:40:36.990: INFO: stderr: ""
Jul 4 03:40:36.990: INFO: stdout: "ext4\n"
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
STEP: Verify volume: cfd2023d-0844-43d3-9869-1ce34f57ce14 is attached to the node: k8s-node-148-1656928247, VMUUID : 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:40:37.098: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:40:37.106: INFO: Found FCDID "cfd2023d-0844-43d3-9869-1ce34f57ce14" attached to VM "k8s-worker3"
Jul 4 03:40:37.106: INFO: Found the disk "cfd2023d-0844-43d3-9869-1ce34f57ce14" is attached to the VM with UUID: "42012c70-2cfc-49b2-410d-e65427bd134c"
STEP: Verify the volume is accessible and filesystem type is as expected
Jul 4 03:40:37.106: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-attach-detach-2540 exec pvc-tester-qp799 --namespace=vcp-2-csi-attach-detach-2540 -- /bin/cat /mnt/volume1/fstype'
Jul 4 03:40:37.310: INFO: stderr: ""
Jul 4 03:40:37.310: INFO: stdout: "ext4\n"
STEP: VM UUID is: 42012696-a5ac-0b47-440b-883314beee49 for node: k8s-node-990-1656928220
STEP: Verify volume: 9fc3a7be-3cda-4d2c-9365-c658af1fcb6f is attached to the node: k8s-node-990-1656928220, VMUUID : 42012696-a5ac-0b47-440b-883314beee49
Jul 4 03:40:37.394: INFO: vmRef: VirtualMachine:vm-53 for the VM uuid: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 03:40:37.400: INFO: Found FCDID "9fc3a7be-3cda-4d2c-9365-c658af1fcb6f" attached to VM "k8s-worker1"
Jul 4 03:40:37.400: INFO: Found the disk "9fc3a7be-3cda-4d2c-9365-c658af1fcb6f" is attached to the VM with UUID: "42012696-a5ac-0b47-440b-883314beee49"
STEP: Verify the volume is accessible and filesystem type is as expected
Jul 4 03:40:37.400: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-attach-detach-1445 exec pvc-tester-5sjqs --namespace=vcp-2-csi-attach-detach-1445 -- /bin/cat /mnt/volume1/fstype'
Jul 4 03:40:37.626: INFO: stderr: ""
Jul 4 03:40:37.626: INFO: stdout: "ext4\n"
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
STEP: Verify volume: 1c0a67af-16c9-48cc-ae74-4e13641fabe7 is attached to the node: k8s-node-148-1656928247, VMUUID : 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:40:37.722: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:40:37.728: INFO: Found FCDID "1c0a67af-16c9-48cc-ae74-4e13641fabe7" attached to VM "k8s-worker3"
Jul 4 03:40:37.728: INFO: Found the disk "1c0a67af-16c9-48cc-ae74-4e13641fabe7" is attached to the VM with UUID: "42012c70-2cfc-49b2-410d-e65427bd134c"
STEP: Verify the volume is accessible and filesystem type is as expected
Jul 4 03:40:37.728: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-attach-detach-1445 exec pvc-tester-tbzds --namespace=vcp-2-csi-attach-detach-1445 -- /bin/cat /mnt/volume1/fstype'
Jul 4 03:40:37.950: INFO: stderr: ""
Jul 4 03:40:37.950: INFO: stdout: "ext4\n"
STEP: VM UUID is: 4201c124-84e2-596b-a670-ef0e99be85a5 for node: k8s-node-236-1656928234
STEP: Verify volume: 2806d2b0-0bbd-48ce-9a86-def41e2d87e9 is attached to the node: k8s-node-236-1656928234, VMUUID : 4201c124-84e2-596b-a670-ef0e99be85a5
Jul 4 03:40:38.040: INFO: vmRef: VirtualMachine:vm-52 for the VM uuid: 4201c124-84e2-596b-a670-ef0e99be85a5
Jul 4 03:40:38.047: INFO: Found FCDID "2806d2b0-0bbd-48ce-9a86-def41e2d87e9" attached to VM "k8s-worker2"
Jul 4 03:40:38.047: INFO: Found the disk "2806d2b0-0bbd-48ce-9a86-def41e2d87e9" is attached to the VM with UUID: "4201c124-84e2-596b-a670-ef0e99be85a5"
STEP: Verify the volume is accessible and filesystem type is as expected
Jul 4 03:40:38.047: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-attach-detach-1445 exec pvc-tester-4cd4l --namespace=vcp-2-csi-attach-detach-1445 -- /bin/cat /mnt/volume1/fstype'
Jul 4 03:40:38.266: INFO: stderr: ""
Jul 4 03:40:38.266: INFO: stdout: "ext4\n"
STEP: VM UUID is: 4201c124-84e2-596b-a670-ef0e99be85a5 for node: k8s-node-236-1656928234
STEP: Verify volume: 44befe11-354c-41a8-9a62-02941a98837e is attached to the node: k8s-node-236-1656928234, VMUUID : 4201c124-84e2-596b-a670-ef0e99be85a5
Jul 4 03:40:38.355: INFO: vmRef: VirtualMachine:vm-52 for the VM uuid: 4201c124-84e2-596b-a670-ef0e99be85a5
Jul 4 03:40:38.370: INFO: Found FCDID "44befe11-354c-41a8-9a62-02941a98837e" attached to VM "k8s-worker2"
Jul 4 03:40:38.370: INFO: Found the disk "44befe11-354c-41a8-9a62-02941a98837e" is attached to the VM with UUID: "4201c124-84e2-596b-a670-ef0e99be85a5"
STEP: Verify the volume is accessible and filesystem type is as expected
Jul 4 03:40:38.370: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-attach-detach-1445 exec pvc-tester-xftg5 --namespace=vcp-2-csi-attach-detach-1445 -- /bin/cat /mnt/volume1/fstype'
Jul 4 03:40:38.585: INFO: stderr: ""
Jul 4 03:40:38.585: INFO: stdout: "ext4\n"
STEP: VM UUID is: 42012696-a5ac-0b47-440b-883314beee49 for node: k8s-node-990-1656928220
STEP: Verify volume: b7e2a25b-b6d3-4457-bc0e-ad730052377e is attached to the node: k8s-node-990-1656928220, VMUUID : 42012696-a5ac-0b47-440b-883314beee49
Jul 4 03:40:38.673: INFO: vmRef: VirtualMachine:vm-53 for the VM uuid: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 03:40:38.680: INFO: Found FCDID "b7e2a25b-b6d3-4457-bc0e-ad730052377e" attached to VM "k8s-worker1"
Jul 4 03:40:38.680: INFO: Found the disk "b7e2a25b-b6d3-4457-bc0e-ad730052377e" is attached to the VM with UUID: "42012696-a5ac-0b47-440b-883314beee49"
STEP: Verify the volume is accessible and filesystem type is as expected
Jul 4 03:40:38.680: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-attach-detach-1445 exec pvc-tester-ckzrc --namespace=vcp-2-csi-attach-detach-1445 -- /bin/cat /mnt/volume1/fstype'
Jul 4 03:40:38.897: INFO: stderr: ""
Jul 4 03:40:38.897: INFO: stdout: "ext4\n"
STEP: Creating pod to attach PV(s) to a node
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
STEP: Verify volume: 9280857a-e9c3-4b13-b90b-9f790b6fe696 is attached to the node: k8s-node-148-1656928247, VMUUID : 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:40:51.045: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:40:51.051: INFO: Found FCDID "9280857a-e9c3-4b13-b90b-9f790b6fe696" attached to VM "k8s-worker3"
Jul 4 03:40:51.051: INFO: Found the disk "9280857a-e9c3-4b13-b90b-9f790b6fe696" is attached to the VM with UUID: "42012c70-2cfc-49b2-410d-e65427bd134c"
STEP: Verify the volume is accessible and filesystem type is as expected
Jul 4 03:40:51.051: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-attach-detach-2540 exec pvc-tester-qvw6l --namespace=vcp-2-csi-attach-detach-2540 -- /bin/cat /mnt/volume1/fstype'
Jul 4 03:40:51.274: INFO: stderr: ""
Jul 4 03:40:51.274: INFO: stdout: "ext4\n"
STEP: Delete pod created for test18
STEP: Deleting pod: pvc-tester-qvw6l
Jul 4 03:40:51.285: INFO: pod info:
(*v1.Pod)(0xc000808c00)(&Pod{ObjectMeta:{pvc-tester-qvw6l pvc-tester- vcp-2-csi-attach-detach-2540 5cd82eae-97f2-48f6-b95b-5f7b13d7965a 11780 0 2022-07-04 03:40:38 -0700 PDT <nil> <nil> map[] map[] [] [] [{e2e.test Update v1 2022-07-04 03:40:38 -0700 PDT FieldsV1 {"f:metadata":{"f:generateName":{}},"f:spec":{"f:containers":{"k:{\"name\":\"write-pod\"}":{".":{},"f:command":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{".":{},"f:privileged":{}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/mnt/volume1\"}":{".":{},"f:mountPath":{},"f:name":{}}}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{},"f:volumes":{".":{},"k:{\"name\":\"volume1\"}":{".":{},"f:name":{},"f:persistentVolumeClaim":{".":{},"f:claimName":{}}}}}} } {kubelet Update v1 2022-07-04 03:40:49 -0700 PDT FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"10.244.5.10\"}":{".":{},"f:ip":{}}},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-wt4g9,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},Volume{Name:kube-api-access-9l4kq,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:write-pod,Image:gcr.io/google_containers/busybox:1.27,Command:[/bin/sh -c /bin/df -T /mnt/volume1 | /bin/awk 'FNR == 2 {print $2}' > /mnt/volume1/fstype && while true ; do sleep 2 ; done],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:volume1,ReadOnly:false,MountPath:/mnt/volume1,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:kube-api-access-9l4kq,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:*false,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:OnFailure,TerminationGracePeriodSeconds:*30,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:k8s-node-148-1656928247,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,},Status:PodStatus{Phase:Running,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-07-04 03:40:38 -0700 PDT,Reason:,Message:,},PodCondition{Type:Ready,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-07-04 03:40:49 -0700 PDT,Reason:,Message:,},PodCondition{Type:ContainersReady,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-07-04 03:40:49 -0700 PDT,Reason:,Message:,},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-07-04 03:40:38 -0700 PDT,Reason:,Message:,},},Message:,Reason:,HostIP:10.185.38.32,PodIP:10.244.5.10,StartTime:2022-07-04 03:40:38 -0700 PDT,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:write-pod,State:ContainerState{Waiting:nil,Running:&ContainerStateRunning{StartedAt:2022-07-04 03:40:49 -0700 PDT,},Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:true,RestartCount:0,Image:gcr.io/google_containers/busybox:1.27,ImageID:gcr.io/google_containers/busybox@sha256:545e6a6310a27636260920bc07b994a299b6708a1b26910cfefd335fdfb60d2b,ContainerID:containerd://ca05c5259af7525129342302500e43c69fc83bc124b8e8cdd5a855ec98a8b917,Started:*true,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:10.244.5.10,},},EphemeralContainerStatuses:[]ContainerStatus{},},})
Jul 4 03:40:51.285: INFO: vol info:
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-wt4g9,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},}
Jul 4 03:40:51.329: INFO: Deleting pod "pvc-tester-qvw6l" in namespace "vcp-2-csi-attach-detach-2540"
Jul 4 03:40:51.361: INFO: Wait up to 5m0s for pod "pvc-tester-qvw6l" to be fully deleted
STEP: Verify volume is detached from the node
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
Jul 4 03:41:25.415: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:41:25.424: INFO: Found FCDID "9280857a-e9c3-4b13-b90b-9f790b6fe696" attached to VM "k8s-worker3"
Jul 4 03:41:25.424: INFO: Found the disk "9280857a-e9c3-4b13-b90b-9f790b6fe696" is attached to the VM with UUID: "42012c70-2cfc-49b2-410d-e65427bd134c"
Jul 4 03:41:25.424: INFO: Waiting for disk: "9280857a-e9c3-4b13-b90b-9f790b6fe696" to be detached from the node :"k8s-node-148-1656928247"
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
Jul 4 03:41:27.417: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:41:27.424: INFO: Found FCDID "9280857a-e9c3-4b13-b90b-9f790b6fe696" attached to VM "k8s-worker3"
Jul 4 03:41:27.424: INFO: Found the disk "9280857a-e9c3-4b13-b90b-9f790b6fe696" is attached to the VM with UUID: "42012c70-2cfc-49b2-410d-e65427bd134c"
Jul 4 03:41:27.424: INFO: Waiting for disk: "9280857a-e9c3-4b13-b90b-9f790b6fe696" to be detached from the node :"k8s-node-148-1656928247"
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
Jul 4 03:41:29.421: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:41:29.430: INFO: Found FCDID "9280857a-e9c3-4b13-b90b-9f790b6fe696" attached to VM "k8s-worker3"
Jul 4 03:41:29.430: INFO: Found the disk "9280857a-e9c3-4b13-b90b-9f790b6fe696" is attached to the VM with UUID: "42012c70-2cfc-49b2-410d-e65427bd134c"
Jul 4 03:41:29.430: INFO: Waiting for disk: "9280857a-e9c3-4b13-b90b-9f790b6fe696" to be detached from the node :"k8s-node-148-1656928247"
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
Jul 4 03:41:31.449: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:41:31.456: INFO: failed to find FCDID "9280857a-e9c3-4b13-b90b-9f790b6fe696" attached to VM "k8s-worker3"
Jul 4 03:41:31.456: INFO: Disk: 9280857a-e9c3-4b13-b90b-9f790b6fe696 successfully detached
STEP: Restart CSI driver
Jul 4 03:41:31.474: INFO: Stopping CSI driver
STEP: Waiting for update operation on deployment to take effect
Jul 4 03:42:01.542: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:0, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2022, time.July, 4, 3, 26, 8, 0, time.Local), LastTransitionTime:time.Date(2022, time.July, 4, 3, 26, 8, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.July, 4, 3, 26, 10, 0, time.Local), LastTransitionTime:time.Date(2022, time.July, 4, 3, 25, 36, 0, time.Local), Reason:"NewReplicaSetAvailable", Message:"ReplicaSet \"vsphere-csi-controller-65c6d44ffc\" has successfully progressed."}}, CollisionCount:(*int32)(nil)}
Jul 4 03:42:03.557: INFO: Starting CSI driver
STEP: Waiting for update operation on deployment to take effect
Jul 4 03:42:33.647: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:0, UpdatedReplicas:0, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:0, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2022, time.July, 4, 3, 26, 8, 0, time.Local), LastTransitionTime:time.Date(2022, time.July, 4, 3, 26, 8, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.July, 4, 3, 26, 10, 0, time.Local), LastTransitionTime:time.Date(2022, time.July, 4, 3, 25, 36, 0, time.Local), Reason:"NewReplicaSetAvailable", Message:"ReplicaSet \"vsphere-csi-controller-65c6d44ffc\" has successfully progressed."}}, CollisionCount:(*int32)(nil)}
Jul 4 03:42:35.668: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:3, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.July, 4, 3, 26, 10, 0, time.Local), LastTransitionTime:time.Date(2022, time.July, 4, 3, 25, 36, 0, time.Local), Reason:"NewReplicaSetAvailable", Message:"ReplicaSet \"vsphere-csi-controller-65c6d44ffc\" has successfully progressed."}, v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.July, 4, 3, 42, 33, 0, time.Local), LastTransitionTime:time.Date(2022, time.July, 4, 3, 42, 33, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}}, CollisionCount:(*int32)(nil)}
Jul 4 03:42:37.683: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:3, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.July, 4, 3, 26, 10, 0, time.Local), LastTransitionTime:time.Date(2022, time.July, 4, 3, 25, 36, 0, time.Local), Reason:"NewReplicaSetAvailable", Message:"ReplicaSet \"vsphere-csi-controller-65c6d44ffc\" has successfully progressed."}, v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.July, 4, 3, 42, 33, 0, time.Local), LastTransitionTime:time.Date(2022, time.July, 4, 3, 42, 33, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}}, CollisionCount:(*int32)(nil)}
STEP: Re-create pod for test18
STEP: Creating pod to attach PV(s) to a node
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
STEP: Verify volume: 9280857a-e9c3-4b13-b90b-9f790b6fe696 is attached to the node: k8s-node-148-1656928247, VMUUID : 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:43:01.818: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:43:01.826: INFO: Found FCDID "9280857a-e9c3-4b13-b90b-9f790b6fe696" attached to VM "k8s-worker3"
Jul 4 03:43:01.826: INFO: Found the disk "9280857a-e9c3-4b13-b90b-9f790b6fe696" is attached to the VM with UUID: "42012c70-2cfc-49b2-410d-e65427bd134c"
STEP: Verify the volume is accessible and filesystem type is as expected
Jul 4 03:43:01.826: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-attach-detach-2540 exec pvc-tester-rqkbz --namespace=vcp-2-csi-attach-detach-2540 -- /bin/cat /mnt/volume1/fstype'
Jul 4 03:43:02.066: INFO: stderr: ""
Jul 4 03:43:02.066: INFO: stdout: "ext4\n"
STEP: Wait and verify CNS entries for all CNS volumes
Jul 4 03:43:02.066: INFO: Checking PVC pvc-wq8xm
Jul 4 03:43:02.080: INFO: Processing PVC: pvc-wq8xm
Jul 4 03:43:02.154: INFO: For pod 'pvc-tester-6r98m', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-w64rk,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-dsv56,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:02.154: INFO: For pod 'pvc-tester-8vb2r', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-8j5wl,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-5bcp2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:02.155: INFO: For pod 'pvc-tester-8wkjp', volumes:
([]v1.Volume) (len=3 cap=4) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-x9cc4,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:volume2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-kchcp,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-8l7wp,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:02.155: INFO: For pod 'pvc-tester-hntc9', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-wlsvt,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-lkprv,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:02.155: INFO: For pod 'pvc-tester-n565r', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-qqj9l,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-wwwf9,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:02.155: INFO: For pod 'pvc-tester-qp799', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-qhnfl,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-hb845,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:02.155: INFO: For pod 'pvc-tester-r7fx7', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-rlt68,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-25xhm,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:02.155: INFO: For pod 'pvc-tester-rqkbz', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-wt4g9,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-k52m9,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:02.155: INFO: For pod 'pvc-tester-rz5pd', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-kxw6c,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-rltgr,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:02.155: INFO: For pod 'pvc-tester-rzs54', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-wq8xm,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-rxxnj,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:02.234: INFO: Found CNS volume with id 95a11459-1d2f-4a00-919b-a03c462f0a8d
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "95a11459-1d2f-4a00-919b-a03c462f0a8d"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "49ea8df6-fb85-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=3 cap=4) {
(*types.CnsKubernetesEntityMetadata)(0xc0018f8d00)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=16) "pvc-tester-rzs54",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=3) "POD",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
EntityName: (string) (len=9) "pvc-wq8xm",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc0018f8d80)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-wq8xm",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=15) "vspherepv-w8wv5",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc0018f8e00)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=15) "vspherepv-w8wv5",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc00153f580)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "95a11459-1d2f-4a00-919b-a03c462f0a8d",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "07c2c262-fc69-dec0-67e5-020088cd1d5a"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=13) "notAccessible",
HealthStatus: (string) (len=7) "unknown"
}
Jul 4 03:43:02.234: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:true, verifyPodEntry:true
Jul 4 03:43:02.234: INFO: Checking PVC pvc-rlt68
Jul 4 03:43:02.255: INFO: Processing PVC: pvc-rlt68
Jul 4 03:43:02.351: INFO: For pod 'pvc-tester-6r98m', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-w64rk,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-dsv56,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:02.351: INFO: For pod 'pvc-tester-8vb2r', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-8j5wl,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-5bcp2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:02.351: INFO: For pod 'pvc-tester-8wkjp', volumes:
([]v1.Volume) (len=3 cap=4) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-x9cc4,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:volume2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-kchcp,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-8l7wp,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:02.351: INFO: For pod 'pvc-tester-hntc9', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-wlsvt,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-lkprv,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:02.351: INFO: For pod 'pvc-tester-n565r', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-qqj9l,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-wwwf9,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:02.351: INFO: For pod 'pvc-tester-qp799', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-qhnfl,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-hb845,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:02.351: INFO: For pod 'pvc-tester-r7fx7', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-rlt68,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-25xhm,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:02.752: INFO: Found CNS volume with id e89429ea-ddfa-42bf-9272-d543c69bf2fc
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "e89429ea-ddfa-42bf-9272-d543c69bf2fc"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "4522cd9d-fb85-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=3 cap=4) {
(*types.CnsKubernetesEntityMetadata)(0xc0018f8d00)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-rlt68",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=15) "vspherepv-khnpl",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc0018f8d80)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=16) "pvc-tester-r7fx7",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=3) "POD",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
EntityName: (string) (len=9) "pvc-rlt68",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc0018f8e00)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=15) "vspherepv-khnpl",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc000faa940)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "e89429ea-ddfa-42bf-9272-d543c69bf2fc",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "14c2c262-4a65-fdc0-13bf-020088cd1d5a"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:43:02.752: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:true, verifyPodEntry:true
Jul 4 03:43:02.752: INFO: Checking PVC pvc-kxw6c
Jul 4 03:43:02.779: INFO: Processing PVC: pvc-kxw6c
Jul 4 03:43:02.833: INFO: For pod 'pvc-tester-6r98m', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-w64rk,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-dsv56,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:02.833: INFO: For pod 'pvc-tester-8vb2r', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-8j5wl,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-5bcp2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:02.833: INFO: For pod 'pvc-tester-8wkjp', volumes:
([]v1.Volume) (len=3 cap=4) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-x9cc4,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:volume2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-kchcp,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-8l7wp,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:02.833: INFO: For pod 'pvc-tester-hntc9', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-wlsvt,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-lkprv,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:02.833: INFO: For pod 'pvc-tester-n565r', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-qqj9l,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-wwwf9,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:02.833: INFO: For pod 'pvc-tester-qp799', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-qhnfl,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-hb845,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:02.833: INFO: For pod 'pvc-tester-r7fx7', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-rlt68,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-25xhm,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:02.833: INFO: For pod 'pvc-tester-rqkbz', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-wt4g9,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-k52m9,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:02.834: INFO: For pod 'pvc-tester-rz5pd', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-kxw6c,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-rltgr,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:02.897: INFO: Found CNS volume with id 941b2c3c-7e68-41e2-a24d-f764e64e6004
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "941b2c3c-7e68-41e2-a24d-f764e64e6004"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "495b9279-fb85-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=3 cap=4) {
(*types.CnsKubernetesEntityMetadata)(0xc000ba5300)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-19419533-9395-4614-8d66-7adcf6e8024c",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc000ba5380)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-kxw6c",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-19419533-9395-4614-8d66-7adcf6e8024c",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc000ba5400)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=16) "pvc-tester-rz5pd",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=3) "POD",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
EntityName: (string) (len=9) "pvc-kxw6c",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc000669500)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "941b2c3c-7e68-41e2-a24d-f764e64e6004",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "26c2c262-641a-ae04-6e07-020088529ac5"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=13) "notAccessible",
HealthStatus: (string) (len=7) "unknown"
}
Jul 4 03:43:02.897: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:true, verifyPodEntry:true
Jul 4 03:43:02.897: INFO: Checking PVC pvc-wlsvt
Jul 4 03:43:02.912: INFO: Processing PVC: pvc-wlsvt
Jul 4 03:43:02.974: INFO: For pod 'pvc-tester-6r98m', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-w64rk,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-dsv56,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:02.974: INFO: For pod 'pvc-tester-8vb2r', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-8j5wl,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-5bcp2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:02.974: INFO: For pod 'pvc-tester-8wkjp', volumes:
([]v1.Volume) (len=3 cap=4) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-x9cc4,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:volume2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-kchcp,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-8l7wp,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:02.974: INFO: For pod 'pvc-tester-hntc9', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-wlsvt,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-lkprv,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:03.414: INFO: Found CNS volume with id 452b55a1-2b90-452e-add1-0e4d08f3d365
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "452b55a1-2b90-452e-add1-0e4d08f3d365"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "51a64e65-fb85-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=3 cap=4) {
(*types.CnsKubernetesEntityMetadata)(0xc000ba5580)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-0a8fe646-fee8-4506-aa19-21f8da4b3479",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc000ba5600)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=16) "pvc-tester-hntc9",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=3) "POD",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
EntityName: (string) (len=9) "pvc-wlsvt",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc000ba5680)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-wlsvt",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-0a8fe646-fee8-4506-aa19-21f8da4b3479",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc001447140)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "452b55a1-2b90-452e-add1-0e4d08f3d365",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "26c2c262-4a6f-5168-523c-02008803ef9f"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:43:03.414: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:true, verifyPodEntry:true
Jul 4 03:43:03.414: INFO: Checking PVC pvc-x9cc4
Jul 4 03:43:03.429: INFO: Processing PVC: pvc-x9cc4
Jul 4 03:43:03.486: INFO: For pod 'pvc-tester-6r98m', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-w64rk,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-dsv56,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:03.486: INFO: For pod 'pvc-tester-8vb2r', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-8j5wl,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-5bcp2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:03.486: INFO: For pod 'pvc-tester-8wkjp', volumes:
([]v1.Volume) (len=3 cap=4) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-x9cc4,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:volume2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-kchcp,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-8l7wp,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:03.543: INFO: Found CNS volume with id 9e9dad92-bf8c-4b96-a9f2-100fe0d92ed9
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "9e9dad92-bf8c-4b96-a9f2-100fe0d92ed9"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "4e454d7a-fb85-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=3 cap=4) {
(*types.CnsKubernetesEntityMetadata)(0xc001217200)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-ef64f55f-50b3-41b7-b572-ead72fa03a03",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc001217280)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=16) "pvc-tester-8wkjp",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=3) "POD",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
EntityName: (string) (len=9) "pvc-x9cc4",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc001217380)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-x9cc4",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-ef64f55f-50b3-41b7-b572-ead72fa03a03",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc001263380)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "9e9dad92-bf8c-4b96-a9f2-100fe0d92ed9",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "26c2c262-58d9-a3f8-ea41-0200883dcaf9"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=13) "notAccessible",
HealthStatus: (string) (len=7) "unknown"
}
Jul 4 03:43:03.543: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:true, verifyPodEntry:true
Jul 4 03:43:03.543: INFO: Checking PVC pvc-w64rk
Jul 4 03:43:03.561: INFO: Processing PVC: pvc-w64rk
Jul 4 03:43:03.634: INFO: For pod 'pvc-tester-6r98m', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-w64rk,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-dsv56,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:03.752: INFO: Found CNS volume with id 686ff46a-4547-457a-ab8b-6c5c0e8cb526
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "686ff46a-4547-457a-ab8b-6c5c0e8cb526"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "4b2b0696-fb85-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) (len=36) "aa6d5a82-1c88-45da-85d3-3d74b91a5bad",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=3 cap=4) {
(*types.CnsKubernetesEntityMetadata)(0xc001926000)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-fe4f7c74-6617-4b31-b774-a7612581c13f",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc001926080)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=16) "pvc-tester-6r98m",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=3) "POD",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
EntityName: (string) (len=9) "pvc-w64rk",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc001926100)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-w64rk",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-fe4f7c74-6617-4b31-b774-a7612581c13f",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc0015e7680)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "686ff46a-4547-457a-ab8b-6c5c0e8cb526",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "2bc2c262-7afb-ad57-7a15-020088cd1d5a"
}),
ComplianceStatus: (string) (len=9) "compliant",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:43:03.752: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:true, verifyPodEntry:true
Jul 4 03:43:03.752: INFO: Checking PVC pvc-wt4g9
Jul 4 03:43:03.769: INFO: Processing PVC: pvc-wt4g9
Jul 4 03:43:03.830: INFO: For pod 'pvc-tester-6r98m', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-w64rk,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-dsv56,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:03.830: INFO: For pod 'pvc-tester-8vb2r', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-8j5wl,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-5bcp2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:03.830: INFO: For pod 'pvc-tester-8wkjp', volumes:
([]v1.Volume) (len=3 cap=4) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-x9cc4,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:volume2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-kchcp,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-8l7wp,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:03.830: INFO: For pod 'pvc-tester-hntc9', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-wlsvt,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-lkprv,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:03.830: INFO: For pod 'pvc-tester-n565r', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-qqj9l,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-wwwf9,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:03.830: INFO: For pod 'pvc-tester-qp799', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-qhnfl,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-hb845,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:03.830: INFO: For pod 'pvc-tester-r7fx7', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-rlt68,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-25xhm,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:03.830: INFO: For pod 'pvc-tester-rqkbz', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-wt4g9,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-k52m9,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:04.195: INFO: Found CNS volume with id 9280857a-e9c3-4b13-b90b-9f790b6fe696
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "9280857a-e9c3-4b13-b90b-9f790b6fe696"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "5a9f6c82-fb85-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=3 cap=4) {
(*types.CnsKubernetesEntityMetadata)(0xc000555a80)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-b33657c8-79d0-424f-a1bf-926f8f86a074",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc000555b00)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=16) "pvc-tester-rqkbz",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=3) "POD",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
EntityName: (string) (len=9) "pvc-wt4g9",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc000555b80)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-wt4g9",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-b33657c8-79d0-424f-a1bf-926f8f86a074",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc0001135c0)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "9280857a-e9c3-4b13-b90b-9f790b6fe696",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "28c2c262-ea2e-df03-ca48-02008803ef9f"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:43:04.195: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:true, verifyPodEntry:true
Jul 4 03:43:04.195: INFO: Checking PVC pvc-s74cc
Jul 4 03:43:04.209: INFO: Processing PVC: pvc-s74cc
Jul 4 03:43:04.267: INFO: For pod 'pvc-tester-4cd4l', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-npwlr,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-rt5h8,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:04.267: INFO: For pod 'pvc-tester-5sjqs', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-s74cc,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-js5sl,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:04.673: INFO: Found CNS volume with id 9fc3a7be-3cda-4d2c-9365-c658af1fcb6f
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "9fc3a7be-3cda-4d2c-9365-c658af1fcb6f"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "552734da-fb85-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=3 cap=4) {
(*types.CnsKubernetesEntityMetadata)(0xc0011b1880)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-78cab45d-c584-4c99-9898-65e25227289c",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc0011b1980)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-s74cc",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-1445",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-78cab45d-c584-4c99-9898-65e25227289c",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc0011b1a00)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=16) "pvc-tester-5sjqs",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=3) "POD",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-1445",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
EntityName: (string) (len=9) "pvc-s74cc",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-1445",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc000d878c0)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "9fc3a7be-3cda-4d2c-9365-c658af1fcb6f",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "26c2c262-f6d0-7c80-730e-02008803ef9f"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:43:04.673: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:true, verifyPodEntry:true
Jul 4 03:43:04.673: INFO: Checking PVC pvc-cs7jn
Jul 4 03:43:04.697: INFO: Processing PVC: pvc-cs7jn
Jul 4 03:43:04.780: INFO: For pod 'pvc-tester-4cd4l', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-npwlr,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-rt5h8,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:04.780: INFO: For pod 'pvc-tester-5sjqs', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-s74cc,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-js5sl,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:04.780: INFO: For pod 'pvc-tester-ckzrc', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-j4m6t,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-js5pv,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:04.781: INFO: For pod 'pvc-tester-tbzds', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-cs7jn,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-w6t7p,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:05.166: INFO: Found CNS volume with id 1c0a67af-16c9-48cc-ae74-4e13641fabe7
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "1c0a67af-16c9-48cc-ae74-4e13641fabe7"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "4f752448-fb85-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=3 cap=4) {
(*types.CnsKubernetesEntityMetadata)(0xc000ba4800)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-8ee850fe-9e71-4901-aa03-53dfa0b5b098",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc000ba4880)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-cs7jn",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-1445",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-8ee850fe-9e71-4901-aa03-53dfa0b5b098",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc000ba4900)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=16) "pvc-tester-tbzds",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=3) "POD",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-1445",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
EntityName: (string) (len=9) "pvc-cs7jn",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-1445",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc0007b1fc0)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "1c0a67af-16c9-48cc-ae74-4e13641fabe7",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "26c2c262-3869-0506-0982-020088529ac5"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:43:05.166: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:true, verifyPodEntry:true
Jul 4 03:43:05.166: INFO: Checking PVC pvc-npwlr
Jul 4 03:43:05.184: INFO: Processing PVC: pvc-npwlr
Jul 4 03:43:05.243: INFO: For pod 'pvc-tester-4cd4l', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-npwlr,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-rt5h8,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:05.642: INFO: Found CNS volume with id 2806d2b0-0bbd-48ce-9a86-def41e2d87e9
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "2806d2b0-0bbd-48ce-9a86-def41e2d87e9"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "57c101eb-fb85-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=3 cap=4) {
(*types.CnsKubernetesEntityMetadata)(0xc000df4900)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-76530b0d-9001-4c96-b2a5-4d2e06b06b37",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc000df4980)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-npwlr",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-1445",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-76530b0d-9001-4c96-b2a5-4d2e06b06b37",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc000df4a00)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=16) "pvc-tester-4cd4l",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=3) "POD",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-1445",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
EntityName: (string) (len=9) "pvc-npwlr",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-1445",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc0017c1000)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "2806d2b0-0bbd-48ce-9a86-def41e2d87e9",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "27c2c262-1ab9-1763-25a1-020088529ac5"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:43:05.642: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:true, verifyPodEntry:true
Jul 4 03:43:05.642: INFO: Checking PVC pvc-wxmsb
Jul 4 03:43:05.658: INFO: Processing PVC: pvc-wxmsb
Jul 4 03:43:05.719: INFO: For pod 'pvc-tester-4cd4l', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-npwlr,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-rt5h8,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:05.719: INFO: For pod 'pvc-tester-5sjqs', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-s74cc,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-js5sl,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:05.719: INFO: For pod 'pvc-tester-ckzrc', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-j4m6t,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-js5pv,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:05.719: INFO: For pod 'pvc-tester-tbzds', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-cs7jn,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-w6t7p,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:05.719: INFO: For pod 'pvc-tester-xftg5', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-wxmsb,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-jkx5w,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:06.103: INFO: Found CNS volume with id 44befe11-354c-41a8-9a62-02941a98837e
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "44befe11-354c-41a8-9a62-02941a98837e"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "45290ce2-fb85-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=3 cap=4) {
(*types.CnsKubernetesEntityMetadata)(0xc000df5280)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-776478c5-5d3f-4800-bc09-b9506f1a498d",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc000df5300)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=16) "pvc-tester-xftg5",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=3) "POD",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-1445",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
EntityName: (string) (len=9) "pvc-wxmsb",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-1445",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc000df5380)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-wxmsb",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-1445",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-776478c5-5d3f-4800-bc09-b9506f1a498d",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc001923100)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "44befe11-354c-41a8-9a62-02941a98837e",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "27c2c262-066d-9b2b-4bc8-0200883dcaf9"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:43:06.103: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:true, verifyPodEntry:true
Jul 4 03:43:06.103: INFO: Checking PVC pvc-j4m6t
Jul 4 03:43:06.121: INFO: Processing PVC: pvc-j4m6t
Jul 4 03:43:06.173: INFO: For pod 'pvc-tester-4cd4l', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-npwlr,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-rt5h8,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:06.173: INFO: For pod 'pvc-tester-5sjqs', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-s74cc,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-js5sl,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:06.173: INFO: For pod 'pvc-tester-ckzrc', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-j4m6t,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-js5pv,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:06.596: INFO: Found CNS volume with id b7e2a25b-b6d3-4457-bc0e-ad730052377e
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "b7e2a25b-b6d3-4457-bc0e-ad730052377e"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "4793f576-fb85-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=3 cap=4) {
(*types.CnsKubernetesEntityMetadata)(0xc0018f9d80)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-befe34b1-94db-4318-9e89-ed15a118d6b4",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc0018f9e00)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-j4m6t",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-1445",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-befe34b1-94db-4318-9e89-ed15a118d6b4",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc0018f9e80)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=16) "pvc-tester-ckzrc",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=3) "POD",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-1445",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
EntityName: (string) (len=9) "pvc-j4m6t",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-1445",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc001391a00)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "b7e2a25b-b6d3-4457-bc0e-ad730052377e",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "27c2c262-b664-5cc0-2a8f-02008803ef9f"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:43:06.596: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:true, verifyPodEntry:true
Jul 4 03:43:06.596: INFO: Checking PVC pvc-qqj9l
Jul 4 03:43:06.617: INFO: Processing PVC: pvc-qqj9l
Jul 4 03:43:06.690: INFO: For pod 'pvc-tester-6r98m', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-w64rk,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-dsv56,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:06.690: INFO: For pod 'pvc-tester-8vb2r', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-8j5wl,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-5bcp2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:06.690: INFO: For pod 'pvc-tester-8wkjp', volumes:
([]v1.Volume) (len=3 cap=4) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-x9cc4,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:volume2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-kchcp,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-8l7wp,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:06.690: INFO: For pod 'pvc-tester-hntc9', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-wlsvt,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-lkprv,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:06.690: INFO: For pod 'pvc-tester-n565r', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-qqj9l,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-wwwf9,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:07.069: INFO: Found CNS volume with id 2de4fab8-4123-419c-8c4f-23210d6b14a8
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "2de4fab8-4123-419c-8c4f-23210d6b14a8"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "5b444fcf-fb85-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=3 cap=4) {
(*types.CnsKubernetesEntityMetadata)(0xc0011b0a80)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-33031f22-7baf-4bcd-ada2-ac79f1775a21",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc0011b0b80)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-qqj9l",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-33031f22-7baf-4bcd-ada2-ac79f1775a21",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc0011b0c80)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=16) "pvc-tester-n565r",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=3) "POD",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
EntityName: (string) (len=9) "pvc-qqj9l",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc0006e5540)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "2de4fab8-4123-419c-8c4f-23210d6b14a8",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "27c2c262-e630-8265-e82c-020088529ac5"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:43:07.069: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:true, verifyPodEntry:true
Jul 4 03:43:07.069: INFO: Checking PVC pvc-qhnfl
Jul 4 03:43:07.096: INFO: Processing PVC: pvc-qhnfl
Jul 4 03:43:07.144: INFO: For pod 'pvc-tester-6r98m', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-w64rk,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-dsv56,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:07.144: INFO: For pod 'pvc-tester-8vb2r', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-8j5wl,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-5bcp2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:07.145: INFO: For pod 'pvc-tester-8wkjp', volumes:
([]v1.Volume) (len=3 cap=4) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-x9cc4,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:volume2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-kchcp,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-8l7wp,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:07.145: INFO: For pod 'pvc-tester-hntc9', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-wlsvt,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-lkprv,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:07.145: INFO: For pod 'pvc-tester-n565r', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-qqj9l,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-wwwf9,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:07.145: INFO: For pod 'pvc-tester-qp799', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-qhnfl,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-hb845,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:07.509: INFO: Found CNS volume with id cfd2023d-0844-43d3-9869-1ce34f57ce14
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "cfd2023d-0844-43d3-9869-1ce34f57ce14"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "55112454-fb85-11ec-bc33-7a88859c5ba7",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=3 cap=4) {
(*types.CnsKubernetesEntityMetadata)(0xc000075f00)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-a6caf5c3-8f0a-4c1b-b5ea-fc06db3e082b",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc000075f80)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-qhnfl",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-a6caf5c3-8f0a-4c1b-b5ea-fc06db3e082b",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc000ba4000)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=16) "pvc-tester-qp799",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=3) "POD",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
EntityName: (string) (len=9) "pvc-qhnfl",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc0014a2c80)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "cfd2023d-0844-43d3-9869-1ce34f57ce14",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "27c2c262-1aa5-d59e-4fe7-020088cd1d5a"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:43:07.510: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:true, verifyPodEntry:true
Jul 4 03:43:07.510: INFO: Checking PVC pvc-kchcp
Jul 4 03:43:07.534: INFO: Processing PVC: pvc-kchcp
Jul 4 03:43:07.585: INFO: For pod 'pvc-tester-6r98m', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-w64rk,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-dsv56,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:07.585: INFO: For pod 'pvc-tester-8vb2r', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-8j5wl,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-5bcp2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:07.585: INFO: For pod 'pvc-tester-8wkjp', volumes:
([]v1.Volume) (len=3 cap=4) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-x9cc4,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:volume2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-kchcp,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-8l7wp,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:07.733: INFO: Found CNS volume with id 9c1051b9-ab74-41b4-a350-01c1a9fba472
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "9c1051b9-ab74-41b4-a350-01c1a9fba472"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=40) "pvc-243d71a8-6c58-4b33-94e2-21b88ced71c9",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) (len=36) "aa6d5a82-1c88-45da-85d3-3d74b91a5bad",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=3 cap=4) {
(*types.CnsKubernetesEntityMetadata)(0xc001926880)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-243d71a8-6c58-4b33-94e2-21b88ced71c9",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc001926900)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-kchcp",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-243d71a8-6c58-4b33-94e2-21b88ced71c9",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc001926980)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=16) "pvc-tester-8wkjp",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=3) "POD",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
EntityName: (string) (len=9) "pvc-kchcp",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc001113a80)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "9c1051b9-ab74-41b4-a350-01c1a9fba472",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "84c3c262-4253-5aa4-9c5c-020088529ac5"
}),
ComplianceStatus: (string) (len=9) "compliant",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:43:07.733: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:true, verifyPodEntry:true
Jul 4 03:43:07.733: INFO: Checking PVC pvc-8j5wl
Jul 4 03:43:07.749: INFO: Processing PVC: pvc-8j5wl
Jul 4 03:43:07.805: INFO: For pod 'pvc-tester-6r98m', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-w64rk,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-dsv56,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:07.805: INFO: For pod 'pvc-tester-8vb2r', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-8j5wl,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-5bcp2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:43:07.902: INFO: Found CNS volume with id 76bdf10a-9728-4da6-a617-b58274e3259a
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "76bdf10a-9728-4da6-a617-b58274e3259a"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=40) "pvc-dac01e56-0677-4cc5-a4fd-09d5aa4082eb",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) (len=36) "aa6d5a82-1c88-45da-85d3-3d74b91a5bad",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=3 cap=4) {
(*types.CnsKubernetesEntityMetadata)(0xc000ba4080)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-8j5wl",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-dac01e56-0677-4cc5-a4fd-09d5aa4082eb",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc000ba4100)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-dac01e56-0677-4cc5-a4fd-09d5aa4082eb",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc000ba4180)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=16) "pvc-tester-8vb2r",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=3) "POD",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
EntityName: (string) (len=9) "pvc-8j5wl",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2540",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc00043b280)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "76bdf10a-9728-4da6-a617-b58274e3259a",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "84c3c262-e29b-68a4-7433-020088529ac5"
}),
ComplianceStatus: (string) (len=9) "compliant",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:43:07.902: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:true, verifyPodEntry:true
STEP: Delete pods
Jul 4 03:43:08.756: INFO: Deleting pod: pvc-tester-rz5pd
STEP: Deleting pod pvc-tester-rz5pd in namespace vcp-2-csi-attach-detach-2540
Jul 4 03:43:08.788: INFO: Deleting pod: pvc-tester-hntc9
STEP: Deleting pod pvc-tester-hntc9 in namespace vcp-2-csi-attach-detach-2540
Jul 4 03:43:08.816: INFO: Deleting pod: pvc-tester-rzs54
STEP: Deleting pod pvc-tester-rzs54 in namespace vcp-2-csi-attach-detach-2540
Jul 4 03:43:08.866: INFO: Deleting pod: pvc-tester-r7fx7
STEP: Deleting pod pvc-tester-r7fx7 in namespace vcp-2-csi-attach-detach-2540
Jul 4 03:43:08.886: INFO: Deleting pod: pvc-tester-8wkjp
STEP: Deleting pod pvc-tester-8wkjp in namespace vcp-2-csi-attach-detach-2540
Jul 4 03:43:08.915: INFO: Deleting pod: pvc-tester-8vb2r
STEP: Deleting pod pvc-tester-8vb2r in namespace vcp-2-csi-attach-detach-2540
Jul 4 03:43:08.955: INFO: Deleting pod: pvc-tester-6r98m
STEP: Deleting pod pvc-tester-6r98m in namespace vcp-2-csi-attach-detach-2540
Jul 4 03:43:08.989: INFO: Deleting pod: pvc-tester-n565r
STEP: Deleting pod pvc-tester-n565r in namespace vcp-2-csi-attach-detach-2540
Jul 4 03:43:09.032: INFO: Deleting pod: pvc-tester-qp799
STEP: Deleting pod pvc-tester-qp799 in namespace vcp-2-csi-attach-detach-2540
Jul 4 03:43:09.046: INFO: Deleting pod: pvc-tester-5sjqs
STEP: Deleting pod pvc-tester-5sjqs in namespace vcp-2-csi-attach-detach-1445
Jul 4 03:43:09.098: INFO: Deleting pod: pvc-tester-tbzds
STEP: Deleting pod pvc-tester-tbzds in namespace vcp-2-csi-attach-detach-1445
Jul 4 03:43:09.136: INFO: Deleting pod: pvc-tester-4cd4l
STEP: Deleting pod pvc-tester-4cd4l in namespace vcp-2-csi-attach-detach-1445
Jul 4 03:43:09.163: INFO: Deleting pod: pvc-tester-xftg5
STEP: Deleting pod pvc-tester-xftg5 in namespace vcp-2-csi-attach-detach-1445
Jul 4 03:43:09.193: INFO: Deleting pod: pvc-tester-ckzrc
STEP: Deleting pod pvc-tester-ckzrc in namespace vcp-2-csi-attach-detach-1445
Jul 4 03:43:09.228: INFO: Deleting pod: pvc-tester-rqkbz
STEP: Deleting pod pvc-tester-rqkbz in namespace vcp-2-csi-attach-detach-2540
STEP: Verify volume is detached from the node
STEP: VM UUID is: 4201c124-84e2-596b-a670-ef0e99be85a5 for node: k8s-node-236-1656928234
Jul 4 03:43:45.481: INFO: vmRef: VirtualMachine:vm-52 for the VM uuid: 4201c124-84e2-596b-a670-ef0e99be85a5
Jul 4 03:43:45.488: INFO: Found FCDID "941b2c3c-7e68-41e2-a24d-f764e64e6004" attached to VM "k8s-worker2"
Jul 4 03:43:45.488: INFO: Found the disk "941b2c3c-7e68-41e2-a24d-f764e64e6004" is attached to the VM with UUID: "4201c124-84e2-596b-a670-ef0e99be85a5"
Jul 4 03:43:45.488: INFO: Waiting for disk: "941b2c3c-7e68-41e2-a24d-f764e64e6004" to be detached from the node :"k8s-node-236-1656928234"
STEP: VM UUID is: 4201c124-84e2-596b-a670-ef0e99be85a5 for node: k8s-node-236-1656928234
Jul 4 03:43:47.469: INFO: vmRef: VirtualMachine:vm-52 for the VM uuid: 4201c124-84e2-596b-a670-ef0e99be85a5
Jul 4 03:43:47.477: INFO: failed to find FCDID "941b2c3c-7e68-41e2-a24d-f764e64e6004" attached to VM "k8s-worker2"
Jul 4 03:43:47.477: INFO: Disk: 941b2c3c-7e68-41e2-a24d-f764e64e6004 successfully detached
STEP: Verify volume is detached from the node
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
Jul 4 03:43:49.521: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:43:49.532: INFO: failed to find FCDID "452b55a1-2b90-452e-add1-0e4d08f3d365" attached to VM "k8s-worker3"
Jul 4 03:43:49.533: INFO: Disk: 452b55a1-2b90-452e-add1-0e4d08f3d365 successfully detached
STEP: Verify volume is detached from the node
STEP: VM UUID is: 42012696-a5ac-0b47-440b-883314beee49 for node: k8s-node-990-1656928220
Jul 4 03:43:51.578: INFO: vmRef: VirtualMachine:vm-53 for the VM uuid: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 03:43:51.587: INFO: failed to find FCDID "95a11459-1d2f-4a00-919b-a03c462f0a8d" attached to VM "k8s-worker1"
Jul 4 03:43:51.587: INFO: Disk: 95a11459-1d2f-4a00-919b-a03c462f0a8d successfully detached
STEP: Verify volume is detached from the node
STEP: VM UUID is: 42012696-a5ac-0b47-440b-883314beee49 for node: k8s-node-990-1656928220
Jul 4 03:43:53.621: INFO: vmRef: VirtualMachine:vm-53 for the VM uuid: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 03:43:53.632: INFO: failed to find FCDID "e89429ea-ddfa-42bf-9272-d543c69bf2fc" attached to VM "k8s-worker1"
Jul 4 03:43:53.632: INFO: Disk: e89429ea-ddfa-42bf-9272-d543c69bf2fc successfully detached
STEP: Verify volume is detached from the node
STEP: VM UUID is: 4201c124-84e2-596b-a670-ef0e99be85a5 for node: k8s-node-236-1656928234
Jul 4 03:43:55.665: INFO: vmRef: VirtualMachine:vm-52 for the VM uuid: 4201c124-84e2-596b-a670-ef0e99be85a5
Jul 4 03:43:55.672: INFO: failed to find FCDID "9e9dad92-bf8c-4b96-a9f2-100fe0d92ed9" attached to VM "k8s-worker2"
Jul 4 03:43:55.672: INFO: Disk: 9e9dad92-bf8c-4b96-a9f2-100fe0d92ed9 successfully detached
STEP: Verify volume is detached from the node
STEP: VM UUID is: 4201c124-84e2-596b-a670-ef0e99be85a5 for node: k8s-node-236-1656928234
Jul 4 03:43:57.721: INFO: vmRef: VirtualMachine:vm-52 for the VM uuid: 4201c124-84e2-596b-a670-ef0e99be85a5
Jul 4 03:43:57.728: INFO: failed to find FCDID "9c1051b9-ab74-41b4-a350-01c1a9fba472" attached to VM "k8s-worker2"
Jul 4 03:43:57.728: INFO: Disk: 9c1051b9-ab74-41b4-a350-01c1a9fba472 successfully detached
STEP: Verify volume is detached from the node
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
Jul 4 03:43:59.761: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:43:59.769: INFO: failed to find FCDID "76bdf10a-9728-4da6-a617-b58274e3259a" attached to VM "k8s-worker3"
Jul 4 03:43:59.769: INFO: Disk: 76bdf10a-9728-4da6-a617-b58274e3259a successfully detached
STEP: Verify volume is detached from the node
STEP: VM UUID is: 4201c124-84e2-596b-a670-ef0e99be85a5 for node: k8s-node-236-1656928234
Jul 4 03:44:01.803: INFO: vmRef: VirtualMachine:vm-52 for the VM uuid: 4201c124-84e2-596b-a670-ef0e99be85a5
Jul 4 03:44:01.813: INFO: failed to find FCDID "686ff46a-4547-457a-ab8b-6c5c0e8cb526" attached to VM "k8s-worker2"
Jul 4 03:44:01.813: INFO: Disk: 686ff46a-4547-457a-ab8b-6c5c0e8cb526 successfully detached
STEP: Verify volume is detached from the node
STEP: VM UUID is: 42012696-a5ac-0b47-440b-883314beee49 for node: k8s-node-990-1656928220
Jul 4 03:44:03.843: INFO: vmRef: VirtualMachine:vm-53 for the VM uuid: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 03:44:03.849: INFO: failed to find FCDID "2de4fab8-4123-419c-8c4f-23210d6b14a8" attached to VM "k8s-worker1"
Jul 4 03:44:03.849: INFO: Disk: 2de4fab8-4123-419c-8c4f-23210d6b14a8 successfully detached
STEP: Verify volume is detached from the node
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
Jul 4 03:44:05.894: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:44:05.901: INFO: failed to find FCDID "cfd2023d-0844-43d3-9869-1ce34f57ce14" attached to VM "k8s-worker3"
Jul 4 03:44:05.901: INFO: Disk: cfd2023d-0844-43d3-9869-1ce34f57ce14 successfully detached
STEP: Verify volume is detached from the node
STEP: VM UUID is: 42012696-a5ac-0b47-440b-883314beee49 for node: k8s-node-990-1656928220
Jul 4 03:44:07.943: INFO: vmRef: VirtualMachine:vm-53 for the VM uuid: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 03:44:07.948: INFO: failed to find FCDID "9fc3a7be-3cda-4d2c-9365-c658af1fcb6f" attached to VM "k8s-worker1"
Jul 4 03:44:07.949: INFO: Disk: 9fc3a7be-3cda-4d2c-9365-c658af1fcb6f successfully detached
STEP: Verify volume is detached from the node
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
Jul 4 03:44:10.003: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:44:10.013: INFO: failed to find FCDID "1c0a67af-16c9-48cc-ae74-4e13641fabe7" attached to VM "k8s-worker3"
Jul 4 03:44:10.013: INFO: Disk: 1c0a67af-16c9-48cc-ae74-4e13641fabe7 successfully detached
STEP: Verify volume is detached from the node
STEP: VM UUID is: 4201c124-84e2-596b-a670-ef0e99be85a5 for node: k8s-node-236-1656928234
Jul 4 03:44:12.058: INFO: vmRef: VirtualMachine:vm-52 for the VM uuid: 4201c124-84e2-596b-a670-ef0e99be85a5
Jul 4 03:44:12.069: INFO: failed to find FCDID "2806d2b0-0bbd-48ce-9a86-def41e2d87e9" attached to VM "k8s-worker2"
Jul 4 03:44:12.069: INFO: Disk: 2806d2b0-0bbd-48ce-9a86-def41e2d87e9 successfully detached
STEP: Verify volume is detached from the node
STEP: VM UUID is: 4201c124-84e2-596b-a670-ef0e99be85a5 for node: k8s-node-236-1656928234
Jul 4 03:44:14.102: INFO: vmRef: VirtualMachine:vm-52 for the VM uuid: 4201c124-84e2-596b-a670-ef0e99be85a5
Jul 4 03:44:14.108: INFO: failed to find FCDID "44befe11-354c-41a8-9a62-02941a98837e" attached to VM "k8s-worker2"
Jul 4 03:44:14.108: INFO: Disk: 44befe11-354c-41a8-9a62-02941a98837e successfully detached
STEP: Verify volume is detached from the node
STEP: VM UUID is: 42012696-a5ac-0b47-440b-883314beee49 for node: k8s-node-990-1656928220
Jul 4 03:44:16.153: INFO: vmRef: VirtualMachine:vm-53 for the VM uuid: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 03:44:16.161: INFO: failed to find FCDID "b7e2a25b-b6d3-4457-bc0e-ad730052377e" attached to VM "k8s-worker1"
Jul 4 03:44:16.161: INFO: Disk: b7e2a25b-b6d3-4457-bc0e-ad730052377e successfully detached
STEP: Verify volume is detached from the node
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
Jul 4 03:44:18.190: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:44:18.196: INFO: failed to find FCDID "9280857a-e9c3-4b13-b90b-9f790b6fe696" attached to VM "k8s-worker3"
Jul 4 03:44:18.196: INFO: Disk: 9280857a-e9c3-4b13-b90b-9f790b6fe696 successfully detached
STEP: Delete namespace created for test14
STEP: Delete pvcs
Jul 4 03:44:18.900: INFO: Deleting PVC pvc-wq8xm
Jul 4 03:44:18.922: INFO: Deleting PVC pvc-rlt68
Jul 4 03:44:18.965: INFO: Deleting PVC pvc-kxw6c
Jul 4 03:44:19.013: INFO: Deleting PVC pvc-wlsvt
Jul 4 03:44:19.071: INFO: Deleting PVC pvc-x9cc4
Jul 4 03:44:19.121: INFO: Deleting PVC pvc-w64rk
Jul 4 03:44:19.164: INFO: Deleting PVC pvc-wt4g9
Jul 4 03:44:19.225: INFO: Deleting PVC pvc-kchcp
Jul 4 03:44:19.263: INFO: Deleting PVC pvc-8j5wl
STEP: Wait for CNS volumes for VCP PVCs to be deleted
Jul 4 03:44:21.298: INFO: volume "95a11459-1d2f-4a00-919b-a03c462f0a8d" has successfully deleted
Jul 4 03:44:23.313: INFO: volume "e89429ea-ddfa-42bf-9272-d543c69bf2fc" has successfully deleted
Jul 4 03:44:25.322: INFO: volume "941b2c3c-7e68-41e2-a24d-f764e64e6004" has successfully deleted
Jul 4 03:44:27.338: INFO: volume "452b55a1-2b90-452e-add1-0e4d08f3d365" has successfully deleted
Jul 4 03:44:29.351: INFO: volume "9e9dad92-bf8c-4b96-a9f2-100fe0d92ed9" has successfully deleted
Jul 4 03:44:31.366: INFO: volume "686ff46a-4547-457a-ab8b-6c5c0e8cb526" has successfully deleted
Jul 4 03:44:33.375: INFO: volume "9280857a-e9c3-4b13-b90b-9f790b6fe696" has successfully deleted
Jul 4 03:44:35.390: INFO: volume "9fc3a7be-3cda-4d2c-9365-c658af1fcb6f" has successfully deleted
Jul 4 03:44:37.402: INFO: volume "1c0a67af-16c9-48cc-ae74-4e13641fabe7" has successfully deleted
Jul 4 03:44:39.419: INFO: volume "2806d2b0-0bbd-48ce-9a86-def41e2d87e9" has successfully deleted
Jul 4 03:44:41.432: INFO: volume "44befe11-354c-41a8-9a62-02941a98837e" has successfully deleted
Jul 4 03:44:43.442: INFO: volume "b7e2a25b-b6d3-4457-bc0e-ad730052377e" has successfully deleted
Jul 4 03:44:45.455: INFO: volume "9c1051b9-ab74-41b4-a350-01c1a9fba472" has successfully deleted
Jul 4 03:44:47.468: INFO: volume "76bdf10a-9728-4da6-a617-b58274e3259a" has successfully deleted
STEP: Wait for vmdks used by VCP PVCs to be deleted
Jul 4 03:44:47.474: INFO: Looking for default datastore in DC: VSAN-DC
Jul 4 03:44:47.484: INFO: Datstore found for DS URL:ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/
Jul 4 03:44:47.683: INFO: Looking for default datastore in DC: VSAN-DC
Jul 4 03:44:47.694: INFO: Datstore found for DS URL:ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/
Jul 4 03:44:47.743: INFO: Looking for default datastore in DC: VSAN-DC
Jul 4 03:44:47.754: INFO: Datstore found for DS URL:ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/
Jul 4 03:44:47.804: INFO: Looking for default datastore in DC: VSAN-DC
Jul 4 03:44:47.816: INFO: Datstore found for DS URL:ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/
Jul 4 03:44:47.867: INFO: Looking for default datastore in DC: VSAN-DC
Jul 4 03:44:47.881: INFO: Datstore found for DS URL:ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/
Jul 4 03:44:47.924: INFO: Looking for default datastore in DC: VSAN-DC
Jul 4 03:44:47.939: INFO: Datstore found for DS URL:ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/
Jul 4 03:44:48.140: INFO: Looking for default datastore in DC: VSAN-DC
Jul 4 03:44:48.153: INFO: Datstore found for DS URL:ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/
Jul 4 03:44:48.216: INFO: Looking for default datastore in DC: VSAN-DC
Jul 4 03:44:48.226: INFO: Datstore found for DS URL:ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/
Jul 4 03:44:48.275: INFO: Looking for default datastore in DC: VSAN-DC
Jul 4 03:44:48.286: INFO: Datstore found for DS URL:ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/
Jul 4 03:44:48.351: INFO: Looking for default datastore in DC: VSAN-DC
Jul 4 03:44:48.361: INFO: Datstore found for DS URL:ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/
Jul 4 03:44:48.403: INFO: Looking for default datastore in DC: VSAN-DC
Jul 4 03:44:48.417: INFO: Datstore found for DS URL:ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/
Jul 4 03:44:48.483: INFO: Looking for default datastore in DC: VSAN-DC
Jul 4 03:44:48.495: INFO: Datstore found for DS URL:ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/
Jul 4 03:44:48.541: INFO: Looking for default datastore in DC: VSAN-DC
Jul 4 03:44:48.552: INFO: Datstore found for DS URL:ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/
Jul 4 03:44:48.797: INFO: Looking for default datastore in DC: VSAN-DC
Jul 4 03:44:48.810: INFO: Datstore found for DS URL:ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/
STEP: Disable CSI migration feature gates on kublets on k8s nodes
Jul 4 03:44:48.874: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
STEP: Cordoning of node: k8s-node-148-1656928247
STEP: Draining of node: k8s-node-148-1656928247
WARNING: ignoring DaemonSet-managed Pods: kube-system/kube-flannel-ds-kbxvd, kube-system/kube-proxy-q9t45, vmware-system-csi/vsphere-csi-node-jkxkm
STEP: Modifying feature gates in kubelet config yaml of node: k8s-node-148-1656928247
Jul 4 03:44:48.944: INFO: Invoking command 'grep CSIMigration /var/lib/kubelet/config.yaml' on host 10.185.38.32
Jul 4 03:44:50.025: INFO: host: 10.185.38.32, command: grep CSIMigration /var/lib/kubelet/config.yaml, return code: 0, stdout: CSIMigration: true,
CSIMigrationvSphere: true
, stderr:
Jul 4 03:44:50.025: INFO: Invoking command 'head -n -5 /var/lib/kubelet/config.yaml > tmp.txt && mv tmp.txt /var/lib/kubelet/config.yaml' on host 10.185.38.32
Jul 4 03:44:50.686: INFO: host: 10.185.38.32, command: head -n -5 /var/lib/kubelet/config.yaml > tmp.txt && mv tmp.txt /var/lib/kubelet/config.yaml, return code: 0, stdout: , stderr:
Jul 4 03:44:50.686: INFO: Invoking command 'systemctl daemon-reload && systemctl restart kubelet' on host 10.185.38.32
Jul 4 03:44:51.982: INFO: host: 10.185.38.32, command: systemctl daemon-reload && systemctl restart kubelet, return code: 0, stdout: , stderr:
STEP: Wait for feature gates update on the k8s CSI node: k8s-node-148-1656928247
Jul 4 03:44:51.990: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
Jul 4 03:45:02.002: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
STEP: Uncordoning of node: k8s-node-148-1656928247
Jul 4 03:45:02.042: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
STEP: Cordoning of node: k8s-node-236-1656928234
STEP: Draining of node: k8s-node-236-1656928234
WARNING: ignoring DaemonSet-managed Pods: kube-system/kube-flannel-ds-jtklh, kube-system/kube-proxy-wtp4g, vmware-system-csi/vsphere-csi-node-8rswp
STEP: Modifying feature gates in kubelet config yaml of node: k8s-node-236-1656928234
Jul 4 03:45:02.122: INFO: Invoking command 'grep CSIMigration /var/lib/kubelet/config.yaml' on host 10.185.33.157
Jul 4 03:45:03.282: INFO: host: 10.185.33.157, command: grep CSIMigration /var/lib/kubelet/config.yaml, return code: 0, stdout: CSIMigration: true,
CSIMigrationvSphere: true
, stderr:
Jul 4 03:45:03.282: INFO: Invoking command 'head -n -5 /var/lib/kubelet/config.yaml > tmp.txt && mv tmp.txt /var/lib/kubelet/config.yaml' on host 10.185.33.157
Jul 4 03:45:04.022: INFO: host: 10.185.33.157, command: head -n -5 /var/lib/kubelet/config.yaml > tmp.txt && mv tmp.txt /var/lib/kubelet/config.yaml, return code: 0, stdout: , stderr:
Jul 4 03:45:04.022: INFO: Invoking command 'systemctl daemon-reload && systemctl restart kubelet' on host 10.185.33.157
Jul 4 03:45:05.467: INFO: host: 10.185.33.157, command: systemctl daemon-reload && systemctl restart kubelet, return code: 0, stdout: , stderr:
STEP: Wait for feature gates update on the k8s CSI node: k8s-node-236-1656928234
Jul 4 03:45:05.476: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
Jul 4 03:45:15.494: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
STEP: Uncordoning of node: k8s-node-236-1656928234
Jul 4 03:45:15.528: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
STEP: Cordoning of node: k8s-node-990-1656928220
STEP: Draining of node: k8s-node-990-1656928220
WARNING: ignoring DaemonSet-managed Pods: kube-system/kube-flannel-ds-jv5wm, kube-system/kube-proxy-62sc9, vmware-system-csi/vsphere-csi-node-xzpc9
STEP: Modifying feature gates in kubelet config yaml of node: k8s-node-990-1656928220
Jul 4 03:45:15.625: INFO: Invoking command 'grep CSIMigration /var/lib/kubelet/config.yaml' on host 10.185.35.185
Jul 4 03:45:16.791: INFO: host: 10.185.35.185, command: grep CSIMigration /var/lib/kubelet/config.yaml, return code: 0, stdout: CSIMigration: true,
CSIMigrationvSphere: true
, stderr:
Jul 4 03:45:16.791: INFO: Invoking command 'head -n -5 /var/lib/kubelet/config.yaml > tmp.txt && mv tmp.txt /var/lib/kubelet/config.yaml' on host 10.185.35.185
Jul 4 03:45:17.503: INFO: host: 10.185.35.185, command: head -n -5 /var/lib/kubelet/config.yaml > tmp.txt && mv tmp.txt /var/lib/kubelet/config.yaml, return code: 0, stdout: , stderr:
Jul 4 03:45:17.503: INFO: Invoking command 'systemctl daemon-reload && systemctl restart kubelet' on host 10.185.35.185
Jul 4 03:45:18.946: INFO: host: 10.185.35.185, command: systemctl daemon-reload && systemctl restart kubelet, return code: 0, stdout: , stderr:
STEP: Wait for feature gates update on the k8s CSI node: k8s-node-990-1656928220
Jul 4 03:45:18.955: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
Jul 4 03:45:28.972: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
STEP: Uncordoning of node: k8s-node-990-1656928220
Jul 4 03:45:29.011: INFO: Waiting up to 10m0s for all pods (need at least 0) in namespace 'vcp-2-csi-attach-detach-2540' to be running and ready
Jul 4 03:45:29.045: INFO: 0 / 0 pods in namespace 'vcp-2-csi-attach-detach-2540' are running and ready (0 seconds elapsed)
Jul 4 03:45:29.045: INFO: expected 0 pod replicas in namespace 'vcp-2-csi-attach-detach-2540', 0 are Running and Ready.
STEP: Disable CSI migration feature gates on kube-controller-manager
Jul 4 03:45:29.053: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.43.70
Jul 4 03:45:30.736: INFO: host: 10.185.43.70, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true
, stderr:
Jul 4 03:45:30.736: INFO: Invoking command sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.43.70
Jul 4 03:45:31.573: INFO: host: 10.185.43.70, command: sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 03:45:31.573: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.43.70
Jul 4 03:45:32.463: INFO: host: 10.185.43.70, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 03:45:32.463: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.45.237
Jul 4 03:45:33.882: INFO: host: 10.185.45.237, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true
, stderr:
Jul 4 03:45:33.882: INFO: Invoking command sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.45.237
Jul 4 03:45:34.635: INFO: host: 10.185.45.237, command: sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 03:45:34.635: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.45.237
Jul 4 03:45:35.533: INFO: host: 10.185.45.237, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 03:45:35.533: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.32.9
Jul 4 03:45:36.775: INFO: host: 10.185.32.9, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true
, stderr:
Jul 4 03:45:36.776: INFO: Invoking command sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.32.9
Jul 4 03:45:37.527: INFO: host: 10.185.32.9, command: sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 03:45:37.527: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.32.9
Jul 4 03:45:38.433: INFO: host: 10.185.32.9, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 03:45:40.433: INFO: Waiting for 'kube-controller-manager' controller pod to come up within 10m0s seconds
Jul 4 03:45:42.446: INFO: Got 1 pods running and ready, expect: 3
Jul 4 03:45:44.448: INFO: Got 0 pods running and ready, expect: 3
Jul 4 03:45:46.464: INFO: Got 1 pods running and ready, expect: 3
Jul 4 03:45:48.453: INFO: Got 1 pods running and ready, expect: 3
Jul 4 03:45:50.449: INFO: Got 1 pods running and ready, expect: 3
Jul 4 03:45:52.451: INFO: Got 1 pods running and ready, expect: 3
Jul 4 03:45:54.458: INFO: 'kube-controller-manager' controller pod is up and ready within 10m0s seconds
STEP: Creating pvc post reset
STEP: Creating PVC using the Storage Class vcp-sc-4chpr with disk size and labels: map[] accessMode:
Jul 4 03:45:54.482: INFO: PVC created: pvc-tj8rf in namespace: vcp-2-csi-attach-detach-2540
STEP: Waiting for all claims created post reset to be in bound state
Jul 4 03:45:54.482: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-tj8rf] to have phase Bound
Jul 4 03:45:54.489: INFO: PersistentVolumeClaim pvc-tj8rf found but phase is Pending instead of Bound.
Jul 4 03:45:56.498: INFO: PersistentVolumeClaim pvc-tj8rf found but phase is Pending instead of Bound.
Jul 4 03:45:58.510: INFO: PersistentVolumeClaim pvc-tj8rf found but phase is Pending instead of Bound.
Jul 4 03:46:00.530: INFO: PersistentVolumeClaim pvc-tj8rf found but phase is Pending instead of Bound.
Jul 4 03:46:02.541: INFO: PersistentVolumeClaim pvc-tj8rf found and phase=Bound (8.059225226s)
STEP: Creating pods post reset
STEP: Verify the volume is accessible and filesystem type is as expected
Jul 4 03:46:14.690: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-attach-detach-2540 exec pvc-tester-88hw5 --namespace=vcp-2-csi-attach-detach-2540 -- /bin/cat /mnt/volume1/fstype'
Jul 4 03:46:14.941: INFO: stderr: ""
Jul 4 03:46:14.941: INFO: stdout: "ext4\n"
STEP: Verify the volume is accessible and filesystem type is as expected
Jul 4 03:46:14.957: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-attach-detach-2540 exec pvc-tester-vkfmn --namespace=vcp-2-csi-attach-detach-2540 -- /bin/cat /mnt/volume1/fstype'
Jul 4 03:46:15.229: INFO: stderr: ""
Jul 4 03:46:15.229: INFO: stdout: "ext4\n"
STEP: Verify the volume is accessible and filesystem type is as expected
Jul 4 03:46:15.243: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-attach-detach-2540 exec pvc-tester-kjkkf --namespace=vcp-2-csi-attach-detach-2540 -- /bin/cat /mnt/volume1/fstype'
Jul 4 03:46:15.478: INFO: stderr: ""
Jul 4 03:46:15.478: INFO: stdout: "ext4\n"
STEP: Deleting pods created post reset
Jul 4 03:46:15.478: INFO: Deleting pod: pvc-tester-88hw5
STEP: Deleting pod pvc-tester-88hw5 in namespace vcp-2-csi-attach-detach-2540
Jul 4 03:46:15.509: INFO: Deleting pod: pvc-tester-vkfmn
STEP: Deleting pod pvc-tester-vkfmn in namespace vcp-2-csi-attach-detach-2540
Jul 4 03:46:15.537: INFO: Deleting pod: pvc-tester-kjkkf
STEP: Deleting pod pvc-tester-kjkkf in namespace vcp-2-csi-attach-detach-2540
STEP: Delete VCP PVCs post reset
STEP: Wait for vmdks used by VCP PVCs to be deleted
Jul 4 03:46:47.743: INFO: Looking for default datastore in DC: VSAN-DC
Jul 4 03:46:47.756: INFO: Datstore found for DS URL:ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/
Jul 4 03:46:47.825: INFO: Looking for default datastore in DC: VSAN-DC
Jul 4 03:46:47.836: INFO: Datstore found for DS URL:ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/
Jul 4 03:46:47.919: INFO: Looking for default datastore in DC: VSAN-DC
Jul 4 03:46:47.933: INFO: Datstore found for DS URL:ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/
[JustAfterEach] [csi-vcp-mig] VCP to CSI migration attach, detach tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_attach_detach.go:101
[AfterEach] [csi-vcp-mig] VCP to CSI migration attach, detach tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/go/pkg/mod/k8s.io/kubernetes@v1.24.2/test/e2e/framework/framework.go:188
Jul 4 03:46:48.103: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "vcp-2-csi-attach-detach-2540" for this suite.
STEP: Destroying namespace "vcp-2-csi-attach-detach-1445" for this suite.
Jul 4 03:46:48.138: INFO: Namespace vcp-2-csi-attach-detach-1445 was already deleted
• [SLOW TEST:799.295 seconds]
[csi-vcp-mig] VCP to CSI migration attach, detach tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_attach_detach.go:42
Attach detach combined test
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_attach_detach.go:261
------------------------------
S
------------------------------
[csi-vcp-mig] VCP to CSI migration attach, detach tests
VSAN health is down before enabling migration
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_attach_detach.go:956
[BeforeEach] [csi-vcp-mig] VCP to CSI migration attach, detach tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/go/pkg/mod/k8s.io/kubernetes@v1.24.2/test/e2e/framework/framework.go:187
STEP: Creating a kubernetes client
Jul 4 03:46:48.140: INFO: >>> kubeConfig: /home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config
STEP: Building a namespace api object, basename vcp-2-csi-attach-detach
STEP: Waiting for a default service account to be provisioned in namespace
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[BeforeEach] [csi-vcp-mig] VCP to CSI migration attach, detach tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_attach_detach.go:66
Jul 4 03:46:48.365: INFO: Search candidates vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 03:46:48.365: INFO: Searching for node with UUID: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 03:46:48.366: INFO: Searching for node with UUID: 4201f777-84d8-9463-c37d-868274d333cb
Jul 4 03:46:48.366: INFO: Searching for node with UUID: 42019a83-8fab-0ed3-6745-5980c88e61be
Jul 4 03:46:48.366: INFO: Searching for node with UUID: 42019292-0601-e6cc-cf83-9e7ad2ff1147
Jul 4 03:46:48.366: INFO: Searching for node with UUID: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:46:48.366: INFO: Searching for node with UUID: 4201c124-84e2-596b-a670-ef0e99be85a5
Jul 4 03:46:49.263: INFO: Found node k8s-control-280-1656928192 as vm=VirtualMachine:vm-54 placed on host=HostSystem:host-28 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 03:46:49.399: INFO: Found node k8s-node-148-1656928247 as vm=VirtualMachine:vm-51 placed on host=HostSystem:host-28 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 03:46:49.614: INFO: Found node k8s-control-292-1656928177 as vm=VirtualMachine:vm-50 placed on host=HostSystem:host-22 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 03:46:49.797: INFO: Found node k8s-control-468-1656928206 as vm=VirtualMachine:vm-55 placed on host=HostSystem:host-34 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 03:46:49.812: INFO: Found node k8s-node-990-1656928220 as vm=VirtualMachine:vm-53 placed on host=HostSystem:host-16 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 03:46:49.839: INFO: Found node k8s-node-236-1656928234 as vm=VirtualMachine:vm-52 placed on host=HostSystem:host-34 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 03:46:49.856: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
Jul 4 03:46:49.862: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
Jul 4 03:46:49.868: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
Jul 4 03:46:49.873: INFO: Waiting up to 10m0s for all pods (need at least 0) in namespace 'vcp-2-csi-attach-detach-495' to be running and ready
Jul 4 03:46:49.889: INFO: 0 / 0 pods in namespace 'vcp-2-csi-attach-detach-495' are running and ready (0 seconds elapsed)
Jul 4 03:46:49.889: INFO: expected 0 pod replicas in namespace 'vcp-2-csi-attach-detach-495', 0 are Running and Ready.
Jul 4 03:46:49.896: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.43.70
Jul 4 03:46:51.189: INFO: host: 10.185.43.70, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 1, stdout: , stderr:
[It] VSAN health is down before enabling migration
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_attach_detach.go:956
STEP: Creating VCP SC
STEP: Creating StorageClass with scParameters: map[datastore:vsanDatastore] and zones: [] and ReclaimPolicy: and allowVolumeExpansion: false
STEP: Creating dynamic VCP PVCs before migration
STEP: Creating PVC using the Storage Class vcp-sc-ttg98 with disk size and labels: map[] accessMode:
Jul 4 03:46:51.224: INFO: PVC created: pvc-hz8sb in namespace: vcp-2-csi-attach-detach-495
STEP: Waiting for all claims created before migration to be in bound state
Jul 4 03:46:51.224: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-hz8sb] to have phase Bound
Jul 4 03:46:51.230: INFO: PersistentVolumeClaim pvc-hz8sb found but phase is Pending instead of Bound.
Jul 4 03:46:53.247: INFO: PersistentVolumeClaim pvc-hz8sb found and phase=Bound (2.022910163s)
STEP: Create POD and wait for it to reach running state
STEP: Stopping vsan-health on the vCenter
Jul 4 03:46:59.306: INFO: Invoking command service-control --stop vsan-health on vCenter host 10.185.39.37:22
Jul 4 03:47:10.255: INFO: Invoking command service-control --status vsan-health on vCenter host 10.185.39.37:22
Jul 4 03:47:11.049: INFO: ssh root@10.185.39.37:22: command: service-control --status vsan-health
Jul 4 03:47:11.049: INFO: ssh root@10.185.39.37:22: stdout: "Stopped:\n vsan-health\n"
Jul 4 03:47:11.049: INFO: ssh root@10.185.39.37:22: stderr: ""
Jul 4 03:47:11.049: INFO: ssh root@10.185.39.37:22: exit code: 0
Jul 4 03:47:11.049: INFO: Found service vsan-health in Stopped state
STEP: Enabling CSIMigration and CSIMigrationvSphere feature gates on kube-controller-manager
Jul 4 03:47:11.073: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.43.70
Jul 4 03:47:12.354: INFO: host: 10.185.43.70, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 1, stdout: , stderr:
Jul 4 03:47:12.354: INFO: Invoking command gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.43.70
Jul 4 03:47:13.331: INFO: host: 10.185.43.70, command: gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 03:47:13.332: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.43.70
Jul 4 03:47:14.182: INFO: host: 10.185.43.70, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 03:47:14.182: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.45.237
Jul 4 03:47:15.186: INFO: host: 10.185.45.237, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 1, stdout: , stderr:
Jul 4 03:47:15.186: INFO: Invoking command gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.45.237
Jul 4 03:47:15.870: INFO: host: 10.185.45.237, command: gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 03:47:15.870: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.45.237
Jul 4 03:47:16.814: INFO: host: 10.185.45.237, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 03:47:16.814: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.32.9
Jul 4 03:47:18.055: INFO: host: 10.185.32.9, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 1, stdout: , stderr:
Jul 4 03:47:18.055: INFO: Invoking command gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.32.9
Jul 4 03:47:18.768: INFO: host: 10.185.32.9, command: gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 03:47:18.768: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.32.9
Jul 4 03:47:19.629: INFO: host: 10.185.32.9, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 03:47:21.630: INFO: Waiting for 'kube-controller-manager' controller pod to come up within 10m0s seconds
Jul 4 03:47:23.648: INFO: Got 1 pods running and ready, expect: 3
Jul 4 03:47:25.656: INFO: Got 0 pods running and ready, expect: 3
Jul 4 03:47:27.663: INFO: Got 1 pods running and ready, expect: 3
Jul 4 03:47:29.648: INFO: Got 1 pods running and ready, expect: 3
Jul 4 03:47:31.666: INFO: Got 1 pods running and ready, expect: 3
Jul 4 03:47:33.654: INFO: Got 1 pods running and ready, expect: 3
Jul 4 03:47:35.650: INFO: Got 2 pods running and ready, expect: 3
Jul 4 03:47:37.655: INFO: 'kube-controller-manager' controller pod is up and ready within 10m0s seconds
STEP: Enable CSI migration feature gates on kublets on k8s nodes
Jul 4 03:47:37.685: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
STEP: Cordoning of node: k8s-node-148-1656928247
STEP: Draining of node: k8s-node-148-1656928247
WARNING: ignoring DaemonSet-managed Pods: kube-system/kube-flannel-ds-kbxvd, kube-system/kube-proxy-q9t45, vmware-system-csi/vsphere-csi-node-jkxkm; deleting Pods that declare no controller: vcp-2-csi-attach-detach-495/pvc-tester-4vgpg
evicting pod vcp-2-csi-attach-detach-495/pvc-tester-4vgpg
STEP: Modifying feature gates in kubelet config yaml of node: k8s-node-148-1656928247
Jul 4 03:47:37.849: INFO: Invoking command 'grep CSIMigration /var/lib/kubelet/config.yaml' on host 10.185.38.32
Jul 4 03:47:38.994: INFO: host: 10.185.38.32, command: grep CSIMigration /var/lib/kubelet/config.yaml, return code: 1, stdout: , stderr:
Jul 4 03:47:38.994: INFO: Invoking command 'echo "featureGates:
{
"CSIMigration": true,
"CSIMigrationvSphere": true
}" >>/var/lib/kubelet/config.yaml' on host 10.185.38.32
Jul 4 03:47:39.659: INFO: host: 10.185.38.32, command: echo "featureGates:
{
"CSIMigration": true,
"CSIMigrationvSphere": true
}" >>/var/lib/kubelet/config.yaml, return code: 0, stdout: , stderr:
Jul 4 03:47:39.659: INFO: Invoking command 'systemctl daemon-reload && systemctl restart kubelet' on host 10.185.38.32
Jul 4 03:47:41.019: INFO: host: 10.185.38.32, command: systemctl daemon-reload && systemctl restart kubelet, return code: 0, stdout: , stderr:
STEP: Wait for feature gates update on the k8s CSI node: k8s-node-148-1656928247
Jul 4 03:47:41.027: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
Jul 4 03:47:51.045: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
STEP: Uncordoning of node: k8s-node-148-1656928247
Jul 4 03:47:51.082: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
STEP: Cordoning of node: k8s-node-236-1656928234
STEP: Draining of node: k8s-node-236-1656928234
WARNING: ignoring DaemonSet-managed Pods: kube-system/kube-flannel-ds-jtklh, kube-system/kube-proxy-wtp4g, vmware-system-csi/vsphere-csi-node-8rswp
STEP: Modifying feature gates in kubelet config yaml of node: k8s-node-236-1656928234
Jul 4 03:47:51.165: INFO: Invoking command 'grep CSIMigration /var/lib/kubelet/config.yaml' on host 10.185.33.157
Jul 4 03:47:52.340: INFO: host: 10.185.33.157, command: grep CSIMigration /var/lib/kubelet/config.yaml, return code: 1, stdout: , stderr:
Jul 4 03:47:52.340: INFO: Invoking command 'echo "featureGates:
{
"CSIMigration": true,
"CSIMigrationvSphere": true
}" >>/var/lib/kubelet/config.yaml' on host 10.185.33.157
Jul 4 03:47:53.044: INFO: host: 10.185.33.157, command: echo "featureGates:
{
"CSIMigration": true,
"CSIMigrationvSphere": true
}" >>/var/lib/kubelet/config.yaml, return code: 0, stdout: , stderr:
Jul 4 03:47:53.044: INFO: Invoking command 'systemctl daemon-reload && systemctl restart kubelet' on host 10.185.33.157
Jul 4 03:47:54.385: INFO: host: 10.185.33.157, command: systemctl daemon-reload && systemctl restart kubelet, return code: 0, stdout: , stderr:
STEP: Wait for feature gates update on the k8s CSI node: k8s-node-236-1656928234
Jul 4 03:47:54.403: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
Jul 4 03:48:04.422: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
STEP: Uncordoning of node: k8s-node-236-1656928234
Jul 4 03:48:04.456: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
STEP: Cordoning of node: k8s-node-990-1656928220
STEP: Draining of node: k8s-node-990-1656928220
WARNING: ignoring DaemonSet-managed Pods: kube-system/kube-flannel-ds-jv5wm, kube-system/kube-proxy-62sc9, vmware-system-csi/vsphere-csi-node-xzpc9
STEP: Modifying feature gates in kubelet config yaml of node: k8s-node-990-1656928220
Jul 4 03:48:04.562: INFO: Invoking command 'grep CSIMigration /var/lib/kubelet/config.yaml' on host 10.185.35.185
Jul 4 03:48:05.943: INFO: host: 10.185.35.185, command: grep CSIMigration /var/lib/kubelet/config.yaml, return code: 1, stdout: , stderr:
Jul 4 03:48:05.944: INFO: Invoking command 'echo "featureGates:
{
"CSIMigration": true,
"CSIMigrationvSphere": true
}" >>/var/lib/kubelet/config.yaml' on host 10.185.35.185
Jul 4 03:48:06.686: INFO: host: 10.185.35.185, command: echo "featureGates:
{
"CSIMigration": true,
"CSIMigrationvSphere": true
}" >>/var/lib/kubelet/config.yaml, return code: 0, stdout: , stderr:
Jul 4 03:48:06.686: INFO: Invoking command 'systemctl daemon-reload && systemctl restart kubelet' on host 10.185.35.185
Jul 4 03:48:08.084: INFO: host: 10.185.35.185, command: systemctl daemon-reload && systemctl restart kubelet, return code: 0, stdout: , stderr:
STEP: Wait for feature gates update on the k8s CSI node: k8s-node-990-1656928220
Jul 4 03:48:08.094: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
Jul 4 03:48:18.103: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
STEP: Uncordoning of node: k8s-node-990-1656928220
Jul 4 03:48:18.147: INFO: Waiting up to 10m0s for all pods (need at least 0) in namespace 'vcp-2-csi-attach-detach-495' to be running and ready
Jul 4 03:48:18.185: INFO: 0 / 0 pods in namespace 'vcp-2-csi-attach-detach-495' are running and ready (0 seconds elapsed)
Jul 4 03:48:18.185: INFO: expected 0 pod replicas in namespace 'vcp-2-csi-attach-detach-495', 0 are Running and Ready.
STEP: Creating pod
STEP: Till the Service is down , verify that POD is not in running state
STEP: Starting vsan-health on the vCenter
Jul 4 03:49:18.265: INFO: Invoking command service-control --start vsan-health on vCenter host 10.185.39.37:22
Jul 4 03:49:29.530: INFO: Invoking command service-control --status vsan-health on vCenter host 10.185.39.37:22
Jul 4 03:49:31.287: INFO: ssh root@10.185.39.37:22: command: service-control --status vsan-health
Jul 4 03:49:31.287: INFO: ssh root@10.185.39.37:22: stdout: "Running:\n vsan-health\n"
Jul 4 03:49:31.287: INFO: ssh root@10.185.39.37:22: stderr: ""
Jul 4 03:49:31.287: INFO: ssh root@10.185.39.37:22: exit code: 0
Jul 4 03:49:31.287: INFO: Found service vsan-health in Running state
STEP: Waiting for migration related annotations on PV/PVCs created before migration
Jul 4 03:49:31.287: INFO: Checking PVC pvc-hz8sb
Jul 4 03:49:31.306: INFO: Annotations found on PVC: pvc-hz8sb in namespace:vcp-2-csi-attach-detach-495 are,
(map[string]string) (len=5) {
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 03:49:31.306: INFO: Checking PV pvc-ae962f86-e049-4dca-822b-c5423fcdffad
Jul 4 03:49:31.316: INFO: Annotations found on PV: pvc-ae962f86-e049-4dca-822b-c5423fcdffad are,
(map[string]string) (len=4) {
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=31) "pv.kubernetes.io/provisioned-by": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=23) "kubernetes.io/createdby": (string) (len=34) "vsphere-volume-dynamic-provisioner"
}
STEP: wait for some time and make sure POD is created and it is in running state
Jul 4 03:49:31.323: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:49:33.333: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:49:35.336: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:49:37.338: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:49:39.334: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:49:41.337: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:49:43.336: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:49:45.335: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:49:47.336: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:49:49.334: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:49:51.337: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:49:53.338: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:49:55.343: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:49:57.335: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:49:59.333: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:50:01.335: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:50:03.339: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:50:05.338: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:50:07.338: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:50:09.335: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:50:11.333: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:50:13.336: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:50:15.338: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:50:17.335: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:50:19.335: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:50:21.340: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:50:23.336: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:50:25.339: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:50:27.336: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:50:29.334: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:50:31.336: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:50:33.335: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:50:35.337: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:50:37.339: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:50:39.338: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:50:41.334: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:50:43.333: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:50:45.338: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:50:47.335: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:50:49.335: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:50:51.334: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:50:53.333: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:50:55.345: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:50:57.335: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:50:59.338: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:51:01.335: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:51:03.337: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:51:05.337: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:51:07.339: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:51:09.336: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:51:11.339: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:51:13.334: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:51:15.338: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:51:17.337: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:51:19.335: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:51:21.349: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:51:23.333: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:51:25.335: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:51:27.339: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:51:29.333: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:51:31.334: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:51:33.335: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:51:35.334: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:51:37.333: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:51:39.333: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:51:41.340: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:51:43.335: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:51:45.335: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:51:47.334: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:51:49.333: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:51:51.334: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:51:53.332: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:51:55.333: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:51:57.342: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:51:59.333: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:52:01.334: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:52:03.338: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:52:05.336: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:52:07.334: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:52:09.333: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:52:11.335: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:52:13.337: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:52:15.334: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:52:17.338: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:52:19.333: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:52:21.342: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:52:23.336: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:52:25.336: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:52:27.338: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:52:29.337: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:52:31.336: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:52:33.334: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:52:35.335: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:52:37.336: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:52:39.332: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:52:41.336: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:52:43.333: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:52:45.338: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:52:47.333: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:52:49.333: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:52:51.339: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:52:53.338: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:52:55.336: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:52:57.338: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:52:59.334: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:53:01.340: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:53:03.336: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:53:05.335: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:53:07.338: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:53:09.332: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:53:11.334: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:53:13.338: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:53:15.335: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:53:17.335: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:53:19.334: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:53:21.470: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:53:23.333: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:53:25.334: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:53:27.335: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:53:29.345: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:53:31.335: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:53:33.338: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:53:35.334: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:53:37.333: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:53:39.337: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:53:41.341: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:53:43.336: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:53:45.336: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:53:47.335: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:53:49.333: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:53:51.337: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:53:53.344: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:53:55.337: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:53:57.349: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:53:59.335: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:54:01.338: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:54:03.337: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:54:05.335: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:54:07.340: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:54:09.333: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:54:11.336: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:54:13.337: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:54:15.337: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:54:17.338: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:54:19.337: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:54:21.337: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:54:23.336: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:54:25.335: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:54:27.335: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:54:29.334: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:54:31.334: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:54:33.339: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:54:35.334: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:54:37.341: INFO: The status of Pod pvc-tester-hfgsd is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:54:39.332: INFO: The status of Pod pvc-tester-hfgsd is Running (Ready = true)
STEP: Verify CnsVSphereVolumeMigration crds and CNS volume metadata on pvc created before migration
Jul 4 03:54:39.333: INFO: Checking PVC pvc-hz8sb
Jul 4 03:54:39.348: INFO: Processing PVC: pvc-hz8sb
Jul 4 03:54:39.398: INFO: For pod 'pvc-tester-hfgsd', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-hz8sb,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-b5sqb,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 03:54:39.472: INFO: Found CNS volume with id 71fd98a9-6518-476b-b23a-676b061b3968
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "71fd98a9-6518-476b-b23a-676b061b3968"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "2ee10b76-fb87-11ec-8a4e-527b6bf8b324",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=2 cap=2) {
(*types.CnsKubernetesEntityMetadata)(0xc001256400)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-ae962f86-e049-4dca-822b-c5423fcdffad",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc001256480)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-hz8sb",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=27) "vcp-2-csi-attach-detach-495",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-ae962f86-e049-4dca-822b-c5423fcdffad",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc00123ad80)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "71fd98a9-6518-476b-b23a-676b061b3968",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "1bc5c262-d068-68a4-6eda-020088529ac5"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=13) "notAccessible",
HealthStatus: (string) (len=7) "unknown"
}
Jul 4 03:54:39.472: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:true
Jul 4 03:54:49.535: INFO: Found CNS volume with id 71fd98a9-6518-476b-b23a-676b061b3968
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "71fd98a9-6518-476b-b23a-676b061b3968"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "2ee10b76-fb87-11ec-8a4e-527b6bf8b324",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=3 cap=4) {
(*types.CnsKubernetesEntityMetadata)(0xc001256580)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-ae962f86-e049-4dca-822b-c5423fcdffad",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc001256680)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-hz8sb",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=27) "vcp-2-csi-attach-detach-495",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-ae962f86-e049-4dca-822b-c5423fcdffad",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc001256700)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=16) "pvc-tester-hfgsd",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=3) "POD",
Namespace: (string) (len=27) "vcp-2-csi-attach-detach-495",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
EntityName: (string) (len=9) "pvc-hz8sb",
Namespace: (string) (len=27) "vcp-2-csi-attach-detach-495",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc000698fc0)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "71fd98a9-6518-476b-b23a-676b061b3968",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "1bc5c262-d068-68a4-6eda-020088529ac5"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=13) "notAccessible",
HealthStatus: (string) (len=7) "unknown"
}
Jul 4 03:54:49.535: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:true, verifyPodEntry:true
[JustAfterEach] [csi-vcp-mig] VCP to CSI migration attach, detach tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_attach_detach.go:101
Jul 4 03:54:49.549: INFO: Deleting pod: pvc-tester-hfgsd
Jul 4 03:54:49.642: INFO: Verify volume 71fd98a9-6518-476b-b23a-676b061b3968 is detached from the node: k8s-node-148-1656928247
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
Jul 4 03:54:51.677: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:54:51.685: INFO: Found FCDID "71fd98a9-6518-476b-b23a-676b061b3968" attached to VM "k8s-worker3"
Jul 4 03:54:51.686: INFO: Found the disk "71fd98a9-6518-476b-b23a-676b061b3968" is attached to the VM with UUID: "42012c70-2cfc-49b2-410d-e65427bd134c"
Jul 4 03:54:51.686: INFO: Waiting for disk: "71fd98a9-6518-476b-b23a-676b061b3968" to be detached from the node :"k8s-node-148-1656928247"
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
Jul 4 03:54:53.685: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:54:53.692: INFO: Found FCDID "71fd98a9-6518-476b-b23a-676b061b3968" attached to VM "k8s-worker3"
Jul 4 03:54:53.692: INFO: Found the disk "71fd98a9-6518-476b-b23a-676b061b3968" is attached to the VM with UUID: "42012c70-2cfc-49b2-410d-e65427bd134c"
Jul 4 03:54:53.692: INFO: Waiting for disk: "71fd98a9-6518-476b-b23a-676b061b3968" to be detached from the node :"k8s-node-148-1656928247"
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
Jul 4 03:54:55.677: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:54:55.684: INFO: Found FCDID "71fd98a9-6518-476b-b23a-676b061b3968" attached to VM "k8s-worker3"
Jul 4 03:54:55.684: INFO: Found the disk "71fd98a9-6518-476b-b23a-676b061b3968" is attached to the VM with UUID: "42012c70-2cfc-49b2-410d-e65427bd134c"
Jul 4 03:54:55.684: INFO: Waiting for disk: "71fd98a9-6518-476b-b23a-676b061b3968" to be detached from the node :"k8s-node-148-1656928247"
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
Jul 4 03:54:57.680: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:54:57.689: INFO: Found FCDID "71fd98a9-6518-476b-b23a-676b061b3968" attached to VM "k8s-worker3"
Jul 4 03:54:57.689: INFO: Found the disk "71fd98a9-6518-476b-b23a-676b061b3968" is attached to the VM with UUID: "42012c70-2cfc-49b2-410d-e65427bd134c"
Jul 4 03:54:57.689: INFO: Waiting for disk: "71fd98a9-6518-476b-b23a-676b061b3968" to be detached from the node :"k8s-node-148-1656928247"
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
Jul 4 03:54:59.679: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:54:59.694: INFO: Found FCDID "71fd98a9-6518-476b-b23a-676b061b3968" attached to VM "k8s-worker3"
Jul 4 03:54:59.694: INFO: Found the disk "71fd98a9-6518-476b-b23a-676b061b3968" is attached to the VM with UUID: "42012c70-2cfc-49b2-410d-e65427bd134c"
Jul 4 03:54:59.694: INFO: Waiting for disk: "71fd98a9-6518-476b-b23a-676b061b3968" to be detached from the node :"k8s-node-148-1656928247"
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
Jul 4 03:55:01.689: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:55:01.699: INFO: Found FCDID "71fd98a9-6518-476b-b23a-676b061b3968" attached to VM "k8s-worker3"
Jul 4 03:55:01.699: INFO: Found the disk "71fd98a9-6518-476b-b23a-676b061b3968" is attached to the VM with UUID: "42012c70-2cfc-49b2-410d-e65427bd134c"
Jul 4 03:55:01.699: INFO: Waiting for disk: "71fd98a9-6518-476b-b23a-676b061b3968" to be detached from the node :"k8s-node-148-1656928247"
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
Jul 4 03:55:03.697: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:55:03.704: INFO: Found FCDID "71fd98a9-6518-476b-b23a-676b061b3968" attached to VM "k8s-worker3"
Jul 4 03:55:03.704: INFO: Found the disk "71fd98a9-6518-476b-b23a-676b061b3968" is attached to the VM with UUID: "42012c70-2cfc-49b2-410d-e65427bd134c"
Jul 4 03:55:03.704: INFO: Waiting for disk: "71fd98a9-6518-476b-b23a-676b061b3968" to be detached from the node :"k8s-node-148-1656928247"
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
Jul 4 03:55:05.681: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:55:05.688: INFO: Found FCDID "71fd98a9-6518-476b-b23a-676b061b3968" attached to VM "k8s-worker3"
Jul 4 03:55:05.688: INFO: Found the disk "71fd98a9-6518-476b-b23a-676b061b3968" is attached to the VM with UUID: "42012c70-2cfc-49b2-410d-e65427bd134c"
Jul 4 03:55:05.688: INFO: Waiting for disk: "71fd98a9-6518-476b-b23a-676b061b3968" to be detached from the node :"k8s-node-148-1656928247"
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
Jul 4 03:55:07.668: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:55:07.674: INFO: Found FCDID "71fd98a9-6518-476b-b23a-676b061b3968" attached to VM "k8s-worker3"
Jul 4 03:55:07.674: INFO: Found the disk "71fd98a9-6518-476b-b23a-676b061b3968" is attached to the VM with UUID: "42012c70-2cfc-49b2-410d-e65427bd134c"
Jul 4 03:55:07.674: INFO: Waiting for disk: "71fd98a9-6518-476b-b23a-676b061b3968" to be detached from the node :"k8s-node-148-1656928247"
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
Jul 4 03:55:09.680: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:55:09.686: INFO: Found FCDID "71fd98a9-6518-476b-b23a-676b061b3968" attached to VM "k8s-worker3"
Jul 4 03:55:09.686: INFO: Found the disk "71fd98a9-6518-476b-b23a-676b061b3968" is attached to the VM with UUID: "42012c70-2cfc-49b2-410d-e65427bd134c"
Jul 4 03:55:09.686: INFO: Waiting for disk: "71fd98a9-6518-476b-b23a-676b061b3968" to be detached from the node :"k8s-node-148-1656928247"
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
Jul 4 03:55:11.701: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:55:11.706: INFO: Found FCDID "71fd98a9-6518-476b-b23a-676b061b3968" attached to VM "k8s-worker3"
Jul 4 03:55:11.706: INFO: Found the disk "71fd98a9-6518-476b-b23a-676b061b3968" is attached to the VM with UUID: "42012c70-2cfc-49b2-410d-e65427bd134c"
Jul 4 03:55:11.706: INFO: Waiting for disk: "71fd98a9-6518-476b-b23a-676b061b3968" to be detached from the node :"k8s-node-148-1656928247"
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
Jul 4 03:55:13.699: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:55:13.706: INFO: Found FCDID "71fd98a9-6518-476b-b23a-676b061b3968" attached to VM "k8s-worker3"
Jul 4 03:55:13.706: INFO: Found the disk "71fd98a9-6518-476b-b23a-676b061b3968" is attached to the VM with UUID: "42012c70-2cfc-49b2-410d-e65427bd134c"
Jul 4 03:55:13.706: INFO: Waiting for disk: "71fd98a9-6518-476b-b23a-676b061b3968" to be detached from the node :"k8s-node-148-1656928247"
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
Jul 4 03:55:15.677: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:55:15.685: INFO: Found FCDID "71fd98a9-6518-476b-b23a-676b061b3968" attached to VM "k8s-worker3"
Jul 4 03:55:15.685: INFO: Found the disk "71fd98a9-6518-476b-b23a-676b061b3968" is attached to the VM with UUID: "42012c70-2cfc-49b2-410d-e65427bd134c"
Jul 4 03:55:15.685: INFO: Waiting for disk: "71fd98a9-6518-476b-b23a-676b061b3968" to be detached from the node :"k8s-node-148-1656928247"
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
Jul 4 03:55:17.683: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:55:17.691: INFO: Found FCDID "71fd98a9-6518-476b-b23a-676b061b3968" attached to VM "k8s-worker3"
Jul 4 03:55:17.691: INFO: Found the disk "71fd98a9-6518-476b-b23a-676b061b3968" is attached to the VM with UUID: "42012c70-2cfc-49b2-410d-e65427bd134c"
Jul 4 03:55:17.691: INFO: Waiting for disk: "71fd98a9-6518-476b-b23a-676b061b3968" to be detached from the node :"k8s-node-148-1656928247"
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
Jul 4 03:55:19.680: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:55:19.687: INFO: Found FCDID "71fd98a9-6518-476b-b23a-676b061b3968" attached to VM "k8s-worker3"
Jul 4 03:55:19.687: INFO: Found the disk "71fd98a9-6518-476b-b23a-676b061b3968" is attached to the VM with UUID: "42012c70-2cfc-49b2-410d-e65427bd134c"
Jul 4 03:55:19.687: INFO: Waiting for disk: "71fd98a9-6518-476b-b23a-676b061b3968" to be detached from the node :"k8s-node-148-1656928247"
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
Jul 4 03:55:21.688: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:55:21.694: INFO: Found FCDID "71fd98a9-6518-476b-b23a-676b061b3968" attached to VM "k8s-worker3"
Jul 4 03:55:21.694: INFO: Found the disk "71fd98a9-6518-476b-b23a-676b061b3968" is attached to the VM with UUID: "42012c70-2cfc-49b2-410d-e65427bd134c"
Jul 4 03:55:21.694: INFO: Waiting for disk: "71fd98a9-6518-476b-b23a-676b061b3968" to be detached from the node :"k8s-node-148-1656928247"
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
Jul 4 03:55:23.677: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:55:23.685: INFO: failed to find FCDID "71fd98a9-6518-476b-b23a-676b061b3968" attached to VM "k8s-worker3"
Jul 4 03:55:23.685: INFO: Disk: 71fd98a9-6518-476b-b23a-676b061b3968 successfully detached
STEP: Disable CSI migration feature gates on kublets on k8s nodes
Jul 4 03:55:23.729: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
STEP: Cordoning of node: k8s-node-148-1656928247
STEP: Draining of node: k8s-node-148-1656928247
WARNING: ignoring DaemonSet-managed Pods: kube-system/kube-flannel-ds-kbxvd, kube-system/kube-proxy-q9t45, vmware-system-csi/vsphere-csi-node-jkxkm
STEP: Modifying feature gates in kubelet config yaml of node: k8s-node-148-1656928247
Jul 4 03:55:23.821: INFO: Invoking command 'grep CSIMigration /var/lib/kubelet/config.yaml' on host 10.185.38.32
Jul 4 03:55:24.948: INFO: host: 10.185.38.32, command: grep CSIMigration /var/lib/kubelet/config.yaml, return code: 0, stdout: CSIMigration: true,
CSIMigrationvSphere: true
, stderr:
Jul 4 03:55:24.948: INFO: Invoking command 'head -n -5 /var/lib/kubelet/config.yaml > tmp.txt && mv tmp.txt /var/lib/kubelet/config.yaml' on host 10.185.38.32
Jul 4 03:55:25.639: INFO: host: 10.185.38.32, command: head -n -5 /var/lib/kubelet/config.yaml > tmp.txt && mv tmp.txt /var/lib/kubelet/config.yaml, return code: 0, stdout: , stderr:
Jul 4 03:55:25.639: INFO: Invoking command 'systemctl daemon-reload && systemctl restart kubelet' on host 10.185.38.32
Jul 4 03:55:26.978: INFO: host: 10.185.38.32, command: systemctl daemon-reload && systemctl restart kubelet, return code: 0, stdout: , stderr:
STEP: Wait for feature gates update on the k8s CSI node: k8s-node-148-1656928247
Jul 4 03:55:26.990: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
Jul 4 03:55:37.010: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
STEP: Uncordoning of node: k8s-node-148-1656928247
Jul 4 03:55:37.047: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
STEP: Cordoning of node: k8s-node-236-1656928234
STEP: Draining of node: k8s-node-236-1656928234
WARNING: ignoring DaemonSet-managed Pods: kube-system/kube-flannel-ds-jtklh, kube-system/kube-proxy-wtp4g, vmware-system-csi/vsphere-csi-node-8rswp
STEP: Modifying feature gates in kubelet config yaml of node: k8s-node-236-1656928234
Jul 4 03:55:37.157: INFO: Invoking command 'grep CSIMigration /var/lib/kubelet/config.yaml' on host 10.185.33.157
Jul 4 03:55:38.626: INFO: host: 10.185.33.157, command: grep CSIMigration /var/lib/kubelet/config.yaml, return code: 0, stdout: CSIMigration: true,
CSIMigrationvSphere: true
, stderr:
Jul 4 03:55:38.627: INFO: Invoking command 'head -n -5 /var/lib/kubelet/config.yaml > tmp.txt && mv tmp.txt /var/lib/kubelet/config.yaml' on host 10.185.33.157
Jul 4 03:55:39.400: INFO: host: 10.185.33.157, command: head -n -5 /var/lib/kubelet/config.yaml > tmp.txt && mv tmp.txt /var/lib/kubelet/config.yaml, return code: 0, stdout: , stderr:
Jul 4 03:55:39.400: INFO: Invoking command 'systemctl daemon-reload && systemctl restart kubelet' on host 10.185.33.157
Jul 4 03:55:40.878: INFO: host: 10.185.33.157, command: systemctl daemon-reload && systemctl restart kubelet, return code: 0, stdout: , stderr:
STEP: Wait for feature gates update on the k8s CSI node: k8s-node-236-1656928234
Jul 4 03:55:40.892: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
Jul 4 03:55:50.912: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
STEP: Uncordoning of node: k8s-node-236-1656928234
Jul 4 03:55:50.965: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
STEP: Cordoning of node: k8s-node-990-1656928220
STEP: Draining of node: k8s-node-990-1656928220
WARNING: ignoring DaemonSet-managed Pods: kube-system/kube-flannel-ds-jv5wm, kube-system/kube-proxy-62sc9, vmware-system-csi/vsphere-csi-node-xzpc9
STEP: Modifying feature gates in kubelet config yaml of node: k8s-node-990-1656928220
Jul 4 03:55:51.043: INFO: Invoking command 'grep CSIMigration /var/lib/kubelet/config.yaml' on host 10.185.35.185
Jul 4 03:55:52.431: INFO: host: 10.185.35.185, command: grep CSIMigration /var/lib/kubelet/config.yaml, return code: 0, stdout: CSIMigration: true,
CSIMigrationvSphere: true
, stderr:
Jul 4 03:55:52.432: INFO: Invoking command 'head -n -5 /var/lib/kubelet/config.yaml > tmp.txt && mv tmp.txt /var/lib/kubelet/config.yaml' on host 10.185.35.185
Jul 4 03:55:53.186: INFO: host: 10.185.35.185, command: head -n -5 /var/lib/kubelet/config.yaml > tmp.txt && mv tmp.txt /var/lib/kubelet/config.yaml, return code: 0, stdout: , stderr:
Jul 4 03:55:53.186: INFO: Invoking command 'systemctl daemon-reload && systemctl restart kubelet' on host 10.185.35.185
Jul 4 03:55:54.600: INFO: host: 10.185.35.185, command: systemctl daemon-reload && systemctl restart kubelet, return code: 0, stdout: , stderr:
STEP: Wait for feature gates update on the k8s CSI node: k8s-node-990-1656928220
Jul 4 03:55:54.618: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
Jul 4 03:56:04.636: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
STEP: Uncordoning of node: k8s-node-990-1656928220
Jul 4 03:56:04.681: INFO: Waiting up to 10m0s for all pods (need at least 0) in namespace 'vcp-2-csi-attach-detach-495' to be running and ready
Jul 4 03:56:04.718: INFO: 0 / 0 pods in namespace 'vcp-2-csi-attach-detach-495' are running and ready (0 seconds elapsed)
Jul 4 03:56:04.718: INFO: expected 0 pod replicas in namespace 'vcp-2-csi-attach-detach-495', 0 are Running and Ready.
Jul 4 03:56:04.776: INFO: Deleting PVC pvc-hz8sb
Jul 4 03:56:04.818: INFO: Looking for default datastore in DC: VSAN-DC
Jul 4 03:56:04.833: INFO: Datstore found for DS URL:ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/
Jul 4 03:56:05.055: INFO: Waiting for CnsVSphereVolumeMigration crd 71fd98a9-6518-476b-b23a-676b061b3968 to be deleted
Jul 4 03:56:07.146: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.43.70
Jul 4 03:56:08.658: INFO: host: 10.185.43.70, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true
, stderr:
Jul 4 03:56:08.658: INFO: Invoking command sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.43.70
Jul 4 03:56:09.420: INFO: host: 10.185.43.70, command: sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 03:56:09.420: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.43.70
Jul 4 03:56:10.283: INFO: host: 10.185.43.70, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 03:56:10.283: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.45.237
Jul 4 03:56:11.399: INFO: host: 10.185.45.237, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true
, stderr:
Jul 4 03:56:11.399: INFO: Invoking command sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.45.237
Jul 4 03:56:12.112: INFO: host: 10.185.45.237, command: sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 03:56:12.112: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.45.237
Jul 4 03:56:13.006: INFO: host: 10.185.45.237, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 03:56:13.006: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.32.9
Jul 4 03:56:14.749: INFO: host: 10.185.32.9, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true
, stderr:
Jul 4 03:56:14.750: INFO: Invoking command sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.32.9
Jul 4 03:56:15.583: INFO: host: 10.185.32.9, command: sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 03:56:15.583: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.32.9
Jul 4 03:56:16.554: INFO: host: 10.185.32.9, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 03:56:18.556: INFO: Waiting for 'kube-controller-manager' controller pod to come up within 10m0s seconds
Jul 4 03:56:20.577: INFO: Got 1 pods running and ready, expect: 3
Jul 4 03:56:22.569: INFO: Got 0 pods running and ready, expect: 3
Jul 4 03:56:24.583: INFO: Got 1 pods running and ready, expect: 3
Jul 4 03:56:26.576: INFO: Got 1 pods running and ready, expect: 3
Jul 4 03:56:28.590: INFO: Got 1 pods running and ready, expect: 3
Jul 4 03:56:30.582: INFO: Got 2 pods running and ready, expect: 3
Jul 4 03:56:32.575: INFO: Got 2 pods running and ready, expect: 3
Jul 4 03:56:34.578: INFO: 'kube-controller-manager' controller pod is up and ready within 10m0s seconds
[AfterEach] [csi-vcp-mig] VCP to CSI migration attach, detach tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/go/pkg/mod/k8s.io/kubernetes@v1.24.2/test/e2e/framework/framework.go:188
Jul 4 03:56:34.598: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "vcp-2-csi-attach-detach-495" for this suite.
• [SLOW TEST:586.496 seconds]
[csi-vcp-mig] VCP to CSI migration attach, detach tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_attach_detach.go:42
VSAN health is down before enabling migration
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_attach_detach.go:956
------------------------------
SSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[csi-vcp-mig] VCP to CSI migration attach, detach tests
Migration enabled - VSAN health is down
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_attach_detach.go:854
[BeforeEach] [csi-vcp-mig] VCP to CSI migration attach, detach tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/go/pkg/mod/k8s.io/kubernetes@v1.24.2/test/e2e/framework/framework.go:187
STEP: Creating a kubernetes client
Jul 4 03:56:34.636: INFO: >>> kubeConfig: /home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config
STEP: Building a namespace api object, basename vcp-2-csi-attach-detach
STEP: Waiting for a default service account to be provisioned in namespace
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[BeforeEach] [csi-vcp-mig] VCP to CSI migration attach, detach tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_attach_detach.go:66
Jul 4 03:56:40.660: INFO: Search candidates vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 03:56:40.660: INFO: Searching for node with UUID: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 03:56:40.660: INFO: Searching for node with UUID: 42019a83-8fab-0ed3-6745-5980c88e61be
Jul 4 03:56:40.660: INFO: Searching for node with UUID: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 03:56:40.660: INFO: Searching for node with UUID: 42019292-0601-e6cc-cf83-9e7ad2ff1147
Jul 4 03:56:40.660: INFO: Searching for node with UUID: 4201f777-84d8-9463-c37d-868274d333cb
Jul 4 03:56:40.660: INFO: Searching for node with UUID: 4201c124-84e2-596b-a670-ef0e99be85a5
Jul 4 03:56:41.466: INFO: Found node k8s-control-292-1656928177 as vm=VirtualMachine:vm-50 placed on host=HostSystem:host-22 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 03:56:41.700: INFO: Found node k8s-node-990-1656928220 as vm=VirtualMachine:vm-53 placed on host=HostSystem:host-16 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 03:56:41.894: INFO: Found node k8s-control-280-1656928192 as vm=VirtualMachine:vm-54 placed on host=HostSystem:host-28 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 03:56:41.989: INFO: Found node k8s-control-468-1656928206 as vm=VirtualMachine:vm-55 placed on host=HostSystem:host-34 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 03:56:41.996: INFO: Found node k8s-node-236-1656928234 as vm=VirtualMachine:vm-52 placed on host=HostSystem:host-34 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 03:56:42.004: INFO: Found node k8s-node-148-1656928247 as vm=VirtualMachine:vm-51 placed on host=HostSystem:host-28 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 03:56:42.027: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
Jul 4 03:56:42.035: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
Jul 4 03:56:42.042: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
Jul 4 03:56:42.049: INFO: Waiting up to 10m0s for all pods (need at least 0) in namespace 'vcp-2-csi-attach-detach-2888' to be running and ready
Jul 4 03:56:42.068: INFO: 0 / 0 pods in namespace 'vcp-2-csi-attach-detach-2888' are running and ready (0 seconds elapsed)
Jul 4 03:56:42.068: INFO: expected 0 pod replicas in namespace 'vcp-2-csi-attach-detach-2888', 0 are Running and Ready.
Jul 4 03:56:42.076: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.43.70
Jul 4 03:56:42.931: INFO: host: 10.185.43.70, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 1, stdout: , stderr:
[It] Migration enabled - VSAN health is down
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_attach_detach.go:854
STEP: Creating VCP SC
STEP: Creating StorageClass with scParameters: map[datastore:vsanDatastore] and zones: [] and ReclaimPolicy: and allowVolumeExpansion: false
STEP: Creating dynamic VCP PVCs before migration
STEP: Creating PVC using the Storage Class vcp-sc-rmbxk with disk size and labels: map[] accessMode:
Jul 4 03:56:42.986: INFO: PVC created: pvc-rvbp6 in namespace: vcp-2-csi-attach-detach-2888
STEP: Waiting for all claims created before migration to be in bound state
Jul 4 03:56:42.986: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-rvbp6] to have phase Bound
Jul 4 03:56:42.992: INFO: PersistentVolumeClaim pvc-rvbp6 found but phase is Pending instead of Bound.
Jul 4 03:56:45.003: INFO: PersistentVolumeClaim pvc-rvbp6 found and phase=Bound (2.016980584s)
STEP: Create POD and wait for it to reach running state
STEP: Enabling CSIMigration and CSIMigrationvSphere feature gates on kube-controller-manager
Jul 4 03:56:53.112: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.43.70
Jul 4 03:56:53.964: INFO: host: 10.185.43.70, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 1, stdout: , stderr:
Jul 4 03:56:53.964: INFO: Invoking command gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.43.70
Jul 4 03:56:54.664: INFO: host: 10.185.43.70, command: gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 03:56:54.664: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.43.70
Jul 4 03:56:55.506: INFO: host: 10.185.43.70, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 03:56:55.506: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.45.237
Jul 4 03:56:56.503: INFO: host: 10.185.45.237, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 1, stdout: , stderr:
Jul 4 03:56:56.503: INFO: Invoking command gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.45.237
Jul 4 03:56:57.238: INFO: host: 10.185.45.237, command: gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 03:56:57.238: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.45.237
Jul 4 03:56:58.090: INFO: host: 10.185.45.237, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 03:56:58.090: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.32.9
Jul 4 03:56:59.487: INFO: host: 10.185.32.9, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 1, stdout: , stderr:
Jul 4 03:56:59.488: INFO: Invoking command gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.32.9
Jul 4 03:57:00.363: INFO: host: 10.185.32.9, command: gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 03:57:00.364: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.32.9
Jul 4 03:57:01.339: INFO: host: 10.185.32.9, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 03:57:03.339: INFO: Waiting for 'kube-controller-manager' controller pod to come up within 10m0s seconds
Jul 4 03:57:05.357: INFO: Got 1 pods running and ready, expect: 3
Jul 4 03:57:07.365: INFO: Got 0 pods running and ready, expect: 3
Jul 4 03:57:09.354: INFO: Got 1 pods running and ready, expect: 3
Jul 4 03:57:11.360: INFO: Got 1 pods running and ready, expect: 3
Jul 4 03:57:13.358: INFO: Got 1 pods running and ready, expect: 3
Jul 4 03:57:15.362: INFO: Got 2 pods running and ready, expect: 3
Jul 4 03:57:17.359: INFO: Got 2 pods running and ready, expect: 3
Jul 4 03:57:19.357: INFO: 'kube-controller-manager' controller pod is up and ready within 10m0s seconds
STEP: Enable CSI migration feature gates on kublets on k8s nodes
Jul 4 03:57:19.374: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
STEP: Cordoning of node: k8s-node-148-1656928247
STEP: Draining of node: k8s-node-148-1656928247
WARNING: ignoring DaemonSet-managed Pods: kube-system/kube-flannel-ds-kbxvd, kube-system/kube-proxy-q9t45, vmware-system-csi/vsphere-csi-node-jkxkm; deleting Pods that declare no controller: vcp-2-csi-attach-detach-2888/pvc-tester-vxbpn
evicting pod vcp-2-csi-attach-detach-2888/pvc-tester-vxbpn
STEP: Modifying feature gates in kubelet config yaml of node: k8s-node-148-1656928247
Jul 4 03:57:19.498: INFO: Invoking command 'grep CSIMigration /var/lib/kubelet/config.yaml' on host 10.185.38.32
Jul 4 03:57:20.409: INFO: host: 10.185.38.32, command: grep CSIMigration /var/lib/kubelet/config.yaml, return code: 1, stdout: , stderr:
Jul 4 03:57:20.410: INFO: Invoking command 'echo "featureGates:
{
"CSIMigration": true,
"CSIMigrationvSphere": true
}" >>/var/lib/kubelet/config.yaml' on host 10.185.38.32
Jul 4 03:57:21.092: INFO: host: 10.185.38.32, command: echo "featureGates:
{
"CSIMigration": true,
"CSIMigrationvSphere": true
}" >>/var/lib/kubelet/config.yaml, return code: 0, stdout: , stderr:
Jul 4 03:57:21.092: INFO: Invoking command 'systemctl daemon-reload && systemctl restart kubelet' on host 10.185.38.32
Jul 4 03:57:22.440: INFO: host: 10.185.38.32, command: systemctl daemon-reload && systemctl restart kubelet, return code: 0, stdout: , stderr:
STEP: Wait for feature gates update on the k8s CSI node: k8s-node-148-1656928247
Jul 4 03:57:22.450: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
Jul 4 03:57:32.464: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
STEP: Uncordoning of node: k8s-node-148-1656928247
Jul 4 03:57:32.501: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
STEP: Cordoning of node: k8s-node-236-1656928234
STEP: Draining of node: k8s-node-236-1656928234
WARNING: ignoring DaemonSet-managed Pods: kube-system/kube-flannel-ds-jtklh, kube-system/kube-proxy-wtp4g, vmware-system-csi/vsphere-csi-node-8rswp
STEP: Modifying feature gates in kubelet config yaml of node: k8s-node-236-1656928234
Jul 4 03:57:32.588: INFO: Invoking command 'grep CSIMigration /var/lib/kubelet/config.yaml' on host 10.185.33.157
Jul 4 03:57:34.051: INFO: host: 10.185.33.157, command: grep CSIMigration /var/lib/kubelet/config.yaml, return code: 1, stdout: , stderr:
Jul 4 03:57:34.051: INFO: Invoking command 'echo "featureGates:
{
"CSIMigration": true,
"CSIMigrationvSphere": true
}" >>/var/lib/kubelet/config.yaml' on host 10.185.33.157
Jul 4 03:57:34.913: INFO: host: 10.185.33.157, command: echo "featureGates:
{
"CSIMigration": true,
"CSIMigrationvSphere": true
}" >>/var/lib/kubelet/config.yaml, return code: 0, stdout: , stderr:
Jul 4 03:57:34.913: INFO: Invoking command 'systemctl daemon-reload && systemctl restart kubelet' on host 10.185.33.157
Jul 4 03:57:36.464: INFO: host: 10.185.33.157, command: systemctl daemon-reload && systemctl restart kubelet, return code: 0, stdout: , stderr:
STEP: Wait for feature gates update on the k8s CSI node: k8s-node-236-1656928234
Jul 4 03:57:36.485: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
Jul 4 03:57:46.501: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
STEP: Uncordoning of node: k8s-node-236-1656928234
Jul 4 03:57:46.540: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
STEP: Cordoning of node: k8s-node-990-1656928220
STEP: Draining of node: k8s-node-990-1656928220
WARNING: ignoring DaemonSet-managed Pods: kube-system/kube-flannel-ds-jv5wm, kube-system/kube-proxy-62sc9, vmware-system-csi/vsphere-csi-node-xzpc9
STEP: Modifying feature gates in kubelet config yaml of node: k8s-node-990-1656928220
Jul 4 03:57:46.639: INFO: Invoking command 'grep CSIMigration /var/lib/kubelet/config.yaml' on host 10.185.35.185
Jul 4 03:57:47.844: INFO: host: 10.185.35.185, command: grep CSIMigration /var/lib/kubelet/config.yaml, return code: 1, stdout: , stderr:
Jul 4 03:57:47.844: INFO: Invoking command 'echo "featureGates:
{
"CSIMigration": true,
"CSIMigrationvSphere": true
}" >>/var/lib/kubelet/config.yaml' on host 10.185.35.185
Jul 4 03:57:48.518: INFO: host: 10.185.35.185, command: echo "featureGates:
{
"CSIMigration": true,
"CSIMigrationvSphere": true
}" >>/var/lib/kubelet/config.yaml, return code: 0, stdout: , stderr:
Jul 4 03:57:48.518: INFO: Invoking command 'systemctl daemon-reload && systemctl restart kubelet' on host 10.185.35.185
Jul 4 03:57:49.958: INFO: host: 10.185.35.185, command: systemctl daemon-reload && systemctl restart kubelet, return code: 0, stdout: , stderr:
STEP: Wait for feature gates update on the k8s CSI node: k8s-node-990-1656928220
Jul 4 03:57:49.968: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
Jul 4 03:57:59.986: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
STEP: Uncordoning of node: k8s-node-990-1656928220
Jul 4 03:58:00.038: INFO: Waiting up to 10m0s for all pods (need at least 0) in namespace 'vcp-2-csi-attach-detach-2888' to be running and ready
Jul 4 03:58:00.068: INFO: 0 / 0 pods in namespace 'vcp-2-csi-attach-detach-2888' are running and ready (0 seconds elapsed)
Jul 4 03:58:00.068: INFO: expected 0 pod replicas in namespace 'vcp-2-csi-attach-detach-2888', 0 are Running and Ready.
STEP: Waiting for migration related annotations on PV/PVCs created before migration
Jul 4 03:58:00.069: INFO: Checking PVC pvc-rvbp6
Jul 4 03:58:00.075: INFO: Annotations found on PVC: pvc-rvbp6 in namespace:vcp-2-csi-attach-detach-2888 are,
(map[string]string) (len=5) {
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 03:58:00.075: INFO: Checking PV pvc-df133b7b-e8b4-4f54-92d8-87d5f892d2a0
Jul 4 03:58:00.081: INFO: Annotations found on PV: pvc-df133b7b-e8b4-4f54-92d8-87d5f892d2a0 are,
(map[string]string) (len=4) {
(string) (len=23) "kubernetes.io/createdby": (string) (len=34) "vsphere-volume-dynamic-provisioner",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=31) "pv.kubernetes.io/provisioned-by": (string) (len=28) "kubernetes.io/vsphere-volume"
}
STEP: Verify CnsVSphereVolumeMigration crds and CNS volume metadata on pvc created before migration
Jul 4 03:58:00.081: INFO: Checking PVC pvc-rvbp6
Jul 4 03:58:00.094: INFO: Processing PVC: pvc-rvbp6
Jul 4 03:58:00.560: INFO: Found CNS volume with id 49a679ff-64f1-465b-a01c-f791e90952d4
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "49a679ff-64f1-465b-a01c-f791e90952d4"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "1629026e-fb88-11ec-8a4e-527b6bf8b324",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=2 cap=2) {
(*types.CnsKubernetesEntityMetadata)(0xc000df4300)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-df133b7b-e8b4-4f54-92d8-87d5f892d2a0",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc000df4400)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-rvbp6",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=28) "vcp-2-csi-attach-detach-2888",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-df133b7b-e8b4-4f54-92d8-87d5f892d2a0",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc001674e40)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "49a679ff-64f1-465b-a01c-f791e90952d4",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "6bc7c262-3407-dc08-0c9c-02008803ef9f"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 03:58:00.560: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:false
STEP: Stopping vsan-health on the vCenter
Jul 4 03:58:00.560: INFO: Invoking command service-control --stop vsan-health on vCenter host 10.185.39.37:22
Jul 4 03:58:11.417: INFO: Invoking command service-control --status vsan-health on vCenter host 10.185.39.37:22
Jul 4 03:58:12.176: INFO: ssh root@10.185.39.37:22: command: service-control --status vsan-health
Jul 4 03:58:12.176: INFO: ssh root@10.185.39.37:22: stdout: "Stopped:\n vsan-health\n"
Jul 4 03:58:12.176: INFO: ssh root@10.185.39.37:22: stderr: ""
Jul 4 03:58:12.176: INFO: ssh root@10.185.39.37:22: exit code: 0
Jul 4 03:58:12.176: INFO: Found service vsan-health in Stopped state
STEP: Creating pod
STEP: Till the Service is down , verify that POD is not in running state
STEP: Starting vsan-health on the vCenter
Jul 4 03:59:12.234: INFO: Invoking command service-control --start vsan-health on vCenter host 10.185.39.37:22
Jul 4 03:59:23.778: INFO: Invoking command service-control --status vsan-health on vCenter host 10.185.39.37:22
Jul 4 03:59:25.849: INFO: ssh root@10.185.39.37:22: command: service-control --status vsan-health
Jul 4 03:59:25.849: INFO: ssh root@10.185.39.37:22: stdout: "Running:\n vsan-health\n"
Jul 4 03:59:25.849: INFO: ssh root@10.185.39.37:22: stderr: ""
Jul 4 03:59:25.849: INFO: ssh root@10.185.39.37:22: exit code: 0
Jul 4 03:59:25.849: INFO: Found service vsan-health in Running state
STEP: wait for some time and make sure POD is created and it is in running state
Jul 4 03:59:25.866: INFO: The status of Pod pvc-tester-gv94r is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:59:27.879: INFO: The status of Pod pvc-tester-gv94r is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:59:29.880: INFO: The status of Pod pvc-tester-gv94r is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:59:31.879: INFO: The status of Pod pvc-tester-gv94r is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:59:33.877: INFO: The status of Pod pvc-tester-gv94r is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:59:35.876: INFO: The status of Pod pvc-tester-gv94r is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:59:37.880: INFO: The status of Pod pvc-tester-gv94r is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:59:39.887: INFO: The status of Pod pvc-tester-gv94r is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:59:41.876: INFO: The status of Pod pvc-tester-gv94r is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:59:43.887: INFO: The status of Pod pvc-tester-gv94r is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:59:45.876: INFO: The status of Pod pvc-tester-gv94r is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:59:47.877: INFO: The status of Pod pvc-tester-gv94r is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:59:49.879: INFO: The status of Pod pvc-tester-gv94r is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:59:51.876: INFO: The status of Pod pvc-tester-gv94r is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:59:53.880: INFO: The status of Pod pvc-tester-gv94r is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:59:55.877: INFO: The status of Pod pvc-tester-gv94r is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:59:57.883: INFO: The status of Pod pvc-tester-gv94r is Pending, waiting for it to be Running (with Ready = true)
Jul 4 03:59:59.877: INFO: The status of Pod pvc-tester-gv94r is Pending, waiting for it to be Running (with Ready = true)
Jul 4 04:00:01.879: INFO: The status of Pod pvc-tester-gv94r is Pending, waiting for it to be Running (with Ready = true)
Jul 4 04:00:03.884: INFO: The status of Pod pvc-tester-gv94r is Pending, waiting for it to be Running (with Ready = true)
Jul 4 04:00:05.880: INFO: The status of Pod pvc-tester-gv94r is Pending, waiting for it to be Running (with Ready = true)
Jul 4 04:00:07.881: INFO: The status of Pod pvc-tester-gv94r is Pending, waiting for it to be Running (with Ready = true)
Jul 4 04:00:09.891: INFO: The status of Pod pvc-tester-gv94r is Pending, waiting for it to be Running (with Ready = true)
Jul 4 04:00:11.878: INFO: The status of Pod pvc-tester-gv94r is Pending, waiting for it to be Running (with Ready = true)
Jul 4 04:00:13.879: INFO: The status of Pod pvc-tester-gv94r is Pending, waiting for it to be Running (with Ready = true)
Jul 4 04:00:15.877: INFO: The status of Pod pvc-tester-gv94r is Pending, waiting for it to be Running (with Ready = true)
Jul 4 04:00:17.880: INFO: The status of Pod pvc-tester-gv94r is Pending, waiting for it to be Running (with Ready = true)
Jul 4 04:00:19.878: INFO: The status of Pod pvc-tester-gv94r is Pending, waiting for it to be Running (with Ready = true)
Jul 4 04:00:21.879: INFO: The status of Pod pvc-tester-gv94r is Pending, waiting for it to be Running (with Ready = true)
Jul 4 04:00:23.877: INFO: The status of Pod pvc-tester-gv94r is Pending, waiting for it to be Running (with Ready = true)
Jul 4 04:00:25.878: INFO: The status of Pod pvc-tester-gv94r is Pending, waiting for it to be Running (with Ready = true)
Jul 4 04:00:27.878: INFO: The status of Pod pvc-tester-gv94r is Pending, waiting for it to be Running (with Ready = true)
Jul 4 04:00:29.878: INFO: The status of Pod pvc-tester-gv94r is Pending, waiting for it to be Running (with Ready = true)
Jul 4 04:00:31.875: INFO: The status of Pod pvc-tester-gv94r is Pending, waiting for it to be Running (with Ready = true)
Jul 4 04:00:33.877: INFO: The status of Pod pvc-tester-gv94r is Running (Ready = true)
[JustAfterEach] [csi-vcp-mig] VCP to CSI migration attach, detach tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_attach_detach.go:101
Jul 4 04:00:33.896: INFO: Deleting pod: pvc-tester-gv94r
Jul 4 04:00:34.004: INFO: Verify volume 49a679ff-64f1-465b-a01c-f791e90952d4 is detached from the node: k8s-node-990-1656928220
STEP: VM UUID is: 42012696-a5ac-0b47-440b-883314beee49 for node: k8s-node-990-1656928220
Jul 4 04:00:36.046: INFO: vmRef: VirtualMachine:vm-53 for the VM uuid: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 04:00:36.055: INFO: Found FCDID "49a679ff-64f1-465b-a01c-f791e90952d4" attached to VM "k8s-worker1"
Jul 4 04:00:36.055: INFO: Found the disk "49a679ff-64f1-465b-a01c-f791e90952d4" is attached to the VM with UUID: "42012696-a5ac-0b47-440b-883314beee49"
Jul 4 04:00:36.055: INFO: Waiting for disk: "49a679ff-64f1-465b-a01c-f791e90952d4" to be detached from the node :"k8s-node-990-1656928220"
STEP: VM UUID is: 42012696-a5ac-0b47-440b-883314beee49 for node: k8s-node-990-1656928220
Jul 4 04:00:38.036: INFO: vmRef: VirtualMachine:vm-53 for the VM uuid: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 04:00:38.041: INFO: Found FCDID "49a679ff-64f1-465b-a01c-f791e90952d4" attached to VM "k8s-worker1"
Jul 4 04:00:38.041: INFO: Found the disk "49a679ff-64f1-465b-a01c-f791e90952d4" is attached to the VM with UUID: "42012696-a5ac-0b47-440b-883314beee49"
Jul 4 04:00:38.041: INFO: Waiting for disk: "49a679ff-64f1-465b-a01c-f791e90952d4" to be detached from the node :"k8s-node-990-1656928220"
STEP: VM UUID is: 42012696-a5ac-0b47-440b-883314beee49 for node: k8s-node-990-1656928220
Jul 4 04:00:40.040: INFO: vmRef: VirtualMachine:vm-53 for the VM uuid: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 04:00:40.047: INFO: Found FCDID "49a679ff-64f1-465b-a01c-f791e90952d4" attached to VM "k8s-worker1"
Jul 4 04:00:40.047: INFO: Found the disk "49a679ff-64f1-465b-a01c-f791e90952d4" is attached to the VM with UUID: "42012696-a5ac-0b47-440b-883314beee49"
Jul 4 04:00:40.047: INFO: Waiting for disk: "49a679ff-64f1-465b-a01c-f791e90952d4" to be detached from the node :"k8s-node-990-1656928220"
STEP: VM UUID is: 42012696-a5ac-0b47-440b-883314beee49 for node: k8s-node-990-1656928220
Jul 4 04:00:42.041: INFO: vmRef: VirtualMachine:vm-53 for the VM uuid: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 04:00:42.048: INFO: Found FCDID "49a679ff-64f1-465b-a01c-f791e90952d4" attached to VM "k8s-worker1"
Jul 4 04:00:42.048: INFO: Found the disk "49a679ff-64f1-465b-a01c-f791e90952d4" is attached to the VM with UUID: "42012696-a5ac-0b47-440b-883314beee49"
Jul 4 04:00:42.048: INFO: Waiting for disk: "49a679ff-64f1-465b-a01c-f791e90952d4" to be detached from the node :"k8s-node-990-1656928220"
STEP: VM UUID is: 42012696-a5ac-0b47-440b-883314beee49 for node: k8s-node-990-1656928220
Jul 4 04:00:44.044: INFO: vmRef: VirtualMachine:vm-53 for the VM uuid: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 04:00:44.050: INFO: Found FCDID "49a679ff-64f1-465b-a01c-f791e90952d4" attached to VM "k8s-worker1"
Jul 4 04:00:44.051: INFO: Found the disk "49a679ff-64f1-465b-a01c-f791e90952d4" is attached to the VM with UUID: "42012696-a5ac-0b47-440b-883314beee49"
Jul 4 04:00:44.051: INFO: Waiting for disk: "49a679ff-64f1-465b-a01c-f791e90952d4" to be detached from the node :"k8s-node-990-1656928220"
STEP: VM UUID is: 42012696-a5ac-0b47-440b-883314beee49 for node: k8s-node-990-1656928220
Jul 4 04:00:46.035: INFO: vmRef: VirtualMachine:vm-53 for the VM uuid: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 04:00:46.041: INFO: Found FCDID "49a679ff-64f1-465b-a01c-f791e90952d4" attached to VM "k8s-worker1"
Jul 4 04:00:46.041: INFO: Found the disk "49a679ff-64f1-465b-a01c-f791e90952d4" is attached to the VM with UUID: "42012696-a5ac-0b47-440b-883314beee49"
Jul 4 04:00:46.041: INFO: Waiting for disk: "49a679ff-64f1-465b-a01c-f791e90952d4" to be detached from the node :"k8s-node-990-1656928220"
STEP: VM UUID is: 42012696-a5ac-0b47-440b-883314beee49 for node: k8s-node-990-1656928220
Jul 4 04:00:48.035: INFO: vmRef: VirtualMachine:vm-53 for the VM uuid: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 04:00:48.041: INFO: Found FCDID "49a679ff-64f1-465b-a01c-f791e90952d4" attached to VM "k8s-worker1"
Jul 4 04:00:48.041: INFO: Found the disk "49a679ff-64f1-465b-a01c-f791e90952d4" is attached to the VM with UUID: "42012696-a5ac-0b47-440b-883314beee49"
Jul 4 04:00:48.041: INFO: Waiting for disk: "49a679ff-64f1-465b-a01c-f791e90952d4" to be detached from the node :"k8s-node-990-1656928220"
STEP: VM UUID is: 42012696-a5ac-0b47-440b-883314beee49 for node: k8s-node-990-1656928220
Jul 4 04:00:50.034: INFO: vmRef: VirtualMachine:vm-53 for the VM uuid: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 04:00:50.039: INFO: Found FCDID "49a679ff-64f1-465b-a01c-f791e90952d4" attached to VM "k8s-worker1"
Jul 4 04:00:50.039: INFO: Found the disk "49a679ff-64f1-465b-a01c-f791e90952d4" is attached to the VM with UUID: "42012696-a5ac-0b47-440b-883314beee49"
Jul 4 04:00:50.039: INFO: Waiting for disk: "49a679ff-64f1-465b-a01c-f791e90952d4" to be detached from the node :"k8s-node-990-1656928220"
STEP: VM UUID is: 42012696-a5ac-0b47-440b-883314beee49 for node: k8s-node-990-1656928220
Jul 4 04:00:52.037: INFO: vmRef: VirtualMachine:vm-53 for the VM uuid: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 04:00:52.045: INFO: Found FCDID "49a679ff-64f1-465b-a01c-f791e90952d4" attached to VM "k8s-worker1"
Jul 4 04:00:52.045: INFO: Found the disk "49a679ff-64f1-465b-a01c-f791e90952d4" is attached to the VM with UUID: "42012696-a5ac-0b47-440b-883314beee49"
Jul 4 04:00:52.045: INFO: Waiting for disk: "49a679ff-64f1-465b-a01c-f791e90952d4" to be detached from the node :"k8s-node-990-1656928220"
STEP: VM UUID is: 42012696-a5ac-0b47-440b-883314beee49 for node: k8s-node-990-1656928220
Jul 4 04:00:54.044: INFO: vmRef: VirtualMachine:vm-53 for the VM uuid: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 04:00:54.054: INFO: Found FCDID "49a679ff-64f1-465b-a01c-f791e90952d4" attached to VM "k8s-worker1"
Jul 4 04:00:54.054: INFO: Found the disk "49a679ff-64f1-465b-a01c-f791e90952d4" is attached to the VM with UUID: "42012696-a5ac-0b47-440b-883314beee49"
Jul 4 04:00:54.054: INFO: Waiting for disk: "49a679ff-64f1-465b-a01c-f791e90952d4" to be detached from the node :"k8s-node-990-1656928220"
STEP: VM UUID is: 42012696-a5ac-0b47-440b-883314beee49 for node: k8s-node-990-1656928220
Jul 4 04:00:56.041: INFO: vmRef: VirtualMachine:vm-53 for the VM uuid: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 04:00:56.048: INFO: Found FCDID "49a679ff-64f1-465b-a01c-f791e90952d4" attached to VM "k8s-worker1"
Jul 4 04:00:56.048: INFO: Found the disk "49a679ff-64f1-465b-a01c-f791e90952d4" is attached to the VM with UUID: "42012696-a5ac-0b47-440b-883314beee49"
Jul 4 04:00:56.048: INFO: Waiting for disk: "49a679ff-64f1-465b-a01c-f791e90952d4" to be detached from the node :"k8s-node-990-1656928220"
STEP: VM UUID is: 42012696-a5ac-0b47-440b-883314beee49 for node: k8s-node-990-1656928220
Jul 4 04:00:58.054: INFO: vmRef: VirtualMachine:vm-53 for the VM uuid: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 04:00:58.061: INFO: Found FCDID "49a679ff-64f1-465b-a01c-f791e90952d4" attached to VM "k8s-worker1"
Jul 4 04:00:58.061: INFO: Found the disk "49a679ff-64f1-465b-a01c-f791e90952d4" is attached to the VM with UUID: "42012696-a5ac-0b47-440b-883314beee49"
Jul 4 04:00:58.061: INFO: Waiting for disk: "49a679ff-64f1-465b-a01c-f791e90952d4" to be detached from the node :"k8s-node-990-1656928220"
STEP: VM UUID is: 42012696-a5ac-0b47-440b-883314beee49 for node: k8s-node-990-1656928220
Jul 4 04:01:00.041: INFO: vmRef: VirtualMachine:vm-53 for the VM uuid: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 04:01:00.049: INFO: Found FCDID "49a679ff-64f1-465b-a01c-f791e90952d4" attached to VM "k8s-worker1"
Jul 4 04:01:00.049: INFO: Found the disk "49a679ff-64f1-465b-a01c-f791e90952d4" is attached to the VM with UUID: "42012696-a5ac-0b47-440b-883314beee49"
Jul 4 04:01:00.049: INFO: Waiting for disk: "49a679ff-64f1-465b-a01c-f791e90952d4" to be detached from the node :"k8s-node-990-1656928220"
STEP: VM UUID is: 42012696-a5ac-0b47-440b-883314beee49 for node: k8s-node-990-1656928220
Jul 4 04:01:02.036: INFO: vmRef: VirtualMachine:vm-53 for the VM uuid: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 04:01:02.043: INFO: Found FCDID "49a679ff-64f1-465b-a01c-f791e90952d4" attached to VM "k8s-worker1"
Jul 4 04:01:02.043: INFO: Found the disk "49a679ff-64f1-465b-a01c-f791e90952d4" is attached to the VM with UUID: "42012696-a5ac-0b47-440b-883314beee49"
Jul 4 04:01:02.043: INFO: Waiting for disk: "49a679ff-64f1-465b-a01c-f791e90952d4" to be detached from the node :"k8s-node-990-1656928220"
STEP: VM UUID is: 42012696-a5ac-0b47-440b-883314beee49 for node: k8s-node-990-1656928220
Jul 4 04:01:04.033: INFO: vmRef: VirtualMachine:vm-53 for the VM uuid: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 04:01:04.041: INFO: Found FCDID "49a679ff-64f1-465b-a01c-f791e90952d4" attached to VM "k8s-worker1"
Jul 4 04:01:04.041: INFO: Found the disk "49a679ff-64f1-465b-a01c-f791e90952d4" is attached to the VM with UUID: "42012696-a5ac-0b47-440b-883314beee49"
Jul 4 04:01:04.041: INFO: Waiting for disk: "49a679ff-64f1-465b-a01c-f791e90952d4" to be detached from the node :"k8s-node-990-1656928220"
STEP: VM UUID is: 42012696-a5ac-0b47-440b-883314beee49 for node: k8s-node-990-1656928220
Jul 4 04:01:06.033: INFO: vmRef: VirtualMachine:vm-53 for the VM uuid: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 04:01:06.038: INFO: Found FCDID "49a679ff-64f1-465b-a01c-f791e90952d4" attached to VM "k8s-worker1"
Jul 4 04:01:06.038: INFO: Found the disk "49a679ff-64f1-465b-a01c-f791e90952d4" is attached to the VM with UUID: "42012696-a5ac-0b47-440b-883314beee49"
Jul 4 04:01:06.038: INFO: Waiting for disk: "49a679ff-64f1-465b-a01c-f791e90952d4" to be detached from the node :"k8s-node-990-1656928220"
STEP: VM UUID is: 42012696-a5ac-0b47-440b-883314beee49 for node: k8s-node-990-1656928220
Jul 4 04:01:08.037: INFO: vmRef: VirtualMachine:vm-53 for the VM uuid: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 04:01:08.042: INFO: Found FCDID "49a679ff-64f1-465b-a01c-f791e90952d4" attached to VM "k8s-worker1"
Jul 4 04:01:08.042: INFO: Found the disk "49a679ff-64f1-465b-a01c-f791e90952d4" is attached to the VM with UUID: "42012696-a5ac-0b47-440b-883314beee49"
Jul 4 04:01:08.042: INFO: Waiting for disk: "49a679ff-64f1-465b-a01c-f791e90952d4" to be detached from the node :"k8s-node-990-1656928220"
STEP: VM UUID is: 42012696-a5ac-0b47-440b-883314beee49 for node: k8s-node-990-1656928220
Jul 4 04:01:10.035: INFO: vmRef: VirtualMachine:vm-53 for the VM uuid: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 04:01:10.039: INFO: Found FCDID "49a679ff-64f1-465b-a01c-f791e90952d4" attached to VM "k8s-worker1"
Jul 4 04:01:10.039: INFO: Found the disk "49a679ff-64f1-465b-a01c-f791e90952d4" is attached to the VM with UUID: "42012696-a5ac-0b47-440b-883314beee49"
Jul 4 04:01:10.039: INFO: Waiting for disk: "49a679ff-64f1-465b-a01c-f791e90952d4" to be detached from the node :"k8s-node-990-1656928220"
STEP: VM UUID is: 42012696-a5ac-0b47-440b-883314beee49 for node: k8s-node-990-1656928220
Jul 4 04:01:12.040: INFO: vmRef: VirtualMachine:vm-53 for the VM uuid: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 04:01:12.047: INFO: Found FCDID "49a679ff-64f1-465b-a01c-f791e90952d4" attached to VM "k8s-worker1"
Jul 4 04:01:12.047: INFO: Found the disk "49a679ff-64f1-465b-a01c-f791e90952d4" is attached to the VM with UUID: "42012696-a5ac-0b47-440b-883314beee49"
Jul 4 04:01:12.047: INFO: Waiting for disk: "49a679ff-64f1-465b-a01c-f791e90952d4" to be detached from the node :"k8s-node-990-1656928220"
STEP: VM UUID is: 42012696-a5ac-0b47-440b-883314beee49 for node: k8s-node-990-1656928220
Jul 4 04:01:14.043: INFO: vmRef: VirtualMachine:vm-53 for the VM uuid: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 04:01:14.049: INFO: Found FCDID "49a679ff-64f1-465b-a01c-f791e90952d4" attached to VM "k8s-worker1"
Jul 4 04:01:14.049: INFO: Found the disk "49a679ff-64f1-465b-a01c-f791e90952d4" is attached to the VM with UUID: "42012696-a5ac-0b47-440b-883314beee49"
Jul 4 04:01:14.049: INFO: Waiting for disk: "49a679ff-64f1-465b-a01c-f791e90952d4" to be detached from the node :"k8s-node-990-1656928220"
STEP: VM UUID is: 42012696-a5ac-0b47-440b-883314beee49 for node: k8s-node-990-1656928220
Jul 4 04:01:16.041: INFO: vmRef: VirtualMachine:vm-53 for the VM uuid: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 04:01:16.048: INFO: failed to find FCDID "49a679ff-64f1-465b-a01c-f791e90952d4" attached to VM "k8s-worker1"
Jul 4 04:01:16.048: INFO: Disk: 49a679ff-64f1-465b-a01c-f791e90952d4 successfully detached
STEP: Disable CSI migration feature gates on kublets on k8s nodes
Jul 4 04:01:16.089: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
STEP: Cordoning of node: k8s-node-148-1656928247
STEP: Draining of node: k8s-node-148-1656928247
WARNING: ignoring DaemonSet-managed Pods: kube-system/kube-flannel-ds-kbxvd, kube-system/kube-proxy-q9t45, vmware-system-csi/vsphere-csi-node-jkxkm
STEP: Modifying feature gates in kubelet config yaml of node: k8s-node-148-1656928247
Jul 4 04:01:16.168: INFO: Invoking command 'grep CSIMigration /var/lib/kubelet/config.yaml' on host 10.185.38.32
Jul 4 04:01:17.380: INFO: host: 10.185.38.32, command: grep CSIMigration /var/lib/kubelet/config.yaml, return code: 0, stdout: CSIMigration: true,
CSIMigrationvSphere: true
, stderr:
Jul 4 04:01:17.380: INFO: Invoking command 'head -n -5 /var/lib/kubelet/config.yaml > tmp.txt && mv tmp.txt /var/lib/kubelet/config.yaml' on host 10.185.38.32
Jul 4 04:01:18.093: INFO: host: 10.185.38.32, command: head -n -5 /var/lib/kubelet/config.yaml > tmp.txt && mv tmp.txt /var/lib/kubelet/config.yaml, return code: 0, stdout: , stderr:
Jul 4 04:01:18.093: INFO: Invoking command 'systemctl daemon-reload && systemctl restart kubelet' on host 10.185.38.32
Jul 4 04:01:19.492: INFO: host: 10.185.38.32, command: systemctl daemon-reload && systemctl restart kubelet, return code: 0, stdout: , stderr:
STEP: Wait for feature gates update on the k8s CSI node: k8s-node-148-1656928247
Jul 4 04:01:19.505: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
Jul 4 04:01:29.524: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
STEP: Uncordoning of node: k8s-node-148-1656928247
Jul 4 04:01:29.561: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
STEP: Cordoning of node: k8s-node-236-1656928234
STEP: Draining of node: k8s-node-236-1656928234
WARNING: ignoring DaemonSet-managed Pods: kube-system/kube-flannel-ds-jtklh, kube-system/kube-proxy-wtp4g, vmware-system-csi/vsphere-csi-node-8rswp
STEP: Modifying feature gates in kubelet config yaml of node: k8s-node-236-1656928234
Jul 4 04:01:29.655: INFO: Invoking command 'grep CSIMigration /var/lib/kubelet/config.yaml' on host 10.185.33.157
Jul 4 04:01:30.925: INFO: host: 10.185.33.157, command: grep CSIMigration /var/lib/kubelet/config.yaml, return code: 0, stdout: CSIMigration: true,
CSIMigrationvSphere: true
, stderr:
Jul 4 04:01:30.925: INFO: Invoking command 'head -n -5 /var/lib/kubelet/config.yaml > tmp.txt && mv tmp.txt /var/lib/kubelet/config.yaml' on host 10.185.33.157
Jul 4 04:01:31.676: INFO: host: 10.185.33.157, command: head -n -5 /var/lib/kubelet/config.yaml > tmp.txt && mv tmp.txt /var/lib/kubelet/config.yaml, return code: 0, stdout: , stderr:
Jul 4 04:01:31.676: INFO: Invoking command 'systemctl daemon-reload && systemctl restart kubelet' on host 10.185.33.157
Jul 4 04:01:33.049: INFO: host: 10.185.33.157, command: systemctl daemon-reload && systemctl restart kubelet, return code: 0, stdout: , stderr:
STEP: Wait for feature gates update on the k8s CSI node: k8s-node-236-1656928234
Jul 4 04:01:33.060: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
Jul 4 04:01:43.075: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
STEP: Uncordoning of node: k8s-node-236-1656928234
Jul 4 04:01:43.111: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
STEP: Cordoning of node: k8s-node-990-1656928220
STEP: Draining of node: k8s-node-990-1656928220
WARNING: ignoring DaemonSet-managed Pods: kube-system/kube-flannel-ds-jv5wm, kube-system/kube-proxy-62sc9, vmware-system-csi/vsphere-csi-node-xzpc9
STEP: Modifying feature gates in kubelet config yaml of node: k8s-node-990-1656928220
Jul 4 04:01:43.206: INFO: Invoking command 'grep CSIMigration /var/lib/kubelet/config.yaml' on host 10.185.35.185
Jul 4 04:01:44.454: INFO: host: 10.185.35.185, command: grep CSIMigration /var/lib/kubelet/config.yaml, return code: 0, stdout: CSIMigration: true,
CSIMigrationvSphere: true
, stderr:
Jul 4 04:01:44.454: INFO: Invoking command 'head -n -5 /var/lib/kubelet/config.yaml > tmp.txt && mv tmp.txt /var/lib/kubelet/config.yaml' on host 10.185.35.185
Jul 4 04:01:45.152: INFO: host: 10.185.35.185, command: head -n -5 /var/lib/kubelet/config.yaml > tmp.txt && mv tmp.txt /var/lib/kubelet/config.yaml, return code: 0, stdout: , stderr:
Jul 4 04:01:45.152: INFO: Invoking command 'systemctl daemon-reload && systemctl restart kubelet' on host 10.185.35.185
Jul 4 04:01:46.572: INFO: host: 10.185.35.185, command: systemctl daemon-reload && systemctl restart kubelet, return code: 0, stdout: , stderr:
STEP: Wait for feature gates update on the k8s CSI node: k8s-node-990-1656928220
Jul 4 04:01:46.581: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
Jul 4 04:01:56.601: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
STEP: Uncordoning of node: k8s-node-990-1656928220
Jul 4 04:01:56.640: INFO: Waiting up to 10m0s for all pods (need at least 0) in namespace 'vcp-2-csi-attach-detach-2888' to be running and ready
Jul 4 04:01:56.684: INFO: 0 / 0 pods in namespace 'vcp-2-csi-attach-detach-2888' are running and ready (0 seconds elapsed)
Jul 4 04:01:56.684: INFO: expected 0 pod replicas in namespace 'vcp-2-csi-attach-detach-2888', 0 are Running and Ready.
Jul 4 04:01:56.728: INFO: Deleting PVC pvc-rvbp6
Jul 4 04:01:56.756: INFO: Looking for default datastore in DC: VSAN-DC
Jul 4 04:01:56.774: INFO: Datstore found for DS URL:ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/
Jul 4 04:01:56.982: INFO: Waiting for CnsVSphereVolumeMigration crd 49a679ff-64f1-465b-a01c-f791e90952d4 to be deleted
Jul 4 04:01:59.054: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.43.70
Jul 4 04:02:00.235: INFO: host: 10.185.43.70, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true
, stderr:
Jul 4 04:02:00.235: INFO: Invoking command sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.43.70
Jul 4 04:02:00.949: INFO: host: 10.185.43.70, command: sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 04:02:00.949: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.43.70
Jul 4 04:02:01.879: INFO: host: 10.185.43.70, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 04:02:01.880: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.45.237
Jul 4 04:02:02.944: INFO: host: 10.185.45.237, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true
, stderr:
Jul 4 04:02:02.944: INFO: Invoking command sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.45.237
Jul 4 04:02:03.675: INFO: host: 10.185.45.237, command: sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 04:02:03.676: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.45.237
Jul 4 04:02:04.486: INFO: host: 10.185.45.237, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 04:02:04.486: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.32.9
Jul 4 04:02:06.100: INFO: host: 10.185.32.9, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true
, stderr:
Jul 4 04:02:06.100: INFO: Invoking command sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.32.9
Jul 4 04:02:06.895: INFO: host: 10.185.32.9, command: sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 04:02:06.895: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.32.9
Jul 4 04:02:07.856: INFO: host: 10.185.32.9, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 04:02:09.857: INFO: Waiting for 'kube-controller-manager' controller pod to come up within 10m0s seconds
Jul 4 04:02:11.878: INFO: Got 1 pods running and ready, expect: 3
Jul 4 04:02:13.875: INFO: Got 1 pods running and ready, expect: 3
Jul 4 04:02:15.880: INFO: Got 1 pods running and ready, expect: 3
Jul 4 04:02:17.878: INFO: Got 1 pods running and ready, expect: 3
Jul 4 04:02:19.883: INFO: Got 1 pods running and ready, expect: 3
Jul 4 04:02:21.878: INFO: Got 2 pods running and ready, expect: 3
Jul 4 04:02:23.882: INFO: Got 2 pods running and ready, expect: 3
Jul 4 04:02:25.878: INFO: Got 2 pods running and ready, expect: 3
Jul 4 04:02:27.881: INFO: Got 2 pods running and ready, expect: 3
Jul 4 04:02:29.877: INFO: 'kube-controller-manager' controller pod is up and ready within 10m0s seconds
[AfterEach] [csi-vcp-mig] VCP to CSI migration attach, detach tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/go/pkg/mod/k8s.io/kubernetes@v1.24.2/test/e2e/framework/framework.go:188
Jul 4 04:02:29.901: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "vcp-2-csi-attach-detach-2888" for this suite.
• [SLOW TEST:355.287 seconds]
[csi-vcp-mig] VCP to CSI migration attach, detach tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_attach_detach.go:42
Migration enabled - VSAN health is down
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_attach_detach.go:854
------------------------------
SSSSSS
------------------------------
[csi-vcp-mig] VCP to CSI migration syncer tests
Verify in-line volume creation on the migrated node
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_syncer.go:1026
[BeforeEach] [csi-vcp-mig] VCP to CSI migration syncer tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/go/pkg/mod/k8s.io/kubernetes@v1.24.2/test/e2e/framework/framework.go:187
STEP: Creating a kubernetes client
Jul 4 04:02:29.923: INFO: >>> kubeConfig: /home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config
STEP: Building a namespace api object, basename vcp-2-csi-syncer
STEP: Waiting for a default service account to be provisioned in namespace
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[BeforeEach] [csi-vcp-mig] VCP to CSI migration syncer tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_syncer.go:78
Jul 4 04:02:31.858: INFO: Search candidates vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 04:02:31.858: INFO: Searching for node with UUID: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 04:02:31.858: INFO: Searching for node with UUID: 42019292-0601-e6cc-cf83-9e7ad2ff1147
Jul 4 04:02:31.858: INFO: Searching for node with UUID: 42019a83-8fab-0ed3-6745-5980c88e61be
Jul 4 04:02:31.858: INFO: Searching for node with UUID: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 04:02:31.858: INFO: Searching for node with UUID: 4201f777-84d8-9463-c37d-868274d333cb
Jul 4 04:02:31.858: INFO: Searching for node with UUID: 4201c124-84e2-596b-a670-ef0e99be85a5
Jul 4 04:02:32.682: INFO: Found node k8s-control-292-1656928177 as vm=VirtualMachine:vm-50 placed on host=HostSystem:host-22 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 04:02:32.825: INFO: Found node k8s-node-990-1656928220 as vm=VirtualMachine:vm-53 placed on host=HostSystem:host-16 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 04:02:33.112: INFO: Found node k8s-node-236-1656928234 as vm=VirtualMachine:vm-52 placed on host=HostSystem:host-34 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 04:02:33.158: INFO: Found node k8s-control-280-1656928192 as vm=VirtualMachine:vm-54 placed on host=HostSystem:host-28 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 04:02:33.166: INFO: Found node k8s-control-468-1656928206 as vm=VirtualMachine:vm-55 placed on host=HostSystem:host-34 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 04:02:33.168: INFO: Found node k8s-node-148-1656928247 as vm=VirtualMachine:vm-51 placed on host=HostSystem:host-28 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 04:02:33.193: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
Jul 4 04:02:33.212: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
Jul 4 04:02:33.220: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
Jul 4 04:02:33.226: INFO: Waiting up to 10m0s for all pods (need at least 0) in namespace 'vcp-2-csi-syncer-5429' to be running and ready
Jul 4 04:02:33.247: INFO: 0 / 0 pods in namespace 'vcp-2-csi-syncer-5429' are running and ready (0 seconds elapsed)
Jul 4 04:02:33.247: INFO: expected 0 pod replicas in namespace 'vcp-2-csi-syncer-5429', 0 are Running and Ready.
Jul 4 04:02:33.255: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.43.70
Jul 4 04:02:34.137: INFO: host: 10.185.43.70, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 1, stdout: , stderr:
[It] Verify in-line volume creation on the migrated node
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_syncer.go:1026
STEP: Creating VCP SC
STEP: Creating StorageClass with scParameters: map[datastore:vsanDatastore] and zones: [] and ReclaimPolicy: and allowVolumeExpansion: false
STEP: Creating vmdk1 on the shared datastore vsanDatastore
Jul 4 04:02:34.153: INFO: Invoking command 'mkdir -p /vmfs/volumes/vsanDatastore/e2e' on ESX host 10.185.37.178
Jul 4 04:02:34.485: INFO: Invoking command 'vmkfstools -c 2g -d thin -W vsan /vmfs/volumes/vsanDatastore/e2e/test-1656932554485481755-90.vmdk' on ESX host 10.185.37.178
STEP: Enabling CSIMigration and CSIMigrationvSphere feature gates on kube-controller-manager
Jul 4 04:02:34.996: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.43.70
Jul 4 04:02:35.678: INFO: host: 10.185.43.70, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 1, stdout: , stderr:
Jul 4 04:02:35.678: INFO: Invoking command gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.43.70
Jul 4 04:02:36.372: INFO: host: 10.185.43.70, command: gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 04:02:36.373: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.43.70
Jul 4 04:02:37.190: INFO: host: 10.185.43.70, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 04:02:37.190: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.45.237
Jul 4 04:02:37.997: INFO: host: 10.185.45.237, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 1, stdout: , stderr:
Jul 4 04:02:37.997: INFO: Invoking command gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.45.237
Jul 4 04:02:38.693: INFO: host: 10.185.45.237, command: gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 04:02:38.693: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.45.237
Jul 4 04:02:39.469: INFO: host: 10.185.45.237, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 04:02:39.469: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.32.9
Jul 4 04:02:40.782: INFO: host: 10.185.32.9, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 1, stdout: , stderr:
Jul 4 04:02:40.782: INFO: Invoking command gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.32.9
Jul 4 04:02:41.592: INFO: host: 10.185.32.9, command: gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 04:02:41.593: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.32.9
Jul 4 04:02:42.559: INFO: host: 10.185.32.9, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 04:02:44.559: INFO: Waiting for 'kube-controller-manager' controller pod to come up within 10m0s seconds
Jul 4 04:02:46.575: INFO: Got 1 pods running and ready, expect: 3
Jul 4 04:02:48.574: INFO: Got 0 pods running and ready, expect: 3
Jul 4 04:02:50.584: INFO: Got 1 pods running and ready, expect: 3
Jul 4 04:02:52.585: INFO: Got 1 pods running and ready, expect: 3
Jul 4 04:02:54.583: INFO: Got 2 pods running and ready, expect: 3
Jul 4 04:02:56.577: INFO: Got 2 pods running and ready, expect: 3
Jul 4 04:02:58.577: INFO: Got 2 pods running and ready, expect: 3
Jul 4 04:03:00.577: INFO: 'kube-controller-manager' controller pod is up and ready within 10m0s seconds
STEP: Enable CSI migration feature gates on kublets on k8s nodes
Jul 4 04:03:00.591: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
STEP: Cordoning of node: k8s-node-148-1656928247
STEP: Draining of node: k8s-node-148-1656928247
WARNING: ignoring DaemonSet-managed Pods: kube-system/kube-flannel-ds-kbxvd, kube-system/kube-proxy-q9t45, vmware-system-csi/vsphere-csi-node-jkxkm
STEP: Modifying feature gates in kubelet config yaml of node: k8s-node-148-1656928247
Jul 4 04:03:00.656: INFO: Invoking command 'grep CSIMigration /var/lib/kubelet/config.yaml' on host 10.185.38.32
Jul 4 04:03:02.052: INFO: host: 10.185.38.32, command: grep CSIMigration /var/lib/kubelet/config.yaml, return code: 1, stdout: , stderr:
Jul 4 04:03:02.053: INFO: Invoking command 'echo "featureGates:
{
"CSIMigration": true,
"CSIMigrationvSphere": true
}" >>/var/lib/kubelet/config.yaml' on host 10.185.38.32
Jul 4 04:03:02.836: INFO: host: 10.185.38.32, command: echo "featureGates:
{
"CSIMigration": true,
"CSIMigrationvSphere": true
}" >>/var/lib/kubelet/config.yaml, return code: 0, stdout: , stderr:
Jul 4 04:03:02.836: INFO: Invoking command 'systemctl daemon-reload && systemctl restart kubelet' on host 10.185.38.32
Jul 4 04:03:04.334: INFO: host: 10.185.38.32, command: systemctl daemon-reload && systemctl restart kubelet, return code: 0, stdout: , stderr:
STEP: Wait for feature gates update on the k8s CSI node: k8s-node-148-1656928247
Jul 4 04:03:04.344: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
Jul 4 04:03:14.363: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
STEP: Uncordoning of node: k8s-node-148-1656928247
Jul 4 04:03:14.400: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
STEP: Cordoning of node: k8s-node-236-1656928234
STEP: Draining of node: k8s-node-236-1656928234
WARNING: ignoring DaemonSet-managed Pods: kube-system/kube-flannel-ds-jtklh, kube-system/kube-proxy-wtp4g, vmware-system-csi/vsphere-csi-node-8rswp
STEP: Modifying feature gates in kubelet config yaml of node: k8s-node-236-1656928234
Jul 4 04:03:14.498: INFO: Invoking command 'grep CSIMigration /var/lib/kubelet/config.yaml' on host 10.185.33.157
Jul 4 04:03:15.698: INFO: host: 10.185.33.157, command: grep CSIMigration /var/lib/kubelet/config.yaml, return code: 1, stdout: , stderr:
Jul 4 04:03:15.698: INFO: Invoking command 'echo "featureGates:
{
"CSIMigration": true,
"CSIMigrationvSphere": true
}" >>/var/lib/kubelet/config.yaml' on host 10.185.33.157
Jul 4 04:03:16.380: INFO: host: 10.185.33.157, command: echo "featureGates:
{
"CSIMigration": true,
"CSIMigrationvSphere": true
}" >>/var/lib/kubelet/config.yaml, return code: 0, stdout: , stderr:
Jul 4 04:03:16.380: INFO: Invoking command 'systemctl daemon-reload && systemctl restart kubelet' on host 10.185.33.157
Jul 4 04:03:17.800: INFO: host: 10.185.33.157, command: systemctl daemon-reload && systemctl restart kubelet, return code: 0, stdout: , stderr:
STEP: Wait for feature gates update on the k8s CSI node: k8s-node-236-1656928234
Jul 4 04:03:17.810: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
Jul 4 04:03:27.833: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
STEP: Uncordoning of node: k8s-node-236-1656928234
Jul 4 04:03:27.882: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
STEP: Cordoning of node: k8s-node-990-1656928220
STEP: Draining of node: k8s-node-990-1656928220
WARNING: ignoring DaemonSet-managed Pods: kube-system/kube-flannel-ds-jv5wm, kube-system/kube-proxy-62sc9, vmware-system-csi/vsphere-csi-node-xzpc9
STEP: Modifying feature gates in kubelet config yaml of node: k8s-node-990-1656928220
Jul 4 04:03:28.000: INFO: Invoking command 'grep CSIMigration /var/lib/kubelet/config.yaml' on host 10.185.35.185
Jul 4 04:03:29.261: INFO: host: 10.185.35.185, command: grep CSIMigration /var/lib/kubelet/config.yaml, return code: 1, stdout: , stderr:
Jul 4 04:03:29.261: INFO: Invoking command 'echo "featureGates:
{
"CSIMigration": true,
"CSIMigrationvSphere": true
}" >>/var/lib/kubelet/config.yaml' on host 10.185.35.185
Jul 4 04:03:29.958: INFO: host: 10.185.35.185, command: echo "featureGates:
{
"CSIMigration": true,
"CSIMigrationvSphere": true
}" >>/var/lib/kubelet/config.yaml, return code: 0, stdout: , stderr:
Jul 4 04:03:29.958: INFO: Invoking command 'systemctl daemon-reload && systemctl restart kubelet' on host 10.185.35.185
Jul 4 04:03:31.342: INFO: host: 10.185.35.185, command: systemctl daemon-reload && systemctl restart kubelet, return code: 0, stdout: , stderr:
STEP: Wait for feature gates update on the k8s CSI node: k8s-node-990-1656928220
Jul 4 04:03:31.364: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
Jul 4 04:03:41.385: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
STEP: Uncordoning of node: k8s-node-990-1656928220
Jul 4 04:03:41.428: INFO: Waiting up to 10m0s for all pods (need at least 0) in namespace 'vcp-2-csi-syncer-5429' to be running and ready
Jul 4 04:03:41.452: INFO: 0 / 0 pods in namespace 'vcp-2-csi-syncer-5429' are running and ready (0 seconds elapsed)
Jul 4 04:03:41.452: INFO: expected 0 pod replicas in namespace 'vcp-2-csi-syncer-5429', 0 are Running and Ready.
STEP: Create pod1 with inline volume and wait for it to reach Running state
STEP: Verify vmdk1 is registered as a CNS volume and pod metadata is added for the CNS volume
Jul 4 04:03:55.625: INFO: Found CNS volume with id b511850b-b0a1-4186-be6a-0d28ff40b470
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "b511850b-b0a1-4186-be6a-0d28ff40b470"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "f6bba3de-fb88-11ec-8a4e-527b6bf8b324",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) <nil>,
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc0019ef040)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "b511850b-b0a1-4186-be6a-0d28ff40b470",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "cac8c262-26f0-48f0-b6c7-020088cd1d5a"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=13) "notAccessible",
HealthStatus: (string) (len=7) "unknown"
}
Jul 4 04:03:55.625: INFO: pvEntryFound:false, verifyPvEntry:false, pvcEntryFound:false, verifyPvcEntry:false, podEntryFound:false, verifyPodEntry:true
Jul 4 04:04:05.690: INFO: Found CNS volume with id b511850b-b0a1-4186-be6a-0d28ff40b470
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "b511850b-b0a1-4186-be6a-0d28ff40b470"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "f6bba3de-fb88-11ec-8a4e-527b6bf8b324",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=1 cap=1) {
(*types.CnsKubernetesEntityMetadata)(0xc000554400)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=16) "pvc-tester-7s4vs",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=3) "POD",
Namespace: (string) (len=21) "vcp-2-csi-syncer-5429",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc0017af640)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "b511850b-b0a1-4186-be6a-0d28ff40b470",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "cac8c262-26f0-48f0-b6c7-020088cd1d5a"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=13) "notAccessible",
HealthStatus: (string) (len=7) "unknown"
}
Jul 4 04:04:05.690: INFO: pvEntryFound:false, verifyPvEntry:false, pvcEntryFound:false, verifyPvcEntry:false, podEntryFound:true, verifyPodEntry:true
STEP: Delete pod1
Jul 4 04:04:05.690: INFO: Deleting pod "pvc-tester-7s4vs" in namespace "vcp-2-csi-syncer-5429"
Jul 4 04:04:05.729: INFO: Wait up to 5m0s for pod "pvc-tester-7s4vs" to be fully deleted
STEP: Verify CNS volume for vmdk1 is removed
Jul 4 04:04:11.821: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:04:13.819: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:04:15.834: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:04:17.821: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:04:19.825: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:04:21.863: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:04:23.830: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:04:25.831: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:04:27.816: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:04:29.816: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:04:31.818: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:04:33.819: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:04:35.818: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:04:37.818: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:04:39.817: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:04:41.821: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:04:43.824: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:04:45.825: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:04:47.820: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:04:49.828: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:04:51.819: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:04:53.820: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:04:55.849: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:04:57.815: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:04:59.842: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:05:01.822: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:05:03.828: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:05:05.824: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:05:07.821: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:05:09.826: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:05:11.818: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:05:13.818: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:05:15.824: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:05:17.821: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:05:19.821: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:05:21.820: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:05:23.853: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:05:25.826: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:05:27.812: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:05:29.824: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:05:31.820: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:05:33.824: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:05:35.830: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:05:37.815: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:05:39.834: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:05:41.825: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:05:43.824: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:05:45.827: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:05:47.825: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:05:49.823: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:05:51.824: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:05:53.818: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:05:55.827: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:05:57.811: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:05:59.830: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:06:01.830: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:06:03.828: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:06:05.829: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:06:07.821: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:06:09.817: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:06:11.816: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:06:13.812: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:06:15.827: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:06:17.808: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:06:19.839: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:06:21.821: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:06:23.820: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:06:25.831: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:06:27.826: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:06:29.818: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:06:31.815: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:06:33.812: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:06:35.818: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:06:37.821: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:06:39.813: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:06:41.817: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:06:43.823: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:06:45.823: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:06:47.822: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:06:49.812: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:06:51.822: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:06:53.817: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:06:55.819: INFO: waiting for Volume "b511850b-b0a1-4186-be6a-0d28ff40b470" to be deleted.
Jul 4 04:06:57.772: INFO: volume "b511850b-b0a1-4186-be6a-0d28ff40b470" has successfully deleted
[JustAfterEach] [csi-vcp-mig] VCP to CSI migration syncer tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_syncer.go:118
STEP: Disable CSI migration feature gates on kublets on k8s nodes
Jul 4 04:06:59.906: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
STEP: Cordoning of node: k8s-node-148-1656928247
STEP: Draining of node: k8s-node-148-1656928247
WARNING: ignoring DaemonSet-managed Pods: kube-system/kube-flannel-ds-kbxvd, kube-system/kube-proxy-q9t45, vmware-system-csi/vsphere-csi-node-jkxkm
STEP: Modifying feature gates in kubelet config yaml of node: k8s-node-148-1656928247
Jul 4 04:07:00.039: INFO: Invoking command 'grep CSIMigration /var/lib/kubelet/config.yaml' on host 10.185.38.32
Jul 4 04:07:01.499: INFO: host: 10.185.38.32, command: grep CSIMigration /var/lib/kubelet/config.yaml, return code: 0, stdout: CSIMigration: true,
CSIMigrationvSphere: true
, stderr:
Jul 4 04:07:01.499: INFO: Invoking command 'head -n -5 /var/lib/kubelet/config.yaml > tmp.txt && mv tmp.txt /var/lib/kubelet/config.yaml' on host 10.185.38.32
Jul 4 04:07:02.211: INFO: host: 10.185.38.32, command: head -n -5 /var/lib/kubelet/config.yaml > tmp.txt && mv tmp.txt /var/lib/kubelet/config.yaml, return code: 0, stdout: , stderr:
Jul 4 04:07:02.211: INFO: Invoking command 'systemctl daemon-reload && systemctl restart kubelet' on host 10.185.38.32
Jul 4 04:07:03.641: INFO: host: 10.185.38.32, command: systemctl daemon-reload && systemctl restart kubelet, return code: 0, stdout: , stderr:
STEP: Wait for feature gates update on the k8s CSI node: k8s-node-148-1656928247
Jul 4 04:07:03.657: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
Jul 4 04:07:13.667: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
STEP: Uncordoning of node: k8s-node-148-1656928247
Jul 4 04:07:13.704: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
STEP: Cordoning of node: k8s-node-236-1656928234
STEP: Draining of node: k8s-node-236-1656928234
WARNING: ignoring DaemonSet-managed Pods: kube-system/kube-flannel-ds-jtklh, kube-system/kube-proxy-wtp4g, vmware-system-csi/vsphere-csi-node-8rswp
STEP: Modifying feature gates in kubelet config yaml of node: k8s-node-236-1656928234
Jul 4 04:07:13.814: INFO: Invoking command 'grep CSIMigration /var/lib/kubelet/config.yaml' on host 10.185.33.157
Jul 4 04:07:15.252: INFO: host: 10.185.33.157, command: grep CSIMigration /var/lib/kubelet/config.yaml, return code: 0, stdout: CSIMigration: true,
CSIMigrationvSphere: true
, stderr:
Jul 4 04:07:15.253: INFO: Invoking command 'head -n -5 /var/lib/kubelet/config.yaml > tmp.txt && mv tmp.txt /var/lib/kubelet/config.yaml' on host 10.185.33.157
Jul 4 04:07:15.997: INFO: host: 10.185.33.157, command: head -n -5 /var/lib/kubelet/config.yaml > tmp.txt && mv tmp.txt /var/lib/kubelet/config.yaml, return code: 0, stdout: , stderr:
Jul 4 04:07:15.997: INFO: Invoking command 'systemctl daemon-reload && systemctl restart kubelet' on host 10.185.33.157
Jul 4 04:07:17.411: INFO: host: 10.185.33.157, command: systemctl daemon-reload && systemctl restart kubelet, return code: 0, stdout: , stderr:
STEP: Wait for feature gates update on the k8s CSI node: k8s-node-236-1656928234
Jul 4 04:07:17.420: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
Jul 4 04:07:27.441: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
STEP: Uncordoning of node: k8s-node-236-1656928234
Jul 4 04:07:27.498: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
STEP: Cordoning of node: k8s-node-990-1656928220
STEP: Draining of node: k8s-node-990-1656928220
WARNING: ignoring DaemonSet-managed Pods: kube-system/kube-flannel-ds-jv5wm, kube-system/kube-proxy-62sc9, vmware-system-csi/vsphere-csi-node-xzpc9
STEP: Modifying feature gates in kubelet config yaml of node: k8s-node-990-1656928220
Jul 4 04:07:27.612: INFO: Invoking command 'grep CSIMigration /var/lib/kubelet/config.yaml' on host 10.185.35.185
Jul 4 04:07:28.871: INFO: host: 10.185.35.185, command: grep CSIMigration /var/lib/kubelet/config.yaml, return code: 0, stdout: CSIMigration: true,
CSIMigrationvSphere: true
, stderr:
Jul 4 04:07:28.871: INFO: Invoking command 'head -n -5 /var/lib/kubelet/config.yaml > tmp.txt && mv tmp.txt /var/lib/kubelet/config.yaml' on host 10.185.35.185
Jul 4 04:07:29.594: INFO: host: 10.185.35.185, command: head -n -5 /var/lib/kubelet/config.yaml > tmp.txt && mv tmp.txt /var/lib/kubelet/config.yaml, return code: 0, stdout: , stderr:
Jul 4 04:07:29.594: INFO: Invoking command 'systemctl daemon-reload && systemctl restart kubelet' on host 10.185.35.185
Jul 4 04:07:30.976: INFO: host: 10.185.35.185, command: systemctl daemon-reload && systemctl restart kubelet, return code: 0, stdout: , stderr:
STEP: Wait for feature gates update on the k8s CSI node: k8s-node-990-1656928220
Jul 4 04:07:30.984: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
Jul 4 04:07:41.014: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
STEP: Uncordoning of node: k8s-node-990-1656928220
Jul 4 04:07:41.045: INFO: Waiting up to 10m0s for all pods (need at least 0) in namespace 'vcp-2-csi-syncer-5429' to be running and ready
Jul 4 04:07:41.076: INFO: 0 / 0 pods in namespace 'vcp-2-csi-syncer-5429' are running and ready (0 seconds elapsed)
Jul 4 04:07:41.076: INFO: expected 0 pod replicas in namespace 'vcp-2-csi-syncer-5429', 0 are Running and Ready.
Jul 4 04:07:41.086: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.43.70
Jul 4 04:07:42.355: INFO: host: 10.185.43.70, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true
, stderr:
Jul 4 04:07:42.356: INFO: Invoking command sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.43.70
Jul 4 04:07:43.056: INFO: host: 10.185.43.70, command: sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 04:07:43.056: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.43.70
Jul 4 04:07:43.914: INFO: host: 10.185.43.70, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 04:07:43.914: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.45.237
Jul 4 04:07:45.004: INFO: host: 10.185.45.237, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true
, stderr:
Jul 4 04:07:45.004: INFO: Invoking command sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.45.237
Jul 4 04:07:45.766: INFO: host: 10.185.45.237, command: sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 04:07:45.767: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.45.237
Jul 4 04:07:46.981: INFO: host: 10.185.45.237, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 04:07:46.981: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.32.9
Jul 4 04:07:48.331: INFO: host: 10.185.32.9, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true
, stderr:
Jul 4 04:07:48.331: INFO: Invoking command sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.32.9
Jul 4 04:07:49.216: INFO: host: 10.185.32.9, command: sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 04:07:49.217: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.32.9
Jul 4 04:07:50.146: INFO: host: 10.185.32.9, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 04:07:52.147: INFO: Waiting for 'kube-controller-manager' controller pod to come up within 10m0s seconds
Jul 4 04:07:54.181: INFO: Got 1 pods running and ready, expect: 3
Jul 4 04:07:56.182: INFO: Got 0 pods running and ready, expect: 3
Jul 4 04:07:58.186: INFO: Got 0 pods running and ready, expect: 3
Jul 4 04:08:00.172: INFO: Got 0 pods running and ready, expect: 3
Jul 4 04:08:02.169: INFO: Got 1 pods running and ready, expect: 3
Jul 4 04:08:04.177: INFO: Got 1 pods running and ready, expect: 3
Jul 4 04:08:06.173: INFO: 'kube-controller-manager' controller pod is up and ready within 10m0s seconds
Jul 4 04:08:06.173: INFO: Invoking command 'rm -f /vmfs/volumes/vsanDatastore/e2e/test-1656932554485481755-90.vmdk' on ESX host 10.185.37.178
[AfterEach] [csi-vcp-mig] VCP to CSI migration syncer tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/go/pkg/mod/k8s.io/kubernetes@v1.24.2/test/e2e/framework/framework.go:188
Jul 4 04:08:06.551: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "vcp-2-csi-syncer-5429" for this suite.
• [SLOW TEST:336.666 seconds]
[csi-vcp-mig] VCP to CSI migration syncer tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_syncer.go:53
Verify in-line volume creation on the migrated node
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_syncer.go:1026
------------------------------
SSSSSSSSSSSSSSSS
------------------------------
[csi-vcp-mig] VCP to CSI migration syncer tests
Verify Pod Name updates on CNS
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_syncer.go:591
[BeforeEach] [csi-vcp-mig] VCP to CSI migration syncer tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/go/pkg/mod/k8s.io/kubernetes@v1.24.2/test/e2e/framework/framework.go:187
STEP: Creating a kubernetes client
Jul 4 04:08:06.590: INFO: >>> kubeConfig: /home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config
STEP: Building a namespace api object, basename vcp-2-csi-syncer
STEP: Waiting for a default service account to be provisioned in namespace
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[BeforeEach] [csi-vcp-mig] VCP to CSI migration syncer tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_syncer.go:78
Jul 4 04:08:15.788: INFO: Search candidates vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 04:08:15.788: INFO: Searching for node with UUID: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 04:08:15.788: INFO: Searching for node with UUID: 4201f777-84d8-9463-c37d-868274d333cb
Jul 4 04:08:15.788: INFO: Searching for node with UUID: 42019a83-8fab-0ed3-6745-5980c88e61be
Jul 4 04:08:15.788: INFO: Searching for node with UUID: 42019292-0601-e6cc-cf83-9e7ad2ff1147
Jul 4 04:08:15.788: INFO: Searching for node with UUID: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 04:08:15.788: INFO: Searching for node with UUID: 4201c124-84e2-596b-a670-ef0e99be85a5
Jul 4 04:08:16.730: INFO: Found node k8s-control-280-1656928192 as vm=VirtualMachine:vm-54 placed on host=HostSystem:host-28 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 04:08:17.023: INFO: Found node k8s-node-990-1656928220 as vm=VirtualMachine:vm-53 placed on host=HostSystem:host-16 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 04:08:17.160: INFO: Found node k8s-control-292-1656928177 as vm=VirtualMachine:vm-50 placed on host=HostSystem:host-22 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 04:08:17.198: INFO: Found node k8s-node-236-1656928234 as vm=VirtualMachine:vm-52 placed on host=HostSystem:host-34 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 04:08:17.203: INFO: Found node k8s-control-468-1656928206 as vm=VirtualMachine:vm-55 placed on host=HostSystem:host-34 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 04:08:17.208: INFO: Found node k8s-node-148-1656928247 as vm=VirtualMachine:vm-51 placed on host=HostSystem:host-28 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 04:08:17.229: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
Jul 4 04:08:17.237: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
Jul 4 04:08:17.244: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
Jul 4 04:08:17.253: INFO: Waiting up to 10m0s for all pods (need at least 0) in namespace 'vcp-2-csi-syncer-5194' to be running and ready
Jul 4 04:08:17.277: INFO: 0 / 0 pods in namespace 'vcp-2-csi-syncer-5194' are running and ready (0 seconds elapsed)
Jul 4 04:08:17.277: INFO: expected 0 pod replicas in namespace 'vcp-2-csi-syncer-5194', 0 are Running and Ready.
Jul 4 04:08:17.287: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.43.70
Jul 4 04:08:18.256: INFO: host: 10.185.43.70, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 1, stdout: , stderr:
[It] Verify Pod Name updates on CNS
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_syncer.go:591
STEP: Creating VCP SC
STEP: Creating StorageClass with scParameters: map[datastore:vsanDatastore] and zones: [] and ReclaimPolicy: and allowVolumeExpansion: false
STEP: Creating VCP PVC pvc1 before migration
STEP: Creating PVC using the Storage Class vcp-sc-l9h9r with disk size and labels: map[] accessMode:
Jul 4 04:08:18.294: INFO: PVC created: pvc-sq74q in namespace: vcp-2-csi-syncer-5194
STEP: Waiting for all claims created before migration to be in bound state
Jul 4 04:08:18.294: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-sq74q] to have phase Bound
Jul 4 04:08:18.302: INFO: PersistentVolumeClaim pvc-sq74q found but phase is Pending instead of Bound.
Jul 4 04:08:20.312: INFO: PersistentVolumeClaim pvc-sq74q found and phase=Bound (2.018135113s)
STEP: Enabling CSIMigration and CSIMigrationvSphere feature gates on kube-controller-manager
Jul 4 04:08:20.337: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.43.70
Jul 4 04:08:21.044: INFO: host: 10.185.43.70, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 1, stdout: , stderr:
Jul 4 04:08:21.044: INFO: Invoking command gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.43.70
Jul 4 04:08:21.743: INFO: host: 10.185.43.70, command: gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 04:08:21.743: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.43.70
Jul 4 04:08:22.517: INFO: host: 10.185.43.70, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 04:08:22.517: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.45.237
Jul 4 04:08:23.363: INFO: host: 10.185.45.237, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 1, stdout: , stderr:
Jul 4 04:08:23.363: INFO: Invoking command gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.45.237
Jul 4 04:08:24.055: INFO: host: 10.185.45.237, command: gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 04:08:24.055: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.45.237
Jul 4 04:08:24.874: INFO: host: 10.185.45.237, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 04:08:24.874: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.32.9
Jul 4 04:08:25.953: INFO: host: 10.185.32.9, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 1, stdout: , stderr:
Jul 4 04:08:25.953: INFO: Invoking command gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.32.9
Jul 4 04:08:26.718: INFO: host: 10.185.32.9, command: gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 04:08:26.718: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.32.9
Jul 4 04:08:27.598: INFO: host: 10.185.32.9, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 04:08:29.599: INFO: Waiting for 'kube-controller-manager' controller pod to come up within 10m0s seconds
Jul 4 04:08:31.619: INFO: Got 1 pods running and ready, expect: 3
Jul 4 04:08:33.618: INFO: Got 0 pods running and ready, expect: 3
Jul 4 04:08:35.617: INFO: Got 0 pods running and ready, expect: 3
Jul 4 04:08:37.618: INFO: Got 1 pods running and ready, expect: 3
Jul 4 04:08:39.622: INFO: Got 1 pods running and ready, expect: 3
Jul 4 04:08:41.649: INFO: Got 1 pods running and ready, expect: 3
Jul 4 04:08:43.619: INFO: Got 1 pods running and ready, expect: 3
Jul 4 04:08:45.617: INFO: 'kube-controller-manager' controller pod is up and ready within 10m0s seconds
STEP: Waiting for migration related annotations on PV/PVCs created before migration
Jul 4 04:08:45.617: INFO: Checking PVC pvc-sq74q
Jul 4 04:08:45.624: INFO: Annotations found on PVC: pvc-sq74q in namespace:vcp-2-csi-syncer-5194 are,
(map[string]string) (len=4) {
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes"
}
Jul 4 04:08:47.635: INFO: Annotations found on PVC: pvc-sq74q in namespace:vcp-2-csi-syncer-5194 are,
(map[string]string) (len=4) {
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes"
}
Jul 4 04:08:49.638: INFO: Annotations found on PVC: pvc-sq74q in namespace:vcp-2-csi-syncer-5194 are,
(map[string]string) (len=4) {
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 04:08:51.637: INFO: Annotations found on PVC: pvc-sq74q in namespace:vcp-2-csi-syncer-5194 are,
(map[string]string) (len=4) {
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 04:08:53.633: INFO: Annotations found on PVC: pvc-sq74q in namespace:vcp-2-csi-syncer-5194 are,
(map[string]string) (len=5) {
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes"
}
Jul 4 04:08:53.633: INFO: Checking PV pvc-e526fae8-daf3-48d8-8d2e-5ae554d18683
Jul 4 04:08:53.641: INFO: Annotations found on PV: pvc-e526fae8-daf3-48d8-8d2e-5ae554d18683 are,
(map[string]string) (len=4) {
(string) (len=23) "kubernetes.io/createdby": (string) (len=34) "vsphere-volume-dynamic-provisioner",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=31) "pv.kubernetes.io/provisioned-by": (string) (len=28) "kubernetes.io/vsphere-volume"
}
STEP: Verify CnsVSphereVolumeMigration crds and CNS volume metadata on pvc created before migration
Jul 4 04:08:53.641: INFO: Checking PVC pvc-sq74q
Jul 4 04:08:53.656: INFO: Processing PVC: pvc-sq74q
Jul 4 04:08:57.795: INFO: Found CNS volume with id 864f0bf0-cae5-456a-a1df-bcd495874ed8
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "864f0bf0-cae5-456a-a1df-bcd495874ed8"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "b06c4917-fb89-11ec-8a4e-527b6bf8b324",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=1 cap=1) {
(*types.CnsKubernetesEntityMetadata)(0xc00104af00)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-e526fae8-daf3-48d8-8d2e-5ae554d18683",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc001a01a00)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "864f0bf0-cae5-456a-a1df-bcd495874ed8",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "23cac262-487e-f4a2-944a-020088529ac5"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=13) "notAccessible",
HealthStatus: (string) (len=7) "unknown"
}
Jul 4 04:08:57.795: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:false, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:false
Jul 4 04:09:07.854: INFO: Found CNS volume with id 864f0bf0-cae5-456a-a1df-bcd495874ed8
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "864f0bf0-cae5-456a-a1df-bcd495874ed8"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "b06c4917-fb89-11ec-8a4e-527b6bf8b324",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=2 cap=2) {
(*types.CnsKubernetesEntityMetadata)(0xc000ba5080)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-e526fae8-daf3-48d8-8d2e-5ae554d18683",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc000ba5100)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-sq74q",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=21) "vcp-2-csi-syncer-5194",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-e526fae8-daf3-48d8-8d2e-5ae554d18683",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc0017b3ac0)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "864f0bf0-cae5-456a-a1df-bcd495874ed8",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "23cac262-487e-f4a2-944a-020088529ac5"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=13) "notAccessible",
HealthStatus: (string) (len=7) "unknown"
}
Jul 4 04:09:07.854: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:false
STEP: Creating VCP PVC pvc2 post migration
STEP: Creating PVC using the Storage Class vcp-sc-l9h9r with disk size and labels: map[] accessMode:
Jul 4 04:09:07.885: INFO: PVC created: pvc-4zh7n in namespace: vcp-2-csi-syncer-5194
STEP: Waiting for all claims created post migration to be in bound state
Jul 4 04:09:07.885: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-4zh7n] to have phase Bound
Jul 4 04:09:07.893: INFO: PersistentVolumeClaim pvc-4zh7n found but phase is Pending instead of Bound.
Jul 4 04:09:09.903: INFO: PersistentVolumeClaim pvc-4zh7n found but phase is Pending instead of Bound.
Jul 4 04:09:11.912: INFO: PersistentVolumeClaim pvc-4zh7n found and phase=Bound (4.027203463s)
STEP: Verify annotations on PV/PVCs created post migration
Jul 4 04:09:11.929: INFO: Checking PVC pvc-4zh7n
Jul 4 04:09:11.936: INFO: Annotations found on PVC: pvc-4zh7n in namespace:vcp-2-csi-syncer-5194 are,
(map[string]string) (len=4) {
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=22) "csi.vsphere.vmware.com"
}
Jul 4 04:09:11.936: INFO: Checking PV pvc-2fd9d2af-d2a0-448b-b0de-a22850a156b6
Jul 4 04:09:11.943: INFO: Annotations found on PV: pvc-2fd9d2af-d2a0-448b-b0de-a22850a156b6 are,
(map[string]string) (len=2) {
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=31) "pv.kubernetes.io/provisioned-by": (string) (len=28) "kubernetes.io/vsphere-volume"
}
STEP: Wait and verify CNS entries for all CNS volumes created post migration along with their respective CnsVSphereVolumeMigration CRDs
Jul 4 04:09:11.943: INFO: Checking PVC pvc-4zh7n
Jul 4 04:09:11.964: INFO: Processing PVC: pvc-4zh7n
Jul 4 04:09:12.129: INFO: Found CNS volume with id 374d324e-5d31-4690-ac9b-ca1c1c299767
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "374d324e-5d31-4690-ac9b-ca1c1c299767"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=40) "pvc-2fd9d2af-d2a0-448b-b0de-a22850a156b6",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) (len=36) "aa6d5a82-1c88-45da-85d3-3d74b91a5bad",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) <nil>,
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc001849f80)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "374d324e-5d31-4690-ac9b-ca1c1c299767",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "54cac262-5e65-dae6-d503-020088cd1d5a"
}),
ComplianceStatus: (string) (len=9) "compliant",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 04:09:12.129: INFO: pvEntryFound:false, verifyPvEntry:true, pvcEntryFound:false, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:false
Jul 4 04:09:22.263: INFO: Found CNS volume with id 374d324e-5d31-4690-ac9b-ca1c1c299767
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "374d324e-5d31-4690-ac9b-ca1c1c299767"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=40) "pvc-2fd9d2af-d2a0-448b-b0de-a22850a156b6",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) (len=36) "aa6d5a82-1c88-45da-85d3-3d74b91a5bad",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=2 cap=2) {
(*types.CnsKubernetesEntityMetadata)(0xc00062ae00)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-2fd9d2af-d2a0-448b-b0de-a22850a156b6",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc00062ae80)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-4zh7n",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=21) "vcp-2-csi-syncer-5194",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-2fd9d2af-d2a0-448b-b0de-a22850a156b6",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc0012a2c80)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "374d324e-5d31-4690-ac9b-ca1c1c299767",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "54cac262-5e65-dae6-d503-020088cd1d5a"
}),
ComplianceStatus: (string) (len=9) "compliant",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 04:09:22.263: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:false
STEP: Enable CSI migration feature gates on kublets on k8s nodes
Jul 4 04:09:22.287: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
STEP: Cordoning of node: k8s-node-148-1656928247
STEP: Draining of node: k8s-node-148-1656928247
WARNING: ignoring DaemonSet-managed Pods: kube-system/kube-flannel-ds-kbxvd, kube-system/kube-proxy-q9t45, vmware-system-csi/vsphere-csi-node-jkxkm
STEP: Modifying feature gates in kubelet config yaml of node: k8s-node-148-1656928247
Jul 4 04:09:22.361: INFO: Invoking command 'grep CSIMigration /var/lib/kubelet/config.yaml' on host 10.185.38.32
Jul 4 04:09:23.295: INFO: host: 10.185.38.32, command: grep CSIMigration /var/lib/kubelet/config.yaml, return code: 1, stdout: , stderr:
Jul 4 04:09:23.295: INFO: Invoking command 'echo "featureGates:
{
"CSIMigration": true,
"CSIMigrationvSphere": true
}" >>/var/lib/kubelet/config.yaml' on host 10.185.38.32
Jul 4 04:09:23.994: INFO: host: 10.185.38.32, command: echo "featureGates:
{
"CSIMigration": true,
"CSIMigrationvSphere": true
}" >>/var/lib/kubelet/config.yaml, return code: 0, stdout: , stderr:
Jul 4 04:09:23.994: INFO: Invoking command 'systemctl daemon-reload && systemctl restart kubelet' on host 10.185.38.32
Jul 4 04:09:25.301: INFO: host: 10.185.38.32, command: systemctl daemon-reload && systemctl restart kubelet, return code: 0, stdout: , stderr:
STEP: Wait for feature gates update on the k8s CSI node: k8s-node-148-1656928247
Jul 4 04:09:25.313: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
Jul 4 04:09:35.332: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
STEP: Uncordoning of node: k8s-node-148-1656928247
Jul 4 04:09:35.367: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
STEP: Cordoning of node: k8s-node-236-1656928234
STEP: Draining of node: k8s-node-236-1656928234
WARNING: ignoring DaemonSet-managed Pods: kube-system/kube-flannel-ds-jtklh, kube-system/kube-proxy-wtp4g, vmware-system-csi/vsphere-csi-node-8rswp
STEP: Modifying feature gates in kubelet config yaml of node: k8s-node-236-1656928234
Jul 4 04:09:35.451: INFO: Invoking command 'grep CSIMigration /var/lib/kubelet/config.yaml' on host 10.185.33.157
Jul 4 04:09:36.777: INFO: host: 10.185.33.157, command: grep CSIMigration /var/lib/kubelet/config.yaml, return code: 1, stdout: , stderr:
Jul 4 04:09:36.777: INFO: Invoking command 'echo "featureGates:
{
"CSIMigration": true,
"CSIMigrationvSphere": true
}" >>/var/lib/kubelet/config.yaml' on host 10.185.33.157
Jul 4 04:09:37.544: INFO: host: 10.185.33.157, command: echo "featureGates:
{
"CSIMigration": true,
"CSIMigrationvSphere": true
}" >>/var/lib/kubelet/config.yaml, return code: 0, stdout: , stderr:
Jul 4 04:09:37.544: INFO: Invoking command 'systemctl daemon-reload && systemctl restart kubelet' on host 10.185.33.157
Jul 4 04:09:39.220: INFO: host: 10.185.33.157, command: systemctl daemon-reload && systemctl restart kubelet, return code: 0, stdout: , stderr:
STEP: Wait for feature gates update on the k8s CSI node: k8s-node-236-1656928234
Jul 4 04:09:39.229: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
Jul 4 04:09:49.237: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
STEP: Uncordoning of node: k8s-node-236-1656928234
Jul 4 04:09:49.273: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
STEP: Cordoning of node: k8s-node-990-1656928220
STEP: Draining of node: k8s-node-990-1656928220
WARNING: ignoring DaemonSet-managed Pods: kube-system/kube-flannel-ds-jv5wm, kube-system/kube-proxy-62sc9, vmware-system-csi/vsphere-csi-node-xzpc9
STEP: Modifying feature gates in kubelet config yaml of node: k8s-node-990-1656928220
Jul 4 04:09:49.373: INFO: Invoking command 'grep CSIMigration /var/lib/kubelet/config.yaml' on host 10.185.35.185
Jul 4 04:09:50.817: INFO: host: 10.185.35.185, command: grep CSIMigration /var/lib/kubelet/config.yaml, return code: 1, stdout: , stderr:
Jul 4 04:09:50.817: INFO: Invoking command 'echo "featureGates:
{
"CSIMigration": true,
"CSIMigrationvSphere": true
}" >>/var/lib/kubelet/config.yaml' on host 10.185.35.185
Jul 4 04:09:51.551: INFO: host: 10.185.35.185, command: echo "featureGates:
{
"CSIMigration": true,
"CSIMigrationvSphere": true
}" >>/var/lib/kubelet/config.yaml, return code: 0, stdout: , stderr:
Jul 4 04:09:51.552: INFO: Invoking command 'systemctl daemon-reload && systemctl restart kubelet' on host 10.185.35.185
Jul 4 04:09:52.979: INFO: host: 10.185.35.185, command: systemctl daemon-reload && systemctl restart kubelet, return code: 0, stdout: , stderr:
STEP: Wait for feature gates update on the k8s CSI node: k8s-node-990-1656928220
Jul 4 04:09:52.991: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
Jul 4 04:10:03.011: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
STEP: Uncordoning of node: k8s-node-990-1656928220
Jul 4 04:10:03.046: INFO: Waiting up to 10m0s for all pods (need at least 0) in namespace 'vcp-2-csi-syncer-5194' to be running and ready
Jul 4 04:10:03.079: INFO: 0 / 0 pods in namespace 'vcp-2-csi-syncer-5194' are running and ready (0 seconds elapsed)
Jul 4 04:10:03.079: INFO: expected 0 pod replicas in namespace 'vcp-2-csi-syncer-5194', 0 are Running and Ready.
STEP: Create pod1 using PVC1 and PVC2
STEP: Creating pod to attach PV(s) to a node
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
STEP: Verify volume: 864f0bf0-cae5-456a-a1df-bcd495874ed8 is attached to the node: k8s-node-148-1656928247, VMUUID : 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 04:10:11.211: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 04:10:11.223: INFO: Found FCDID "864f0bf0-cae5-456a-a1df-bcd495874ed8" attached to VM "k8s-worker3"
Jul 4 04:10:11.223: INFO: Found the disk "864f0bf0-cae5-456a-a1df-bcd495874ed8" is attached to the VM with UUID: "42012c70-2cfc-49b2-410d-e65427bd134c"
STEP: Verify the volume is accessible and filesystem type is as expected
Jul 4 04:10:11.224: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-syncer-5194 exec pvc-tester-7lx4k --namespace=vcp-2-csi-syncer-5194 -- /bin/cat /mnt/volume1/fstype'
Jul 4 04:10:11.500: INFO: stderr: ""
Jul 4 04:10:11.500: INFO: stdout: "ext4\n"
STEP: Verify volume: 374d324e-5d31-4690-ac9b-ca1c1c299767 is attached to the node: k8s-node-148-1656928247, VMUUID : 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 04:10:11.565: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 04:10:11.573: INFO: Found FCDID "374d324e-5d31-4690-ac9b-ca1c1c299767" attached to VM "k8s-worker3"
Jul 4 04:10:11.573: INFO: Found the disk "374d324e-5d31-4690-ac9b-ca1c1c299767" is attached to the VM with UUID: "42012c70-2cfc-49b2-410d-e65427bd134c"
STEP: Verify the volume is accessible and filesystem type is as expected
Jul 4 04:10:11.573: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-syncer-5194 exec pvc-tester-7lx4k --namespace=vcp-2-csi-syncer-5194 -- /bin/cat /mnt/volume1/fstype'
Jul 4 04:10:11.806: INFO: stderr: ""
Jul 4 04:10:11.806: INFO: stdout: "ext4\n"
STEP: Wait and verify CNS entries for all CNS volumes
Jul 4 04:10:11.806: INFO: Checking PVC pvc-sq74q
Jul 4 04:10:11.822: INFO: Processing PVC: pvc-sq74q
Jul 4 04:10:11.886: INFO: For pod 'pvc-tester-7lx4k', volumes:
([]v1.Volume) (len=3 cap=4) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-sq74q,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:volume2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-4zh7n,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-qmfv6,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 04:10:11.937: INFO: Found CNS volume with id 864f0bf0-cae5-456a-a1df-bcd495874ed8
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "864f0bf0-cae5-456a-a1df-bcd495874ed8"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "b06c4917-fb89-11ec-8a4e-527b6bf8b324",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=3 cap=4) {
(*types.CnsKubernetesEntityMetadata)(0xc001a83680)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-e526fae8-daf3-48d8-8d2e-5ae554d18683",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc001a83700)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-sq74q",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=21) "vcp-2-csi-syncer-5194",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-e526fae8-daf3-48d8-8d2e-5ae554d18683",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc001a83780)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=16) "pvc-tester-7lx4k",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=3) "POD",
Namespace: (string) (len=21) "vcp-2-csi-syncer-5194",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
EntityName: (string) (len=9) "pvc-sq74q",
Namespace: (string) (len=21) "vcp-2-csi-syncer-5194",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc001b34380)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "864f0bf0-cae5-456a-a1df-bcd495874ed8",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "23cac262-487e-f4a2-944a-020088529ac5"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=13) "notAccessible",
HealthStatus: (string) (len=7) "unknown"
}
Jul 4 04:10:11.937: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:true, verifyPodEntry:true
Jul 4 04:10:11.937: INFO: Checking PVC pvc-4zh7n
Jul 4 04:10:11.955: INFO: Processing PVC: pvc-4zh7n
Jul 4 04:10:12.014: INFO: For pod 'pvc-tester-7lx4k', volumes:
([]v1.Volume) (len=3 cap=4) {
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-sq74q,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:volume2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-4zh7n,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-qmfv6,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 04:10:12.118: INFO: Found CNS volume with id 374d324e-5d31-4690-ac9b-ca1c1c299767
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "374d324e-5d31-4690-ac9b-ca1c1c299767"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=40) "pvc-2fd9d2af-d2a0-448b-b0de-a22850a156b6",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) (len=36) "aa6d5a82-1c88-45da-85d3-3d74b91a5bad",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=2 cap=2) {
(*types.CnsKubernetesEntityMetadata)(0xc000074480)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-2fd9d2af-d2a0-448b-b0de-a22850a156b6",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc000074500)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-4zh7n",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=21) "vcp-2-csi-syncer-5194",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-2fd9d2af-d2a0-448b-b0de-a22850a156b6",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc00043bb80)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "374d324e-5d31-4690-ac9b-ca1c1c299767",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "54cac262-5e65-dae6-d503-020088cd1d5a"
}),
ComplianceStatus: (string) (len=9) "compliant",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 04:10:12.118: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:true
Jul 4 04:10:22.237: INFO: Found CNS volume with id 374d324e-5d31-4690-ac9b-ca1c1c299767
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "374d324e-5d31-4690-ac9b-ca1c1c299767"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=40) "pvc-2fd9d2af-d2a0-448b-b0de-a22850a156b6",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) (len=36) "aa6d5a82-1c88-45da-85d3-3d74b91a5bad",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=3 cap=4) {
(*types.CnsKubernetesEntityMetadata)(0xc000074780)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-2fd9d2af-d2a0-448b-b0de-a22850a156b6",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc000074880)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-4zh7n",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=21) "vcp-2-csi-syncer-5194",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-2fd9d2af-d2a0-448b-b0de-a22850a156b6",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc000074900)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=16) "pvc-tester-7lx4k",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=3) "POD",
Namespace: (string) (len=21) "vcp-2-csi-syncer-5194",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
EntityName: (string) (len=9) "pvc-4zh7n",
Namespace: (string) (len=21) "vcp-2-csi-syncer-5194",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc001390c80)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "374d324e-5d31-4690-ac9b-ca1c1c299767",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "54cac262-5e65-dae6-d503-020088cd1d5a"
}),
ComplianceStatus: (string) (len=9) "compliant",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 04:10:22.237: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:true, verifyPodEntry:true
STEP: Delete pod
STEP: Deleting pod: pvc-tester-7lx4k
Jul 4 04:10:22.246: INFO: pod info:
(*v1.Pod)(0xc000f63400)(&Pod{ObjectMeta:{pvc-tester-7lx4k pvc-tester- vcp-2-csi-syncer-5194 b7dd84a4-8826-42be-a018-0771aedef902 20423 0 2022-07-04 04:10:03 -0700 PDT <nil> <nil> map[] map[] [] [] [{e2e.test Update v1 2022-07-04 04:10:03 -0700 PDT FieldsV1 {"f:metadata":{"f:generateName":{}},"f:spec":{"f:containers":{"k:{\"name\":\"write-pod\"}":{".":{},"f:command":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{".":{},"f:privileged":{}},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{},"f:volumeMounts":{".":{},"k:{\"mountPath\":\"/mnt/volume1\"}":{".":{},"f:mountPath":{},"f:name":{}},"k:{\"mountPath\":\"/mnt/volume2\"}":{".":{},"f:mountPath":{},"f:name":{}}}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{},"f:volumes":{".":{},"k:{\"name\":\"volume1\"}":{".":{},"f:name":{},"f:persistentVolumeClaim":{".":{},"f:claimName":{}}},"k:{\"name\":\"volume2\"}":{".":{},"f:name":{},"f:persistentVolumeClaim":{".":{},"f:claimName":{}}}}}} } {kubelet Update v1 2022-07-04 04:10:10 -0700 PDT FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"10.244.5.17\"}":{".":{},"f:ip":{}}},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-sq74q,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},Volume{Name:volume2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-4zh7n,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},Volume{Name:kube-api-access-qmfv6,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:write-pod,Image:gcr.io/google_containers/busybox:1.27,Command:[/bin/sh -c /bin/df -T /mnt/volume1 | /bin/awk 'FNR == 2 {print $2}' > /mnt/volume1/fstype && while true ; do sleep 2 ; done],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:volume1,ReadOnly:false,MountPath:/mnt/volume1,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:volume2,ReadOnly:false,MountPath:/mnt/volume2,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:kube-api-access-qmfv6,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:*false,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:OnFailure,TerminationGracePeriodSeconds:*30,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:k8s-node-148-1656928247,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,},Status:PodStatus{Phase:Running,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-07-04 04:10:03 -0700 PDT,Reason:,Message:,},PodCondition{Type:Ready,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-07-04 04:10:09 -0700 PDT,Reason:,Message:,},PodCondition{Type:ContainersReady,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-07-04 04:10:09 -0700 PDT,Reason:,Message:,},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2022-07-04 04:10:03 -0700 PDT,Reason:,Message:,},},Message:,Reason:,HostIP:10.185.38.32,PodIP:10.244.5.17,StartTime:2022-07-04 04:10:03 -0700 PDT,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:write-pod,State:ContainerState{Waiting:nil,Running:&ContainerStateRunning{StartedAt:2022-07-04 04:10:09 -0700 PDT,},Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:true,RestartCount:0,Image:gcr.io/google_containers/busybox:1.27,ImageID:gcr.io/google_containers/busybox@sha256:545e6a6310a27636260920bc07b994a299b6708a1b26910cfefd335fdfb60d2b,ContainerID:containerd://bc9fd35257b121f868755fa237eac2b3ba44bc4c802ef38cefb6b907d46b1c4e,Started:*true,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:10.244.5.17,},},EphemeralContainerStatuses:[]ContainerStatus{},},})
Jul 4 04:10:22.246: INFO: vol info:
(v1.Volume) &Volume{Name:volume1,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-sq74q,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},}
Jul 4 04:10:22.294: INFO: vol info:
(v1.Volume) &Volume{Name:volume2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:pvc-4zh7n,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},}
Jul 4 04:10:22.336: INFO: Deleting pod "pvc-tester-7lx4k" in namespace "vcp-2-csi-syncer-5194"
Jul 4 04:10:22.362: INFO: Wait up to 5m0s for pod "pvc-tester-7lx4k" to be fully deleted
STEP: Verify volume is detached from the node
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
Jul 4 04:10:56.436: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 04:10:56.444: INFO: Found FCDID "864f0bf0-cae5-456a-a1df-bcd495874ed8" attached to VM "k8s-worker3"
Jul 4 04:10:56.444: INFO: Found the disk "864f0bf0-cae5-456a-a1df-bcd495874ed8" is attached to the VM with UUID: "42012c70-2cfc-49b2-410d-e65427bd134c"
Jul 4 04:10:56.444: INFO: Waiting for disk: "864f0bf0-cae5-456a-a1df-bcd495874ed8" to be detached from the node :"k8s-node-148-1656928247"
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
Jul 4 04:10:58.423: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 04:10:58.428: INFO: Found FCDID "864f0bf0-cae5-456a-a1df-bcd495874ed8" attached to VM "k8s-worker3"
Jul 4 04:10:58.428: INFO: Found the disk "864f0bf0-cae5-456a-a1df-bcd495874ed8" is attached to the VM with UUID: "42012c70-2cfc-49b2-410d-e65427bd134c"
Jul 4 04:10:58.428: INFO: Waiting for disk: "864f0bf0-cae5-456a-a1df-bcd495874ed8" to be detached from the node :"k8s-node-148-1656928247"
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
Jul 4 04:11:00.416: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 04:11:00.422: INFO: failed to find FCDID "864f0bf0-cae5-456a-a1df-bcd495874ed8" attached to VM "k8s-worker3"
Jul 4 04:11:00.422: INFO: Disk: 864f0bf0-cae5-456a-a1df-bcd495874ed8 successfully detached
STEP: Verify volume is detached from the node
STEP: VM UUID is: 42012c70-2cfc-49b2-410d-e65427bd134c for node: k8s-node-148-1656928247
Jul 4 04:11:02.463: INFO: vmRef: VirtualMachine:vm-51 for the VM uuid: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 04:11:02.470: INFO: failed to find FCDID "374d324e-5d31-4690-ac9b-ca1c1c299767" attached to VM "k8s-worker3"
Jul 4 04:11:02.470: INFO: Disk: 374d324e-5d31-4690-ac9b-ca1c1c299767 successfully detached
STEP: Wait and verify CNS entries for all CNS volumes
Jul 4 04:11:02.470: INFO: Checking PVC pvc-sq74q
Jul 4 04:11:02.489: INFO: Processing PVC: pvc-sq74q
Jul 4 04:11:02.614: INFO: Found CNS volume with id 864f0bf0-cae5-456a-a1df-bcd495874ed8
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "864f0bf0-cae5-456a-a1df-bcd495874ed8"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "b06c4917-fb89-11ec-8a4e-527b6bf8b324",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=2 cap=2) {
(*types.CnsKubernetesEntityMetadata)(0xc000df5b80)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-e526fae8-daf3-48d8-8d2e-5ae554d18683",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc000df5c00)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-sq74q",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=21) "vcp-2-csi-syncer-5194",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-e526fae8-daf3-48d8-8d2e-5ae554d18683",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc0015eaa40)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "864f0bf0-cae5-456a-a1df-bcd495874ed8",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "23cac262-487e-f4a2-944a-020088529ac5"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=13) "notAccessible",
HealthStatus: (string) (len=7) "unknown"
}
Jul 4 04:11:02.614: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:false
Jul 4 04:11:02.614: INFO: Checking PVC pvc-4zh7n
Jul 4 04:11:02.632: INFO: Processing PVC: pvc-4zh7n
Jul 4 04:11:02.806: INFO: Found CNS volume with id 374d324e-5d31-4690-ac9b-ca1c1c299767
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "374d324e-5d31-4690-ac9b-ca1c1c299767"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=40) "pvc-2fd9d2af-d2a0-448b-b0de-a22850a156b6",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) (len=36) "aa6d5a82-1c88-45da-85d3-3d74b91a5bad",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=2 cap=2) {
(*types.CnsKubernetesEntityMetadata)(0xc0003b0080)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-2fd9d2af-d2a0-448b-b0de-a22850a156b6",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc0003b0100)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-4zh7n",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=21) "vcp-2-csi-syncer-5194",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-2fd9d2af-d2a0-448b-b0de-a22850a156b6",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc001a9ad80)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "374d324e-5d31-4690-ac9b-ca1c1c299767",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "54cac262-5e65-dae6-d503-020088cd1d5a"
}),
ComplianceStatus: (string) (len=9) "compliant",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 04:11:02.806: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:false
STEP: Disable CSI migration feature gates on kublets on k8s nodes
Jul 4 04:11:02.830: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
STEP: Cordoning of node: k8s-node-148-1656928247
STEP: Draining of node: k8s-node-148-1656928247
WARNING: ignoring DaemonSet-managed Pods: kube-system/kube-flannel-ds-kbxvd, kube-system/kube-proxy-q9t45, vmware-system-csi/vsphere-csi-node-jkxkm
STEP: Modifying feature gates in kubelet config yaml of node: k8s-node-148-1656928247
Jul 4 04:11:02.931: INFO: Invoking command 'grep CSIMigration /var/lib/kubelet/config.yaml' on host 10.185.38.32
Jul 4 04:11:03.796: INFO: host: 10.185.38.32, command: grep CSIMigration /var/lib/kubelet/config.yaml, return code: 0, stdout: CSIMigration: true,
CSIMigrationvSphere: true
, stderr:
Jul 4 04:11:03.796: INFO: Invoking command 'head -n -5 /var/lib/kubelet/config.yaml > tmp.txt && mv tmp.txt /var/lib/kubelet/config.yaml' on host 10.185.38.32
Jul 4 04:11:04.482: INFO: host: 10.185.38.32, command: head -n -5 /var/lib/kubelet/config.yaml > tmp.txt && mv tmp.txt /var/lib/kubelet/config.yaml, return code: 0, stdout: , stderr:
Jul 4 04:11:04.482: INFO: Invoking command 'systemctl daemon-reload && systemctl restart kubelet' on host 10.185.38.32
Jul 4 04:11:05.787: INFO: host: 10.185.38.32, command: systemctl daemon-reload && systemctl restart kubelet, return code: 0, stdout: , stderr:
STEP: Wait for feature gates update on the k8s CSI node: k8s-node-148-1656928247
Jul 4 04:11:05.796: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
Jul 4 04:11:15.815: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
STEP: Uncordoning of node: k8s-node-148-1656928247
Jul 4 04:11:15.852: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
STEP: Cordoning of node: k8s-node-236-1656928234
STEP: Draining of node: k8s-node-236-1656928234
WARNING: ignoring DaemonSet-managed Pods: kube-system/kube-flannel-ds-jtklh, kube-system/kube-proxy-wtp4g, vmware-system-csi/vsphere-csi-node-8rswp
STEP: Modifying feature gates in kubelet config yaml of node: k8s-node-236-1656928234
Jul 4 04:11:15.936: INFO: Invoking command 'grep CSIMigration /var/lib/kubelet/config.yaml' on host 10.185.33.157
Jul 4 04:11:17.461: INFO: host: 10.185.33.157, command: grep CSIMigration /var/lib/kubelet/config.yaml, return code: 0, stdout: CSIMigration: true,
CSIMigrationvSphere: true
, stderr:
Jul 4 04:11:17.461: INFO: Invoking command 'head -n -5 /var/lib/kubelet/config.yaml > tmp.txt && mv tmp.txt /var/lib/kubelet/config.yaml' on host 10.185.33.157
Jul 4 04:11:18.200: INFO: host: 10.185.33.157, command: head -n -5 /var/lib/kubelet/config.yaml > tmp.txt && mv tmp.txt /var/lib/kubelet/config.yaml, return code: 0, stdout: , stderr:
Jul 4 04:11:18.200: INFO: Invoking command 'systemctl daemon-reload && systemctl restart kubelet' on host 10.185.33.157
Jul 4 04:11:19.636: INFO: host: 10.185.33.157, command: systemctl daemon-reload && systemctl restart kubelet, return code: 0, stdout: , stderr:
STEP: Wait for feature gates update on the k8s CSI node: k8s-node-236-1656928234
Jul 4 04:11:19.646: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
Jul 4 04:11:29.667: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
STEP: Uncordoning of node: k8s-node-236-1656928234
Jul 4 04:11:29.719: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
STEP: Cordoning of node: k8s-node-990-1656928220
STEP: Draining of node: k8s-node-990-1656928220
WARNING: ignoring DaemonSet-managed Pods: kube-system/kube-flannel-ds-jv5wm, kube-system/kube-proxy-62sc9, vmware-system-csi/vsphere-csi-node-xzpc9
STEP: Modifying feature gates in kubelet config yaml of node: k8s-node-990-1656928220
Jul 4 04:11:29.814: INFO: Invoking command 'grep CSIMigration /var/lib/kubelet/config.yaml' on host 10.185.35.185
Jul 4 04:11:31.072: INFO: host: 10.185.35.185, command: grep CSIMigration /var/lib/kubelet/config.yaml, return code: 0, stdout: CSIMigration: true,
CSIMigrationvSphere: true
, stderr:
Jul 4 04:11:31.072: INFO: Invoking command 'head -n -5 /var/lib/kubelet/config.yaml > tmp.txt && mv tmp.txt /var/lib/kubelet/config.yaml' on host 10.185.35.185
Jul 4 04:11:31.837: INFO: host: 10.185.35.185, command: head -n -5 /var/lib/kubelet/config.yaml > tmp.txt && mv tmp.txt /var/lib/kubelet/config.yaml, return code: 0, stdout: , stderr:
Jul 4 04:11:31.837: INFO: Invoking command 'systemctl daemon-reload && systemctl restart kubelet' on host 10.185.35.185
Jul 4 04:11:33.212: INFO: host: 10.185.35.185, command: systemctl daemon-reload && systemctl restart kubelet, return code: 0, stdout: , stderr:
STEP: Wait for feature gates update on the k8s CSI node: k8s-node-990-1656928220
Jul 4 04:11:33.225: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
Jul 4 04:11:43.238: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
STEP: Uncordoning of node: k8s-node-990-1656928220
Jul 4 04:11:43.286: INFO: Waiting up to 10m0s for all pods (need at least 0) in namespace 'vcp-2-csi-syncer-5194' to be running and ready
Jul 4 04:11:43.335: INFO: 0 / 0 pods in namespace 'vcp-2-csi-syncer-5194' are running and ready (0 seconds elapsed)
Jul 4 04:11:43.335: INFO: expected 0 pod replicas in namespace 'vcp-2-csi-syncer-5194', 0 are Running and Ready.
[JustAfterEach] [csi-vcp-mig] VCP to CSI migration syncer tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_syncer.go:118
Jul 4 04:11:43.436: INFO: Deleting PVC pvc-sq74q
Jul 4 04:11:43.540: INFO: Deleting PVC pvc-4zh7n
Jul 4 04:11:43.584: INFO: Looking for default datastore in DC: VSAN-DC
Jul 4 04:11:43.619: INFO: Datstore found for DS URL:ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/
Jul 4 04:11:43.957: INFO: Looking for default datastore in DC: VSAN-DC
Jul 4 04:11:43.975: INFO: Datstore found for DS URL:ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/
Jul 4 04:11:44.265: INFO: Waiting for CnsVSphereVolumeMigration crd 864f0bf0-cae5-456a-a1df-bcd495874ed8 to be deleted
Jul 4 04:11:46.348: INFO: Waiting for CnsVSphereVolumeMigration crd 374d324e-5d31-4690-ac9b-ca1c1c299767 to be deleted
Jul 4 04:11:46.399: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.43.70
Jul 4 04:11:48.083: INFO: host: 10.185.43.70, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true
, stderr:
Jul 4 04:11:48.083: INFO: Invoking command sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.43.70
Jul 4 04:11:49.098: INFO: host: 10.185.43.70, command: sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 04:11:49.098: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.43.70
Jul 4 04:11:50.046: INFO: host: 10.185.43.70, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 04:11:50.046: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.45.237
Jul 4 04:11:51.060: INFO: host: 10.185.45.237, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true
, stderr:
Jul 4 04:11:51.060: INFO: Invoking command sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.45.237
Jul 4 04:11:51.856: INFO: host: 10.185.45.237, command: sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 04:11:51.856: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.45.237
Jul 4 04:11:52.827: INFO: host: 10.185.45.237, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 04:11:52.827: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.32.9
Jul 4 04:11:54.439: INFO: host: 10.185.32.9, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true
, stderr:
Jul 4 04:11:54.439: INFO: Invoking command sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.32.9
Jul 4 04:11:55.283: INFO: host: 10.185.32.9, command: sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 04:11:55.283: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.32.9
Jul 4 04:11:56.214: INFO: host: 10.185.32.9, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 04:11:58.215: INFO: Waiting for 'kube-controller-manager' controller pod to come up within 10m0s seconds
Jul 4 04:12:00.238: INFO: Got 1 pods running and ready, expect: 3
Jul 4 04:12:02.238: INFO: Got 0 pods running and ready, expect: 3
Jul 4 04:12:04.262: INFO: Got 1 pods running and ready, expect: 3
Jul 4 04:12:06.264: INFO: Got 2 pods running and ready, expect: 3
Jul 4 04:12:08.254: INFO: Got 2 pods running and ready, expect: 3
Jul 4 04:12:10.246: INFO: 'kube-controller-manager' controller pod is up and ready within 10m0s seconds
[AfterEach] [csi-vcp-mig] VCP to CSI migration syncer tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/go/pkg/mod/k8s.io/kubernetes@v1.24.2/test/e2e/framework/framework.go:188
Jul 4 04:12:10.273: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "vcp-2-csi-syncer-5194" for this suite.
• [SLOW TEST:243.720 seconds]
[csi-vcp-mig] VCP to CSI migration syncer tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_syncer.go:53
Verify Pod Name updates on CNS
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_syncer.go:591
------------------------------
SSSSSSSSSSSS
------------------------------
[csi-vcp-mig] VCP to CSI migration full sync tests
Verify volume entry is updated in CNS when PVC is bound to statically created PV in K8s (when SPS was down)
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_full_sync.go:621
[BeforeEach] [csi-vcp-mig] VCP to CSI migration full sync tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/go/pkg/mod/k8s.io/kubernetes@v1.24.2/test/e2e/framework/framework.go:187
STEP: Creating a kubernetes client
Jul 4 04:12:10.311: INFO: >>> kubeConfig: /home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config
STEP: Building a namespace api object, basename vcp-2-csi-full-sync
STEP: Waiting for a default service account to be provisioned in namespace
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[BeforeEach] [csi-vcp-mig] VCP to CSI migration full sync tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_full_sync.go:62
Jul 4 04:12:20.159: INFO: Search candidates vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 04:12:20.159: INFO: Searching for node with UUID: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 04:12:20.159: INFO: Searching for node with UUID: 4201f777-84d8-9463-c37d-868274d333cb
Jul 4 04:12:20.159: INFO: Searching for node with UUID: 42019a83-8fab-0ed3-6745-5980c88e61be
Jul 4 04:12:20.159: INFO: Searching for node with UUID: 42019292-0601-e6cc-cf83-9e7ad2ff1147
Jul 4 04:12:20.159: INFO: Searching for node with UUID: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 04:12:20.159: INFO: Searching for node with UUID: 4201c124-84e2-596b-a670-ef0e99be85a5
Jul 4 04:12:21.042: INFO: Found node k8s-node-990-1656928220 as vm=VirtualMachine:vm-53 placed on host=HostSystem:host-16 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 04:12:21.167: INFO: Found node k8s-control-280-1656928192 as vm=VirtualMachine:vm-54 placed on host=HostSystem:host-28 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 04:12:21.343: INFO: Found node k8s-control-468-1656928206 as vm=VirtualMachine:vm-55 placed on host=HostSystem:host-34 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 04:12:21.402: INFO: Found node k8s-node-236-1656928234 as vm=VirtualMachine:vm-52 placed on host=HostSystem:host-34 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 04:12:21.549: INFO: Found node k8s-node-148-1656928247 as vm=VirtualMachine:vm-51 placed on host=HostSystem:host-28 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 04:12:21.552: INFO: Found node k8s-control-292-1656928177 as vm=VirtualMachine:vm-50 placed on host=HostSystem:host-22 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 04:12:21.574: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.43.70
Jul 4 04:12:22.688: INFO: host: 10.185.43.70, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 1, stdout: , stderr:
[It] Verify volume entry is updated in CNS when PVC is bound to statically created PV in K8s (when SPS was down)
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_full_sync.go:621
STEP: Enabling CSIMigration and CSIMigrationvSphere feature gates on kube-controller-manager
Jul 4 04:12:22.707: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.43.70
Jul 4 04:12:23.447: INFO: host: 10.185.43.70, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 1, stdout: , stderr:
Jul 4 04:12:23.447: INFO: Invoking command gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.43.70
Jul 4 04:12:24.269: INFO: host: 10.185.43.70, command: gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 04:12:24.269: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.43.70
Jul 4 04:12:25.171: INFO: host: 10.185.43.70, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 04:12:25.171: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.45.237
Jul 4 04:12:26.013: INFO: host: 10.185.45.237, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 1, stdout: , stderr:
Jul 4 04:12:26.014: INFO: Invoking command gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.45.237
Jul 4 04:12:26.802: INFO: host: 10.185.45.237, command: gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 04:12:26.803: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.45.237
Jul 4 04:12:27.663: INFO: host: 10.185.45.237, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 04:12:27.664: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.32.9
Jul 4 04:12:29.187: INFO: host: 10.185.32.9, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 1, stdout: , stderr:
Jul 4 04:12:29.187: INFO: Invoking command gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.32.9
Jul 4 04:12:30.043: INFO: host: 10.185.32.9, command: gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 04:12:30.043: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.32.9
Jul 4 04:12:30.978: INFO: host: 10.185.32.9, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 04:12:32.978: INFO: Waiting for 'kube-controller-manager' controller pod to come up within 10m0s seconds
Jul 4 04:12:35.006: INFO: Got 1 pods running and ready, expect: 3
Jul 4 04:12:36.994: INFO: Got 0 pods running and ready, expect: 3
Jul 4 04:12:38.998: INFO: Got 0 pods running and ready, expect: 3
Jul 4 04:12:40.992: INFO: Got 0 pods running and ready, expect: 3
Jul 4 04:12:43.008: INFO: Got 2 pods running and ready, expect: 3
Jul 4 04:12:45.002: INFO: 'kube-controller-manager' controller pod is up and ready within 10m0s seconds
STEP: Create VCP SC with ReclaimPolicy=Delete
STEP: Creating StorageClass with scParameters: map[datastore:vsanDatastore] and zones: [] and ReclaimPolicy: and allowVolumeExpansion: false
STEP: Creating vmdk1 on the shared datastore vsanDatastore
Jul 4 04:12:45.018: INFO: Invoking command 'mkdir -p /vmfs/volumes/vsanDatastore/e2e' on ESX host 10.185.37.178
Jul 4 04:12:45.419: INFO: Invoking command 'vmkfstools -c 2g -d thin -W vsan /vmfs/volumes/vsanDatastore/e2e/test-1656933165419559176-888.vmdk' on ESX host 10.185.37.178
STEP: Creating PV1 with vmdk1
STEP: Stopping sps on the vCenter host
Jul 4 04:12:45.996: INFO: Invoking command service-control --stop sps on vCenter host 10.185.39.37:22
STEP: Sleeping for 15 seconds to allow sps to completely shutdown
STEP: Creating PVC1 with PV1 and VCP SC
STEP: Waiting for PVC1 and PV1 to bind
Jul 4 04:13:04.554: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-twd64] to have phase Bound
Jul 4 04:13:04.560: INFO: PersistentVolumeClaim pvc-twd64 found but phase is Pending instead of Bound.
Jul 4 04:13:06.570: INFO: PersistentVolumeClaim pvc-twd64 found and phase=Bound (2.01675233s)
STEP: Starting sps on the vCenter host
Jul 4 04:13:06.583: INFO: Invoking command service-control --start sps on vCenter host 10.185.39.37:22
STEP: Sleeping for 15 seconds to allow sps to start
STEP: Sleeping for 260 seconds to allow full sync finish
STEP: Waiting for migration related annotations on PV/PVCs created before migration
Jul 4 04:18:01.826: INFO: Checking PVC pvc-twd64
Jul 4 04:18:01.868: INFO: Annotations found on PVC: pvc-twd64 in namespace:vcp-2-csi-full-sync-1353 are,
(map[string]string) (len=3) {
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 04:18:01.868: INFO: Checking PV vspherepv-4jr55
Jul 4 04:18:01.876: INFO: Annotations found on PV: vspherepv-4jr55 are,
(map[string]string) (len=3) {
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=31) "pv.kubernetes.io/provisioned-by": (string) (len=28) "kubernetes.io/vsphere-volume"
}
STEP: Verify CnsVSphereVolumeMigration crds and CNS volume metadata on pvc created before migration
Jul 4 04:18:01.876: INFO: Checking PVC pvc-twd64
Jul 4 04:18:01.896: INFO: Processing PVC: pvc-twd64
Jul 4 04:18:02.043: INFO: Found CNS volume with id fbf1b06f-94ee-4051-8ff2-5684ae71e8f1
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "fbf1b06f-94ee-4051-8ff2-5684ae71e8f1"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "4d127d2e-fb8a-11ec-8a4e-527b6bf8b324",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=2 cap=2) {
(*types.CnsKubernetesEntityMetadata)(0xc001926700)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-twd64",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=24) "vcp-2-csi-full-sync-1353",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=15) "vspherepv-4jr55",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc001926780)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=15) "vspherepv-4jr55",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc000669e00)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "fbf1b06f-94ee-4051-8ff2-5684ae71e8f1",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "2dcbc262-d40e-54be-0189-020088cd1d5a"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=13) "notAccessible",
HealthStatus: (string) (len=7) "unknown"
}
Jul 4 04:18:02.043: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:false
[JustAfterEach] [csi-vcp-mig] VCP to CSI migration full sync tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_full_sync.go:94
Jul 4 04:18:02.082: INFO: Deleting PVC pvc-twd64
Jul 4 04:18:02.109: INFO: Looking for default datastore in DC: VSAN-DC
Jul 4 04:18:02.126: INFO: Datstore found for DS URL:ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/
Jul 4 04:18:02.431: INFO: Waiting for CnsVSphereVolumeMigration crd fbf1b06f-94ee-4051-8ff2-5684ae71e8f1 to be deleted
Jul 4 04:18:04.535: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.43.70
Jul 4 04:18:05.896: INFO: host: 10.185.43.70, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true
, stderr:
Jul 4 04:18:05.896: INFO: Invoking command sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.43.70
Jul 4 04:18:06.767: INFO: host: 10.185.43.70, command: sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 04:18:06.767: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.43.70
Jul 4 04:18:07.604: INFO: host: 10.185.43.70, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 04:18:07.604: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.45.237
Jul 4 04:18:08.683: INFO: host: 10.185.45.237, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true
, stderr:
Jul 4 04:18:08.683: INFO: Invoking command sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.45.237
Jul 4 04:18:09.482: INFO: host: 10.185.45.237, command: sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 04:18:09.482: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.45.237
Jul 4 04:18:10.321: INFO: host: 10.185.45.237, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 04:18:10.321: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.32.9
Jul 4 04:18:11.670: INFO: host: 10.185.32.9, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true
, stderr:
Jul 4 04:18:11.670: INFO: Invoking command sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.32.9
Jul 4 04:18:12.463: INFO: host: 10.185.32.9, command: sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 04:18:12.463: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.32.9
Jul 4 04:18:13.495: INFO: host: 10.185.32.9, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 04:18:15.495: INFO: Waiting for 'kube-controller-manager' controller pod to come up within 10m0s seconds
Jul 4 04:18:17.513: INFO: Got 1 pods running and ready, expect: 3
Jul 4 04:18:19.515: INFO: Got 0 pods running and ready, expect: 3
Jul 4 04:18:21.513: INFO: Got 0 pods running and ready, expect: 3
Jul 4 04:18:23.513: INFO: Got 0 pods running and ready, expect: 3
Jul 4 04:18:25.521: INFO: Got 1 pods running and ready, expect: 3
Jul 4 04:18:27.510: INFO: Got 2 pods running and ready, expect: 3
Jul 4 04:18:29.516: INFO: Got 2 pods running and ready, expect: 3
Jul 4 04:18:31.512: INFO: 'kube-controller-manager' controller pod is up and ready within 10m0s seconds
[AfterEach] [csi-vcp-mig] VCP to CSI migration full sync tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/go/pkg/mod/k8s.io/kubernetes@v1.24.2/test/e2e/framework/framework.go:188
Jul 4 04:18:31.529: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "vcp-2-csi-full-sync-1353" for this suite.
• [SLOW TEST:381.263 seconds]
[csi-vcp-mig] VCP to CSI migration full sync tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_full_sync.go:40
Verify volume entry is updated in CNS when PVC is bound to statically created PV in K8s (when SPS was down)
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_full_sync.go:621
------------------------------
SSSSSSSSSSSSSSSSSSSSS
------------------------------
[csi-vcp-mig] VCP to CSI migration create/delete tests
Create volumes using VCP SC with parameters not supported by CSI before and after migration
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_create_delete.go:280
[BeforeEach] [csi-vcp-mig] VCP to CSI migration create/delete tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/go/pkg/mod/k8s.io/kubernetes@v1.24.2/test/e2e/framework/framework.go:187
STEP: Creating a kubernetes client
Jul 4 04:18:31.574: INFO: >>> kubeConfig: /home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config
STEP: Building a namespace api object, basename csi-vcp-mig-create-del
STEP: Waiting for a default service account to be provisioned in namespace
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[BeforeEach] [csi-vcp-mig] VCP to CSI migration create/delete tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_create_delete.go:64
Jul 4 04:18:39.527: INFO: Search candidates vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 04:18:39.527: INFO: Searching for node with UUID: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 04:18:39.527: INFO: Searching for node with UUID: 4201f777-84d8-9463-c37d-868274d333cb
Jul 4 04:18:39.527: INFO: Searching for node with UUID: 42019a83-8fab-0ed3-6745-5980c88e61be
Jul 4 04:18:39.527: INFO: Searching for node with UUID: 42019292-0601-e6cc-cf83-9e7ad2ff1147
Jul 4 04:18:39.527: INFO: Searching for node with UUID: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 04:18:39.527: INFO: Searching for node with UUID: 4201c124-84e2-596b-a670-ef0e99be85a5
Jul 4 04:18:40.246: INFO: Found node k8s-node-990-1656928220 as vm=VirtualMachine:vm-53 placed on host=HostSystem:host-16 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 04:18:40.589: INFO: Found node k8s-control-280-1656928192 as vm=VirtualMachine:vm-54 placed on host=HostSystem:host-28 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 04:18:40.665: INFO: Found node k8s-control-292-1656928177 as vm=VirtualMachine:vm-50 placed on host=HostSystem:host-22 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 04:18:40.802: INFO: Found node k8s-node-148-1656928247 as vm=VirtualMachine:vm-51 placed on host=HostSystem:host-28 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 04:18:40.839: INFO: Found node k8s-control-468-1656928206 as vm=VirtualMachine:vm-55 placed on host=HostSystem:host-34 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 04:18:40.846: INFO: Found node k8s-node-236-1656928234 as vm=VirtualMachine:vm-52 placed on host=HostSystem:host-34 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 04:18:40.859: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.43.70
Jul 4 04:18:42.211: INFO: host: 10.185.43.70, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 1, stdout: , stderr:
[It] Create volumes using VCP SC with parameters not supported by CSI before and after migration
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_create_delete.go:280
STEP: Creating VCP SCs
STEP: Creating StorageClass with scParameters: map[datastore:vsanDatastore hostfailurestotolerate:1] and zones: [] and ReclaimPolicy: and allowVolumeExpansion: false
STEP: Creating VCP PVCs before migration
STEP: Creating PVC using the Storage Class vcp-sc-sg5gw with disk size and labels: map[] accessMode:
Jul 4 04:18:42.255: INFO: PVC created: pvc-p62bw in namespace: csi-vcp-mig-create-del-4538
STEP: Waiting for all claims created before migration to be in bound state
Jul 4 04:18:42.255: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [pvc-p62bw] to have phase Bound
Jul 4 04:18:42.271: INFO: PersistentVolumeClaim pvc-p62bw found but phase is Pending instead of Bound.
Jul 4 04:18:44.282: INFO: PersistentVolumeClaim pvc-p62bw found but phase is Pending instead of Bound.
Jul 4 04:18:46.294: INFO: PersistentVolumeClaim pvc-p62bw found but phase is Pending instead of Bound.
Jul 4 04:18:48.301: INFO: PersistentVolumeClaim pvc-p62bw found but phase is Pending instead of Bound.
Jul 4 04:18:50.330: INFO: PersistentVolumeClaim pvc-p62bw found but phase is Pending instead of Bound.
Jul 4 04:18:52.340: INFO: PersistentVolumeClaim pvc-p62bw found and phase=Bound (10.08437889s)
STEP: Enabling CSIMigration and CSIMigrationvSphere feature gates on kube-controller-manager
Jul 4 04:18:52.364: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.43.70
Jul 4 04:18:53.539: INFO: host: 10.185.43.70, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 1, stdout: , stderr:
Jul 4 04:18:53.539: INFO: Invoking command gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.43.70
Jul 4 04:18:54.301: INFO: host: 10.185.43.70, command: gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 04:18:54.301: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.43.70
Jul 4 04:18:55.193: INFO: host: 10.185.43.70, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 04:18:55.193: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.45.237
Jul 4 04:18:56.001: INFO: host: 10.185.45.237, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 1, stdout: , stderr:
Jul 4 04:18:56.001: INFO: Invoking command gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.45.237
Jul 4 04:18:56.771: INFO: host: 10.185.45.237, command: gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 04:18:56.771: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.45.237
Jul 4 04:18:57.671: INFO: host: 10.185.45.237, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 04:18:57.671: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.32.9
Jul 4 04:18:58.946: INFO: host: 10.185.32.9, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 1, stdout: , stderr:
Jul 4 04:18:58.947: INFO: Invoking command gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.32.9
Jul 4 04:18:59.806: INFO: host: 10.185.32.9, command: gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 04:18:59.806: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.32.9
Jul 4 04:19:00.871: INFO: host: 10.185.32.9, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 04:19:02.872: INFO: Waiting for 'kube-controller-manager' controller pod to come up within 10m0s seconds
Jul 4 04:19:04.889: INFO: Got 1 pods running and ready, expect: 3
Jul 4 04:19:06.886: INFO: Got 0 pods running and ready, expect: 3
Jul 4 04:19:08.888: INFO: Got 0 pods running and ready, expect: 3
Jul 4 04:19:10.889: INFO: Got 0 pods running and ready, expect: 3
Jul 4 04:19:12.894: INFO: Got 0 pods running and ready, expect: 3
Jul 4 04:19:14.892: INFO: Got 1 pods running and ready, expect: 3
Jul 4 04:19:16.892: INFO: Got 1 pods running and ready, expect: 3
Jul 4 04:19:18.890: INFO: 'kube-controller-manager' controller pod is up and ready within 10m0s seconds
STEP: Waiting for migration related annotations on PV/PVCs created before migration
Jul 4 04:19:18.890: INFO: Checking PVC pvc-p62bw
Jul 4 04:19:18.897: INFO: Annotations found on PVC: pvc-p62bw in namespace:csi-vcp-mig-create-del-4538 are,
(map[string]string) (len=4) {
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 04:19:20.905: INFO: Annotations found on PVC: pvc-p62bw in namespace:csi-vcp-mig-create-del-4538 are,
(map[string]string) (len=4) {
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 04:19:22.908: INFO: Annotations found on PVC: pvc-p62bw in namespace:csi-vcp-mig-create-del-4538 are,
(map[string]string) (len=4) {
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 04:19:24.916: INFO: Annotations found on PVC: pvc-p62bw in namespace:csi-vcp-mig-create-del-4538 are,
(map[string]string) (len=4) {
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 04:19:26.910: INFO: Annotations found on PVC: pvc-p62bw in namespace:csi-vcp-mig-create-del-4538 are,
(map[string]string) (len=4) {
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes"
}
Jul 4 04:19:28.907: INFO: Annotations found on PVC: pvc-p62bw in namespace:csi-vcp-mig-create-del-4538 are,
(map[string]string) (len=5) {
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 04:19:28.907: INFO: Checking PV pvc-65e93794-4c56-4386-a9bc-876c885c873a
Jul 4 04:19:28.916: INFO: Annotations found on PV: pvc-65e93794-4c56-4386-a9bc-876c885c873a are,
(map[string]string) (len=4) {
(string) (len=23) "kubernetes.io/createdby": (string) (len=34) "vsphere-volume-dynamic-provisioner",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=31) "pv.kubernetes.io/provisioned-by": (string) (len=28) "kubernetes.io/vsphere-volume"
}
STEP: Creating VCP PVCs after migration
STEP: Creating PVC using the Storage Class vcp-sc-sg5gw with disk size and labels: map[] accessMode:
Jul 4 04:19:28.963: INFO: PVC created: pvc-554h2 in namespace: csi-vcp-mig-create-del-4538
STEP: Checking for error in events related to pvc pvc-554h2
Jul 4 04:19:58.974: INFO: EventList item: "waiting for a volume to be created, either by external provisioner \"csi.vsphere.vmware.com\" or manually created by system administrator"
Jul 4 04:19:58.974: INFO: EventList item: "External provisioner is provisioning volume for claim \"csi-vcp-mig-create-del-4538/pvc-554h2\""
Jul 4 04:19:58.974: INFO: EventList item: "failed to provision volume with StorageClass \"vcp-sc-sg5gw\": rpc error: code = InvalidArgument desc = parsing storage class parameters failed with error: vSphere CSI driver does not support creating volume using in-tree vSphere volume plugin parameter key:hostfailurestotolerate-migrationparam, value:1"
STEP: Verify CnsVSphereVolumeMigration crds and CNS volume metadata for all volumes created before migration
Jul 4 04:19:59.002: INFO: Processing PVC: pvc-p62bw
Jul 4 04:19:59.150: INFO: Found CNS volume with id 571acfab-5808-4093-bf99-5de4636ec14f
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "571acfab-5808-4093-bf99-5de4636ec14f"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "2aa7661b-fb8b-11ec-8a4e-527b6bf8b324",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=2 cap=2) {
(*types.CnsKubernetesEntityMetadata)(0xc000074780)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-65e93794-4c56-4386-a9bc-876c885c873a",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc000074800)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "pvc-p62bw",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=27) "csi-vcp-mig-create-del-4538",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-65e93794-4c56-4386-a9bc-876c885c873a",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc000541dc0)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 2048
},
BackingDiskId: (string) (len=36) "571acfab-5808-4093-bf99-5de4636ec14f",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "97ccc262-5011-4fb8-7e52-0200883dcaf9"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=13) "notAccessible",
HealthStatus: (string) (len=7) "unknown"
}
Jul 4 04:19:59.150: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:false
[JustAfterEach] [csi-vcp-mig] VCP to CSI migration create/delete tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_create_delete.go:81
Jul 4 04:19:59.205: INFO: Deleting PVC pvc-p62bw
Jul 4 04:20:01.270: INFO: volume "571acfab-5808-4093-bf99-5de4636ec14f" has successfully deleted
Jul 4 04:20:01.270: INFO: Waiting for vmdk [vsanDatastore] 7dc1c262-523a-ca6d-963a-020088cd1d5a/kubernetes-dynamic-pvc-65e93794-4c56-4386-a9bc-876c885c873a.vmdk to be deleted
Jul 4 04:20:01.276: INFO: Looking for default datastore in DC: VSAN-DC
Jul 4 04:20:01.289: INFO: Datstore found for DS URL:ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/
Jul 4 04:20:01.546: INFO: Waiting for CnsVSphereVolumeMigration crds 571acfab-5808-4093-bf99-5de4636ec14f to be deleted
Jul 4 04:20:01.608: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.43.70
Jul 4 04:20:03.095: INFO: host: 10.185.43.70, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true
, stderr:
Jul 4 04:20:03.095: INFO: Invoking command sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.43.70
Jul 4 04:20:03.939: INFO: host: 10.185.43.70, command: sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 04:20:03.939: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.43.70
Jul 4 04:20:04.831: INFO: host: 10.185.43.70, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 04:20:04.831: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.45.237
Jul 4 04:20:06.064: INFO: host: 10.185.45.237, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true
, stderr:
Jul 4 04:20:06.064: INFO: Invoking command sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.45.237
Jul 4 04:20:06.948: INFO: host: 10.185.45.237, command: sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 04:20:06.949: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.45.237
Jul 4 04:20:07.903: INFO: host: 10.185.45.237, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 04:20:07.903: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.32.9
Jul 4 04:20:09.250: INFO: host: 10.185.32.9, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true
, stderr:
Jul 4 04:20:09.250: INFO: Invoking command sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.32.9
Jul 4 04:20:10.146: INFO: host: 10.185.32.9, command: sed -i '/CSIMigration/d' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 04:20:10.146: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.32.9
Jul 4 04:20:11.083: INFO: host: 10.185.32.9, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 04:20:13.084: INFO: Waiting for 'kube-controller-manager' controller pod to come up within 10m0s seconds
Jul 4 04:20:15.103: INFO: Got 1 pods running and ready, expect: 3
Jul 4 04:20:17.103: INFO: Got 0 pods running and ready, expect: 3
Jul 4 04:20:19.114: INFO: Got 0 pods running and ready, expect: 3
Jul 4 04:20:21.103: INFO: Got 1 pods running and ready, expect: 3
Jul 4 04:20:23.106: INFO: Got 2 pods running and ready, expect: 3
Jul 4 04:20:25.104: INFO: 'kube-controller-manager' controller pod is up and ready within 10m0s seconds
[AfterEach] [csi-vcp-mig] VCP to CSI migration create/delete tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/go/pkg/mod/k8s.io/kubernetes@v1.24.2/test/e2e/framework/framework.go:188
Jul 4 04:20:25.124: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "csi-vcp-mig-create-del-4538" for this suite.
• [SLOW TEST:113.577 seconds]
[csi-vcp-mig] VCP to CSI migration create/delete tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_create_delete.go:47
Create volumes using VCP SC with parameters not supported by CSI before and after migration
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_create_delete.go:280
------------------------------
SSSSSSSSSS
------------------------------
[csi-vcp-mig] VCP to CSI migration syncer tests
Statefulsets label and pod name updates
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_syncer.go:717
[BeforeEach] [csi-vcp-mig] VCP to CSI migration syncer tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/go/pkg/mod/k8s.io/kubernetes@v1.24.2/test/e2e/framework/framework.go:187
STEP: Creating a kubernetes client
Jul 4 04:20:25.151: INFO: >>> kubeConfig: /home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config
STEP: Building a namespace api object, basename vcp-2-csi-syncer
STEP: Waiting for a default service account to be provisioned in namespace
STEP: Waiting for kube-root-ca.crt to be provisioned in namespace
[BeforeEach] [csi-vcp-mig] VCP to CSI migration syncer tests
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_syncer.go:78
Jul 4 04:20:39.170: INFO: Search candidates vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 04:20:39.170: INFO: Searching for node with UUID: 42012696-a5ac-0b47-440b-883314beee49
Jul 4 04:20:39.170: INFO: Searching for node with UUID: 4201f777-84d8-9463-c37d-868274d333cb
Jul 4 04:20:39.170: INFO: Searching for node with UUID: 42019a83-8fab-0ed3-6745-5980c88e61be
Jul 4 04:20:39.170: INFO: Searching for node with UUID: 42019292-0601-e6cc-cf83-9e7ad2ff1147
Jul 4 04:20:39.170: INFO: Searching for node with UUID: 42012c70-2cfc-49b2-410d-e65427bd134c
Jul 4 04:20:39.170: INFO: Searching for node with UUID: 4201c124-84e2-596b-a670-ef0e99be85a5
Jul 4 04:20:39.987: INFO: Found node k8s-node-990-1656928220 as vm=VirtualMachine:vm-53 placed on host=HostSystem:host-16 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 04:20:40.098: INFO: Found node k8s-control-292-1656928177 as vm=VirtualMachine:vm-50 placed on host=HostSystem:host-22 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 04:20:40.183: INFO: Found node k8s-control-468-1656928206 as vm=VirtualMachine:vm-55 placed on host=HostSystem:host-34 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 04:20:40.185: INFO: Found node k8s-control-280-1656928192 as vm=VirtualMachine:vm-54 placed on host=HostSystem:host-28 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 04:20:40.298: INFO: Found node k8s-node-148-1656928247 as vm=VirtualMachine:vm-51 placed on host=HostSystem:host-28 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 04:20:40.347: INFO: Found node k8s-node-236-1656928234 as vm=VirtualMachine:vm-52 placed on host=HostSystem:host-34 under zones [] in vc=10.185.39.37 and datacenter=VSAN-DC
Jul 4 04:20:40.373: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
Jul 4 04:20:40.382: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
Jul 4 04:20:40.390: INFO: Annotation seen on CSI node - storage.alpha.kubernetes.io/migrated-plugins:kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd
Jul 4 04:20:40.398: INFO: Waiting up to 10m0s for all pods (need at least 0) in namespace 'vcp-2-csi-syncer-8266' to be running and ready
Jul 4 04:20:40.419: INFO: 0 / 0 pods in namespace 'vcp-2-csi-syncer-8266' are running and ready (0 seconds elapsed)
Jul 4 04:20:40.419: INFO: expected 0 pod replicas in namespace 'vcp-2-csi-syncer-8266', 0 are Running and Ready.
Jul 4 04:20:40.428: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.43.70
Jul 4 04:20:42.064: INFO: host: 10.185.43.70, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 1, stdout: , stderr:
[It] Statefulsets label and pod name updates
/home/worker/workspace/vcp-to-csi-migration/Results/420/vsphere-csi-driver/tests/e2e/vcp_to_csi_syncer.go:717
STEP: Creating VCP SC
STEP: Creating StorageClass with scParameters: map[datastore:vsanDatastore] and zones: [] and ReclaimPolicy: and allowVolumeExpansion: false
Jul 4 04:20:42.085: INFO: Parsing statefulset from tests/e2e/testing-manifests/statefulset/nginx/statefulset.yaml
STEP: Creating statefulset and waiting for the replicas to be ready
Jul 4 04:20:42.088: INFO: Creating statefulset vcp-2-csi-syncer-8266/web with 3 replicas and selector &LabelSelector{MatchLabels:map[string]string{app: nginx,},MatchExpressions:[]LabelSelectorRequirement{},}
Jul 4 04:20:42.134: INFO: Found 0 stateful pods, waiting for 3
Jul 4 04:20:52.148: INFO: Waiting for pod web-0 to enter Running - Ready=true, currently Pending - Ready=false
Jul 4 04:21:02.148: INFO: Waiting for pod web-0 to enter Running - Ready=true, currently Pending - Ready=false
Jul 4 04:21:12.164: INFO: Waiting for pod web-0 to enter Running - Ready=true, currently Running - Ready=true
Jul 4 04:21:12.164: INFO: Waiting for pod web-1 to enter Running - Ready=true, currently Running - Ready=true
Jul 4 04:21:12.164: INFO: Waiting for pod web-2 to enter Running - Ready=true, currently Running - Ready=true
Jul 4 04:21:12.164: INFO: Waiting for statefulset status.replicas updated to 3
Jul 4 04:21:12.182: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-syncer-8266 exec web-0 -- /bin/sh -x -c ls -idlh /usr/share/nginx/html'
Jul 4 04:21:12.494: INFO: stderr: "+ ls -idlh /usr/share/nginx/html\n"
Jul 4 04:21:12.494: INFO: stdout: "2 drwxr-xr-x 3 root root 4.0K Jul 4 11:20 /usr/share/nginx/html\n"
Jul 4 04:21:12.494: INFO: stdout of ls -idlh /usr/share/nginx/html on web-0: 2 drwxr-xr-x 3 root root 4.0K Jul 4 11:20 /usr/share/nginx/html
Jul 4 04:21:12.494: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-syncer-8266 exec web-1 -- /bin/sh -x -c ls -idlh /usr/share/nginx/html'
Jul 4 04:21:12.772: INFO: stderr: "+ ls -idlh /usr/share/nginx/html\n"
Jul 4 04:21:12.772: INFO: stdout: "2 drwxr-xr-x 3 root root 4.0K Jul 4 11:20 /usr/share/nginx/html\n"
Jul 4 04:21:12.772: INFO: stdout of ls -idlh /usr/share/nginx/html on web-1: 2 drwxr-xr-x 3 root root 4.0K Jul 4 11:20 /usr/share/nginx/html
Jul 4 04:21:12.772: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-syncer-8266 exec web-2 -- /bin/sh -x -c ls -idlh /usr/share/nginx/html'
Jul 4 04:21:13.212: INFO: stderr: "+ ls -idlh /usr/share/nginx/html\n"
Jul 4 04:21:13.212: INFO: stdout: "2 drwxr-xr-x 3 root root 4.0K Jul 4 11:20 /usr/share/nginx/html\n"
Jul 4 04:21:13.212: INFO: stdout of ls -idlh /usr/share/nginx/html on web-2: 2 drwxr-xr-x 3 root root 4.0K Jul 4 11:20 /usr/share/nginx/html
Jul 4 04:21:13.227: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-syncer-8266 exec web-0 -- /bin/sh -x -c find /usr/share/nginx/html'
Jul 4 04:21:13.463: INFO: stderr: "+ find /usr/share/nginx/html\n"
Jul 4 04:21:13.463: INFO: stdout: "/usr/share/nginx/html\n/usr/share/nginx/html/lost+found\n"
Jul 4 04:21:13.463: INFO: stdout of find /usr/share/nginx/html on web-0: /usr/share/nginx/html
/usr/share/nginx/html/lost+found
Jul 4 04:21:13.463: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-syncer-8266 exec web-1 -- /bin/sh -x -c find /usr/share/nginx/html'
Jul 4 04:21:13.715: INFO: stderr: "+ find /usr/share/nginx/html\n"
Jul 4 04:21:13.715: INFO: stdout: "/usr/share/nginx/html\n/usr/share/nginx/html/lost+found\n"
Jul 4 04:21:13.715: INFO: stdout of find /usr/share/nginx/html on web-1: /usr/share/nginx/html
/usr/share/nginx/html/lost+found
Jul 4 04:21:13.715: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-syncer-8266 exec web-2 -- /bin/sh -x -c find /usr/share/nginx/html'
Jul 4 04:21:13.968: INFO: stderr: "+ find /usr/share/nginx/html\n"
Jul 4 04:21:13.968: INFO: stdout: "/usr/share/nginx/html\n/usr/share/nginx/html/lost+found\n"
Jul 4 04:21:13.968: INFO: stdout of find /usr/share/nginx/html on web-2: /usr/share/nginx/html
/usr/share/nginx/html/lost+found
Jul 4 04:21:13.977: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-syncer-8266 exec web-0 -- /bin/sh -x -c touch /usr/share/nginx/html/1656933672173786907'
Jul 4 04:21:14.212: INFO: stderr: "+ touch /usr/share/nginx/html/1656933672173786907\n"
Jul 4 04:21:14.212: INFO: stdout: ""
Jul 4 04:21:14.212: INFO: stdout of touch /usr/share/nginx/html/1656933672173786907 on web-0:
Jul 4 04:21:14.212: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-syncer-8266 exec web-1 -- /bin/sh -x -c touch /usr/share/nginx/html/1656933672173786907'
Jul 4 04:21:14.418: INFO: stderr: "+ touch /usr/share/nginx/html/1656933672173786907\n"
Jul 4 04:21:14.418: INFO: stdout: ""
Jul 4 04:21:14.418: INFO: stdout of touch /usr/share/nginx/html/1656933672173786907 on web-1:
Jul 4 04:21:14.418: INFO: Running '/usr/bin/kubectl --kubeconfig=/home/worker/workspace/vcp-to-csi-migration/Results/420/.kube/config --namespace=vcp-2-csi-syncer-8266 exec web-2 -- /bin/sh -x -c touch /usr/share/nginx/html/1656933672173786907'
Jul 4 04:21:14.692: INFO: stderr: "+ touch /usr/share/nginx/html/1656933672173786907\n"
Jul 4 04:21:14.692: INFO: stdout: ""
Jul 4 04:21:14.692: INFO: stdout of touch /usr/share/nginx/html/1656933672173786907 on web-2:
STEP: Enabling CSIMigration and CSIMigrationvSphere feature gates on kube-controller-manager
Jul 4 04:21:14.785: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.43.70
Jul 4 04:21:16.384: INFO: host: 10.185.43.70, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 1, stdout: , stderr:
Jul 4 04:21:16.384: INFO: Invoking command gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.43.70
Jul 4 04:21:17.475: INFO: host: 10.185.43.70, command: gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 04:21:17.475: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.43.70
Jul 4 04:21:18.438: INFO: host: 10.185.43.70, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 04:21:18.438: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.45.237
Jul 4 04:21:19.704: INFO: host: 10.185.45.237, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 1, stdout: , stderr:
Jul 4 04:21:19.704: INFO: Invoking command gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.45.237
Jul 4 04:21:20.712: INFO: host: 10.185.45.237, command: gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 04:21:20.712: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.45.237
Jul 4 04:21:21.704: INFO: host: 10.185.45.237, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 04:21:21.704: INFO: Invoking command 'grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml' on host 10.185.32.9
Jul 4 04:21:23.809: INFO: host: 10.185.32.9, command: grep CSIMigration /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 1, stdout: , stderr:
Jul 4 04:21:23.809: INFO: Invoking command gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml on host 10.185.32.9
Jul 4 04:21:24.824: INFO: host: 10.185.32.9, command: gawk -i inplace '/--bind-addres/ { print; print " - --feature-gates=CSIMigration=true,CSIMigrationvSphere=true"; next }1' /etc/kubernetes/manifests/kube-controller-manager.yaml, return code: 0, stdout: , stderr:
Jul 4 04:21:24.824: INFO: Invoking command 'systemctl restart kubelet' on host 10.185.32.9
Jul 4 04:21:25.772: INFO: host: 10.185.32.9, command: systemctl restart kubelet, return code: 0, stdout: , stderr:
Jul 4 04:21:27.772: INFO: Waiting for 'kube-controller-manager' controller pod to come up within 10m0s seconds
Jul 4 04:21:29.792: INFO: Got 1 pods running and ready, expect: 3
Jul 4 04:21:31.794: INFO: Got 0 pods running and ready, expect: 3
Jul 4 04:21:33.795: INFO: Got 0 pods running and ready, expect: 3
Jul 4 04:21:35.792: INFO: Got 0 pods running and ready, expect: 3
Jul 4 04:21:37.794: INFO: Got 2 pods running and ready, expect: 3
Jul 4 04:21:39.801: INFO: Got 2 pods running and ready, expect: 3
Jul 4 04:21:41.799: INFO: Got 2 pods running and ready, expect: 3
Jul 4 04:21:43.794: INFO: 'kube-controller-manager' controller pod is up and ready within 10m0s seconds
STEP: Waiting for migration related annotations on PV/PVCs created before migration
Jul 4 04:21:43.794: INFO: Checking PVC www-web-0
Jul 4 04:21:43.807: INFO: Annotations found on PVC: www-web-0 in namespace:vcp-2-csi-syncer-8266 are,
(map[string]string) (len=5) {
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=39) "volume.beta.kubernetes.io/storage-class": (string) (len=12) "vcp-sc-zqjgj",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 04:21:45.817: INFO: Annotations found on PVC: www-web-0 in namespace:vcp-2-csi-syncer-8266 are,
(map[string]string) (len=5) {
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=39) "volume.beta.kubernetes.io/storage-class": (string) (len=12) "vcp-sc-zqjgj",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 04:21:47.819: INFO: Annotations found on PVC: www-web-0 in namespace:vcp-2-csi-syncer-8266 are,
(map[string]string) (len=5) {
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=39) "volume.beta.kubernetes.io/storage-class": (string) (len=12) "vcp-sc-zqjgj",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 04:21:49.818: INFO: Annotations found on PVC: www-web-0 in namespace:vcp-2-csi-syncer-8266 are,
(map[string]string) (len=5) {
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=39) "volume.beta.kubernetes.io/storage-class": (string) (len=12) "vcp-sc-zqjgj",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 04:21:51.819: INFO: Annotations found on PVC: www-web-0 in namespace:vcp-2-csi-syncer-8266 are,
(map[string]string) (len=6) {
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=39) "volume.beta.kubernetes.io/storage-class": (string) (len=12) "vcp-sc-zqjgj",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes"
}
Jul 4 04:21:51.819: INFO: Checking PVC www-web-1
Jul 4 04:21:51.827: INFO: Annotations found on PVC: www-web-1 in namespace:vcp-2-csi-syncer-8266 are,
(map[string]string) (len=6) {
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=39) "volume.beta.kubernetes.io/storage-class": (string) (len=12) "vcp-sc-zqjgj",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes"
}
Jul 4 04:21:51.827: INFO: Checking PVC www-web-2
Jul 4 04:21:51.833: INFO: Annotations found on PVC: www-web-2 in namespace:vcp-2-csi-syncer-8266 are,
(map[string]string) (len=6) {
(string) (len=31) "pv.kubernetes.io/bind-completed": (string) (len=3) "yes",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=39) "volume.beta.kubernetes.io/storage-class": (string) (len=12) "vcp-sc-zqjgj",
(string) (len=45) "volume.beta.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=40) "volume.kubernetes.io/storage-provisioner": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 04:21:51.833: INFO: Checking PV pvc-bdc8565b-676a-4b7f-9b74-12dc3ea2b33d
Jul 4 04:21:51.838: INFO: Annotations found on PV: pvc-bdc8565b-676a-4b7f-9b74-12dc3ea2b33d are,
(map[string]string) (len=4) {
(string) (len=31) "pv.kubernetes.io/provisioned-by": (string) (len=28) "kubernetes.io/vsphere-volume",
(string) (len=23) "kubernetes.io/createdby": (string) (len=34) "vsphere-volume-dynamic-provisioner",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com"
}
Jul 4 04:21:51.838: INFO: Checking PV pvc-2d473567-3a4f-47c0-b8dd-30dc72bc6ac0
Jul 4 04:21:51.844: INFO: Annotations found on PV: pvc-2d473567-3a4f-47c0-b8dd-30dc72bc6ac0 are,
(map[string]string) (len=4) {
(string) (len=23) "kubernetes.io/createdby": (string) (len=34) "vsphere-volume-dynamic-provisioner",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=31) "pv.kubernetes.io/provisioned-by": (string) (len=28) "kubernetes.io/vsphere-volume"
}
Jul 4 04:21:51.844: INFO: Checking PV pvc-bae65e35-e8b4-4c5a-8c56-75c23edc9f16
Jul 4 04:21:51.851: INFO: Annotations found on PV: pvc-bae65e35-e8b4-4c5a-8c56-75c23edc9f16 are,
(map[string]string) (len=4) {
(string) (len=23) "kubernetes.io/createdby": (string) (len=34) "vsphere-volume-dynamic-provisioner",
(string) (len=36) "pv.kubernetes.io/bound-by-controller": (string) (len=3) "yes",
(string) (len=28) "pv.kubernetes.io/migrated-to": (string) (len=22) "csi.vsphere.vmware.com",
(string) (len=31) "pv.kubernetes.io/provisioned-by": (string) (len=28) "kubernetes.io/vsphere-volume"
}
STEP: Verify CnsVSphereVolumeMigration crds and CNS volume metadata on pvc created before migration
Jul 4 04:21:51.851: INFO: Checking PVC www-web-0
Jul 4 04:21:51.864: INFO: Processing PVC: www-web-0
Jul 4 04:21:56.012: INFO: For pod 'web-0', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:www,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:www-web-0,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-lm6wx,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 04:21:56.512: INFO: Found CNS volume with id 89c5ae13-1075-4953-b7a5-eebe0891998f
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "89c5ae13-1075-4953-b7a5-eebe0891998f"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "804d5728-fb8b-11ec-8a4e-527b6bf8b324",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) <nil>,
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc0012a2940)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 1024
},
BackingDiskId: (string) (len=36) "89c5ae13-1075-4953-b7a5-eebe0891998f",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "0bcdc262-d47b-bb55-1748-020088529ac5"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 04:21:56.512: INFO: pvEntryFound:false, verifyPvEntry:true, pvcEntryFound:false, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:true
Jul 4 04:22:06.921: INFO: Found CNS volume with id 89c5ae13-1075-4953-b7a5-eebe0891998f
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "89c5ae13-1075-4953-b7a5-eebe0891998f"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "804d5728-fb8b-11ec-8a4e-527b6bf8b324",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=2 cap=2) {
(*types.CnsKubernetesEntityMetadata)(0xc001256480)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-bdc8565b-676a-4b7f-9b74-12dc3ea2b33d",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc001256580)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "www-web-0",
Labels: ([]types.KeyValue) (len=1 cap=1) {
(types.KeyValue) {
DynamicData: (types.DynamicData) {
},
Key: (string) (len=3) "app",
Value: (string) (len=5) "nginx"
}
},
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=21) "vcp-2-csi-syncer-8266",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-bdc8565b-676a-4b7f-9b74-12dc3ea2b33d",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc00071aac0)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 1024
},
BackingDiskId: (string) (len=36) "89c5ae13-1075-4953-b7a5-eebe0891998f",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "0bcdc262-d47b-bb55-1748-020088529ac5"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 04:22:06.921: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:true
Jul 4 04:22:16.931: INFO: Found CNS volume with id 89c5ae13-1075-4953-b7a5-eebe0891998f
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "89c5ae13-1075-4953-b7a5-eebe0891998f"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "804d5728-fb8b-11ec-8a4e-527b6bf8b324",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=2 cap=2) {
(*types.CnsKubernetesEntityMetadata)(0xc0014be800)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-bdc8565b-676a-4b7f-9b74-12dc3ea2b33d",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc0014be880)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "www-web-0",
Labels: ([]types.KeyValue) (len=1 cap=1) {
(types.KeyValue) {
DynamicData: (types.DynamicData) {
},
Key: (string) (len=3) "app",
Value: (string) (len=5) "nginx"
}
},
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=21) "vcp-2-csi-syncer-8266",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-bdc8565b-676a-4b7f-9b74-12dc3ea2b33d",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc001390ac0)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 1024
},
BackingDiskId: (string) (len=36) "89c5ae13-1075-4953-b7a5-eebe0891998f",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "0bcdc262-d47b-bb55-1748-020088529ac5"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 04:22:16.931: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:true
Jul 4 04:22:26.937: INFO: Found CNS volume with id 89c5ae13-1075-4953-b7a5-eebe0891998f
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "89c5ae13-1075-4953-b7a5-eebe0891998f"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "804d5728-fb8b-11ec-8a4e-527b6bf8b324",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=2 cap=2) {
(*types.CnsKubernetesEntityMetadata)(0xc0014bea80)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-bdc8565b-676a-4b7f-9b74-12dc3ea2b33d",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc0014beb00)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "www-web-0",
Labels: ([]types.KeyValue) (len=1 cap=1) {
(types.KeyValue) {
DynamicData: (types.DynamicData) {
},
Key: (string) (len=3) "app",
Value: (string) (len=5) "nginx"
}
},
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=21) "vcp-2-csi-syncer-8266",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-bdc8565b-676a-4b7f-9b74-12dc3ea2b33d",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc000596cc0)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 1024
},
BackingDiskId: (string) (len=36) "89c5ae13-1075-4953-b7a5-eebe0891998f",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "0bcdc262-d47b-bb55-1748-020088529ac5"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 04:22:26.937: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:true
Jul 4 04:22:37.126: INFO: Found CNS volume with id 89c5ae13-1075-4953-b7a5-eebe0891998f
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "89c5ae13-1075-4953-b7a5-eebe0891998f"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "804d5728-fb8b-11ec-8a4e-527b6bf8b324",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=2 cap=2) {
(*types.CnsKubernetesEntityMetadata)(0xc0014bed00)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-bdc8565b-676a-4b7f-9b74-12dc3ea2b33d",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc0014bed80)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "www-web-0",
Labels: ([]types.KeyValue) (len=1 cap=1) {
(types.KeyValue) {
DynamicData: (types.DynamicData) {
},
Key: (string) (len=3) "app",
Value: (string) (len=5) "nginx"
}
},
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=21) "vcp-2-csi-syncer-8266",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-bdc8565b-676a-4b7f-9b74-12dc3ea2b33d",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc000698e00)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 1024
},
BackingDiskId: (string) (len=36) "89c5ae13-1075-4953-b7a5-eebe0891998f",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "0bcdc262-d47b-bb55-1748-020088529ac5"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 04:22:37.126: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:true
Jul 4 04:22:46.951: INFO: Found CNS volume with id 89c5ae13-1075-4953-b7a5-eebe0891998f
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "89c5ae13-1075-4953-b7a5-eebe0891998f"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "804d5728-fb8b-11ec-8a4e-527b6bf8b324",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=2 cap=2) {
(*types.CnsKubernetesEntityMetadata)(0xc001257280)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-bdc8565b-676a-4b7f-9b74-12dc3ea2b33d",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc001257480)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "www-web-0",
Labels: ([]types.KeyValue) (len=1 cap=1) {
(types.KeyValue) {
DynamicData: (types.DynamicData) {
},
Key: (string) (len=3) "app",
Value: (string) (len=5) "nginx"
}
},
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=21) "vcp-2-csi-syncer-8266",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-bdc8565b-676a-4b7f-9b74-12dc3ea2b33d",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc0018f7000)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 1024
},
BackingDiskId: (string) (len=36) "89c5ae13-1075-4953-b7a5-eebe0891998f",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "0bcdc262-d47b-bb55-1748-020088529ac5"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 04:22:46.951: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:true
Jul 4 04:22:56.952: INFO: Found CNS volume with id 89c5ae13-1075-4953-b7a5-eebe0891998f
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "89c5ae13-1075-4953-b7a5-eebe0891998f"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "804d5728-fb8b-11ec-8a4e-527b6bf8b324",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=2 cap=2) {
(*types.CnsKubernetesEntityMetadata)(0xc001257880)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-bdc8565b-676a-4b7f-9b74-12dc3ea2b33d",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc001257900)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "www-web-0",
Labels: ([]types.KeyValue) (len=1 cap=1) {
(types.KeyValue) {
DynamicData: (types.DynamicData) {
},
Key: (string) (len=3) "app",
Value: (string) (len=5) "nginx"
}
},
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=21) "vcp-2-csi-syncer-8266",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-bdc8565b-676a-4b7f-9b74-12dc3ea2b33d",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc000c58d80)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 1024
},
BackingDiskId: (string) (len=36) "89c5ae13-1075-4953-b7a5-eebe0891998f",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "0bcdc262-d47b-bb55-1748-020088529ac5"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 04:22:56.952: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:false, verifyPodEntry:true
Jul 4 04:23:06.915: INFO: Found CNS volume with id 89c5ae13-1075-4953-b7a5-eebe0891998f
(types.CnsVolume) {
DynamicData: (types.DynamicData) {
},
VolumeId: (types.CnsVolumeId) {
DynamicData: (types.DynamicData) {
},
Id: (string) (len=36) "89c5ae13-1075-4953-b7a5-eebe0891998f"
},
DatastoreUrl: (string) (len=58) "ds:///vmfs/volumes/vsan:5250f9561b393e06-86f26008251c38b2/",
Name: (string) (len=36) "804d5728-fb8b-11ec-8a4e-527b6bf8b324",
VolumeType: (string) (len=5) "BLOCK",
StoragePolicyId: (string) "",
Metadata: (types.CnsVolumeMetadata) {
DynamicData: (types.DynamicData) {
},
ContainerCluster: (types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
},
EntityMetadata: ([]types.BaseCnsEntityMetadata) (len=3 cap=4) {
(*types.CnsKubernetesEntityMetadata)(0xc001257d00)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=40) "pvc-bdc8565b-676a-4b7f-9b74-12dc3ea2b33d",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
Namespace: (string) "",
ReferredEntity: ([]types.CnsKubernetesEntityReference) <nil>
}),
(*types.CnsKubernetesEntityMetadata)(0xc001257e00)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=5) "web-0",
Labels: ([]types.KeyValue) <nil>,
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=3) "POD",
Namespace: (string) (len=21) "vcp-2-csi-syncer-8266",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
EntityName: (string) (len=9) "www-web-0",
Namespace: (string) (len=21) "vcp-2-csi-syncer-8266",
ClusterID: (string) (len=8) "cluster1"
}
}
}),
(*types.CnsKubernetesEntityMetadata)(0xc001257f00)({
CnsEntityMetadata: (types.CnsEntityMetadata) {
DynamicData: (types.DynamicData) {
},
EntityName: (string) (len=9) "www-web-0",
Labels: ([]types.KeyValue) (len=1 cap=1) {
(types.KeyValue) {
DynamicData: (types.DynamicData) {
},
Key: (string) (len=3) "app",
Value: (string) (len=5) "nginx"
}
},
Delete: (bool) false,
ClusterID: (string) (len=8) "cluster1"
},
EntityType: (string) (len=23) "PERSISTENT_VOLUME_CLAIM",
Namespace: (string) (len=21) "vcp-2-csi-syncer-8266",
ReferredEntity: ([]types.CnsKubernetesEntityReference) (len=1 cap=1) {
(types.CnsKubernetesEntityReference) {
EntityType: (string) (len=17) "PERSISTENT_VOLUME",
EntityName: (string) (len=40) "pvc-bdc8565b-676a-4b7f-9b74-12dc3ea2b33d",
Namespace: (string) "",
ClusterID: (string) (len=8) "cluster1"
}
}
})
},
ContainerClusterArray: ([]types.CnsContainerCluster) (len=1 cap=1) {
(types.CnsContainerCluster) {
DynamicData: (types.DynamicData) {
},
ClusterType: (string) (len=10) "KUBERNETES",
ClusterId: (string) (len=8) "cluster1",
VSphereUser: (string) (len=27) "Administrator@vsphere.local",
ClusterFlavor: (string) (len=7) "VANILLA",
ClusterDistribution: (string) (len=11) "CSI-Vanilla"
}
}
},
BackingObjectDetails: (*types.CnsBlockBackingDetails)(0xc000ed27c0)({
CnsBackingObjectDetails: (types.CnsBackingObjectDetails) {
DynamicData: (types.DynamicData) {
},
CapacityInMb: (int64) 1024
},
BackingDiskId: (string) (len=36) "89c5ae13-1075-4953-b7a5-eebe0891998f",
BackingDiskUrlPath: (string) "",
BackingDiskObjectId: (string) (len=36) "0bcdc262-d47b-bb55-1748-020088529ac5"
}),
ComplianceStatus: (string) "",
DatastoreAccessibilityStatus: (string) (len=10) "accessible",
HealthStatus: (string) (len=5) "green"
}
Jul 4 04:23:06.915: INFO: pvEntryFound:true, verifyPvEntry:true, pvcEntryFound:true, verifyPvcEntry:true, podEntryFound:true, verifyPodEntry:true
Jul 4 04:23:06.915: INFO: Checking PVC www-web-1
Jul 4 04:23:06.931: INFO: Processing PVC: www-web-1
Jul 4 04:23:06.983: INFO: For pod 'web-0', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:www,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:www-web-0,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-lm6wx,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},}
}
Jul 4 04:23:06.983: INFO: For pod 'web-1', volumes:
([]v1.Volume) (len=2 cap=2) {
(v1.Volume) &Volume{Name:www,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:&PersistentVolumeClaimVolumeSource{ClaimName:www-web-1,ReadOnly:false,},RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:nil,StorageOS:nil,CSI:nil,Ephemeral:nil,},},
(v1.Volume) &Volume{Name:kube-api-access-hkvn8,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment