Skip to content

Instantly share code, notes, and snippets.

@ianb-mp
Last active April 19, 2024 11:40
Show Gist options
  • Save ianb-mp/05834c3cfb8da198ed5c4f89cb68b201 to your computer and use it in GitHub Desktop.
Save ianb-mp/05834c3cfb8da198ed5c4f89cb68b201 to your computer and use it in GitHub Desktop.
zfs-localpv error 2024-04-19
apiVersion: v1
items:
- apiVersion: storage.k8s.io/v1
kind: CSINode
metadata:
annotations:
storage.alpha.kubernetes.io/migrated-plugins: kubernetes.io/aws-ebs,kubernetes.io/azure-disk,kubernetes.io/azure-file,kubernetes.io/cinder,kubernetes.io/gce-pd,kubernetes.io/vsphere-volume
creationTimestamp: "2024-04-16T22:30:43Z"
name: bne-lab-vr-2.i.example.com
ownerReferences:
- apiVersion: v1
kind: Node
name: bne-lab-vr-2.i.example.com
uid: 97df1eba-a604-459f-9bb7-dc63f0a4afaa
resourceVersion: "1316802"
uid: 5d9c86fc-b1be-4b85-afbf-0e065b05a04d
spec:
drivers:
- name: local.csi.openebs.io
nodeID: bne-lab-vr-2.i.example.com
topologyKeys:
- kubernetes.io/hostname
- openebs.io/nodename
- name: zfs.csi.openebs.io
nodeID: bne-lab-vr-2.i.example.com
topologyKeys:
- beta.kubernetes.io/arch
- beta.kubernetes.io/instance-type
- beta.kubernetes.io/os
- cpu-feature.node.kubevirt.io/3dnowprefetch
- cpu-feature.node.kubevirt.io/abm
- cpu-feature.node.kubevirt.io/adx
- cpu-feature.node.kubevirt.io/aes
- cpu-feature.node.kubevirt.io/amd-ssbd
- cpu-feature.node.kubevirt.io/amd-stibp
- cpu-feature.node.kubevirt.io/apic
- cpu-feature.node.kubevirt.io/arat
- cpu-feature.node.kubevirt.io/arch-capabilities
- cpu-feature.node.kubevirt.io/avx
- cpu-feature.node.kubevirt.io/avx2
- cpu-feature.node.kubevirt.io/avx512bw
- cpu-feature.node.kubevirt.io/avx512cd
- cpu-feature.node.kubevirt.io/avx512dq
- cpu-feature.node.kubevirt.io/avx512f
- cpu-feature.node.kubevirt.io/avx512vl
- cpu-feature.node.kubevirt.io/bmi1
- cpu-feature.node.kubevirt.io/bmi2
- cpu-feature.node.kubevirt.io/clflush
- cpu-feature.node.kubevirt.io/clflushopt
- cpu-feature.node.kubevirt.io/clwb
- cpu-feature.node.kubevirt.io/cmov
- cpu-feature.node.kubevirt.io/cx16
- cpu-feature.node.kubevirt.io/cx8
- cpu-feature.node.kubevirt.io/de
- cpu-feature.node.kubevirt.io/erms
- cpu-feature.node.kubevirt.io/f16c
- cpu-feature.node.kubevirt.io/flush-l1d
- cpu-feature.node.kubevirt.io/fma
- cpu-feature.node.kubevirt.io/fpu
- cpu-feature.node.kubevirt.io/fsgsbase
- cpu-feature.node.kubevirt.io/fxsr
- cpu-feature.node.kubevirt.io/hle
- cpu-feature.node.kubevirt.io/hypervisor
- cpu-feature.node.kubevirt.io/ibpb
- cpu-feature.node.kubevirt.io/ibrs
- cpu-feature.node.kubevirt.io/invpcid
- cpu-feature.node.kubevirt.io/invtsc
- cpu-feature.node.kubevirt.io/lahf_lm
- cpu-feature.node.kubevirt.io/lm
- cpu-feature.node.kubevirt.io/mca
- cpu-feature.node.kubevirt.io/mce
- cpu-feature.node.kubevirt.io/md-clear
- cpu-feature.node.kubevirt.io/mmx
- cpu-feature.node.kubevirt.io/movbe
- cpu-feature.node.kubevirt.io/mpx
- cpu-feature.node.kubevirt.io/msr
- cpu-feature.node.kubevirt.io/mtrr
- cpu-feature.node.kubevirt.io/nx
- cpu-feature.node.kubevirt.io/pae
- cpu-feature.node.kubevirt.io/pat
- cpu-feature.node.kubevirt.io/pcid
- cpu-feature.node.kubevirt.io/pclmuldq
- cpu-feature.node.kubevirt.io/pdcm
- cpu-feature.node.kubevirt.io/pdpe1gb
- cpu-feature.node.kubevirt.io/pge
- cpu-feature.node.kubevirt.io/pku
- cpu-feature.node.kubevirt.io/pni
- cpu-feature.node.kubevirt.io/popcnt
- cpu-feature.node.kubevirt.io/pschange-mc-no
- cpu-feature.node.kubevirt.io/pse
- cpu-feature.node.kubevirt.io/pse36
- cpu-feature.node.kubevirt.io/rdrand
- cpu-feature.node.kubevirt.io/rdseed
- cpu-feature.node.kubevirt.io/rdtscp
- cpu-feature.node.kubevirt.io/rsba
- cpu-feature.node.kubevirt.io/rtm
- cpu-feature.node.kubevirt.io/sep
- cpu-feature.node.kubevirt.io/skip-l1dfl-vmentry
- cpu-feature.node.kubevirt.io/smap
- cpu-feature.node.kubevirt.io/smep
- cpu-feature.node.kubevirt.io/spec-ctrl
- cpu-feature.node.kubevirt.io/ss
- cpu-feature.node.kubevirt.io/ssbd
- cpu-feature.node.kubevirt.io/sse
- cpu-feature.node.kubevirt.io/sse2
- cpu-feature.node.kubevirt.io/sse4.1
- cpu-feature.node.kubevirt.io/sse4.2
- cpu-feature.node.kubevirt.io/ssse3
- cpu-feature.node.kubevirt.io/stibp
- cpu-feature.node.kubevirt.io/syscall
- cpu-feature.node.kubevirt.io/tsc
- cpu-feature.node.kubevirt.io/tsc-deadline
- cpu-feature.node.kubevirt.io/tsc_adjust
- cpu-feature.node.kubevirt.io/umip
- cpu-feature.node.kubevirt.io/vme
- cpu-feature.node.kubevirt.io/vmx
- cpu-feature.node.kubevirt.io/x2apic
- cpu-feature.node.kubevirt.io/xgetbv1
- cpu-feature.node.kubevirt.io/xsave
- cpu-feature.node.kubevirt.io/xsavec
- cpu-feature.node.kubevirt.io/xsaveopt
- cpu-feature.node.kubevirt.io/xsaves
- cpu-model-migration.node.kubevirt.io/Broadwell
- cpu-model-migration.node.kubevirt.io/Broadwell-IBRS
- cpu-model-migration.node.kubevirt.io/Broadwell-noTSX
- cpu-model-migration.node.kubevirt.io/Broadwell-noTSX-IBRS
- cpu-model-migration.node.kubevirt.io/Haswell
- cpu-model-migration.node.kubevirt.io/Haswell-IBRS
- cpu-model-migration.node.kubevirt.io/Haswell-noTSX
- cpu-model-migration.node.kubevirt.io/Haswell-noTSX-IBRS
- cpu-model-migration.node.kubevirt.io/IvyBridge
- cpu-model-migration.node.kubevirt.io/IvyBridge-IBRS
- cpu-model-migration.node.kubevirt.io/Nehalem
- cpu-model-migration.node.kubevirt.io/Nehalem-IBRS
- cpu-model-migration.node.kubevirt.io/Opteron_G1
- cpu-model-migration.node.kubevirt.io/Penryn
- cpu-model-migration.node.kubevirt.io/SandyBridge
- cpu-model-migration.node.kubevirt.io/SandyBridge-IBRS
- cpu-model-migration.node.kubevirt.io/Skylake-Client
- cpu-model-migration.node.kubevirt.io/Skylake-Client-IBRS
- cpu-model-migration.node.kubevirt.io/Skylake-Client-noTSX-IBRS
- cpu-model-migration.node.kubevirt.io/Skylake-Server
- cpu-model-migration.node.kubevirt.io/Skylake-Server-IBRS
- cpu-model-migration.node.kubevirt.io/Skylake-Server-noTSX-IBRS
- cpu-model-migration.node.kubevirt.io/Westmere
- cpu-model-migration.node.kubevirt.io/Westmere-IBRS
- cpu-model.node.kubevirt.io/Broadwell
- cpu-model.node.kubevirt.io/Broadwell-IBRS
- cpu-model.node.kubevirt.io/Broadwell-noTSX
- cpu-model.node.kubevirt.io/Broadwell-noTSX-IBRS
- cpu-model.node.kubevirt.io/Haswell
- cpu-model.node.kubevirt.io/Haswell-IBRS
- cpu-model.node.kubevirt.io/Haswell-noTSX
- cpu-model.node.kubevirt.io/Haswell-noTSX-IBRS
- cpu-model.node.kubevirt.io/IvyBridge
- cpu-model.node.kubevirt.io/IvyBridge-IBRS
- cpu-model.node.kubevirt.io/Nehalem
- cpu-model.node.kubevirt.io/Nehalem-IBRS
- cpu-model.node.kubevirt.io/Opteron_G1
- cpu-model.node.kubevirt.io/Penryn
- cpu-model.node.kubevirt.io/SandyBridge
- cpu-model.node.kubevirt.io/SandyBridge-IBRS
- cpu-model.node.kubevirt.io/Skylake-Client
- cpu-model.node.kubevirt.io/Skylake-Client-IBRS
- cpu-model.node.kubevirt.io/Skylake-Client-noTSX-IBRS
- cpu-model.node.kubevirt.io/Skylake-Server
- cpu-model.node.kubevirt.io/Skylake-Server-IBRS
- cpu-model.node.kubevirt.io/Skylake-Server-noTSX-IBRS
- cpu-model.node.kubevirt.io/Westmere
- cpu-model.node.kubevirt.io/Westmere-IBRS
- cpu-timer.node.kubevirt.io/tsc-frequency
- cpu-timer.node.kubevirt.io/tsc-scalable
- cpu-vendor.node.kubevirt.io/Intel
- cpumanager
- feature.node.kubernetes.io/cpu-cpuid.ADX
- feature.node.kubernetes.io/cpu-cpuid.AESNI
- feature.node.kubernetes.io/cpu-cpuid.AVX
- feature.node.kubernetes.io/cpu-cpuid.AVX2
- feature.node.kubernetes.io/cpu-cpuid.AVX512BW
- feature.node.kubernetes.io/cpu-cpuid.AVX512CD
- feature.node.kubernetes.io/cpu-cpuid.AVX512DQ
- feature.node.kubernetes.io/cpu-cpuid.AVX512F
- feature.node.kubernetes.io/cpu-cpuid.AVX512VL
- feature.node.kubernetes.io/cpu-cpuid.CMPXCHG8
- feature.node.kubernetes.io/cpu-cpuid.FLUSH_L1D
- feature.node.kubernetes.io/cpu-cpuid.FMA3
- feature.node.kubernetes.io/cpu-cpuid.FXSR
- feature.node.kubernetes.io/cpu-cpuid.FXSROPT
- feature.node.kubernetes.io/cpu-cpuid.HLE
- feature.node.kubernetes.io/cpu-cpuid.IA32_ARCH_CAP
- feature.node.kubernetes.io/cpu-cpuid.IBPB
- feature.node.kubernetes.io/cpu-cpuid.LAHF
- feature.node.kubernetes.io/cpu-cpuid.MD_CLEAR
- feature.node.kubernetes.io/cpu-cpuid.MOVBE
- feature.node.kubernetes.io/cpu-cpuid.MPX
- feature.node.kubernetes.io/cpu-cpuid.OSXSAVE
- feature.node.kubernetes.io/cpu-cpuid.RTM
- feature.node.kubernetes.io/cpu-cpuid.SPEC_CTRL_SSBD
- feature.node.kubernetes.io/cpu-cpuid.STIBP
- feature.node.kubernetes.io/cpu-cpuid.SYSCALL
- feature.node.kubernetes.io/cpu-cpuid.SYSEE
- feature.node.kubernetes.io/cpu-cpuid.VMX
- feature.node.kubernetes.io/cpu-cpuid.X87
- feature.node.kubernetes.io/cpu-cpuid.XGETBV1
- feature.node.kubernetes.io/cpu-cpuid.XSAVE
- feature.node.kubernetes.io/cpu-cpuid.XSAVEC
- feature.node.kubernetes.io/cpu-cpuid.XSAVEOPT
- feature.node.kubernetes.io/cpu-cpuid.XSAVES
- feature.node.kubernetes.io/cpu-cstate.enabled
- feature.node.kubernetes.io/cpu-hardware_multithreading
- feature.node.kubernetes.io/cpu-model.family
- feature.node.kubernetes.io/cpu-model.id
- feature.node.kubernetes.io/cpu-model.vendor_id
- feature.node.kubernetes.io/cpu-pstate.scaling_governor
- feature.node.kubernetes.io/cpu-pstate.status
- feature.node.kubernetes.io/cpu-pstate.turbo
- feature.node.kubernetes.io/cpu-rdt.RDTCMT
- feature.node.kubernetes.io/cpu-rdt.RDTL3CA
- feature.node.kubernetes.io/cpu-rdt.RDTMBA
- feature.node.kubernetes.io/cpu-rdt.RDTMBM
- feature.node.kubernetes.io/cpu-rdt.RDTMON
- feature.node.kubernetes.io/kernel-config.NO_HZ
- feature.node.kubernetes.io/kernel-config.NO_HZ_FULL
- feature.node.kubernetes.io/kernel-version.full
- feature.node.kubernetes.io/kernel-version.major
- feature.node.kubernetes.io/kernel-version.minor
- feature.node.kubernetes.io/kernel-version.revision
- feature.node.kubernetes.io/memory-numa
- feature.node.kubernetes.io/network-sriov.capable
- feature.node.kubernetes.io/network-sriov.configured
- feature.node.kubernetes.io/pci-0300_102b.present
- feature.node.kubernetes.io/system-os_release.ID
- feature.node.kubernetes.io/system-os_release.VERSION_ID
- feature.node.kubernetes.io/system-os_release.VERSION_ID.major
- feature.node.kubernetes.io/system-os_release.VERSION_ID.minor
- host-model-cpu.node.kubevirt.io/Skylake-Server-IBRS
- host-model-required-features.node.kubevirt.io/amd-ssbd
- host-model-required-features.node.kubevirt.io/amd-stibp
- host-model-required-features.node.kubevirt.io/arch-capabilities
- host-model-required-features.node.kubevirt.io/clflushopt
- host-model-required-features.node.kubevirt.io/flush-l1d
- host-model-required-features.node.kubevirt.io/hypervisor
- host-model-required-features.node.kubevirt.io/ibpb
- host-model-required-features.node.kubevirt.io/ibrs
- host-model-required-features.node.kubevirt.io/invtsc
- host-model-required-features.node.kubevirt.io/md-clear
- host-model-required-features.node.kubevirt.io/pdcm
- host-model-required-features.node.kubevirt.io/pku
- host-model-required-features.node.kubevirt.io/pschange-mc-no
- host-model-required-features.node.kubevirt.io/rsba
- host-model-required-features.node.kubevirt.io/skip-l1dfl-vmentry
- host-model-required-features.node.kubevirt.io/ss
- host-model-required-features.node.kubevirt.io/ssbd
- host-model-required-features.node.kubevirt.io/stibp
- host-model-required-features.node.kubevirt.io/tsc_adjust
- host-model-required-features.node.kubevirt.io/umip
- host-model-required-features.node.kubevirt.io/vmx
- host-model-required-features.node.kubevirt.io/xsaves
- hyperv.node.kubevirt.io/base
- hyperv.node.kubevirt.io/frequencies
- hyperv.node.kubevirt.io/ipi
- hyperv.node.kubevirt.io/reenlightenment
- hyperv.node.kubevirt.io/reset
- hyperv.node.kubevirt.io/runtime
- hyperv.node.kubevirt.io/synic
- hyperv.node.kubevirt.io/synic2
- hyperv.node.kubevirt.io/synictimer
- hyperv.node.kubevirt.io/time
- hyperv.node.kubevirt.io/tlbflush
- hyperv.node.kubevirt.io/vpindex
- kubernetes.io/arch
- kubernetes.io/hostname
- kubernetes.io/os
- kubevirt.io/ksm-enabled
- kubevirt.io/schedulable
- node-role.kubernetes.io/control-plane
- node-role.kubernetes.io/etcd
- node-role.kubernetes.io/master
- node-role.kubernetes.io/worker
- node.kubernetes.io/instance-type
- openebs.io/nodeid
- openebs.io/nodename
- scheduling.node.kubevirt.io/tsc-frequency-2200000000
kind: List
metadata:
resourceVersion: ""
labels:
beta.kubernetes.io/arch: amd64
beta.kubernetes.io/instance-type: rke2
beta.kubernetes.io/os: linux
cpu-feature.node.kubevirt.io/3dnowprefetch: "true"
cpu-feature.node.kubevirt.io/abm: "true"
cpu-feature.node.kubevirt.io/adx: "true"
cpu-feature.node.kubevirt.io/aes: "true"
cpu-feature.node.kubevirt.io/amd-ssbd: "true"
cpu-feature.node.kubevirt.io/amd-stibp: "true"
cpu-feature.node.kubevirt.io/apic: "true"
cpu-feature.node.kubevirt.io/arat: "true"
cpu-feature.node.kubevirt.io/arch-capabilities: "true"
cpu-feature.node.kubevirt.io/avx: "true"
cpu-feature.node.kubevirt.io/avx2: "true"
cpu-feature.node.kubevirt.io/avx512bw: "true"
cpu-feature.node.kubevirt.io/avx512cd: "true"
cpu-feature.node.kubevirt.io/avx512dq: "true"
cpu-feature.node.kubevirt.io/avx512f: "true"
cpu-feature.node.kubevirt.io/avx512vl: "true"
cpu-feature.node.kubevirt.io/bmi1: "true"
cpu-feature.node.kubevirt.io/bmi2: "true"
cpu-feature.node.kubevirt.io/clflush: "true"
cpu-feature.node.kubevirt.io/clflushopt: "true"
cpu-feature.node.kubevirt.io/clwb: "true"
cpu-feature.node.kubevirt.io/cmov: "true"
cpu-feature.node.kubevirt.io/cx8: "true"
cpu-feature.node.kubevirt.io/cx16: "true"
cpu-feature.node.kubevirt.io/de: "true"
cpu-feature.node.kubevirt.io/erms: "true"
cpu-feature.node.kubevirt.io/f16c: "true"
cpu-feature.node.kubevirt.io/flush-l1d: "true"
cpu-feature.node.kubevirt.io/fma: "true"
cpu-feature.node.kubevirt.io/fpu: "true"
cpu-feature.node.kubevirt.io/fsgsbase: "true"
cpu-feature.node.kubevirt.io/fxsr: "true"
cpu-feature.node.kubevirt.io/hle: "true"
cpu-feature.node.kubevirt.io/hypervisor: "true"
cpu-feature.node.kubevirt.io/ibpb: "true"
cpu-feature.node.kubevirt.io/ibrs: "true"
cpu-feature.node.kubevirt.io/invpcid: "true"
cpu-feature.node.kubevirt.io/invtsc: "true"
cpu-feature.node.kubevirt.io/lahf_lm: "true"
cpu-feature.node.kubevirt.io/lm: "true"
cpu-feature.node.kubevirt.io/mca: "true"
cpu-feature.node.kubevirt.io/mce: "true"
cpu-feature.node.kubevirt.io/md-clear: "true"
cpu-feature.node.kubevirt.io/mmx: "true"
cpu-feature.node.kubevirt.io/movbe: "true"
cpu-feature.node.kubevirt.io/mpx: "true"
cpu-feature.node.kubevirt.io/msr: "true"
cpu-feature.node.kubevirt.io/mtrr: "true"
cpu-feature.node.kubevirt.io/nx: "true"
cpu-feature.node.kubevirt.io/pae: "true"
cpu-feature.node.kubevirt.io/pat: "true"
cpu-feature.node.kubevirt.io/pcid: "true"
cpu-feature.node.kubevirt.io/pclmuldq: "true"
cpu-feature.node.kubevirt.io/pdcm: "true"
cpu-feature.node.kubevirt.io/pdpe1gb: "true"
cpu-feature.node.kubevirt.io/pge: "true"
cpu-feature.node.kubevirt.io/pku: "true"
cpu-feature.node.kubevirt.io/pni: "true"
cpu-feature.node.kubevirt.io/popcnt: "true"
cpu-feature.node.kubevirt.io/pschange-mc-no: "true"
cpu-feature.node.kubevirt.io/pse: "true"
cpu-feature.node.kubevirt.io/pse36: "true"
cpu-feature.node.kubevirt.io/rdrand: "true"
cpu-feature.node.kubevirt.io/rdseed: "true"
cpu-feature.node.kubevirt.io/rdtscp: "true"
cpu-feature.node.kubevirt.io/rsba: "true"
cpu-feature.node.kubevirt.io/rtm: "true"
cpu-feature.node.kubevirt.io/sep: "true"
cpu-feature.node.kubevirt.io/skip-l1dfl-vmentry: "true"
cpu-feature.node.kubevirt.io/smap: "true"
cpu-feature.node.kubevirt.io/smep: "true"
cpu-feature.node.kubevirt.io/spec-ctrl: "true"
cpu-feature.node.kubevirt.io/ss: "true"
cpu-feature.node.kubevirt.io/ssbd: "true"
cpu-feature.node.kubevirt.io/sse: "true"
cpu-feature.node.kubevirt.io/sse2: "true"
cpu-feature.node.kubevirt.io/sse4.1: "true"
cpu-feature.node.kubevirt.io/sse4.2: "true"
cpu-feature.node.kubevirt.io/ssse3: "true"
cpu-feature.node.kubevirt.io/stibp: "true"
cpu-feature.node.kubevirt.io/syscall: "true"
cpu-feature.node.kubevirt.io/tsc: "true"
cpu-feature.node.kubevirt.io/tsc-deadline: "true"
cpu-feature.node.kubevirt.io/tsc_adjust: "true"
cpu-feature.node.kubevirt.io/umip: "true"
cpu-feature.node.kubevirt.io/vme: "true"
cpu-feature.node.kubevirt.io/vmx: "true"
cpu-feature.node.kubevirt.io/x2apic: "true"
cpu-feature.node.kubevirt.io/xgetbv1: "true"
cpu-feature.node.kubevirt.io/xsave: "true"
cpu-feature.node.kubevirt.io/xsavec: "true"
cpu-feature.node.kubevirt.io/xsaveopt: "true"
cpu-feature.node.kubevirt.io/xsaves: "true"
cpu-model-migration.node.kubevirt.io/Broadwell: "true"
cpu-model-migration.node.kubevirt.io/Broadwell-IBRS: "true"
cpu-model-migration.node.kubevirt.io/Broadwell-noTSX: "true"
cpu-model-migration.node.kubevirt.io/Broadwell-noTSX-IBRS: "true"
cpu-model-migration.node.kubevirt.io/Haswell: "true"
cpu-model-migration.node.kubevirt.io/Haswell-IBRS: "true"
cpu-model-migration.node.kubevirt.io/Haswell-noTSX: "true"
cpu-model-migration.node.kubevirt.io/Haswell-noTSX-IBRS: "true"
cpu-model-migration.node.kubevirt.io/IvyBridge: "true"
cpu-model-migration.node.kubevirt.io/IvyBridge-IBRS: "true"
cpu-model-migration.node.kubevirt.io/Nehalem: "true"
cpu-model-migration.node.kubevirt.io/Nehalem-IBRS: "true"
cpu-model-migration.node.kubevirt.io/Opteron_G1: "true"
cpu-model-migration.node.kubevirt.io/Penryn: "true"
cpu-model-migration.node.kubevirt.io/SandyBridge: "true"
cpu-model-migration.node.kubevirt.io/SandyBridge-IBRS: "true"
cpu-model-migration.node.kubevirt.io/Skylake-Client: "true"
cpu-model-migration.node.kubevirt.io/Skylake-Client-IBRS: "true"
cpu-model-migration.node.kubevirt.io/Skylake-Client-noTSX-IBRS: "true"
cpu-model-migration.node.kubevirt.io/Skylake-Server: "true"
cpu-model-migration.node.kubevirt.io/Skylake-Server-IBRS: "true"
cpu-model-migration.node.kubevirt.io/Skylake-Server-noTSX-IBRS: "true"
cpu-model-migration.node.kubevirt.io/Westmere: "true"
cpu-model-migration.node.kubevirt.io/Westmere-IBRS: "true"
cpu-model.node.kubevirt.io/Broadwell: "true"
cpu-model.node.kubevirt.io/Broadwell-IBRS: "true"
cpu-model.node.kubevirt.io/Broadwell-noTSX: "true"
cpu-model.node.kubevirt.io/Broadwell-noTSX-IBRS: "true"
cpu-model.node.kubevirt.io/Haswell: "true"
cpu-model.node.kubevirt.io/Haswell-IBRS: "true"
cpu-model.node.kubevirt.io/Haswell-noTSX: "true"
cpu-model.node.kubevirt.io/Haswell-noTSX-IBRS: "true"
cpu-model.node.kubevirt.io/IvyBridge: "true"
cpu-model.node.kubevirt.io/IvyBridge-IBRS: "true"
cpu-model.node.kubevirt.io/Nehalem: "true"
cpu-model.node.kubevirt.io/Nehalem-IBRS: "true"
cpu-model.node.kubevirt.io/Opteron_G1: "true"
cpu-model.node.kubevirt.io/Penryn: "true"
cpu-model.node.kubevirt.io/SandyBridge: "true"
cpu-model.node.kubevirt.io/SandyBridge-IBRS: "true"
cpu-model.node.kubevirt.io/Skylake-Client: "true"
cpu-model.node.kubevirt.io/Skylake-Client-IBRS: "true"
cpu-model.node.kubevirt.io/Skylake-Client-noTSX-IBRS: "true"
cpu-model.node.kubevirt.io/Skylake-Server: "true"
cpu-model.node.kubevirt.io/Skylake-Server-IBRS: "true"
cpu-model.node.kubevirt.io/Skylake-Server-noTSX-IBRS: "true"
cpu-model.node.kubevirt.io/Westmere: "true"
cpu-model.node.kubevirt.io/Westmere-IBRS: "true"
cpu-timer.node.kubevirt.io/tsc-frequency: "2199997000"
cpu-timer.node.kubevirt.io/tsc-scalable: "true"
cpu-vendor.node.kubevirt.io/Intel: "true"
cpumanager: "true"
feature.node.kubernetes.io/cpu-cpuid.ADX: "true"
feature.node.kubernetes.io/cpu-cpuid.AESNI: "true"
feature.node.kubernetes.io/cpu-cpuid.AVX: "true"
feature.node.kubernetes.io/cpu-cpuid.AVX2: "true"
feature.node.kubernetes.io/cpu-cpuid.AVX512BW: "true"
feature.node.kubernetes.io/cpu-cpuid.AVX512CD: "true"
feature.node.kubernetes.io/cpu-cpuid.AVX512DQ: "true"
feature.node.kubernetes.io/cpu-cpuid.AVX512F: "true"
feature.node.kubernetes.io/cpu-cpuid.AVX512VL: "true"
feature.node.kubernetes.io/cpu-cpuid.CMPXCHG8: "true"
feature.node.kubernetes.io/cpu-cpuid.FLUSH_L1D: "true"
feature.node.kubernetes.io/cpu-cpuid.FMA3: "true"
feature.node.kubernetes.io/cpu-cpuid.FXSR: "true"
feature.node.kubernetes.io/cpu-cpuid.FXSROPT: "true"
feature.node.kubernetes.io/cpu-cpuid.HLE: "true"
feature.node.kubernetes.io/cpu-cpuid.IA32_ARCH_CAP: "true"
feature.node.kubernetes.io/cpu-cpuid.IBPB: "true"
feature.node.kubernetes.io/cpu-cpuid.LAHF: "true"
feature.node.kubernetes.io/cpu-cpuid.MD_CLEAR: "true"
feature.node.kubernetes.io/cpu-cpuid.MOVBE: "true"
feature.node.kubernetes.io/cpu-cpuid.MPX: "true"
feature.node.kubernetes.io/cpu-cpuid.OSXSAVE: "true"
feature.node.kubernetes.io/cpu-cpuid.RTM: "true"
feature.node.kubernetes.io/cpu-cpuid.SPEC_CTRL_SSBD: "true"
feature.node.kubernetes.io/cpu-cpuid.STIBP: "true"
feature.node.kubernetes.io/cpu-cpuid.SYSCALL: "true"
feature.node.kubernetes.io/cpu-cpuid.SYSEE: "true"
feature.node.kubernetes.io/cpu-cpuid.VMX: "true"
feature.node.kubernetes.io/cpu-cpuid.X87: "true"
feature.node.kubernetes.io/cpu-cpuid.XGETBV1: "true"
feature.node.kubernetes.io/cpu-cpuid.XSAVE: "true"
feature.node.kubernetes.io/cpu-cpuid.XSAVEC: "true"
feature.node.kubernetes.io/cpu-cpuid.XSAVEOPT: "true"
feature.node.kubernetes.io/cpu-cpuid.XSAVES: "true"
feature.node.kubernetes.io/cpu-cstate.enabled: "true"
feature.node.kubernetes.io/cpu-hardware_multithreading: "false"
feature.node.kubernetes.io/cpu-model.family: "6"
feature.node.kubernetes.io/cpu-model.id: "85"
feature.node.kubernetes.io/cpu-model.vendor_id: Intel
feature.node.kubernetes.io/cpu-pstate.scaling_governor: performance
feature.node.kubernetes.io/cpu-pstate.status: active
feature.node.kubernetes.io/cpu-pstate.turbo: "true"
feature.node.kubernetes.io/cpu-rdt.RDTCMT: "true"
feature.node.kubernetes.io/cpu-rdt.RDTL3CA: "true"
feature.node.kubernetes.io/cpu-rdt.RDTMBA: "true"
feature.node.kubernetes.io/cpu-rdt.RDTMBM: "true"
feature.node.kubernetes.io/cpu-rdt.RDTMON: "true"
feature.node.kubernetes.io/kernel-config.NO_HZ: "true"
feature.node.kubernetes.io/kernel-config.NO_HZ_FULL: "true"
feature.node.kubernetes.io/kernel-version.full: 5.14.0-362.18.1.el9_3.x86_64
feature.node.kubernetes.io/kernel-version.major: "5"
feature.node.kubernetes.io/kernel-version.minor: "14"
feature.node.kubernetes.io/kernel-version.revision: "0"
feature.node.kubernetes.io/memory-numa: "true"
feature.node.kubernetes.io/network-sriov.capable: "true"
feature.node.kubernetes.io/network-sriov.configured: "true"
feature.node.kubernetes.io/pci-0300_102b.present: "true"
feature.node.kubernetes.io/system-os_release.ID: rocky
feature.node.kubernetes.io/system-os_release.VERSION_ID: "9.3"
feature.node.kubernetes.io/system-os_release.VERSION_ID.major: "9"
feature.node.kubernetes.io/system-os_release.VERSION_ID.minor: "3"
host-model-cpu.node.kubevirt.io/Skylake-Server-IBRS: "true"
host-model-required-features.node.kubevirt.io/amd-ssbd: "true"
host-model-required-features.node.kubevirt.io/amd-stibp: "true"
host-model-required-features.node.kubevirt.io/arch-capabilities: "true"
host-model-required-features.node.kubevirt.io/clflushopt: "true"
host-model-required-features.node.kubevirt.io/flush-l1d: "true"
host-model-required-features.node.kubevirt.io/hypervisor: "true"
host-model-required-features.node.kubevirt.io/ibpb: "true"
host-model-required-features.node.kubevirt.io/ibrs: "true"
host-model-required-features.node.kubevirt.io/invtsc: "true"
host-model-required-features.node.kubevirt.io/md-clear: "true"
host-model-required-features.node.kubevirt.io/pdcm: "true"
host-model-required-features.node.kubevirt.io/pku: "true"
host-model-required-features.node.kubevirt.io/pschange-mc-no: "true"
host-model-required-features.node.kubevirt.io/rsba: "true"
host-model-required-features.node.kubevirt.io/skip-l1dfl-vmentry: "true"
host-model-required-features.node.kubevirt.io/ss: "true"
host-model-required-features.node.kubevirt.io/ssbd: "true"
host-model-required-features.node.kubevirt.io/stibp: "true"
host-model-required-features.node.kubevirt.io/tsc_adjust: "true"
host-model-required-features.node.kubevirt.io/umip: "true"
host-model-required-features.node.kubevirt.io/vmx: "true"
host-model-required-features.node.kubevirt.io/xsaves: "true"
hyperv.node.kubevirt.io/base: "true"
hyperv.node.kubevirt.io/frequencies: "true"
hyperv.node.kubevirt.io/ipi: "true"
hyperv.node.kubevirt.io/reenlightenment: "true"
hyperv.node.kubevirt.io/reset: "true"
hyperv.node.kubevirt.io/runtime: "true"
hyperv.node.kubevirt.io/synic: "true"
hyperv.node.kubevirt.io/synic2: "true"
hyperv.node.kubevirt.io/synictimer: "true"
hyperv.node.kubevirt.io/time: "true"
hyperv.node.kubevirt.io/tlbflush: "true"
hyperv.node.kubevirt.io/vpindex: "true"
kubernetes.io/arch: amd64
kubernetes.io/hostname: bne-lab-vr-2.i.example.com
kubernetes.io/os: linux
kubevirt.io/ksm-enabled: "false"
kubevirt.io/schedulable: "true"
node-role.kubernetes.io/control-plane: "true"
node-role.kubernetes.io/etcd: "true"
node-role.kubernetes.io/master: "true"
node-role.kubernetes.io/worker: ""
node.kubernetes.io/instance-type: rke2
openebs.io/nodeid: bne-lab-vr-2.i.example.com
openebs.io/nodename: bne-lab-vr-2.i.example.com
scheduling.node.kubevirt.io/tsc-frequency-2199997000: "true"
$ kubectl logs -f openebs-zfs-localpv-controller-6f879b95b-jbx8p -n openebs -c openebs-zfs-plugin
I0419 03:00:13.734106 1 main.go:89] ZFS Driver Version :- 2.5.0 - commit :- c0d0bfd5bb2a69ecd42f120d633e95a49664d268
I0419 03:00:13.734198 1 main.go:90] DriverName: zfs.csi.openebs.io Plugin: controller EndPoint: unix:///var/lib/csi/sockets/pluginproxy/csi.sock Node Name:
I0419 03:00:13.779320 1 driver.go:48] enabling volume access mode: SINGLE_NODE_WRITER
I0419 03:00:14.423405 1 controller.go:140] waiting for k8s & zfs node informer caches to be synced
I0419 03:00:14.423435 1 controller.go:144] synced k8s & zfs node informer caches
I0419 03:00:14.423915 1 grpc.go:190] Listening for connections on address: &net.UnixAddr{Name:"//var/lib/csi/sockets/pluginproxy/csi.sock", Net:"unix"}
I0419 03:00:20.799296 1 grpc.go:72] GRPC call: /csi.v1.Identity/Probe requests {}
I0419 03:00:20.800459 1 grpc.go:81] GRPC response: {}
I0419 03:00:20.801297 1 grpc.go:72] GRPC call: /csi.v1.Identity/GetPluginInfo requests {}
I0419 03:00:20.801343 1 grpc.go:81] GRPC response: {"name":"zfs.csi.openebs.io","vendor_version":"2.5.0"}
I0419 03:00:20.802332 1 grpc.go:72] GRPC call: /csi.v1.Identity/GetPluginCapabilities requests {}
I0419 03:00:20.802355 1 grpc.go:81] GRPC response: {"capabilities":[{"Type":{"Service":{"type":1}}},{"Type":{"Service":{"type":2}}}]}
I0419 03:00:20.803117 1 grpc.go:72] GRPC call: /csi.v1.Controller/ControllerGetCapabilities requests {}
I0419 03:00:20.803150 1 grpc.go:81] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":4}}}]}
I0419 03:00:20.803764 1 grpc.go:72] GRPC call: /csi.v1.Controller/ControllerGetCapabilities requests {}
I0419 03:00:20.803789 1 grpc.go:81] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":4}}}]}
I0419 03:00:21.640192 1 grpc.go:72] GRPC call: /csi.v1.Identity/GetPluginInfo requests {}
I0419 03:00:21.640257 1 grpc.go:81] GRPC response: {"name":"zfs.csi.openebs.io","vendor_version":"2.5.0"}
I0419 03:00:21.641041 1 grpc.go:72] GRPC call: /csi.v1.Identity/Probe requests {}
I0419 03:00:21.641385 1 grpc.go:81] GRPC response: {}
I0419 03:00:21.645090 1 grpc.go:72] GRPC call: /csi.v1.Controller/ControllerGetCapabilities requests {}
I0419 03:00:21.645140 1 grpc.go:81] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":4}}}]}
I0419 03:00:21.749173 1 grpc.go:72] GRPC call: /csi.v1.Controller/DeleteSnapshot requests {"snapshot_id":"pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-d85f41de-6918-48a6-8b17-0890aeefdb43"}
I0419 03:00:21.749296 1 controller.go:816] DeleteSnapshot request for pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-d85f41de-6918-48a6-8b17-0890aeefdb43
I0419 03:00:21.835203 1 volume.go:204] deprovisioned snapshot snapshot-d85f41de-6918-48a6-8b17-0890aeefdb43
I0419 03:00:21.835227 1 grpc.go:81] GRPC response: {}
I0419 03:00:22.595379 1 grpc.go:72] GRPC call: /csi.v1.Identity/Probe requests {}
I0419 03:00:22.595470 1 grpc.go:81] GRPC response: {}
I0419 03:00:22.596569 1 grpc.go:72] GRPC call: /csi.v1.Identity/GetPluginInfo requests {}
I0419 03:00:22.596610 1 grpc.go:81] GRPC response: {"name":"zfs.csi.openebs.io","vendor_version":"2.5.0"}
I0419 03:00:22.597597 1 grpc.go:72] GRPC call: /csi.v1.Identity/GetPluginCapabilities requests {}
I0419 03:00:22.597648 1 grpc.go:81] GRPC response: {"capabilities":[{"Type":{"Service":{"type":1}}},{"Type":{"Service":{"type":2}}}]}
I0419 03:00:22.598226 1 grpc.go:72] GRPC call: /csi.v1.Controller/ControllerGetCapabilities requests {}
I0419 03:00:22.598262 1 grpc.go:81] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":7}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":4}}}]}
I0419 03:01:40.379813 1 grpc.go:72] GRPC call: /csi.v1.Controller/DeleteVolume requests {"volume_id":"pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76"}
I0419 03:01:40.379895 1 controller.go:508] received request to delete volume {pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76}
I0419 03:01:40.405987 1 volume.go:221] zfs: deleted the volume pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76
I0419 03:01:40.406026 1 grpc.go:81] GRPC response: {}
I0419 03:01:53.112347 1 grpc.go:72] GRPC call: /csi.v1.Identity/GetPluginInfo requests {}
I0419 03:01:53.112395 1 grpc.go:81] GRPC response: {"name":"zfs.csi.openebs.io","vendor_version":"2.5.0"}
I0419 03:01:53.112832 1 grpc.go:72] GRPC call: /csi.v1.Controller/CreateSnapshot requests {"name":"snapshot-0ae0ade0-ae4d-4488-bd3d-2a0bc07905f0","source_volume_id":"pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065"}
I0419 03:01:53.112902 1 controller.go:724] CreateSnapshot volume pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-0ae0ade0-ae4d-4488-bd3d-2a0bc07905f0
I0419 03:01:53.160963 1 volume.go:194] provisioned snapshot snapshot-0ae0ade0-ae4d-4488-bd3d-2a0bc07905f0
I0419 03:01:53.163837 1 grpc.go:81] GRPC response: {"snapshot":{"creation_time":{"seconds":1713495713},"size_bytes":24696061952,"snapshot_id":"pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-0ae0ade0-ae4d-4488-bd3d-2a0bc07905f0","source_volume_id":"pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065"}}
I0419 03:01:53.240397 1 grpc.go:72] GRPC call: /csi.v1.Identity/GetPluginInfo requests {}
I0419 03:01:53.240451 1 grpc.go:81] GRPC response: {"name":"zfs.csi.openebs.io","vendor_version":"2.5.0"}
I0419 03:01:53.240722 1 grpc.go:72] GRPC call: /csi.v1.Controller/CreateSnapshot requests {"name":"snapshot-0ae0ade0-ae4d-4488-bd3d-2a0bc07905f0","source_volume_id":"pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065"}
I0419 03:01:53.240768 1 controller.go:724] CreateSnapshot volume pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-0ae0ade0-ae4d-4488-bd3d-2a0bc07905f0
I0419 03:01:53.243734 1 grpc.go:81] GRPC response: {"snapshot":{"creation_time":{"seconds":1713495713},"size_bytes":24696061952,"snapshot_id":"pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-0ae0ade0-ae4d-4488-bd3d-2a0bc07905f0","source_volume_id":"pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065"}}
I0419 03:01:53.282798 1 grpc.go:72] GRPC call: /csi.v1.Identity/GetPluginInfo requests {}
I0419 03:01:53.282842 1 grpc.go:81] GRPC response: {"name":"zfs.csi.openebs.io","vendor_version":"2.5.0"}
I0419 03:01:53.283094 1 grpc.go:72] GRPC call: /csi.v1.Controller/CreateSnapshot requests {"name":"snapshot-0ae0ade0-ae4d-4488-bd3d-2a0bc07905f0","source_volume_id":"pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065"}
I0419 03:01:53.283139 1 controller.go:724] CreateSnapshot volume pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-0ae0ade0-ae4d-4488-bd3d-2a0bc07905f0
I0419 03:01:53.285850 1 grpc.go:81] GRPC response: {"snapshot":{"creation_time":{"seconds":1713495713},"size_bytes":24696061952,"snapshot_id":"pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-0ae0ade0-ae4d-4488-bd3d-2a0bc07905f0","source_volume_id":"pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065"}}
I0419 03:01:53.430028 1 grpc.go:72] GRPC call: /csi.v1.Identity/GetPluginInfo requests {}
I0419 03:01:53.430075 1 grpc.go:81] GRPC response: {"name":"zfs.csi.openebs.io","vendor_version":"2.5.0"}
I0419 03:01:53.430364 1 grpc.go:72] GRPC call: /csi.v1.Controller/CreateSnapshot requests {"name":"snapshot-0ae0ade0-ae4d-4488-bd3d-2a0bc07905f0","source_volume_id":"pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065"}
I0419 03:01:53.430423 1 controller.go:724] CreateSnapshot volume pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-0ae0ade0-ae4d-4488-bd3d-2a0bc07905f0
I0419 03:01:53.439665 1 grpc.go:81] GRPC response: {"snapshot":{"creation_time":{"seconds":1713495713},"ready_to_use":true,"size_bytes":24696061952,"snapshot_id":"pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-0ae0ade0-ae4d-4488-bd3d-2a0bc07905f0","source_volume_id":"pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065"}}
^C
$ kubectl logs -f openebs-zfs-localpv-node-44f9n -n openebs -c openebs-zfs-plugin
I0419 03:00:27.820174 1 volume.go:94] zfs: node(bne-lab-vr-2.i.example.com) has node affinity openebs.io/nodeid=bne-lab-vr-2.i.example.com
I0419 03:00:27.820635 1 main.go:89] ZFS Driver Version :- 2.5.0 - commit :- c0d0bfd5bb2a69ecd42f120d633e95a49664d268
I0419 03:00:27.820648 1 main.go:90] DriverName: zfs.csi.openebs.io Plugin: agent EndPoint: unix:///plugin/csi.sock Node Name: bne-lab-vr-2.i.example.com
I0419 03:00:27.820666 1 driver.go:48] enabling volume access mode: SINGLE_NODE_WRITER
I0419 03:00:27.822049 1 builder.go:108] Creating event broadcaster
I0419 03:00:27.822113 1 grpc.go:190] Listening for connections on address: &net.UnixAddr{Name:"//plugin/csi.sock", Net:"unix"}
I0419 03:00:27.822306 1 backup.go:168] Starting Bkp controller
I0419 03:00:27.822314 1 backup.go:171] Waiting for informer caches to sync
I0419 03:00:27.827558 1 builder.go:107] Creating event broadcaster
I0419 03:00:27.828217 1 volume.go:182] Starting ZV controller
I0419 03:00:27.828231 1 volume.go:185] Waiting for informer caches to sync
I0419 03:00:27.828249 1 builder.go:107] Creating event broadcaster
I0419 03:00:27.828429 1 snapshot.go:171] Starting Snap controller
I0419 03:00:27.828437 1 snapshot.go:174] Waiting for informer caches to sync
I0419 03:00:27.828477 1 builder.go:108] Creating event broadcaster
I0419 03:00:27.828584 1 restore.go:163] Starting Restore controller
I0419 03:00:27.828590 1 restore.go:166] Waiting for informer caches to sync
I0419 03:00:27.828644 1 builder.go:116] Creating event broadcaster
I0419 03:00:27.828980 1 zfsnode.go:191] Starting Node controller
I0419 03:00:27.828987 1 zfsnode.go:194] Waiting for informer caches to sync
I0419 03:00:27.829843 1 snapshot.go:114] Got add event for Snap zfspv-pool/snapshot-d85f41de-6918-48a6-8b17-0890aeefdb43
I0419 03:00:27.829854 1 snapshot.go:114] Got add event for Snap zfspv-pool/snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d
I0419 03:00:27.829903 1 volume.go:123] Got add event for ZV zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065
I0419 03:00:27.829921 1 volume.go:123] Got add event for ZV zfspv-pool/pvc-79f4c293-077c-4b5d-9e42-4239aa7c3a79
I0419 03:00:27.829928 1 volume.go:123] Got add event for ZV zfspv-pool/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76
I0419 03:00:27.830148 1 zfsnode.go:127] Got add event for zfs node openebs/bne-lab-vr-2.i.example.com
I0419 03:00:27.922910 1 backup.go:175] Starting Bkp workers
I0419 03:00:27.922928 1 backup.go:182] Started Bkp workers
I0419 03:00:27.929531 1 restore.go:170] Starting Restore workers
I0419 03:00:27.929545 1 snapshot.go:178] Starting Snap workers
I0419 03:00:27.929556 1 zfsnode.go:199] Starting Node workers
I0419 03:00:27.929550 1 restore.go:177] Started Restore workers
I0419 03:00:27.929561 1 snapshot.go:185] Started Snap workers
I0419 03:00:27.929576 1 zfsnode.go:206] Started Node workers
I0419 03:00:27.929593 1 volume.go:189] Starting ZV workers
I0419 03:00:27.929613 1 volume.go:196] Started ZV workers
I0419 03:00:28.214120 1 zfsnode.go:100] zfs node controller: node pools updated current=[{Name:zfspv-pool UUID:15979848324292221408 Free:{i:{value:2259140826624 scale:0} d:{Dec:<nil>} s:2259140826624 Format:DecimalSI} Used:{i:{value:4843809280 scale:0} d:{Dec:<nil>} s:4843809280 Format:DecimalSI}}], required=[{Name:zfspv-pool UUID:15979848324292221408 Free:{i:{value:2259083128320 scale:0} d:{Dec:<nil>} s: Format:BinarySI} Used:{i:{value:4901507584 scale:0} d:{Dec:<nil>} s: Format:BinarySI}}]
I0419 03:00:28.214164 1 zfsnode.go:110] zfs node controller: updating node object with &{TypeMeta:{Kind:ZFSNode APIVersion:zfs.openebs.io/v1} ObjectMeta:{Name:bne-lab-vr-2.i.example.com GenerateName: Namespace:openebs SelfLink: UID:e9dadda8-5e64-42e3-b070-6f59c0941ac7 ResourceVersion:1321358 Generation:3050 CreationTimestamp:2024-04-16 22:35:04 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[] Annotations:map[] OwnerReferences:[{APIVersion:v1 Kind:Node Name:bne-lab-vr-2.i.example.com UID:97df1eba-a604-459f-9bb7-dc63f0a4afaa Controller:0xc0007a3438 BlockOwnerDeletion:<nil>}] Finalizers:[] ManagedFields:[{Manager:zfs-driver Operation:Update APIVersion:zfs.openebs.io/v1 Time:2024-04-19 02:53:36 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:ownerReferences":{".":{},"k:{\"uid\":\"97df1eba-a604-459f-9bb7-dc63f0a4afaa\"}":{}}},"f:pools":{}} Subresource:}]} Pools:[{Name:zfspv-pool UUID:15979848324292221408 Free:{i:{value:2259083128320 scale:0} d:{Dec:<nil>} s: Format:BinarySI} Used:{i:{value:4901507584 scale:0} d:{Dec:<nil>} s: Format:BinarySI}}]}
I0419 03:00:28.241862 1 zfsnode.go:114] zfs node controller: updated node object openebs/bne-lab-vr-2.i.example.com
I0419 03:00:28.241938 1 zfsnode.go:139] Got update event for zfs node openebs/bne-lab-vr-2.i.example.com
E0419 03:00:28.242882 1 zfs_util.go:732] zfs: could not destroy snapshot pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d cmd [destroy zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d] error: cannot destroy 'zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d': snapshot has dependent clones
use '-R' to destroy the following datasets:
zfspv-pool/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76
E0419 03:00:28.242918 1 snapshot.go:248] error syncing 'openebs/snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d': exit status 1, requeuing
E0419 03:00:28.273947 1 zfs_util.go:732] zfs: could not destroy snapshot pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d cmd [destroy zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d] error: cannot destroy 'zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d': snapshot has dependent clones
use '-R' to destroy the following datasets:
zfspv-pool/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76
E0419 03:00:28.273985 1 snapshot.go:248] error syncing 'openebs/snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d': exit status 1, requeuing
E0419 03:00:28.308974 1 zfs_util.go:732] zfs: could not destroy snapshot pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d cmd [destroy zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d] error: cannot destroy 'zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d': snapshot has dependent clones
use '-R' to destroy the following datasets:
zfspv-pool/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76
E0419 03:00:28.309055 1 snapshot.go:248] error syncing 'openebs/snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d': exit status 1, requeuing
E0419 03:00:28.354154 1 zfs_util.go:732] zfs: could not destroy snapshot pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d cmd [destroy zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d] error: cannot destroy 'zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d': snapshot has dependent clones
use '-R' to destroy the following datasets:
zfspv-pool/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76
E0419 03:00:28.354191 1 snapshot.go:248] error syncing 'openebs/snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d': exit status 1, requeuing
I0419 03:00:28.377362 1 zfs_util.go:616] property set on volume zfspv-pool/pvc-79f4c293-077c-4b5d-9e42-4239aa7c3a79
I0419 03:00:28.377381 1 volume.go:254] Successfully synced 'openebs/pvc-79f4c293-077c-4b5d-9e42-4239aa7c3a79'
I0419 03:00:28.377457 1 zfs_util.go:616] property set on volume zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065
I0419 03:00:28.377472 1 volume.go:254] Successfully synced 'openebs/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065'
E0419 03:00:28.417758 1 zfs_util.go:732] zfs: could not destroy snapshot pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d cmd [destroy zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d] error: cannot destroy 'zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d': snapshot has dependent clones
use '-R' to destroy the following datasets:
zfspv-pool/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76
E0419 03:00:28.417821 1 snapshot.go:248] error syncing 'openebs/snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d': exit status 1, requeuing
E0419 03:00:28.523400 1 zfs_util.go:732] zfs: could not destroy snapshot pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d cmd [destroy zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d] error: cannot destroy 'zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d': snapshot has dependent clones
use '-R' to destroy the following datasets:
zfspv-pool/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76
E0419 03:00:28.523444 1 snapshot.go:248] error syncing 'openebs/snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d': exit status 1, requeuing
I0419 03:00:28.585314 1 zfs_util.go:737] deleted snapshot pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-d85f41de-6918-48a6-8b17-0890aeefdb43
I0419 03:00:28.596561 1 snapshot.go:243] Successfully synced 'openebs/snapshot-d85f41de-6918-48a6-8b17-0890aeefdb43'
I0419 03:00:28.596594 1 snapshot.go:158] Got delete event for Snap zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-d85f41de-6918-48a6-8b17-0890aeefdb43
E0419 03:00:28.596629 1 snapshot.go:50] zfs snapshot 'openebs/snapshot-d85f41de-6918-48a6-8b17-0890aeefdb43' has been deleted
I0419 03:00:28.596639 1 snapshot.go:243] Successfully synced 'openebs/snapshot-d85f41de-6918-48a6-8b17-0890aeefdb43'
E0419 03:00:28.708208 1 zfs_util.go:732] zfs: could not destroy snapshot pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d cmd [destroy zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d] error: cannot destroy 'zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d': snapshot has dependent clones
use '-R' to destroy the following datasets:
zfspv-pool/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76
E0419 03:00:28.708274 1 snapshot.go:248] error syncing 'openebs/snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d': exit status 1, requeuing
I0419 03:00:28.798805 1 zfs_util.go:616] property set on volume zfspv-pool/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76
I0419 03:00:28.798840 1 volume.go:254] Successfully synced 'openebs/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76'
I0419 03:00:28.822560 1 grpc.go:72] GRPC call: /csi.v1.Identity/GetPluginInfo requests {}
I0419 03:00:28.823623 1 grpc.go:81] GRPC response: {"name":"zfs.csi.openebs.io","vendor_version":"2.5.0"}
E0419 03:00:29.055291 1 zfs_util.go:732] zfs: could not destroy snapshot pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d cmd [destroy zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d] error: cannot destroy 'zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d': snapshot has dependent clones
use '-R' to destroy the following datasets:
zfspv-pool/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76
E0419 03:00:29.055359 1 snapshot.go:248] error syncing 'openebs/snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d': exit status 1, requeuing
I0419 03:00:29.450384 1 grpc.go:72] GRPC call: /csi.v1.Node/NodeGetInfo requests {}
I0419 03:00:29.454024 1 grpc.go:81] GRPC response: {"accessible_topology":{"segments":{"beta.kubernetes.io/arch":"amd64","beta.kubernetes.io/instance-type":"rke2","beta.kubernetes.io/os":"linux","cpu-feature.node.kubevirt.io/3dnowprefetch":"true","cpu-feature.node.kubevirt.io/abm":"true","cpu-feature.node.kubevirt.io/adx":"true","cpu-feature.node.kubevirt.io/aes":"true","cpu-feature.node.kubevirt.io/amd-ssbd":"true","cpu-feature.node.kubevirt.io/amd-stibp":"true","cpu-feature.node.kubevirt.io/apic":"true","cpu-feature.node.kubevirt.io/arat":"true","cpu-feature.node.kubevirt.io/arch-capabilities":"true","cpu-feature.node.kubevirt.io/avx":"true","cpu-feature.node.kubevirt.io/avx2":"true","cpu-feature.node.kubevirt.io/avx512bw":"true","cpu-feature.node.kubevirt.io/avx512cd":"true","cpu-feature.node.kubevirt.io/avx512dq":"true","cpu-feature.node.kubevirt.io/avx512f":"true","cpu-feature.node.kubevirt.io/avx512vl":"true","cpu-feature.node.kubevirt.io/bmi1":"true","cpu-feature.node.kubevirt.io/bmi2":"true","cpu-feature.node.kubevirt.io/clflush":"true","cpu-feature.node.kubevirt.io/clflushopt":"true","cpu-feature.node.kubevirt.io/clwb":"true","cpu-feature.node.kubevirt.io/cmov":"true","cpu-feature.node.kubevirt.io/cx16":"true","cpu-feature.node.kubevirt.io/cx8":"true","cpu-feature.node.kubevirt.io/de":"true","cpu-feature.node.kubevirt.io/erms":"true","cpu-feature.node.kubevirt.io/f16c":"true","cpu-feature.node.kubevirt.io/flush-l1d":"true","cpu-feature.node.kubevirt.io/fma":"true","cpu-feature.node.kubevirt.io/fpu":"true","cpu-feature.node.kubevirt.io/fsgsbase":"true","cpu-feature.node.kubevirt.io/fxsr":"true","cpu-feature.node.kubevirt.io/hle":"true","cpu-feature.node.kubevirt.io/hypervisor":"true","cpu-feature.node.kubevirt.io/ibpb":"true","cpu-feature.node.kubevirt.io/ibrs":"true","cpu-feature.node.kubevirt.io/invpcid":"true","cpu-feature.node.kubevirt.io/invtsc":"true","cpu-feature.node.kubevirt.io/lahf_lm":"true","cpu-feature.node.kubevirt.io/lm":"true","cpu-feature.node.kubevirt.io/mca":"true","cpu-feature.node.kubevirt.io/mce":"true","cpu-feature.node.kubevirt.io/md-clear":"true","cpu-feature.node.kubevirt.io/mmx":"true","cpu-feature.node.kubevirt.io/movbe":"true","cpu-feature.node.kubevirt.io/mpx":"true","cpu-feature.node.kubevirt.io/msr":"true","cpu-feature.node.kubevirt.io/mtrr":"true","cpu-feature.node.kubevirt.io/nx":"true","cpu-feature.node.kubevirt.io/pae":"true","cpu-feature.node.kubevirt.io/pat":"true","cpu-feature.node.kubevirt.io/pcid":"true","cpu-feature.node.kubevirt.io/pclmuldq":"true","cpu-feature.node.kubevirt.io/pdcm":"true","cpu-feature.node.kubevirt.io/pdpe1gb":"true","cpu-feature.node.kubevirt.io/pge":"true","cpu-feature.node.kubevirt.io/pku":"true","cpu-feature.node.kubevirt.io/pni":"true","cpu-feature.node.kubevirt.io/popcnt":"true","cpu-feature.node.kubevirt.io/pschange-mc-no":"true","cpu-feature.node.kubevirt.io/pse":"true","cpu-feature.node.kubevirt.io/pse36":"true","cpu-feature.node.kubevirt.io/rdrand":"true","cpu-feature.node.kubevirt.io/rdseed":"true","cpu-feature.node.kubevirt.io/rdtscp":"true","cpu-feature.node.kubevirt.io/rsba":"true","cpu-feature.node.kubevirt.io/rtm":"true","cpu-feature.node.kubevirt.io/sep":"true","cpu-feature.node.kubevirt.io/skip-l1dfl-vmentry":"true","cpu-feature.node.kubevirt.io/smap":"true","cpu-feature.node.kubevirt.io/smep":"true","cpu-feature.node.kubevirt.io/spec-ctrl":"true","cpu-feature.node.kubevirt.io/ss":"true","cpu-feature.node.kubevirt.io/ssbd":"true","cpu-feature.node.kubevirt.io/sse":"true","cpu-feature.node.kubevirt.io/sse2":"true","cpu-feature.node.kubevirt.io/sse4.1":"true","cpu-feature.node.kubevirt.io/sse4.2":"true","cpu-feature.node.kubevirt.io/ssse3":"true","cpu-feature.node.kubevirt.io/stibp":"true","cpu-feature.node.kubevirt.io/syscall":"true","cpu-feature.node.kubevirt.io/tsc":"true","cpu-feature.node.kubevirt.io/tsc-deadline":"true","cpu-feature.node.kubevirt.io/tsc_adjust":"true","cpu-feature.node.kubevirt.io/umip":"true","cpu-feature.node.kubevirt.io/vme":"true","cpu-feature.node.kubevirt.io/vmx":"true","cpu-feature.node.kubevirt.io/x2apic":"true","cpu-feature.node.kubevirt.io/xgetbv1":"true","cpu-feature.node.kubevirt.io/xsave":"true","cpu-feature.node.kubevirt.io/xsavec":"true","cpu-feature.node.kubevirt.io/xsaveopt":"true","cpu-feature.node.kubevirt.io/xsaves":"true","cpu-model-migration.node.kubevirt.io/Broadwell":"true","cpu-model-migration.node.kubevirt.io/Broadwell-IBRS":"true","cpu-model-migration.node.kubevirt.io/Broadwell-noTSX":"true","cpu-model-migration.node.kubevirt.io/Broadwell-noTSX-IBRS":"true","cpu-model-migration.node.kubevirt.io/Haswell":"true","cpu-model-migration.node.kubevirt.io/Haswell-IBRS":"true","cpu-model-migration.node.kubevirt.io/Haswell-noTSX":"true","cpu-model-migration.node.kubevirt.io/Haswell-noTSX-IBRS":"true","cpu-model-migration.node.kubevirt.io/IvyBridge":"true","cpu-model-migration.node.kubevirt.io/IvyBridge-IBRS":"true","cpu-model-migration.node.kubevirt.io/Nehalem":"true","cpu-model-migration.node.kubevirt.io/Nehalem-IBRS":"true","cpu-model-migration.node.kubevirt.io/Opteron_G1":"true","cpu-model-migration.node.kubevirt.io/Penryn":"true","cpu-model-migration.node.kubevirt.io/SandyBridge":"true","cpu-model-migration.node.kubevirt.io/SandyBridge-IBRS":"true","cpu-model-migration.node.kubevirt.io/Skylake-Client":"true","cpu-model-migration.node.kubevirt.io/Skylake-Client-IBRS":"true","cpu-model-migration.node.kubevirt.io/Skylake-Client-noTSX-IBRS":"true","cpu-model-migration.node.kubevirt.io/Skylake-Server":"true","cpu-model-migration.node.kubevirt.io/Skylake-Server-IBRS":"true","cpu-model-migration.node.kubevirt.io/Skylake-Server-noTSX-IBRS":"true","cpu-model-migration.node.kubevirt.io/Westmere":"true","cpu-model-migration.node.kubevirt.io/Westmere-IBRS":"true","cpu-model.node.kubevirt.io/Broadwell":"true","cpu-model.node.kubevirt.io/Broadwell-IBRS":"true","cpu-model.node.kubevirt.io/Broadwell-noTSX":"true","cpu-model.node.kubevirt.io/Broadwell-noTSX-IBRS":"true","cpu-model.node.kubevirt.io/Haswell":"true","cpu-model.node.kubevirt.io/Haswell-IBRS":"true","cpu-model.node.kubevirt.io/Haswell-noTSX":"true","cpu-model.node.kubevirt.io/Haswell-noTSX-IBRS":"true","cpu-model.node.kubevirt.io/IvyBridge":"true","cpu-model.node.kubevirt.io/IvyBridge-IBRS":"true","cpu-model.node.kubevirt.io/Nehalem":"true","cpu-model.node.kubevirt.io/Nehalem-IBRS":"true","cpu-model.node.kubevirt.io/Opteron_G1":"true","cpu-model.node.kubevirt.io/Penryn":"true","cpu-model.node.kubevirt.io/SandyBridge":"true","cpu-model.node.kubevirt.io/SandyBridge-IBRS":"true","cpu-model.node.kubevirt.io/Skylake-Client":"true","cpu-model.node.kubevirt.io/Skylake-Client-IBRS":"true","cpu-model.node.kubevirt.io/Skylake-Client-noTSX-IBRS":"true","cpu-model.node.kubevirt.io/Skylake-Server":"true","cpu-model.node.kubevirt.io/Skylake-Server-IBRS":"true","cpu-model.node.kubevirt.io/Skylake-Server-noTSX-IBRS":"true","cpu-model.node.kubevirt.io/Westmere":"true","cpu-model.node.kubevirt.io/Westmere-IBRS":"true","cpu-timer.node.kubevirt.io/tsc-frequency":"2199997000","cpu-timer.node.kubevirt.io/tsc-scalable":"true","cpu-vendor.node.kubevirt.io/Intel":"true","cpumanager":"true","feature.node.kubernetes.io/cpu-cpuid.ADX":"true","feature.node.kubernetes.io/cpu-cpuid.AESNI":"true","feature.node.kubernetes.io/cpu-cpuid.AVX":"true","feature.node.kubernetes.io/cpu-cpuid.AVX2":"true","feature.node.kubernetes.io/cpu-cpuid.AVX512BW":"true","feature.node.kubernetes.io/cpu-cpuid.AVX512CD":"true","feature.node.kubernetes.io/cpu-cpuid.AVX512DQ":"true","feature.node.kubernetes.io/cpu-cpuid.AVX512F":"true","feature.node.kubernetes.io/cpu-cpuid.AVX512VL":"true","feature.node.kubernetes.io/cpu-cpuid.CMPXCHG8":"true","feature.node.kubernetes.io/cpu-cpuid.FLUSH_L1D":"true","feature.node.kubernetes.io/cpu-cpuid.FMA3":"true","feature.node.kubernetes.io/cpu-cpuid.FXSR":"true","feature.node.kubernetes.io/cpu-cpuid.FXSROPT":"true","feature.node.kubernetes.io/cpu-cpuid.HLE":"true","feature.node.kubernetes.io/cpu-cpuid.IA32_ARCH_CAP":"true","feature.node.kubernetes.io/cpu-cpuid.IBPB":"true","feature.node.kubernetes.io/cpu-cpuid.LAHF":"true","feature.node.kubernetes.io/cpu-cpuid.MD_CLEAR":"true","feature.node.kubernetes.io/cpu-cpuid.MOVBE":"true","feature.node.kubernetes.io/cpu-cpuid.MPX":"true","feature.node.kubernetes.io/cpu-cpuid.OSXSAVE":"true","feature.node.kubernetes.io/cpu-cpuid.RTM":"true","feature.node.kubernetes.io/cpu-cpuid.SPEC_CTRL_SSBD":"true","feature.node.kubernetes.io/cpu-cpuid.STIBP":"true","feature.node.kubernetes.io/cpu-cpuid.SYSCALL":"true","feature.node.kubernetes.io/cpu-cpuid.SYSEE":"true","feature.node.kubernetes.io/cpu-cpuid.VMX":"true","feature.node.kubernetes.io/cpu-cpuid.X87":"true","feature.node.kubernetes.io/cpu-cpuid.XGETBV1":"true","feature.node.kubernetes.io/cpu-cpuid.XSAVE":"true","feature.node.kubernetes.io/cpu-cpuid.XSAVEC":"true","feature.node.kubernetes.io/cpu-cpuid.XSAVEOPT":"true","feature.node.kubernetes.io/cpu-cpuid.XSAVES":"true","feature.node.kubernetes.io/cpu-cstate.enabled":"true","feature.node.kubernetes.io/cpu-hardware_multithreading":"false","feature.node.kubernetes.io/cpu-model.family":"6","feature.node.kubernetes.io/cpu-model.id":"85","feature.node.kubernetes.io/cpu-model.vendor_id":"Intel","feature.node.kubernetes.io/cpu-pstate.scaling_governor":"performance","feature.node.kubernetes.io/cpu-pstate.status":"active","feature.node.kubernetes.io/cpu-pstate.turbo":"true","feature.node.kubernetes.io/cpu-rdt.RDTCMT":"true","feature.node.kubernetes.io/cpu-rdt.RDTL3CA":"true","feature.node.kubernetes.io/cpu-rdt.RDTMBA":"true","feature.node.kubernetes.io/cpu-rdt.RDTMBM":"true","feature.node.kubernetes.io/cpu-rdt.RDTMON":"true","feature.node.kubernetes.io/kernel-config.NO_HZ":"true","feature.node.kubernetes.io/kernel-config.NO_HZ_FULL":"true","feature.node.kubernetes.io/kernel-version.full":"5.14.0-362.18.1.el9_3.x86_64","feature.node.kubernetes.io/kernel-version.major":"5","feature.node.kubernetes.io/kernel-version.minor":"14","feature.node.kubernetes.io/kernel-version.revision":"0","feature.node.kubernetes.io/memory-numa":"true","feature.node.kubernetes.io/network-sriov.capable":"true","feature.node.kubernetes.io/network-sriov.configured":"true","feature.node.kubernetes.io/pci-0300_102b.present":"true","feature.node.kubernetes.io/system-os_release.ID":"rocky","feature.node.kubernetes.io/system-os_release.VERSION_ID":"9.3","feature.node.kubernetes.io/system-os_release.VERSION_ID.major":"9","feature.node.kubernetes.io/system-os_release.VERSION_ID.minor":"3","host-model-cpu.node.kubevirt.io/Skylake-Server-IBRS":"true","host-model-required-features.node.kubevirt.io/amd-ssbd":"true","host-model-required-features.node.kubevirt.io/amd-stibp":"true","host-model-required-features.node.kubevirt.io/arch-capabilities":"true","host-model-required-features.node.kubevirt.io/clflushopt":"true","host-model-required-features.node.kubevirt.io/flush-l1d":"true","host-model-required-features.node.kubevirt.io/hypervisor":"true","host-model-required-features.node.kubevirt.io/ibpb":"true","host-model-required-features.node.kubevirt.io/ibrs":"true","host-model-required-features.node.kubevirt.io/invtsc":"true","host-model-required-features.node.kubevirt.io/md-clear":"true","host-model-required-features.node.kubevirt.io/pdcm":"true","host-model-required-features.node.kubevirt.io/pku":"true","host-model-required-features.node.kubevirt.io/pschange-mc-no":"true","host-model-required-features.node.kubevirt.io/rsba":"true","host-model-required-features.node.kubevirt.io/skip-l1dfl-vmentry":"true","host-model-required-features.node.kubevirt.io/ss":"true","host-model-required-features.node.kubevirt.io/ssbd":"true","host-model-required-features.node.kubevirt.io/stibp":"true","host-model-required-features.node.kubevirt.io/tsc_adjust":"true","host-model-required-features.node.kubevirt.io/umip":"true","host-model-required-features.node.kubevirt.io/vmx":"true","host-model-required-features.node.kubevirt.io/xsaves":"true","hyperv.node.kubevirt.io/base":"true","hyperv.node.kubevirt.io/frequencies":"true","hyperv.node.kubevirt.io/ipi":"true","hyperv.node.kubevirt.io/reenlightenment":"true","hyperv.node.kubevirt.io/reset":"true","hyperv.node.kubevirt.io/runtime":"true","hyperv.node.kubevirt.io/synic":"true","hyperv.node.kubevirt.io/synic2":"true","hyperv.node.kubevirt.io/synictimer":"true","hyperv.node.kubevirt.io/time":"true","hyperv.node.kubevirt.io/tlbflush":"true","hyperv.node.kubevirt.io/vpindex":"true","kubernetes.io/arch":"amd64","kubernetes.io/hostname":"bne-lab-vr-2.i.example.com","kubernetes.io/os":"linux","kubevirt.io/ksm-enabled":"false","kubevirt.io/schedulable":"false","node-role.kubernetes.io/control-plane":"true","node-role.kubernetes.io/etcd":"true","node-role.kubernetes.io/master":"true","node-role.kubernetes.io/worker":"","node.kubernetes.io/instance-type":"rke2","openebs.io/nodeid":"bne-lab-vr-2.i.example.com","openebs.io/nodename":"bne-lab-vr-2.i.example.com","scheduling.node.kubevirt.io/tsc-frequency-2200000000":"true"}},"node_id":"bne-lab-vr-2.i.example.com"}
E0419 03:00:29.719890 1 zfs_util.go:732] zfs: could not destroy snapshot pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d cmd [destroy zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d] error: cannot destroy 'zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d': snapshot has dependent clones
use '-R' to destroy the following datasets:
zfspv-pool/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76
E0419 03:00:29.719958 1 snapshot.go:248] error syncing 'openebs/snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d': exit status 1, requeuing
E0419 03:00:31.027940 1 zfs_util.go:732] zfs: could not destroy snapshot pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d cmd [destroy zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d] error: cannot destroy 'zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d': snapshot has dependent clones
use '-R' to destroy the following datasets:
zfspv-pool/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76
E0419 03:00:31.027997 1 snapshot.go:248] error syncing 'openebs/snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d': exit status 1, requeuing
E0419 03:00:33.616138 1 zfs_util.go:732] zfs: could not destroy snapshot pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d cmd [destroy zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d] error: cannot destroy 'zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d': snapshot has dependent clones
use '-R' to destroy the following datasets:
zfspv-pool/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76
E0419 03:00:33.616181 1 snapshot.go:248] error syncing 'openebs/snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d': exit status 1, requeuing
E0419 03:00:38.762256 1 zfs_util.go:732] zfs: could not destroy snapshot pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d cmd [destroy zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d] error: cannot destroy 'zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d': snapshot has dependent clones
use '-R' to destroy the following datasets:
zfspv-pool/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76
E0419 03:00:38.762295 1 snapshot.go:248] error syncing 'openebs/snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d': exit status 1, requeuing
I0419 03:00:40.462168 1 grpc.go:72] GRPC call: /csi.v1.Node/NodeUnpublishVolume requests {"target_path":"/var/lib/kubelet/pods/d5e3465e-2a6d-4942-b14f-2864a6e09365/volumes/kubernetes.io~csi/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76/mount","volume_id":"pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76"}
W0419 03:00:40.469751 1 mount.go:86] Warning: Unmount skipped because volume pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76 not mounted: /var/lib/kubelet/pods/d5e3465e-2a6d-4942-b14f-2864a6e09365/volumes/kubernetes.io~csi/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76/mount
I0419 03:00:40.469769 1 agent.go:202] hostpath: volume pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76 path: /var/lib/kubelet/pods/d5e3465e-2a6d-4942-b14f-2864a6e09365/volumes/kubernetes.io~csi/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76/mount has been unmounted.
I0419 03:00:40.469777 1 grpc.go:81] GRPC response: {}
E0419 03:00:49.031906 1 zfs_util.go:732] zfs: could not destroy snapshot pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d cmd [destroy zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d] error: cannot destroy 'zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d': snapshot has dependent clones
use '-R' to destroy the following datasets:
zfspv-pool/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76
E0419 03:00:49.031981 1 snapshot.go:248] error syncing 'openebs/snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d': exit status 1, requeuing
I0419 03:00:57.830805 1 snapshot.go:133] Got update event for Snap zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d
E0419 03:00:57.855599 1 zfs_util.go:732] zfs: could not destroy snapshot pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d cmd [destroy zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d] error: cannot destroy 'zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d': snapshot has dependent clones
use '-R' to destroy the following datasets:
zfspv-pool/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76
E0419 03:00:57.855666 1 snapshot.go:248] error syncing 'openebs/snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d': exit status 1, requeuing
E0419 03:01:09.542028 1 zfs_util.go:732] zfs: could not destroy snapshot pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d cmd [destroy zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d] error: cannot destroy 'zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d': snapshot has dependent clones
use '-R' to destroy the following datasets:
zfspv-pool/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76
E0419 03:01:09.542075 1 snapshot.go:248] error syncing 'openebs/snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d': exit status 1, requeuing
I0419 03:01:11.133308 1 grpc.go:72] GRPC call: /csi.v1.Node/NodePublishVolume requests {"target_path":"/var/lib/kubelet/pods/ebd1b992-cb77-4ac7-9f91-b9326d7b9aa9/volumes/kubernetes.io~csi/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76/mount","volume_capability":{"AccessType":{"Mount":{"fs_type":"zfs"}},"access_mode":{"mode":1}},"volume_context":{"openebs.io/cas-type":"localpv-zfs","openebs.io/poolname":"zfspv-pool","storage.kubernetes.io/csiProvisionerIdentity":"1713489189699-2766-zfs.csi.openebs.io"},"volume_id":"pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76"}
I0419 03:01:11.446522 1 mount.go:240] dataset : legacy mounted zfspv-pool/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76 => /var/lib/kubelet/pods/ebd1b992-cb77-4ac7-9f91-b9326d7b9aa9/volumes/kubernetes.io~csi/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76/mount
I0419 03:01:11.446549 1 grpc.go:81] GRPC response: {}
I0419 03:01:27.831066 1 snapshot.go:133] Got update event for Snap zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d
E0419 03:01:27.853331 1 zfs_util.go:732] zfs: could not destroy snapshot pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d cmd [destroy zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d] error: cannot destroy 'zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d': snapshot has dependent clones
use '-R' to destroy the following datasets:
zfspv-pool/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76
E0419 03:01:27.853369 1 snapshot.go:248] error syncing 'openebs/snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d': exit status 1, requeuing
I0419 03:01:27.939733 1 zfsnode.go:100] zfs node controller: node pools updated current=[{Name:zfspv-pool UUID:15979848324292221408 Free:{i:{value:2259083128320 scale:0} d:{Dec:<nil>} s:2259083128320 Format:DecimalSI} Used:{i:{value:4901507584 scale:0} d:{Dec:<nil>} s:4901507584 Format:DecimalSI}}], required=[{Name:zfspv-pool UUID:15979848324292221408 Free:{i:{value:2259083520000 scale:0} d:{Dec:<nil>} s: Format:BinarySI} Used:{i:{value:4901115904 scale:0} d:{Dec:<nil>} s: Format:BinarySI}}]
I0419 03:01:27.939764 1 zfsnode.go:110] zfs node controller: updating node object with &{TypeMeta:{Kind: APIVersion:} ObjectMeta:{Name:bne-lab-vr-2.i.example.com GenerateName: Namespace:openebs SelfLink: UID:e9dadda8-5e64-42e3-b070-6f59c0941ac7 ResourceVersion:1322460 Generation:3051 CreationTimestamp:2024-04-16 22:35:04 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[] Annotations:map[] OwnerReferences:[{APIVersion:v1 Kind:Node Name:bne-lab-vr-2.i.example.com UID:97df1eba-a604-459f-9bb7-dc63f0a4afaa Controller:0xc0002a60d8 BlockOwnerDeletion:<nil>}] Finalizers:[] ManagedFields:[{Manager:zfs-driver Operation:Update APIVersion:zfs.openebs.io/v1 Time:2024-04-19 03:00:28 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:ownerReferences":{".":{},"k:{\"uid\":\"97df1eba-a604-459f-9bb7-dc63f0a4afaa\"}":{}}},"f:pools":{}} Subresource:}]} Pools:[{Name:zfspv-pool UUID:15979848324292221408 Free:{i:{value:2259083520000 scale:0} d:{Dec:<nil>} s: Format:BinarySI} Used:{i:{value:4901115904 scale:0} d:{Dec:<nil>} s: Format:BinarySI}}]}
I0419 03:01:27.955977 1 zfsnode.go:114] zfs node controller: updated node object openebs/bne-lab-vr-2.i.example.com
I0419 03:01:27.956057 1 zfsnode.go:139] Got update event for zfs node openebs/bne-lab-vr-2.i.example.com
I0419 03:01:39.265783 1 grpc.go:72] GRPC call: /csi.v1.Node/NodeUnpublishVolume requests {"target_path":"/var/lib/kubelet/pods/ebd1b992-cb77-4ac7-9f91-b9326d7b9aa9/volumes/kubernetes.io~csi/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76/mount","volume_id":"pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76"}
I0419 03:01:39.324005 1 mount.go:124] umount done pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76 path /var/lib/kubelet/pods/ebd1b992-cb77-4ac7-9f91-b9326d7b9aa9/volumes/kubernetes.io~csi/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76/mount
I0419 03:01:39.324050 1 agent.go:202] hostpath: volume pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76 path: /var/lib/kubelet/pods/ebd1b992-cb77-4ac7-9f91-b9326d7b9aa9/volumes/kubernetes.io~csi/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76/mount has been unmounted.
I0419 03:01:39.324063 1 grpc.go:81] GRPC response: {}
I0419 03:01:40.406302 1 volume.go:144] Got update event for ZV zfspv-pool/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76
I0419 03:01:40.425642 1 volume.go:144] Got update event for ZV zfspv-pool/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76
I0419 03:01:40.649656 1 zfs_util.go:672] destroyed volume zfspv-pool/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76
E0419 03:01:40.660620 1 volume.go:259] error syncing 'openebs/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76': Operation cannot be fulfilled on zfsvolumes.zfs.openebs.io "pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76": the object has been modified; please apply your changes to the latest version and try again, requeuing
E0419 03:01:40.673202 1 zfs_util.go:635] destroy: volume zfspv-pool/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76 is not present, error: exit status 1
I0419 03:01:40.690734 1 volume.go:254] Successfully synced 'openebs/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76'
I0419 03:01:40.690754 1 volume.go:169] Got delete event for ZV zfspv-pool/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76
E0419 03:01:40.690759 1 volume.go:50] zfsvolume 'openebs/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76' has been deleted
I0419 03:01:40.690774 1 volume.go:254] Successfully synced 'openebs/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76'
E0419 03:01:40.690789 1 volume.go:50] zfsvolume 'openebs/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76' has been deleted
I0419 03:01:40.691882 1 volume.go:254] Successfully synced 'openebs/pvc-b69d007e-56ae-4f4a-a93a-e6e879204f76'
I0419 03:01:53.160871 1 snapshot.go:114] Got add event for Snap zfspv-pool/snapshot-0ae0ade0-ae4d-4488-bd3d-2a0bc07905f0
I0419 03:01:53.410300 1 zfs_util.go:699] created snapshot pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-0ae0ade0-ae4d-4488-bd3d-2a0bc07905f0
I0419 03:01:53.430022 1 snapshot.go:243] Successfully synced 'openebs/snapshot-0ae0ade0-ae4d-4488-bd3d-2a0bc07905f0'
I0419 03:01:57.831988 1 snapshot.go:133] Got update event for Snap zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d
I0419 03:01:58.049820 1 zfs_util.go:737] deleted snapshot pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d
I0419 03:01:58.068053 1 snapshot.go:243] Successfully synced 'openebs/snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d'
I0419 03:01:58.068158 1 snapshot.go:158] Got delete event for Snap zfspv-pool/pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065@snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d
E0419 03:01:58.068186 1 snapshot.go:50] zfs snapshot 'openebs/snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d' has been deleted
I0419 03:01:58.068194 1 snapshot.go:243] Successfully synced 'openebs/snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d'
I0419 03:02:27.943053 1 zfsnode.go:100] zfs node controller: node pools updated current=[{Name:zfspv-pool UUID:15979848324292221408 Free:{i:{value:2259083520000 scale:0} d:{Dec:<nil>} s:2206136250Ki Format:BinarySI} Used:{i:{value:4901115904 scale:0} d:{Dec:<nil>} s:4786246Ki Format:BinarySI}}], required=[{Name:zfspv-pool UUID:15979848324292221408 Free:{i:{value:2259140997632 scale:0} d:{Dec:<nil>} s: Format:BinarySI} Used:{i:{value:4843638272 scale:0} d:{Dec:<nil>} s: Format:BinarySI}}]
I0419 03:02:27.943093 1 zfsnode.go:110] zfs node controller: updating node object with &{TypeMeta:{Kind: APIVersion:} ObjectMeta:{Name:bne-lab-vr-2.i.example.com GenerateName: Namespace:openebs SelfLink: UID:e9dadda8-5e64-42e3-b070-6f59c0941ac7 ResourceVersion:1323074 Generation:3052 CreationTimestamp:2024-04-16 22:35:04 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[] Annotations:map[] OwnerReferences:[{APIVersion:v1 Kind:Node Name:bne-lab-vr-2.i.example.com UID:97df1eba-a604-459f-9bb7-dc63f0a4afaa Controller:0xc0002a7eb0 BlockOwnerDeletion:<nil>}] Finalizers:[] ManagedFields:[{Manager:zfs-driver Operation:Update APIVersion:zfs.openebs.io/v1 Time:2024-04-19 03:01:27 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:ownerReferences":{".":{},"k:{\"uid\":\"97df1eba-a604-459f-9bb7-dc63f0a4afaa\"}":{}}},"f:pools":{}} Subresource:}]} Pools:[{Name:zfspv-pool UUID:15979848324292221408 Free:{i:{value:2259140997632 scale:0} d:{Dec:<nil>} s: Format:BinarySI} Used:{i:{value:4843638272 scale:0} d:{Dec:<nil>} s: Format:BinarySI}}]}
I0419 03:02:27.946362 1 zfsnode.go:114] zfs node controller: updated node object openebs/bne-lab-vr-2.i.example.com
I0419 03:02:27.946496 1 zfsnode.go:139] Got update event for zfs node openebs/bne-lab-vr-2.i.example.com
E0419 03:02:31.464104 1 snapshot.go:50] zfs snapshot 'openebs/snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d' has been deleted
I0419 03:02:31.464132 1 snapshot.go:243] Successfully synced 'openebs/snapshot-ec67e67e-49b9-4666-af88-ab4edb44e77d'
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Provisioning 9s (x6 over 40s) zfs.csi.openebs.io_openebs-zfs-localpv-controller-6f879b95b-jbx8p_da1292cf-7d6f-44c6-badf-f6cec37555d8 External provisioner is provisioning volume for claim "vm-images/tmp-pvc-af37efd7-c926-4adb-971f-d54ff46ba57b"
Warning ProvisioningFailed 9s (x6 over 40s) zfs.csi.openebs.io_openebs-zfs-localpv-controller-6f879b95b-jbx8p_da1292cf-7d6f-44c6-badf-f6cec37555d8 failed to provision volume with StorageClass "openebs-zfspv": error generating accessibility requirements: topologyKeys [beta.kubernetes.io/arch beta.kubernetes.io/instance-type beta.kubernetes.io/os cpu-feature.node.kubevirt.io/3dnowprefetch cpu-feature.node.kubevirt.io/abm cpu-feature.node.kubevirt.io/adx cpu-feature.node.kubevirt.io/aes cpu-feature.node.kubevirt.io/amd-ssbd cpu-feature.node.kubevirt.io/amd-stibp cpu-feature.node.kubevirt.io/apic cpu-feature.node.kubevirt.io/arat cpu-feature.node.kubevirt.io/arch-capabilities cpu-feature.node.kubevirt.io/avx cpu-feature.node.kubevirt.io/avx2 cpu-feature.node.kubevirt.io/avx512bw cpu-feature.node.kubevirt.io/avx512cd cpu-feature.node.kubevirt.io/avx512dq cpu-feature.node.kubevirt.io/avx512f cpu-feature.node.kubevirt.io/avx512vl cpu-feature.node.kubevirt.io/bmi1 cpu-feature.node.kubevirt.io/bmi2 cpu-feature.node.kubevirt.io/clflush cpu-feature.node.kubevirt.io/clflushopt cpu-feature.node.kubevirt.io/clwb cpu-feature.node.kubevirt.io/cmov cpu-feature.node.kubevirt.io/cx16 cpu-feature.node.kubevirt.io/cx8 cpu-feature.node.kubevirt.io/de cpu-feature.node.kubevirt.io/erms cpu-feature.node.kubevirt.io/f16c cpu-feature.node.kubevirt.io/flush-l1d cpu-feature.node.kubevirt.io/fma cpu-feature.node.kubevirt.io/fpu cpu-feature.node.kubevirt.io/fsgsbase cpu-feature.node.kubevirt.io/fxsr cpu-feature.node.kubevirt.io/hle cpu-feature.node.kubevirt.io/hypervisor cpu-feature.node.kubevirt.io/ibpb cpu-feature.node.kubevirt.io/ibrs cpu-feature.node.kubevirt.io/invpcid cpu-feature.node.kubevirt.io/invtsc cpu-feature.node.kubevirt.io/lahf_lm cpu-feature.node.kubevirt.io/lm cpu-feature.node.kubevirt.io/mca cpu-feature.node.kubevirt.io/mce cpu-feature.node.kubevirt.io/md-clear cpu-feature.node.kubevirt.io/mmx cpu-feature.node.kubevirt.io/movbe cpu-feature.node.kubevirt.io/mpx cpu-feature.node.kubevirt.io/msr cpu-feature.node.kubevirt.io/mtrr cpu-feature.node.kubevirt.io/nx cpu-feature.node.kubevirt.io/pae cpu-feature.node.kubevirt.io/pat cpu-feature.node.kubevirt.io/pcid cpu-feature.node.kubevirt.io/pclmuldq cpu-feature.node.kubevirt.io/pdcm cpu-feature.node.kubevirt.io/pdpe1gb cpu-feature.node.kubevirt.io/pge cpu-feature.node.kubevirt.io/pku cpu-feature.node.kubevirt.io/pni cpu-feature.node.kubevirt.io/popcnt cpu-feature.node.kubevirt.io/pschange-mc-no cpu-feature.node.kubevirt.io/pse cpu-feature.node.kubevirt.io/pse36 cpu-feature.node.kubevirt.io/rdrand cpu-feature.node.kubevirt.io/rdseed cpu-feature.node.kubevirt.io/rdtscp cpu-feature.node.kubevirt.io/rsba cpu-feature.node.kubevirt.io/rtm cpu-feature.node.kubevirt.io/sep cpu-feature.node.kubevirt.io/skip-l1dfl-vmentry cpu-feature.node.kubevirt.io/smap cpu-feature.node.kubevirt.io/smep cpu-feature.node.kubevirt.io/spec-ctrl cpu-feature.node.kubevirt.io/ss cpu-feature.node.kubevirt.io/ssbd cpu-feature.node.kubevirt.io/sse cpu-feature.node.kubevirt.io/sse2 cpu-feature.node.kubevirt.io/sse4.1 cpu-feature.node.kubevirt.io/sse4.2 cpu-feature.node.kubevirt.io/ssse3 cpu-feature.node.kubevirt.io/stibp cpu-feature.node.kubevirt.io/syscall cpu-feature.node.kubevirt.io/tsc cpu-feature.node.kubevirt.io/tsc-deadline cpu-feature.node.kubevirt.io/tsc_adjust cpu-feature.node.kubevirt.io/umip cpu-feature.node.kubevirt.io/vme cpu-feature.node.kubevirt.io/vmx cpu-feature.node.kubevirt.io/x2apic cpu-feature.node.kubevirt.io/xgetbv1 cpu-feature.node.kubevirt.io/xsave cpu-feature.node.kubevirt.io/xsavec cpu-feature.node.kubevirt.io/xsaveopt cpu-feature.node.kubevirt.io/xsaves cpu-model-migration.node.kubevirt.io/Broadwell cpu-model-migration.node.kubevirt.io/Broadwell-IBRS cpu-model-migration.node.kubevirt.io/Broadwell-noTSX cpu-model-migration.node.kubevirt.io/Broadwell-noTSX-IBRS cpu-model-migration.node.kubevirt.io/Haswell cpu-model-migration.node.kubevirt.io/Haswell-IBRS cpu-model-migration.node.kubevirt.io/Haswell-noTSX cpu-model-migration.node.kubevirt.io/Haswell-noTSX-IBRS cpu-model-migration.node.kubevirt.io/IvyBridge cpu-model-migration.node.kubevirt.io/IvyBridge-IBRS cpu-model-migration.node.kubevirt.io/Nehalem cpu-model-migration.node.kubevirt.io/Nehalem-IBRS cpu-model-migration.node.kubevirt.io/Opteron_G1 cpu-model-migration.node.kubevirt.io/Penryn cpu-model-migration.node.kubevirt.io/SandyBridge cpu-model-migration.node.kubevirt.io/SandyBridge-IBRS cpu-model-migration.node.kubevirt.io/Skylake-Client cpu-model-migration.node.kubevirt.io/Skylake-Client-IBRS cpu-model-migration.node.kubevirt.io/Skylake-Client-noTSX-IBRS cpu-model-migration.node.kubevirt.io/Skylake-Server cpu-model-migration.node.kubevirt.io/Skylake-Server-IBRS cpu-model-migration.node.kubevirt.io/Skylake-Server-noTSX-IBRS cpu-model-migration.node.kubevirt.io/Westmere cpu-model-migration.node.kubevirt.io/Westmere-IBRS cpu-model.node.kubevirt.io/Broadwell cpu-model.node.kubevirt.io/Broadwell-IBRS cpu-model.node.kubevirt.io/Broadwell-noTSX cpu-model.node.kubevirt.io/Broadwell-noTSX-IBRS cpu-model.node.kubevirt.io/Haswell cpu-model.node.kubevirt.io/Haswell-IBRS cpu-model.node.kubevirt.io/Haswell-noTSX cpu-model.node.kubevirt.io/Haswell-noTSX-IBRS cpu-model.node.kubevirt.io/IvyBridge cpu-model.node.kubevirt.io/IvyBridge-IBRS cpu-model.node.kubevirt.io/Nehalem cpu-model.node.kubevirt.io/Nehalem-IBRS cpu-model.node.kubevirt.io/Opteron_G1 cpu-model.node.kubevirt.io/Penryn cpu-model.node.kubevirt.io/SandyBridge cpu-model.node.kubevirt.io/SandyBridge-IBRS cpu-model.node.kubevirt.io/Skylake-Client cpu-model.node.kubevirt.io/Skylake-Client-IBRS cpu-model.node.kubevirt.io/Skylake-Client-noTSX-IBRS cpu-model.node.kubevirt.io/Skylake-Server cpu-model.node.kubevirt.io/Skylake-Server-IBRS cpu-model.node.kubevirt.io/Skylake-Server-noTSX-IBRS cpu-model.node.kubevirt.io/Westmere cpu-model.node.kubevirt.io/Westmere-IBRS cpu-timer.node.kubevirt.io/tsc-frequency cpu-timer.node.kubevirt.io/tsc-scalable cpu-vendor.node.kubevirt.io/Intel cpumanager feature.node.kubernetes.io/cpu-cpuid.ADX feature.node.kubernetes.io/cpu-cpuid.AESNI feature.node.kubernetes.io/cpu-cpuid.AVX feature.node.kubernetes.io/cpu-cpuid.AVX2 feature.node.kubernetes.io/cpu-cpuid.AVX512BW feature.node.kubernetes.io/cpu-cpuid.AVX512CD feature.node.kubernetes.io/cpu-cpuid.AVX512DQ feature.node.kubernetes.io/cpu-cpuid.AVX512F feature.node.kubernetes.io/cpu-cpuid.AVX512VL feature.node.kubernetes.io/cpu-cpuid.CMPXCHG8 feature.node.kubernetes.io/cpu-cpuid.FLUSH_L1D feature.node.kubernetes.io/cpu-cpuid.FMA3 feature.node.kubernetes.io/cpu-cpuid.FXSR feature.node.kubernetes.io/cpu-cpuid.FXSROPT feature.node.kubernetes.io/cpu-cpuid.HLE feature.node.kubernetes.io/cpu-cpuid.IA32_ARCH_CAP feature.node.kubernetes.io/cpu-cpuid.IBPB feature.node.kubernetes.io/cpu-cpuid.LAHF feature.node.kubernetes.io/cpu-cpuid.MD_CLEAR feature.node.kubernetes.io/cpu-cpuid.MOVBE feature.node.kubernetes.io/cpu-cpuid.MPX feature.node.kubernetes.io/cpu-cpuid.OSXSAVE feature.node.kubernetes.io/cpu-cpuid.RTM feature.node.kubernetes.io/cpu-cpuid.SPEC_CTRL_SSBD feature.node.kubernetes.io/cpu-cpuid.STIBP feature.node.kubernetes.io/cpu-cpuid.SYSCALL feature.node.kubernetes.io/cpu-cpuid.SYSEE feature.node.kubernetes.io/cpu-cpuid.VMX feature.node.kubernetes.io/cpu-cpuid.X87 feature.node.kubernetes.io/cpu-cpuid.XGETBV1 feature.node.kubernetes.io/cpu-cpuid.XSAVE feature.node.kubernetes.io/cpu-cpuid.XSAVEC feature.node.kubernetes.io/cpu-cpuid.XSAVEOPT feature.node.kubernetes.io/cpu-cpuid.XSAVES feature.node.kubernetes.io/cpu-cstate.enabled feature.node.kubernetes.io/cpu-hardware_multithreading feature.node.kubernetes.io/cpu-model.family feature.node.kubernetes.io/cpu-model.id feature.node.kubernetes.io/cpu-model.vendor_id feature.node.kubernetes.io/cpu-pstate.scaling_governor feature.node.kubernetes.io/cpu-pstate.status feature.node.kubernetes.io/cpu-pstate.turbo feature.node.kubernetes.io/cpu-rdt.RDTCMT feature.node.kubernetes.io/cpu-rdt.RDTL3CA feature.node.kubernetes.io/cpu-rdt.RDTMBA feature.node.kubernetes.io/cpu-rdt.RDTMBM feature.node.kubernetes.io/cpu-rdt.RDTMON feature.node.kubernetes.io/kernel-config.NO_HZ feature.node.kubernetes.io/kernel-config.NO_HZ_FULL feature.node.kubernetes.io/kernel-version.full feature.node.kubernetes.io/kernel-version.major feature.node.kubernetes.io/kernel-version.minor feature.node.kubernetes.io/kernel-version.revision feature.node.kubernetes.io/memory-numa feature.node.kubernetes.io/network-sriov.capable feature.node.kubernetes.io/network-sriov.configured feature.node.kubernetes.io/pci-0300_102b.present feature.node.kubernetes.io/system-os_release.ID feature.node.kubernetes.io/system-os_release.VERSION_ID feature.node.kubernetes.io/system-os_release.VERSION_ID.major feature.node.kubernetes.io/system-os_release.VERSION_ID.minor host-model-cpu.node.kubevirt.io/Skylake-Server-IBRS host-model-required-features.node.kubevirt.io/amd-ssbd host-model-required-features.node.kubevirt.io/amd-stibp host-model-required-features.node.kubevirt.io/arch-capabilities host-model-required-features.node.kubevirt.io/clflushopt host-model-required-features.node.kubevirt.io/flush-l1d host-model-required-features.node.kubevirt.io/hypervisor host-model-required-features.node.kubevirt.io/ibpb host-model-required-features.node.kubevirt.io/ibrs host-model-required-features.node.kubevirt.io/invtsc host-model-required-features.node.kubevirt.io/md-clear host-model-required-features.node.kubevirt.io/pdcm host-model-required-features.node.kubevirt.io/pku host-model-required-features.node.kubevirt.io/pschange-mc-no host-model-required-features.node.kubevirt.io/rsba host-model-required-features.node.kubevirt.io/skip-l1dfl-vmentry host-model-required-features.node.kubevirt.io/ss host-model-required-features.node.kubevirt.io/ssbd host-model-required-features.node.kubevirt.io/stibp host-model-required-features.node.kubevirt.io/tsc_adjust host-model-required-features.node.kubevirt.io/umip host-model-required-features.node.kubevirt.io/vmx host-model-required-features.node.kubevirt.io/xsaves hyperv.node.kubevirt.io/base hyperv.node.kubevirt.io/frequencies hyperv.node.kubevirt.io/ipi hyperv.node.kubevirt.io/reenlightenment hyperv.node.kubevirt.io/reset hyperv.node.kubevirt.io/runtime hyperv.node.kubevirt.io/synic hyperv.node.kubevirt.io/synic2 hyperv.node.kubevirt.io/synictimer hyperv.node.kubevirt.io/time hyperv.node.kubevirt.io/tlbflush hyperv.node.kubevirt.io/vpindex kubernetes.io/arch kubernetes.io/hostname kubernetes.io/os kubevirt.io/ksm-enabled kubevirt.io/schedulable node-role.kubernetes.io/control-plane node-role.kubernetes.io/etcd node-role.kubernetes.io/master node-role.kubernetes.io/worker node.kubernetes.io/instance-type openebs.io/nodeid openebs.io/nodename scheduling.node.kubevirt.io/tsc-frequency-2200000000] were not found on any nodes
Normal ExternalProvisioning 1s (x4 over 40s) persistentvolume-controller Waiting for a volume to be created either by the external provisioner 'zfs.csi.openebs.io' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered.
$ kubectl get zv -A -o yaml
apiVersion: v1
items:
- apiVersion: zfs.openebs.io/v1
kind: ZFSVolume
metadata:
creationTimestamp: "2024-04-16T22:44:26Z"
finalizers:
- zfs.openebs.io/finalizer
generation: 2
labels:
kubernetes.io/nodename: bne-lab-vr-2.i.example.com
name: pvc-5cffce03-4757-4f9a-b307-8f73ef8e6065
namespace: openebs
resourceVersion: "7562"
uid: c60ceae8-e857-40d8-9174-4782c7564922
spec:
capacity: "24696061952"
compression: "off"
dedup: "off"
fsType: zfs
ownerNodeID: bne-lab-vr-2.i.example.com
poolName: zfspv-pool
recordsize: 128k
volumeType: DATASET
status:
state: Ready
- apiVersion: zfs.openebs.io/v1
kind: ZFSVolume
metadata:
creationTimestamp: "2024-04-17T01:06:30Z"
finalizers:
- zfs.openebs.io/finalizer
generation: 2
labels:
kubernetes.io/nodename: bne-lab-vr-2.i.example.com
name: pvc-79f4c293-077c-4b5d-9e42-4239aa7c3a79
namespace: openebs
resourceVersion: "68338"
uid: 7aec0a59-4b0a-4fa8-ae30-8f910f00cb31
spec:
capacity: "24696061952"
compression: "off"
dedup: "off"
fsType: zfs
ownerNodeID: bne-lab-vr-2.i.example.com
poolName: zfspv-pool
recordsize: 128k
volumeType: DATASET
status:
state: Ready
kind: List
metadata:
resourceVersion: ""
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment