What steps did you take and what happened:
[A clear and concise description of what the bug is, and what commands you ran.]
I installed openebs lvm-localpv using openebs helm chart version 4.1.1 deployed via Ansible on my k0s cluster.
Helm chart values:
image:
repository: repo.lexoya.com
# Refer to https://github.com/openebs/dynamic-localpv-provisioner/blob/HEAD/deploy/helm/charts/values.yaml for complete set of values.
localpv-provisioner:
enabled: false
rbac:
create: true
localpv:
image:
# Make sure that registry name end with a '/'.
registry: repo.lexoya.com/
openebs-crds:
csi:
volumeSnapshots:
enabled: true
keep: true
# Refer to https://github.com/openebs/zfs-localpv/blob/HEAD/deploy/helm/charts/values.yaml for complete set of values.
zfs-localpv:
enabled: false
# Refer to https://github.com/openebs/lvm-localpv/blob/HEAD/deploy/helm/charts/values.yaml for complete set of values.
lvm-localpv:
enabled: true
crds:
lvmLocalPv:
enabled: true
keep: true
csi:
volumeSnapshots:
enabled: false
lvmNode:
kubeletDir: /var/lib/k0s/kubelet/
driverRegistrar:
image:
# Make sure that registry name end with a '/'.
# For example : registry.k8s.io/ is a correct value here and quay.io is incorrect
registry: repo.lexoya.com/
lvmController:
resizer:
name: "csi-resizer"
image:
# Make sure that registry name end with a '/'.
# For example : registry.k8s.io/ is a correct value here and quay.io is incorrect
registry: repo.lexoya.com/
snapshotter:
image:
# Make sure that registry name end with a '/'.
registry: repo.lexoya.com/
snapshotController:
image:
# Make sure that registry name end with a '/'.
registry: repo.lexoya.com/
provisioner:
image:
# Make sure that registry name end with a '/'.
registry: repo.lexoya.com/
lvmPlugin:
image:
# Make sure that registry name end with a '/'.
registry: repo.lexoya.com/
# Refer to https://github.com/openebs/mayastor-extensions/blob/v2.6.0/chart/values.yaml for complete set of values.
mayastor:
enabled: false
# -- Configuration options for pre-upgrade helm hook job.
preUpgradeHook:
image:
# -- The container image registry URL for the hook job
registry: repo.lexoya.com
# -- The container repository for the hook job
repo: bitnami/kubectl
# -- The container image tag for the hook job
tag: "1.25.15"
# -- The imagePullPolicy for the container
pullPolicy: IfNotPresent
engines:
local:
lvm:
enabled: true
zfs:
enabled: false
localpv-provisioner:
enabled: false
replicated:
mayastor:
enabled: falseI created vg.openebs volume group on my k0s node and created openebs-lvm storage class:
kind: StorageClass
apiVersion: storage.k8s.io/v1
metadata:
name: openebs-lvm
uid: ca92c7a4-d488-42ab-aefd-c79cfe464c08
resourceVersion: '9349'
creationTimestamp: '2025-10-09T12:25:03Z'
provisioner: local.csi.openebs.io
parameters:
shared: 'yes'
storage: lvm
volgroup: vg.openebs
reclaimPolicy: Delete
allowVolumeExpansion: true
volumeBindingMode: Immediate
ReclaimPolicy is Delete which means when deleting PVC, PV and LV should be automatically deleted.
When I delete a PVC, PV is deleted correctly and I have no dangling PV. But when I run lvs vg.openebs on my node, it lists more LV than I have PVC or PV
mahdi@laptop:~$ kubectl get pvc -A
NAMESPACE NAME STATUS VOLUME CAPACITY ACCESS MODES STORAGECLASS VOLUMEATTRIBUTESCLASS AGE
aredaawb mphuleiayi Bound pvc-9840b5bb-50bb-42b5-94f4-f33a397b2201 259Gi RWO openebs-lvm <unset> 65d
default ubuntu-24-04 Bound pvc-150b969d-50b8-4765-830c-9342252ae3dc 5Gi RWO openebs-lvm <unset> 112d
default vm-4090-169 Bound pvc-a9ed8ea8-bd1e-4323-805a-4a1cbc1b2d65 200Gi RWO openebs-lvm <unset> 112d
eejkgcwu vqmybabpkz Bound pvc-1e3e3d90-96e2-4ec2-a957-34df6f3ea117 21Gi RWO openebs-lvm <unset> 76d
fezhtsuf voogyfnzpz Bound pvc-5c1f9965-f141-4b5a-9824-c4a483f9fc38 21Gi RWO openebs-lvm <unset> 22h
ijmvzqqy htrxvlfdpi Bound pvc-89a2a3ed-b288-4ea2-b3e2-3f771ef2c17a 42Gi RWO openebs-lvm <unset> 24d
jnpmpiyu ifklzcszoc Bound pvc-19dcfd37-f2cb-4635-b180-67286d79a01f 21Gi RWO openebs-lvm <unset> 2d4h
monitoring alertmanager-kube-prometheus-stack-db-alertmanager-kube-prometheus-stack-0 Bound pvc-3cc5371e-680b-41e5-876f-c51427b3c30c 100Mi RWO openebs-lvm <unset> 111d
monitoring kube-prometheus-stack-grafana Pending csi-rbd-sc-hdd <unset> 111d
monitoring prometheus-kube-prometheus-stack-db-prometheus-kube-prometheus-stack-0 Bound pvc-87d63b12-a6b6-4b15-b98b-2a94c65b710c 10Gi RWO openebs-lvm <unset> 111d
nubyawsibx hzezkpksfz Bound pvc-78d2c40f-ce50-4f50-98b6-22ae01e6b863 21Gi RWO openebs-lvm <unset> 2d13h
nubyawsibx sucnizrwnm Bound pvc-212890be-5290-4c39-89e6-edea1f1a508f 21Gi RWO openebs-lvm <unset> 30d
rgrojpyexy nyoqwzuych Bound pvc-217b39d0-45b3-463a-987a-d71f1bc11cc5 21Gi RWO openebs-lvm <unset> 19d
rgrojpyexy wxvvtwpdcw Bound pvc-00f11127-0bc0-4621-80a5-0c122034b029 21Gi RWO openebs-lvm <unset> 19d
tipthbkmlv dljwslibak Bound pvc-6efa3529-b3ee-45a6-b52e-30e6c56859d0 156Gi RWO openebs-lvm <unset> 11d
tipthbkmlv jcbwbckgss Bound pvc-7ac7629f-1756-48d8-b945-65fbd32d8a3c 83Gi RWO openebs-lvm <unset> 11d
tipthbkmlv mevdxtwoaz Bound pvc-1f5de57f-fef5-4b5d-bcfa-41285a35aa44 156Gi RWO openebs-lvm <unset> 11d
tipthbkmlv nnexjvvpxd Bound pvc-f59cfb0d-cac2-48b2-b6e6-067c764afed1 207Gi RWO openebs-lvm <unset> 11d
tipthbkmlv synvitqwet Bound pvc-bb36613b-d4d1-47d1-8e85-545c04e47243 42Gi RWO openebs-lvm <unset> 8d
tipthbkmlv wnyvbjzyiy Bound pvc-a663f2d8-a9cc-433a-a332-182b31a1e869 259Gi RWO openebs-lvm <unset> 11d
uxxjuqhinm ezrucoehyf Bound pvc-50c537a1-81a6-4e73-ba1a-50d743e52449 21Gi RWO openebs-lvm <unset> 13d
uxxjuqhinm ivbynvtaea Bound pvc-cc87a5e3-bfba-4d1c-8281-6d1c365232d7 21Gi RWO openebs-lvm <unset> 13d
uxxjuqhinm qrqqadywtr Bound pvc-89fcbb93-4021-4e50-95a0-308f2376b2c8 21Gi RWO openebs-lvm <unset> 14d
xxcwbnkkyq thmyuqcvry Bound pvc-39a1458e-a477-4cec-96f9-410703df69b2 21Gi RWO openebs-lvm <unset> 38d
ynewvabxhp qwurwcxufh Bound pvc-b26d304e-ae12-4c3c-8cf0-55d4fcd1ee55 83Gi RWO openebs-lvm <unset> 44d
mahdi@laptop:~$
mahdi@laptop:~$ kubectl get pv -A
NAME CAPACITY ACCESS MODES RECLAIM POLICY STATUS CLAIM STORAGECLASS VOLUMEATTRIBUTESCLASS REASON AGE
pvc-00f11127-0bc0-4621-80a5-0c122034b029 21Gi RWO Delete Bound rgrojpyexy/wxvvtwpdcw openebs-lvm <unset> 19d
pvc-150b969d-50b8-4765-830c-9342252ae3dc 5Gi RWO Delete Bound default/ubuntu-24-04 openebs-lvm <unset> 112d
pvc-19dcfd37-f2cb-4635-b180-67286d79a01f 21Gi RWO Delete Bound jnpmpiyu/ifklzcszoc openebs-lvm <unset> 2d4h
pvc-1e3e3d90-96e2-4ec2-a957-34df6f3ea117 21Gi RWO Delete Bound eejkgcwu/vqmybabpkz openebs-lvm <unset> 76d
pvc-1f5de57f-fef5-4b5d-bcfa-41285a35aa44 156Gi RWO Delete Bound tipthbkmlv/mevdxtwoaz openebs-lvm <unset> 11d
pvc-212890be-5290-4c39-89e6-edea1f1a508f 21Gi RWO Delete Bound nubyawsibx/sucnizrwnm openebs-lvm <unset> 30d
pvc-217b39d0-45b3-463a-987a-d71f1bc11cc5 21Gi RWO Delete Bound rgrojpyexy/nyoqwzuych openebs-lvm <unset> 19d
pvc-39a1458e-a477-4cec-96f9-410703df69b2 21Gi RWO Delete Bound xxcwbnkkyq/thmyuqcvry openebs-lvm <unset> 38d
pvc-3cc5371e-680b-41e5-876f-c51427b3c30c 100Mi RWO Delete Bound monitoring/alertmanager-kube-prometheus-stack-db-alertmanager-kube-prometheus-stack-0 openebs-lvm <unset> 111d
pvc-50c537a1-81a6-4e73-ba1a-50d743e52449 75Gi RWO Delete Bound uxxjuqhinm/ezrucoehyf openebs-lvm <unset> 13d
pvc-5c1f9965-f141-4b5a-9824-c4a483f9fc38 21Gi RWO Delete Bound fezhtsuf/voogyfnzpz openebs-lvm <unset> 22h
pvc-6efa3529-b3ee-45a6-b52e-30e6c56859d0 156Gi RWO Delete Bound tipthbkmlv/dljwslibak openebs-lvm <unset> 11d
pvc-78d2c40f-ce50-4f50-98b6-22ae01e6b863 21Gi RWO Delete Bound nubyawsibx/hzezkpksfz openebs-lvm <unset> 2d13h
pvc-7ac7629f-1756-48d8-b945-65fbd32d8a3c 83Gi RWO Delete Bound tipthbkmlv/jcbwbckgss openebs-lvm <unset> 11d
pvc-87d63b12-a6b6-4b15-b98b-2a94c65b710c 10Gi RWO Delete Bound monitoring/prometheus-kube-prometheus-stack-db-prometheus-kube-prometheus-stack-0 openebs-lvm <unset> 111d
pvc-89a2a3ed-b288-4ea2-b3e2-3f771ef2c17a 42Gi RWO Delete Bound ijmvzqqy/htrxvlfdpi openebs-lvm <unset> 24d
pvc-89fcbb93-4021-4e50-95a0-308f2376b2c8 21Gi RWO Delete Bound uxxjuqhinm/qrqqadywtr openebs-lvm <unset> 14d
pvc-9840b5bb-50bb-42b5-94f4-f33a397b2201 259Gi RWO Delete Bound aredaawb/mphuleiayi openebs-lvm <unset> 65d
pvc-a663f2d8-a9cc-433a-a332-182b31a1e869 259Gi RWO Delete Bound tipthbkmlv/wnyvbjzyiy openebs-lvm <unset> 11d
pvc-a9ed8ea8-bd1e-4323-805a-4a1cbc1b2d65 200Gi RWO Delete Bound default/vm-4090-169 openebs-lvm <unset> 112d
pvc-b26d304e-ae12-4c3c-8cf0-55d4fcd1ee55 83Gi RWO Delete Bound ynewvabxhp/qwurwcxufh openebs-lvm <unset> 44d
pvc-bb36613b-d4d1-47d1-8e85-545c04e47243 42Gi RWO Delete Bound tipthbkmlv/synvitqwet openebs-lvm <unset> 8d
pvc-cc87a5e3-bfba-4d1c-8281-6d1c365232d7 21Gi RWO Delete Bound uxxjuqhinm/ivbynvtaea openebs-lvm <unset> 13d
pvc-f59cfb0d-cac2-48b2-b6e6-067c764afed1 207Gi RWO Delete Bound tipthbkmlv/nnexjvvpxd openebs-lvm <unset> 11d
mahdi@laptop:~$
mahdi@laptop:~$ kubectl get lvmvol -A
NAMESPACE NAME VOLGROUP NODE SIZE STATUS AGE
openenbs pvc-00f11127-0bc0-4621-80a5-0c122034b029 vg.openebs k0s-ir02-node01 22548578304 Ready 20d
openenbs pvc-150b969d-50b8-4765-830c-9342252ae3dc vg.openebs k0s-ir02-node01 5368709120 Ready 112d
openenbs pvc-19dcfd37-f2cb-4635-b180-67286d79a01f vg.openebs k0s-ir02-node01 22548578304 Ready 2d5h
openenbs pvc-1e3e3d90-96e2-4ec2-a957-34df6f3ea117 vg.openebs k0s-ir02-node01 22548578304 Ready 76d
openenbs pvc-1f5de57f-fef5-4b5d-bcfa-41285a35aa44 vg.openebs k0s-ir02-node01 167503724544 Ready 11d
openenbs pvc-212890be-5290-4c39-89e6-edea1f1a508f vg.openebs k0s-ir02-node01 22548578304 Ready 30d
openenbs pvc-217b39d0-45b3-463a-987a-d71f1bc11cc5 vg.openebs k0s-ir02-node01 22548578304 Ready 19d
openenbs pvc-39a1458e-a477-4cec-96f9-410703df69b2 vg.openebs k0s-ir02-node01 22548578304 Ready 38d
openenbs pvc-3cc5371e-680b-41e5-876f-c51427b3c30c vg.openebs k0s-ir02-node01 104857600 Ready 111d
openenbs pvc-50c537a1-81a6-4e73-ba1a-50d743e52449 vg.openebs k0s-ir02-node01 80530636800 Ready 13d
openenbs pvc-5c1f9965-f141-4b5a-9824-c4a483f9fc38 vg.openebs k0s-ir02-node01 22548578304 Ready 22h
openenbs pvc-6efa3529-b3ee-45a6-b52e-30e6c56859d0 vg.openebs k0s-ir02-node01 167503724544 Ready 11d
openenbs pvc-78d2c40f-ce50-4f50-98b6-22ae01e6b863 vg.openebs k0s-ir02-node01 22548578304 Ready 2d13h
openenbs pvc-7ac7629f-1756-48d8-b945-65fbd32d8a3c vg.openebs k0s-ir02-node01 89120571392 Ready 11d
openenbs pvc-87d63b12-a6b6-4b15-b98b-2a94c65b710c vg.openebs k0s-ir02-node01 10737418240 Ready 111d
openenbs pvc-89a2a3ed-b288-4ea2-b3e2-3f771ef2c17a vg.openebs k0s-ir02-node01 45097156608 Ready 25d
openenbs pvc-89fcbb93-4021-4e50-95a0-308f2376b2c8 vg.openebs k0s-ir02-node01 22548578304 Ready 14d
openenbs pvc-9840b5bb-50bb-42b5-94f4-f33a397b2201 vg.openebs k0s-ir02-node01 278099132416 Ready 65d
openenbs pvc-a663f2d8-a9cc-433a-a332-182b31a1e869 vg.openebs k0s-ir02-node01 278099132416 Ready 11d
openenbs pvc-a9ed8ea8-bd1e-4323-805a-4a1cbc1b2d65 vg.openebs k0s-ir02-node01 214748364800 Ready 112d
openenbs pvc-b26d304e-ae12-4c3c-8cf0-55d4fcd1ee55 vg.openebs k0s-ir02-node01 89120571392 Ready 44d
openenbs pvc-bb36613b-d4d1-47d1-8e85-545c04e47243 vg.openebs k0s-ir02-node01 45097156608 Ready 8d
openenbs pvc-cc87a5e3-bfba-4d1c-8281-6d1c365232d7 vg.openebs k0s-ir02-node01 22548578304 Ready 13d
openenbs pvc-f59cfb0d-cac2-48b2-b6e6-067c764afed1 vg.openebs k0s-ir02-node01 222264557568 Ready 11d
mahdi@laptop:~$
root@k0s-ir02-node01:/# lvs vg.openebs
LV VG Attr LSize Pool Origin Data% Meta% Move Log Cpy%Sync Convert
pvc-00f11127-0bc0-4621-80a5-0c122034b029 vg.openebs -wi-a----- 21.00g
pvc-150b969d-50b8-4765-830c-9342252ae3dc vg.openebs -wi-a----- 5.00g
pvc-19dcfd37-f2cb-4635-b180-67286d79a01f vg.openebs -wi-a----- 21.00g
pvc-1e3e3d90-96e2-4ec2-a957-34df6f3ea117 vg.openebs -wi-ao---- 21.00g
pvc-1f5de57f-fef5-4b5d-bcfa-41285a35aa44 vg.openebs -wi-ao---- 156.00g
pvc-212890be-5290-4c39-89e6-edea1f1a508f vg.openebs -wi-a----- 21.00g
pvc-217b39d0-45b3-463a-987a-d71f1bc11cc5 vg.openebs -wi-a----- 21.00g
pvc-26c26fd7-23af-4952-be56-414897aec567 vg.openebs -wi-a----- 10.00g
pvc-276ab079-e3c5-4d45-9606-f0e1ba64e532 vg.openebs -wi-a----- 10.00g
pvc-39a1458e-a477-4cec-96f9-410703df69b2 vg.openebs -wi-a----- 21.00g
pvc-3cc5371e-680b-41e5-876f-c51427b3c30c vg.openebs -wi-ao---- 100.00m
pvc-3e3ee28a-5971-40bd-99a6-099e40022e48 vg.openebs -wi-a----- 10.00g
pvc-50c537a1-81a6-4e73-ba1a-50d743e52449 vg.openebs -wi-ao---- 21.00g
pvc-5c1f9965-f141-4b5a-9824-c4a483f9fc38 vg.openebs -wi-ao---- 21.00g
pvc-60ee6eaa-63c8-4341-96b7-66a590412f62 vg.openebs -wi-a----- 10.00g
pvc-6d619549-9021-40f0-8455-56f75c431c58 vg.openebs -wi-a----- 10.00g
pvc-6efa3529-b3ee-45a6-b52e-30e6c56859d0 vg.openebs -wi-ao---- 156.00g
pvc-78d2c40f-ce50-4f50-98b6-22ae01e6b863 vg.openebs -wi-ao---- 21.00g
pvc-7ac7629f-1756-48d8-b945-65fbd32d8a3c vg.openebs -wi-ao---- 83.00g
pvc-86b3eb68-5256-45f5-b865-c695b259dcb6 vg.openebs -wi-a----- 10.00g
pvc-87d63b12-a6b6-4b15-b98b-2a94c65b710c vg.openebs -wi-ao---- 10.00g
pvc-89a2a3ed-b288-4ea2-b3e2-3f771ef2c17a vg.openebs -wi-a----- 42.00g
pvc-89fcbb93-4021-4e50-95a0-308f2376b2c8 vg.openebs -wi-a----- 21.00g
pvc-9840b5bb-50bb-42b5-94f4-f33a397b2201 vg.openebs -wi-ao---- 259.00g
pvc-9a5c0e8d-059c-4adf-a40f-69be115610b0 vg.openebs -wi-a----- 10.00g
pvc-a663f2d8-a9cc-433a-a332-182b31a1e869 vg.openebs -wi-a----- 259.00g
pvc-a9ed8ea8-bd1e-4323-805a-4a1cbc1b2d65 vg.openebs -wi-ao---- 200.00g
pvc-b26d304e-ae12-4c3c-8cf0-55d4fcd1ee55 vg.openebs -wi-a----- 83.00g
pvc-bb36613b-d4d1-47d1-8e85-545c04e47243 vg.openebs -wi-ao---- 42.00g
pvc-cc87a5e3-bfba-4d1c-8281-6d1c365232d7 vg.openebs -wi-ao---- 21.00g
pvc-ecac66d4-7ad2-4e46-bde7-831253d16365 vg.openebs -wi-a----- 10.00g
pvc-eedcb866-c1e7-41b0-9421-4ea4e6183221 vg.openebs -wi-a----- 10.00g
pvc-f59cfb0d-cac2-48b2-b6e6-067c764afed1 vg.openebs -wi-ao---- 207.00g
pvc-f6cd4aba-2e04-4565-93e9-7ac911a55988 vg.openebs -wi-a----- 10.00g
root@k0s-ir02-node01:/#
As you can see, I have dangling LVs that are not automatically deleted despite ReclaimPolicy: Delete
What did you expect to happen:
I expected LVs to be automatically deleted and be the same number as the PVs in my cluster.
The output of the following commands will help us better understand what's going on:
(Pasting long output into a GitHub gist or other Pastebin is fine.)
kubectl logs -f openebs-lvm-localpv-controller-7b6d6b4665-fk78q -n openebs -c openebs-lvm-plugin
mahdi@laptop:~$ kubectl logs -f openebs-lvm-localpv-controller-7b6ffd478c-4tjnx -n openenbs -c openebs-lvm-plugin
I0202 12:55:22.936995 1 main.go:149] LVM Driver Version :- 1.6.1 - commit :- a3c08bad6ad3ae64581f135e076d20b2ca26636c
I0202 12:55:22.937055 1 main.go:150] DriverName: local.csi.openebs.io Plugin: controller EndPoint: unix:///var/lib/csi/sockets/pluginproxy/csi.sock NodeID: SetIOLimits: false ContainerRuntime: containerd RIopsPerGB: [] WIopsPerGB: [] RBpsPerGB: [] WBpsPerGB: []
I0202 12:55:22.937078 1 driver.go:49] enabling volume access mode: SINGLE_NODE_WRITER
I0202 12:55:22.937783 1 controller.go:213] waiting for k8s & lvm node informer caches to be synced
I0202 12:55:23.038949 1 controller.go:217] synced k8s & lvm node informer caches
I0202 12:55:23.038977 1 controller.go:219] initializing csi provisioning leak protection controller
I0202 12:55:23.074673 1 leak_protection.go:134] "starting up csi pvc controller"
I0202 12:55:23.074739 1 shared_informer.go:311] Waiting for caches to sync for CSI Provisioner
I0202 12:55:23.074752 1 shared_informer.go:318] Caches are synced for CSI Provisioner
I0202 12:55:23.074976 1 grpc.go:190] Listening for connections on address: &net.UnixAddr{Name:"//var/lib/csi/sockets/pluginproxy/csi.sock", Net:"unix"}
I0202 12:55:23.517096 1 grpc.go:72] GRPC call: /csi.v1.Identity/Probe requests {}
I0202 12:55:23.518161 1 grpc.go:81] GRPC response: {}
I0202 12:55:23.518993 1 grpc.go:72] GRPC call: /csi.v1.Identity/GetPluginInfo requests {}
I0202 12:55:23.519070 1 grpc.go:81] GRPC response: {"name":"local.csi.openebs.io","vendor_version":"1.6.1"}
I0202 12:55:23.519978 1 grpc.go:72] GRPC call: /csi.v1.Identity/GetPluginCapabilities requests {}
I0202 12:55:23.520001 1 grpc.go:81] GRPC response: {"capabilities":[{"Type":{"Service":{"type":1}}},{"Type":{"Service":{"type":2}}}]}
I0202 12:55:23.521007 1 grpc.go:72] GRPC call: /csi.v1.Controller/ControllerGetCapabilities requests {}
I0202 12:55:23.521048 1 grpc.go:81] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":4}}}]}
I0202 12:55:23.522054 1 grpc.go:72] GRPC call: /csi.v1.Controller/ControllerGetCapabilities requests {}
I0202 12:55:23.522087 1 grpc.go:81] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":4}}}]}
I0202 12:55:23.626849 1 grpc.go:72] GRPC call: /csi.v1.Identity/GetPluginInfo requests {}
I0202 12:55:23.626950 1 grpc.go:81] GRPC response: {"name":"local.csi.openebs.io","vendor_version":"1.6.1"}
I0202 12:55:23.627790 1 grpc.go:72] GRPC call: /csi.v1.Identity/Probe requests {}
I0202 12:55:23.627851 1 grpc.go:81] GRPC response: {}
I0202 12:55:23.628581 1 grpc.go:72] GRPC call: /csi.v1.Controller/ControllerGetCapabilities requests {}
I0202 12:55:23.628639 1 grpc.go:81] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":4}}}]}
I0202 12:55:23.824628 1 grpc.go:72] GRPC call: /csi.v1.Identity/Probe requests {}
I0202 12:55:23.824685 1 grpc.go:81] GRPC response: {}
I0202 12:55:23.825708 1 grpc.go:72] GRPC call: /csi.v1.Identity/GetPluginInfo requests {}
I0202 12:55:23.825798 1 grpc.go:81] GRPC response: {"name":"local.csi.openebs.io","vendor_version":"1.6.1"}
I0202 12:55:23.826504 1 grpc.go:72] GRPC call: /csi.v1.Identity/GetPluginCapabilities requests {}
I0202 12:55:23.826569 1 grpc.go:81] GRPC response: {"capabilities":[{"Type":{"Service":{"type":1}}},{"Type":{"Service":{"type":2}}}]}
I0202 12:55:23.827390 1 grpc.go:72] GRPC call: /csi.v1.Controller/ControllerGetCapabilities requests {}
I0202 12:55:23.827450 1 grpc.go:81] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":4}}}]}
kubectl logs -f openebs-lvm-localpv-node-[xxxx] -n openebs -c openebs-lvm-plugin
mahdi@laptop:~$ kubectl logs -f openebs-lvm-localpv-node-jj76w -n openenbs -c openebs-lvm-plugin
I0202 12:56:00.707864 1 main.go:149] LVM Driver Version :- 1.6.1 - commit :- a3c08bad6ad3ae64581f135e076d20b2ca26636c
I0202 12:56:00.707922 1 main.go:150] DriverName: local.csi.openebs.io Plugin: agent EndPoint: unix:///plugin/csi.sock NodeID: k0s-ir02-node01 SetIOLimits: false ContainerRuntime: containerd RIopsPerGB: [] WIopsPerGB: [] RBpsPerGB: [] WBpsPerGB: []
I0202 12:56:00.707941 1 driver.go:49] enabling volume access mode: SINGLE_NODE_WRITER
I0202 12:56:00.708747 1 builder.go:84] Creating event broadcaster
I0202 12:56:00.709792 1 builder.go:90] Creating lvm snapshot controller object
I0202 12:56:00.710954 1 builder.go:99] Adding Event handler functions for lvm snapshot controller
I0202 12:56:00.710962 1 grpc.go:190] Listening for connections on address: &net.UnixAddr{Name:"//plugin/csi.sock", Net:"unix"}
I0202 12:56:00.711017 1 start.go:72] Starting informer for lvm snapshot controller
I0202 12:56:00.711034 1 start.go:74] Starting Lvm snapshot controller
I0202 12:56:00.711050 1 builder.go:84] Creating event broadcaster
I0202 12:56:00.711047 1 snapshot.go:195] Starting Snap controller
I0202 12:56:00.711091 1 snapshot.go:198] Waiting for informer caches to sync
I0202 12:56:00.711377 1 builder.go:90] Creating lvm volume controller object
I0202 12:56:00.711421 1 builder.go:101] Adding Event handler functions for lvm volume controller
I0202 12:56:00.711519 1 start.go:73] Starting informer for lvm volume controller
I0202 12:56:00.711526 1 start.go:75] Starting Lvm volume controller
I0202 12:56:00.711532 1 volume.go:295] Starting Vol controller
I0202 12:56:00.711536 1 volume.go:298] Waiting for informer caches to sync
I0202 12:56:00.718602 1 volume.go:85] Got add event for Vol pvc-00f11127-0bc0-4621-80a5-0c122034b029
I0202 12:56:00.718612 1 volume.go:86] lvmvolume object to be enqueued by Add handler: &{{LVMVolume local.openebs.io/v1alpha1} {pvc-00f11127-0bc0-4621-80a5-0c122034b029 openenbs e3539ef7-3998-4882-b0d4-e99f61871b96 42397823 3 2026-01-13 14:17:35 +0000 UTC <nil> <nil> map[kubernetes.io/nodename:k0s-ir02-node01] map[] [] [lvm.openebs.io/finalizer] [{lvm-driver Update local.openebs.io/v1alpha1 2026-01-13 14:17:36 +0000 UTC FieldsV1 {"f:metadata":{"f:finalizers":{".":{},"v:\"lvm.openebs.io/finalizer\"":{}},"f:labels":{".":{},"f:kubernetes.io/nodename":{}}},"f:spec":{".":{},"f:capacity":{},"f:ownerNodeID":{},"f:shared":{},"f:thinProvision":{},"f:vgPattern":{},"f:volGroup":{}},"f:status":{".":{},"f:state":{}}} }]} {k0s-ir02-node01 vg.openebs ^vg.openebs$ 22548578304 yes no} {Ready <nil>}}
I0202 12:56:00.718736 1 volume.go:85] Got add event for Vol pvc-150b969d-50b8-4765-830c-9342252ae3dc
I0202 12:56:00.718742 1 volume.go:86] lvmvolume object to be enqueued by Add handler: &{{LVMVolume local.openebs.io/v1alpha1} {pvc-150b969d-50b8-4765-830c-9342252ae3dc openenbs 12e6d9fe-3297-4a5b-ad96-4fbe8dd9a346 1753811 3 2025-10-13 11:59:51 +0000 UTC <nil> <nil> map[kubernetes.io/nodename:k0s-ir02-node01] map[] [] [lvm.openebs.io/finalizer] [{lvm-driver Update local.openebs.io/v1alpha1 2025-10-13 11:59:52 +0000 UTC FieldsV1 {"f:metadata":{"f:finalizers":{".":{},"v:\"lvm.openebs.io/finalizer\"":{}},"f:labels":{".":{},"f:kubernetes.io/nodename":{}}},"f:spec":{".":{},"f:capacity":{},"f:ownerNodeID":{},"f:shared":{},"f:thinProvision":{},"f:vgPattern":{},"f:volGroup":{}},"f:status":{".":{},"f:state":{}}} }]} {k0s-ir02-node01 vg.openebs ^vg.openebs$ 5368709120 yes no} {Ready <nil>}}
...
...
E0202 14:17:01.610610 1 grpc.go:79] GRPC error: rpc error: code = Internal desc = failed to handle NodeExpandVolume Request for pvc-50c537a1-81a6-4e73-ba1a-50d743e52449, {exit status 5}
I0202 14:18:01.033314 1 lvmnode.go:306] Successfully synced 'openenbs/k0s-ir02-node01'
I0202 14:19:01.060701 1 lvmnode.go:306] Successfully synced 'openenbs/k0s-ir02-node01'
I0202 14:19:03.697872 1 grpc.go:72] GRPC call: /csi.v1.Node/NodePublishVolume requests {"target_path":"/var/lib/k0s/kubelet/pods/08926d9a-1122-4f74-b6cc-01b5454819bd/volumes/kubernetes.io~csi/pvc-50c537a1-81a6-4e73-ba1a-50d743e52449/mount","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_context":{"csi.storage.k8s.io/ephemeral":"false","csi.storage.k8s.io/pod.name":"virt-launcher-ezrucoehyf-6hhtj","csi.storage.k8s.io/pod.namespace":"uxxjuqhinm","csi.storage.k8s.io/pod.uid":"08926d9a-1122-4f74-b6cc-01b5454819bd","csi.storage.k8s.io/serviceAccount.name":"default","openebs.io/cas-type":"localpv-lvm","openebs.io/volgroup":"vg.openebs","storage.kubernetes.io/csiProvisionerIdentity":"1760043856041-3422-local.csi.openebs.io"},"volume_id":"pvc-50c537a1-81a6-4e73-ba1a-50d743e52449"}
I0202 14:19:03.703545 1 mount.go:194] lvm : already mounted vg.openebs/pvc-50c537a1-81a6-4e73-ba1a-50d743e52449 => /var/lib/k0s/kubelet/pods/08926d9a-1122-4f74-b6cc-01b5454819bd/volumes/kubernetes.io~csi/pvc-50c537a1-81a6-4e73-ba1a-50d743e52449/mount
I0202 14:19:03.703591 1 grpc.go:81] GRPC response: {}
I0202 14:19:03.709347 1 grpc.go:72] GRPC call: /csi.v1.Node/NodeExpandVolume requests {"capacity_range":{"required_bytes":80530636800},"staging_target_path":"/var/lib/k0s/kubelet/plugins/kubernetes.io/csi/local.csi.openebs.io/b4f9a15b088181ef1984a1d7af1fda410dc53f1a58d4b11cb819a36917cde276/globalmount","volume_capability":{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}},"volume_id":"pvc-50c537a1-81a6-4e73-ba1a-50d743e52449","volume_path":"/var/lib/k0s/kubelet/pods/08926d9a-1122-4f74-b6cc-01b5454819bd/volumes/kubernetes.io~csi/pvc-50c537a1-81a6-4e73-ba1a-50d743e52449/mount"}
W0202 14:19:03.846501 1 lvm_util.go:279] lvm: said into stderr: Insufficient free space: 13824 extents needed, but only 7526 available
E0202 14:19:03.846529 1 lvm_util.go:431] lvm: could not resize the volume vg.openebs/pvc-50c537a1-81a6-4e73-ba1a-50d743e52449 cmd [/dev/vg.openebs/pvc-50c537a1-81a6-4e73-ba1a-50d743e52449 -L 80530636800b -r] error:
E0202 14:19:03.846557 1 grpc.go:79] GRPC error: rpc error: code = Internal desc = failed to handle NodeExpandVolume Request for pvc-50c537a1-81a6-4e73-ba1a-50d743e52449, {exit status 5}
kubectl get pods -n openebs
mahdi@laptop:~$ kubectl get pods -n openenbs
NAME READY STATUS RESTARTS AGE
openebs-localpv-provisioner-75db8cc658-lcxmx 1/1 Running 0 84m
openebs-lvm-localpv-controller-7b6ffd478c-4tjnx 5/5 Running 0 84m
openebs-lvm-localpv-node-jj76w 2/2 Running 0 84m
mahdi@laptop:~$
kubectl get lvmvol -A -o yaml
mahdi@laptop:~$ kubectl get lvmvol -A -o yaml
apiVersion: v1
items:
- apiVersion: local.openebs.io/v1alpha1
kind: LVMVolume
metadata:
creationTimestamp: "2026-01-13T14:17:35Z"
finalizers:
- lvm.openebs.io/finalizer
generation: 3
labels:
kubernetes.io/nodename: k0s-ir02-node01
name: pvc-00f11127-0bc0-4621-80a5-0c122034b029
namespace: openenbs
resourceVersion: "42397823"
uid: e3539ef7-3998-4882-b0d4-e99f61871b96
spec:
capacity: "22548578304"
ownerNodeID: k0s-ir02-node01
shared: "yes"
thinProvision: "no"
vgPattern: ^vg.openebs$
volGroup: vg.openebs
status:
state: Ready
- apiVersion: local.openebs.io/v1alpha1
kind: LVMVolume
metadata:
creationTimestamp: "2025-10-13T11:59:51Z"
finalizers:
- lvm.openebs.io/finalizer
generation: 3
labels:
kubernetes.io/nodename: k0s-ir02-node01
name: pvc-150b969d-50b8-4765-830c-9342252ae3dc
namespace: openenbs
resourceVersion: "1753811"
uid: 12e6d9fe-3297-4a5b-ad96-4fbe8dd9a346
spec:
capacity: "5368709120"
ownerNodeID: k0s-ir02-node01
shared: "yes"
thinProvision: "no"
vgPattern: ^vg.openebs$
volGroup: vg.openebs
status:
state: Ready
- apiVersion: local.openebs.io/v1alpha1
kind: LVMVolume
metadata:
creationTimestamp: "2026-01-31T09:16:13Z"
finalizers:
- lvm.openebs.io/finalizer
generation: 3
labels:
kubernetes.io/nodename: k0s-ir02-node01
name: pvc-19dcfd37-f2cb-4635-b180-67286d79a01f
namespace: openenbs
resourceVersion: "50246053"
uid: cbf30ae9-70a3-4c79-b042-c9abb9630028
spec:
capacity: "22548578304"
ownerNodeID: k0s-ir02-node01
shared: "yes"
thinProvision: "no"
vgPattern: ^vg.openebs$
volGroup: vg.openebs
status:
state: Ready
- apiVersion: local.openebs.io/v1alpha1
kind: LVMVolume
metadata:
creationTimestamp: "2025-11-18T11:57:54Z"
finalizers:
- lvm.openebs.io/finalizer
generation: 3
labels:
kubernetes.io/nodename: k0s-ir02-node01
name: pvc-1e3e3d90-96e2-4ec2-a957-34df6f3ea117
namespace: openenbs
resourceVersion: "17676998"
uid: fc7f9594-e363-4523-8578-6c013d5e07e5
spec:
capacity: "22548578304"
ownerNodeID: k0s-ir02-node01
shared: "yes"
thinProvision: "no"
vgPattern: ^vg.openebs$
volGroup: vg.openebs
status:
state: Ready
- apiVersion: local.openebs.io/v1alpha1
kind: LVMVolume
metadata:
creationTimestamp: "2026-01-22T11:30:52Z"
finalizers:
- lvm.openebs.io/finalizer
generation: 3
labels:
kubernetes.io/nodename: k0s-ir02-node01
name: pvc-1f5de57f-fef5-4b5d-bcfa-41285a35aa44
namespace: openenbs
resourceVersion: "46320176"
uid: 118ddcca-76c8-4c2b-bca2-2ce6d5b41e77
spec:
capacity: "167503724544"
ownerNodeID: k0s-ir02-node01
shared: "yes"
thinProvision: "no"
vgPattern: ^vg.openebs$
volGroup: vg.openebs
status:
state: Ready
- apiVersion: local.openebs.io/v1alpha1
kind: LVMVolume
metadata:
creationTimestamp: "2026-01-03T09:59:10Z"
finalizers:
- lvm.openebs.io/finalizer
generation: 3
labels:
kubernetes.io/nodename: k0s-ir02-node01
name: pvc-212890be-5290-4c39-89e6-edea1f1a508f
namespace: openenbs
resourceVersion: "37914174"
uid: 584e01c4-8f4e-43ad-b7c1-8dececc509b8
spec:
capacity: "22548578304"
ownerNodeID: k0s-ir02-node01
shared: "yes"
thinProvision: "no"
vgPattern: ^vg.openebs$
volGroup: vg.openebs
status:
state: Ready
- apiVersion: local.openebs.io/v1alpha1
kind: LVMVolume
metadata:
creationTimestamp: "2026-01-13T14:32:32Z"
finalizers:
- lvm.openebs.io/finalizer
generation: 3
labels:
kubernetes.io/nodename: k0s-ir02-node01
name: pvc-217b39d0-45b3-463a-987a-d71f1bc11cc5
namespace: openenbs
resourceVersion: "42402724"
uid: 0b966a70-93ff-412e-9e13-c834e396f142
spec:
capacity: "22548578304"
ownerNodeID: k0s-ir02-node01
shared: "yes"
thinProvision: "no"
vgPattern: ^vg.openebs$
volGroup: vg.openebs
status:
state: Ready
- apiVersion: local.openebs.io/v1alpha1
kind: LVMVolume
metadata:
creationTimestamp: "2025-12-26T08:45:32Z"
finalizers:
- lvm.openebs.io/finalizer
generation: 3
labels:
kubernetes.io/nodename: k0s-ir02-node01
name: pvc-39a1458e-a477-4cec-96f9-410703df69b2
namespace: openenbs
resourceVersion: "34368181"
uid: db2ccb6e-2bd2-4447-92db-8985167a11a8
spec:
capacity: "22548578304"
ownerNodeID: k0s-ir02-node01
shared: "yes"
thinProvision: "no"
vgPattern: ^vg.openebs$
volGroup: vg.openebs
status:
state: Ready
- apiVersion: local.openebs.io/v1alpha1
kind: LVMVolume
metadata:
creationTimestamp: "2025-10-14T11:14:02Z"
finalizers:
- lvm.openebs.io/finalizer
generation: 3
labels:
kubernetes.io/nodename: k0s-ir02-node01
name: pvc-3cc5371e-680b-41e5-876f-c51427b3c30c
namespace: openenbs
resourceVersion: "2183493"
uid: e867cdf7-7fd9-4e0a-a84c-b6fadbce4677
spec:
capacity: "104857600"
ownerNodeID: k0s-ir02-node01
shared: "yes"
thinProvision: "no"
vgPattern: ^vg.openebs$
volGroup: vg.openebs
status:
state: Ready
- apiVersion: local.openebs.io/v1alpha1
kind: LVMVolume
metadata:
creationTimestamp: "2026-01-20T13:13:31Z"
finalizers:
- lvm.openebs.io/finalizer
generation: 4
labels:
kubernetes.io/nodename: k0s-ir02-node01
name: pvc-50c537a1-81a6-4e73-ba1a-50d743e52449
namespace: openenbs
resourceVersion: "51108041"
uid: a49da2ad-2029-4cdb-b5c8-b87b21722880
spec:
capacity: "80530636800"
ownerNodeID: k0s-ir02-node01
shared: "yes"
thinProvision: "no"
vgPattern: ^vg.openebs$
volGroup: vg.openebs
status:
state: Ready
- apiVersion: local.openebs.io/v1alpha1
kind: LVMVolume
metadata:
creationTimestamp: "2026-02-01T15:41:46Z"
finalizers:
- lvm.openebs.io/finalizer
generation: 3
labels:
kubernetes.io/nodename: k0s-ir02-node01
name: pvc-5c1f9965-f141-4b5a-9824-c4a483f9fc38
namespace: openenbs
resourceVersion: "50805266"
uid: 70181129-52b6-4dcd-a339-fb6eef55496f
spec:
capacity: "22548578304"
ownerNodeID: k0s-ir02-node01
shared: "yes"
thinProvision: "no"
vgPattern: ^vg.openebs$
volGroup: vg.openebs
status:
state: Ready
- apiVersion: local.openebs.io/v1alpha1
kind: LVMVolume
metadata:
creationTimestamp: "2026-01-22T11:56:12Z"
finalizers:
- lvm.openebs.io/finalizer
generation: 3
labels:
kubernetes.io/nodename: k0s-ir02-node01
name: pvc-6efa3529-b3ee-45a6-b52e-30e6c56859d0
namespace: openenbs
resourceVersion: "46328412"
uid: a92b2286-6406-47a2-a952-1fae6581a026
spec:
capacity: "167503724544"
ownerNodeID: k0s-ir02-node01
shared: "yes"
thinProvision: "no"
vgPattern: ^vg.openebs$
volGroup: vg.openebs
status:
state: Ready
- apiVersion: local.openebs.io/v1alpha1
kind: LVMVolume
metadata:
creationTimestamp: "2026-01-31T00:35:18Z"
finalizers:
- lvm.openebs.io/finalizer
generation: 3
labels:
kubernetes.io/nodename: k0s-ir02-node01
name: pvc-78d2c40f-ce50-4f50-98b6-22ae01e6b863
namespace: openenbs
resourceVersion: "50086434"
uid: 12756f91-53d0-4609-8359-5b6f9b0967de
spec:
capacity: "22548578304"
ownerNodeID: k0s-ir02-node01
shared: "yes"
thinProvision: "no"
vgPattern: ^vg.openebs$
volGroup: vg.openebs
status:
state: Ready
- apiVersion: local.openebs.io/v1alpha1
kind: LVMVolume
metadata:
creationTimestamp: "2026-01-22T11:57:21Z"
finalizers:
- lvm.openebs.io/finalizer
generation: 3
labels:
kubernetes.io/nodename: k0s-ir02-node01
name: pvc-7ac7629f-1756-48d8-b945-65fbd32d8a3c
namespace: openenbs
resourceVersion: "46329032"
uid: b86e9fac-868b-4674-8c67-b47d73e64125
spec:
capacity: "89120571392"
ownerNodeID: k0s-ir02-node01
shared: "yes"
thinProvision: "no"
vgPattern: ^vg.openebs$
volGroup: vg.openebs
status:
state: Ready
- apiVersion: local.openebs.io/v1alpha1
kind: LVMVolume
metadata:
creationTimestamp: "2025-10-14T11:14:02Z"
finalizers:
- lvm.openebs.io/finalizer
generation: 3
labels:
kubernetes.io/nodename: k0s-ir02-node01
name: pvc-87d63b12-a6b6-4b15-b98b-2a94c65b710c
namespace: openenbs
resourceVersion: "2183501"
uid: 39538420-5ed6-4c2d-865e-de72811d0931
spec:
capacity: "10737418240"
ownerNodeID: k0s-ir02-node01
shared: "yes"
thinProvision: "no"
vgPattern: ^vg.openebs$
volGroup: vg.openebs
status:
state: Ready
- apiVersion: local.openebs.io/v1alpha1
kind: LVMVolume
metadata:
creationTimestamp: "2026-01-08T14:20:22Z"
finalizers:
- lvm.openebs.io/finalizer
generation: 3
labels:
kubernetes.io/nodename: k0s-ir02-node01
name: pvc-89a2a3ed-b288-4ea2-b3e2-3f771ef2c17a
namespace: openenbs
resourceVersion: "40196475"
uid: 8893ac88-119b-4683-bb98-89e928cda118
spec:
capacity: "45097156608"
ownerNodeID: k0s-ir02-node01
shared: "yes"
thinProvision: "no"
vgPattern: ^vg.openebs$
volGroup: vg.openebs
status:
state: Ready
- apiVersion: local.openebs.io/v1alpha1
kind: LVMVolume
metadata:
creationTimestamp: "2026-01-19T08:59:06Z"
finalizers:
- lvm.openebs.io/finalizer
generation: 3
labels:
kubernetes.io/nodename: k0s-ir02-node01
name: pvc-89fcbb93-4021-4e50-95a0-308f2376b2c8
namespace: openenbs
resourceVersion: "44951144"
uid: ab41bfc6-64b8-421d-9111-2347d027982f
spec:
capacity: "22548578304"
ownerNodeID: k0s-ir02-node01
shared: "yes"
thinProvision: "no"
vgPattern: ^vg.openebs$
volGroup: vg.openebs
status:
state: Ready
- apiVersion: local.openebs.io/v1alpha1
kind: LVMVolume
metadata:
creationTimestamp: "2025-11-28T19:57:05Z"
finalizers:
- lvm.openebs.io/finalizer
generation: 3
labels:
kubernetes.io/nodename: k0s-ir02-node01
name: pvc-9840b5bb-50bb-42b5-94f4-f33a397b2201
namespace: openenbs
resourceVersion: "22240228"
uid: 1b33425c-bf5e-431e-afbf-b183ce9307f5
spec:
capacity: "278099132416"
ownerNodeID: k0s-ir02-node01
shared: "yes"
thinProvision: "no"
vgPattern: ^vg.openebs$
volGroup: vg.openebs
status:
state: Ready
- apiVersion: local.openebs.io/v1alpha1
kind: LVMVolume
metadata:
creationTimestamp: "2026-01-22T11:07:47Z"
finalizers:
- lvm.openebs.io/finalizer
generation: 3
labels:
kubernetes.io/nodename: k0s-ir02-node01
name: pvc-a663f2d8-a9cc-433a-a332-182b31a1e869
namespace: openenbs
resourceVersion: "46312825"
uid: 78a03f26-3ec9-4e47-b114-d621caf29a69
spec:
capacity: "278099132416"
ownerNodeID: k0s-ir02-node01
shared: "yes"
thinProvision: "no"
vgPattern: ^vg.openebs$
volGroup: vg.openebs
status:
state: Ready
- apiVersion: local.openebs.io/v1alpha1
kind: LVMVolume
metadata:
creationTimestamp: "2025-10-13T11:01:52Z"
finalizers:
- lvm.openebs.io/finalizer
generation: 3
labels:
kubernetes.io/nodename: k0s-ir02-node01
name: pvc-a9ed8ea8-bd1e-4323-805a-4a1cbc1b2d65
namespace: openenbs
resourceVersion: "1735748"
uid: 53461331-82b5-432e-8f08-77dda7f90381
spec:
capacity: "214748364800"
ownerNodeID: k0s-ir02-node01
shared: "yes"
thinProvision: "no"
vgPattern: ^vg.openebs$
volGroup: vg.openebs
status:
state: Ready
- apiVersion: local.openebs.io/v1alpha1
kind: LVMVolume
metadata:
creationTimestamp: "2025-12-20T09:09:44Z"
finalizers:
- lvm.openebs.io/finalizer
generation: 3
labels:
kubernetes.io/nodename: k0s-ir02-node01
name: pvc-b26d304e-ae12-4c3c-8cf0-55d4fcd1ee55
namespace: openenbs
resourceVersion: "31732221"
uid: 00ccf90b-3100-44ca-ac3a-f14aba760b54
spec:
capacity: "89120571392"
ownerNodeID: k0s-ir02-node01
shared: "yes"
thinProvision: "no"
vgPattern: ^vg.openebs$
volGroup: vg.openebs
status:
state: Ready
- apiVersion: local.openebs.io/v1alpha1
kind: LVMVolume
metadata:
creationTimestamp: "2026-01-24T22:23:13Z"
finalizers:
- lvm.openebs.io/finalizer
generation: 3
labels:
kubernetes.io/nodename: k0s-ir02-node01
name: pvc-bb36613b-d4d1-47d1-8e85-545c04e47243
namespace: openenbs
resourceVersion: "47402897"
uid: d38cc6fc-79d5-44c4-b9eb-74766cf58b17
spec:
capacity: "45097156608"
ownerNodeID: k0s-ir02-node01
shared: "yes"
thinProvision: "no"
vgPattern: ^vg.openebs$
volGroup: vg.openebs
status:
state: Ready
- apiVersion: local.openebs.io/v1alpha1
kind: LVMVolume
metadata:
creationTimestamp: "2026-01-20T13:09:41Z"
finalizers:
- lvm.openebs.io/finalizer
generation: 3
labels:
kubernetes.io/nodename: k0s-ir02-node01
name: pvc-cc87a5e3-bfba-4d1c-8281-6d1c365232d7
namespace: openenbs
resourceVersion: "45468630"
uid: 3b5df996-2e92-450b-a521-f7abdfa8a4d0
spec:
capacity: "22548578304"
ownerNodeID: k0s-ir02-node01
shared: "yes"
thinProvision: "no"
vgPattern: ^vg.openebs$
volGroup: vg.openebs
status:
state: Ready
- apiVersion: local.openebs.io/v1alpha1
kind: LVMVolume
metadata:
creationTimestamp: "2026-01-22T11:42:38Z"
finalizers:
- lvm.openebs.io/finalizer
generation: 3
labels:
kubernetes.io/nodename: k0s-ir02-node01
name: pvc-f59cfb0d-cac2-48b2-b6e6-067c764afed1
namespace: openenbs
resourceVersion: "46324009"
uid: a4a84258-897a-4edc-b257-5989ad03af98
spec:
capacity: "222264557568"
ownerNodeID: k0s-ir02-node01
shared: "yes"
thinProvision: "no"
vgPattern: ^vg.openebs$
volGroup: vg.openebs
status:
state: Ready
kind: List
metadata:
resourceVersion: ""Anything else you would like to add:
[Miscellaneous information that will assist in solving the issue.]
Environment:
- LVM Driver version
openebs.io/version: 1.6.1 (from openebs-lvm-localpv-controller metadata)
- Kubernetes version (use
kubectl version):
mahdi@laptop:~$ kubectl version
Client Version: v1.34.0
Kustomize Version: v5.7.1
Server Version: v1.33.4+k0s
mahdi@laptop:~$
-
Kubernetes installer & version:
k0sctl
-
Cloud provider or hardware configuration:
Bare metal. G11 servers.
-
OS (e.g. from /etc/os-release):
root@k0s-ir02-node01:/# cat /etc/os-release
PRETTY_NAME="Debian GNU/Linux 13 (trixie)"
NAME="Debian GNU/Linux"
VERSION_ID="13"
VERSION="13 (trixie)"
VERSION_CODENAME=trixie
DEBIAN_VERSION_FULL=13.2
ID=debian
HOME_URL="https://www.debian.org/"
SUPPORT_URL="https://www.debian.org/support"
BUG_REPORT_URL="https://bugs.debian.org/"
root@k0s-ir02-node01:/#
What steps did you take and what happened:
[A clear and concise description of what the bug is, and what commands you ran.]
I installed openebs lvm-localpv using openebs helm chart version 4.1.1 deployed via Ansible on my k0s cluster.
Helm chart values:
I created
vg.openebsvolume group on my k0s node and created openebs-lvm storage class:ReclaimPolicy is Delete which means when deleting PVC, PV and LV should be automatically deleted.
When I delete a PVC, PV is deleted correctly and I have no dangling PV. But when I run
lvs vg.openebson my node, it lists more LV than I have PVC or PVAs you can see, I have dangling LVs that are not automatically deleted despite ReclaimPolicy: Delete
What did you expect to happen:
I expected LVs to be automatically deleted and be the same number as the PVs in my cluster.
The output of the following commands will help us better understand what's going on:
(Pasting long output into a GitHub gist or other Pastebin is fine.)
kubectl logs -f openebs-lvm-localpv-controller-7b6d6b4665-fk78q -n openebs -c openebs-lvm-pluginkubectl logs -f openebs-lvm-localpv-node-[xxxx] -n openebs -c openebs-lvm-pluginkubectl get pods -n openebskubectl get lvmvol -A -o yamlAnything else you would like to add:
[Miscellaneous information that will assist in solving the issue.]
Environment:
openebs.io/version: 1.6.1 (from openebs-lvm-localpv-controller metadata)
kubectl version):Kubernetes installer & version:
k0sctl
Cloud provider or hardware configuration:
Bare metal. G11 servers.
OS (e.g. from
/etc/os-release):