I cannot delete Volumes from CloudStack.

[w1a2n3o4]

I cannot delete Volumes from CloudStack.
The virtual machines have been deleted, but the Volumes remain in Destroy status.
When I try to delete a Volume, I get the following error:
Failed to expunge the volume Volume {“id”:8174,“instanceId”:6893,‘name’:“ROOT-6893”," uuid“:”0cac74bc-7664-4ee9-aca9-43184ce317e9“,‘volumeType’:”ROOT"} in Primary data store : The uuid you supplied was invalid.

I get the following log:
2025-12-11 09:35:22,684 INFO [c.c.s.VolumeApiServiceImpl] (qtp949767857-527781: [ctx-8ae1ecab, ctx-269033f0]) (logid:38564811) Expunging volume Volume {“id”:8174,“instanceId”:6893,‘name’:“ROOT-6893”," uuid“:”0cac74bc-7664-4ee9-aca9-43184ce317e9“,‘volumeType’:”ROOT"} from Primary data store
2025-12-11 09:35:22,702 DEBUG [c.c.a.t.Request] (qtp949767857-527781:[ctx-8ae1ecab, ctx-269033f0]) (logid:38564811) Seq 77362-2491616493842741986: Sending { Cmd , MgmtId: 108597816265214, via: 77362(host-1.local), Ver: v1, Flags: 100011, [{“org.apache.cloudstack.storage.command.DeleteCommand”:{" data“:{”org.apache.cloudstack.storage.to.VolumeObjectTO“:{”uuid“:”0cac74bc-7664-4ee9-aca9-43184ce317e9“,”volumeType“:”ROOT“,‘dataStore’:{” org.apache.cloudstack.storage.to.PrimaryDataStoreTO“:{”uuid“:”test-storage“,”name“:”test-storage“,”id“:”71“,”poolType“:”PreSetup“,”host“:‘localhost’,” path“:”/test-storage“,”port“:”0“,‘url’:”PreSetup://localhost/test-storage/?ROLE=Primary&STOREUUID=test-storage“,” isManaged“:”false“}},”name“:”ROOT-6893“,‘size’:”(1000.00 GB) 1073741824000“,” path“:”893dbeb2-074a-4cee-b7f0-98516f9df125“,”volumeId“:”8174“,”accountId“:”335“,”format“:”VHD“,”provisioningType“:”THIN“,”poolId“:‘71’,” id“:”8174“,”deviceId“:”0“,”cacheMode“:”NONE“,”hypervisorType“:”XenServer“,”directDownload“:”false“,”deployAsIs“:”false“,”checkpointPaths“:[],”checkpointImageStoreUrls“:[],”followRedirects“:”true“}},‘wait’:”0", “bypassHostMaintenance”:“false”}}] }
2025-12-11 09:35:22,703 DEBUG [c.c.a.t.Request] (qtp949767857-527781: [ctx-8ae1ecab, ctx-269033f0]) (logid:38564811) Seq 77362-2491616493842741986: Executing: { Cmd , MgmtId: 108597816265214, via: 77362(host-1.local), Ver: v1, Flags: 100011, [{“org.apache.cloudstack.storage.command.DeleteCommand”:{‘data’:{" org.apache.cloudstack.storage.to.VolumeObjectTO“:{”uuid“:”0cac74bc-7664-4ee9-aca9-43184ce317e9“,”volumeType“:”ROOT“,‘dataStore’:{”org.apache.cloudstack.storage.to. PrimaryDataStoreTO“:{”uuid“:”test-storage“,”name“:”test-storage“,”id“:”71“,”poolType“:”PreSetup“,”host“:‘localhost’,” path“:”/test-storage“,”port“:”0“,‘url’:”PreSetup://localhost/test-storage/?ROLE=Primary&STOREUUID=test-storage“,” isManaged“:”false“}},”name“:”ROOT-6893“,”size“:”(1000.00 GB) 1073741824000“,‘path’:”893dbeb2-074a-4cee-b7f0-98516f9df125“,” volumeId“:”8174“,”accountId“:”335“,”format“:”VHD“,”provisioningType“:”THIN“,”poolId“:”71“,”id“:”8174“,”deviceId“:‘0’,” cacheMode“:”NONE“,”hypervisorType“:”XenServer“,”directDownload“:”false“,”deployAsIs“:”false“,”checkpointPaths“:[],”checkpointImageStoreUrls“:[],”followRedirects“:”true“}},”wait“:”0“,‘bypassHostMaintenance’:”false"}}] }
2025-12-11 09:35:22,703 DEBUG [c.c.s.r.StorageSubsystemCommandHandlerBase] (DirectAgent-347:[ctx-7d122c4b]) (logid:38564811) Executing command DeleteCommand: [{“data”:{" org.apache.cloudstack.storage.to.VolumeObjectTO“:{”uuid“:”0cac74bc-7664-4ee9-aca9-43184ce317e9“,”volumeType“:”ROOT“,‘dataStore’:{”org.apache.cloudstack.storage.to. PrimaryDataStoreTO“:{”uuid“:”test-storage“,”name“:”test-storage“,”id“:71,”poolType“:”PreSetup“,”host“:‘localhost’,” path“:”/test-storage“,”port“:0,‘url’:”PreSetup://localhost/test-storage/?ROLE=Primary&STOREUUID=test-storage“,” isManaged“:false}},”name“:”ROOT-6893“,”size“:1073741824000,”path“:”893dbeb2-074a-4cee-b7f0-98516f9df125“,‘volumeId’:8174,” accountId“:335,”format“:”VHD“,”provisioningType“:”THIN“,”poolId“:71,”id“:8174,”deviceId“:0,”cacheMode“:‘NONE’,” hypervisorType“:”XenServer“,”directDownload“:false,”deployAsIs“:false,”checkpointPaths“:[],”checkpointImageStoreUrls“:[],”followRedirects“:true}},‘wait’:0,”bypassHostMaintenance":false}].
2025-12-11 09:35:22,712 WARN [c.c.s.VolumeApiServiceImpl] (qtp949767857-527781: [ctx-8ae1ecab, ctx-269033f0]) (logid:38564811) Failed to expunge the volume Volume {“id”:8174,“instanceId”:6893,‘name’:“ROOT-6893”," uuid“:”0cac74bc-7664-4ee9-aca9-43184ce317e9“,‘volumeType’:”ROOT"} in Primary data store
2025-12-11 09:35:22,718 ERROR [c.c.a.ApiServer] (qtp949767857-527781: [ctx-8ae1ecab, ctx-269033f0]) (logid:38564811) unhandled exception executing api command: [Ljava.lang.String;@269a67a2 com.cloud.utils.exception.CloudRuntimeException: Failed to expunge the volume Volume {“id”:8174," instanceId“:6893,”name“:”ROOT-6893“,”uuid“:”0cac74bc-7664-4ee9-aca9-43184ce317e9“,‘volumeType’:”ROOT"} in Primary data store : The uuid you supplied was invalid.

Please advise how I can correctly delete the volume.

[prashanthr2]

@w1a2n3o4 This can happen if the volume with the UUID doesn't exist on the backend.

Can you check if the volume with uuid exists on XCP-ng cluster? You can do xe vdi-list uuid=<<failing_uuid>>

[w1a2n3o4]

No, there are no volumes on the XCP-ng cluster.

[w1a2n3o4]

But it remained on CloudStack and was not deleted.

[prashanthr2]

@w1a2n3o4 What is the version of cloudstack you are using? I tested on 4.21 ( but with KVM) , the volume is expunged fine even though the file on the backend no longer exists.

Only option I can see here for you is a manual DB update to mark the volume as Expunged with removed date set.

[w1a2n3o4]

Please tell me how to do this correctly.
In which tables and which records need to be changed?

[prashanthr2]

@w1a2n3o4 you need to update the volumes table like below

update volumes set state='Expunged', removed=now() where id=#;

Make sure you replace the right value for the id in the above query. Also, take a DB backup before proceeding so that you have a copy to revert it if needed