VMware VMs fail to complete VM disk consolidation in NFS datastore

VMware VMs fails to complete VM disk consolidation in NFS datastore

Due to disk consolidation failures, several delta-vmdk disks for the VMs are left accumulating and are not being removed after VMware snapshots are deleted

- VMware VMX logs report:

2024-03-04T21:35:35.738Z Er(02) vmx lssj33yh-1254789-auto-qw7a-h5:70079402-74-4-da95 ConsolidateFillSnapDiskTransferArray: Failed to fetch disk size of '/vmfs/volumes/2e2b585d-4625cd18/GEROME01/GEROME01-000001.vmdk' for consolidate: Unknown error (5)

2024-03-04T21:35:35.738Z In(05) vmx lssj33yh-1254789-auto-qw7a-h5:70079402-74-4-da95 ConsolidateStart: Failure while populating the snapDataPerCombineOperation array: 'Unknown error' (5)

- vCenter VPXD logs report the same failure:

2024-03-04T21:35:35.682Z info vpxd[09080] [Originator@6876 sub=vpxLro opID=lssj33yh-1254789-auto-qw7a-h5:70079402-74] [VpxLRO] -- BEGIN task-3319906 -- snapshot-638149 -- vim.vm.Snapshot.remove -- 528553b1-c826-7000-fc8f-75e2b3a9edf7(5298215b-47bf-6666-80ee-6348c4a56724)
2024-03-04T21:35:35.803Z info vpxd[20643] [Originator@6876 sub=MoCluster opID=HB-host-301534@1297016-1de1161e] Host [vim.HostSystem:host-301534,gerrdesxiprd01.ds.jdsu.net] has 1 HDCS resources
2024-03-04T21:35:35.829Z warning vpxd[20641] [Originator@6876 sub=Default opID=lssj33yh-1254789-auto-qw7a-h5:70079402-74-24731ae5] Skipping empty diskLayout configuration for VM[gernfs1b_vm2] GEROME01/GEROME01.vmx, key 2000 while populating diskLayout
2024-03-04T21:35:35.832Z warning vpxd[07206] [Originator@6876 sub=vmomi.soapStub[35] opID=TaskLoop-host-78754] SOAP request returned HTTP failure;<SSL(<io_objp:0x00007fba003be098,h:48,<TCP'10.104.9.17 : 59930'>, <TCP '10.104.9.45 :443'>>), /vpxa>, method: waitForUpdates; code: 500(Internal Server Error)
2024-03-04T21:35:35.833Z info vpxd[09080] [Originator@6876 sub=vpxLro opID=lssj33yh-1254789-auto-qw7a-h5:70079402-74] [VpxLRO] -- FINISH task-331990