SCV backups fail because of lack of space for some ONTAP volumes
Applies to
- NetApp SnapCenter Plugin for VMWare (SCV) 4.X
- NetApp ONTAP
Issue
SCV backup fail with traces like the following in the SCV logs:
Error: Snapshot operation failed [Storage System: svm1]Snapshot operation failed for some of the volumes [Storage System: svm1] [Volume:vol1]
Error: Snapshot operation failed for some of the volumes [Storage System: svm1] [Volume:vol2]
Error: Snapshot operation failed for some of the volumes [Storage System: svm1] [Volume:vol3]
Error: Snapshot operation failed for some of the volumes [Storage System: svm1] [Volume:vol4]
Error: Snapshot operation failed for some of the volumes [Storage System: svm1] [Volume:vol5]
Error: Snapshot operation failed for some of the volumes [Storage System: svm1] [Volume:vol6]
Error: Snapshot operation failed for some of the volumes [Storage System: svm1] [Volume:vol7]
Error: Snapshot operation failed for some of the volumes [Storage System: svm1] [Volume:vol8]
Error: Snapshot operation failed for Reason: No space left on the device to create Snapshot copies
The audit log in the ontap cluster show the snapshot deletion for all the volumes involved, after creation:
Day Month hh:mm:ss [node1: svc_queue_thread: wafl.snap.delete:debug]: Snapshot copy Daily-Backup_MM-DD-YYYY_hh.mm.ss on volume vol1@vserver:xxxxxxxx-yyyy-zzzz-xxxx-yyyyyyyyyyyy NetApp was deleted by the Data ONTAP function ods_multicreate (cleanup). The unique ID for this Snapshot copy is (xxx, yyy).
Day Month hh:mm:ss [node1: svc_queue_thread: wafl.snap.delete:debug]: Snapshot copy Daily-Backup_MM-DD-YYYY_hh.mm.ss on volume vol2@vserver:xxxxxxxx-yyyy-zzzz-xxxx-yyyyyyyyyyyy NetApp was deleted by the Data ONTAP function ods_multicreate (cleanup). The unique ID for this Snapshot copy is (xxx, yyy).
Day Month hh:mm:ss [node1: svc_queue_thread: wafl.snap.delete:debug]: Snapshot copy Daily-Backup_MM-DD-YYYY_hh.mm.ss on volume vol3@vserver:xxxxxxxx-yyyy-zzzz-xxxx-yyyyyyyyyyyy NetApp was deleted by the Data ONTAP function ods_multicreate (cleanup). The unique ID for this Snapshot copy is (xxx, yyy).
Day Month hh:mm:ss [node1: svc_queue_thread: wafl.snap.delete:debug]: Snapshot copy Daily-Backup_MM-DD-YYYY_hh.mm.ss on volume vol4@vserver:xxxxxxxx-yyyy-zzzz-xxxx-yyyyyyyyyyyy NetApp was deleted by the Data ONTAP function ods_multicreate (cleanup). The unique ID for this Snapshot copy is (xxx, yyy).
Day Month hh:mm:ss [node1: svc_queue_thread: wafl.snap.delete:debug]: Snapshot copy Daily-Backup_MM-DD-YYYY_hh.mm.ss on volume vol5@vserver:xxxxxxxx-yyyy-zzzz-xxxx-yyyyyyyyyyyy NetApp was deleted by the Data ONTAP function ods_multicreate (cleanup). The unique ID for this Snapshot copy is (xxx, yyy).
Day Month hh:mm:ss [node1: svc_queue_thread: wafl.snap.delete:debug]: Snapshot copy Daily-Backup_MM-DD-YYYY_hh.mm.ss on volume vol6@vserver:xxxxxxxx-yyyy-zzzz-xxxx-yyyyyyyyyyyy NetApp was deleted by the Data ONTAP function ods_multicreate (cleanup). The unique ID for this Snapshot copy is (xxx, yyy).
Day Month hh:mm:ss [node1: svc_queue_thread: wafl.snap.delete:debug]: Snapshot copy Daily-Backup_MM-DD-YYYY_hh.mm.ss on volume vol7@vserver:xxxxxxxx-yyyy-zzzz-xxxx-yyyyyyyyyyyy NetApp was deleted by the Data ONTAP function ods_multicreate (cleanup). The unique ID for this Snapshot copy is (xxx, yyy).
Day Month hh:mm:ss [node1: svc_queue_thread: wafl.snap.delete:debug]: Snapshot copy Daily-Backup_MM-DD-YYYY_hh.mm.ss on volume vol8@vserver:xxxxxxxx-yyyy-zzzz-xxxx-yyyyyyyyyyyy NetApp was deleted by the Data ONTAP function ods_multicreate (cleanup). The unique ID for this Snapshot copy is (xxx, yyy).