Failure during resynchronization after converting from DP to XDP
Applies to
ONTAP 9
Issue
- The
snapmirror show-history
command indicates that the resync operation has failed.
::> snapmirror show-history
Destination Source Start End
Path Path Operation Time Time Result
----------- ----------- --------- ----------- ----------- -------
XXX: XXX: resync 12/8/2024 16:50:36 12/9/2024 01:50:17 failure
XXX: XXX: create 12/8/2024 16:50:02 12/8/2024 16:50:03 success
XXX: XXX: delete 12/8/2024 16:46:33 12/8/2024 16:46:36 success
XXX: XXX: break 12/8/2024 16:46:08 12/8/2024 16:46:14 success
4 entries were displayed.
- The
df
command shows that both the source and destination are at 100% usage.
SRC
DST
/vol/XXX/ 18552245456 18495493852 56751604 100% /vol/XXXI
/vol/ XXX /.snapshot 976433968 111085944 865348024 11% /vol/ XXX /.snapshot
DST
/vol/ XXX / 18552245456 18531286092 20959364 100% /vol/ XXX /
/vol/ XXX /.snapshot 976433968 92091712 884342256 9% /vol/ XXX /.snapshot
- The EMS log records a
wafl.vol.full:alert
.
Mon Dec 09 00:49:32 +0900 [XXX: wafl_exempt07: wafl.vol.full:alert]: Insufficient space on volume XXX to perform operation. 48.6GB was requested but only 20.0GB was available.
- The
SNAPMIRROR-AUDIT-LOG-TXT.GZ
contains the following records:
Mon Dec 9 00:49:32 JST 2024 ResyncTransfer[Dec 8 16:52:52]:XXX Operation-Uuid=XXX Group=vserver Operation-Cookie=XXX action=Defer source=XXX destination=XXX status=Failure message=Transfer failed.(Stream destroy failed(No space left on device))
Mon Dec 9 00:50:35 JST 2024 ResyncTransfer[Dec 8 16:52:52]:XXX Operation-Uuid=XXX Group=vserver Operation-Cookie=XXX action=Info sm_rpm_snaplist_delete([110]): Snapshot 12hour.2024-11-29_0000 deleted.
Mon Dec 9 00:50:35 JST 2024 ResyncTransfer[Dec 8 16:52:52]:XXX Operation-Uuid=XXX Group=vserver Operation-Cookie=XXX action=Info Detected an incomplete transfer of snapshot 12hour.2024-12-08_1200. Completing it.
Mon Dec 9 00:50:42 JST 2024 ResyncTransfer[Dec 8 16:52:52]:XXX Operation-Uuid=XXX Group=vserver Operation-Cookie=XXX action=Defer source=XXX destination=XXX status=Failure message=Transfer failed.(Stream destroy failed(No space left on device))
Mon Dec 9 00:51:42 JST 2024 ResyncTransfer[Dec 8 16:52:52]:XXX Operation-Uuid=XXX Group=vserver Operation-Cookie=XXX action=Info Detected an incomplete transfer of snapshot 12hour.2024-12-08_1200. Completing it.
Mon Dec 9 00:51:49 JST 2024 ResyncTransfer[Dec 8 16:52:52]:XXX Operation-Uuid=XXX Group=vserver Operation-Cookie=XXX action=Defer source=XXX destination=XXX status=Failure message=Transfer failed.(Stream destroy failed(No space left on device))