CVO Call home for SYNCMIRROR SNAPSHOTS NOT ROTATING PROPERLY No space left on device

Applies to

Issue

• During the creation of  2 new snapmirror relationships, EMS reports the following

.
Sat Nov 21 10:57:53 +0000 [CVO__cluster11-01: config_async_0: callhome.sync.mirror.nospc:alert]: Call home for SYNCMIRROR SNAPSHOTS NOT ROTATING PROPERLY

Sat Nov 21 20:44:14 +0000 [CVO_cluster11-01: config_async_0: raid.mirror.resync.snapcrtfail:error]: Aggregate aggr0_dr: could not create mirror resynchronization Snapshot copy mirror_resync.1121204414(CVO_prodcifs_cluster11-01)(No space left on device)

• The aggregate snap reserve space was full and there was only one syncmirror snapshot during the time.

::*> df -A

Aggregate               kbytes       used      avail capacity  
aggr0_dr            21688768968 1965182296 19723586672       9%  
aggr0_dr/.snapshot  1141514156 1141514156          0     100%  

• The aggregate itself had plenty of free space

Aggregate               kbytes       used      avail capacity  
aggr0_dr            21688768968 1965182296 19723586672       9%

Review aggregate snapshot: 
::> node run -node c-mode-01 -command snap list -A aggr0_dr

Aggregate aggr0_dr
working...

date          name
------------  --------
Nov 21 13:51  mirror_resync.1121135148(CVO_prodcifs_cluster11-01) (busy,syncmirror)

• It cleared itself later , confirmed a new syncmirror snapshot was created and old snapshot deleted.

[?] Sat Nov 21 18:52:40 +0000 [CVO_prodcifs_cluster11-01: snap_helper: wafl.snap.autoDelete:info]: Deleting Snapshot copy 'mirror_resync.1121160915(CVO_prodcifs_cluster11-01)' in aggregate 'aggr0_dr' to free up space.
[?] Sat Nov 21 18:52:42 +0000 [CVO_prodcifs_cluster11-01: snap_helper: wafl.snap.autoDelete:info]: Deleting Snapshot copy 'mirror_resync.1121185236(CVO_prodcifs_cluster11-01)' in aggregate 'aggr0_dr' to free up space.