Snapshot spill causes Root volume to be low on space
Applies to
- Data ONTAP 8.3
- ONTAP 9
- ONTAP Select
Issue
Multiple issues can produce a node's root volume running out of space. Examples:
- System is generating the following error message:
Critical: This node is not healthy because the root volume is low on space (<10MB). The node can still serve data but it cannot participate in cluster operations until this situation is rectified. Free space using the nodeshell or contact technical support for assistance.- Autosupport messages:
Call home for MDB RECOVERY UNSUCCESSFUL FOR THE crs WARNING.
- The System also may panic with some of the following messages
PANIC: Process vifmgr unresponsive for 630 seconds in process nodewatchdog on release 9.5P6 (C) on Sat Nov 6 01:42:45 MST 2021
mgmtgwd.rootvolrec.low.space:EMERGENCY]: The root volume on node "Node10" is dangerously low on space. Less than 10 MB of free space remaining.
callhome.root.vol.recovery.reqd:EMERGENCY]: Call home for ROOT VOLUME NOT WORKING PROPERLY: RECOVERY REQUIRED.
boot.varfs.backup.issue:EMERGENCY]: Backup of the /var file system failed (cp: /mroot/etc/tmpvarfs.tgz: No space left on device