HA Group Notification from node_name (CONTROLLER TAKEOVER COMPLETE AUTOMATIC - INTERNAL HALT) ALERT
Applies to
- Unexpected Takeover Event
- Automatic case alert with "
INTERNAL HALT"
- Automatic case alert with "
Issue
- Automatic case with AutoSupport alert message for "
INTERNAL HALT". Example:
HA Group Notification from node_name (CONTROLLER TAKEOVER COMPLETE AUTOMATIC - INTERNAL HALT) ALERT
- Internal halt initiated due to an environmental shutdown for multiple fan failures. Example:
... [node_name: env_mgr: monitor.chassisFan.stop:error]: Chassis fan contains at least one stopped fan: Sysfan1 F1 Speed (failed)
... [node_name: env_mgr: monitor.chassisFan.stop:error]: Chassis fan contains at least one stopped fan: Sysfan1 F2 Speed (failed)
... [node_name: env_mgr: monitor.chassisFan.stop:error]: Chassis fan contains at least one stopped fan: Sysfan2 F1 Speed (failed)
... [node_name: env_mgr: monitor.chassisFan.stop:error]: Chassis fan contains at least one stopped fan: Sysfan2 F2 Speed (failed)
... [node_name: env_mgr: monitor.chassisFan.stop:error]: Chassis fan contains at least one stopped fan: Sysfan3 F1 Speed (failed)
... [node_name: env_mgr: monitor.chassisFan.stop:error]: Chassis fan contains at least one stopped fan: Sysfan3 F2 Speed (failed)
... [node_name: env_mgr: monitor.chassisFan.stop:error]: Chassis fan contains at least one stopped fan: Sysfan4 F1 Speed (failed)
... [node_name: env_mgr: monitor.chassisFan.stop:error]: Chassis fan contains at least one stopped fan: Sysfan4 F2 Speed (failed)
... [node_name: env_mgr: monitor.chassisFan.stop:error]: Chassis fan contains at least one stopped fan: Sysfan5 F1 Speed (failed)
... [node_name: env_mgr: monitor.chassisFan.stop:error]: Chassis fan contains at least one stopped fan: Sysfan5 F2 Speed (failed)
... [node_name: env_mgr: monitor.shutdown.emergency:EMERGENCY]: Emergency shutdown: Multiple chassis fans have failed.
... [node_name: statd: monitor.fan.failed:alert]: Multiple fans has failed: Sysfan1 F1, Sysfan1 F2, Sysfan2 F1, Sysfan2 F2, Sysfan3 F1, Sysfan3 F2, Sysfan4 F1, Sysfan4 F2, Sysfan5 F1, Sysfan5 F2.
... [node_name: monitor: monitor.globalStatus.critical:EMERGENCY]: Multiple fans has failed: Sysfan1 F1, Sysfan1 F2, Sysfan2 F1, Sysfan2 F2, Sysfan3 F1, Sysfan3 F2, Sysfan4 F1, Sysfan4 F2, Sysfan5 F1, Sysfan5 F2. Power Supply Status Critical: PSU1.
... [node_name: env_mgr: monitor.shutdown.emergency:EMERGENCY]: Emergency shutdown: Environmental Reason Shutdown (Multiple fans failed)
... [node_name: shutdown_thread0: ha.localNodeShutDown:notice]: Shutdown of the local node has been initiated with inhibit_takeover set to FALSE.
- ONTAP events report
Chassis power is degraded: Power Supply Status Critical. Example:
::> event log show
... node EMERGENCY monitor.globalStatus.critical: Power Supply Status Critical: PSU1.
... node ERROR callhome.chassis.power: Call home for CHASSIS POWER DEGRADED: Power Supply Status Critical: PSU1.
... node ALERT monitor.chassisPower.degraded: Chassis power is degraded: Power Supply Status Critical: PSU1.
... node ERROR callhome.chassis.ps.degraded: Call home for CHASSIS POWER SUPPLY DEGRADED: PS 1
- The issue remains after the power cord and PSU re-seat in the chassis
- The issue follows the PSU, when swapped with another working one.
- The SP/BMC may report events for the PSU. Example:
BMC node_name> events all
...
Record 1303: Thu Sep 04 15:01:00.484212 2025 [IPMI.notice]: 0008 | 02 | EVT: 6f02ffff | PSU1_Status | Assertion Event, "Attention"
