AFF A20 Environmental Reason Shutdown (Multiple fans failed)
Applies to
- AFF A20
- ONTAP 9
Issue
- The node goes down due to a multiple fan failed error.
EMS log:
[node01: env_mgr: monitor.chassisFan.stop:error]: Chassis fan contains at least one stopped fan: Sysfan5 F1 Speed (0 RPM)
[node01: env_mgr: monitor.chassisFan.stop:error]: Chassis fan contains at least one stopped fan: Sysfan1 F1 Speed (0 RPM)
[node01: env_mgr: monitor.chassisFan.stop:error]: Chassis fan contains at least one stopped fan: Sysfan2 F1 Speed (0 RPM)
[node01: env_mgr: monitor.chassisFan.stop:error]: Chassis fan contains at least one stopped fan: Sysfan3 F1 Speed (0 RPM)
[node01: env_mgr: monitor.chassisFan.stop:error]: Chassis fan contains at least one stopped fan: Sysfan4 F1 Speed (0 RPM)
[node01: env_mgr: monitor.shutdown.emergency:EMERGENCY]: Emergency shutdown: Multiple chassis fans have failed.
[node01: env_mgr: monitor.shutdown.emergency:EMERGENCY]: Emergency shutdown: Environmental Reason Shutdown (Multiple fans failed)
[node01: mgwd: mgwd.notify.halt.result:info]: MGWD able to notify CLAM on its HA partner node that this node is undergoing a planned shutdown (reason: E). Error: -
[node01: monitor: monitor.globalStatus.critical:EMERGENCY]: Multiple fans has failed: Sysfan5 F1, Sysfan1 F1, Sysfan2 F1, Sysfan3 F1, Sysfan4 F1. Disk shelf fault.
- Multiple fans failed are seen in BMC log.
BMC node01*> events all
Record 1025:[IPMI.notice]: 0387 | 02 | EVT: 01520007 | Sysfan3_F1_Speed | Assertion Event, "Lower Critical going low " | Reading: 0.000 | Threshold: 1120.000
Record 1026:[IPMI.notice]: 0388 | 02 | EVT: 01520007 | Sysfan4_F1_Speed | Assertion Event, "Lower Critical going low " | Reading: 0.000 | Threshold: 1120.000
Record 1027:[IPMI.notice]: 0389 | 02 | EVT: 01520007 | Sysfan5_F1_Speed | Assertion Event, "Lower Critical going low " | Reading: 0.000 | Threshold: 1120.000
Record 1028:[IPMI.notice]: 038a | 02 | EVT: 01520007 | Sysfan1_F1_Speed | Assertion Event, "Lower Critical going low " | Reading: 0.000 | Threshold: 1120.000
Record 1029:[IPMI.notice]: 038b | 02 | EVT: 01520007 | Sysfan2_F1_Speed | Assertion Event, "Lower Critical going low " | Reading: 0.000 | Threshold: 1120.000
Record 1030:[IPMI.emergency]: env_mgr triggers OS halt:Multiple fans failed
- Re-seating all FANs is not helpful.