CFBMC-6022: Takeover due to Pilot4 hang causes ONTAP shutdown with BMC FW 13.11
Issue
Takeover performed by partner node after a missed and stopped heartbeat on Platform running on BMC FW 13.11
- The ONTAP has not received an IPMI heartbeat from the Service Processor (SP) in the last 600 seconds
- The ASUP system has notified that the SP heartbeat has stopped
- The system has been rebooted to recover the BMC
Example:
1/7/2025 20:47:32 node-01 ERROR asup.post.drop: AutoSupport message (HA Group Notification from node-01 (SP HBT MISSED) NOTICE) was not posted to NetApp. The system will drop the message.
1/7/2025 20:16:20 node-02 ERROR mgmtgwd.vreport.nodesUnreachable: Vreport encountered some unreachable nodes. The report may be incomplete.
1/7/2025 20:11:38 node-02 ALERT callhome.sfo.takeover: Call home for CONTROLLER TAKEOVER COMPLETE AUTOMATIC
1/7/2025 20:11:21 node-01 ERROR cf.fsm.takeoverOfPartnerDisabled: Failover monitor: takeover of node-02 disabled (local halt in progress).
1/7/2025 20:11:02 node-01 EMERGENCY monitor.shutdown.emergency: Emergency shutdown: Environmental Reason Shutdown (System reboot to recover the BMC)
1/7/2025 20:01:02 node-01 EMERGENCY sp.ipmi.lost.shutdown: SP heartbeat stopped and cannot be recovered. To prevent hardware damage and data loss, the system will shut down in 10 minutes.
1/7/2025 19:58:39 node-01 ALERT callhome.sp.hbt.stopped: Call home for SP HBT STOPPED
1/7/2025 19:36:33 node-01 ERROR sp.heartbeat.stopped: Have not received a IPMI heartbeat from the Service Processor (SP) in last 600 seconds.