EMS reports ACP Processor error and SHELF_FAULT error
Applies to
- ONTAP 9
- Alternate control path (ACP)
- Service Processor (SP)
- Baseboard Management Controller(BMC)
Issue
- System reports shelf 0 ACP errors and recovers automatically.
[?] Sun Sep 22 09:02:02 +0900 [node: dsa_worker5: ses.status.ACPError:alert]: DS212-12 (S/N SHFFG1913000045) shelf 0 on channel 0a ACP Processor error for SAS shelf ACP processor 1: critical status ; Alternate Control Path hardware failed This module is on the rear of the shelf at the top left, on shelf module A.
[?] Sun Sep 22 09:02:02 +0900 [node: dsa_worker5: ses.status.ACPError:alert]: DS212-12 (S/N SHFFG1913000045) shelf 0 on channel 0a ACP Processor error for SAS shelf ACP processor 2: critical status ; Alternate Control Path hardware failed This module is on the rear of the shelf at the top right, on shelf module B.
[?] Sun Sep 22 09:12:23 +0900 [node: dsa_worker4: ses.status.ACPInfo:info]: DS212-12 (S/N SHFFG1913000045) shelf 0 on channel 0a ACP Processor information for SAS shelf ACP processor 2: normal status.
[?] Sun Sep 22 09:12:32 +0900 [node: dsa_worker5: ses.status.ACPInfo:info]: DS212-12 (S/N SHFFG1913000045) shelf 0 on channel 0a ACP Processor information for SAS shelf ACP processor 1: normal status.
- Both node reports
HA Group Notification (SHELF_FAULT) ERRORand the following errors detected.
[?] Tue Sep 24 10:06:45 +0900 [node: dsa_worker2: ses.exceptionShelfLog:debug]: Retrieving Exception SES Shelf Log information on channel PARTNER IOM module A disk shelf ID 0.
[?] Tue Sep 24 10:06:45 +0900 [snetappcon003: storlog_admin: sla.shelf.message:debug]: params: {'type': 'SEVERITY', 'log': 'Thu Jan 1 00:00:00 1970 ( 0+00:00:00.474); 02000093; U?; HAL; hal; 04; Module Reboot: Startup type 8-Remote reset'}
[?] Tue Sep 24 10:07:08 +0900 [node: dsa_worker4: ses.status.ACPWarn:error]: DS212-12 (S/N SHFFG1913000045) shelf 0 on channel 0a ACP Processor warning for SAS shelf ACP processor 1: ACP status not available. Element in transition mode. This module is on the rear of the shelf at the top left, on shelf module A.
[?] Tue Sep 24 10:12:14 +0900 [node: statd: monitor.shelf.fault:alert]: Critical fault reported on disk storage shelf attached to channel 0a. Check fans, power supplies, disks, and temperature sensors.
[?] Tue Sep 24 10:12:14 +0900 [node: statd: callhome.shlf.fault:error]: Call home for SHELF_FAULT
storage show faultreports both IOM Alternate Control Path is critical.
Vendor Unique Element 85-IOM12E: (ACP)
Element Status Status Bytes Status Descriptions
1 [IOM12E A] : CRITICAL 02,18,00,40 NO ACPP, INBACP, FAIL
2 [IOM12E B] : CRITICAL 02,18,00,40 NO ACPP, INBACP, FAIL
- Use the following command to reboot the SP/BMC and reset ACP doesn't resolve the problem.
Cluster::> system service-processor reboot-sp -node <node_name>
Cluster::> storage shelf acp configure -is-enabled false
Cluster::> storage shelf acp configure -is-enabled true -channel <in-band or out-of-band>
- Node front attention LED may trun on.