AFF8080 PCI Error NMI paic on root port 0,2,0

Last updated
Save as PDF
Share
1. Share
2. Tweet
3. Share

Views:: 169

Visibility:: Public

Votes:: 1

Category:: aff-series

Specialty:: HW

Last Updated:

Applies to

AFF8080
ONTAP 9

Issue

Node panics with PCI Error NMI on root port 0,2,0.

SP system log:

::> 0x0051de0b00847be4: Add bad root port 0/2/0 (1) 0x0051de0b00cddda8: 0/2/0 ucerr_status 0x4000 0x0051de0b00cded10: Recovery process terminated PANIC : PCI Error NMI from device(s):ErrSrcID(CorrSrc(0x810),UCorrSrc(0x10)), RPT(0,2,0): version: 9.5P19: Sat Nov 27 01:46:06 EST 2021 conf : x86_64.optimize cpuid = 18 Uptime: 95d11h22m33s PANIC: PCI Error NMI from device(s):ErrSrcID(CorrSrc(0x810),UCorrSrc(0x10)), RPT(0,2,0): in SK process nblade1 on release 9.5P19 (C)

Examine SSRAM-LOG in ASUP, uncorrectable errors on device 8,2,0 in slot 4.

Fri Apr 7 03:53:43 2023 SRAM record type(LOG) from Data ONTAP: NMIsource(PCIErr). Fri Apr 7 03:53:43 2023 SRAM record type(LOG) from Data ONTAP: IIO0gblfe(0x0), gblne(0x100) Fri Apr 7 03:53:43 2023 SRAM record type(LOG) from Data ONTAP: IIO1gblfe(0x0), gblne(0x0) Fri Apr 7 03:53:43 2023 SRAM record type(LOG) from Data ONTAP: RPT(0,2,0): Fri Apr 7 03:53:43 2023 SRAM record type(LOG) from Data ONTAP: BSF(0:2:0) status = 0x4010 Fri Apr 7 03:53:43 2023 SRAM record type(LOG) from Data ONTAP: BSF(0:2:0) dev_status = 0x3 Fri Apr 7 03:53:43 2023 SRAM record type(LOG) from Data ONTAP: BSF(0:2:0) root_sts = 0x27 Fri Apr 7 03:53:43 2023 SRAM record type(LOG) from Data ONTAP: BSF(0:2:0) corr_sts = 0x2000 Fri Apr 7 03:53:43 2023 SRAM record type(LOG) from Data ONTAP: BSF(0:2:0) ucorr_sts = 0x4000 Fri Apr 7 03:53:43 2023 SRAM record type(LOG) from Data ONTAP: Br[806c](8,2,0) in slot 4: Fri Apr 7 03:53:43 2023 SRAM record type(LOG) from Data ONTAP: BSF(8:2:0) dev_status = 0x1 Fri Apr 7 03:53:43 2023 SRAM record type(LOG) from Data ONTAP: BSF(8:2:0) corr_sts = 0x10c1 Fri Apr 7 03:53:43 2023 SRAM record type(PCI) from Data ONTAP: device(8, 2, 0) in slot(4) Fri Apr 7 03:53:43 2023 SRAM record type(LOG) from Data ONTAP: AGUS,1_0.IIO0: GNERR<0x00000100>(P2A), GNFERR<0x00000100>(P2A); RPT(0,2,0): GLB<0x00000002>(NFERR), PTR<0x1>, Status(SigSysErr), DevStatus(Corr,NFatal), RootErr(Corr,MCorr,UCor,NFatal), ErrSrcID(CorrSrc(0x810),UCorrSrc(0x10)), CorrErr(AdvsNF), UCorrErr(CpTim), FirstUCorrErr(CpTim); Br[806c](8,2,0) in slot 4: DevStatus(Corr), CorrErr(Rcvr,BTLP,BDLLP,RpTim).

sysconfig -ac shows details of the card in slot 4.

sysconfig: slot 1 OK: X1132A: QLogic ISP 2532; Quad Ported 2532 FCP Adapter (PCIe) sysconfig: slot 3 OK: X1132A: QLogic ISP 2532; Quad Ported 2532 FCP Adapter (PCIe) sysconfig: slot 4 OK: X1132A: QLogic ISP 2532; Quad Ported 2532 FCP Adapter (PCIe)