Core Blade on Slot 8 is faulty as the blade was DOA
Applies to
- Brocade X7-8 Switch
Issue
- While doing switch installation, the blade on slot 8 is not coming up online.
- Core blade on slot 8 is failing to boot and is in faulty state.
- HA is in sync and switch is in online state.
/fabos/cliexec/hadump:
---------------------------------------
TIME_STAMP: Dec 19 07:56:28.729073
---------------------------------------
Local CP (Slot 1, CP0): Active, Cold Recovered
Remote CP (Slot 2, CP1): Standby, Healthy
HA enabled, Heartbeat Up, HA State synchronized
- Rebooting of the switch and physical reseat of the blade on slot 8 tried but issue persists.
- Below events were reported during installation-
Switch:FID128:admin> slotshow
Slot Blade Type ID Status
-----------------------------------
1 CP BLADE 220 ENABLED
2 CP BLADE 220 ENABLED
3 SW BLADE 218 ENABLED
4 SW BLADE 218 ENABLED
5 SW BLADE 218 ENABLED
6 SW BLADE 218 ENABLED
7 CORE BLADE 215 ENABLED
8 UNKNOWN VACANT
9 SW BLADE 218 ENABLED
10 SW BLADE 218 ENABLED
11 SW BLADE 218 ENABLED
12 SW BLADE 218 ENABLED
DIAG: Command /fabos/cliexec/forceerror invalid on Slot 8
2024/12/18-22:29:04 (GMT), [EM-1004], 76, SLOT 1 | FFDC | CHASSIS, CRITICAL, Brocade_X7-8, Slot 8 failed to power on.
2024/12/18-22:29:04 (GMT), [RAS-1001], 77, SLOT 1 | CHASSIS, INFO, Brocade_X7-8, First failure data capture (FFDC) event occurred.
2024/12/18-22:29:04 (GMT), [EM-1069], 78, SLOT 1 | CHASSIS, INFO, Brocade_X7-8, Slot 8 is being powered off.
Switch:FID128:admin> ipaddrset -cp 0slotshow
Slot Blade Type ID Status
-----------------------------------
1 CP BLADE 220 ENABLED
2 CP BLADE 220 ENABLED
3 SW BLADE 218 ENABLED
4 SW BLADE 218 ENABLED
5 SW BLADE 218 ENABLED
6 SW BLADE 218 ENABLED
7 CORE BLADE 215 ENABLED
8 CORE BLADE 215 FAULTY (3)
9 SW BLADE 218 ENABLED
10 SW BLADE 218 ENABLED
11 SW BLADE 218 ENABLED
12 SW BLADE 218 ENABLED
- Below events are reported under
errdump
-
2024/12/18-22:19:50 (GMT), [EM-2003], 28, SLOT 1 | CHASSIS, ERROR, Brocade_X7-8, Slot 8 has failed the POST tests. FRU is being faulted.
2024/12/18-22:19:58 (GMT), [MAPS-1021], 33, SLOT 1 | FID 128, WARNING, Switch, RuleName=defCHASSISHA_SYNC_0, Condition=CHASSIS(HA_SYNC/NONE==0), Obj:Chassis [HA_SYNC,0] has contributed to switch status MARGINAL.
2024/12/18-22:19:58 (GMT), [MAPS-1020], 34, SLOT 1 | FID 128, WARNING, Switch, Switch wide status has changed from HEALTHY to MARGINAL.
2024/12/18-22:20:00 (GMT), [MAPS-1021], 35, SLOT 1 | FID 128, WARNING, Switch, RuleName=defCHASSISFAULTY_BLADE_1, Condition=CHASSIS(FAULTY_BLADE/NONE>=1), Obj:Chassis [FAULTY_BLADE,1] has contributed to switch status MARGINAL.
2024/12/18-22:20:00 (GMT), [MAPS-1021], 36, SLOT 1 | FID 128, WARNING, Switch, RuleName=defCHASSISDOWN_CORE_1, Condition=CHASSIS(DOWN_CORE/NONE>=1), Obj:Chassis [DOWN_CORE,1] has contributed to switch status MARGINAL.
Line 149: 2024/12/18-22:25:25 (GMT), [EM-1050], 69, SLOT 1 | CHASSIS, INFO, Brocade_X7-8, FRU Slot 8 removal detected.
Line 151: 2024/12/18-22:28:31 (GMT), [EM-1029], 70, SLOT 1 | CHASSIS, WARNING, Brocade_X7-8, Slot 8, a problem occurred accessing a device on the I2C bus (-4). Operational status (40) not changed, access is being retried.
Line 153: 2024/12/18-22:28:31 (GMT), [EM-1029], 71, SLOT 1 | CHASSIS, WARNING, Brocade_X7-8, Slot 8, a problem occurred accessing a device on the I2C bus (-4). Operational status (40) not changed, access is being retried.
Line 155: 2024/12/18-22:28:32 (GMT), [EM-1049], 72, SLOT 1 | CHASSIS, INFO, Brocade_X7-8, FRU Slot 8 insertion detected.
Line 157: 2024/12/18-22:28:32 (GMT), [EM-1050], 73, SLOT 1 | CHASSIS, INFO, Brocade_X7-8, FRU Slot 8 removal detected.
Line 159: 2024/12/18-22:28:52 (GMT), [EM-1049], 74, SLOT 1 | CHASSIS, INFO, Brocade_X7-8, FRU Slot 8 insertion detected.
Line 161: 2024/12/18-22:28:52 (GMT), [EM-1070], 75, SLOT 1 | CHASSIS, INFO, Brocade_X7-8, Slot 8 is being powered on.
Line 163: 2024/12/18-22:29:04 (GMT), [EM-1004], 76, SLOT 1 | FFDC | CHASSIS, CRITICAL, Brocade_X7-8, Slot 8 failed to power on.
Line 167: 2024/12/18-22:29:04 (GMT), [EM-1069], 78, SLOT 1 | CHASSIS, INFO, Brocade_X7-8, Slot 8 is being powered off.
Line 193: 2024/12/19-07:45:59 (GMT), [EM-1223], 92, SLOT 1 | FID 128, INFO, FNS1940V023, Slot 8 has been powered on.
Line 195: 2024/12/19-07:46:00 (GMT), [EM-1070], 93, SLOT 1 | CHASSIS, INFO, Brocade_X7-8, Slot 8 is being powered on.
Line 197: 2024/12/19-07:46:12 (GMT), [EM-1004], 94, SLOT 1 | FFDC | CHASSIS, CRITICAL, Brocade_X7-8, Slot 8 failed to power on.
2024/12/19-07:46:12 (GMT), [RAS-1001], 95, SLOT 1 | CHASSIS, INFO, Brocade_X7-8, First failure data capture (FFDC) event occurred.
Line 201: 2024/12/19-07:46:12 (GMT), [EM-1069], 96, SLOT 1 | CHASSIS, INFO, Brocade_X7-8, Slot 8 is being powered off.
- In order to isolate the issue further, below steps need to be implemented-
- Perform a physical reseat of the blade on slot 8 and Reboot the switch.
- If issue still persists, need to ensure that the blade is correctly seated in the chassis and the only way of checking this is to lay a flat device across the front of the chassis, for example using a metal-edged ruler.
- If any of the blades are not completely ‘flush’ or flat across this chassis face then we have a problem with a blade not correctly seated.
- The Onsite/field engineer will need to check the top, middle and bottom of the front of the chassis to ensure the blades are perfectly ‘flat’. If the ruler shows any evidence of not being flat across all blades then there is a problem with the blades not being seated correctly.
- In this case, we need to power the chassis off, and carefully remove and reseat the blades to be completely flat across the front.