Brocade FC port offline with No_Sync state due to faulty switch SFP
Applies to
- Brocade FC switch
- Fabric OS (FOS)
Issue
- Brocade FC port is in
No_Sync
state anddisabled
state as perswitchshow
output
/fabos/bin/switchshow :
Index Slot Port Address Media Speed State Proto
============================================================
106 11 10 676a40 id N32 No_Sync FC Disabled
sfpshow
displays that Tx value is not in recommended range
=============
Slot 11/Port 10:
=============
Transceiver: 6804404000000000 8,16,32_Gbps M5 sw Short_dist
Vendor PN: 57-1000333-01
RX Power: -2.2 dBm (604.6uW)
TX Power: -27.2 dBm (1.9 uW)
Note: Disabled port and TX power is -40 indicates the laser is turned off and does not indicate a fault necessarily.
-
Enabling the port confirms TX power stays < 300 uW
- Brocade FC port is in
No_Sync
state as perswitchshow
output
/fabos/bin/switchshow :
Index Slot Port Address Media Speed State Proto
============================================================
127 12 15 107f40 id N32 No_Sync FC
-
Porterrshow
reports lot of media errors includingpcs error
,uncorr errors
,c3 discards
, along withlink fail
andloss_sig
errors.
/fabos/cliexec/porterrshow :
frames enc crc crc too too bad enc disc link loss loss frjt fbsy c3timeout pcs uncor
tx rx in err g_eof shrt long eof out c3 fail sync sig tx rx err err
296: 12.4k 12.1k 0 0 0 0 0 0 0 11 1.5k 57.3k 9.2k 0 0 11 0 252 43.7k
portstatsshow
output shows port isoffline
&no_syn
c state along with disable reason asport throttled
.
portshow 127
portDisableReason: Port Throttled
portCFlags: 0x0
portFlags: 0x61 PRESENT DISABLED
LocalSwcFlags: 0x0
portType: 26.0
portState: 2 Offline
Protocol: FC
portPhys: 5 No_Sync portScn: 2 Offline
portstatsshow
output shows port isoffline
&no_syn
c state
portshow 330
portDisableReason: None
portCFlags: 0x0
portFlags: 0x4021 PRESENT U_PORT DISABLED LED
LocalSwcFlags: 0x0
portType: 26.0
portState: 2 Offline
Protocol: FC
portPhys: 5 No_Sync portScn: 2 Offline
Errdump
reports link failures and loss signal errors along with rule-defNON_E_F_PORTSSTATE_CHG_20_FENCE
&ALL_SFP_32GSWL_TX_POWER_251
getting triggered
2023/01/20-15:37:58, [MAPS-2022], 23317, SLOT 1 | FID 128, WARNING, SWITCHXX, slot6 port8 HBAXX_HBA1 DISABLED_LR_11112022, U-Port 6/8, Condition=ALL_PORTS(LOSS_SIGNAL/min>3), Current Value:[LOSS_SIGNAL, 70 LOS], RuleName=defALL_PORTSLOSS_SIGNAL_3, Dashboard Category=Port Health.
2023/01/20-15:38:28, [MAPS-2018], 23318, SLOT 1 | FID 128, WARNING, SWITCHXX, slot6 port8 HBAXX_HBA1 DISABLED_LR_11112022, U-Port 6/8, Condition=ALL_PORTS(LF/min>3), Current Value:[LF, 4 LFs], RuleName=defALL_PORTSLF_3, Dashboard Category=Port Health.
2023/03/06-17:48:07, [MAPS-1003], 89981, SLOT 1 | FID 128, WARNING, SWITCHXX, slot9 port15, U-Port 9/15, Condition=NON_E_F_PORTS(STATE_CHG/min>11), Current Value:[STATE_CHG, 14], RuleName=defNON_E_F_PORTSSTATE_CHG_11, Dashboard Category=Port Health.
2023/03/06-17:48:13, [MAPS-1010], 89983, SLOT 1 | FID 128, ERROR, SWITCHXX, Port(s) fenced due to RuleName=defNON_E_F_PORTSSTATE_CHG_20_FENCE, Condition=NON_E_F_PORTS(STATE_CHG/min>20), Obj:slot9 port15, U-Port 9/15 [ STATE_CHG,21]
2023/06/15-18:16:27, [MAPS-1005], 182673, SLOT 1 | FID 128, WARNING, H1NETxxx, SFP 12/15, Condition=ALL_32GSWL_SFP(TXP<=251), Current Value:[TXP, 251 uW], Rule ALL_SFP_32GSWL_TX_POWER_251 triggered 57 times in 1 day and last trigger time Thu Jun 15 16:38:27 2023, Dashboard Category=Port Health.
023/06/14-17:29:26, [MAPS-1003], 182281, SLOT 1 | FID 128, WARNING, H1NETxxx, slot12 port15, F-Port 12/15, Condition=ALL_HOST_PORTS(LR/min>1), Current Value:[LR, 2 LRs], RuleName=ALL_HOST_PORTS_LR_1_ELK, Dashboard Category=Port Health.
2023/06/14-17:30:08, [MAPS-1003], 182282, SLOT 1 | FID 128, WARNING, H1NETxxx, slot12 port15, F-Port 12/15, Condition=ALL_HOST_PORTS(LR/min>4), Current Value:[LR, 5 LRs], RuleName=ALL_HOST_PORTS_LR_4, Dashboard Category=Port Health.
2023/06/14-17:30:26, [MAPS-1003], 182283, SLOT 1 | FID 128, WARNING, H1NETxxx, slot12 port15, F-Port 12/15, Condition=ALL_HOST_PORTS(LR/min>1), Current Value:[LR, 8 LRs], RuleName=ALL_HOST_PORTS_LR_1_ELK, Dashboard Category=Port Health.
2023/06/14-09:27:56 (IST), [MAPS-1003], 915764, SLOT 1 | FID 128 | PORT 9/42, WARNING, Brocade, slot9 port42-H.DELL_Chassis.xx.10.226.xx.xx.3F07xxx.SI, U-Port 9/42, Condition=ALL_OTHER_F_PORTS(STATE_CHG/min>5), Current Value:[STATE_CHG, 9], RuleName=defALL_OTHER_F_PORTSSTATE_CHG_5, Dashboard Category=Port Health, Quiet Time=None.
2023/06/14-09:27:56 (IST), [MAPS-1003], 915763, SLOT 1 | FID 128 | PORT 9/42, WARNING, Brocade, slot9 port42-H.DELL_Chassis.xx.10.226.xx.xx.3F07xx1.SI, U-Port 9/42, Condition=ALL_HOST_PORTS(STATE_CHG/min>5), Current Value:[STATE_CHG, 9],
RuleName= defALL_HOST_PORTSSTATE_CHG_5, Dashboard Category=Port Health, Quiet Time=None.
-
sfpshow
reports low Rx power and Tx power as -inf:
=============
Slot 6/Port 8:
=============
RX Power: -5.5 dBm (284.6uW)
TX Power: -inf dBm (0.0 uW)
sfpshow
reports Tx power as-inf
:
=============
Slot 9/Port 15:
=============
RX Power: -1.2 dBm (751.4uW)
TX Power: -inf dBm (0.0 uW)
sfpshow
reports low Tx power:
=============
Slot 12/Port 15:
=============
RX Power: -2.5 dBm (556.0uW)
TX Power: -8.4 dBm (144.1 uW)
- Fabriclog reports link flapping as shown below:
17:47:01.645590 *Removing all nodes from port A2,P0 A2,P0 79 NA
17:47:01.645838 SCN Port F_PORT A2,P1 A2,P0 79 NA
17:47:01.646695 SCN Port Offline;rsn=0x3,g=0x66c A2,P0 A2,P0 79 NA
17:47:01.646703 *Removing all nodes from port A2,P0 A2,P0 79 NA
17:47:02.439648 SCN LR_PORT(0);g=0x66c A2,P0 A2,P0 79 NA
17:47:03.316504 SCN LR_PORT(0);g=0x66c A2,P0 A2,P0 79 NA
17:47:03.366059 SCN Port Online; g=0x66c,isolated=0 A2,P0 A2,P1 79 NA