Continual link resets (LR) occurring against Brocade switch port
Applies to
- Brocade SAN switch.
Issue
- Link resets on one port are reported:
2020/09/01-09:22:48 (CET), [C5-1014], 2001, CHASSIS | PORT 0/13, WARNING, BrocadeG720, Link Reset on Port S0,P13(52) vc_no=0 crd(s)lost=5 auto trigger.
- Continual link resets (LR) reported by MAPS on port # as indicated in
errdump -a:
2020/09/01-14:54:34, [MAPS-1003], 796, FID 128, WARNING, brocade_switch, onpom_fc0, F-Port 13, Condition=ALL_F_PORTS(LR/min>=1), Current Value:[LR, 2], RuleName=CNLV_CMPLNT_LR, Dashboard Category=Port Health.
2020/09/01-15:16:53, [LOG-1000], 798, FID 128, INFO, brocade_switch, Previous message repeated 2 time(s).
2020/09/01-15:20:34, [MAPS-1003], 799, FID 128, WARNING, brocade_switch, onpom_fc0, F-Port 13, Condition=ALL_F_PORTS(LR/min>=1), Current Value:[LR, 2], RuleName=CNLV_CMPLNT_LR, Dashboard Category=Port Health.
2020/09/01-15:46:53, [LOG-1000], 802, FID 128, INFO, brocade_switch, Previous message repeated 3 time(s).
2020/09/01-15:46:58, [MAPS-1003], 803, FID 128, WARNING, brocade_switch, onpom_fc0, F-Port 13, Condition=ALL_F_PORTS(LR/min>=1), Current Value:[LR, 4], RuleName=CNLV_CMPLNT_LR, Dashboard Category=Port Health.
2020/09/01-15:56:10, [MAPS-1003], 804, FID 128, WARNING, brocade_switch, onpom_fc0, F-Port 13, Condition=ALL_F_PORTS(LR/min>=1), Current Value:[LR, 2], RuleName=CNLV_CMPLNT_LR, Dashboard Category=Port Health.
2020/09/01-16:01:22, [MAPS-1003], 805, FID 128, WARNING, brocade_switch, onpom_fc0, F-Port 13, Condition=ALL_F_PORTS(LR/min>=1), Current Value:[LR, 4], RuleName=CNLV_CMPLNT_LR, Dashboard Category=Port Health.
2020/09/01-16:16:53, [LOG-1000], 806, FID 128, INFO, brocade_switch, Previous message repeated 1 time(s).
2020/09/01-16:23:40, [MAPS-1003], 807, FID 128, WARNING, brocade_switch, onpom_fc0, F-Port 13, Condition=ALL_F_PORTS(LR/min>=1), Current Value:[LR, 4], RuleName=CNLV_CMPLNT_LR, Dashboard Category=Port Health.
-
Under
Fabriclog, could see port is flapping.
08:39:49.865779 SCN LR_PORT(0);g=0x24e4 LR_IN D2,P0 D2,P0 13 NA08:39:57.801578 SCN LR_PORT(0);g=0x24e4 LR_IN D2,P0 D2,P0 13 NA08:40:10.095012 SCN LR_PORT(0);g=0x24e4 LR_IN D2,P0 D2,P0 13 NA08:40:22.120959 SCN LR_PORT(0);g=0x24e4 LR_IN D2,P0 D2,P0 13 NA08:40:23.031030 *Removing all nodes from port D2,P0 D2,P0 13 NA08:53:26.644103 *Removing all nodes from port D2,P0 D2,P0 13 NA08:53:26.644295 SCN Port F_PORT D2,P0 D2,P0 13 NA10:09:04.749379 SCN LR_PORT(0);g=0x27be LR_IN D2,P0 D2,P0 144 NA
- Verifying porterrshow reports excessive link fail counters :
frames enc crc crc too too bad enc disc link loss loss frjt fbsy c3timeout pcs uncor
tx rx in err g_eof shrt long eof out c3 fail sync sig tx rx err err
376: 298.7k 501.9k 0 0 0 0 0 0 0 0 9.9k 0 0 0 0 0 0 0 0
- Interrupts, lli, proc_rqrd, lr_in, lr_out, ols_in, ols_out increasing in
portshow:
portshow 13
portDisableReason: None
portCFlags: 0x1
portFlags: 0x24b03 PRESENT ACTIVE F_PORT G_PORT U_PORT LOGICAL_ONLINE LOGIN NOELP LED ACCEPT FLOGI
LocalSwcFlags: 0x0
portType: 26.0
POD Port: Port is licensed
portState: 1 Online
Protocol: FC
portPhys: 6 In_Sync portScn: 32 F_Port
port generation number: 93268
state transition count: 92939
portId: 0a0d00
portIfId: 43020034
portWwn: 20:0d:88:94:71:b1:69:c0
portWwn of device(s) connected:
21:00:00:24:ff:1d:8c:e2
16b Area list:
Distance: normal
portSpeed: N16Gbps
FEC: Inactive
Credit Recovery: Inactive
Aoq: Inactive
FAA: Inactive
F_Trunk: Inactive
LE domain: 0
Peer beacon: Off
FC Fastwrite: OFF
Interrupts: 9909 Link_failure: 3 Frjt: 0
Unknown: 0 Loss_of_sync: 0 Fbsy: 0
Lli: 9909 Loss_of_sig: 0
Proc_rqrd: 211621 Protocol_err: 0
Timed_out: 0 Invalid_word: 0
Tx_unavail: 0 Invalid_crc: 0
Delim_err: 0 Address_err: 0
Lr_in: 4914 Ols_in: 4877
Lr_out: 4877 Ols_out: 4914
- sfpshow 13
=============
Port 13:
=============
Identifier: 3 SFP
Connector: 7 LC
Transceiver: 6804404000000000 8,16,32_Gbps M5 sw Short_dist
Encoding: 6 64B66B
Baud Rate: 280 (units 100 megabaud)
Length 9u: 0 (units km)
Length 9u: 0 (units 100 meters)
Length 50u (OM2): 3 (units 10 meters)
Length 50u (OM3): 7 (units 10 meters)
Length 62.5u:0 (units 10 meters)
Length 50u (OM4): 10 (units 10 meters)
Vendor Name: BROCADE
Vendor OUI: 00:05:1e
Vendor PN: 57-1000333-01
Vendor Rev: A
Wavelength: 850 (units nm)
Options: 083a Loss_of_Sig,Tx_Fault,Tx_Disable
BR Max: 112
BR Min: 0
Serial No: JAF419030000RAD
Date Code: 190116
DD Type: 0x68
Enh Options: 0xfa
Status/Ctrl: 0x0
Pwr On Time: 1.15 years (10052 hours)
E-Wrap Control: 0
O-Wrap Control: 0
Alarm flags[0,1] = 0x5, 0x0
Warn Flags[0,1] = 0x5, 0x0
Temperature: 58 Centigrade
Current: 6.524 mAmps
Voltage: 3345.4 mVolts
RX Power: -1.7 dBm (675.3uW) HIGHER THAN TX BELOW
TX Power: -2.1 dBm (621.2 uW)
Below steps can be followed to isolate the problem:-
- Remove, clean, and reseat cable and SFPs for the connection. [NOTE: This will include FC Patch Panels / Crossovers if applicable. Please verify physical fabric if connection is straight through LC-LC, or otherwise.]
- If issue persists after re-seat, change FC patch panel connection (if applicable).
- If issue persists, replace cable(s) and swap or replace SFPs for switch and distant end device, and re-assess.
- If above steps do not resolve link resets, please proceed with "Solution" section.
