Cluster port down using CX6 card
Applies to
- ONTAP 9
- FAS/AFF System
- CX6 PSID Card
Issue
- Cluster port e4a went down.
e4a MAC Address: d0:39:ea:58:b4:7e (auto-unknown-fd-down)
QSFP Vendor: AVAGO
QSFP Part Number: 332-00389
QSFP Serial Number: QM060143
- From event logs, the port e4a was flapping.
Tue Apr 16 23:13:13 -0500 [Node-s01: kernel: netif.linkDown:info]: Ethernet e4a: Link down, check cable.
Tue Apr 16 23:13:17 -0500 [Node-s01: vifmgr: vifmgr.lifmoved.linkdown:notice]: LIF Node-s01_clus1 (on virtual server 4294967293), IP address 169.254.79.159, is being moved to node Node-s01, port e4a.
Tue Apr 16 23:13:18 -0500 [Node-s01: vifmgr: vifmgr.reach.noreach:notice]: Network port e4a on node Node-s01 cannot reach its expected broadcast domain Cluster:Cluster. No other broadcast domains appear to be reachable from this port.
Tue Apr 16 23:13:18 -0500 [Node-s01: vifmgr: vifmgr.reach.skipped:notice]: Network port e4a on node Node-s01 was not scanned for reachability because it was administratively or operationally down at the time of the scan.
Tue Apr 16 23:14:01 -0500 [Node-s01: client_common_RPC: csm.updateBladeIpv4Mapping:debug]: CSM updated blade to IPv4 mapping for cluster 00000000-0000-0000-0000-000000000000, blade baf9c7b3-fc35-11ee-98fe-d039ea589875 to IP address 169.254.231.221, Device ID: e4a, Vserver ID -3.
Tue Apr 16 23:15:39 -0500 [Node-s01: kernel: netif.linkUp:info]: Ethernet e4a: Link up.
Tue Apr 16 23:15:39 -0500 [Node-s01: vifmgr: vifmgr.portup:notice]: A link up event was received on node Node-s01, port e4a.
- ONTAP reported "Link Resetting"
Mon May 27 10:23:25 -0500 [Node-s01: processEntry: netif.linkInfo:info]: Ethernet adapter e4a(pci0:78:0:0) has generated a register dump in /mroot/etc/mlx5log : Link Resetting.
Mon May 27 10:23:25 -0500 [Node-s01: kernel: netif.linkInfo:info]: Ethernet adapter e4a(pci0:78:0:0) failed to generate a register dump with error = 17 : Link Resetting.
Mon May 27 10:25:54 -0500 [Node-s01: kernel: netif.linkInfo:info]: Ethernet adapter e4a(pci0:78:0:0) has generated a register dump in /mroot/etc/mlx5log : Link Resetting.
Mon May 27 10:25:54 -0500 [Node-s01: kernel: netif.linkInfo:info]: Ethernet adapter e4a(pci0:78:0:0) failed to generate a register dump with error = 17 : Link Resetting.
Mon May 27 10:28:23 -0500 [Node-s01: processEntry: netif.linkInfo:info]: Ethernet adapter e4a(pci0:78:0:0) has generated a register dump in /mroot/etc/mlx5log : Link Resetting.
Mon May 27 10:28:23 -0500 [Node-s01: kernel: netif.linkInfo:info]: Ethernet adapter e4a(pci0:78:0:0) failed to generate a register dump with error = 17 : Link Resetting.
- Replacement of SFP on port e4a didn't fixed the issue.