Cluster ports down in both controllers
Applies to
Cisco NX3232C Cluster Network Switch (CNS)
Issue
- All cluster ports in two nodes are down:
::> system node run -node * -command sysconfig -a
(...)
e0b MAC Address: 00:a0:98:ef:a2:f4 (auto-unknown-fd-down)
SFP Vendor: CISCO-JPC
SFP Part Number: P3057U101000-1
SFP Serial Number: JPC235000A0-CH1
(...)
e0b MAC Address: 00:a0:98:ef:9a:20 (auto-unknown-fd-down)
SFP Vendor: CISCO-JPC
SFP Part Number: P3057U101000-1
SFP Serial Number: JPC24200028-CH1
- In case of MCC-IP, the ports used there are down as well
- All the ports are connected to the same Cluster Network Switch
- EMS messages reported simultaneously for both nodes:
Tue Mar 29 20:21:38 +0200 [node_name-01: intr: netif.linkDown:info]: Ethernet e1b: Link down, check cable.
Tue Mar 29 20:21:38 +0200 [node_name-01: intr: netif.linkDown:info]: Ethernet e0b: Link down, check cable.
Tue Mar 29 20:21:41 +0200 [node_name-01: vifmgr: vifmgr.portdown:notice]: A link down event was received on node node_name-01, port e0b.
Tue Mar 29 20:21:42 +0200 [node_name-01: vifmgr: vifmgr.clus.linkdown:EMERGENCY]: The cluster port e0b on node node_name-01 has gone down unexpectedly.
Tue Mar 29 20:27:13 +0200 [node_name-01: nchmd: hm.alert.raised:alert]: Alert Id = MccIp_PortOfflineAlert , Alerting Resource = node_name-01_t6nex0_e1b raised by monitor node-connect
Tue Mar 29 20:21:38 +0200 [node_name-02: intr: netif.linkDown:info]: Ethernet e1b: Link down, check cable.
Tue Mar 29 20:21:38 +0200 [node_name-02: intr: netif.linkDown:info]: Ethernet e0b: Link down, check cable.
Tue Mar 29 20:21:41 +0200 [node_name-02: vifmgr: vifmgr.portdown:notice]: A link down event was received on node node_name-02, port e0b.
Tue Mar 29 20:21:43 +0200 [node_name-02: vifmgr: vifmgr.clus.linkdown:EMERGENCY]: The cluster port e0b on node node_name-02 has gone down unexpectedly.
Tue Mar 29 20:27:49 +0200 [node_name-02: nchmd: hm.alert.raised:alert]: Alert Id = MccIp_PortOfflineAlert , Alerting Resource = node_name-02_t6nex0_e1b raised by monitor node-connect
Tue Mar 29 20:28:20 +0200 [node_name-02: cshmd: hm.alert.raised:alert]: Alert Id = ClusterSwitchMissing_Alert , Alerting Resource = node_name raised by monitor ethernet-switch
Tue Mar 29 20:28:42 +0200 [node_name-02: mgwd: callhome.hm.alert.major:alert]: Call home for Health Monitor process nchm: MccIp_PortOfflineAlert[node_name-01_t6nex0_e1b]
- The switch is not reachable through ping or SSH
- All the port LEDs are off
- The PSU power LED is orange.