ONTAP ANDU to 9.11.1P3 paused when Cluster ports fail to come online
Applies to
- ONTAP 9.11.1 P3
- Automated Non-Disruptive Upgrade (ANDU)
- AFF A700s
- AOI SFPs
Issue
- During an ONTAP upgrade some nodes' cluster ports do not come online when the node reboots..
- From the nodeshell
ifconfig
shows the cluster ports up and status is no carrier
Example
::> node run -node <node_name> -c ifconfig e4a e4a: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 9000 uuid: dd218a54-75fa-11eb-975e-00a098f51d25 options=4ec07bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6,NOMAP> capabilities=4ec07bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6,NOMAP> ether 3c:fd:fe:ca:4e:c0 inet 169.254.250.128 netmask 0xffff0000 broadcast 169.254.255.255 Services: 0x0000000000000002 Vserver ID: -3 UUID: 850d680c-515a-11e9-aa40-00a098f51d0d nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL> media: Ethernet autoselect (40Gbase-LR4 <full-duplex>) status: no carrier
- Node's cluster ports have an AOI SFP
::> node run -node <node_name> -command sysconfig -a ... slot 4: 10/40 Gigabit Ethernet Controller XL710 QSFP+ e4a MAC Address: 3c:fd:fe:ca:4e:c0 (auto-40g_lr4-fd-up) QSFP Vendor: CISCO-FINISAR >>> supported sfp, ports are online QSFP Part Number: FTL4C1QE2C-C5 QSFP Serial Number: FNS2435063E e4e MAC Address: 3c:fd:fe:ca:4e:c1 (auto-40g_lr4-fd-up) QSFP Vendor: AOI >>> unsupported sfp, port does not come online QSFP Part Number: AQOLBCQ4EDMA0878 QSFP Serial Number: 89418H15801 Device Type: XL710(0x1583) B1 (BSD99), PBA J27441-000 Firmware Version: fw 5.20 nvm 5.05 etid 8000a7f8 Serial Number: 3CFDFECA4EC0
- Bouncing the switch port does not bring the ports up.
- Power cycle of the node does not bring the ports up.