LACP not working due to LACPDUs not incrementing
Applies to
- Ontap 9.3 and above
- Multimode LACP
Issue
- Physical ports are up but IFGRPs are showing down.
- IFGRP showing down both ports, example:
Cluster::> network port ifgrp show
Port Distribution Active
Node ifgrp Function MAC Address Ports Ports
------ ------- ------------ -------------- ------- ---------------
node0 a0a ip 02:a0:98:11:22:33 none e0c
- LACPDUs not incrementing
Note: This counter was added to ifconfig -v
in ONTAP 9.3
::> system node run -node <node> -command ifconfig -v
a0a: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 9000
options=6407bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
ether 02:a0:98:11:22:33
media: Ethernet autoselect
status: active
groups: lagg
laggproto lacp lagghash l3
lagg options:
flags=11<USE_FLOWID,LACP_STRICT>
flowid_shift: 16
lagg statistics:
active ports: 0 <-- No ports active in the ifgrp
flapping: 0
lag id: [(8000,02-A0-98-11-22-33,0032,0000,0000),
(8000,AA-BB-CC-DD-EE-FF,0037,0000,0000)]
laggport: e0d flags=1c<ACTIVE,COLLECTING,DISTRIBUTING> state=3d<ACTIVITY,AGGREGATION,SYNC,COLLECTING,DISTRIBUTING>
[(8000,02-A0-98-11-22-33,0032,8000,0006),
(8000,AA-BB-CC-DD-EE-FF,0037,8000,00B9)]
input/output LACPDUs: 0 / 14099<--- LACPDU count, this should increment over time
laggport: e0c flags=18<COLLECTING,DISTRIBUTING> state=3d<ACTIVITY,AGGREGATION,SYNC,COLLECTING,DISTRIBUTING>
[(8000,02-A0-98-11-22-33,0032,8000,0007),
(8000,AA-BB-CC-DD-EE-FF,0037,8000,043A)]
input/output LACPDUs: 0 / 14099<--- LACPDU count, this should increment over time
- Wait 2 minutes and run it again to validate if LACPDUs incrementing
a0a: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 9000
options=6407bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
ether 02:a0:98:11:22:33
media: Ethernet autoselect
status: active
groups: lagg
laggproto lacp lagghash l3
lagg options:
flags=11<USE_FLOWID,LACP_STRICT>
flowid_shift: 16
lagg statistics:
active ports: 0 <-- No ports active in the ifgrp
flapping: 0
lag id: [(8000,02-A0-98-11-22-33,0032,0000,0000),
(8000,AA-BB-CC-DD-EE-FF,0037,0000,0000)]
laggport: e0d flags=1c<ACTIVE,COLLECTING,DISTRIBUTING> state=3d<ACTIVITY,AGGREGATION,SYNC,COLLECTING,DISTRIBUTING>
[(8000,02-A0-98-11-22-33,0032,8000,0006),
(8000,AA-BB-CC-DD-EE-FF,0037,8000,00B9)]
input/output LACPDUs: 0 / 14539<--- LACPDU count, this should increment over time
laggport: e0c flags=18<COLLECTING,DISTRIBUTING> state=3d<ACTIVITY,AGGREGATION,SYNC,COLLECTING,DISTRIBUTING>
[(8000,02-A0-98-11-22-33,0032,8000,0007),
(8000,AA-BB-CC-DD-EE-FF,0037,8000,043A)]
input/output LACPDUs: 0 /14539<--- LACPDU count, this should increment over time
- Physical link connectivity confirmed.
- Tried to remove the ports from ifgrp and re-added the ports still ifgrp is showing down.
- Toggled the physical ports still the status is same.
- Below link down messages are seen in EMS logs.
Sun Nov 12 11:37:16 -0800 [node-01: intr: netif.linkDown:info]: Ethernet a0a: Link down, check cable.
Sun Nov 12 11:37:16 -0800 [node-01: intr: netif.linkDown:info]: Ethernet a0a-1x4: Link down, check cable.
Sun Nov 12 11:37:16 -0800 [node-01: intr: netif.linkDown:info]: Ethernet a0a-1x7: Link down, check cable.
Sun Nov 12 11:37:16 -0800 [node-01: intr: netif.linkDown:info]: Ethernet a0a-1x9: Link down, check cable.
Sun Nov 12 11:37:16 -0800 [node-01: vifmgr: vifmgr.portdown:notice]: A link down event was received on node node-01, port a0a.
Sun Nov 12 11:37:16 -0800 [node-01: vifmgr: vifmgr.portdown:notice]: A link down event was received on node node-01, port a0a-1x4.
Sun Nov 12 11:37:16 -0800 [node-01: vifmgr: vifmgr.portdown:notice]: A link down event was received on node node-01, port a0a-1x7.
Sun Nov 12 11:37:16 -0800 [node-01: vifmgr: vifmgr.portdown:notice]: A link down event was received on node node-01, port a0a-1x9.