Inbound packet errors warning observed after converting to switched cluster

Last updated
Save as PDF
Share
1. Share
2. Tweet
3. Share

Views:: 850

Visibility:: Public

Votes:: 3

Category:: aff-series

Specialty:: hw

Last Updated:

Applies to

AFF A800
ONTAP 9.8P7
Cisco Nexus 9336 cluster network switches
Cisco Nexus 3132 cluster network switches
Dual 40/100G Ethernet T62100 network interface card (NIC)

Issue

After conversion from switchless to switched cluster configuration errors such as the below can be observed for the newly added switches

Jan 31, 2022 16:33:19 +0100 HA Group Notification (Health Monitor process cshm: ClusterIfOutErrorsWarn_Alert[switch-01(XXXXXXXXXXX)/Ethernet1/10]) ALERT

Jan 31, 2022 18:48:19 +0100 HA Group Notification (Health Monitor process cshm: ClusterIfIslDownWarn_Alert[switch-01(XXXXXXXXXXX)/Ethernet1/35]) ALERT

This can be confirmed from the health alerts as well

Cluster::> system health alert show

               Node: node-01
           Resource: Ethernet1/10
           Severity: Major
    Indication Time: Tue Feb 15 16:34:10 2022
           Suppress: false
        Acknowledge: false
     Probable Cause: The percentage of inbound packet errors of switch interface
                     "switch-01(XXXXXXXXXXX)/Ethernet1/10" is
                     above the warning threshold.

CRC errors can be observed on all cluster network- and switch-side ports

Cluster::> system node run -node <node name> -command ifstat -a

-- interface  e0a  (19 hours, 40 minutes, 32 seconds) --

RECEIVE
 Total frames:     5041k | Frames/second:      71  | Total bytes:      1504m
 Bytes/second:    21244  | Total errors:       99  | Errors/minute:       0
 Total discards:      0  | Discards/minute:     0  | Multi/broadcast: 31388
 Non-primary u/c:     0  | CRC errors:         74  | Long frames:        25
 Jabber:              0  | Length errors:       0  | No buffer:           0
 Pause:               0  | Jumbo:             129k | Error symbol:        0
 Bus overruns:        0  | LRO segments:     4851k | LRO bytes:        1352m
 LRO6 segments:       0  | LRO6 bytes:          0  | Bad UDP cksum:       0
 Bad UDP6 cksum:      0  | Bad TCP cksum:     165  | Bad TCP6 cksum:      0
 Mcast v6 solicit:    0  | Lagg errors:         0  | Lacp errors:         0
 Lacp PDU errors:     0

Switch-01# show interface <interface name>

Ethernet1/10 is up
admin state is up, Dedicated Interface
  Hardware: 1000/10000/25000/40000/50000/100000 Ethernet, address: XXXX.XXXX.XXXX (bia XXXX.XXXX.XXXX)
  MTU 9216 bytes, BW 100000000 Kbit , DLY 10 usec
  reliability 255/255, txload 1/255, rxload 1/255
  Encapsulation ARPA, medium is broadcast


   RX
    11846294 unicast packets  8431 multicast packets  5847 broadcast packets
    11881885 input packets  5043515271 bytes
    527370 jumbo packets  0 storm suppression bytes
    0 runts  0 giants  21313 CRC  0 no buffer
    21313 input error  0 short frame  0 overrun   0 underrun  0 ignored
    0 watchdog  0 bad etype drop  0 bad proto drop  0 if down drop
    0 input with dribble  0 input discard
    0 Rx pause

Changing SFPs and cables attached to these ports does not help