Skip to main content
NetApp Knowledge Base

CRC Errors on XL710 40GbE ports after ONTAP reboot

Views:
1,294
Visibility:
Public
Votes:
0
Category:
ontap-9
Specialty:
core
Last Updated:

Applies to

  • ONTAP 9
  • 10/40 Gigabit Ethernet Controller XL710 network port
    • X91440A Ethernet module
    • X1144A Ethernet NIC (PCIe)
    • AFF A700s onboard Ethernet ports
  • Frontend 40G switches like Cisco Nexus or similar

Issue

  • A storage system has 10/40 Gigabit Ethernet Controller XL710 network ports connected to a 40G switches (e.g. Cisco Nexus 9336C-FX2)
  • After an ONTAP reboot or upgrade, the node with XL710-based 40 Gigabit Ethernet cluster ports reports Cluster Network Degraded events. Example:
[node1: vifmgr: callhome.clus.net.degraded:alert]: Call home for CLUSTER NETWORK DEGRADED: CRC Errors Detected - High CRC errors detected on port e8a node node1
[node1: vifmgr: vifmgr.cluscheck.hwerrors:alert]: Port e8a on node node1 is reporting a high number (at least 1 per 1000 packets) of observed hardware errors (CRC, length, alignment, dropped).
  • 40GbE ports (used for cluster or front-end data) are reporting CRC errors in the RECEIVE section of the ifstat command. Example

::> system node run -node <node_name> -command ifstat e8a
-- interface e8a (0 hours, 5 minutes, 31 seconds) --
RECEIVE
Total frames: 23634 | Frames/second: 71 | Total bytes: 2019k
Bytes/second: 6100 | Total errors: 18292 | Errors/minute: 3316
Total discards: 0 | Discards/minute: 0 | Multi/broadcast: 92
Non-primary u/c: 0 | CRC errors: 16978 | Runt frames: 0
Fragment: 0 | Long frames: 0 | Jabber: 1
Length errors: 0 | No buffer: 0 | Xon: 0
Xoff: 0 | Pause: 0 | Jumbo: 0
Noproto: 0 | Error symbol: 0 | Illegal symbol: 1313
Bus overruns: 0 | Queue drops: 0 | LRO segments: 20456
LRO bytes: 1707k | LRO6 segments: 0 | LRO6 bytes: 0
Bad UDP cksum: 0 | Bad UDP6 cksum: 0 | Bad TCP cksum: 0
Bad TCP6 cksum: 0 | Mcast v6 solicit: 0 | Lagg errors: 0
Lacp errors: 0 | Lacp PDU errors: 0

After some hours/days

-- interface e8a (4 days, 3 hours, 24 minutes, 3 seconds) --
RECEIVE
Total frames: 19227k | Frames/second: 54 | Total bytes: 2006m
Bytes/second: 5607 | Total errors: 19949k | Errors/minute: 3345
Total discards: 0 | Discards/minute: 0 | Multi/broadcast: 64901
Non-primary u/c: 0 | CRC errors: 18677k | Runt frames: 0
Fragment: 0 | Long frames: 0 | Jabber: 250
Length errors: 0 | No buffer: 0 | Xon: 0
Xoff: 0 | Pause: 0 | Jumbo: 0
Noproto: 0 | Error symbol: 0 | Illegal symbol: 1271k
Bus overruns: 0 | Queue drops: 0 | LRO segments: 17554k
LRO bytes: 1805m | LRO6 segments: 0 | LRO6 bytes: 0
Bad UDP cksum: 0 | Bad UDP6 cksum: 0 | Bad TCP cksum: 0
Bad TCP6 cksum: 0 | Mcast v6 solicit: 0 | Lagg errors: 0
Lacp errors: 0 | Lacp PDU errors: 0

  • The 40GbE port link might be flapping or might subsequently go down.

Sign in to view the entire content of this KB article.

New to NetApp?

Learn more about our award-winning Support

NetApp provides no representations or warranties regarding the accuracy or reliability or serviceability of any information or recommendations provided in this publication or with respect to any results that may be obtained by the use of the information or observance of any recommendations provided herein. The information in this document is distributed AS IS and the use of this information or the implementation of any recommendations or techniques herein is a customer's responsibility and depends on the customer's ability to evaluate and integrate them into the customer's operational environment. This document and the information contained herein may be used solely in connection with the NetApp products discussed in this document.
  • Was this article helpful?