Skip to main content
NetApp Knowledge Base

Disk redundancy failed for disk with one path only on NVMe shelf

  1. Last updated
  2. Save as PDF
Views:
2,758
Visibility:
Public
Votes:
1
Category:
fas-systems
Specialty:
hw
Last Updated:

Applies to

  • All Flash Fas (AFF)
  • NS224 shelf
  • A800 internal shelf

Issue

  • An expansion card and a NS224 shelf were added to an HA-pair
  • Cabling is found to be correct
  • All disks are added to the disk inventory
  • Call home for DISK REDUNDANCY FAILED Auto Support alert is seen right after
  • System Storage Configuration shows Mixed-Path HA
  • EMS shows
Wed Nov 10 11:22:31 +0100 [Node-01: rshd_0: shelf.config.tomixedha:notice]: System has transitioned to a mixture of single, multi-path or quad-path storage configurations.

Wed Nov 10 11:22:31 +0100 [Node-02: rshd_0: shelf.config.tomixedha:notice]: System has transitioned to a mixture of single, multi-path or quad-path storage configurations.
  • Both nodes report the disk only on one path.

Example:

 ClusterA::> run -node Node-01 sysconfig -a

   shows for for each node/path:

    NetApp Release 9.9.1P3: Wed Sep 29 09:06:45 EDT 2021
	System ID: 0537412960 (Node-01); partner ID: 0537412973 (Node-02)
	System Serial Number: xxxxxx (Node-01)
	System Rev: A6
	System Storage Configuration: Mixed-Path HA
 
slot 1: 100G Ethernet Controller CX6-Mezz
 
e1a MAC Address:    xx:xx:xx:xx:xx:2e (auto-100g_cr4-fd-up)
 
QSFP Vendor:         Molex
QSFP Part Number:    112-00574
QSFP Serial Number:  93A2117520794
11.2.0: NETAPP   X4010S17331T9NTE NA51 1831.1GB 4160B/sect (S60PNA0R301728)
11.2.1: NETAPP   X4010S17331T9NTE NA51 1831.1GB 4160B/sect (S60PNA0R301733)
11.2.2: NETAPP   X4010S17331T9NTE NA51 1831.1GB 4160B/sect (S60PNA0R301717)
11.2.20: NETAPP   X4010S17331T9NTE NA51 1831.1GB 4160B/sect (S60PNA0R301716)
11.2.21: NETAPP   X4010S17331T9NTE NA51 1831.1GB 4160B/sect (S60PNA0R301736)
11.2.22: NETAPP   X4010S17331T9NTE NA51 1831.1GB 4160B/sect (S60PNA0R301738)
11.2.23: NETAPP   X4010S17331T9NTE NA51 1831.1GB 4160B/sect (S60PNA0R301730)
Shelf 11: NS224NSM100  Firmware rev. NSM100 A: 0141  NSM100 B: 0141
 
e1b MAC Address:    xx:xx:xx:xx:xx:xx (auto-100g_cr4-fd-up)
 
QSFP Vendor:         Molex
QSFP Part Number:    112-00574
QSFP Serial Number:  93A2117520700
11.1.0: NETAPP   X4010S17331T9NTE NA51 1831.1GB 4160B/sect (S60PNA0R301728)
11.1.1: NETAPP   X4010S17331T9NTE NA51 1831.1GB 4160B/sect (S60PNA0R301733)
11.1.2: NETAPP   X4010S17331T9NTE NA51 1831.1GB 4160B/sect (S60PNA0R301717)
11.1.20: NETAPP   X4010S17331T9NTE NA51 1831.1GB 4160B/sect (S60PNA0R301716)
11.1.22: NETAPP   X4010S17331T9NTE NA51 1831.1GB 4160B/sect (S60PNA0R301738) 11.2.21 missing here11.1.23: NETAPP   X4010S17331T9NTE NA51 1831.1GB 4160B/sect (S60PNA0R301730)
Shelf 11: NS224NSM100  Firmware rev. NSM100 A: 0141  NSM100 B: 0141
 
  • In the storage shelf show info we see that one link is incorrectly initialized and the port is disabled

Example:

cluster1::> storage shelf show

Shelf name:    0x.shelf11
Shelf id:      11
Channel:       0x
Module:        A
Shelf UID:     00:a0:xx:xx:xx:xx:xx:xx
Shelf S/N:     SHFHUxxxxxxxxx
Term switch:   N/A
Shelf state:   ONLINE
Module state:  OK

                 Device       Port         Negotiated    Medium       Device       Port          Negotiated   Received                                              
Disk   Port      Max Link     Max Link     Link          Max Link     Max Lane     Max Lane      Lane         Error        Bad TLP      Bad DLLP     Uncorrectable  Correctable
Id     State     Speed        Speed        Speed         Speed        Width        width         width        Count        Count        Count        Errors         Errors
                 (GT/s)       (GT/s)       (GT/s)        (GT/s)
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
(...)
[  20] OK        8.0          8.0          8.0           8.0          4            2            2             0            0            0            0              8192           
[  21] DIS/DLL   8.0          8.0          2.5           8.0          4            2            0             0            0            0            0              8193           
[  22] OK        8.0          8.0          8.0           8.0          4            2            2             0            0            0            0              0              
[  23] OK        8.0          8.0          8.0           8.0          4            2            2             0            0

Sign in to view the entire content of this KB article.

New to NetApp?

Learn more about our award-winning Support

NetApp provides no representations or warranties regarding the accuracy or reliability or serviceability of any information or recommendations provided in this publication or with respect to any results that may be obtained by the use of the information or observance of any recommendations provided herein. The information in this document is distributed AS IS and the use of this information or the implementation of any recommendations or techniques herein is a customer's responsibility and depends on the customer's ability to evaluate and integrate them into the customer's operational environment. This document and the information contained herein may be used solely in connection with the NetApp products discussed in this document.