DISK REDUNDANCY FAILED: Shelf and disk entries of one path not shows in sysconfig -a of one node after IOM12B shelf expansion

Last updated
Save as PDF
Share
1. Share
2. Tweet
3. Share

Views:: 250

Visibility:: Public

Votes:: 0

Category:: ontap-9

Specialty:: HW

Last Updated:

Applies to

FAS8300
IOM12B shelf expansion

Issue

After added an external IOM12B shelf, SAS path 0d of one node do not show all shelf and disk entries.
- Before shelf expansion:
  - System Storage Configuration: Multi-Path HA slot 0: SAS Host Adapter 0d (Broadcom SAS3616W rev. 2, SAS, <UP>) Firmware rev: 12.00.00.00 NVDATA rev: 12.03.01.03 Base WWN: 5:00a098:00xxxxx:8c Temperature: Not Available Phy State: [0] Enabled, 12.0 Gb/s [1] Enabled, 12.0 Gb/s [2] Enabled, 12.0 Gb/s [3] Enabled, 12.0 Gb/s Mini-SAS HD Vendor: Amphenol Mini-SAS HD Part Number: 112-00437+A0 Mini-SAS HD Type: Passive Copper (unequalized) 2m end_1 Mini-SAS HD Serial Number: APF214xxxxxx83 00.0 : NETAPP X380_WVAXE10TA07 NA01 9324.2GB 520B/sect (VCJL39JP) ... 00.11: NETAPP X380_WVAXE10TA07 NA01 9324.2GB 520B/sect (VCJL78SP) 01.0 : NETAPP X380_WVAXE10TA07 NA01 9324.2GB 520B/sect (VCJL32LP) ... 01.11: NETAPP X380_WVAXE10TA07 NA01 9324.2GB 520B/sect (VCJL663P) Shelf 0: DS212-12 Firmware rev. IOM12 A: 0300 IOM12 B: 0300 Shelf 1: DS212-12 Firmware rev. IOM12 A: 0300 IOM12 B: 0300
- After shelf expansion, all shelf and disk entries are gone. SAS port 0d link up:

System Storage Configuration: Mixed-Path HA slot 0: SAS Host Adapter 0d (Broadcom SAS3616W rev. 2, SAS, <UP>) Firmware rev: 12.00.00.00 NVDATA rev: 12.03.01.03 Base WWN: 5:00a098:00xxxxx:8c Temperature: Not Available Phy State: [0] Enabled, 12.0 Gb/s [1] Enabled, 12.0 Gb/s [2] Enabled, 12.0 Gb/s [3] Enabled, 12.0 Gb/s Mini-SAS HD Vendor: Amphenol Mini-SAS HD Part Number: 112-00439+A0 Mini-SAS HD Type: Passive Copper (unequalized) 5m end_1 Mini-SAS HD Serial Number: APFxxxxxx27440

EMS-FILE-LOG.GZ shows:

Tue Jul 04 16:59:06 +0900 [Node-01: dsa_disc: ses.multipath.ReqError:alert]: SAS disk shelf detected without a multipath configuration. Tue Jul 04 19:45:26 +0900 [Node-01: svc_queue_thread: callhome.dsk.redun.fault:error]: Call home for DISK REDUNDANCY FAILED

Reseat or replaced the cable and the affected IOM module, only shelf 2 entry appeared in SYSCONFIG-A.

slot 0: SAS Host Adapter 0d (Broadcom SAS3616W rev. 2, SAS, <UP>) Firmware rev: 12.00.00.00 NVDATA rev: 12.03.01.03 Base WWN: 5:00a098:00xxxxx:8c Temperature: Not Available Phy State: [0] Enabled, 12.0 Gb/s [1] Enabled, 12.0 Gb/s [2] Enabled, 12.0 Gb/s [3] Enabled, 12.0 Gb/s Mini-SAS HD Vendor: Amphenol Mini-SAS HD Part Number: 112-00439+A0 Mini-SAS HD Type: Passive Copper (unequalized) 5m end_1 Mini-SAS HD Serial Number: APFxxxxxx27440 Shelf 2: DS212-12 Firmware rev. IOM12B A: 0100 IOM12B B: 0100

SAS-Expander sub items shows all paths are normal:
- SAS-EXPANDER-MAP shows:
  - Expanders on channel 0a: Level 1: WWN 500xxxxxxxxxxxa9, ID 0, Serial Number ' SHJxxxxxxxxxx48', Product 'DS21212IOM12A ', Rev '0300', Slot A Level 2: WWN 500xxxxxxxxxxx2d, ID 1, Serial Number ' SHJxxxxxxxxxx49', Product 'DS21212IOM12A ', Rev '0300', Slot A Level 3: WWN 500xxxxxxxxxxxb1, ID 2, Serial Number ' SHJxxxxxxxxxx46', Product 'DS21212IOM12 ', Rev '0100', Slot A ... Expanders on channel 0d: Level 1: WWN 500xxxxxxxxxxxb1, ID 2, Serial Number ' SHJxxxxxxxxxx46', Product 'DS21212IOM12 ', Rev '0100', Slot B Level 2: WWN 500xxxxxxxxxxx35, ID 1, Serial Number ' SHJxxxxxxxxxx49', Product 'DS21212IOM12A ', Rev '0300', Slot B Level 3: WWN 500xxxxxxxxxxx7d, ID 0, Serial Number ' SHJxxxxxxxxxx48', Product 'DS21212IOM12A ', Rev '0300', Slot B
- SAS-EXPANDER-PHY-STATE shows all phy state are normal:

Expander phy state on 0d.2 (NETAPP :DS21212IOM12 SHJxxxxxxxxxx46): Pwr Invald Disprt Loss Phy CRC Phy Pwr Ccl Rsv Rls DWord Error Sync Reset Error Change SATA PHY/BAY STATE ON Cnt Cnt Cnt Count Count Count Prob Cnt Cnt Affiliation ------- ----------------- --- --- --- --- ------ ------ ------ ------ ------ ------ ---------------- 0/P0:0 12.0 Gb/s --- --- --- --- 0 0 0 0 0 1 ---------------- 1/P0:1 12.0 Gb/s --- --- --- --- 0 0 0 0 0 1 ---------------- 2/P0:2 12.0 Gb/s --- --- --- --- 0 0 0 0 0 1 ---------------- 3/P0:3 12.0 Gb/s --- --- --- --- 0 0 0 0 0 1 ---------------- ... 8/P2:0 12.0 Gb/s --- --- --- --- 0 0 0 0 0 15 ---------------- 9/P2:1 12.0 Gb/s --- --- --- --- 0 0 0 0 0 15 ---------------- 10/P2:2 12.0 Gb/s --- --- --- --- 0 0 0 0 0 15 ---------------- 11/P2:3 12.0 Gb/s --- --- --- --- 0 0 0 0 0 15 ---------------- ...

HA partner node is multi-path:

System Storage Configuration: Multi-Path HA