One controller not responding during upgrade
Applies to
- FAS2650
- DS212C Disk shelf
- ONTAP upgrade
Issue
- Controller not responding during upgrade
- Boot process hangs with message
Entering FM state:5 because mbFound:0 local inheadswap:0
- Eventually, controller reboots due to no root volume found
WARNING: there do not appear to be any disks attached to the system.
No root volume found.
Rebooting... (press ctrl-c during boot to break reboot loop)
Uptime: 6m10s
System rebooting...
- No disks can be seen in maintenance mode
*> disk show -v
Local System ID: 123456789
disk show: No disks attached to system.
- Shelves and disks information is missing from SAS adapters in maintenance mode
slot 0: SAS Host Adapter 0a (PMC-Sierra PM8070 rev. C, SAS, <UP>)
Firmware rev: 03.08.09.00
Base WWN: 5:00a098:00aec1a:30
Temperature: Not Available
Phy State: [0] Enabled, 12.0 Gb/s
[1] Enabled, 12.0 Gb/s
[2] Enabled, 12.0 Gb/s
[3] Enabled, 12.0 Gb/s
Mini-SAS HD Vendor: Amphenol
Mini-SAS HD Part Number: X66032A+A0
Mini-SAS HD Type: Passive Copper (unequalized) 2m ID:01
Mini-SAS HD Serial Number: APF16340162481
slot 0: SAS Host Adapter 0b (PMC-Sierra PM8070 rev. C, SAS, <UP>)
Firmware rev: 03.08.09.00
Base WWN: 5:00a098:00aec1a:34
Temperature: Not Available
Phy State: [4] Enabled, 12.0 Gb/s
[5] Enabled, 12.0 Gb/s
[6] Enabled, 12.0 Gb/s
[7] Enabled, 12.0 Gb/s
sasadmin expander_map
shows correct cabling for adapter 0b but corrupted information for adapter 0a (e.g. missing shelf serial number)
Expanders on channel 0a:
Level 0: WWN 500a098007cb4815, ID 0, Serial Number ' ', Product '', Rev '', Slot A
Level 1: WWN 500a098007cb47b5, ID 0, Serial Number ' ', Product '', Rev '', Slot A
Expanders on channel 0b:
Level 1: WWN 500a09800aec1a3f, ID 0, Serial Number ' SHFHU1736000204', Product 'DS22412IOM12E ', Rev '0230', Slot A
Level 2: WWN 500a098007cb4811, ID 2, Serial Number ' SHFHU1739000214', Product 'DS22412IOM12A ', Rev '0281', Slot A
Level 3: WWN 500a098007cb47a5, ID 1, Serial Number ' SHFHU1739000215', Product 'DS22412IOM12A ', Rev '0281', Slot A
- Removing the SAS cable from adapter 0a allows the system to see disks again and boot
- Reseating/replacing IOM module and SAS cable do not solve the issue