CONTAP-524989: Newly installed drives are showing up as broken in ONTAP 9.15.1 or lower
Issue
- Unable to assign new drives added to a storage system.
- This happens when using drives shipped in an ONTAP 9.16+ system, but connected to a 9.15 or earlier storage.
- If the drives are forcedly added a PANIC can be triggered. Example:
PANIC : aggr aggr_name: raid volfsm, fatal multi-disk error...
- DISK-PARTITION-OWNERSHIP AutoSupport section reports system IDs for other nodes not in this cluster. Example:
::> storage disk show -disk 1.0.1 -partition-ownership
Disk Partition Home Owner Home ID Owner ID
-------- --------- ----------------- ----------------- ----------- -----------
1.0.1 Container node_name node_name 123456789 123456789
Root 999999999 999999999
Data1 node_name node_name 123456789 123456789
Data2 node_name node_name 123456789 123456789- The newly installed disk might show up as failed / broken with a "bad label" version mismatch.
- When this issue happens, the disk may be moved to the "Broken disks" pool and be reported as below under SYSCONFIG-R AutoSupport section. Example:
Broken disks
RAID Disk Device HA SHELF BAY CHAN Pool Type RPM ...
------------- ----------- --- ---- ---- ----- ---- ---- ---- ...
label version 0a.0.1P1 0a 0 1 SA:B 0 SSD N/A ...
label version 0a.0.1P2 0a 0 1 SA:B 0 SSD N/A ...
label version 0a.0.1P3 0a 0 1 SA:B 0 SSD N/A ...
label version 0a.0.1 0a 0 1 SA:B 0 SSD N/A ...or
bad label 0a.0.1 0a 0 1 ...
bad label 0a.0.2 0a 0 2 ...
bad label 0a.0.3 0a 0 3 ...- And the following events will be reported in the ONTAP Event Messaging System (EMS) logs, Example:
... [node_name: config_thread: raid.assim.disk.badlabelversion:alert]: Disk 11d.10.6P3 Shelf 10 Bay 6 [NETAPP X357_KPM7V3T8ATE NA51] S/N [...] UID [...] has RAID label with version (17), which is not within the currently supported range (5 - 16).
... [node_name: config_thread: raid.config.filesystem.disk.bad.label.version:notice]: File system Disk 11d.10.6 Shelf 10 Bay 6 [NETAPP X357_KPM7V3T8ATE NA51] S/N [...] UID [...] has an unsupported label version.
... [node_name: raidarea_thread: raid.label.raidarea.invalidType:debug]: params: {'disk_info': 'Disk 11d.10.6P1 Shelf 10 Bay 6 [NETAPP X357_KPM7V3T8ATE NA51] S/N [...] UID [...]', 'expectedType': 'RAIDAREA_TYPE_TOC', 'actualType': 'RAIDAREA_TYPE_TOC', 'expectedSize': '544', 'actualSize': '568', 'shelf': '10', 'bay': '6', 'vendor': 'NETAPP ', 'model': 'X357_KPM7V3T8ATE', 'firmware_revision': 'NA51', 'serialno': '...', 'disk_type': '5', 'disk_rpm': 'N/A', 'carrier': '', 'site': 'Local'}- ONTAP EMS output when attempted a drive assignment. Example:
... [node_name: config_thread: raid.disk.unfail.reassim:info]: Disk 11d.10.6P3 Shelf 10 Bay 6 [...] was unfailed, and is now being reassimilated- It is possible the above errors may not be reported immediately and may only show up when trying to add them to an aggregate.