ONTAP upgrade version mismatch and RAID label version error
Applies to
- NetApp ONTAP 9
- ONTAP upgrade from version 9.14.1P10 to 9.16.1P6
- High Availability (HA) configurations
Issue
- During an ONTAP upgrade,
node-01completed the update first, butnode-02was rebooted without being specified to the new version, resulting in a version mismatch. - As a result
Call home for FILESYSTEM DISK BAD LABEL VERSIONAutosupport messages have been observed:
[?] Thu Jul 31 18:48:42 +0900 [node-02: rc: cf.fm.kernelMismatch:error]: Failover monitor: possible kernel mismatch detected local 'NetApp//9.14.1P10', partner 'NetApp//9.16.1P6'
[?] Thu Jul 31 18:48:42 +0900 [node-02: rc: cf.fm.versionMismatch:alert]: Failover monitor: nvram toc version mismatch detected: 47/48
[?] Thu Jul 31 18:48:42 +0900 [node-02: rc: cf.fm.versionMismatch:alert]: Failover monitor: wafl fsinfo version mismatch detected: 51715/56834
[?] Thu Jul 31 18:48:42 +0900 [node-02: rc: cf.fm.versionMismatch:alert]: Failover monitor: nvram nvlog version mismatch detected: 113902478/115213249
[?] Thu Jul 31 18:48:42 +0900 [node-02: rc: cf.fm.versionMismatch:alert]: Failover monitor: raid version mismatch detected: 16/17
[?] Thu Jul 31 18:48:42 +0900 [node-02: rc: cf.fm.versionMismatch:alert]: Failover monitor: raid nvram version mismatch detected: 57/58
[?] Thu Jul 31 18:48:42 +0900 [node-02: rc: ha.partner.dbladeId:debug]: D-blade ID of the partner node is 0258cf8b-d5aa-11ee-88ac-d039eab7a414.
[?] Thu Jul 31 18:48:42 +0900 [node-02: rc: cf.fm.partnerFwState:info]: params: {'state': '6'}
[?] Thu Jul 31 18:48:42 +0900 [node-02: rc: cf.fm.MBstatusOnBoot:info]: params: {'status': '4'}
[?] Thu Jul 31 18:48:42 +0900 [node-02: config_thread: raid.assim.disk.badlabelversion:alert]: Disk 0c.00.7P2 Shelf 0 Bay 7 [NETAPP X388_WPSCE16TA07 NA02] S/N [5EXXXXXXXXX02] UID [6000CCA2:CB157FC0:500A0981:00000002:00000000:00000000:00000000:00000000:00000000:00000000] has RAID label with version (17), which is not within the currently supported range (5 - 16).
[?] Thu Jul 31 18:48:42 +0900 [node-02: config_thread: raid.assim.disk.badlabelversion:alert]: Disk 0b.00.6P2 Shelf 0 Bay 6 [NETAPP X388_WPSCE16TA07 NA02] S/N [5EXXXXXXXXX02] UID [6000CCA2:CB1542DC:500A0981:00000002:00000000:00000000:00000000:00000000:00000000:00000000] has RAID label with version (17), which is not within the currently supported range (5 - 16).
[?] Thu Jul 31 18:48:42 +0900 [node-02: config_thread: raid.assim.disk.badlabelversion:alert]: Disk 0b.00.10P2 Shelf 0 Bay 10 [NETAPP X388_WPSCE16TA07 NA02] S/N [5EXXXXXXXXX02] UID [6000CCA2:CB154428:500A0981:00000002:00000000:00000000:00000000:00000000:00000000:00000000] has RAID label with version (17), which is not within the currently supported range (5 - 16).
[?] Thu Jul 31 18:48:42 +0900 [node-02: config_thread: raid.assim.disk.badlabelversion:alert]: Disk 0b.00.8P2 Shelf 0 Bay 8 [NETAPP X388_WPSCE16TA07 NA02] S/N [5EXXXXXXXXX02] UID [6000CCA2:CB154550:500A0981:00000002:00000000:00000000:00000000:00000000:00000000:00000000] has RAID label with version (17), which is not within the currently supported range (5 - 16).
[?] Thu Jul 31 18:48:42 +0900 [node-02: config_thread: raid.assim.disk.badlabelversion:alert]: Disk 0c.00.9P2 Shelf 0 Bay 9 [NETAPP X388_WPSCE16TA07 NA02] S/N [5EXXXXXXXXX02] UID [6000CCA2:CB158448:500A0981:00000002:00000000:00000000:00000000:00000000:00000000:00000000] has RAID label with version (17), which is not within the currently supported range (5 - 16).
[?] Thu Jul 31 18:48:42 +0900 [node-02: config_thread: raid.assim.tree.noRootVol:error]: No usable root volume was found!
[?] Thu Jul 31 18:48:42 +0900 [node-02: raidarea_thread: raid.label.raidarea.invalidType:debug]: params: {'disk_info': 'Disk 0c.00.11P2 Shelf 0 Bay 11 [NETAPP X388_WPSCE16TA07 NA02] S/N [5EXXXXXXXXX02] UID [6000CCA2:CB158314:500A0981:00000002:00000000:00000000:00000000:00000000:00000000:00000000]', 'expectedType': 'RAIDAREA_TYPE_TOC', 'actualType': 'RAIDAREA_TYPE_TOC', 'expectedSize': '544', 'actualSize': '568', 'shelf': '0', 'bay': '11', 'vendor': 'NETAPP ', 'model': 'X388_WPSCE16TA07', 'firmware_revision': 'NA02', 'serialno': '5EXXXXXXXXX02', 'disk_type': '8', 'disk_rpm': '7200', 'carrier': '', 'site': 'Local'}
[?] Thu Jul 31 18:48:42 +0900 [node-02: config_thread: raid.config.filesystem.disk.bad.label.version:notice]: File system Disk 0c.00.7 Shelf 0 Bay 7 [NETAPP X388_WPSCE16TA07 NA02] S/N [5XXXXXXN] UID [5000CCA2:CB157FC0:00000000:00000000:00000000:00000000:00000000:00000000:00000000:00000000] has an unsupported label version.
[?] Thu Jul 31 18:48:42 +0900 [node-02: config_thread: callhome.fdsk.label.v:error]: Call home for FILESYSTEM DISK BAD LABEL VERSION
[?] Thu Jul 31 18:48:42 +0900 [node-02: config_thread: raid.config.filesystem.disk.bad.label.version:notice]: File system Disk 0b.00.6 Shelf 0 Bay 6 [NETAPP X388_WPSCE16TA07 NA02] S/N [5EXXXXWN] UID [5000CCA2:CB1542DC:00000000:00000000:00000000:00000000:00000000:00000000:00000000:00000000] has an unsupported label version.
[?] Thu Jul 31 18:48:42 +0900 [node-02: config_thread: raid.config.filesystem.disk.bad.label.version:notice]: File system Disk 0b.00.10 Shelf 0 Bay 10 [NETAPP X388_WPSCE16TA07 NA02] S/N [5EXXXXKN] UID [5000CCA2:CB154428:00000000:00000000:00000000:00000000:00000000:00000000:00000000:00000000] has an unsupported label version.
[?] Thu Jul 31 18:48:42 +0900 [node-02: config_thread: raid.config.filesystem.disk.bad.label.version:notice]: File system Disk 0b.00.8 Shelf 0 Bay 8 [NETAPP X388_WPSCE16TA07 NA02] S/N [5EGXXXXN] UID [5000CCA2:CB154550:00000000:00000000:00000000:00000000:00000000:00000000:00000000:00000000] has an unsupported label version.
[?] Thu Jul 31 18:48:42 +0900 [node-02: config_thread: raid.config.filesystem.disk.bad.label.version:notice]: File system Disk 0c.00.9 Shelf 0 Bay 9 [NETAPP X388_WPSCE16TA07 NA02] S/N [5EXXXXYN] UID [5000CCA2:CB158448:00000000:00000000:00000000:00000000:00000000:00000000:00000000:00000000] has an unsupported label version.
[?] Thu Jul 31 18:48:43 +0900 [node-02: cf_firmware: cf.fm.partnerFwTransition:info]: params: {'prevstate': 'SF_OPEN', 'newstate': 'SF_UP', 'progresscounter': '188'}
