PANIC: Upgrade unsupported from release 9.7 to release 9.10 in SK process rc on release 9.10.1P3
Applies to
- ONTAP 9
- FAS System Upgrade(Headswap)
Issue
- Task is using Upgrade by moving storage method to upgrade FAS system(Headswap)
- As part of headswap procedure, target FAS8700 HA system downgraded from ONTAP 9.10.1P3 to ONTAP 9.7P20
- After downgrade, subsequent reboot failed with
PANIC: Upgrade unsupported from release 9.7 to release 9.10 in SK process rc on release 9.10.1P3 (C) on Sun Dec 18 06:28:38 GMT 2022
- Image2 has been set as default image
::*> node image show
Is Is Install
Node Image Default Current Version Date
-------- ------- ------- ------- ------------------------- -------------------
localhost
image1 false false 9.10.1P3 9/23/2022 21:40:08
image2 true true 9.7P20 12/18/2022 07:12:34
2 entries were displayed.
- Reboot console
LOADER-B> boot_ontap menu
Loading X86_64/freebsd/image2/kernel:0x200000/1093750 0x30c000/10963136 0xf81000/3786424 0x131d6b8/13718536 0x200200/1016 Entry at 0xffffffff8030c000
Loading X86_64/freebsd/image2/platform.ko:0x2033000/4413152 0x24686e0/596216
Starting program at 0xffffffff8030c000
NetApp Data ONTAP 9.7P20
arc4random: no preloaded entropy cache
ena_rss_init_default_deferred() [TID:100000]: No devclass ena
Dec 18 14:17:27 Battery charge capacity: 1200 mA*hr. Power outage protection flash de-staging cycles: 14
The boot device has changed. System configuration information
could be lost. Use option (6) to restore the system configuration, or
option (4) to initialize all disks and setup a new system.
Normal Boot is prohibited.
Please choose one of the following:
(1) Normal Boot.
(2) Boot without /etc/rc.
(3) Change password.
(4) Clean configuration and initialize all disks.
(5) Maintenance mode boot.
(6) Update flash from backup config.
(7) Install new software first.
(8) Reboot node.
(9) Configure Advanced Drive Partitioning.
Selection (1-9)? 6
This will replace all flash-based configuration with the last backup to
disks. Are you sure you want to continue?: yes
Dec 18 14:20:18 [localhost:cf.ic.xferTimedOut:error]: HA interconnect: OFW transfer timed out.
Dec 18 14:20:19 [localhost:cf.fm.notkoverClusterDisable:error]: Failover monitor: takeover disabled (restart)
Dec 18 14:20:19 [localhost:cf.hwassist.invalidConfig:notice]: Invalid hardware-assist configurations. IPv4: xxx.xxx.xxx.xxx IPv6: port: 4444 keep_alive_interval: 180
Dec 18 14:20:20 [localhost:cf.fsm.backupMailboxError:error]: Failover monitor: partner mailbox error detected.
Dec 18 14:20:20 [localhost:cf.fsm.takeoverOfPartnerDisabled:error]: Failover monitor: takeover of node-01 disabled (Controller Failover takeover disabled).
Dec 18 14:20:21 [localhost:kern.syslog.msg:notice]: The system was down for 36158 seconds
boot_from_disk:last_booted_OS:9.10.1P3
varfs_backup_restore: bootarg.abandon_varfs is set! Skipping /var backup.
varfs_backup_restore: update checksum for varfs.tgz
varfs_backup_restore: restore using /mroot/etc/varfs.tgz
varfs_backup_restore: attempting to restore /var/kmip to the boot device
varfs_backup_restore: failed to restore /var/kmip to the boot device
varfs_backup_restore: attempting to restore env file to the boot device
varfs_backup_restore: successfully restored env file to the boot device
varfs_backup_restore: bootarg.abandon_varfs is set! Skipping /var backup.
wrote key file "/tmp/rndc.key"
varfs_backup_restore: bootarg.abandon_varfs is set! Skipping /var backup.
Dec 18 14:21:00 [localhost:monitor.globalStatus.critical:EMERGENCY]: Controller failover of node-01 is not possible: Controller Failover takeover disabled.
Sun Dec 18 14:21:54 UTC 2022
login: varfs_backup_restore: Rebooting to load the new varfs
Terminated
.
varfs_backup_restore: bootarg.abandon_varfs is set! Skipping /var backup.
Uptime: 5m9s
BIOS Version: 16.7
PEI start.
CPU PEI initialization.
Wait BMC self-test result.
BMC self-test: OK.
UPI initialization.
CPU initialization.
Running full memory initialization.
SPI FLASH: Primary BIOS
PEI end.
DXE start.
USB initialization.
PCI host bridge initialization.
CSM initialization.
PCI Bus initialization start.
BDS start.
Console output devices connect.
Memory Size : 278528 MB
Ready to boot.
Boot Loader version 6.4.13
Copyright (C) 2000-2003 Broadcom Corporation.
Portions Copyright (C) 2002-2022 NetApp, Inc. All Rights Reserved.
ACPI RSDP Found at 0x6cc21000
Starting AUTOBOOT press Ctrl-C to abort...
Loading X86_64/freebsd/image2/kernel:0x200000/1093750 0x30c000/10963136 0xf81000/3786424 0x131d6b8/13718536 0x200200/1016 Entry at 0xffffffff8030c000
Loading X86_64/freebsd/image2/platform.ko:0x2033000/4413152 0x24686e0/596216
Starting program at 0xffffffff8030c000
NetApp Data ONTAP 9.7P20
arc4random: no preloaded entropy cache
ena_rss_init_default_deferred() [TID:100000]: No devclass ena
Copyright (C) 1992-2022 NetApp.
All rights reserved.
Restoring env file from boot media...
copy_env_file:scenario = head upgrade
Successfully restored env file from boot media...
Rebooting to load the restored env file...
Uptime: 5s
BIOS Version: 16.7
PEI start.
CPU PEI initialization.
Wait BMC self-test result.
BMC self-test: OK.
UPI initialization.
CPU initialization.
Running full memory initialization.
SPI FLASH: Primary BIOS
PEI end.
DXE start.
USB initialization.
PCI host bridge initialization.
CSM initialization.
PCI Bus initialization start.
BDS start.
Console output devices connect.
Memory Size : 278528 MB
Ready to boot.
Boot Loader version 6.4.13
Copyright (C) 2000-2003 Broadcom Corporation.
Portions Copyright (C) 2002-2022 NetApp, Inc. All Rights Reserved.
ACPI RSDP Found at 0x6cc21000
Starting AUTOBOOT press Ctrl-C to abort...
Loading X86_64/freebsd/image1/kernel:0x200000/1163120 0x31c000/10687120 0xf4d290/3994896 0x131c7a0/3896968 0x200240/1016 Entry at 0xffffffff8031c000
Loading X86_64/freebsd/image1/platform.ko:0x16d4000/4204080 0x1ad6630/637728
Starting program at 0xffffffff8031c000
---<<BOOT>>---
NetApp Data ONTAP 9.10.1P3
WARNING: System ID mismatch. This usually occurs when replacing a boot device or NVRAM cards!
Override system ID? {y|n} y
Running the upgrade system
bootarg.upgrade="true"
bootarg.from.version="9.7P20"
bootarg.to.version="Stormking__9.10.1"
dd: /mroot/etc/entropy-file: Read-only file system
FWU has no post firmware update action registered.
PANIC : Upgrade unsupported from release 9.7 to release 9.10
version: 9.10.1P3: Tue Apr 19 13:44:44 EDT 2022
conf : x86_64.optimize
cpuid = 0
Uptime: 2m54s
ahcich2: AHCI reset done: devices=00000001
PANIC: Upgrade unsupported from release 9.7 to release 9.10 in SK process rc on release 9.10.1P3 (C) on Sun Dec 18 06:28:34 GMT 2022
version: 9.10.1P3: Tue Apr 19 13:44:44 EDT 2022
- Another panic message:
The boot device has changed. System configuration information
could be lost. Use option (6) to restore the system configuration, or
option (4) to initialize all disks and setup a new system.
Normal Boot is prohibited.
Please choose one of the following:
(1) Normal Boot.
(2) Boot without /etc/rc.
(3) Change password.
(4) Clean configuration and initialize all disks.
(5) Maintenance mode boot.
(6) Update flash from backup config.
(7) Install new software first.
(8) Reboot node.
(9) Configure Advanced Drive Partitioning.
Selection (1-9)? 6
This will replace all flash-based configuration with the last backup to
disks. Are you sure you want to continue?: yes
Warning: previous shutdown was dirty, there is a possible loss of data.
Dec 18 08:02:22 [localhost:wafl.root.content.changed:error]: Contents of the root volume '' might have changed. Verify that all recent configuration changes are still in effect.
PANIC : NVRAM contents are invalid...
version: 9.7P20: Thu Aug 11 09:23:52 EDT 2022
conf : x86_64.optimize
cpuid = 0
Uptime: 3m11s
ahcich2: AHCI reset done: devices=00000001
PANIC: NVRAM contents are invalid... in SK process rc on release 9.7P20 (C) on Sun Dec 18 08:02:22 GMT 2022
version: 9.7P20: Thu Aug 11 09:23:52 EDT 2022
compile flags: x86_64.optimize
Writing panic info to HA mailbox disks.
HA: current time (in sk_msecs) 55269 (in sk_cycles) 17120870014206
DUMPCORE: START
Dumping to boot device.