SP upgrade fails: new image is set to backup and booting to backup image fails
Applies to
- ONTAP 9
- AFF A300, AFF A200, FAS8200, FAS2650, FAS2620
- Service Processor (SP)
Issue
- SP upgrade process started but not completed, with the newer version in the backup image. Example:
Primary firmware version 5.6P2
Backup firmware version 5.10
- Unable to re-flash and/or boot the backup image.
- SP manual update is still not progressing in ONTAP nor SP CLI with a forced backup image flash
SP events:
Record 1310: Thu Oct 27 06:51:01 2022 [Fud.normal]: retcode 110, Error Flashing JFFS2 image
Record 1442: Thu Nov 10 09:18:16 2022 [Fud.normal]: retcode 103, Metadata info not present int primary
Record 1471: Tue Nov 15 12:04:58 2022 [SP.emergency]: Reset by Ontap
Record 1472: Thu Jan 1 00:00:44 1970 [IPMI.notice]: 6f01 | c0 | OEM: ffff70005200 | ManufId: 150300 | SP Reset Due to Panic
Record 1473: Thu Jan 1 00:00:44 1970 [IPMI.notice]: 7001 | c0 | OEM: fcff70da0000 | ManufId: 150300 | POS Register: Kernel Panic
EMS logs:
Tue Nov 15 13:09:36 +0100 [defeufas01mc-01: spsm_listener: callhome.sp.hbt.missed:notice]: Call home for SP HBT MISSED
Tue Nov 15 13:13:58 +0100 [defeufas01mc-01: servprocd: sp.firmware.incompatible:alert]: The SP firmware version 5.6P2 is not compatible with this version of Data ONTAP.
Tue Nov 15 13:34:45 +0100 [defeufas01mc-01: servprocd: sp.servprocd.upd.evts:debug]: params: {'reason': 'SP Firmware network update from 5.6P2 to 5.10 has been triggered.'}
Tue Nov 15 13:35:01 +0100 [defeufas01mc-01: servprocd: sp.servprocd.upd.evts:debug]: params: {'reason': 'SP firmware image has been successfully transferred to SP using network interface.'}
Tue Nov 15 13:35:28 +0100 [defeufas01mc-01: servprocd: sp.servprocd.upd.unexpt.evts:debug]: params: {'reason': 'Unable to successfully update SP firmware using network interface'}
Tue Nov 15 13:35:29 +0100 [defeufas01mc-01: servprocd: sp.servprocd.upd.error:error]: SP update error: SP firmware update failure has been detected.
Tue Nov 15 13:36:31 +0100 [defeufas01mc-01: servprocd: sp.servprocd.upd.evts:debug]: params: {'reason': 'SP Firmware network update has been successfully scheduled from 5.6P2 to 5.10'}
- The issue remains after a SP reset and
servprocd
service restart in ONTAP - The issue remains after a node reboot