BMC firmware upgrade stuck at 5% and not progressing when SAML enabled

Last updated
Save as PDF
Share
1. Share
2. Tweet
3. Share

Views:: 2,622

Visibility:: Public

Votes:: 0

Category:: ontap-9

Specialty:: HW

Last Updated:

Applies to

All platforms with the e0S interface
ONTAP 9
BMC firmware upgrade

Issue

BMC firmware upgrade from ONTAP is stuck at 5% and not progressing

cluster::> system service-processor image update-progress show In Percent Node Progress Start Time Done End Time ---------------- -------- ------------------- ------- ------------------- clujster1-01 yes 17/10/2022 11:43:07 5 - clujster1-02 no - 0 - 2 entries were displayed.

SP-MGMT-MLOG-TXT.GZ in AutoSupport shows the update starting but getting stuck on unable to get firmware update progress

... 11:43:07 +00:00 [kern_servprocd:info:6569] 0x808ac9b00: 0: NOTICE: Servprocd::SpUpdate: SpUpdateReport: New SP package 13.7 is available on local node.
... 12:02:17 +00:00 [kern_servprocd:info:6569] 0x809428a00: 8003e80000258cf3: NOTICE: Servprocd::SpUpdate: InstallSpPckg: Removing /mroot/etc/RLM_FW
... 12:02:17 +00:00 [kern_servprocd:info:6569] 0x809428a00: 8003e80000258cf3: NOTICE: Servprocd::SpUpdate: InstallSpPckg: Installing /mroot/etc/software/BMC_FW_308-04115_13.7.zip
... 12:02:17 +00:00 [kern_servprocd:info:6569] 0x809428a00: 8003e80000258cf3: NOTICE: Servprocd::SpUpdate: InstallSpPckg: SP firmware package /mroot/etc/software/BMC_FW_308-04115_13.7.zip has been installed.
... 12:02:17 +00:00 [kern_servprocd:info:6569] 0x809428a00: 8003e80000258cf3: ERR: Servprocd::SpUpdate: doPreUpdateChecks: In function - SpCPMIUpdateOp::doPreUpdateChecks()
... 12:02:17 +00:00 [kern_servprocd:info:6569] 0x809428a00: 8003e80000258cf3: NOTICE: Servprocd::SpUpdate: doPreUpdateChecks: BMC update - Pre-update checks passed.
... 12:02:17 +00:00 [kern_servprocd:info:6569] 0x809428a00: 8003e80000258cf3: NOTICE: Servprocd::SpUpdate: UpdateSmfState: processing ck_update_cli_scheduled.
... 12:02:17 +00:00 [kern_servprocd:info:6569] 0x80942cb00: 0: NOTICE: Servprocd::SpUpdate: set_bmc_state_cpmi: updated BMC status - 8.
... 12:02:22 +00:00 [kern_servprocd:info:6569] 0x80942cb00: 0: NOTICE: Servprocd::SpUpdate: servprocd_trigger_fw_update_cpmi: cpmi_set_fw_update_info(16) suceeded.
... 12:02:22 +00:00 [kern_servprocd:info:6569] 0x80942cb00: 0: NOTICE: Servprocd::SpUpdate: update: BMC update has been successfully triggered.
... 12:02:52 +00:00 [kern_servprocd:info:6569] 0x80942cb00: 0: NOTICE: Servprocd::SpUpdate: monitorUpdate: Waiting for BMC update to complete. Monitor count=(0), sleep 30 seconds...
... 12:02:52 +00:00 [kern_servprocd:info:6569] 0x80942cb00: 0: ERR: Servprocd::SpUpdate: servprocd_cpmi_get_fw_update_info: cpmi_get_fw_update_info(0x10) Failed.
... 12:02:52 +00:00 [kern_servprocd:info:6569] 0x80942cb00: 0: ERR: Servprocd::SpUpdate: monitorUpdtPrgrs: unable to get firmware update progress.

APACHE-ACCESS.GZ in AutoSupport will show a 302 return code when the package is attempted to be downloaded

192.0.2.81 192.0.2.84 4294967295/4294967288 - [Mon Dec 05 12:46:48.088423 2022 +0000] "GET /FW_BMC/CPMI_BMC.ima HTTP/1.1" 302 1264 3886 - 0 - - -

The following lines will continue to repeat until the operation times out or the BMC is rebooted

... 12:02:52 +00:00 [kern_servprocd:info:6569] 0x80942cb00: 0: NOTICE: Servprocd::SpUpdate: lookup_bmc_updt_str: BMC update - Triggered but not started.(0x0)
... 12:03:22 +00:00 [kern_servprocd:info:6569] 0x80942cb00: 0: NOTICE: Servprocd::SpUpdate: monitorUpdate: Waiting for BMC update to complete. Monitor count=(X), sleep 30 seconds...
... 12:03:22 +00:00 [kern_servprocd:info:6569] 0x80942cb00: 0: ERR: Servprocd::SpUpdate: servprocd_cpmi_get_fw_update_info: cpmi_get_fw_update_info(0x10) Failed.