Skip to main content
NetApp Knowledge Base

SP firmware autoupdate fails during ONTAP upgrade - SP/BMC is not reachable

Views:
1,392
Visibility:
Public
Votes:
2
Category:
fas-systems
Specialty:
hw
Last Updated:

Applies to

  • FAS/AFF Systems
  • Service Processor (SP)
  • Baseboard Management Console (BMC)
  • ONTAP 9

Issue

  • Automated SP/BMC firmware fails to update during ONTAP upgrade:

[Node-01: servprocd: sp.servprocd.upd.evts:debug]: params: {'reason': 'BMC update - Pre-update checks successful.'}
[Node-01: servprocd: sp.servprocd.upd.evts:debug]: params: {'reason': 'SP Firmware network update from 13.7 to 13.8 has been triggered.'}
[Node-01: servprocd: sp.servprocd.upd.unexpt.evts:debug]: params: {'reason': 'BMC update - Update has timed out. Last status code (1)'}
[Node-01: servprocd: sp.servprocd.upd.error:error]: SP update error: SP firmware update failure has been detected.

  • The system health subsystem show output shows the Service-Processor as degraded:
::> system health subsystem show
Subsystem
Health
----------------- ------------------
SAS-connect       ok
Environment       ok
Memory            ok
Service-Processor degraded
Switch-Health     ok
CIFS-NDO          ok
Motherboard       ok
IO                ok
MetroCluster      ok
MetroCluster_Node ok
FHM-Switch        ok
FHM-Bridge        ok
SAS-connect_Cluster ok
13 entries were displayed.
  • The SP-MGMT-MLOG-TXT.GZ in the autosupport shows the following events:

[kern_servprocd:info:5478] 0x80acc8000: 0: NOTICE: Servprocd::SpUpdate: SpUpdateStateHandleEvent: SP update from version 11.7 to version 11.8 has been scheduled.
[kern_servprocd:info:5478] 0x80acc8000: 0: NOTICE: Servprocd::SpUpdate: UpdateSmfState: processing ck_auto_update_scheduled.
[kern_servprocd:info:5478] 0x80c3af200: 0: NOTICE: Servprocd::SpUpdate: prepareImage: SP firmware image files were successfully checked for compression.
[kern_servprocd:info:5478] 0x80c3af200: 0: NOTICE: Servprocd::SpUpdate: prepareImage: Creating /mroot/etc/RLM_FW/sp_image.tar.gz image for network transfer.
[kern_servprocd:info:5478] 0x80c3af200: 0: NOTICE: Servprocd::SpUpdate: prepareImage: /mroot/etc/RLM_FW/sp_image.tar.gz image has been successfully created for network transfer to SP.
[kern_servprocd:info:5478] 0x80c3af200: 0: NOTICE: Servprocd::SpUpdate: update: SP firmware image for network transfer has been created.
[kern_servprocd:info:5478] 0x80c3af200: 0: NOTICE: Servprocd::SpUpdate: transferImage: sending /mroot/etc/RLM_FW/sp_image.tar.gz to SP, destination: /mnt/sapps/sp_image.tar.gz.
[kern_servprocd:info:5478]     0x29077a: SpUpdateOp::startUpdate()+8474
[kern_servprocd:info:5478]     0x291e6b: SpUpdateOp::startUpdate()+14347
[kern_servprocd:info:5478]     0x28e9ea: SpUpdateOp::startUpdate()+906
[kern_servprocd:info:5478] 0x80c3af200: 0: NOTICE: Servprocd::SpUpdate: update: SP firmware image has been successfully transferred to SP using network interface.
[kern_servprocd:info:5478] 0x80c3af200: 0: NOTICE: Servprocd::SpUpdate: writeImage: sending spcs update command to write SP firmware image to flash.
[kern_servprocd:info:5478] 0x80c3af200: 0: ERR: Servprocd::CLI: sp_update_worker : TTX ERROR: 7
[kern_servprocd:info:5478] 0x80c3af200: 0: ERR: Servprocd::CLI: sp_update_worker : sp reset connection, marking update success, we will catch failures in post update stage.
[kern_servprocd:info:5478] 0x80c3af200: 0: ERR: Servprocd::CLI: sp_update_worker : EXCEPTION Occured in closing the spcc transport
[kern_servprocd:info:5478] 0x80c3af200: 0: ERR: Servprocd::SpUpdate: writeImage: spcs sp update command failed (The Service Processor on node "Node-01" is not reachable. Verify that the SP or BMC is online, verify that api-service is enabled on the SP or BMC, verify that the partner node is running, check if pings from SP or BMC to partner node work, check if hw-assist keep-alives are normal, check that network ports are configured correctly and are functional (up). Then, try the command again.)

Sign in to view the entire content of this KB article.

New to NetApp?

Learn more about our award-winning Support

NetApp provides no representations or warranties regarding the accuracy or reliability or serviceability of any information or recommendations provided in this publication or with respect to any results that may be obtained by the use of the information or observance of any recommendations provided herein. The information in this document is distributed AS IS and the use of this information or the implementation of any recommendations or techniques herein is a customer's responsibility and depends on the customer's ability to evaluate and integrate them into the customer's operational environment. This document and the information contained herein may be used solely in connection with the NetApp products discussed in this document.