CFBMC-2735: Cannot communicate with BMC after firmware upgrade to 13.7
Issue
- AFF A400, AFF C400, ASA A400, ASA C400, FAS8300, FAS8700
- Upgrading to BMC 13.7
- BMC is showing the installed version
Example:
::> system service-processor show
IP Firmware
Node Type Status Configured Version IP Address
---------- ---- --------- ---------- --------- --------------
node-01 BMC online true 13.7 172.10.10.10
node-02 BMC online true 13.7 172.10.10.11
2 entries were displayed.
- Ping to BMC IP fails:
user@pc:~$ ping -c 5 node-02-sp PING node-02-sp.fqdn (172.10.10.11) 56(84) bytes of data.
--- node-02-sp.fqdn ping statistics ---
5 packets transmitted, 0 received, 100% packet loss, time 410
- SSH to BMC fails:
user@pc:~$ ssh node-02-sp.fqdn;
ssh: connect to host node-02-sp.fqdn port 22:
Connection timed out
- The same issue is seen using the backup BMC image:
::> system service-processor reboot-sp -node node-02 -image backup
- The issue remains even after reseating the controller.
- Attempt to upgrade / reinstall BMC firmware fails due to network inaccessibility
- Example when updating from the BMC CLI:
BMC node-01> bmc update http://123.123.123.123/BMC_FW_308-04160_13.10P1.ima
[231117093034][bmc][INFO]URL = http://123.123.123.123/BMC_FW_308-04160_13.10P1.ima
...
rom.ima 100% |*******************************| 32768k 0:00:00 ETA
...
[1704 : 1704 CRITICAL][flashlib.c:2853]public key not found
[1704 : 1704 CRITICAL][flashlib.c:2950]unable to load public key
[1704 : 1704 CRITICAL][utils.c:1475]Encrypted hash of Image and the actual contents of rom.ima does not match
[1704 : 1704 CRITICAL][main.c:400]Error verifying image, VerifyImage failed
[10290 : 10290 CRITICAL][flashlib.c:813]Image verification failed, response status = 28
[0;32;32mVerification error! ...[m
[231117093105][bmc][INFO]Remove /tmp/rom.ima
[1;31mFail to update bmc
SP-MGMT-MLOG-TXT.GZ
logs example:
[kern_servprocd:info:6020] 0x8086ff900: 0: ERR: Servprocd::sp_mgmt_user: cpmi_bmc_user_sync: Failed to send the user file to the BMC (-1)
[kern_servprocd:info:6020] 0x8086ff900: 0: ERR: Servprocd::BmcManager: update_bmc_users: Failed to refresh users on the BMC : User configuration error: Failed to send userlist to BMC