Upgrading SANtricity OS on storage controller fails by RuntimeError with SYSTEM_ERR
Applies to
- NetApp StorageGRID 11.4 and above
- NetApp StorageGRID Appliances
Issue
- Upgrading SANtricity OS on storage controller fails with error:
Error: Fatal installation failure - SANtricity OS staging failed with: RuntimeError: Union <<class 'SYMbol.parser.RpcAcceptedReplyBody'>> at 0xXXXXXXXXXXXX> discriminator value SYSTEM_ERR does not have a corresponding qualifier
gdu-server.log
of the primary admin node shows errors:
INFO -- gdu-server: Invalidating any staged SANtricity OS on <NODE>
INFO -- gdu-server: 1% SANtricity OS staging done.
INFO -- gdu-server: Staging SANtricity OS on <NODE>
INFO -- gdu-server: 2% SANtricity OS staging done.
INFO -- gdu-server: Staging SANtricity OS on <NODE>
INFO -- gdu-server: WARNING -- Union <<class 'SYMbol.parser.RpcAcceptedReplyBody'>> at 0xXXXXXXXXXXXX> discriminator value SYSTEM_ERR does not have a corresponding qualifier
INFO -- gdu-server: RuntimeError: Union <<class 'SYMbol.parser.RpcAcceptedReplyBody'>> at 0xXXXXXXXXXXXX> discriminator value SYSTEM_ERR does not have a corresponding qualifier
ERROR -- gdu-server: SANtricity OS staging failed with: SANtricity OS precheck successful.
Invalidating any staged SANtricity OS.
1% SANtricity OS staging done.
2% SANtricity OS staging done.
ERROR -- gdu-server: SANtricity OS staging failed with: RuntimeError: Union <<class 'SYMbol.parser.RpcAcceptedReplyBody'>> at 0xXXXXXXXXXXXX> discriminator value SYSTEM_ERR does not have a corresponding qualifier (Bycast::Tasks::GduServer::SoftwareUpdate::InstallError)
INFO -- gdu-server: Software update task complete at <TIMESTAMP>
ERROR -- gdu-server: Failed to apply SANtricity OS to <NODE>: Fatal installation failure - SANtricity OS staging failed with: RuntimeError: Union <<class 'SYMbol.parser.RpcAcceptedReplyBody'>> at 0xXXXXXXXXXXXX> discriminator value SYSTEM_ERR does not have a corresponding qualifier
ERROR -- gdu-server: Failure occurred during Software Update
/base-os-logs/var/log/eos-system-status
of the failed node shows error includingSYSTEM_ERR
repeatedly:
Error while running status update. Union <<class 'SYMbol.parser.RpcAcceptedReplyBody'>> at 0xXXXXXXXXXXXX> discriminator value SYSTEM_ERR does not have a corresponding qualifier
Error connecting to SYMbolAPI. Union <<class 'SYMbol.parser.RpcAcceptedReplyBody'>> at 0xXXXXXXXXXXXX> discriminator value SYSTEM_ERR does not have a corresponding qualifier
web-server-trace-log.txt
in storage controller may show the following output which means WebServer service is restarted regularly, about every 10 minutes:
INFO [main] c.l.a.w.s.WebServer [WebServer.java:2292] [requestId=0, deviceId=N/A] stdout: Starting web server