AIQUM cluster monitoring fails because of keycache
Applies to
- OnCommand Unified Manager 7.x -9.5 (OCUM)
- Active IQ Unified Manager 9.6+ (AIQUM)
Issue
- Suddenly cluster monitoring fails, or the cluster is not updated anymore
- For a cluster that is being newly added, the addition works but the initial discovery fails
- Issue is limited to one or more but does usually not affect all clusters
- Events for the cluster indicate an
Internal ErrororCannot update serveras the failure reason. ocumserver.logerror for existing cluster:
ERROR [default task-41554] c.o.s.s.sessions (UpdateTaskExecuteSessionEJB.java:38) - Fail execute task com.netapp.oci.platform.originator.OriginatorUpdateTask: com.netapp.oci.server.UpdateTaskException [356-171-153]
Failed to run OriginatorUpdateTask originId:3(IP address)
com.netapp.oci.server.UpdateTaskException [356-171-153]
Failed to run NewOriginatorUpdateTask, origin:3 originatorName:[name or IP]
ocumserver.logerror for new cluster that is attempted for a fresh addition:
[oncommand] [reconciliation-0] [c.n.d.c.ClusterStatusListener] Acquisition Failed for cluster : <cluster_Name_or_IP> message : Cannot update server (com.netapp.oci.server.UpdateTaskException [127-109] Failed execute task: class com.netapp.oci.platform.originator.OriginatorUpdateTask com.netapp.oci.server.UpdateTaskException [127-109] Failed to run NewOriginatorUpdateTask, origin:82 originatorName:<cluster_Name_or_IP> com.netapp.oci.platform.common.table.TableException: Failed to execUpdate: com.netapp.oci.platform.originator.db.InsertOperation@7043005f after 10 retries)
