Skip to main content
NetApp Knowledge Base

ActiveIQ Unified Manager 9.13+ becomes unresponsive due to high CPU utilization

  1. Last updated
  2. Save as PDF
Views:
2,334
Visibility:
Public
Votes:
1
Category:
active-iq-unified-manager
Specialty:
om
Last Updated:

Applies to

  • ActiveIQ Unified Manager (AIQUM) 9.13 and later
  • RHEL/OVA

Issue

  • AIQUM 9.13+  gets unresponsive intermittently
  • Rebooting the server solves the issue for few days before it goes into hung state again
  • Sudden high CPU utilization is observed when the issue occurs

clipboard_e963ae068b4e007e9f6c38e10f240a9d8.png

  • ps -eo pcpu,pid,user,args | sort -k 1 -r | head -10 shows jboss user and Java process is consuming more than 100% CPU:

clipboard_ef431a378b7687ea7cbbbfd7bf3535fa2.png

  • All kinds of jobs associated with AIQUM like acquisition/Commvault aux copy jobs fails.
  • ocumserver.log has an NullPointerException(NPE) recorded every hour for scale db pool:
 
ERROR [oncommand] [task-scheduler-10] [c.n.s.s.a.DbPoolScaleMonitor] Exception occurred while detecting scale db pool issue:
java.lang.NullPointerException: null
at deployment.dfm-app.war//com.netapp.dfm.common.metrics.MetricsRegistryProvider.getGauge(MetricsRegistryProvider.java:168)
at deployment.dfm-app.war//com.netapp.scalemonitor.service.automation.ScaleMonitorUtils.getDbConnectionData(ScaleMonitorUtils.java:71)
at deployment.dfm-app.war//com.netapp.scalemonitor.service.automation.DbPoolScaleMonitor.detectProblemsAndProvideRecommendation(DbPoolScaleMonitor.java:90)
....
....
  • journalctl.log has multiple entries of Rate limit exceeded from one or more sources:
 
ocum kernel: Rate limit exceeded: IN=eth0 OUT= MAC=<YY:YY:YY:YY:YY:YY:YY:YY:YY:YY:YY:YY:YY> SRC=XX.XX.XX.XX DST=<AIQUM_IP> LEN=52 TOS=0x02 PREC=0x00 TTL=126 ID=9520 DF PROTO=TCP SPT=52199 DPT=443 WINDOW=8192 RES=0x00 CWR ECE SYN URGP=0
 
ocum kernel: Rate limit exceeded: IN=eth0 OUT= MAC=<YY:YY:YY:YY:YY:YY:YY:YY:YY:YY:YY:YY:YY> SRC=XX.XX.XX.XX DST=<AIQUM_IP> LEN=52 TOS=0x02 PREC=0x00 TTL=126 ID=9591 DF PROTO=TCP SPT=52206 DPT=443 WINDOW=8192 RES=0x00 CWR ECE SYN URGP=0

Sign in to view the entire content of this KB article.

New to NetApp?

Learn more about our award-winning Support

NetApp provides no representations or warranties regarding the accuracy or reliability or serviceability of any information or recommendations provided in this publication or with respect to any results that may be obtained by the use of the information or observance of any recommendations provided herein. The information in this document is distributed AS IS and the use of this information or the implementation of any recommendations or techniques herein is a customer's responsibility and depends on the customer's ability to evaluate and integrate them into the customer's operational environment. This document and the information contained herein may be used solely in connection with the NetApp products discussed in this document.