Skip to main content
NetApp Knowledge Base

Active IQ Unified Manager web interface goes unresponsive due to 'Too many open files' error caused by file descriptor leak

  1. Last updated
    Dec 30, 2024
  2. Save as PDF
Views:
1,819
Visibility:
Public
Votes:
0
Category:
active-iq-unified-manager
Specialty:
om
Last Updated:
12/30/2024, 2:14:19 PM

Applies to

Active IQ Unified Manager (AIQUM) 9.9 or earlier

Issue

  • AIQUM WebUI is unresponsive
  • API calls triggered fail with Error 500 - Internal Server Error
  • Grafana fails to create report of AIQUM
  • server.log shows Too many open files error:

ERROR [org.jboss.as.server.deployment.scanner] (DeploymentScanner-threads - 1) WFLYDS0012: Scan of /opt/netapp/essentials/jboss/standalone/deployments threw Exception: java.lang.RuntimeException: WFLYDS0032: Failed to list files in directory /opt/netapp/essentials/jboss/standalone/deployments. Check that the contents of the directory are readable.
...

Caused by: java.nio.file.FileSystemException: /opt/netapp/essentials/jboss/standalone/deployments: Too many open files

Exception handling request to /apis/XMLrequest: java.lang.RuntimeException: java.io.IOException: Cannot run program "/opt/netapp/essentials/jboss/bin/native/lib64/authenticate": error=24, Too many open files

  • ocumserver.log indicates Got IO exception while processing access_log with Too many open files during Access Log Task

INFO  [oncommand] [Access Log Task] [com.netapp.ipc.util.AccessLogTask] <YEAR>-<MONTH>-<DATE> is older than 30 days
ERROR [oncommand] [Access Log Task] [com.netapp.ipc.util.AccessLogTask] Got IO exception while processing access_log
java.nio.file.FileSystemException: /var/log/ocie/<YEAR>-<MONTH>-<DATE>: Too many open files

  • Command lsof -p `cat /var/run/ocie.pid` | awk '{print $9}' | sort | grep "/var/log/ocie/20" | uniq -c shows large numbers of file descriptors for /var/log/ocie/<YEAR>-<MONTH>-<DATE>
     directories that are older than 30 days

174 /var/log/ocie/2019-08-26
172 /var/log/ocie/2019-08-27
 :
 34 /var/log/ocie/2021-07-13
 98 /var/log/ocie/2021-07-14
 98 /var/log/ocie/2021-07-15
 40 /var/log/ocie/2021-07-16

 

 

 

Sign in to view the entire content of this KB article.

New to NetApp?

Learn more about our award-winning Support

NetApp provides no representations or warranties regarding the accuracy or reliability or serviceability of any information or recommendations provided in this publication or with respect to any results that may be obtained by the use of the information or observance of any recommendations provided herein. The information in this document is distributed AS IS and the use of this information or the implementation of any recommendations or techniques herein is a customer's responsibility and depends on the customer's ability to evaluate and integrate them into the customer's operational environment. This document and the information contained herein may be used solely in connection with the NetApp products discussed in this document.