StorageGrid nodes are showing major alert FOPN (Open File Descriptors)
Applies to
- StorageGRID 11.6+
- External Load Balancer
- LDR
Issue
- Other then FOPN alarms triggered via the UI. To determine if FOPN are increasing on storage nodes.
- Collect data on network sockets and open files on the storage nodes exhibiting the alert.
- On the storage node(s), run the following, collect the /var/local/tmp/fopn_collection.tar.gz file and upload to NetApp.
- Collect data on network sockets and open files on the storage nodes exhibiting the alert.
mkdir /var/local/tmp/fopn_collection; sleep 1; ss -t > /var/local/tmp/fopn_collection/ss.output; netstat -nat > /var/local/tmp/fopn_collection/netstat.output; sleep 1; lsof -p $(pidof ldr) > /var/local/tmp/fopn_collection/lsof.output; tar czvf /var/local/tmp/fopn_collection.tar.gz /var/local/tmp/fopn_collection/*
- Storage Nodes incrementing FOPN (Open File Descriptors) alarms across multiple nodes.
- Depending on the type and priority of client workload. The below values may be too high before triggering an alarm to notify administrators of an issue.
- Workloads most affected by increasing FOPNs are applications sensitive to delete workflows.
- It is recommended to add a custom alarm if client application workload was determined to be affected by high FOPN values.
- Below are the default triggering values and their severity

- Depending on the type and priority of client workload. The below values may be too high before triggering an alarm to notify administrators of an issue.
