DII EMS Log Collection Gaps for Single Cluster – RPC Connection Error
Applies to
- NetApp ONTAP 9.16.1P8 (Cluster-Mode)
- Data Infrastructure Insights (DII)
Issue
Intermittent gaps were observed in EMS log collection from the DC1H205 cluster into Data Infrastructure Insights (DII). Other nodes in the cluster continued reporting without issue.
The following log errors were observed during the affected period:
Cluster_name [Error retrieving data] - system-get-node-info-iter failed: RPC: Couldn't make connection [from mgwd on node "node_name" (VSID:-1) to mgwd at 10.x.x.x][Device name 19.x.x.x: system-get-node-info-iter]: system-get-node-info-iter failed: RPC: Couldn't make connection [from mgwd on node "node_name" (VSID:-1) to mgwd at 10.x.x.x]com.onaro.sanscreen.acquisition.framework.datasource.DataSourceErrorException: system-get-node-info-iter failed: RPC: Couldn't make connection [from mgwd on node "node_name" (VSID:-1) to mgwd at 10.x.x.x]
Cause
- The log gaps were caused by a temporary network connectivity issue, resulting in an RPC connection error. The failure prevented the DII acquisition unit from retrieving node information. Common root causes for such RPC errors include:
- Network configuration changes
- Firewall rules blocking node communication
- Temporary network outages
- There was an NFS outage during the ONTAP upgrade at the time the issue.
Solution
The network connectivity issue was resolved, restoring RPC communication between the acquisition unit and the affected node. After resolution, EMS logs were collected as expected and no further gaps were observed.