Network port command errors with System busy: 7 requests on table "vifmgr_netports" have been pending for 245 seconds

• Receiving cluster network degraged alerts and vifmgr rpc timeouts in EMS logs for one node:

Sun Jul 17 00:20:07 -0400 [node04: vifmgr: callhome.clus.net.degraded:alert]: Call home for CLUSTER NETWORK DEGRADED: Cluster LIF Not Assigned to Any Port - Cluster LIF node04_clus1 (node node04) is not assigned to any port

Sun Jul 17 00:23:07 -0400 [node04: vifmgr: vifmgr.rpc.nblade.timeouts:error]: The virtual interface manager is not receiving responses from the node's networking component.

• RPC errors for the node when runnning system health commands:

Cluster::> system health alert show
This table is currently empty.

Warning: Unable to list entries on node node04. RPC: Remote system error [from mgwd on node “node04” (VSID: -1) to cshm at 127.0.0.1]

• LIFS on the node show as operationally down.    

Cluster::> network interface show -vserver Cluster
Logical Status Network Current Current Is
Vserver Interface Admin/Oper Address/Mask Node Port Home
----------- ---------- ---------- ------------------ ------------- ------- ----
Cluster
node01_clus1 up/up 169.254.18.89/16 node01 e1a true
...
node03_clus3 up/up 169.254.72.181/16 node03 e5c true
node03_clus4 up/up 169.254.159.33/16 node03 e5d true
node04_clus1 up/- 169.254.94.151/16 node04 e5a true
node04_clus2 up/- 169.254.4.92/16 node04 e5b true
node04_clus3 up/- 169.254.92.129/16 node04 e5c true
node04_clus4 up/- 169.254.179.235/16 node04 e5d true
16 entries were displayed.

• Running network port show gives a warning Unable to list entries for vifmgr on node "x": System busy.  

Cluster::> network port show
Warning: Unable to list entries for vifmgr on node "node04": System busy: 7 requests on table "vifmgr_netports" have been pending for 245 seconds. The last completed call took 300 seconds.