Cannot establish cluster peering Data connection but ICMP is working
Applies to
- ONTAP 9
- SnapMirror
- Cluster peering
Issue
- ICMP (PING) is working
- Full-mesh connectivity is present
- Cluster
peer health showcannot establish Data connection
Cluster::> cluster peer health show -bypass-cache true
Node Cluster-Name Node-Name
Ping-Status RDB-Health Cluster-Health Availability
---------- --------------------------- --------- --------------- ------------
Warning: Unable to list entries in cluster <cluster_name>. Failed to contact peer cluster "<cluster_name>" at addresses: <IP>, <IP>. RPC: Remote system error [from mgwd on node "<cluster_name-01>" (VSID: -1) to mgwd at <IP>, <IP>]
<cluster_name-01>
Data: unreachable
ICMP: interface_reachable - false false
Warning: Unable to list entries in cluster <cluster_name>. Failed to contact peer cluster "<cluster_name>" at addresses: <IP>, <IP>. RPC: Remote system error [from mgwd on node "<cluster_name-02>" (VSID: -1) to mgwd at <IP>, <IP>]
<cluster_name-02>
Data: unreachable
ICMP: interface_reachable - false false
- EMS logs:
[?] Mon Mar 28 00:36:24 +0300 [<cluster_name-02>: kernel: csm.connectionFailed:debug]: CSM failed to create a connection: localBladeUUID = <cluster_name-02>:dblade, remoteBladeUUID = <cluster_name-02>:dblade, uniquifier = <****>, transportType = CT, sessionTag = CPEER, localVifId = 1040, remoteVifIP = <IP>, CsmError = CSM_CONNTIMEOUT, ctLoError = CTLOPCP_ERR_UNKNOWN, socketError = 60, and TLSerror = 0.
[?] Mon Mar 28 00:36:28 +0300 [<cluster_name-02>: mgwd: cpeer.xcm.addr.disc.warn:error]: Address discovery failed for peer cluster <UUID>. Reason: Failed to discover remote addresses: Failed to contact peer cluster "<cluster_name>" at addresses: <IP>. RPC: Remote system error [from mgwd on node "<cluster_name-02>" (VSID: -3) to mgwd at <IP>].
[?] Mon Mar 28 00:36:35 +0300 [<cluster_name-02>: cpeer.xcm.update.warn:error]: Periodic update of peer network information failed. The following operations are incomplete: discovery failure.
[?] Mon Mar 28 00:36:35 +0300 [<cluster_name-02>: mgwd: mgmtgwd.jobmgr.private.jobcomplete.failure:info]: Private job "Cross-Cluster Manager" [id ****] (Cross-Cluster Address Manager) completed unsuccessfully: discovery failure (1).