ActiveIQ Unified Manager alert Cluster Not Reachable caused by Ontap API timeout

Last updated
Save as PDF
Share
1. Share
2. Tweet
3. Share

Views:: 1,051

Visibility:: Public

Votes:: 0

Category:: active-iq-unified-manager

Specialty:: OM

Last Updated:

Applies to

Active IQ Unified manager (AIQUM)
ONTAP System Manager (OSM)
SnapCenter
ONTAP

Issue

AIQUM alert Cluster Not Reachable appearing for one cluster
OSM for the cluster is not reachable in browser
The error reported in ocumserver.log is pointing to Unexpected HTTP response: 502 Bad Gateway

2021-05-24 14:57:43,293 INFO [oncommand] [org.springframework.jms.listener.DefaultMessageListenerContainer#1-1] [com.netapp.ipc.jms.OCIE_Events] OCIE JMS notification message received: {WarningCount=0, DatasourceName=cluster-name, DatasourceID=4, Error0_ClusterManagementIP=cluster-name, PackageName=netappfoundation, TotalReportTime=599460, PollStartTime=1621881148238, Error1_Zapi=nvme-namespace-get-iter, Error1_Type=NETWORK_ACCESS_FAILURE, ErrorCount=2, Success=false, Error1_Port=443, DurationTime=1515050, Error1_ClusterManagementIP=cluster-name, Error0_Message=Communication problem with the cluster: cluster-name command: lun-get-iter, error: 'Unexpected HTTP response: 502 Bad Gateway' on try 5 out of 5, TotalZAPITime=-1, NotificationType=PACKAGE_COMPLETED, Error1_Message=Communication problem with the cluster: cluster-name, command: nvme-namespace-get-iter, error: 'Unexpected HTTP response: 502 Bad Gateway' on try 5 out of 5, Error0_Type=NETWORK_ACCESS_FAILURE, UpdateTime=1621882663293, Error0_Port=443, MessageType=PACKAGE_NOTIFICATION, Error0_Zapi=lun-get-iter}

Error in logs:

2021-07-22 16:36:18,434 WARN [pool-33432-thread-4] c.o.s.a.d.n.t.z.ZAPIConnection (ZAPIConnection.java:574) - [netappfoundation] cluster-name - protocol error on lun-get-iter try 5 out of 5 netapp.manage.NaProtocolException: Unexpected HTTP response: 502 Bad Gateway

at netapp.manage.NaServer.invokeHTTP(NaServer.java:1019) ~[manageontap.jar:5.4]

at netapp.manage.NaServer.invokeElemForXML(NaServer.java:780) ~[manageontap.jar:5.4]

Error in cluster audit-mlog in Cluster ASUP

00000011.01c453f0 120b2ddc Fri Jul 23 2021 04:31:20 -04:00 [kern_audit:info:9425] 8503ee0002871c38 :: cluster-name:ontapi :: pii_encrypt/6px/6pwmAwe2nCkeM0KxDAK1G++1KLAotOwy3T5ZNru3hoTUtAqTZSB6uWVavRps/pii_encrypt :: cluster-name:pii_encrypt/6px/6pwmAwe2nCkeM0KxDJDeFvxMqKE8aHjv+xF2rAE=/pii_encrypt :: POST /servlets/netapp.servlets.admin.XMLrequest_filer HTTP/1.0 :: Error: 502 Proxy Error

Error in apache-error in Cluster ASUP

[Thu Jul 22 17:26:17.338672 2021 +0000] [proxy_ http:error] [pid 9425:tid 34385616640] (70007)The timeout specified has expired: [client AIQUM_IPaddress:41954] AH01102: error reading status line from remote server Node_Ip:936

[Thu Jul 22 17:26:17.481399 2021 +0000] [proxy_ http:error] [pid 9425:tid 34376577280] (70007)The timeout specified has expired: [client AIQUM_IPaddress:41960] AH01102: error reading status line from remote server Node_Ip:936