The acquisition process after adding the datasource does not finish long time because the Health Poll fails

Last updated
Save as PDF
Share
1. Share
2. Tweet
3. Share

Views:: 653

Visibility:: Public

Votes:: 1

Category:: active-iq-unified-manager

Specialty:: om

Last Updated:

Applies to

ActiveIQ Unified Manager (AIQUM) 9.14+
ONTAP 9.14+

Issue

Cluster discovery takes a long time and eventually fails
AIQUM's Event Management shows:

Event: Cluster Monitoring Failed. Monitoring failed for cluster cluster. Reason: Incorrect response from one or more Data ONTAP APIs. Contact technical support.

acquisition/au.log shows:

INFO [common-pool-4105] c.o.s.a.d.n.NetAppOCIEDataSource (NetAppOCIEDataSource.java:217) - [CA] Cloud Agent Baseline response took 600002 ms ERROR [common-pool-4105] c.o.s.a.d.n.NetAppOCIEDataSource (NetAppOCIEDataSource.java:223) - Timed out waiting for cluster, recommend increasing timeout value INFO [common-pool-4105] c.o.s.a.d.n.NetAppOCIEDataSource (NetAppOCIEDataSource.java:338) - [] Total poll duration: 600003 ms INFO [common-pool-4105] c.o.s.a.d.n.NetAppOCIEDataSource (NetAppOCIEDataSource.java:346) - [] -- Finished Poll -- INFO [common-pool-4105] c.o.s.a.f.d.BaseDataSource (BaseDataSource.java:667) - Datasource - 1.2.3.4 is stopped. ERROR [common-pool-4105] c.o.s.a.f.d.BaseDataSource (DataSourceErrorException.java:246) - 1.2.3.4 [Error retrieving data] - Timed out waiting for cluster, recommend increasing timeout value ([Device name General Device]: Timed out waiting for cluster, recommend increasing timeout value) INFO [common-pool-4105] c.o.m.h.AUAuditHttpClientManager (AUAuditHttpClientManager.java:74) - Closing datasource audit INFO [common-pool-4105] c.o.s.a.f.d.BaseDataSource (BaseDataSource.java:311) - [netappfoundation] 1.2.3.4 - Finished acquisition (600058 msecs)

jboss/server_acq.log shows cloud agent communication event:

ERROR [default task-3936] c.n.u.CloudAgentConnectionUtil (CloudAgentConnectionUtil.java:102) - deletion of connection agent from datasource failed with error code: 404 INFO [default task-3936] c.n.s.m.AccessHandle (AccessHandle.java:101) - Transitioning state from MAIN to DOWN ERROR [default task-3936] c.n.s.m.JmsBase (JmsBase.java:261) - Failed to create TextMessage: javax.jms.IllegalStateException: The Session was closed due to an unrecoverable error

OCUMSERVER.log shows:

WARN [oncommand] [reconciliation-0] [c.n.d.c.ClusterStatusListener] Acquisition Failed for cluster : 1.2.3.4 message : Timed out waiting for cluster, recommend increasing timeout value INFO [oncommand] [reconciliation-0] [c.n.dfm.collector.OcieJmsListener] CONFIG ds=1.2.3.4(8), PollStartTime=1748324314785, UpdateTime=1748324914803, MegaDuration=600003, SystemTime=1748324914822 ERROR [oncommand] [job-451] [refresh(dataSource=1.2.3.4)|forceAcquisition] [com.netapp.dfm.job.JobEngine] Error executing job 641be6841c6a5a33:774b111c:196e5df2fc0:-79e9 task 641be6841c6a5a33:774b111c:196e5df2fc0:-79eb: Errors reported on acquisition with start time 14:38:34.785: [Timed out waiting for cluster, recommend increasing timeout value] java.lang.RuntimeException: Errors reported on acquisition with start time 14:38:34.785: [Timed out waiting for cluster, recommend increasing timeout value]