Skip to main content
NetApp Knowledge Base

Unable to access AIQUM by assertion failure due to corruption on MySQL tablespace

Views:
4,561
Visibility:
Public
Votes:
0
Category:
active-iq-unified-manager
Specialty:
OM
Last Updated:

Applies to

Active IQ Unified Manager (AIQUM) 9.12 or earlier

Issue

  • Unable to login to AIQUM with error:

Sign In Failed. Please verify Username and Password.

  • HTTP 404 - Not Found by accessing AIQUM
  • ocumserver.log shows Connection refused to port 3306

ERROR [oncommand] [QuartzScheduler_unifiedManagerScheduler-NON_CLUSTERED_MisfireHandler] [o.s.s.q.LocalDataSourceJobStore] MisfireHandler: Error handling misfires: Failed to obtain DB connection from data source 'springNonTxDataSource.unifiedManagerScheduler': java.sql.SQLTransientConnectionException: um-default-data-source - Connection is not available, request timed out after 30000ms.
org.quartz.JobPersistenceException: Failed to obtain DB connection from data source 'springNonTxDataSource.unifiedManagerScheduler': java.sql.SQLTransientConnectionException: um-default-data-source - Connection is not available, request timed out after 30000ms.
    at deployment.dfm-app.war//org.quartz.impl.jdbcjobstore.JobStoreCMT.getNonManagedTXConnection(JobStoreCMT.java:168)
    at deployment.dfm-app.war//org.quartz.impl.jdbcjobstore.JobStoreSupport.doRecoverMisfires(JobStoreSupport.java:3246)
    at deployment.dfm-app.war//org.quartz.impl.jdbcjobstore.JobStoreSupport$MisfireHandler.manage(JobStoreSupport.java:4012)
    at deployment.dfm-app.war//org.quartz.impl.jdbcjobstore.JobStoreSupport$MisfireHandler.run(JobStoreSupport.java:4033)
Caused by: java.sql.SQLTransientConnectionException: um-default-data-source - Connection is not available, request timed out after 30000ms.
    at deployment.dfm-app.war//com.zaxxer.hikari.pool.HikariPool.createTimeoutException(HikariPool.java:696)
    at deployment.dfm-app.war//com.zaxxer.hikari.pool.HikariPool.getConnection(HikariPool.java:197)
    at deployment.dfm-app.war//com.zaxxer.hikari.pool.HikariPool.getConnection(HikariPool.java:162)
    at deployment.dfm-app.war//com.zaxxer.hikari.HikariDataSource.getConnection(HikariDataSource.java:100)
    at deployment.dfm-app.war//com.netapp.dfm.persist.util.CompositeDataSource.getConnection(CompositeDataSource.java:97)
    at deployment.dfm-app.war//com.netapp.dfm.persist.util.diag.ProfiledDataSource.getConnection(ProfiledDataSource.java:36)
    at deployment.dfm-app.war//org.springframework.scheduling.quartz.LocalDataSourceJobStore$2.getConnection(LocalDataSourceJobStore.java:140)
    at deployment.dfm-app.war//org.quartz.utils.DBConnectionManager.getConnection(DBConnectionManager.java:108)
    at deployment.dfm-app.war//org.quartz.impl.jdbcjobstore.JobStoreCMT.getNonManagedTXConnection(JobStoreCMT.java:165)
    ... 3 common frames omitted
Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to address=(host=localhost)(port=3306)(type=master) : Socket fail to connect to host:localhost, port:3306. Connection refused (Connection refused)
    at org.mariadb//org.mariadb.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:73)

  • server.log of jboss also shows Connection refused to port 3306

WARN  [org.jboss.jca.core.connectionmanager.pool.strategy.OnePool] (pool-15-thread-1) IJ000604: Throwable while attempting to get a new connection: null: javax.resource.ResourceException: IJ031084: Unable to create connection
    at org.jboss.ironjacamar.jdbcadapters@1.5.3.Final//org.jboss.jca.adapters.jdbc.local.LocalManagedConnectionFactory.createLocalManagedConnection(LocalManagedConnectionFactory.java:364)
    at org.jboss.ironjacamar.jdbcadapters@1.5.3.Final//org.jboss.jca.adapters.jdbc.local.LocalManagedConnectionFactory.getLocalManagedConnection(LocalManagedConnectionFactory.java:371)
    at org.jboss.ironjacamar.jdbcadapters@1.5.3.Final//org.jboss.jca.adapters.jdbc.local.LocalManagedConnectionFactory.createManagedConnection(LocalManagedConnectionFactory.java:287)
    at org.jboss.ironjacamar.impl@1.5.3.Final//org.jboss.jca.core.connectionmanager.pool.mcp.SemaphoreConcurrentLinkedDequeManagedConnectionPool.createConnectionEventListener(SemaphoreConcurrentLinkedDequeManagedConnectionPool.java:1328)
    at org.jboss.ironjacamar.impl@1.5.3.Final//org.jboss.jca.core.connectionmanager.pool.mcp.SemaphoreConcurrentLinkedDequeManagedConnectionPool.getConnection(SemaphoreConcurrentLinkedDequeManagedConnectionPool.java:505)
    at org.jboss.ironjacamar.impl@1.5.3.Final//org.jboss.jca.core.connectionmanager.pool.AbstractPool.getSimpleConnection(AbstractPool.java:640)
    at org.jboss.ironjacamar.impl@1.5.3.Final//org.jboss.jca.core.connectionmanager.pool.AbstractPool.getConnection(AbstractPool.java:605)
    at org.jboss.ironjacamar.impl@1.5.3.Final//org.jboss.jca.core.connectionmanager.AbstractConnectionManager.getManagedConnection(AbstractConnectionManager.java:624)
    at org.jboss.ironjacamar.impl@1.5.3.Final//org.jboss.jca.core.connectionmanager.tx.TxConnectionManagerImpl.getManagedConnection(TxConnectionManagerImpl.java:440)
    at org.jboss.ironjacamar.impl@1.5.3.Final//org.jboss.jca.core.connectionmanager.AbstractConnectionManager.allocateConnection(AbstractConnectionManager.java:789)
    at org.jboss.ironjacamar.jdbcadapters@1.5.3.Final//org.jboss.jca.adapters.jdbc.WrapperDataSource.getConnection(WrapperDataSource.java:151)
    at org.jboss.as.connector@26.0.0.Final//org.jboss.as.connector.subsystems.datasources.WildFlyDataSource.getConnection(WildFlyDataSource.java:64)
    at com.netapp.mega//com.netapp.oci.platform.common.table.ConnectionHelper$JndiConnectionHelper.doGetConnection(ConnectionHelper.java:353)
    at com.netapp.mega//com.netapp.oci.platform.common.table.ConnectionHelper.getConnection(ConnectionHelper.java:230)
    at com.netapp.mega//com.netapp.oci.platform.common.table.PrefixConnection.getConnection(PrefixConnection.java:42)
    at com.netapp.mega//com.netapp.oci.platform.common.table.PrefixConnection.close(PrefixConnection.java:96)
    at com.netapp.mega//com.netapp.oci.platform.common.table.ConnectionHelper.close(ConnectionHelper.java:294)
    at deployment.mega-app.ear.server-core.jar//com.onaro.sanscreen.server.sessions.OriginatorUpdateSessionImpl.checkAndSend(OriginatorUpdateSessionImpl.java:443)
    at deployment.mega-app.ear.server-core.jar//com.onaro.sanscreen.server.sessions.OriginatorUpdateSessionImpl.lambda$init$0(OriginatorUpdateSessionImpl.java:96)
    at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [java.base:]
    at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) [java.base:]
    at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) [java.base:]
    at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [java.base:]
    at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [java.base:]
    at java.base/java.lang.Thread.run(Thread.java:829) [java.base:]
Caused by: java.sql.SQLNonTransientConnectionException: Could not connect to address=(host=localhost)(port=3306)(type=master) : Socket fail to connect to host:localhost, port:3306. Connection refused (Connection refused)
    at org.mariadb//org.mariadb.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:73) [mariadb-java-client.jar:]
    at org.mariadb//org.mariadb.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:192) [mariadb-java-client.jar:]
    at org.mariadb//org.mariadb.jdbc.internal.protocol.AbstractConnectProtocol.connectWithoutProxy(AbstractConnectProtocol.java:1346) [mariadb-java-client.jar:]
    at org.mariadb//org.mariadb.jdbc.internal.util.Utils.retrieveProxy(Utils.java:634) [mariadb-java-client.jar:]
    at org.mariadb//org.mariadb.jdbc.MariaDbConnection.newConnection(MariaDbConnection.java:150) [mariadb-java-client.jar:]
    at org.mariadb//org.mariadb.jdbc.Driver.connect(Driver.java:89) [mariadb-java-client.jar:]
    at org.jboss.ironjacamar.jdbcadapters@1.5.3.Final//org.jboss.jca.adapters.jdbc.local.LocalManagedConnectionFactory.createLocalManagedConnection(LocalManagedConnectionFactory.java:335)

  • error.log of mysql indicates that MySQL service detects Assertion failure with corruption in the InnoDB tablespace

[ERROR] [MY-013183] [InnoDB] Assertion failure: rec.cc:271 thread 140576495900416
InnoDB: We intentionally generate a memory trap.
InnoDB: Submit a detailed bug report to http://bugs.mysql.com.
InnoDB: If you get repeated assertion failures or crashes, even
InnoDB: immediately after the mysqld startup, there may be
InnoDB: corruption in the InnoDB tablespace. Please refer to
InnoDB: http://dev.mysql.com/doc/refman/8.0/en/forcing-innodb-recovery.html
InnoDB: about forcing recovery.

 

 

Sign in to view the entire content of this KB article.

New to NetApp?

Learn more about our award-winning Support

NetApp provides no representations or warranties regarding the accuracy or reliability or serviceability of any information or recommendations provided in this publication or with respect to any results that may be obtained by the use of the information or observance of any recommendations provided herein. The information in this document is distributed AS IS and the use of this information or the implementation of any recommendations or techniques herein is a customer's responsibility and depends on the customer's ability to evaluate and integrate them into the customer's operational environment. This document and the information contained herein may be used solely in connection with the NetApp products discussed in this document.