Snapshot based backups are failing in AIQUM 9.14
Applies to
- Active IQ Unified Manager (AIQUM) 9.14
Issue
- Snapshot based backup is failing on AIQUM.
- Error in webUI:
Backup could not be taken.
- Error in ocumserver.log
Error occurred in Regular Backup Job:com.netapp.dfm.impl.backup.BackupCreationException: Snapshot backup could not be taken on volume. Try later.
java.lang.RuntimeException: Error occurred in Regular Backup Job:com.netapp.dfm.impl.backup.BackupCreationException: Snapshot backup could not be taken on volume. Try later.-
2024-10-01 14:18:34,624 ERROR [admin] [job-462] [Create backup|BACKUP_CREATE] [c.n.d.o.o.s.OntapOutboundServiceFactory] Cluster with UUID null does not exist
2024-10-01 14:18:34,625 ERROR [admin] [job-462] [Create backup|BACKUP_CREATE] [c.n.d.i.b.SnapshotBackupProperties] Exception occurred while fetching ontap snapshot service : com.netapp.common.exception.NotFoundException@66363d10[errorEnum=EOBJECTNOTFOUND,errorCode=22255,errorName=EOBJECTNOTFOUND,detailMessage=Cluster with UUID null does not exist,cause=<null>,stackTrace={},suppressedExceptions=[]]
2024-10-01 14:18:34,625 ERROR [admin] [job-462] [Create backup|BACKUP_CREATE] [c.n.d.i.b.AppConsistentSnapshotBackupOperation] Couldn't execute snapshot zapi/rest to take snapshot backup with name AIQ_UM_9.14_snapshot_backup_windows_10-01-2024-14-17 on host volume aiqum_prod_vol1. Exception: Cluster with UUID null does not exist2024-10-01 14:18:34,625 INFO [admin] [job-462] [Create backup|BACKUP_CREATE] [c.n.d.i.b.AppConsistentSnapshotBackupOperation] Successfully completed transaction for app consistent snapshot AIQ_UM_9.14_snapshot_backup_windows_10-01-2024-14-17
snapshot list <vol_name>
command on the cluster will show backup is actually still created on the cluster regardless of the error, but the backups are unusable to restore.- Restore operation will also show error in server.log
2024-10-09 22:49:18,136 ERROR [org.jboss.as.controller.management-operation] (ServerService Thread Pool – 40) WFLYCTL0013: Operation ("add") failed - address: ([
("subsystem" => "elytron"),
("key-manager" => "ServerKeyManager")
]): org.jboss.msc.service.ServiceNotFoundException: service org.wildfly.security.key-store.ServerKeyStore not found