SnapCenter SQL backups intermittently fail with "ServiceUnavailable" error
Applies to
- SnapCenter Server (SC) 6.1P1
- SnapCenter Plug-in for Microsoft SQL Server (SCSQL) 6.1P1
Issue
SnapCenter backups of SQL server resources intermittently fail with the following errors seen:
- SnapCenter UI
Activity 'Replicating to Secondary' failed with error: Request to 'https://<SnapCenter_Server_FQDN>:8146/JobManagerService.svc/CreateJob' failed. Status Code:ServiceUnavailable. RETURN_DATA:The service is unavailable.
Activity 'Registering Backup and Applying Retention' failed with error: Request to 'https://<SnapCenter_Server_FQDN>:8146/BackupMetadataService.svc/RegisterBackups' failed. Status Code:ServiceUnavailable. RETURN_DATA:The service is unavailable.
- SMCoreServicelog
DEBUG NetApp.Ontapi.NaServer PID=[xxxx] TID=[Pipeline Execution Thread] <results reason="Volume "<Volume_Name>" does not exist in Vserver "<SVM_Name>". Reason: entry doesn't exist. " status="failed" errno="13040"/>
ERROR DataONTAP.C.PowerShell.SDK.NcControllerCmdlet PID=[xxxx] TID=[Pipeline Execution Thread] API exception
NetApp.Ontapi.ErrnoException+EVOLUMEDOESNOTEXIST: Volume "<Volume_Name>" does not exist in Vserver "<SVM_Name>". Reason: entry doesn't exist. 
   at DataONTAP.C.PowerShell.SDK.Cmdlets.Snapshot.RemoveNcSnapshot.ProcessRecordFlexvol(NcController controller)
DEBUG SMCore PID=[xxxx] TID=[xxxx] ex.Message : The running command stopped because the preference variable "ErrorActionPreference" or common parameter is set to Stop: Volume "<Volume_Name>" does not exist in Vserver "<SVM_Name>". Reason: entry doesn't exist.
DEBUG SMCore PID=[xxxx] TID=[xxxx] No retry condition match found or max retry reached. Throwing error The running command stopped because the preference variable "ErrorActionPreference" or common parameter is set to Stop: Volume "<Volume_Name>" does not exist in Vserver "<SVM_Name>". Reason: entry doesn't exist. 
- SMCore_<JobID>.log
ERROR SMCore_<JobID> PID=[xxxx] TID=[xxxx] No snapshots found for volume: <Volume_Name>
