How to recover from locked or hung backup or restore jobs in VSC 4.x for VMware

Applies to

• Virtual Storage Console (VSC) For VMware
• ONTAP
• FlexPod

Description

This article describes the process on how to recover from a locked or hung backup or restore job in VSC for VMware.

The procedure described in this article applies to VSC 4.x and above Host Client.

This issue affects only a subset of jobs that are 'stuck' with a 'Running' status in the VSC GUI. If the Error messages below are not seen and there is no evidence of a stuck lock, see KB VSC/SMVI jobs remain in a 'running' or 'failed' state and cannot be edited using the GUI.

Also, this article does not deal with 'stale' VMware vSphere tasks or issues with the vSphere client as that is outside of the scope of the VSC product. This article only describes how to recover from a locked or hung backup or restore job with VSC when evidence of locking issues are found. For example, jobs that show 'success' in the 'backups' pane of VSC but still show 'running' in the 'recent tasks' pane of vCenter are unrelated to this issue.

Error messages:
Examination of the server logs 'smvi\server\log\server.log' (typically residing in folder C:\Program Files\NetApp\Virtual Storage Console\SMVI\server\log) shows one of the following errors:

When job is re-run:
2015-02-12 15:39:52,214 [backup:2c94bbc0d31c5928fbc082a822f6ddcf:] ERROR - FLOW-10110: Lock "20ef83fc-cb4c-4be3-94cf-c4fb122bde0a" already held by backup operation edd3f12f3aec02e767330fa29b535bf2 []
2015-02-12 15:39:52,214 [backup:2c94bbc0d31c5928fbc082a822f6ddcf:] INFO - Backup backup_job_name is already in use. Please try this command again later.

Or when cancelling job:

ERROR - FLOW-11008: Operation failed: Backup is already in use. Please try this command again later.
java.lang.RuntimeException: Backup is already in use. Please try this command again later.,