Deletion of Multiple Snapshots at same time on OpenStack fails with "error_deleting"

Last updated
Save as PDF
Share
1. Share
2. Tweet
3. Share

Views:: 194

Visibility:: Public

Votes:: 1

Category:: element-software

Specialty:: solidfire

Last Updated:

Applies to

Element Software 12.3 and earlier
OpenStack Queens

Issue

Deleting multiple snapshots at the same time on OpenStack fails with :

Snapshot status is shown as "error_deleting"
Following Traceback is seen on cinder.log

2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server [req-51f56f79-37a7-4dfc-9502-8fe743830eda e0bdb7eb798846e794e9a124f30e5542 98f1d3382f234278a90053c0aa081600 - 562bfa8e1b904076931ebdf1dfdcd3fa 562bfa8e1b904076931ebdf1dfdcd3fa] Exception during message handling: SolidFireAPIException: API response: {u'id': None, u'error': {u'message': u'Snapshot 289023 does not exist.', u'code': 500, u'name
': u'xSnapshotIDDoesNotExist'}}
2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 166, in _process_incoming
2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 220, in dispatch
2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 190, in _do_dispatch
2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server   File "<string>", line 2, in delete_snapshot
2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/cinder/coordination.py", line 151, in _synchronized
2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server     return f(*a, **k)
2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 1163, in delete_snapshot
2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server     snapshot.save()
2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server     self.force_reraise()
2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server     six.reraise(self.type_, self.value, self.tb)
2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 1153, in delete_snapshot
2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server     self.driver.delete_snapshot(snapshot)
2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/solidfire.py", line 1563, in delete_snapshot
2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server     sf_snaps = self._get_sf_snapshots(sf_vol['volumeID'])
2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/solidfire.py", line 961, in _get_sf_snapshots
2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server     'ListSnapshots', params, version='6.0')['result']['snapshots']
2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/solidfire.py", line 118, in func_retry
2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server   File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/solidfire.py", line 529, in _issue_api_request
2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server     raise exception.SolidFireAPIException(msg)
2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server SolidFireAPIException: API response: {u'id': None, u'error': {u'message': u'Snapshot 289023 does not exist.', u'code': 500, u'name': u'xSnapshotIDDoesNotExist'}}
2021-07-15 08:25:38.382 35 ERROR oslo_messaging.rpc.server

Following message appears on ClusterEvent

API response: {u'id': None, u'error': {u'message': u'Snapshot XXXXXX does not exist.', u'code': 500, u'name': u'xSnapshotIDDoesNotExist'}