Cloning Operation kicked by OpenStack Cinder fail with exception.VolumeNotFound during Element OS upgrade
Applies to
- Element OS 12.0 and earlier
- OpenStack Victoria and earlier
- Hybrid Cloud Control(HCC) 2.17 and earlier
- Element Healthtools
Issue
- Cloning operation fails in
_get_model_info
() andVolumeNotFound
is returned on OpenStack Cinder.
cinder-volume.log example:
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server File ""/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py"", line 166, in _process_incoming
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message)
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server File ""/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py"", line 220, in dispatch
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args)
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server File ""/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py"", line 190, in _do_dispatch
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args)
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server File ""<string>"", line 2, in create_volume
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server File ""/usr/lib/python2.7/site-packages/cinder/objects/cleanable.py"", line 207, in wrapper
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server result = f(*args, **kwargs)
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server File ""/usr/lib/python2.7/site-packages/cinder/volume/manager.py"", line 693, in create_volume
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server _run_flow()
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server File ""/usr/lib/python2.7/site-packages/cinder/volume/manager.py"", line 682, in _run_flow
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server flow_engine.run()
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server File ""/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py"", line 247, in run
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server for _state in self.run_iter(timeout=timeout):
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server File ""/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/engine.py"", line 340, in run_iter
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server failure.Failure.reraise_if_any(er_failures)
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server File ""/usr/lib/python2.7/site-packages/taskflow/types/failure.py"", line 336, in reraise_if_any
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server failures[0].reraise()
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server File ""/usr/lib/python2.7/site-packages/taskflow/types/failure.py"", line 343, in reraise
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server six.reraise(*self._exc_info)
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server File ""/usr/lib/python2.7/site-packages/taskflow/engines/action_engine/executor.py"", line 53, in _execute_task
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server result = task.execute(**arguments)
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server File ""/usr/lib/python2.7/site-packages/cinder/volume/flows/manager/create_volume.py"", line 1031, in execute
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server **volume_spec)
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server File ""/usr/lib/python2.7/site-packages/cinder/volume/flows/manager/create_volume.py"", line 449, in _create_from_snapshot
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server snapshot)
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server File ""/usr/lib/python2.7/site-packages/cinder/volume/drivers/solidfire.py"", line 283, in lvo_inner1
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server return lvo_inner2()
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server File ""/usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py"", line 274, in inner
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server return f(*args, **kwargs)
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server File ""/usr/lib/python2.7/site-packages/cinder/volume/drivers/solidfire.py"", line 282, in lvo_inner2
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server return f(inst, *args, **kwargs)
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server File ""/usr/lib/python2.7/site-packages/cinder/volume/drivers/solidfire.py"", line 1611, in create_volume_from_snapshot
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server volume)
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server File ""/usr/lib/python2.7/site-packages/cinder/volume/drivers/solidfire.py"", line 776, in _do_clone_volume
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server model_update = self._get_model_info(sf_account, sf_volume_id)
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server File ""/usr/lib/python2.7/site-packages/cinder/volume/drivers/solidfire.py"", line 693, in _get_model_info
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server raise exception.VolumeNotFound(volume_id=sf_volume_id)
2020-07-22 02:47:28.919 41 ERROR oslo_messaging.rpc.server VolumeNotFound: Volume 17470 could not be found.
- Cloning operation succeeds, and the volume is created on SolidFire storage cluster.