Package: python3-cinder
Version: 2:12.0.1-1
Can't "retype" for volume
We have ceph with 2 pools (level_1 and lavel_2).
We can create volume on each pool. But we can't retype volume
https://docs.openstack.org/cinder/latest/contributor/migration.html -
scenario 2
Reproduction:
cinder -d retype --migration-policy on-demand
4f0e5023-a900-4349-907a-1ab0901c77b7 level_1
Log:
2018-06-15 16:09:55.081 174 DEBUG os_brick.initiator.connector
[req-6f739ee7-277b-4d91-832e-120a8d9fb545
70842c79ebd84aea8ab64dcff9725d43 71f917849f2d45b39a7b1c50def4b5e4 - - -]
Factory for rbd on x86_64 factory
/usr/lib/python3/dist-packages/os_brick/initiator/connector.py:262
2018-06-15 16:09:55.082 174 DEBUG os_brick.initiator.connectors.rbd
[req-6f739ee7-277b-4d91-832e-120a8d9fb545
70842c79ebd84aea8ab64dcff9725d43 71f917849f2d45b39a7b1c50def4b5e4 - - -]
==> connect_volume: call "{'self':
<os_brick.initiator.connectors.rbd.RBDConnector object at
0x7f7d452461d0>, 'connection_properties': {'name':
'level_1/volume-42896509-1234-450f-b4d3-5ed301e407b0', 'hosts':
['172.20.99.16', '172.20.99.17', '172.20.99.18'], 'ports': ['6789',
'6789', '6789'], 'cluster_name': 'ceph', 'auth_enabled': True,
'auth_username': 'volumes', 'secret_type': 'ceph', 'secret_uuid': '***',
'volume_id': '42896509-1234-450f-b4d3-5ed301e407b0', 'discard': True,
'keyring': None, 'qos_specs': None, 'access_mode': 'rw', 'encrypted':
False}}" trace_logging_wrapper
/usr/lib/python3/dist-packages/os_brick/utils.py:146
2018-06-15 16:09:55.084 174 DEBUG os_brick.initiator.linuxrbd
[req-6f739ee7-277b-4d91-832e-120a8d9fb545
70842c79ebd84aea8ab64dcff9725d43 71f917849f2d45b39a7b1c50def4b5e4 - - -]
opening connection to ceph cluster (timeout=-1). connect
/usr/lib/python3/dist-packages/os_brick/initiator/linuxrbd.py:70
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager
[req-6f739ee7-277b-4d91-832e-120a8d9fb545
70842c79ebd84aea8ab64dcff9725d43 71f917849f2d45b39a7b1c50def4b5e4 - - -]
Failed to copy volume 4f0e5023-a900-4349-907a-1ab0901c77b7 to
42896509-1234-450f-b4d3-5ed301e407b0: TypeError: self._ioctx,self.image
cannot be converted to a Python object for pickling
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager Traceback (most
recent call last):
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager File
"/usr/lib/python3/dist-packages/cinder/volume/manager.py", line 2144, in
_migrate_volume_generic
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager
self._copy_volume_data(ctxt, volume, new_volume, remote='dest')
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager File
"/usr/lib/python3/dist-packages/cinder/volume/manager.py", line 2024, in
_copy_volume_data
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager
attach_encryptor=attach_encryptor)
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager File
"/usr/lib/python3/dist-packages/cinder/volume/manager.py", line 1955, in
_attach_volume
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager attach_info
= self._connect_device(conn)
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager File
"/usr/lib/python3/dist-packages/cinder/volume/manager.py", line 1919, in
_connect_device
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager vol_handle =
connector.connect_volume(conn['data'])
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager File
"/usr/lib/python3/dist-packages/os_brick/utils.py", line 161, in
trace_logging_wrapper
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager mask_result
= strutils.mask_dict_password(result)
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager File
"/usr/lib/python3/dist-packages/oslo_utils/strutils.py", line 398, in
mask_dict_password
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager out =
copy.deepcopy(dictionary)
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager File
"/usr/lib/python3.6/copy.py", line 150, in deepcopy
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager y =
copier(x, memo)
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager File
"/usr/lib/python3.6/copy.py", line 240, in _deepcopy_dict
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager
y[deepcopy(key, memo)] = deepcopy(value, memo)
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager File
"/usr/lib/python3.6/copy.py", line 180, in deepcopy
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager y =
_reconstruct(x, memo, *rv)
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager File
"/usr/lib/python3.6/copy.py", line 280, in _reconstruct
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager state =
deepcopy(state, memo)
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager File
"/usr/lib/python3.6/copy.py", line 150, in deepcopy
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager y =
copier(x, memo)
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager File
"/usr/lib/python3.6/copy.py", line 240, in _deepcopy_dict
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager
y[deepcopy(key, memo)] = deepcopy(value, memo)
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager File
"/usr/lib/python3.6/copy.py", line 180, in deepcopy
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager y =
_reconstruct(x, memo, *rv)
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager File
"/usr/lib/python3.6/copy.py", line 280, in _reconstruct
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager state =
deepcopy(state, memo)
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager File
"/usr/lib/python3.6/copy.py", line 150, in deepcopy
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager y =
copier(x, memo)
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager File
"/usr/lib/python3.6/copy.py", line 240, in _deepcopy_dict
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager
y[deepcopy(key, memo)] = deepcopy(value, memo)
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager File
"/usr/lib/python3.6/copy.py", line 180, in deepcopy
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager y =
_reconstruct(x, memo, *rv)
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager File
"/usr/lib/python3.6/copy.py", line 280, in _reconstruct
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager state =
deepcopy(state, memo)
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager File
"/usr/lib/python3.6/copy.py", line 150, in deepcopy
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager y =
copier(x, memo)
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager File
"/usr/lib/python3.6/copy.py", line 240, in _deepcopy_dict
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager
y[deepcopy(key, memo)] = deepcopy(value, memo)
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager File
"/usr/lib/python3.6/copy.py", line 169, in deepcopy
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager rv = reductor(4)
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager File
"stringsource", line 2, in rbd.Image.__reduce_cython__
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager TypeError:
self._ioctx,self.image cannot be converted to a Python object for pickling
2018-06-15 16:09:55.126 174 ERROR cinder.volume.manager
2018-06-15 16:09:55.135 17 DEBUG cinder.coordination
[req-6f739ee7-277b-4d91-832e-120a8d9fb545
70842c79ebd84aea8ab64dcff9725d43 71f917849f2d45b39a7b1c50def4b5e4 - - -]
Lock
"/var/lib/cinder/cinder-42896509-1234-450f-b4d3-5ed301e407b0-delete_volume"
acquired by "delete_volume" :: waited 0.001s _synchronized
/usr/lib/python3/dist-packages/cinder/coordination.py:150
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server
[req-6f739ee7-277b-4d91-832e-120a8d9fb545
70842c79ebd84aea8ab64dcff9725d43 71f917849f2d45b39a7b1c50def4b5e4 - - -]
Exception during message handling: TypeError: self._ioctx,self.image
cannot be converted to a Python object for pickling
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server Traceback
(most recent call last):
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3/dist-packages/oslo_messaging/rpc/server.py", line 163,
in _process_incoming
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server res =
self.dispatcher.dispatch(message)
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3/dist-packages/oslo_messaging/rpc/dispatcher.py", line
220, in dispatch
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server return
self._do_dispatch(endpoint, method, ctxt, args)
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3/dist-packages/oslo_messaging/rpc/dispatcher.py", line
190, in _do_dispatch
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server result =
func(ctxt, **new_args)
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3/dist-packages/cinder/volume/manager.py", line 2801, in
retype
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server
new_reservations, status_update)
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 220, in
__exit__
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server
self.force_reraise()
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 196, in
force_reraise
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server
six.reraise(self.type_, self.value, self.tb)
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3/dist-packages/six.py", line 693, in reraise
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server raise value
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3/dist-packages/cinder/volume/manager.py", line 2797, in
retype
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server
new_type_id=new_type_id)
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3/dist-packages/cinder/volume/manager.py", line 2411, in
migrate_volume
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server
volume.save()
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 220, in
__exit__
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server
self.force_reraise()
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 196, in
force_reraise
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server
six.reraise(self.type_, self.value, self.tb)
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3/dist-packages/six.py", line 693, in reraise
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server raise value
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3/dist-packages/cinder/volume/manager.py", line 2404, in
migrate_volume
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server
self._migrate_volume_generic(ctxt, volume, host, new_type_id)
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3/dist-packages/cinder/volume/manager.py", line 2166, in
_migrate_volume_generic
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server new_volume)
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 220, in
__exit__
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server
self.force_reraise()
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3/dist-packages/oslo_utils/excutils.py", line 196, in
force_reraise
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server
six.reraise(self.type_, self.value, self.tb)
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3/dist-packages/six.py", line 693, in reraise
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server raise value
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3/dist-packages/cinder/volume/manager.py", line 2144, in
_migrate_volume_generic
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server
self._copy_volume_data(ctxt, volume, new_volume, remote='dest')
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3/dist-packages/cinder/volume/manager.py", line 2024, in
_copy_volume_data
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server
attach_encryptor=attach_encryptor)
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3/dist-packages/cinder/volume/manager.py", line 1955, in
_attach_volume
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server
attach_info = self._connect_device(conn)
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3/dist-packages/cinder/volume/manager.py", line 1919, in
_connect_device
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server
vol_handle = connector.connect_volume(conn['data'])
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3/dist-packages/os_brick/utils.py", line 161, in
trace_logging_wrapper
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server
mask_result = strutils.mask_dict_password(result)
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3/dist-packages/oslo_utils/strutils.py", line 398, in
mask_dict_password
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server out =
copy.deepcopy(dictionary)
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3.6/copy.py", line 150, in deepcopy
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server y =
copier(x, memo)
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3.6/copy.py", line 240, in _deepcopy_dict
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server
y[deepcopy(key, memo)] = deepcopy(value, memo)
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3.6/copy.py", line 180, in deepcopy
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server y =
_reconstruct(x, memo, *rv)
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3.6/copy.py", line 280, in _reconstruct
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server state =
deepcopy(state, memo)
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3.6/copy.py", line 150, in deepcopy
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server y =
copier(x, memo)
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3.6/copy.py", line 240, in _deepcopy_dict
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server
y[deepcopy(key, memo)] = deepcopy(value, memo)
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3.6/copy.py", line 180, in deepcopy
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server y =
_reconstruct(x, memo, *rv)
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3.6/copy.py", line 280, in _reconstruct
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server state =
deepcopy(state, memo)
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3.6/copy.py", line 150, in deepcopy
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server y =
copier(x, memo)
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3.6/copy.py", line 240, in _deepcopy_dict
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server
y[deepcopy(key, memo)] = deepcopy(value, memo)
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3.6/copy.py", line 180, in deepcopy
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server y =
_reconstruct(x, memo, *rv)
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3.6/copy.py", line 280, in _reconstruct
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server state =
deepcopy(state, memo)
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3.6/copy.py", line 150, in deepcopy
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server y =
copier(x, memo)
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3.6/copy.py", line 240, in _deepcopy_dict
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server
y[deepcopy(key, memo)] = deepcopy(value, memo)
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"/usr/lib/python3.6/copy.py", line 169, in deepcopy
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server rv =
reductor(4)
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server File
"stringsource", line 2, in rbd.Image.__reduce_cython__
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server TypeError:
self._ioctx,self.image cannot be converted to a Python object for pickling
2018-06-15 16:09:55.182 174 ERROR oslo_messaging.rpc.server
2018-06-15 16:09:55.196 17 DEBUG cinder.volume.drivers.rbd
[req-6f739ee7-277b-4d91-832e-120a8d9fb545
70842c79ebd84aea8ab64dcff9725d43 71f917849f2d45b39a7b1c50def4b5e4 - - -]
connecting to ceph (timeout=-1). _do_conn
/usr/lib/python3/dist-packages/cinder/volume/drivers/rbd.py:323
2018-06-15 16:09:55.238 17 DEBUG cinder.volume.drivers.rbd
[req-6f739ee7-277b-4d91-832e-120a8d9fb545
70842c79ebd84aea8ab64dcff9725d43 71f917849f2d45b39a7b1c50def4b5e4 - - -]
volume has no backup snaps _delete_backup_snaps
/usr/lib/python3/dist-packages/cinder/volume/drivers/rbd.py:852
2018-06-15 16:09:55.238 17 DEBUG cinder.volume.drivers.rbd
[req-6f739ee7-277b-4d91-832e-120a8d9fb545
70842c79ebd84aea8ab64dcff9725d43 71f917849f2d45b39a7b1c50def4b5e4 - - -]
Volume volume-42896509-1234-450f-b4d3-5ed301e407b0 is not a clone.
_get_clone_info
/usr/lib/python3/dist-packages/cinder/volume/drivers/rbd.py:875
2018-06-15 16:09:55.242 17 DEBUG cinder.volume.drivers.rbd
[req-6f739ee7-277b-4d91-832e-120a8d9fb545
70842c79ebd84aea8ab64dcff9725d43 71f917849f2d45b39a7b1c50def4b5e4 - - -]
deleting rbd volume volume-42896509-1234-450f-b4d3-5ed301e407b0
delete_volume
/usr/lib/python3/dist-packages/cinder/volume/drivers/rbd.py:973
2018-06-15 16:09:55.284 17 DEBUG cinder.utils
[req-6f739ee7-277b-4d91-832e-120a8d9fb545
70842c79ebd84aea8ab64dcff9725d43 71f917849f2d45b39a7b1c50def4b5e4 - - -]
Failed attempt 1 _print_stop
/usr/lib/python3/dist-packages/cinder/utils.py:804
2018-06-15 16:09:55.284 17 DEBUG cinder.utils
[req-6f739ee7-277b-4d91-832e-120a8d9fb545
70842c79ebd84aea8ab64dcff9725d43 71f917849f2d45b39a7b1c50def4b5e4 - - -]
Have been at this for 0.042 seconds _print_stop
/usr/lib/python3/dist-packages/cinder/utils.py:806
2018-06-15 16:09:55.285 17 DEBUG cinder.utils
[req-6f739ee7-277b-4d91-832e-120a8d9fb545
70842c79ebd84aea8ab64dcff9725d43 71f917849f2d45b39a7b1c50def4b5e4 - - -]
Sleeping for 10.0 seconds _backoff_sleep
/usr/lib/python3/dist-packages/cinder/utils.py:798
2018-06-15 16:10:05.331 17 DEBUG cinder.utils
[req-6f739ee7-277b-4d91-832e-120a8d9fb545
70842c79ebd84aea8ab64dcff9725d43 71f917849f2d45b39a7b1c50def4b5e4 - - -]
Failed attempt 2 _print_stop
/usr/lib/python3/dist-packages/cinder/utils.py:804
2018-06-15 16:10:05.332 17 DEBUG cinder.utils
[req-6f739ee7-277b-4d91-832e-120a8d9fb545
70842c79ebd84aea8ab64dcff9725d43 71f917849f2d45b39a7b1c50def4b5e4 - - -]
Have been at this for 10.089 seconds _print_stop
/usr/lib/python3/dist-packages/cinder/utils.py:806
