Fabricpool SnapMirror Failure to perform I/O with the capacity tier Retry the operation
z
Applies to
- ONTAP 9
- SnapMirror
- CVO
- FabricPool
- StorageGrid
Issue
-
A Snapmirror transfer between an OnPrem (Source) and a CVO (destination) with tiering policy as
Auto
using Google Cloud bucket fails with the below error:
Last transfer error
was 'Transfer failed. (Failure to perform IO with capacity tier. (Failure to perform I/O with the capacity tier. Retry the operation))
EMS-LOG-FILE.GZ
OscHighPriThreadPool: wafl.ca.latency.threshold:notice]: Measured latency from cloud (113899 msec) more than threshold (5000 msec) (aggregate: "aggr2", aggregate uuid: "1adf4020-9791-4023-86b4-3f6d356e917c", object store: "StorageAccount")
OscHighPriThreadPool: wafl.ca.latency.threshold:notice]: Measured latency from cloud (130339 msec) more than threshold (5000 msec) (aggregate: "aggr2", aggregate uuid: "1adf4020-9791-4023-86b4-3f6d356e917c", object store: "StorageAccount")
OscHighPriThreadPool: wafl.ca.latency.threshold:notice]: Measured latency from cloud (122933 msec) more than threshold (5000 msec) (aggregate: "aggr2", aggregate uuid: "1adf4020-9791-4023-86b4-3f6d356e917c", object store: "StorageAccount"
SKTRACE.GZ
CLOUD_BIN_ERR: cloud_io_objstore_callback: Cloud bin: volume aggr2, osc_error 2
CLOUD_BIN_ERR: cio_error_to_raid_error: Cloud-bin read block 35184448022291 data unavailable cloud io error 9 btid: 447292 btuuid: 2cd3d61d-f21a-40c3-94c6-7d9e9c7b8063, seq_num: 383432
CLOUD_BIN_ERR: cloud_io_do_retry_on_callback: Cloud bin: retry fail cioError=9 timePassed=67687
CLOUD_BIN_ERR: cloud_io_do_retry_on_callback: Cloud bin: retry fail cioError=9 timePassed=68179
CLOUD_BIN_ERR: cloud_io_do_retry_on_callback: Cloud bin: retry fail cioError=9 timePassed=70520
- Object-store is available and the config looks fine.
- Object-store connectivity is verified via telnet.