CVO barely responsive during Snapmirror transfers and API calls timed out
Applies to
- NetApp Cloud Manager
- Cloud Volumes ONTAP (CVO)
Issue
- Around 300 volumes/vaults updated each night.
- The CVO VM response is very slow during that update time and API barely answering or running into errors.
- API error:
Connection to cvo on port 443 for protocol HTTPS timed out.
Get-NcSnapshot : Connection to cvo_cl on port 443 for protocol HTTPS timed
Timeout: Operation "localDstSnapMirror_iterator::next_imp()" took longer than 25 seconds to complete [from mgwd on node "cvo-01" (VSID: -1) to vldb at 127.0.0.1]
API invoke failed.
- SnapMirror Error:
Sun May 24 00:38:46 UTC 2020 ManualUpdate[May 23 23:53:21]:04099953-6dca-11ea-be7e-000d3a83909b Operation-Uuid=954bd26d-9d50-11ea-ba24-000d3a83909b Group=none Operation-Cookie=0 action=Defer source=svm_src:vol_001 destination=svm_dst:vol_001_VAULT status=Failure message=Transfer failed.(Volume access error(Capacity tier space limit reached))
Sun May 24 00:38:46 UTC 2020 ManualUpdate[May 23 23:47:44]:507a99fc-6c5d-11ea-93a4-000d3a83909b Operation-Uuid=cc8623f3-9d4f-11ea-ba24-000d3a83909b Group=none Operation-Cookie=0 action=Defer source=svm_src:vol_001 destination=svm_dst:vol_001_VAULT status=Failure message=Transfer failed.(Volume access error(Capacity tier space limit reached))