Cloudsync fails to ingest data to StorageGRID, error message "ExceededQuota: Data byte limit exceeded"
Applies to
- Cloudsync
- StorageGRID 11.x
Issue
- Cloudsync fails to ingest data to StorageGRID, quota exceeded
- Cloudsync failed.log example:
[2021-04-11T21:49:50.576] [INFO] [TRANSFERRER] [5690] [2215932] [605a6b304fe5ef006da87e9f] [COPY] FAILED: source { s3: { bucket: 'source_bucketname', tags: [], provider: 'sgws', path: '', host: 'source_hostname', port: '10443' } } target: { s3: { bucket: 'dest_bucketname', tags: [], provider: 'sgws', path: '', host: 'dest_hostname', port: '10443' } } entry: { path: 'filepath/filename', size: 76263426447, mtimeSec: '1615342172', type: 'FILE' } ExceededQuota: Data byte limit exceeded. Contact your StorageGRID administrator to increase the limit.
at Request.extractError (/opt/netapp/databroker/node_modules/aws-sdk/lib/services/s3.js:712:35)
at Request.callListeners (/opt/netapp/databroker/node_modules/aws-sdk/lib/sequential_executor.js:106:20)
at Request.emit (/opt/netapp/databroker/node_modules/aws-sdk/lib/sequential_executor.js:78:10)
at Request.emit (/opt/netapp/databroker/node_modules/aws-sdk/lib/request.js:688:14)
at Request.transition (/opt/netapp/databroker/node_modules/aws-sdk/lib/request.js:22:10)
at AcceptorStateMachine.runTo (/opt/netapp/databroker/node_modules/aws-sdk/lib/state_machine.js:14:12)
at /opt/netapp/databroker/node_modules/aws-sdk/lib/state_machine.js:26:10
at Request.<anonymous> (/opt/netapp/databroker/node_modules/aws-sdk/lib/request.js:38:9)
at Request.<anonymous> (/opt/netapp/databroker/node_modules/aws-sdk/lib/request.js:690:12)
at Request.callListeners (/opt/netapp/databroker/node_modules/aws-sdk/lib/sequential_executor.js:116:18)
at Request.emit (/opt/netapp/databroker/node_modules/aws-sdk/lib/sequential_executor.js:78:10)
at Request.emit (/opt/netapp/databroker/node_modules/aws-sdk/lib/request.js:688:14)
at Request.transition (/opt/netapp/databroker/node_modules/aws-sdk/lib/request.js:22:10)
at AcceptorStateMachine.runTo (/opt/netapp/databroker/node_modules/aws-sdk/lib/state_machine.js:14:12)
at /opt/netapp/databroker/node_modules/aws-sdk/lib/state_machine.js:26:10
at Request.<anonymous> (/opt/netapp/databroker/node_modules/aws-sdk/lib/request.js:38:9) {
code: 'ExceededQuota',
region: null,
time: '2021-04-11T21:49:50.566Z',
requestId: '1618177789410286',
extendedRequestId: '12324780',
statusCode: 413,
retryable: false,
retryDelay: 651.2057273111136
}