What logs to check to identify the s3 operations failures reported in the metrics?
Applies to
StorageGRID 11.4
Answer
S3 error responses can be checked in the
bycast.log
in /var/local/log
on the storage NodesExample:
Nov 2 09:20:28 StorageGrid-SN01 ADE: |12362958 1406346534 S3RQ %CEA 2021-11-02T09:20:28.868209| NOTICE 1159 S3RQ: EVENT_PROCESS_CREATE - connection=xxxxxxxx method=GET namespace=<> path=</> name=</> auth=<Anonymous> clientIP=<xx.xx.xx.xx>
Nov 2 09:20:28 StorageGrid-SN01 ADE: |12362958 1406346534 S3RQ %CEA 2021-11-02T09:20:28.868409| NOTICE 0137 S3RQ: S3 error response: RequestId=1635844827715261, Resource=/, HTTP Status Code=400, X-Forwarded-For: 'xx.xx.xx.xx', ErrorMsg=InvalidRequest, ErrorType=Client, CustomErrorMessage={Anonymous request cannot perform service operations.}, Details={}
Additional Information
- Supported S3 API error codes
- Accessing and reviewing audit logs
- In 11.5 and later, S3 responses can be viewed and graphed in Prometheus metrics page (https://ADMIN_NODE/metrics/graph) under
storagegrid_s3_requests_total