GET HEAD failures when two nodes down at one site

Last updated
Save as PDF
Share
1. Share
2. Tweet
3. Share

Views:: 23

Visibility:: not set

Votes:: 0

Category:: not set

Specialty:: not set

Last Updated:

Applies to

StorageGRID

Issue

Two nodes down at the same site, GET and HEAD requests may fail:

Nov 21 22:00:04 ADE: |12375468 1557758824 OBDR ^RDY 2025-11-21T22:00:04.835483| ERROR 0277 8b56475f93fe6deb OBDR: lookupObjects Cassandra UnavailableException (SELECT DISTINCT null_version_time, writetime(null_version_time), null_version_data FROM storagegrid.object_by_version WHERE bucket_id = ? AND key = ? - Cassandra Driver Error(Unavailable):'Cannot achieve consistency level LOCAL_QUORUM' Detailed Info:[consistency: LOCAL_QUORUM, responses_received: 1, responses_required: 2])

Nov 21 22:00:23 ADE: |12045653 3394757866 OBDR ^RDY 2025-11-21T22:00:23.990980| ERROR 0277 9955e6754f79ba18 OBDR: lookupObjects Cassandra UnavailableException (SELECT DISTINCT null_version_time, writetime(null_version_time), null_version_data FROM storagegrid.object_by_version WHERE bucket_id = ? AND key = ? - Cassandra Driver Error(Unavailable):'Cannot achieve consistency level EACH_QUORUM in DC group10' Detailed Info:[consistency: EACH_QUORUM, responses_received: 1, responses_required: 2])
Nov 21 22:00:23 ADE: |12045653 3394757866 OBDR ^RDY 2025-11-21T22:00:23.990997| WARNING 0422 9955e6754f79ba18 OBDR: Metadata request failed for '' with result 'GERR'
Nov 21 22:00:23 ADE: |12045653 3394757862 S3RQ %DED 2025-11-21T22:00:23.991163| NOTICE 0140 9955e6754f79ba18 S3RQ: S3 error response: RequestId=1763762423977246, TraceId=9955e6754f79ba18, Resource=/bkb2ptgm-ga-010b-p/i/cce54df8-9e0c-47f2-8252-f7b98ddcc712-public/1, HTTP Method=HEAD, HTTP Status Code=500, ErrorMsg=InternalError, ErrorType=Client, CustomErrorMessage={None}, Details={unexpected error (GERR).