StorageGRID some PUT and GET have a 10s delay
Applies to
- StorageGRID 11.6
Issue
The customer is experiencing intermittent 10-second delays for some PUT and GET operations in their StorageGRID 11.6.0.13 environment. This issue has been affecting the performance of their application, which handles a high transaction volume. The delays have persisted for over a month, causing significant operational impact due to timeouts and failed requests.
Dec 10 03:29:41 sg-snx ADE: |12766533 2962897654 S3RQ ???? 2024-12-10T03:29:41.482263| DEBUG 3 1158 c70aa44c2e259278 PROC: receive from {0@12766533}: %CEA{_connectionID:1732176543475575, _serviceID:ssin, _remoteEndpoint:y.y.y.y:48452, _protocol:https, _request:PUT /usdmp/02C2EFC6E4934F55AEA72CFECFD5C267}
Dec 10 03:29:41 sg-snx ADE: |12766533 2962897654 S3RQ %CEA 2024-12-10T03:29:41.482314| DEBUG 3 0125 c70aa44c2e259278 ADMO: Received message {0@12766533}:%CEA{_connectionID:1732176543475575, _serviceID:ssin, _remoteEndpoint:y.y.y.y:48452, _protocol:https, _request:PUT /usdmp/02C2EFC6E4934F55AEA72CFECFD5C267}
Dec 10 03:29:41 sg-snx ADE: |12766533 2962897654 S3RQ %CEA 2024-12-10T03:29:41.482709| INFO 0131 c70aa44c2e259278 S3RQ: Client IP from create: x.x.x.x
Dec 10 03:29:41 sg-snx ADE: |12766533 2962897654 S3RQ POPD 2024-12-10T03:29:41.485186| DEBUG 3 0167 c70aa44c2e259278 ADMO: Finished message POPD
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< delay 10s
Dec 10 03:29:52 sg-snx ADE: |12766533 2962897654 S3RQ POPD 2024-12-10T03:29:52.474099| DEBUG 3 1158 c70aa44c2e259278 PROC: receive from {2962897655@12766533}: [%DED:[RSLT(FC32):SUCS][CTME(UI64):1732176543485025][CBID(UI64):0xB47944C407AB4ABD][CHID(UUID):A2BDAAA5-2B85-461E-B764-855D71C5FE38][NLOC(UI32):4][DGST(DATA):0x4D443544A2BE9FD2BB9E8E9DFB06AF36C8EAD749][CSIZ(UI64):8957]