The application cannot read some files in the StorageGRID S3 bucket
Applies to
StorageGRID 11.5.0.3 or earlier
Issue
- The application cannot read some files in the StorageGRID S3 bucket.
- An application like spark program does the range read then shows the
Read timed out
error:
Example
21/11/17 17:32:44 WARN TaskSetManager: Lost task 5.0 in stage 47990.0 (TID 1953528, 10.42.63.16, executor 1): java.net.SocketTimeoutException: Failed to re-open s3a://bucket/datalake/db/its/its_sto...snappy.parquet at 1703781 on s3a://bucket/datalake/db/its/its_sto...snappy.parquet: com.amazonaws.SdkClientException: Unable to execute HTTP request: Read timed out