StorageGRID Bucket configured with OpenShift Cluster gives Error failed to flush PUT use of closed network connection
Applies to
- StorageGRID 11.6.0
- Redhat OpenShift Cluster (OCP)
- Network observability Operator
Issue
- Configured StorageGRID bucket within OCP cluster for storing network flows using Network observability Operator
- Application giving below error intermittently during PUT:
2023-08-21T12:01:48.647777489Z level=error ts=2023-08-21T12:01:48.590723063Z caller=flush.go:144 org_id=network msg="failed to flush" err="failed to flush chunks: store put chunk: RequestError: send request failed\ncaused by: Put \"http://<>:10444/<Bucket>/network/<>/<>\": readfrom tcp <Application IP>:57462-><Loadbalancer IP>:10444: write tcp <Application IP>:57462-><Loadbalancer IP>:10444: use of closed network connection, num_chunks: 716, labels: {DstK8S_OwnerName=\"<>\", FlowDirection=\"0\", SrcK8S_OwnerName=\"<>\", app=\"netobserv-flowcollector\"}"
- Error from
bycast.log:
HTTP Status Code=500, ErrorMsg=InternalError, ErrorType=Client, CustomErrorMessage={<none>}, Details={asyncPop error: no producer}