Skip to main content
NetApp Knowledge Base

Magic Committer HEAD request failures on bucket in StorageGRID

  1. Last updated
  2. Save as PDF
Views:
75
Visibility:
Public
Votes:
0
Category:
storagegrid-webscale
Specialty:
sgrid
Last Updated:

Applies to

  • NetApp StorageGRID
  • Spark Application
  • S3A Magic Committer

Issue

  • Application using Magic Committer experiencing HEAD request failures on multi part uploads with bucket consistency level read-after-new-write.
  • Application logs showing the following requests/responses:

File Upload: 
25/01/17 04:58:03 66 FILE UPLOAD COMPLETED; UPLOAD COMMIT WRITTEN TO part-XXXX-c000.snappy.parquet.pending

Request: 25/01/17 04:58:03 66 Executor task launch worker for task146.0 in stage 8.0 (TID 406) DEBUG S3AFileSystem: Recursive list of all entries under FileIngestion/ParquetJob/GDP_SPARK/2025-01-17T04:44:05.630014Z/data/__magic/job-XXX/tasks/attempt_X/__base/

Response:
25/01/17 04:58:04 (part-XXXX-c000.snappy.parquet and part-XXXX-c000.snappy.parquet.pending are NOT found is LIST response)

Request: 25/01/17 04:58:04 66 Executor task launch worker for task146.0 in stage 8.0 (TID 406) DEBUG S3AFileSystem: Recursive list of all entriesunder FileIngestion/ParquetJob/GDP_SPARK/2025-01-17T04:44:05.630014Z/data/__magic/job-/tasks/attempt_X/

Response: 25/01/17 04:58:04 (part-XXXX-c000.snappy.parquetand part-XXXX-c000.snappy.parquet.pending are found is LIST response as expected)

  • StorageGRID bycast.log records:

OBDR: Metadata request failed for unknown '<bucketname>/FileIngestion/ParquetJob/GDP_SPARK/2025-01-17T04:44:05.630014Z/data/__magic/job-XXXX/tasks/attempt_X/__base/part-XXXX-c000.snappy.parquet'

Sign in to view the entire content of this KB article.

New to NetApp?

Learn more about our award-winning Support

NetApp provides no representations or warranties regarding the accuracy or reliability or serviceability of any information or recommendations provided in this publication or with respect to any results that may be obtained by the use of the information or observance of any recommendations provided herein. The information in this document is distributed AS IS and the use of this information or the implementation of any recommendations or techniques herein is a customer's responsibility and depends on the customer's ability to evaluate and integrate them into the customer's operational environment. This document and the information contained herein may be used solely in connection with the NetApp products discussed in this document.