Skip to main content
NetApp Knowledge Base

H610S - 7 Drives simultaneously marked as Failed

Views:
599
Visibility:
Public
Votes:
0
Category:
element-software
Specialty:
solidfire
Last Updated:

Applies to

  • NetApp H610S
  • All versions of Element Software

Issue

  • 7 drives go missing and are marked as failed at the same time
  • The 7 drives are always in slots 3, 4, 7, 8, 9, 10, and 11
  • The drives cannot be unfailed until the node is rebooted (even if the drives are reseated or replaced)
  • When this issue occurs the following events are logged in the cluster UI and in SolidFire Active IQ:
    • The events start with "driveFailed" with a list of the 7 drive IDs:
      • Error Code: driveFailed
      • Details: 7 drive(s) with state: "DriveMissing" driveID: <list-of-drive-IDs>
    • After this is an "unresponsiveService" event for each of the 7 drives:
      • Error Code: unresponsiveService
      • Details: A block service is not responding.
    • Finally, after the 330 second timeout is reached a "blockServiceUnhealthy" event is logged for each of the 7 drives, indicating that block syncs are starting:
      • Error Code: blockServiceUnhealthy
      • Details: A block service is unhealthy and SolidFire is attempting to migrate data away from it.
    • At SolidFire Active IQ iEEvent and ureEvent events logged for all failed 7 drives under Reporting, Error Log page (disk location and mount point might differ):
      • Type: iEEvent
        • Message: return code:4
        • Details: { "throwFile": "shared/BasicFile.cpp", "logContext.requestID": "2069906437", "throwFunction": "size_t solidfire::BasicFile::ReadRaw(uint8_t*, off_t, size_t, solidfire::AllowReadTruncation)", "throwLine": 286, "logContext.sourceID": "1437", "whatString": "/dev/nvme4n1: Input/output error", "exceptionCode": "xFileReadFailed", "currentStack": "", "streamDetails": 1 }
      • Type: ureEvent
        • Message: Unrecoverable Read Error
        • Details: { "Exception": "xFileReadFailed", "Fatal": true, "Repaired": false, "DiskLocation": 1241407822912 }

 

CUSTOMER EXCLUSIVE CONTENT

Registered NetApp customers get unlimited access to our dynamic Knowledge Base.

New authoritative content is published and updated each day by our team of experts.

Current Customer or Partner?

Sign In for unlimited access

New to NetApp?

Learn more about our award-winning Support

 

 

  • Was this article helpful?