blockServiceUnhealthy occurred from multiple drives

Last updated
Save as PDF
Share
1. Share
2. Tweet
3. Share

Views:: 31

Visibility:: Public

Votes:: 0

Category:: h-series

Specialty:: hci

Last Updated:

Applies to

H610S
Element OS 12.3.2.3

Issue

blockServiceUnhealthy occurred on the following three drives due to an Unrecoverable read error
The drives have been moved to available pool

Events:

3016730 2025-06-30T11:23:06.183Z iEEvent return code:4 71 12   { "throwFile": "shared/BasicFile.cpp", "throwFunction": "virtual size_t solidfire::BasicFile::WriteV(const solidfire::SmartBuffer&, const solidfire::SmartBuffer&, off_t)", "throwLine": 436, "whatString": "/dev/nvme2n1: No space left on device", "exceptionCode": "xFileWriteFailed", "currentStack": "", "streamDetails": 1 }

3016739 2025-06-30T11:23:06.159Z iEEvent return code:4 72 12   { "throwFile": "shared/BasicFile.cpp", "throwFunction": "virtual size_t solidfire::BasicFile::WriteV(const solidfire::SmartBuffer&, const solidfire::SmartBuffer&, off_t)", "throwLine": 436, "whatString": "/dev/nvme3n1: No space left on device", "exceptionCode": "xFileWriteFailed", "currentStack": "", "streamDetails": 1 }

3016737 2025-06-30T11:23:06.143Z iEEvent return code:4 73 12   { "throwFile": "shared/BasicFile.cpp", "throwFunction": "virtual size_t solidfire::BasicFile::WriteV(const solidfire::SmartBuffer&, const solidfire::SmartBuffer&, off_t)", "throwLine": 436, "whatString": "/dev/nvme4n1: No space left on device", "exceptionCode": "xFileWriteFailed", "currentStack": "", "streamDetails": 1 }

3016718 2025-06-30T11:22:52.356Z ureEvent Unrecoverable Read Error 71 12 51 { "Exception": "xFileReadTruncated", "Fatal": true, "Repaired": false, "DiskLocation": 3016976211456 }

3016717 2025-06-30T11:22:52.352Z ureEvent Unrecoverable Read Error 72 12 52 { "Exception": "xFileReadTruncated", "Fatal": true, "Repaired": false, "DiskLocation": 2913754897664 }

3016719 2025-06-30T11:22:52.351Z ureEvent Unrecoverable Read Error 73 12 53 { "Exception": "xFileReadTruncated", "Fatal": true, "Repaired": false, "DiskLocation": 2896420114752 }

Error log:

241 2025-06-30T11:28:48.559Z Error service 12 node_name 53 Yes 2025-06-30T11:58:21.168Z blockServiceUnhealthy A block service is unhealthy and SolidFire is attempting to migrate data away from it.

240 2025-06-30T11:28:48.558Z Error service 12 node_name 52 Yes 2025-06-30T11:58:21.167Z blockServiceUnhealthy A block service is unhealthy and SolidFire is attempting to migrate data away from it.

239 2025-06-30T11:28:48.557Z Error service 12 node_name 51 Yes 2025-06-30T11:58:21.166Z blockServiceUnhealthy A block service is unhealthy and SolidFire is attempting to migrate data away from it.

235 2025-06-30T11:23:48.352Z Error cluster 0   0 Yes 2025-06-30T11:57:39.761Z blocksDegraded Only a single complete copy of the block data is accessible.  Restore any offline nodes or block services or contact support for assistance.