StorageGRID reports ILM Placement Instruction Unachievable Due to QUORUM Consistency Level Not Achieved
Applies to
StorageGRID 11.x
Issue
- A placement instruction in an ILM rule could not be achieved for certain objects.
- The following alert and related log entries were observed:
Example Alert/Log Output:
- ILM Placement unachievable alert triggered for node <node_name>.
Sep 10 05:36:31 <node_name> ADE: | ... | ERROR 0277 RDRT: retrieveActiveRepairIds CassandraUnavailableException(SELECT repair_id FROM storagegrid.replicated_data_repair_history WHERE completed_time=0 ALLOW FILTERING - CassandraDriverError(Unavailable): 'Cannot achieve consistency level QUORUM' DetailedInfo:[consistency:QUORUM, responses_received:3, responses_required:4])
- Additional log evidence indicated network instability and NTP synchronization issues:
Command: ntpq -pn
Result:
remote refid st t when poll reach delay offset jitter
==============================================================================
<NTP IP> .STEP. 16 u - 64 0 0.000 +0.000 0.000 >>>> not working
- One of the configured NTP servers was not responding, and the NTP stratum count is greater than 3.
