StorageGRID CassandraRepairProgressSlow after an expansion

Last updated
Save as PDF
Share
1. Share
2. Tweet
3. Share

Views:: 1,028

Visibility:: Public

Votes:: 0

Category:: storagegrid

Specialty:: sgrid

Last Updated:

Applies to

NetApp StorageGRID
StorageGRID Expansion
Cassandra Repair

Issue

StorageGRID UI reports CassandraRepairProgressSlow following a GRID expansion.
From any storage node spreaper list-runs records a previous aborted job as expected during an expansion:
- "blacklisted_tables": [],
  "cause": "auto-scheduled run (schedule id XXXXX)",
  "cluster_name": "storagegrid",
  "column_families": [
  "object_by_uuid",
  "s3_key_versions_by_bucket",
  "s3_multipart_uploads_by_bucket",
  "object_by_cbid",
  "object_by_version"
  ],
  "creation_time": "2026-10-01T06:25:23Z",
  "current_time": "2026-10-21T16:16:50Z",
  "datacenters": [],
  "duration": "14 days 11 hours 32 minutes 14 seconds",
  "end_time": "2026-10-15T17:57:38Z",
  "estimated_time_of_arrival": null,
  "id": "xxxxx",
  "incremental_repair": false,
  "intensity": 1.0,
  "keyspace_name": "storagegrid",
  "last_event": "Aborted based on topology changes",
  "nodes": [],
  "owner": "storagegrid",
  "pause_time": null,
  "repair_parallelism": "PARALLEL",
  "repair_thread_count": 4,
  "repair_unit_id": "xxxxx",
  "segments_repaired": 2857,
  "start_time": "2026-10-01T06:25:23Z",
  "state": "ABORTED",
  "total_segments": 5312 },
The current repairs are running slower based on the previous completion time of the repairs prior to the expansion:
- Example:
  - Before expansion storagegrid schedule took ~4 days to complete:
    - "creation_time": "2026-09-26T16:53:29Z",
      "current_time": "2026-10-21T16:16:50Z",
      "duration": "4 days 13 hours 30 minutes 23 seconds",
      ...
      "keyspace_name": "storagegrid",
      "owner": "storagegrid",
      ...
      "segments_repaired": 5312,
      "state": "DONE",
      "total_segments": 5312
  - After expansion, schedule has been running for 5+ days and only 52 completed out of 5739:
    - "creation_time": "2026-10-15T17:57:24Z",
      "current_time": "2026-10-21T16:16:50Z",
      "duration": "5 days 22 hours 19 minutes 25 seconds",
      .... "id": "XXXXXXXX-c8c1-11f1-82e6-f1bd1a08aa4e",
      "keyspace_name": "storagegrid",
      "owner": "storagegrid",
      ...
      "segments_repaired": 52,
      "start_time": "2026-10-15T17:57:24Z",
      "state": "RUNNING",
      "total_segments": 5739