StorageGRID Cassandra Communication Error - AutoSupport Message
Applies to
NetApp StorageGRID
Event Summary
- StorageGRID reports
CassandraCommunicationErrorindicating nodes that run the Cassandra service are having trouble communicating with each other. - This alert indicates that something is interfering with node-to-node communications. There might be a network issue , the Cassandra service might be down on one or more Storage Nodes or the nodes are overloaded preventing communication
Validate
Confirm the Cassandra services are running:
- Login in the Primary Admin node via SSH
- Switch to root
- Run below two command to verify the status of both services on each storage node:
run-each-node --service ldr --parallel 'service cassandra status'
Through StorageGRID GUI pre StorageGRID 12: Support > Grid Topology > Storage Node > SSM > Services (verify on a per node basis)
Resolution
- Upgrade, hotfix, decommission, or E-Series storage upgrade in progress. The alert clears when the job finishes:
- StorageGRID 12.0.0.5 or earlier, with Cassandra CPU spikes from SSTable growth:
- Cassandra is not Running:
- Run
service cassandra start - Procedure: Start or restart a StorageGRID service
- Run
- Cassandra is Running and the node is overloaded. Often seen with Unable to communicate with node (
jmx). Leave the service running and reduce the workload: nodetool statusshows DN, or nodes are online and still cannot reach each other:- Cassandra is Running on every storage node and the alert is still active. Contact NetApp Technical Support.
Additional Information
N/A
