Is there a way to determine the amount of network traffic generated by ILM replication across sites or by SiteWide Erasure Coding in StorageGRID?
Applies to
StorageGRID
Answer
- No, StorageGRID does not have a built-in feature to view total network traffic between sites.
- It only provides network traffic monitoring on a per-node basis.
Note: While you cannot directly view site-to-site total traffic, aggregating the per-node data for all nodes in a site can provide an estimate of inter-site traffic.
Additional Information
You can check the network traffic for each node using the following methods:
- Checking via GRID Manager Dashboard
- The GRID Manager dashboard displays network traffic statistics for each node in both graphical and numerical formats.
- Navigate to: Nodes > Select Target Node > Network tab
- Here, you can view metrics such as bytes sent and received, as well as transfer rates.
- This allows you to observe trends in data transfer, including those caused by ILM operations.
- Retrieving Metrics via Prometheus API
- StorageGRID includes Prometheus-based monitoring, which allows you to retrieve detailed metrics using the API.
- For example, you can use metrics like
node_network_transmit_bytes_totalandnode_network_receive_bytes_totalto quantitatively obtain network transfer volumes for each node. - By using the API, you can aggregate data over specific periods and automate report generation.
Example: https://<StorageGRID_IP>/metrics/graph?g0.expr=node_network_receive_bytes_total&g0.tab=0&g0.display_mode=lines&g0.show_exemplars=0&g0.range_input=1h
