Multiple node expansion leads to imbalance of ECG distribution and node utilization
Applies to
Ingesting EC data to newly expanded storage nodes
Issue
- Expand a grid with multiple new nodes.
- While continuing to ingest EC data we observe that as data is put on the new nodes, it does not balance evenly to all newly added nodes.
- Please note that data will never be completely evenly distributed.
- This issue is for drastically higher usage on some newly added nodes vs other newly added nodes.
- EXAMPLE: New Node 1 has 50% usage while other newly added nodes have 20% usage.
- Some new nodes appear to be getting utilized far more than others.
- As ingest continues, the gaps between new node utilization continue to grow.
