Cloudflare Reclaims 100 TB of RAM by Optimizing Consistent Hashing
Cloudflare cut more than 100 TB from the memory footprint of its load-balancing service by making its Rust consistent-hashing rings smaller without sacrificing their target distribution.
The team used probability analysis to reduce hash points per backend by about 90%; it also packed each remaining hash point into six bytes instead of the previous eight. They rolled out the new ring gradually alongside the old one, since switching all traffic at once could have churned caches and sent a surge of requests to origin servers. InfoQ has no reader-comment section.