Saving another 100TB of RAM with math (and Rust)
Cloudflare reclaimed more than 100 TB of RAM globally by reducing the memory footprint of a Pingora-based backend router, combining consistent-hashing math with a tighter Rust representation. The post explains how its routing structure grew expensive at Cloudflare scale, then walks through the algorithmic and data-layout changes that made the savings practical across thousands of servers.
HN readers liked the calculus-driven optimization but questioned the sparse crate documentation and asked how the design compares with jump consistent hash; those are useful caveats when interpreting the headline number.