TLDR Tech / IT
Saving another 100TB of RAM with math (and Rust)
Cloudflare explains how relatively small changes to the consistent-hashing implementation used by one of its Pingora services allowed it to reclaim more than 100TB of RAM across its global infrastructure. It is a great example of how engineering economics change at hyperscale: shaving bytes from a data structure and reducing unnecessary hash replicas can turn into infrastructure savings measured in hundreds of terabytes.
Read the full story