TLDR Tech / Dev
Client-Side Load Balancing at a Million Requests Per Second
A client-side load balancer was developed to handle over a million requests per second of internal traffic, migrating routing decisions from a shared edge load balancer, Skipper, to improve latency and system resilience while reducing costs. It included features like occupancy-based bounded load and AZ-aware routing strategies to improve performance and efficiency.
Read the full story