TLDR Tech / Data
Client-Side Load Balancing at a Million Requests Per Second
Zalando built a high-performance client-side load balancer in-process for their Product Read API to handle over a million requests per second of internal fan-out traffic, replacing the shared edge ingress Skipper for batch requests. They implemented consistent hashing matching Skipper, Kubernetes watch-based discovery, N-ring fade-in for smooth scale-ups, and AZ-aware routing.
Read the full story