TLDR Tech / Data
How Reddit Migrated Petabyte-Scale Kafka from EC2 to Kubernetes
Reddit migrated its petabyte-scale Apache Kafka fleet with over 500 brokers from Amazon EC2 to Kubernetes without any downtime, data loss, or client-side changes. It achieved this by introducing a DNS facade for seamless connection abstraction, doubling cluster size with higher-ID EC2 brokers to free low IDs, and forking Strimzi operator for mixed EC2-Kubernetes operation.
Read the full story