TLDR Tech / Data
Scaling StreamHub: Transitioning from Kinesis to Kafka for 145 Billion Daily Events
Atlassian moved from Kinesis to Kafka on AWS MSK as traffic rose from 22 billion to 150 billion events a day. Tiered Storage cut costs, but incidents exposed broker, S3, control-plane, and disk limits. Quotas, sharding, spare capacity, backups, and failover were critical.
Read the full story