TLDR Tech / IT
Ensuring reliable OpenTelemetry ingestion at scale
ClickHouse details the evolution of its LogHouse observability platform to manage OpenTelemetry ingestion at 50 million events per second without data loss during backpressure. After deeming in-memory queues and local collector write-ahead logs insufficient, they developed a priority-based failover pipeline that prioritizes ClickHouse and utilizes blob storage as a durable overflow buffer.
Read the full story