TLDR Tech / Data
Modern Data Warehousing at Scale: Arcesium's Migration to DuckDB and Iceberg
Arcesium migrated a 170TB, 15-trillion-record P&L warehouse from an RDBMS to Apache Iceberg on S3 with DuckDB. The new stack cut ingestion runtime by 80% for larger portfolios, reduced egress timeouts, and lowered infrastructure spend by about 40%. The key enablers were a homegrown, open-sourced DuckDB-Iceberg execution layer called Swiftlake, KEDA for Kubernetes autoscaling, and Iceberg time-travel recovery.
Read the full story