TLDR Tech / Data
Polars in Aggregate: Streaming Expands, Lakehouse I/O, and Cloud Profiling
Polars' latest release cycle pushes the streaming engine closer to default use by expanding support to streaming merge joins, as-of joins, and streaming scans/sinks across CSV, NDJSON, IPC, and cloud reads. It also adds native Delta Lake and Iceberg roundtrips, including direct lazy writes back to Delta and sink_iceberg() for commit-ready streaming pipelines. Polars Cloud now includes query profiling with per-stage CPU, RAM, network, and shuffle metrics.
Read the full story