TLDR Tech / Launches
Polars 2.0 enhances dataframe capabilities
The Polars dataframe library has been updated to version 2.0, introducing support for spilling data to disk out-of-core, integrated SQL functionality, and a new Map data type. This update makes the streaming engine and out-of-core spilling the default settings, thereby improving memory efficiency and performance for demanding workloads. Polars 2.0 also enforces stricter data type rules to help identify schema inconsistencies earlier in data processing workflows.
Read the full story