TLDR Tech / Data
Introducing Apache Spark 4.2
Apache Spark 4.2 adds metric views for defining business metrics, SQL vector similarity search, native geospatial types, and change data capture queries through a new CHANGES clause. Spark Connect and default Arrow optimized Python execution make the engine easier to reach. The release bundles over 1,900 commits from more than 260 contributors.
Read the full story