TLDR Tech / Launches
Google releases ML Drift for on-device GPU AI inference
The Google AI Edge Team has made ML Drift, an open-source compute engine for AI and machine learning inference on edge devices using GPUs, publicly available. ML Drift functions as the primary acceleration engine within LiteRT and can also be used independently. It supports various low-level APIs including OpenGL ES, OpenCL, Metal, and WebGPU, addressing the diverse hardware found at the edge. Google reports substantial performance and latency enhancements in applications like Chrome, YouTube Shorts, Google Photos, and third-party apps such as Adobe Lightroom and Snapchat.
Read the full story