TLDR Tech / DevOps
LiteRT-LM (GitHub Repo)
LiteRT-LM is an open-source inference framework designed to deploy large language models on edge devices like Raspberry Pi, Chromebooks, and Pixel Watch with high performance. The framework already powers on-device AI features in Chrome and Chromebook Plus. It can be tested immediately via terminal using the LiteRT-LM CLI without writing any code.
Read the full story