TLDR Tech / Dev
QVAC SDK: run local LLMs, now with 5x more context
Run local LLMs, speech, and image models fully on-device with QVAC, an open-source SDK. One npm install, no cloud, no API keys. The latest update integrated TurboQuant, unlocking up to 5x more context from the same machine, near-lossless. Get it on GitHub or see the docs at qvac.tether.io.
Read the full story