TLDR Tech / AI
Cactus Needle (GitHub Repo)
Cactus Needle is a 26M parameter Simple Attention Network distilled from Gemini 3.1 that can be finetuned locally on a Mac/PC. It runs on Cactus at 6,000 tokens per second prefill and 1,200 decode speed. The weights are fully open. Simple Attention Networks are aimed at redefining AI for consumer devices like phones, watches, and glasses.
Read the full story