TLDR Tech / AI
Announcing Bonsai 27B: The First 27B-Class Model to Run on a Phone
PrismML announced Bonsai 27B, the first 27B-class model running on a phone, achieved through 1-bit and ternary weights, shrinking the model size to 3.9 GB and 5.9 GB respectively. Bonsai 27B supports complex tasks like multi-step reasoning and tool use while maintaining high performance, fitting securely within the device limits of modern smartphones.
Read the full story