TLDR Tech / AIQwen4's architecture is here early, firing 6B parameters out of 125B2026-08-27Rather than adding experts, the model bolts on 51B parameters as a separate embedding indexed by two- and three-character fragments.Read the full story