TLDR Tech / AI
MiniMax teases upcoming M3 model with new sparse attention mechanism and 15.6X long-context response speed boost
MiniMax has released a new in-depth technical report on the making of its popular M2 series of language models. The report sheds light on numerous engineering innovations and clever approaches. It teases a new sparse attention approach used in MiniMax's upcoming series of models that yields up to 15.6 times faster decode speed at long contexts. MiniMax's upcoming M3 models will make ultra-long-context AI agent deployment economically viable.
Read the full story