TLDR Tech / Launches
StepFun Open-Sources Step 5 Preview Model
StepFun has made the weights for its Step 5 Preview model publicly available under a custom license. This sparse mixture-of-experts model boasts 600 billion total parameters, with 27 billion active parameters and a 1 million token context window, intended for long-horizon agent tasks. Accompanying the release are developer tools and a technical blog explaining the model's architecture. The FP8 and BF16 checkpoints can be found on Hugging Face and ModelScope.
Read the full story