TLDR Tech / Launches
Aleph Alpha's Kolibri 1 open model needs patches for local use
Aleph Alpha has made available Kolibri 1, an open-source mixture-of-experts model with 78.1 billion parameters, activating 3.46 billion per token and supporting a 1-million-token context. Released under an Apache 2.0 license, it utilizes a hybrid sliding-window attention and quantile balancing for efficiency with long contexts. Running it locally currently requires manual software adjustments due to a lack of widespread support.
Read the full story