TLDR Tech / AI
Tuna-2
Tuna-2 outperforms both Tuna-R and Tuna across a diverse suite of multimodal benchmarks by using pixel embeddings. Meta plans to only release a foundation checkpoint rather than the full production-trained model weights. The release will have a small number of layers removed from both the LLM backbone and the diffusion head, but the remaining layers and all other components are fully preserved. Examples of images generated by the model are available in the repository.
Read the full story