How Modalities Learn Together

2026-08-07

Meta researchers explored how modalities learn together during pretraining. They also identified architectures that promote cross-modal synergy and recipes that achieved strong generation performance with 5% of the compute budget.