Model Collapse Is Already Happening, We Just Pretend It Isn't

2026-03-27

Model collapse, where AI models degrade over time, is already happening as new systems are increasingly trained on data generated by previous AI models. This recursive process smooths out rare and diverse patterns, leading to a loss of variance and homogenization in outputs.