GPT-6 Astra, Looped Transformers, and Hidden Reasoning

2026-09-10

This article surveys recent work on recurrent-depth transformers, where the same blocks are reused across multiple passes to reduce parameter memory without reducing computation. The piece also examines hidden reasoning and what these architectural choices imply for the next generation of language models.