Brain the Size of a Planet: Are LLMs Thonking too Hard?

2026-06-18

An analysis of various LLMs in triaging security vulnerabilities showed that a council of four LLMs achieved an impressive 86.2% unanimous agreement on findings, while lower reasoning efforts consistently performed poorly. Although higher reasoning generally correlated with better results, there were exceptions where models struggled with complex tasks.