Study suggests neural networks have specialized neurons

2026-10-15

Preliminary analyses of Qwen3-32B indicate that approximately 90% of its neurons perform a single primary function, with some minor secondary roles. Another 7% appear to handle two related tasks, while the remaining 2-4% remain not fully understood. The proportion of single-function neurons can vary based on activation thresholds, circuit density, and the definition of a "single job."