Don't let the LLM speak, just probe it

2026-06-11

Answers often reside within LLMs' hidden states before any token generation. By extracting the hidden state at the last prompt token, feeding it into a small multilayer perceptron, and calibrating the output, it's possible to bypass generation entirely. This method creates a frozen model that functions as a classifier configurable in English.