TLDR Tech / AI
String-matching evals can reward AI agents for fake compliance
Checking whether generated code contains “Azure” only proves that the word appears somewhere, not that an agent actually used Azure or built working software.
Read the full story