TLDR Tech / Dev
How Well Do Agents Use Test and Verification Techniques?
Across 26 testing conditions for a Rust Zstd task, no technique dramatically outperformed the others, and the default prompt performed above average. Fuzzing and property-based testing helped slightly in some high-effort runs, while TDD and several testing skills underperformed. Agents often followed the requested framework superficially, writing ordinary tests inside new tools or proving properties that did not improve correctness.
Read the full story