How we built a real-world evaluation platform for autonomous SRE agents at scale

2026-05-08

Datadog built a replayable evaluation platform for its Bits AI SRE agent using diverse, production-derived labels and simulated noisy environments to measure performance, detect regressions, and continuously improve agent reliability across complex incident investigations.