TLDR Tech / Data
How we built a lab to evaluate data agents
Hex built Shoebox, an internal eval “lab bench” for data agents, so teams can compare candidate runs against stable production baselines and judge improvements across prompts, models, memory, search, and workspace context. They also created Shorelane Commerce, a realistic fake business with messy warehouse data, because simple text-to-SQL benchmarks do not reflect the ambiguity, context, and data debt real analytics agents must handle.
Read the full story