TLDR Tech / AI
How we optimized Dash's relevance judge with DSPy
Dropbox Dash puts files, messages, and teams' knowledge together in one place, so members can ask questions and get useful answers grounded in the company's context. The experience relies heavily on its capability to reliably judge which results are relevant to a query at scale. DSPy is an open source framework for systematically optimizing prompts against a measurable objective. This post describes how Dropbox defined an objective, used DSPy to adapt its judge across models, and made the judge both cheaper and more reliable in production.
Read the full story