TLDR Tech / DevOps
Prompt Caching In Agents
Prompt caching makes long-running AI agents faster and cheaper by reusing unchanged prompt prefixes, but adding tools, reordering schemas, switching models, rewriting conversation history, or letting caches expire can eliminate those savings.
Read the full story