TLDR Tech / Dev
Sunk Cost
Sunk Cost estimates when local AI hardware will break even against paying for model APIs, and it is willing to conclude that it never will. The calculator factors in model fit, local speed, daily token use, context size, input-to-output ratio, electricity, API latency, and falling API prices.
Read the full story