TLDR Tech / AI
New ways to balance cost and reliability in the Gemini API
Google has added two new service tiers to the Gemini API that give users granular control over cost and reliability. Flex Inference is a new cost-optimized tier designed for latency-tolerant workloads without the overhead of batch processing. The Priority Inference tier offers the highest level of assurance at a premium price point to help ensure users' most important traffic isn't preempted, even during peak platform usage. The new tiers eliminate the complexity of async job management while giving users the economic and performance benefits of specialized tiers.
Read the full story