TLDR Tech / AI
AI21 uses Kueue to manage a 10,000-GPU fleet
AI21 describes replacing ad hoc GPU-capacity negotiations with queueing and fair scheduling across a shared Google Cloud cluster. A Google Cloud case study says high-priority workloads began 83% sooner under the new setup.
Read the full story