Kubernetes as AI Infrastructure: Google Cloud, llm-d, and the CNCF

2026-04-03

Google Cloud announced that llm-d, co-founded with Red Hat, IBM Research, CoreWeave, and NVIDIA, has been accepted as a CNCF Sandbox project. The project provides an open-source foundation for distributed AI inference, aiming to support any model, accelerator, and cloud without vendor lock-in.