TLDR Tech / Practical
NVIDIA Vera Rubin NVL72 Achieves High Token Throughput
For instance, the same GPU power allocated to the Vera Rubin NVL72 can process approximately five times more DeepSeek V4 Pro tokens per second compared to the GB300 NVL72, reaching about 165 tokens per second per user.
Read the full story