TLDR Tech / Dev
Performance per dollar is getting faster and cheaper
The release of GLM-5.2 shows advancements in inference performance, with 2626 tok/s/node on AMD MI355X at more than twice the cost-efficiency compared to similar NVIDIA setups. Despite historical challenges with AMD's software support, improvements in model optimization are narrowing the gap.
Read the full story