TLDR Tech / AI
DFlash and Spec V2 Decoding
Detailing the latest generation of speculative decoding with DFlash and SGLang's Spec V2 engine. Benchmarks showed substantial throughput gains over baseline inference and native MTP speculation.
Read the full story