TLDR Tech / Dev
Open Data: A Dataset Hub for LLM Serving Research
This hub publishes production-scale request traces, GPU telemetry, and agent-serving datasets for studying batching, scheduling, cache reuse, sessions, and infrastructure behavior.
Read the full story