Improving Composer through real-time RL

2026-03-27

'Real-time RL' is a technique created by the Cursor team that involves using real inference tokens for training. The team serves model checkpoints to production, observes user responses, and aggregates those responses as reward signals. The approach allows them to ship an improved version of Composer as often as every five hours.