TLDR Tech / Practical
Netflix Updates Workflow Engine Conductor
Netflix has undertaken a significant overhaul of its internal workflow orchestration system, Conductor, to accommodate its rapid expansion, now managing over 420 million workflow executions monthly. The updated design features a modernized data plane leveraging Cassandra and Timestone, a partitioned task model supporting up to 30,000 tasks per workflow, asynchronous evaluation to minimize latency, and a type-safe Java Workflow SDK.
Read the full story