TLDR Tech / Data
Powering Multimodal Intelligence for Video Search
Netflix built a multimodal video search architecture to surface key moments across hundreds to thousands of hours of footage, replacing brittle keyword search with AI-driven retrieval over characters, scenes, dialogue, and embeddings. The system uses overlapping temporal segmentation, Cassandra for high-throughput annotation storage, Kafka for asynchronous processing, and Elasticsearch for real-time querying, with one-second buckets and composite-key upserts to maintain a single source of truth.
Read the full story