TLDR Tech / AI
FlashMemory DeepSeek-V4 Retriever
FlashMemory predicts which DeepSeek-V4 CSA KV-cache chunks future tokens will attend to, keeping only the most relevant chunks on GPU. The retriever reportedly preserves or improves downstream performance while retaining about 10–15% of the KV cache on-device.
Read the full story