TLDR Tech / Data
Building an Obsidian RAG with DuckDB and MotherDuck
A local-first Retrieval-Augmented Generation (RAG) pipeline for Obsidian notes uses DuckDB as an embedded vector database to store embeddings, intelligently chunks Markdown files while retaining backlinks and the full knowledge graph structure, and supports powerful semantic search combined with two-hop traversals to reveal hidden connections between ideas. The system then syncs data to MotherDuck, enabling a lightweight, serverless web app that executes DuckDB queries directly in the browser.
Read the full story