TLDR Tech / Data
S3 is the perfect place to store data, until you try to search it
Firn is an open-source API for fast vector and full-text search on S3-backed data, using Lance plus caching to make repeated queries extremely fast. It's useful for teams that want searchable object storage without the cost or complexity of running OpenSearch.
Read the full story