Imagine you run a messaging app used by billions of people. Every day, people upload photos, videos, and text as Status updates . But there is one important rule: a Status should disappear after about 24 hours. Now imagine you have to clean up billions of expired Statuses every day . Your first thought might be: “Easy. Just run a query that deletes everything older than 24 hours.” Something like:…
WIKI SEARCH
NO QUERY SERVER. JUST OBJECT STORAGE + YOUR BROWSER.
Type a question to search 100,000 Wikipedia articles. ParqDB builds an IVF-LVQ8 index over their MiniLM embeddings and publishes it to object storage as immutable Parquet files. Your browser embeds the query, reads only the required byte ranges, and ranks results in WASM. No query server sees your data.
QUERY──> vector DB──READ──> o…
Whenever someone asks me to add search to an application, I try to find ways around it. The implementation itself isn't the problem, it's everything that comes with it: extra components to manage, more failure points, and the constant challenge of keeping data in sync. For the past few years, I've worked a lot with DynamoDB and with the introduction of Vector Search I feel a lot more comfortable …
research.io