Digest | Jul/Aug/Sep/Oct 2025
I like Thinking Machines, but more than that, I’m grateful.
Building a web search engine from scratch in two months with 3 billion neural embeddings
blog.wilsonl.inEnd-to-end deep dive of the project, spanning a large GPU cluster, distributed RocksDB, and terabytes of sharded HNSW.
Search is hard
Search is the process of finding useful matches in a (large) set of objects (search corpus). A search engine is only as good as the representations it uses to m
Building a web search engine from scratch in two months with 3 billion neural embeddings
I stumbled upon this quite bonkers article about building a web search engine from scratch as a solo developer with relatively modest resources, i absolutely can recommend reading it: Building a web search engine from scratch in two months with 3 billion neural embeddings