Every post comes from something I've done on a real project. AI tools, development approaches, how I actually build things. You're getting a curation of my taste, not takes on stuff I don't use. Subscribers also get extras: things that went wrong, how my thinking about AI is changing, hacky workflows I use every day, and the occasional personal update. Stuff I share with subscribers because it's a little too personal or unpolished to blast across the internet.
better rag with late interaction free talk
|
Hey this is Isaac, Hamel Husain and I are doing a free public talk on why better RAG starts with late interaction. Most RAG still follows the "embed the chunks, embed the query, compare the vectors” approach. But top retrieval architectures follow a new approach. People do not upgrade because it requires a different setup and they think it’s only an incremental improvement. Companies like Nvidia, AWS, and Cursor have adopted it because it’s a big step up. It’s not just benchmark games. A client struggled with poor search results as a major user pain point. They spent months optimizing each part of their search pipline: hybrid search, rerankers, dataset curation, chunking, labeling, and other experimentation (query rewriting, decomposition, model choice, etc.). The client switched to a simpler late interaction search setup, which basically solved their search quality issues. I’ve seen this many times. In this talk, I will walk through how late interaction is different, why it gives better results, and the engineering tricks that make it work in practice. It's free. Link here: https://maven.com/p/2d7a1c/better-rag-retrieval-with-late-interaction Hope to see you there, Isaac |
Isaac Flath
Every post comes from something I've done on a real project. AI tools, development approaches, how I actually build things. You're getting a curation of my taste, not takes on stuff I don't use. Subscribers also get extras: things that went wrong, how my thinking about AI is changing, hacky workflows I use every day, and the occasional personal update. Stuff I share with subscribers because it's a little too personal or unpolished to blast across the internet.
Hey this is Isaac, Here are a couple demos of things I thought were cool. Then an update on a new project i'm working on with Hamel Husain. First, I’ve been working on Raw2Draft (my writing tool). I just added D3 diagrams to markdown and html text editing and I use one or the other most working hours. D3 is a low level visualization library that gives maximum flexibility but is very painful to write. But agents write D3 surprisingly well and it's amazing for adding visuals to help with...
Hey this is Isaac, Hamel Husain and I are doing a free public talk on tool architecture anti-patterns for agents: MCP, skills, CLIs, plugins, and custom tools. Some of the most popular and widely used skills, CLIs, and mcp’s fall into one of these anti-patterns. Is MCP good? Are skills enough? Should this be a CLI? That is the wrong starting point. A tool call is a product surface and should be created with the same care given to any other user facing page. When it’s treated like plumbing to...
Today's post is about a project that I will take concepts from to improve my own work. So I studied the OSS prototype of it to understand how it works. Point and Talk: How Clicky’s AI Interface Works Clicky is an AI buddy made by Farza that lives on your Mac. You press a key, talk, and a glowing blue triangle flies across your screen, points at whatever you asked about, and talks you through the answer. Most apps with an agent should have something like this. Point and talk is closer to how...