Omar Khattab on Late Interaction in 2030

Omar Khattab argues that single-vector retrieval is running out of road, and the gap between what dense embeddings can do and what reasoning models can do represents the most exciting open problem in AI right now. This talk covers the first principles case for late interaction, the accumulation of evidence over the years, and a roadmap for where the field needs to go by 2030.