Optimization of LLM Systems with DSPy and LangChain/LangSmith
The most interesting LLM applications are less a single LLM call and more a complex system that relies on multiple LLM calls. Prompt engineering all these LLM calls explicitly can be painful and time consuming. DSPy pioneered the idea of "optimization" of LLM systems; using automatic evaluation to optimize the instructions, few shot examples, and even the weights. LangChain and LangSmith are starting to incorporate some of these in an *online* manner. This video covers why you should think in terms of LLM systems, why optimization can be useful, what components make the most sense to optimize, and how to use DSPy and LangChain/LangSmith to do so.

▶︎
DSPy and ColBERT with Omar Khattab! - Weaviate Podcast #85

▶︎
The Art of Loop Engineering: How to Build Agents That Improve Over Time

▶︎
DSPy Explained!

▶︎
I Built an LLM From Scratch

▶︎
Kubeflow Trainer and Katib Call - 2026/07/08

▶︎
Keynote: After the AI Hype – What’s Real, and What’s Next - Richard Campbell - 2026

▶︎
Bay.Area.AI: DSPy: Prompt Optimization for LM Programs, Michael Ryan

▶︎
Complete DSPy Tutorial - Master LLM Prompt Programming in 8 amazing examples!

▶︎
Learn RAG From Scratch – Python AI Tutorial from a LangChain Engineer

▶︎
Let the LLM Write the Prompts: An Intro to DSPy in Compound AI Pipelines

▶︎
Open Cluster Management - ManifestWork Metrics

▶︎
Flow Engineering with LangChain/LangGraph and CodiumAI

▶︎
How Bridgewater Built an AI Analyst That Does Hours of Expert Research in Minutes

▶︎
432Hz + 528Hz + 741Hz | The Deepest Healing Sleep: Whole Body Regeneration, Remove Insomnia Forever

▶︎
Deploying code agents without all the agonizing pain

▶︎
Stop Prompt Engineering! Program Your LLMs with DSPy

▶︎
System Design Course – APIs, Databases, Caching, CDNs, Load Balancing & Production Infra

▶︎
Omar Khattab, DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelines

▶︎
SICSS Istanbul 2026 | Semantic Search, Embeddings, and Retrieval-Augmented Generation (İnanç Arın)

▶︎
