RAG & RetrievalTalk (25 min)Intermediate
Your RAG Pipeline Is Lying To You
Monday, October 12 · 10:00 AM to 10:25 AM PDT · Golden Gate Ballroom
Retrieval metrics look great in eval and fall apart in production. We instrumented ours end to end and found three failure modes nobody writes about.
- Track
- RAG & Retrieval
- Format
- Talk (25 min)
- Level
- Intermediate
- Room
- Golden Gate Ballroom
Speaker
- Staff Engineer, Vectorworks
Sarah has spent four years making retrieval systems fail less often in production. She writes about the parts nobody benchmarks.