Your question is Trace and Optimize RAG Performance. Take a moment with it on the right.
Talk me through your thinking if you like. When you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes).
How would you trace a decrease in performance of a RAG system, and how would you optimize it?
Asked in the Technical round stage. Asked because the candidate's work focused on RAG.
Treat this as a hands-on debugging and optimization exercise. Explain how you would localize the regression across ingestion, chunking, embedding, retrieval, reranking, prompt construction, generation, and serving. Discuss the measurements, experiments, and safeguards you would use.