Your question is Online and Offline LLM Evaluation. Take a moment with it on the right.
Talk me through your thinking if you like. When you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes).
How do you evaluate LLM results and make adjustments in online and offline modes based on your project?
Asked in the Technical Phone Screen stage. Deep dive discussion based on candidate's project. Focus on how you would measure quality, detect regressions, and update prompts, retrieval, or models without breaking production behavior.