Welcome to your interview.
The question is on your right: Evaluate Models in Production. Take a moment with it first.
Talk your thinking through with me if you like - when you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes). Discussion and graded submissions share your five interviewer interactions, so spend them well.
You are responsible for a model that is already live in production. The team wants a clear way to judge whether it is still performing well, whether the current threshold is right, and how to compare offline results with what is happening on real traffic.
How do you handle model evaluation in production?