Welcome to your interview for the Agentic AI Engineer role at Kraken Digital Asset Exchange.
The question is on your right: Define Model Success Metrics. Take a moment with it first.
Talk your thinking through with me if you like - when you're confident, submit your answer and I'll grade it like a real screen. You have three graded attempts to score 7/10 or better.
You are asked to judge whether an AI model is successful after a pilot rollout. The team wants a clear answer, but the model is used in a setting where different kinds of mistakes have different costs.
Describe how you would evaluate the success of an AI model.