Dataford
Interview QuestionsInterview GuidesExperiencesMock InterviewsPricing
Get started

Debug Sudden Accuracy Drop

MediumModel Evaluation00:00
Practice interviewer
In session
5 left
00:00

Your question is Debug Sudden Accuracy Drop. Take a moment with it on the right.

Talk me through your thinking if you like. When you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes).

You need to log in / sign up to chat or submit.

Problem

Scenario

You are the owner of a deployed classification model that had been stable for months, then its accuracy fell by 15% in the latest monitoring window. The model still feeds decisions into a live workflow, so the drop is already affecting downstream users and business outcomes. The team wants you to explain whether this is a data issue, a threshold issue, or a real model regression.

Question

How would you handle a situation where a deployed model's accuracy suddenly drops by 15%?