Dataford
Interview QuestionsInterview GuidesExperiencesMock InterviewsPricing
Get started

Evaluating Imbalanced Classification Models

MediumModel Evaluation00:00
Practice interviewer
In session
5 left
00:00

Your question is Evaluating Imbalanced Classification Models. Take a moment with it on the right.

Talk me through your thinking if you like. When you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes).

You need to log in / sign up to chat or submit.

Problem

Scenario

You are reviewing a classifier on a dataset where the positive class is rare, and the team is worried that standard evaluation can give a misleading picture of performance. You need to explain how you would judge whether the model is actually useful when most examples belong to the negative class.

Question

How do you evaluate a model on imbalanced datasets?

Observed Metrics

Recall·0.68AUC-ROC·0.93Accuracy·99.1%F1 score·0.51Precision·0.41Class prevalence·0.8%