Optimize an Underperforming Model

HardModel Evaluation00:00

Practice interviewer

In session

5 left

00:00

Your question is Optimize an Underperforming Model. Take a moment with it on the right.

Talk me through your thinking if you like. When you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes).

You need to log in / sign up to chat or submit.

Problem

You have a model in production that is underperforming against business goals. Describe how you would optimize it in a structured way, using validation results, error analysis, and operating threshold decisions rather than trial and error.

Representative Context

Model·Gradient boosted treesUse case·Binary classifier for trade review routing in AladdinMain issue·High train to validation gap and weak precision at current thresholdPositive rate·7.8%

Current Performance

Training AUC: 0.91
Cross validation AUC: 0.78
Production AUC: 0.76
Precision: 0.29
Recall: 0.61
Review queue rate: 18.4%