Interview Questions
Interview Guides
Experiences
Explore
Get started
Sign in
Interview Guides
All questions
/
Model Evaluation
Offline AUC Up, Online CTR Down
Medium
Problem
A model's offline AUC went up but online CTR went down. What's happening?
Question
Answer
Problem
A model's offline AUC went up but online CTR went down. What's happening?
Your answer
Edit
Preview
Try one AI text evaluation on us
Get structured feedback, scored against a 4-axis rubric. Premium unlocks unlimited.
0 words
target ~200
Try a free preview
Stuck? Get a hint
Past attempts
Up next
Offline vs Online Metrics Mismatch
Medium
Diagnose Offline-Online Performance Gap
Hard
Diagnose Offline-Online Recommendation Failure
Medium
Next question
Offline AUC Up, Online CTR Down | Dataford Interview Questions
