Dataford
Interview QuestionsInterview GuidesExperiencesMock InterviewsPricing
Get started

AUC vs Online A/B Testing

Medium
Model EvaluationAUC-ROCModel MetricsA/B TestingAsked 1 times

Problem

What are the trade-offs between using offline evaluation metrics like AUC-ROC versus online A/B testing metrics for recommendation systems?

Practicing as: Machine Learning Engineer interview at Samsung Ads

Hi, I'll play your Samsung Ads interviewer for the Machine Learning Engineer role. Candidates describe these interviews as mostly positive and moderately difficult, so expect me to be friendly and conversational. Take your time with the question above and answer like we're in the room.

You are practicing as a guest. Sign up free to get your answer graded with AI feedback. Your draft stays right here.

Sign up freeI have an account
Sign up to unlock solutions
Samsung Ads Machine Learning Engineer Interview QuestionsSamsung Ads Interview Questions
Next questions
YahooOffline vs Online EvaluationMediumPluralsightOffline vs Online Recommendation MetricsMediumOffline and Online EvaluationMedium