Dataford
Interview QuestionsInterview GuidesExperiencesMock InterviewsPricing
Get started

Pitfalls in A/B Testing

MediumA/B Testing & Experimentation00:00
St Engineering
Your interviewer · Data Scientist
In session
Interviewer

Welcome to your interview for the Data Scientist role at St Engineering.

The question is on your right: Pitfalls in A/B Testing. Take a moment with it first.

Talk your thinking through with me if you like - when you're confident, submit your answer and I'll grade it like a real screen. You have three graded attempts to score 7/10 or better.

Only Submit answer is graded - discussion is free practice.

Problem

What pitfalls can invalidate an A/B test, such as novelty effects, network interference, or sample ratio mismatch?