Dataford
Interview QuestionsInterview GuidesExperiencesMock InterviewsPricing
Get started

Plan Sample Size for In-App Experiment

MediumA/B Testing & Experimentation00:00
I
Practice interviewer
Your interviewer
In session
I
Interviewer

Welcome to your interview.

The question is on your right: Plan Sample Size for In-App Experiment. Take a moment with it first.

Talk your thinking through with me if you like - when you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes). Discussion and graded submissions share your five interviewer interactions, so spend them well.

You need to log in / sign up to chat or submit.

Scenario

You work on a consumer marketplace app and are planning an A/B test on a new in-app experience. Leadership wants to know whether the experiment is large enough to detect a meaningful change before you launch it.

Question

How do you think about sample size and power when planning this experiment? Walk through how you would define the minimum detectable effect, choose the primary metric and guardrails, and decide whether the test is feasible.