Dataford
Interview QuestionsInterview GuidesExperiencesMock InterviewsPricing
Get started

Planning Sample Size for a Conversion Test

HardA/B Testing & Experimentation00:00
Practice interviewer
In session
5 left
00:00

Your question is Planning Sample Size for a Conversion Test. Take a moment with it on the right.

Talk me through your thinking if you like. When you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes).

You need to log in / sign up to chat or submit.

Problem

Scenario

You work on a digital product team that wants to test a change to a key conversion flow. The team needs to know whether the experiment is worth running, how much traffic it will require, and what outcomes would justify shipping.

Question

How do you think about sample size and power when planning this experiment? Walk through how you would define the hypothesis, choose the primary metric and guardrails, and decide whether the test is worth launching.