Dataford
Interview QuestionsInterview GuidesExperiencesMock InterviewsPricing
Get started

Sample Size for A/B Tests

Easy
Statistics & ProbabilityPower AnalysisSample SizeA/B Testing
Asked 2mo ago|
Tiger Analytics
Tiger Analytics
Asked 47 times

Problem

Scenario

You're planning an experiment on a product surface and need to decide how much traffic to allocate and how long to run it. You want the test to be sensitive enough to detect a meaningful lift without running longer than necessary.

Question

How do you determine the right sample size and test duration for an A/B test?

Example Inputs

Alpha·0.05Power·0.80Absolute MDE·0.6 percentage pointsTraffic split·50/50Baseline conversion·12.0%Daily exposed users·50,000Target relative lift·5.0%

You are practicing as a guest. Sign up free to get your answer graded with AI feedback. Your draft stays right here.

Sign up freeI have an account
Sign up to unlock solutions
Wealthfront Data Scientist Interview QuestionsAsana Spa Data Scientist Interview QuestionsMicrosoft Data Analyst Interview QuestionsNestlé USA Data Analyst Interview QuestionsMUFG Data Scientist Interview Questions
Next questions
Zest AIDetermining A/B Test Sample SizeMediumGro IntelligenceDetermine A/B Sample SizeMediumHA/B Test Sample SizeMedium
0 / ~200 words