Dataford
Interview QuestionsInterview GuidesExperiencesMock InterviewsPricing
Get started

Sample Size for Feature Experiment

HardStatistics & Probability00:00
Practice interviewer
In session
5 left
00:00

Your question is Sample Size for Feature Experiment. Take a moment with it on the right.

Talk me through your thinking if you like. When you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes).

You need to log in / sign up to chat or submit.

Problem

Scenario

You are planning an A/B test for a new in-app feature in a ride-hailing product. The current user-level conversion rate on the primary metric is 18.0%, and you want to detect an absolute lift of 1.2 percentage points with 80% power at a 5% two-sided significance level using a 50/50 traffic split.

Question

How many users do you need in each variant to reliably detect the target effect, and what total sample size should you plan for?