Dataford
Interview QuestionsInterview GuidesExperiencesMock InterviewsPricing
Get started

Determining A/B Test Significance

MediumStatistics & Probability00:00
I
Practice interviewer
Your interviewer
In session
I
Interviewer

Welcome to your interview.

The question is on your right: Determining A/B Test Significance. Take a moment with it first.

Talk your thinking through with me if you like - when you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes). Discussion and graded submissions share your five interviewer interactions, so spend them well.

You need to log in / sign up to chat or submit.

Problem

Scenario

You're evaluating a marketing experiment on a digital campaign and need to decide whether the observed lift is real or just noise. You are asked to explain how you would assess the result and communicate whether the experiment was statistically significant.

Question

How do you determine the statistical significance of a marketing experiment?