Dataford
Interview QuestionsInterview GuidesExperiencesMock InterviewsPricing
Get started

Compare Marketing Message Effectiveness

MediumA/B Testing & Experimentation00:00
I
Practice interviewer
Your interviewer
In session
I
Interviewer

Welcome to your interview.

The question is on your right: Compare Marketing Message Effectiveness. Take a moment with it first.

Talk your thinking through with me if you like - when you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes). Discussion and graded submissions share your five interviewer interactions, so spend them well.

You need to log in / sign up to chat or submit.

Problem

Scenario

You work on a consumer apparel site and are testing two different marketing messages in a campaign. One message may drive more clicks or purchases, but you also want to avoid harming downstream behavior or creating biased results.

Question

How would you compare the effectiveness of the two messages in an A/B test? Explain how you would define success, choose the randomization unit, and decide whether the result is strong enough to ship.