Dataford
Interview QuestionsInterview GuidesExperiencesMock InterviewsPricing
Get started

Choose the Right Analysis Unit

MediumA/B Testing & Experimentation00:00
Practice interviewer
In session
5 left
00:00

Your question is Choose the Right Analysis Unit. Take a moment with it on the right.

Talk me through your thinking if you like. When you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes).

You need to log in / sign up to chat or submit.

Problem

Scenario

You work on a streaming product where a new feature is being evaluated through an experiment, but the team also wants to compare feedback from a customer survey tied to the same launch. Some users may generate multiple sessions or responses, and leadership is unsure whether the right analysis unit is the user, session, or household.

Question

How would you choose the right unit of analysis for the survey or experiment, and how would that choice affect the metric definition, statistical test, and interpretation of results?