Dataford
Interview QuestionsInterview GuidesExperiencesMock InterviewsPricing
Get started

Visualizing A/B Test Results

HardA/B Testing & Experimentation00:00
Practice interviewer
In session
5 left
00:00

Your question is Visualizing A/B Test Results. Take a moment with it on the right.

Talk me through your thinking if you like. When you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes).

You need to log in / sign up to chat or submit.

Problem

Scenario

You support a product team running online experiments on a travel booking surface. They need a results view that helps them understand whether a treatment is working, whether the effect is trustworthy, and whether any guardrail metrics are being harmed. The challenge is to present statistical evidence clearly without encouraging misreads from noisy early data.

Question

How would you design a visualization to support experimentation results for a product team? Explain what you would show for the primary metric, guardrails, uncertainty, and experiment health so that teams can make better launch decisions.

What the visualization must surface

  • Primary metric lift with confidence interval
  • Guardrail status and thresholds
  • Experiment health checks such as SRM
  • Readiness state: underpowered vs decision-ready