Dataford
Top 30
Skill roadmap
Updated weekly · Last refresh Aug 30

Top 30 A/B Testing Interview Questions

The most frequently asked questions on this topic across all roles and companies, ranked by real interview frequency. Updated weekly.

30questions
~4htotal time
1,763companies covered
Track your progressSign up free to work through all 30 questions and resume where you left off.
Start practicing free →
1
Network InterferenceStart here. 3 questions · ~24 min
Pitfalls in Streaming Experiment AnalysisHard
Recently asked

Identify major online experiment pitfalls and explain how they can bias results in a streaming product A/B test.

Network InterferenceNovelty EffectSample Ratio MismatchElevate CreditSafaricomFoundry.ai
More Network Interference questions with a free account
2
Experimentation16 questions · ~128 min
Marketing Campaign A/B Test DesignMedium
Recently asked

Design a marketing campaign experiment with a pre-registered metric plan, power calculation, and ship rule that respects guardrails.

ExperimentationHypothesis TestingA/B TestingIdexcelBMC SoftwareSage
Primary vs Guardrail MetricsEasy
Recently asked

Explain how a primary metric differs from a guardrail metric and how both are used in A/B test decisions.

ExperimentationGuardrail MetricsA/B TestingBlend360Redesign HealthAgile Defense
Significance of A/B TestingEasy
Recently asked

Explain why A/B testing matters in marketing analytics and how it supports causal, metric-driven campaign decisions.

ExperimentationGuardrail MetricsA/B TestingIowa State Universitybbits&birdsMutual of Omaha
More Experimentation questions with a free account
3
MDE3 questions · ~24 min
Power Analysis for Survey ExperimentHard
Recently asked

Determine sample size and power for a customer survey or experiment, including MDE, guardrails, and a disciplined decision rule.

MDEPower AnalysisSample SizeMcDonald'sDropboxChenega
More MDE questions with a free account
4
More topics8 questions · ~64 min
Common Pitfalls in Experiment ResultsHard
Recently asked

Identify the main pitfalls that can distort A/B test interpretation and explain how to guard against them.

PeekingNovelty EffectSample Ratio MismatchFifth ThirdNeptune Technology GroupSage
Landing Page Conversion Test DesignMedium
Recently asked

Design a landing-page A/B test with clear metrics, power, and significance criteria while guarding against common experiment pitfalls.

Statistical SignificanceSample SizeA/B TestingDoubleVerifySpring HealthAddison Group
Diagnose Sample Ratio MismatchHard
Recently asked

Investigate sample ratio mismatch and decide whether an experiment readout is trustworthy enough to ship.

Guardrail MetricsSample Ratio MismatchA/B TestingMetaActivisionExperian
More questions with a free account

Sign up to see every question

Create a free account to unlock this list and practice real interview questions.

Get my prep plan
The finish line: interview-readyComplete all 30 questions to finish this plan.