Dataford
Dataford
Top 30
Skill roadmap
Updated weekly · Last refresh Oct 18

Top 30 A/B Testing Interview Questions

The most frequently asked questions on this topic across all roles and companies, ranked by real interview frequency. Updated daily.

30questions
~4htotal time
2,260companies covered
Track your progressSign up free to work through all 30 questions and resume where you left off.
Start practicing free →
1
experiment designStart here. 4 questions · ~32 min
Design Test for New FeatureMedium
Recently asked

Design an A/B test for a new platform feature, including success metrics, power, guardrails, and a clear ship decision.

experiment designfeature evaluationA/B TestingHHilti GroupSteadyDDr. Reddy's
More experiment design questions with a free account
2
Network Interference4 questions · ~32 min
Pitfalls in Streaming Experiment AnalysisHard
Recently asked

Identify major online experiment pitfalls and explain how they can bias results in a streaming product A/B test.

Network InterferenceNovelty EffectSample Ratio MismatchFoundry.aiEtsyMITRE
More Network Interference questions with a free account
3
Experimentation13 questions · ~104 min
Marketing Campaign A/B Test DesignMedium
Recently asked

Design a marketing campaign experiment with a pre-registered metric plan, power calculation, and ship rule that respects guardrails.

ExperimentationHypothesis TestingA/B TestingWishMajor League SoccerSage
Primary vs Guardrail MetricsEasy
Recently asked

Explain how a primary metric differs from a guardrail metric and how both are used in A/B test decisions.

ExperimentationGuardrail MetricsA/B TestingBlend360Redesign HealthAgile Defense
Significance of A/B TestingEasy
Recently asked

Explain why A/B testing matters in marketing analytics and how it supports causal, metric-driven campaign decisions.

ExperimentationGuardrail MetricsA/B TestingIowa State UniversityBastian SolutionsOpenTable
More Experimentation questions with a free account
4
MDE3 questions · ~24 min
Power Analysis for Survey ExperimentHard
Recently asked

Determine sample size and power for a customer survey or experiment, including MDE, guardrails, and a disciplined decision rule.

MDEPower AnalysisSample SizeTaboolaDropboxChenega
More MDE questions with a free account
5
More topics6 questions · ~48 min
Common Pitfalls in Experiment ResultsHard
Recently asked

Identify the main pitfalls that can distort A/B test interpretation and explain how to guard against them.

PeekingNovelty EffectSample Ratio MismatchDDr. Reddy'sHHoliduNeptune Technology Group
Landing Page Conversion Test DesignMedium
Recently asked

Design a landing-page A/B test with clear metrics, power, and significance criteria while guarding against common experiment pitfalls.

Statistical SignificanceSample SizeA/B TestingDoubleVerifyCapchasePearl
More questions with a free account

Sign up to see every question

Create a free account to unlock this list and practice real interview questions.

Get my prep plan
The finish line: interview-readyComplete all 30 questions to finish this plan.