Top 30 A/B Testing Interview Questions
The most frequently asked questions on this topic across all roles and companies, ranked by real interview frequency. Updated weekly.
Identify major online experiment pitfalls and explain how they can bias results in a streaming product A/B test.
Foundry.ai
Alcon
SeatgeekDesign a marketing campaign experiment with a pre-registered metric plan, power calculation, and ship rule that respects guardrails.
Publishers Clearing House
Idexcel
LiteratiExplain how a primary metric differs from a guardrail metric and how both are used in A/B test decisions.
Blend360
Redesign Health
SigmoidExplain why A/B testing matters in marketing analytics and how it supports causal, metric-driven campaign decisions.
Iowa State University
Bastian Solutions
Zoom CommunicationsDetermine sample size and power for a customer survey or experiment, including MDE, guardrails, and a disciplined decision rule.
DISH
Experian
McDonald'sIdentify the main pitfalls that can distort A/B test interpretation and explain how to guard against them.
Southern California Edison
Sage
Fifth ThirdDesign a landing-page A/B test with clear metrics, power, and significance criteria while guarding against common experiment pitfalls.
DoubleVerify
Pluralsight
PaddleInvestigate sample ratio mismatch and decide whether an experiment readout is trustworthy enough to ship.
Meta
Cendyn
DropboxSign up to see every question
Create a free account to unlock this list and practice real interview questions.