Top 50 A/B Testing Interview Questions
The most frequently asked A/B Testing questions across all roles and companies, ranked by real interview frequency. Updated daily.
Design an A/B test for a new platform feature, including success metrics, power, guardrails, and a clear ship decision.
SteadyDDr. Reddy'sDesign a marketing campaign experiment with a pre-registered metric plan, power calculation, and ship rule that respects guardrails.
Wish
Major League Soccer
SageExplain how a primary metric differs from a guardrail metric and how both are used in A/B test decisions.
Blend360
Redesign Health
Agile DefenseDesign a landing-page A/B test with clear metrics, power, and significance criteria while guarding against common experiment pitfalls.
DoubleVerify
Capchase
PearlExplain why A/B testing matters in marketing analytics and how it supports causal, metric-driven campaign decisions.
Iowa State University
Bastian Solutions
OpenTableInvestigate sample ratio mismatch and decide whether an experiment readout is trustworthy enough to ship.
Meta
Acumen
DropboxExplain how to design and evaluate an A/B test for a product feature, including metrics, MDE, sample size, and guardrails.
PTC
Bungalow
IpsosAnalyze Shopify Checkout experiment vectors using conversion rates, lift, and a two-proportion z-test.
ShopifySign up to see every question
Create a free account to unlock this list and practice real interview questions.