Top 50 A/B Testing Interview Questions
The most frequently asked A/B Testing questions across all roles and companies, ranked by real interview frequency. Updated daily.
Design an A/B test for a new platform feature, including success metrics, power, guardrails, and a clear ship decision.
SteadyDDr. Reddy'sDesign a marketing campaign experiment with a pre-registered metric plan, power calculation, and ship rule that respects guardrails.
Wish
Major League Soccer
SageExplain how a primary metric differs from a guardrail metric and how both are used in A/B test decisions.
Blend360
Redesign Health
Agile DefenseDesign a landing-page A/B test with clear metrics, power, and significance criteria while guarding against common experiment pitfalls.
DoubleVerify
Capchase
PearlExplain how to design and evaluate an A/B test for a product feature, including metrics, MDE, sample size, and guardrails.
PTC
Bungalow
IpsosCombine joins, aggregations, and window functions to compare conversion and order metrics across A/B test variants.
InstacartAnalyze Shopify Checkout experiment vectors using conversion rates, lift, and a two-proportion z-test.
ShopifyCount valid daily interactions and return the top three users using aggregation and deterministic ranking.
Sign up to see every question
Create a free account to unlock this list and practice real interview questions.
