Top 50
Topic roadmap
Updated weekly · Last refresh Nov 5

Top 50 A/B Testing Interview Questions

The most frequently asked A/B Testing questions across all roles and companies, ranked by real interview frequency. Updated daily.

50questions
~8htotal time
2,136companies covered
Track your progressSign up free to work through all 50 questions and resume where you left off.
Start practicing free →
1
A/B Testing & ExperimentationStart here. 35 questions · ~331 min
Design Test for New FeatureMedium
Recently asked

Design an A/B test for a new platform feature, including success metrics, power, guardrails, and a clear ship decision.

experiment designfeature evaluationA/B TestingHHilti GroupSteadyDDr. Reddy's
Marketing Campaign A/B Test DesignMedium
Recently asked

Design a marketing campaign experiment with a pre-registered metric plan, power calculation, and ship rule that respects guardrails.

ExperimentationHypothesis TestingA/B TestingWishMajor League SoccerSage
Primary vs Guardrail MetricsEasy
Recently asked

Explain how a primary metric differs from a guardrail metric and how both are used in A/B test decisions.

ExperimentationGuardrail MetricsA/B TestingBlend360Redesign HealthAgile Defense
Landing Page Conversion Test DesignMedium
Recently asked

Design a landing-page A/B test with clear metrics, power, and significance criteria while guarding against common experiment pitfalls.

Statistical SignificanceSample SizeA/B TestingDoubleVerifyCapchasePearl
More A/B Testing & Experimentation questions with a free account
2
Statistics & Probability8 questions · ~76 min
A/B Testing for Product FeaturesMedium
Recently asked

Explain how to design and evaluate an A/B test for a product feature, including metrics, MDE, sample size, and guardrails.

Hypothesis TestingStatistical SignificanceA/B TestingPTCBungalowIpsos
More Statistics & Probability questions with a free account
3
Metrics4 questions · ~38 min
More Metrics questions with a free account
4
More topics3 questions · ~28 min
SQL and Experiment Case StudyHard
Practice
Recently asked

Combine joins, aggregations, and window functions to compare conversion and order metrics across A/B test variants.

Joinssqldata validationInstacart
Analyze A/B Test ResultsMedium
Practice

Analyze Shopify Checkout experiment vectors using conversion rates, lift, and a two-proportion z-test.

pythonA/B TestingShopify
Top Users SQL QueryMedium
Practice

Count valid daily interactions and return the top three users using aggregation and deterministic ranking.

data cleaningDate FunctionsGroup By

Sign up to see every question

Create a free account to unlock this list and practice real interview questions.

Get my prep plan
Hands-on SQL practiceWrite and run real queries in the editor. 1 drill · ~10 min
The finish line: interview-readyComplete all 50 questions plus 1 hands-on drill to finish this plan.