Dataford
Top 50
Topic roadmap
Updated weekly · Last refresh Sep 14

Top 50 experiment design Interview Questions

The most frequently asked experiment design questions across all roles and companies, ranked by real interview frequency. Updated daily.

50questions
~7htotal time
648companies covered
Track your progressSign up free to work through all 50 questions and resume where you left off.
Start practicing free →
1
A/B Testing & ExperimentationStart here. 47 questions · ~376 min
Design Test for New FeatureMedium
Recently asked

Design an A/B test for a new platform feature, including success metrics, power, guardrails, and a clear ship decision.

experiment designfeature evaluationA/B TestingHHilti GroupSteadyDDr. Reddy's
Design Test for Product LaunchMedium

Design an A/B test for a new digital product launch with clear metrics, power, guardrails, and a defensible ship decision.

experiment designGuardrail Metricsprimary metricsHewlett Packard Enterprise | HPEConstellation EnergyStrategic Research Insights
Incrementality Test for Card CampaignHard
Recently asked

Design an incrementality experiment for a co-branded card campaign, including lift metric, power, guardrails, and launch criteria.

experiment designincremental liftGuardrail MetricsNextrollSeatgeekMastercard
A/B Test for Trading WorkflowMedium
Recently asked

Design an experiment for a new trading signal or workflow change, including metrics, power, randomization, and launch criteria.

experiment designGuardrail Metricsprimary metricsJane StreetGoldman Sachs BankCME Group
Pitfalls in Concurrent ExperimentsHard
Recently asked

Identify and mitigate interference, metric contamination, SRM, peeking, and multiple-testing risks across concurrent experiments.

experiment designGuardrail Metricsuser baseAsana SpaOptumMayo Clinic
Considerations for A/B Test DesignHard
Recently asked

Design a feature experiment with clear hypotheses, metrics, power, randomization, analysis rules, and safeguards against common pitfalls.

experiment designconsiderationsGuardrail MetricsRipplingDData Science SoftwareAsana Spa
Experiment Design for a Mobile AppHard
Recently asked

Design a mobile feature A/B test with clear hypotheses, metrics, MDE, power, randomization, analysis, and shipping criteria.

experiment designMDEmobile appEEnelRipplingMcKinsey &
Design Instagram Push A/B TestMedium

Design an Instagram push-notification A/B test with MDE, guardrails, randomization, and long-term tradeoffs.

experiment designGuardrail Metricsprimary metricsMeta
More A/B Testing & Experimentation questions with a free account

Sign up to see every question

Create a free account to unlock this list and practice real interview questions.

Get my prep plan
2
Statistics & Probability3 questions · ~24 min
More Statistics & Probability questions with a free account
The finish line: interview-readyComplete all 50 questions to finish this plan.