Top 50 experiment design Interview Questions
The most frequently asked experiment design questions across all roles and companies, ranked by real interview frequency. Updated daily.
Design an A/B test for a new platform feature, including success metrics, power, guardrails, and a clear ship decision.
SteadyDDr. Reddy'sDetermine the sample size needed to detect a meaningful A/B test effect at a chosen significance level and power.
Identify major online experimentation pitfalls and explain practical mitigations for SRM, network effects, peeking, and novelty.
Design an A/B test for a new digital product launch with clear metrics, power, guardrails, and a defensible ship decision.
Hewlett Packard Enterprise | HPEGGames Workshop
Constellation EnergyExplain how to select, execute, and interpret statistical significance tests for A/B test results.
HeadwayIInfrrdSSylveraDetermine A/B test sample size from baseline rate, MDE, significance level, and power, then validate the calculation through simulation.
MoneeDesign a feature experiment with clear hypotheses, metrics, power, randomization, analysis rules, and safeguards against common pitfalls.
Prime VideoCalculate the sample size needed for statistical significance using baseline rate, MDE, alpha, power, and experiment constraints.
Amazon Data ServicesUUniversity of TorontoSign up to see every question
Create a free account to unlock this list and practice real interview questions.