Top 50 experimental design Interview Questions
The most frequently asked experimental design questions across all roles and companies, ranked by real interview frequency. Updated daily.
Determine A/B test sample size from baseline rate, MDE, significance level, and power, then validate the calculation through simulation.
MoneeDesign an evaluation harness to measure autonomous-agent task success, hallucination rate, calibration, and robustness before production deployment.
Citi
Devoteam
GE VernovaDesign and evaluate a contextual multi-armed bandit that balances exploration and exploitation for Netflix content recommendations.
eBay
NetflixUse causal modeling and sensitivity analysis to evaluate whether state lotteries improve public outcomes without confusing prediction with policy justif...
Oscar HealthCompare random forest with gradient boosting, then design price experiments and optimize expected profit from demand predictions.
InstacartDesign a movie and series similarity score, then validate whether it improves Roku recommendations against a production baseline.
RokuSign up to see every question
Create a free account to unlock this list and practice real interview questions.
Compare UX experimental designs, their estimands, sources of bias, and appropriate statistical tests.
GoogleDesign an A/B testing framework to compare a new data delivery model against the existing model.
MSD