Top 50 primary metrics Interview Questions
The most frequently asked primary metrics questions across all roles and companies, ranked by real interview frequency. Updated daily.
Determine the sample size needed to detect a meaningful A/B test effect at a chosen significance level and power.
Design an A/B test for a new digital product launch with clear metrics, power, guardrails, and a defensible ship decision.
Hewlett Packard Enterprise | HPEGGames Workshop
Constellation EnergyExplain how to select, execute, and interpret statistical significance tests for A/B test results.
HeadwayIInfrrdSSylveraDetermine A/B test sample size from baseline rate, MDE, significance level, and power, then validate the calculation through simulation.
MoneeDesign a feature experiment with clear hypotheses, metrics, power, randomization, analysis rules, and safeguards against common pitfalls.
Prime VideoCalculate the sample size needed for statistical significance using baseline rate, MDE, alpha, power, and experiment constraints.
Amazon Data ServicesDesign an experiment for a new trading signal or workflow change, including metrics, power, randomization, and launch criteria.
Jane Street
Goldman Sachs Bank
CME GroupSign up to see every question
Create a free account to unlock this list and practice real interview questions.
Explain how statistical significance differs from practical significance and how both affect an A/B test decision.