Problem
Scenario
You're planning an experiment on a product change and need to decide whether the test is worth running. Before launch, you want to know how much traffic you need and what size effect the experiment can realistically detect.
Question
How would you think about sample size and power before launching an experiment?
Example Anchor
alpha·0.05power·0.80absolute_mde·0.012allocation_ratio·1:1target_relative_lift·0.100baseline_conversion_rate·0.120
Practicing as: Data Scientist interview at Blue Cross Blue Shield Of MassachusettsHi, I'll play your Blue Cross Blue Shield Of Massachusetts interviewer for the Data Scientist role. Candidates describe these interviews as mostly positive and moderately difficult, so expect me to be friendly and conversational. Take your time with the question above and answer like we're in the room.
You are practicing as a guest. Sign up free to get your answer graded with AI feedback. Your draft stays right here.
