You work on a streaming product team that wants to run an A/B test on a Netflix surface and needs to know whether the experiment is large enough to detect a meaningful change. Leadership is asking for a clear read on sample size and the minimum detectable effect before launch.
How would you think about sample size and minimum detectable effect for this Netflix experiment? Walk through how you would define the test, estimate the required traffic, and decide whether the experiment is worth running.
You work on a streaming product team that wants to run an A/B test on a Netflix surface and needs to know whether the experiment is large enough to detect a meaningful change. Leadership is asking for a clear read on sample size and the minimum detectable effect before launch.
How would you think about sample size and minimum detectable effect for this Netflix experiment? Walk through how you would define the test, estimate the required traffic, and decide whether the experiment is worth running.
