Your question is A/B Test for User Retention. Take a moment with it on the right.
Talk me through your thinking if you like. When you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes).
How would you design an A/B test to assess the effectiveness of a new feature in improving user retention?
Explain how you would formulate the hypothesis, define retention and guardrail metrics, choose the randomization unit, and determine the required sample size. State the assumptions you would need when traffic, baseline retention, and the testing time budget are not provided. Include an analysis plan covering significance testing, peeking, sample ratio mismatch, and the final ship or do-not-ship rule.
