Problem
Scenario
You launched a retention-facing change on a Meta surface such as Instagram Reels or Facebook Groups, and retention moved right after launch. The same period overlaps with known seasonal traffic patterns, so a simple before-after read is not enough.
Question
How would you diagnose whether a launch caused a change in retention versus a seasonal effect?
Meta context
- Primary metric is retention, often read alongside AARRR funnel movement
- Useful covariates include pre-period retention, prior Reels engagement, and Instagram Save behavior
- If this came from an experiment, check Sample Ratio Mismatch before trusting treatment-control comparisons
- Watch for novelty effect if the post-launch lift decays quickly
Practicing as: Product Growth Analyst interview at MetaHi, I'll play your Meta interviewer for the Product Growth Analyst role. Candidates describe these interviews as mixed and hard, so expect me to be structured and detail-hungry. Take your time with the question above and answer like we're in the room.
You are practicing as a guest. Sign up free to get your answer graded with AI feedback. Your draft stays right here.
