Problem
Scenario
You changed the onboarding flow and saw better retention afterward. The concern is that the lift may reflect selection effects or broader user mix changes rather than the onboarding itself.
Question
How would you evaluate whether a change in onboarding is actually causal, rather than just correlated with better retention?
What this tests
- Can you distinguish correlation from causation in product retention analysis?
- Do you know when randomized experiments are the cleanest design?
- Can you use regression adjustment when randomization is unavailable?
- Can you interpret effect size, uncertainty, and business impact together?
Practicing as: Product Growth Analyst interview at AsanaHi, I'll play your Asana interviewer for the Product Growth Analyst role. Candidates describe these interviews as often stressful and moderately difficult, so expect me to be direct and to the point. Take your time with the question above and answer like we're in the room.
You are practicing as a guest. Sign up free to get your answer graded with AI feedback. Your draft stays right here.
