Dataford
Interview QuestionsInterview GuidesExperiencesMock InterviewsPricing
Get started

Retention Change vs Seasonality

HardStatistics & Probability00:00
Practice interviewer
In session
5 left
00:00

Your question is Retention Change vs Seasonality. Take a moment with it on the right.

Talk me through your thinking if you like. When you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes).

You need to log in / sign up to chat or submit.

Problem

Scenario

You launched a retention-facing change on a Meta surface such as Instagram Reels or Facebook Groups, and retention moved right after launch. The same period overlaps with known seasonal traffic patterns, so a simple before-after read is not enough.

Question

How would you diagnose whether a launch caused a change in retention versus a seasonal effect?

Meta context

  • Primary metric is retention, often read alongside AARRR funnel movement
  • Useful covariates include pre-period retention, prior Reels engagement, and Instagram Save behavior
  • If this came from an experiment, check Sample Ratio Mismatch before trusting treatment-control comparisons
  • Watch for novelty effect if the post-launch lift decays quickly