Dataford
Popular roles
Software EngineerData AnalystData ScientistData EngineerBusiness AnalystAI EngineerMachine Learning EngineerProduct Manager
Browse
Browse All RolesEvery role hub, from analyst to MLBrowse All CompaniesCompany-specific interview loopsAll Interview GuidesThe full guide library
Top questions by role
Software EngineerData AnalystData ScientistData EngineerBusiness AnalystAI EngineerMachine Learning EngineerProduct Manager
Top questions by skill
SQLPythonStatisticsMachine LearningA/B TestingSystem DesignGenerative AIProduct SenseMetricsBehavioral
Browse all questions →Try a mock interview
ExperiencesCoaching
New
Practice
Mock InterviewsTimed interview simulations with feedbackSuccess PathYour 6-week structured planModulesCurated lessons by topicWebinarsTalks from ex-Big Tech data leadsPlaygroundA free-form scratch editor
Learn
BlogInterview strategy and career adviceTech Job Market ReportHiring trends across data and AI rolesFor UniversitiesDataford for career centersAbout DatafordWho we are and how we build
Pricing
Get started

Seasonality-Adjusted Retention Trend Test

MediumStatistics & Probability00:00
Practice interviewer
In session
5 left
00:00

Whenever you're ready, walk me through how you'd approach this.

You need to log in / sign up to chat or submit.

Problem

Business Context

StreamBox, a subscription video platform, saw lower January retention than December and wants to know whether retention is actually declining or if the drop is just normal post-holiday seasonality.

Problem Statement

You are given monthly cohort retention rates for the same acquisition channel over two years. The product team wants a seasonality-adjusted estimate of year-over-year retention change and a statistical test of whether the underlying retention level has improved.

Given Data

The table below shows month-level Day-30 retention for Jan-Jun in two consecutive years.

MonthYear 1 RetentionYear 2 RetentionYear 1 Cohort SizeYear 2 Cohort Size
Jan41.2%43.1%12,40012,900
Feb42.0%44.0%11,80012,100
Mar44.1%45.0%13,10013,400
Apr45.0%46.2%12,90013,000
May46.3%47.1%13,50013,700
Jun47.1%48.0%13,20013,500

Assume the monthly pattern is seasonal and repeats similarly across years.

Requirements

  1. Compute the naive average retention for each year and the naive year-over-year difference.
  2. Explain why comparing December to January, or even raw averages across different month mixes, can be misleading when seasonality exists.
  3. Estimate the seasonality-adjusted year-over-year lift by comparing matched months.
  4. Construct a 95% confidence interval for the mean matched-month lift.
  5. Test whether the average matched-month lift is greater than 0 at α=0.05\alpha = 0.05α=0.05 using a paired t-test.
  6. State whether the evidence supports a real retention improvement after accounting for seasonality.

Assumptions

  • Each month pair represents the same seasonal position across years.
  • Monthly matched differences are approximately independent.
  • A paired t-test is appropriate for the six month-level differences.
  • Cohort definitions and measurement windows are consistent across both years.