Dataford
Popular roles
Software EngineerData AnalystData ScientistData EngineerBusiness AnalystAI EngineerMachine Learning EngineerProduct Manager
Browse
Browse All RolesEvery role hub, from analyst to MLBrowse All CompaniesCompany-specific interview loopsAll Interview GuidesThe full guide library
Top questions by role
Software EngineerData AnalystData ScientistData EngineerBusiness AnalystAI EngineerMachine Learning EngineerProduct Manager
Top questions by skill
SQLPythonStatisticsMachine LearningA/B TestingSystem DesignGenerative AIProduct SenseMetricsBehavioral
Browse all questions →Try a mock interview
ExperiencesCoaching
New
Practice
Mock InterviewsTimed interview simulations with feedbackSuccess PathYour 6-week structured planModulesCurated lessons by topicWebinarsTalks from ex-Big Tech data leadsPlaygroundA free-form scratch editor
Learn
BlogInterview strategy and career adviceTech Job Market ReportHiring trends across data and AI rolesFor UniversitiesDataford for career centersAbout DatafordWho we are and how we build
Pricing
Get started

Push Notification Reactivation Experiment Design

MediumStatistics & Probability00:00
Practice interviewer
In session
5 left
00:00

Whenever you're ready, walk me through how you'd approach this.

You need to log in / sign up to chat or submit.

Problem

Business Context

RideNow wants to reactivate dormant riders with a new push notification. A rider is considered dormant if they have not taken a trip in the last 28 days.

Problem Statement

Design and evaluate an A/B test to determine whether the new push notification increases 7-day reactivation rate versus the current notification. Use the data below to test for statistical significance, quantify uncertainty, and assess whether the experiment had enough power.

Given Data

GroupEligible Dormant RidersReactivated Within 7 DaysReactivation Rate
Control (current push)48,0002,6405.50%
Treatment (new push)48,0003,0246.30%

Additional planning inputs:

ParameterValue
Significance level0.05
Test typeOne-tailed
Baseline reactivation rate5.50%
Minimum detectable effect0.60 percentage points
Desired power80%

Requirements

  1. Define the experimental unit, randomization strategy, and primary metric.
  2. State the null and alternative hypotheses.
  3. Compute the observed lift in reactivation rate.
  4. Run a two-sample proportion z-test using the observed data.
  5. Construct a 95% confidence interval for the treatment-control difference.
  6. Estimate the required sample size per group for the stated MDE and power.
  7. Recommend whether RideNow should roll out the new push, and name at least three guardrails or design risks.

Assumptions

  • Randomization is at the rider level and each rider appears once.
  • Push delivery infrastructure is stable across groups.
  • No interference between riders.
  • Reactivation is defined as completing at least one trip within 7 days of notification.