Project Background
ShopHub, a mid-size e-commerce marketplace, launched a new Saved Lists feature 8 weeks ago on iOS, Android, and web. The feature lets users save products into named lists and share them with others. You are the program manager responsible for evaluating whether the launch was successful and recommending what the team should do next.
The launch involved a cross-functional team of 11 people: 4 engineers, 1 designer, 1 data analyst, 1 product manager, 1 QA lead, and 3 go-to-market/support partners. Leadership wants a clear after-the-fact assessment before committing budget for phase 2. The decision is urgent because Q3 roadmap planning closes in 2 weeks.
Key Stakeholders
The VP of Product wants evidence that Saved Lists improves retention and repeat purchase behavior. The Growth lead cares most about list sharing and invite-driven acquisition. The Engineering manager is concerned about rising page latency and support tickets since launch. Customer Support wants a simpler version because users are confused by list collaboration settings.
Constraints
- You have 10 business days to deliver the assessment.
- Only 1 analyst is available at 50% capacity.
- The feature launched to 100% of users at once, so there was no clean A/B test.
- You can use product analytics, support tickets, and user research from 20 interviews, but no new survey budget is available.
- Leadership expects a recommendation before the next roadmap review, with no extension.
Complications
- A major summer promotion ran during weeks 2-4 after launch, affecting purchase behavior.
- Android instrumentation for list-sharing events was partially broken for the first 12 days.
- Early usage looks high, but support tickets about accidental public sharing increased by 18%.
Your Task
- Define how you would determine whether the feature launch was successful after the fact.
- Propose the metrics, baselines, and comparison methods you would use despite imperfect data.
- Recommend whether to scale, iterate, or roll back parts of the feature.
- Outline the stakeholder communication plan and decision criteria.
- Identify the top risks in making a post-launch decision and how you would mitigate them.
