Project Context
Meta’s Facebook Reels team wants to change how a ranking improvement program is managed. Historically, the team has been measured on output: number of model launches, experiments shipped, and ranking features delivered. After several quarters of high shipping velocity but flat watch-time satisfaction, leadership wants the next half’s roadmap managed to outcomes instead.
You are the Engineering Manager for a 12-person team supporting Reels ranking on Facebook, partnering with one Product Manager, one Data Scientist, and shared teams in Integrity, Infra, and Core ML. You have 16 weeks before the next planning review, where the VP expects evidence that the team can tie delivery to measurable user and business impact.
Key Stakeholders
The PM wants visible feature launches for the roadmap review. The Data Science lead wants cleaner experiment design and fewer parallel launches. The Integrity team is concerned that aggressive engagement optimization could increase low-quality or borderline content. The Infra team has limited capacity and prefers no major online serving changes this quarter.
Constraints
- Timeline: 16 weeks total, with a midpoint checkpoint in Week 8
- Team: 8 engineers, 2 ML engineers, 1 TPM, 1 EM; no new headcount
- Budget: $350K for labeling, offline evaluation, and limited contractor support
- Dependency: Core ML can support only 1 major model architecture change this half
- Reliability guardrail: Reels ranking latency cannot increase by more than 8 ms at p95
- Launch requirement: Any change above 5% traffic needs Integrity review and rollback readiness
Complications
- The PM has already committed to shipping 6 ranking features this half in the planning draft.
- A previous Reels launch improved short-term watch time by 2.1% but hurt 7-day retention by 0.8%, making leadership skeptical of output-based progress.
- Two senior engineers are allocated 25% to oncall support for Facebook Feed ranking incidents.
Deliverables
- Define how you would reframe the roadmap from output-based commitments to outcome-based commitments.
- Propose a 16-week execution plan, including checkpoints, launch sequencing, and decision points.
- Specify the success criteria, guardrails, and how you would handle trade-offs between shipping velocity and measurable impact.
- Explain how you would align stakeholders with competing priorities and reset expectations on the 6-feature commitment.
- Identify the top execution risks and your mitigation plan.
