You are an engineering manager for a sports betting and gaming platform team responsible for the in-play bet placement journey across web and mobile. Over the last 2 quarters, your team shipped faster, increasing release frequency from 6 to 11 production releases per month, but customer-facing outcomes were mixed: in-play bet placement conversion moved from 24.8% to 24.1%, checkout latency improved from 1.9s to 1.4s, and incident minutes rose from 38 to 71 per month. Senior leadership wants a clear view of whether the team is actually successful, not just shipping more.
What metrics would you use to determine whether your team is successful, and how would you balance engineering delivery metrics with product, reliability, and customer outcome metrics in this context?