An Engineering Manager at NXP Semiconductors leads a 42-person firmware and validation team building software for the S32 Design Studio and supporting releases for the S32K automotive MCU platform. Over the last 2 quarters, leadership has seen mixed signals: release frequency improved from 6 to 9 production releases per quarter, but escaped defects rose from 14 to 23, and average cycle time increased from 11 to 16 days.
The VP of Engineering asks you to define a metric framework to determine whether the team is actually performing well, rather than relying on a single output metric. The team ships customer-facing SDK updates, internal tooling improvements, and silicon validation fixes. In the same period, story points completed increased 18%, on-time milestone delivery fell from 88% to 76%, Sev-1 production incidents increased from 2 to 5, employee attrition rose from 4% to 9%, and internal developer satisfaction dropped from 8.1 to 7.2 out of 10.
You need to recommend a balanced KPI set that captures delivery speed, quality, predictability, and team health, and explain how you would diagnose trade-offs between them.