You are a product growth analyst for a fleet management platform, and weekly active engagement in the Motive Driver App fell from 41% of eligible drivers to 34% in the two weeks after a new home screen and task flow shipped. Average sessions per active driver also dropped from 5.2 to 4.1, while overall eligible driver count stayed flat. The product team believes the release improved clarity, but support tickets about navigation rose 18% and completion of key actions like HOS log review and document upload appears softer. Leadership wants to know if the product change caused the drop or if something else moved at the same time.
How would you investigate whether a drop in engagement is caused by a recent product change?