Guardrailed Policy Test for Ops KPI | Dataford Interview Questions

Scenario

You work on an operations team that is testing a new policy change in a marketplace workflow. The policy appears to improve the main KPI, but there is concern it could create a bad side effect elsewhere in the funnel.

Question

How would you evaluate whether the policy improved the right KPI without causing harm? Walk through how you would define success, choose the experiment design, and decide whether to ship.

Problem

Scenario

Question

How would you evaluate whether the policy improved the right KPI without causing harm? Walk through how you would define success, choose the experiment design, and decide whether to ship.

Problem

Scenario

Question

How would you evaluate whether the policy improved the right KPI without causing harm? Walk through how you would define success, choose the experiment design, and decide whether to ship.

Problem

Scenario

Question

How would you evaluate whether the policy improved the right KPI without causing harm? Walk through how you would define success, choose the experiment design, and decide whether to ship.