Causal Inference Without Clean Experiments

HardStatistics & Probability00:00

Practice interviewer

In session

5 left

00:00

Whenever you're ready, walk me through how you'd approach this.

You need to log in / sign up to chat or submit.

Problem

Scenario

You are evaluating a product change on a feed or notification surface, but rollout was not randomized and adoption was correlated with user behavior. You still need to estimate whether the change caused a shift in outcomes rather than just reflecting selection or timing effects.

Question

How would you think about causal inference in a product setting when you can’t run a clean experiment?

What this tests

Choosing a causal identification strategy in observational product data
Using regression and time-based comparisons to reduce bias
Explaining assumptions behind difference-in-differences
Separating statistical evidence from causal credibility