Welcome to your interview for the Customer Insights Analyst role at The HEINEKEN.
The question is on your right: Diagnose Sample Ratio Mismatch. Take a moment with it first.
Talk your thinking through with me if you like - when you're confident, submit your answer and I'll grade it like a real screen. You have three graded attempts to score 7/10 or better.
You work on a digital product team and an A/B test has just come back with an unexpected imbalance between control and treatment traffic. The primary metric looks promising, but the allocation does not match what was planned, and there are signs of possible data quality issues in the readout.
How would you handle sample ratio mismatch or other data quality issues in the experiment readout, and how would you decide whether the result is trustworthy enough to act on?