Your question is Avoid Pitfalls in Online Experiments. Take a moment with it on the right.
Talk me through your thinking if you like. When you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes).
You are evaluating an online experiment for a digital commerce product, and early results look promising. Before acting on them, you want to make sure the observed lift is not driven by common experimentation pitfalls such as early stopping, novelty, interference across users, or traffic allocation issues.
What are some common pitfalls in online experiments, and how would you avoid them in the way you design, monitor, analyze, and interpret the test?