Your question is A/B Test Analysis for Signup Flow. Take a moment with it on the right.
Talk me through your thinking if you like. When you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes).
You ran an A/B test on a signup flow change. Variant A had 24,800 users and 2,728 signups, while Variant B had 25,100 users and 2,962 signups. You want to evaluate the result at a 5% significance level and explain what else you would consider before recommending a rollout.
How would you analyze whether Variant B meaningfully outperformed Variant A, and what factors would you consider in deciding whether to ship it?