Problem
Scenario
You work on a digital product and have used A/B testing to compare two experiences, such as a change to onboarding, navigation, or content presentation. The goal was to answer a concrete product or research question while balancing user impact and business outcomes.
Question
Have you ever used A/B testing in your research or product work? What was the question, how did you design and evaluate the experiment, and what did you learn from the results?
What this tests
- Ability to frame a clear experimental question
- Metric selection: primary, guardrails, and secondary metrics
- Power analysis with an explicit MDE
- Awareness of peeking and other experimentation pitfalls
Practicing as: Data Analyst interview at DiscoverHi, I'll play your Discover interviewer for the Data Analyst role. Candidates describe these interviews as mostly positive and moderately difficult, so expect me to be friendly and conversational. Take your time with the question above and answer like we're in the room.
You are practicing as a guest. Sign up free to get your answer graded with AI feedback. Your draft stays right here.
