Dataford
Interview QuestionsInterview GuidesExperiencesMock InterviewsPricing
Get started

Pitfalls in A/B Testing

Hard
HardA/B Testing & ExperimentationPeekingNovelty EffectSample Ratio Mismatch

Problem

What pitfalls can invalidate an A/B test, such as peeking, novelty effects, network interference, or sample ratio mismatch?

Practicing as: Data Scientist interview at CGI

Hi, I'll play your CGI interviewer for the Data Scientist role. Candidates describe these interviews as mostly positive and moderately difficult, so expect me to be friendly and conversational. Take your time with the question above and answer like we're in the room.

Take this as a live interview session →

You are practicing as a guest. Sign up free to get your answer graded with AI feedback. Your draft stays right here.

Sign up freeI have an account
Sign up to unlock solutions
CGI Data Scientist Interview Questions
Next questions
LatticePitfalls in A/B TestingMediumSt EngineeringPitfalls in A/B TestingMediumDarwillPitfalls in A/B TestingMedium