

Welcome to your interview for the Data Scientist role at Airtel Payments Bank.
The question is on your right: Measure Onboarding Message Impact. Take a moment with it first.
Talk your thinking through with me if you like - when you're confident, submit your answer and I'll grade it like a real screen. You have three graded attempts to score 7/10 or better.
You work on a consumer product where new users see an onboarding message during their first experience. The team believes the message will help users understand the product faster and become more engaged, but it is not clear whether any observed change would reflect real behavior change or just noise.
How would you measure whether the new onboarding message actually changed user behavior? Walk through the experiment you would run, what success metric you would use, and how you would decide whether to launch it.