Dataford
Interview QuestionsInterview GuidesExperiencesMock InterviewsPricing
Get started

Sample Size in SMB Funnel Tests

HardA/B Testing & Experimentation00:00
Practice interviewer
In session
5 left
00:00

Your question is Sample Size in SMB Funnel Tests. Take a moment with it on the right.

Talk me through your thinking if you like. When you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes).

You need to log in / sign up to chat or submit.

Problem

Scenario

You work on a B2B product with a low-volume SMB acquisition funnel and want to test a change to an early funnel step. Because traffic is limited, you may need to run the experiment for a long time or accept that only larger effects are detectable. The concern is whether the test can be designed to produce a decision you can trust.

Question

What sample size considerations matter most when you are testing a change in a low-volume SMB funnel? How would you choose an MDE, define the key metric and guardrails, and decide whether the experiment is feasible at all?

What This Tests

  • Power analysis under low traffic
  • Choosing a business-relevant MDE
  • Primary metric and guardrail design
  • Feasibility judgment under long runtimes
  • Awareness of peeking and SRM risk