Dataford
Interview QuestionsInterview GuidesExperiencesMock InterviewsPricing
Get started

Choose Research Method for Feature Feedback

EasyStatistics & Probability00:00
Practice interviewer
In session
5 left
00:00

Your question is Choose Research Method for Feature Feedback. Take a moment with it on the right.

Talk me through your thinking if you like. When you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes).

You need to log in / sign up to chat or submit.

Problem

Business Context

StreamBox is deciding how to evaluate a new AI-powered content recommendation feature before a full launch. The product lead wants to know whether the team should use qualitative focus groups, a quantitative survey, or a mixed-methods approach.

Problem Statement

Use the data below to determine which research method is most appropriate for the business question. The team needs both statistical precision on adoption intent and insight into why some users are hesitant.

Given Data

A pilot survey asked users whether they would use the feature weekly. Leadership set a decision threshold of 60% likely weekly usage for launch readiness.

MetricValue
Survey respondents400
Users saying “likely to use weekly”228
Observed proportion57.0%
Benchmark proportion for launch60.0%
Confidence level95%
Desired margin of error for survey estimate4.0 percentage points
Planned focus groups3 groups
Participants per focus group8

Requirements

  1. State the statistical question for the survey and the exploratory question for focus groups.
  2. Test whether the observed likely-usage rate is significantly below the 60% benchmark.
  3. Compute a 95% confidence interval for the true likely-usage proportion.
  4. Check whether the current survey sample size is sufficient for a ±4% margin of error.
  5. Based on the evidence, recommend focus group only, survey only, or mixed methods, and justify the choice.

Assumptions

  • Survey respondents are a simple random sample of the target user base.
  • Each response is independent.
  • The normal approximation for a sample proportion is appropriate because both npnpnp and n(1−p)n(1-p)n(1−p) are large.
  • Focus groups are intended for explanation and idea generation, not population estimation.