Business Context

NovaAssist is testing a new AI reply-suggestion feature in its customer support product. Traffic is limited because only a small share of agents currently use the beta workflow, so the team needs to know whether a standard A/B test is feasible before launch.

Problem Statement

Estimate the minimum sample size needed to detect a meaningful improvement in adoption rate, then assess whether the available traffic is enough to run the experiment in a reasonable time.

Given Data

The primary metric is agent adoption rate: the share of eligible sessions where the agent accepts at least one AI suggestion.

Requirements

1. State the null and alternative hypotheses for the experiment.
2. Compute the minimum required sample size per group for a two-sided test of two proportions.
3. Compute the total required sample size.
4. Estimate how many weeks NovaAssist would need to run the test with current traffic.
5. Conclude whether the test is practical and name at least two alternatives if traffic is too limited.

Assumptions

• Sessions are independently randomized at the eligible-session level.
• The baseline rate of 18.0% is stable during the test window.
• Use a normal approximation for sample size planning.
• Ignore attrition and sample-ratio mismatch for the initial calculation.