Campaign Lift Significance for Email Offer

Business Context

BrightCart ran an email campaign offering free shipping to a randomly selected group of users. The marketing team wants to know whether the observed lift in purchase conversion is real or just sampling noise.

Problem Statement

Use the campaign test results to determine whether the campaign's lift in conversion rate is statistically significant.

Given Data

Additional parameters:

Requirements

1. State the null and alternative hypotheses for the campaign lift.
2. Compute the sample conversion rates and the pooled proportion.
3. Calculate the standard error for a two-proportion z-test.
4. Compute the z-statistic and p-value.
5. Construct a 95% confidence interval for the lift in conversion rate.
6. Decide whether the lift is statistically significant at the 5% level.
7. Briefly explain whether the result is also practically meaningful for the business.

Assumptions

• Users were randomly assigned to treatment and control.
• Each user contributes at most one purchase outcome.
• The normal approximation is valid because both groups have large sample sizes and enough conversions/non-conversions.
• No major targeting or delivery bias affected which users received the campaign.