Your question is Lift Conversion but Hurt Retention. Take a moment with it on the right.
Talk me through your thinking if you like. When you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes).
You work on a consumer marketplace product and run an A/B test on a checkout or booking flow. The treatment increases conversion, but early retention looks worse in the same experiment window. Leadership wants to ship based on the conversion lift, but you are concerned the change may be harming long-term value.
What would you look for if an experiment showed a lift in conversion but a drop in retention? How would you decide whether the result is a true win, a trade-off, or a measurement artifact?