You work on a design software product team running an A/B test on a refreshed in-product navigation experience. Early treatment results look better on engagement, but you suspect users may simply be reacting to something new rather than finding it sustainably more useful.
What is the novelty effect, and why does it matter in product experiments? How would you tell whether the observed lift reflects lasting value versus a short-lived reaction to change?