Your question is Design a Vision Evaluation Experiment. Take a moment with it on the right.
Talk me through your thinking if you like. When you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes).
Your team has a new computer vision algorithm and needs a clear way to measure whether it is actually better than the current approach. You need an evaluation plan that is credible offline and useful for a production decision.
How would you design an experiment to evaluate the performance of a new computer vision algorithm?