Your question is Evaluating Autonomous Agents. Take a moment with it on the right.
Talk me through your thinking if you like. When you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes).
How do you evaluate the performance of an autonomous agent compared to a standard predictive model?
Explain how evaluation changes when a system takes multiple actions, uses tools, adapts to intermediate results, and may produce non-deterministic outcomes. Describe the metrics, datasets, testing strategy, and error analysis you would use, and explain how you would make a fair comparison with a predictive model.