Your question is Reliability and Hallucination Evaluation. Take a moment with it on the right.
Talk me through your thinking if you like. When you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes).
How do you evaluate the reliability and hallucination rate of an autonomous agent before deploying it into a production environment?
Design a practical, reproducible evaluation framework rather than relying on anecdotal testing. Explain how you would construct representative evaluation data, define hallucinations and task failures, test tool use and refusal behavior, measure uncertainty, and report confidence intervals. Address adversarial cases, distribution shift, nondeterminism across repeated runs, evaluator bias, and deployment gates. Provide production-quality Python that calculates the core metrics from agent-run records.