Your question is Evaluating GenAI in Finance. Take a moment with it on the right.
Talk me through your thinking if you like. When you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes).
How would you evaluate the performance of a generative AI model in a financial context? Explain how you would assess factual accuracy, relevance, reliability, safety, and compliance. Address offline testing, human review, adversarial evaluation, production monitoring, and the limitations of common language-model metrics. Discuss how evaluation criteria should reflect the financial cost and regulatory risk of incorrect outputs.