Your question is Evaluating Models in Finance. Take a moment with it on the right.
Talk me through your thinking if you like. When you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes).
How would you evaluate the performance of a model in a high-stakes environment like financial security?
Explain how you would select metrics, validate results, analyze errors, and account for the different costs of false positives and false negatives. Address class imbalance, threshold selection, calibration, data drift, subgroup performance, and monitoring after deployment. Your response should distinguish offline validation from production evaluation and explain how you would determine whether the model is safe to use.