You are evaluating a model and need to decide how success should be measured before launch. Different business problems value different kinds of errors, so the right metric depends on the decision the model drives and the cost of being wrong.
How do you choose the right evaluation metric for a business problem?