LendWise uses a binary classification model to predict whether a personal loan applicant will default within 12 months. The team reports that the model has 92% accuracy, but default losses are still higher than expected and risk analysts believe the metric being emphasized may be misleading.
| Metric | Validation Set | Notes |
|---|---|---|
| Accuracy | 0.92 | Strong at first glance |
| Precision | 0.61 | 61% of predicted defaults are true defaults |
| Recall | 0.38 | Only 38% of actual defaults are caught |
| F1 Score | 0.47 | Weak balance of precision and recall |
| AUC-ROC | 0.81 | Reasonable ranking ability |
| Log Loss | 0.29 | Probabilities are usable but imperfect |
| Default Rate | 0.10 | 10% positive class |
The business wants to understand which evaluation metrics matter most for this model and why accuracy alone is not enough. You need to interpret the current results, explain the trade-offs between common classification metrics, and recommend what LendWise should optimize for before the next release.