LendWise uses a binary classification model to predict whether a personal loan applicant will default within 90 days. The model was deployed 6 months ago to support automated approvals and manual underwriting, but risk leaders now report worsening portfolio quality despite similar application volume.
| Metric | At Launch | Current | Change |
|---|---|---|---|
| Accuracy | 0.84 | 0.79 | -0.05 |
| Precision | 0.76 | 0.74 | -0.02 |
| Recall | 0.81 | 0.62 | -0.19 |
| F1 Score | 0.78 | 0.67 | -0.11 |
| Default rate in evaluation set | 18% | 24% | +6 pts |
| AUC-ROC | 0.87 | 0.80 | -0.07 |
| Monthly bad-loan loss | $1.9M | $3.1M | +63% |
The model still identifies many risky applicants correctly, but it is missing a larger share of actual defaulters than it did at launch. Product and risk teams want to know whether the decline is caused by threshold choice, data drift, changing applicant mix, or model staleness.