MediScan, a telehealth platform, uses a binary classification model to flag chest X-rays for possible pneumonia so radiologists can prioritize urgent cases. The team is debating whether the current model is acceptable because leadership sees high precision, while clinicians are worried about missed positive cases.
| Metric | Current Model | Baseline Model |
|---|---|---|
| Precision | 0.91 | 0.74 |
| Recall | 0.62 | 0.81 |
| F1 Score | 0.74 | 0.77 |
| Accuracy | 0.95 | 0.92 |
| AUC-ROC | 0.88 | 0.86 |
| Threshold | 0.80 | 0.50 |
| Predicted Positive | Predicted Negative | |
|---|---|---|
| Actual Positive | 620 | 380 |
| Actual Negative | 61 | 8,939 |
The product manager argues the model is strong because 91% of flagged scans are truly positive. The clinical lead argues the model is unsafe because it misses 380 of 1,000 pneumonia cases.