Assessing Overfitting vs Underfitting

Scenario

You're comparing a few supervised learning models and need to decide whether poor performance is coming from a model that is too simple or one that is memorizing the training set.

Question

How would you assess whether a model is overfitting or underfitting?

Problem

Scenario

You're comparing a few supervised learning models and need to decide whether poor performance is coming from a model that is too simple or one that is memorizing the training set.

Question

How would you assess whether a model is overfitting or underfitting?

Example Dataset

Size·120K rows, 42 featuresTarget·Binary action completion within 7 daysFeatures·Numerical, categorical, and count-based behavioral featuresMissing data·6% missing in some numerical columnsClass balance·22% positive

Problem

Scenario

You're comparing a few supervised learning models and need to decide whether poor performance is coming from a model that is too simple or one that is memorizing the training set.

Question

How would you assess whether a model is overfitting or underfitting?

Example Dataset

Problem

Scenario

You're comparing a few supervised learning models and need to decide whether poor performance is coming from a model that is too simple or one that is memorizing the training set.

Question

How would you assess whether a model is overfitting or underfitting?

Interview Guides

Problem

Scenario

Question

Example Dataset

Problem

Scenario

Question

Example Dataset

Assessing Overfitting vs Underfitting

Problem

Scenario

Question

Example Dataset

Problem

Scenario

Question

Example Dataset