Top 50 Gradient Descent Interview Questions
The most frequently asked Gradient Descent questions across all roles and companies, ranked by real interview frequency. Updated daily.
Fit a univariate linear regression model from data using gradient descent or the normal equation.
Tavant
Elsevier
BMW of North AmericaImplement batch gradient descent to fit a one-feature linear model for Plymouth Rock Assurance claim severity estimates.
Rocket
Deepmind
DuolingoImplement batch logistic regression with a stable sigmoid, L2 regularization, and gradient descent for CircleUp classification signals.
_VOIS
NewsBreak
CoalitionCompute gradients for a two-layer neural network using vectorized backpropagation and softmax cross-entropy.
OpenAIImplement numerically stable binary focal loss and its backward pass from logits, including reduction handling.
WaymoImplement batch gradient descent from scratch using a Huber loss and its piecewise gradient.
UpstartSign up to see every question
Create a free account to unlock this list and practice real interview questions.
Explain vanishing gradients in deep networks and how residual connections, batch normalization, and activation choice improve training.
Enigma
BNYEEagleViewExplain how to tune hyperparameters to improve validation performance while controlling overfitting and underfitting.
NVIDIA
TrueMotion
App Orchid