Dataford
Interview QuestionsInterview GuidesExperiencesMock InterviewsPricing
Get started

Diagnosing Vanishing and Exploding Gradients

MediumMachine Learning00:00
I
Practice interviewer
Your interviewer
In session
I
Interviewer

Welcome to your interview.

The question is on your right: Diagnosing Vanishing and Exploding Gradients. Take a moment with it first.

Talk your thinking through with me if you like - when you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes). Discussion and graded submissions share your five interviewer interactions, so spend them well.

You need to log in / sign up to chat or submit.

Problem

Scenario

You are training a deep neural network and notice unstable learning. Loss may plateau early, become NaN, or improve only in shallow layers.

Question

How do you diagnose and mitigate vanishing or exploding gradients during the training of deep neural networks?