What causes gradients to vanish in deep neural networks? Discuss how activation functions such as ReLU, Leaky ReLU, and ELU mitigate this issue, and explain their mathematical trade-offs.
Problem
What causes gradients to vanish in deep neural networks? Discuss how activation functions such as ReLU, Leaky ReLU, and ELU mitigate this issue, and explain their mathematical trade-offs.
Your answer
Try one AI text evaluation on us
Get structured feedback, scored against a 4-axis rubric. Premium unlocks unlimited.
