You are training a neural network and need to choose an optimizer that balances convergence speed, stability, and final model quality.
Explain the trade-offs between different optimization algorithms for training neural networks.