Difference between revisions of "Gradient Descent Optimization & Challenges"
(→Vanishing & Exploding Gradients Challenges with Recurrent Neural Networks (RNN) and Long Short-Term Memory (LSTM)) |
|||
| Line 15: | Line 15: | ||
<youtube>qhXZsFVxGKo</youtube> | <youtube>qhXZsFVxGKo</youtube> | ||
| + | <youtube>SKMpmAOUa2Q</youtube> | ||
<youtube>qO_NLVjD6zE</youtube> | <youtube>qO_NLVjD6zE</youtube> | ||
| − | + | <youtube>A7poQbTrhxc</youtube> | |
== Vanishing & Exploding Gradients Challenges with Long Short-Term Memory (LSTM) and Recurrent Neural Networks (RNN) == | == Vanishing & Exploding Gradients Challenges with Long Short-Term Memory (LSTM) and Recurrent Neural Networks (RNN) == | ||
| − | [[http://www.youtube.com/results?search_query=Difficult+to+Train+an+RNN+LSTM+vanishing YouTube Search]] | + | [[http://www.youtube.com/results?search_query=Difficult+to+Train+an+RNN+GRU+LSTM+vanishing YouTube Search]] |
* [[Long Short-Term Memory (LSTM), Gated Recurrent Unit (GRU), and Recurrent Neural Network (RNN)]] | * [[Long Short-Term Memory (LSTM), Gated Recurrent Unit (GRU), and Recurrent Neural Network (RNN)]] | ||
| Line 25: | Line 26: | ||
<youtube>Pp4oKq4kCYs</youtube> | <youtube>Pp4oKq4kCYs</youtube> | ||
<youtube>2GNbIKTKCfE</youtube> | <youtube>2GNbIKTKCfE</youtube> | ||
| − | |||
| − | |||
Revision as of 09:35, 24 June 2018
Gradient Descent - Stochastic (SGD), Batch (BGD) & Mini-Batch
Vanishing & Exploding Gradients Problems
Vanishing & Exploding Gradients Challenges with Long Short-Term Memory (LSTM) and Recurrent Neural Networks (RNN)
