Difference between revisions of "Long Short-Term Memory (LSTM)"
| Line 13: | Line 13: | ||
* [http://towardsdatascience.com/animated-rnn-lstm-and-gru-ef124d06cf45 Animated RNN, LSTM and GRU | Raimi Karim - Towards Data Science] | * [http://towardsdatascience.com/animated-rnn-lstm-and-gru-ef124d06cf45 Animated RNN, LSTM and GRU | Raimi Karim - Towards Data Science] | ||
| − | A LSTM (Long Short-term Memory) Neural Network is just another kind of Artificial Neural Network, which falls in the category of [[Recurrent Neural Network (RNN)]]. What makes LSTM Neural Networks different from regular Neural Networks is, they have LSTM cells as neurons in some of their layers. Much like Convolutional Layers help a [[(Deep) Convolutional Neural Network (DCNN/CNN)]] learn about image features, LSTM cells help the Network learn about temporal data, something which other Machine Learning models traditionally struggled with. ... Each LSTM cell in our Neural Network will only look at a single column of its inputs, and also at the previous column’s LSTM cell’s output. Normally, we feed our LSTM Neural Network a whole matrix as its input, where each column corresponds to something that “comes before” the next column. This way, each LSTM cell will have two different input vectors: the previous LSTM cell’s output (which gives it some information about the previous input column) and its own input column. [http://www.datastuff.tech/machine-learning/lstm-how-to-train-neural-networks-to-write-like-lovecraft/ | Strikingloo] | + | A LSTM (Long Short-term Memory) Neural Network is just another kind of Artificial Neural Network, which falls in the category of [[Recurrent Neural Network (RNN)]]. What makes LSTM Neural Networks different from regular Neural Networks is, they have LSTM cells as neurons in some of their layers. Much like Convolutional Layers help a [[(Deep) Convolutional Neural Network (DCNN/CNN)]] learn about image features, LSTM cells help the Network learn about temporal data, something which other Machine Learning models traditionally struggled with. ... Each LSTM cell in our Neural Network will only look at a single column of its inputs, and also at the previous column’s LSTM cell’s output. Normally, we feed our LSTM Neural Network a whole matrix as its input, where each column corresponds to something that “comes before” the next column. This way, each LSTM cell will have two different input vectors: the previous LSTM cell’s output (which gives it some information about the previous input column) and its own input column. [http://www.datastuff.tech/machine-learning/lstm-how-to-train-neural-networks-to-write-like-lovecraft/ LSTM: HOW TO TRAIN NEURAL NETWORKS TO WRITE LIKE LOVECRAFT | Strikingloo] |
http://chunml.github.io/images/projects/creating-text-generator-using-recurrent-neural-network/LSTM.png | http://chunml.github.io/images/projects/creating-text-generator-using-recurrent-neural-network/LSTM.png | ||
Revision as of 19:06, 30 June 2019
YouTube Search ...Google search
- Neural Network Zoo | Fjodor Van Veen
- A Beginner's Guide to LSTMs
- Recurrent Neural Network (RNN)
- Animated RNN, LSTM and GRU | Raimi Karim - Towards Data Science
A LSTM (Long Short-term Memory) Neural Network is just another kind of Artificial Neural Network, which falls in the category of Recurrent Neural Network (RNN). What makes LSTM Neural Networks different from regular Neural Networks is, they have LSTM cells as neurons in some of their layers. Much like Convolutional Layers help a (Deep) Convolutional Neural Network (DCNN/CNN) learn about image features, LSTM cells help the Network learn about temporal data, something which other Machine Learning models traditionally struggled with. ... Each LSTM cell in our Neural Network will only look at a single column of its inputs, and also at the previous column’s LSTM cell’s output. Normally, we feed our LSTM Neural Network a whole matrix as its input, where each column corresponds to something that “comes before” the next column. This way, each LSTM cell will have two different input vectors: the previous LSTM cell’s output (which gives it some information about the previous input column) and its own input column. LSTM: HOW TO TRAIN NEURAL NETWORKS TO WRITE LIKE LOVECRAFT | Strikingloo
