Optimization Methods
- Natural Language Processing (NLP), Natural Language Inference (NLI) and Recognizing Textual Entailment (RTE)
- Long Short-Term Memory (LSTM), Gated Recurrent Unit (GRU), and Recurrent Neural Network (RNN)
- Average-SGD Weight-Dropped LSTM (AWD-LSTM)
Methods:
- SGD (with and without momentum)
- L-BGFS
- Adagrad
- Adadelta
- RMSprop
- Adam
- Hessian-free (HF)
