Algorithms

• A guide to machine learning algorithms and their applications
• Outline of machine learning | Wikipedia

Architecture:

• Variables type
• Variable scaling
• Cost function
• Type of neural network - CNN, RNN, FFN
• Number of layers, hidden
• Type of layers
  • LSTM, Dense, Highway
  • Convolutional
  • Pooling
• Weight initialization type
• Number of nodes
• Type of activation function - linear, Sigmoid, ReLU
• Dropout rate (or not)
• Threshold

Neural Networks

• Neural Network Zoo | Fjodor Van Veen