Algorithms

Architecture:

• Variables type
• Variable scaling
• Cost function
• Type of neural network - CNN, RNN, FFN
• Number of layers, hidden
• Type of layers
  • LSTM, Dense, Highway
  • Convolutional
  • Pooling
• Weight initialization type
• Number of nodes
• Type of activation function - linear, Sigmoid, ReLU
• Dropout rate (or not)
• Threshold

Zoo

• Neural Network Zoo | Fjodor Van Veen