Early Stopping

From
Revision as of 16:32, 30 December 2018 by BPeat (talk | contribs)
Jump to: navigation, search

Youtube search... ...Google search


Good practices for addressing the Overfitting Challenge:

  • add more data
  • use Data Augmentation
  • use batch normalization
  • use architectures that generalize well
  • reduce architecture complexity
  • add Regularization
    • L1 and L2 Regularization - update the general cost function by adding another term known as the regularization term.
    • Dropout - at every iteration, it randomly selects some nodes and temporarily removes the nodes (along with all of their incoming and outgoing connections)
    • Data Augmentation
    • Early Stopping