Difference between revisions of "Regularization"
| Line 7: | Line 7: | ||
[http://www.youtube.com/results?search_query=Regularization+Overfitting Youtube search...] | [http://www.youtube.com/results?search_query=Regularization+Overfitting Youtube search...] | ||
[http://www.google.com/search?q=Regularization+deep+machine+learning+ML ...Google search] | [http://www.google.com/search?q=Regularization+deep+machine+learning+ML ...Google search] | ||
| + | |||
| + | |||
| + | * [[Overfitting Challenge]] | ||
| + | # Regularization | ||
| + | # [[Boosting]] | ||
| + | # [[Multiclassifiers; Ensembles and Hybrids; Bagging, Boosting, and Stacking]] | ||
| + | |||
Good practices for addressing the [[Overfitting Challenge]]: | Good practices for addressing the [[Overfitting Challenge]]: | ||
| Line 20: | Line 27: | ||
** [[Data Augmentation]] | ** [[Data Augmentation]] | ||
** [[Early Stopping]] | ** [[Early Stopping]] | ||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
Regularization is a technique which makes slight modifications to the learning algorithm such that the model generalizes better. This in turn improves the model’s performance on the unseen data as well. [http://www.analyticsvidhya.com/blog/2018/04/fundamentals-deep-learning-regularization-techniques/ An Overview of Regularization Techniques in Deep Learning (with Python code) | Shubham Jain] | Regularization is a technique which makes slight modifications to the learning algorithm such that the model generalizes better. This in turn improves the model’s performance on the unseen data as well. [http://www.analyticsvidhya.com/blog/2018/04/fundamentals-deep-learning-regularization-techniques/ An Overview of Regularization Techniques in Deep Learning (with Python code) | Shubham Jain] | ||
Revision as of 23:50, 12 July 2019
Youtube search... ...Google search
Good practices for addressing the Overfitting Challenge:
- add more data
- use Data Augmentation
- use Batch Norm(alization) & Standardization
- use architectures that generalize well
- reduce architecture complexity
- add Regularization
- L1 and L2 Regularization - update the general cost function by adding another term known as the regularization term.
- Dropout - at every iteration, it randomly selects some nodes and temporarily removes the nodes (along with all of their incoming and outgoing connections)
- Data Augmentation
- Early Stopping
Regularization is a technique which makes slight modifications to the learning algorithm such that the model generalizes better. This in turn improves the model’s performance on the unseen data as well. An Overview of Regularization Techniques in Deep Learning (with Python code) | Shubham Jain
