Difference between revisions of "Regularization"
m |
|||
| Line 5: | Line 5: | ||
| − | Different Regularization techniques | + | Different Regularization techniques: |
| − | * L2 and L1 regularization | + | * L2 and L1 regularization - update the general cost function by adding another term known as the regularization term. |
| − | * [[Dropout]] | + | * [[Dropout]] - at every iteration, it randomly selects some nodes and temporarily removes the nodes (along with all of their incoming and outgoing connections) |
* Data augmentation | * Data augmentation | ||
* Early stopping | * Early stopping | ||
Revision as of 09:15, 30 December 2018
Youtube search... ...Google search
Different Regularization techniques:
- L2 and L1 regularization - update the general cost function by adding another term known as the regularization term.
- Dropout - at every iteration, it randomly selects some nodes and temporarily removes the nodes (along with all of their incoming and outgoing connections)
- Data augmentation
- Early stopping
Regularization is a technique which makes slight modifications to the learning algorithm such that the model generalizes better. This in turn improves the model’s performance on the unseen data as well. An Overview of Regularization Techniques in Deep Learning (with Python code) | Shubham Jain
