Boosting

Youtube search... ...Google search

• Overfitting Challenge

1. Regularization
2. Boosting
3. Multiclassifiers; Ensembles and Hybrids; Bagging, Boosting, and Stacking

• Gradient Descent Optimization & Challenges
• Objective vs. Cost vs. Loss vs. Error Function
• Boosting | Wikipedia
• A Gentle Introduction to the Gradient Boosting Algorithm for Machine Learning | Jason Brownlee
• Ensemble Learning

Gradient Boosting Algorithm uses multiple weak algorithms to create a more powerful accurate algorithm. Instead of using a single estimator, having multiple will create a more stable and robust algorithm. The specialty of Gradient Boosting Algorithms is their higher accuracy. There are several Gradient Boosting Algorithms. 10 Machine Learning Algorithms You need to Know | Sidath Asir @ Medium

• Gradient Boosting Machine (GBM)
• Gradient (Boosted) Decision Tree (GBDT)
• Adaptive Boosting (AdaBoost)
• XGBoost — uses liner and tree algorithms
• LightGBM ...Microsoft's gradient boosting framework that uses tree based learning algorithms