XGBoost; eXtreme Gradient Boosted trees

YouTube search... ...Google search

• AI Solver
  • ...predict categories
• Capabilities
• Boosting
• Gradient Boosting Machine (GBM)
• Random Forest (or) Random Decision Forest
• Boosted Random Forest
• Three main forms of gradient boosting:
  • Gradient Boosting Machine (GBM)
  • Stochastic Gradient Boosting
  • Regularized Gradient Boosting

Its name stands for eXtreme Gradient Boosting, it was developed by Tianqi Chen and now is part of a wider collection of open-source libraries developed by the Distributed Machine Learning Community (DMLC). XGBoost is a scalable and accurate implementation of gradient boosting machines and it has proven to push the limits of computing power for boosted trees algorithms as it was built and developed for the sole purpose of model performance and computational speed. Specifically, it was engineered to exploit every bit of memory and hardware resources for tree boosting algorithms. The implementation of XGBoost offers several advanced features for model tuning, computing environments and algorithm enhancement. It is capable of performing the three main forms of gradient boosting (Gradient Boosting (GB), Stochastic GB and Regularized GB) and it is robust enough to support fine tuning and addition of regularization parameters. According to Tianqi Chen, the latter is what makes it superior and different to other libraries. XGBoost, a Top Machine Learning Method on Kaggle, Explained | Ilan Reinstein - KDnuggets