Difference between revisions of "Ridge Regression"

From
Jump to: navigation, search
Line 13: Line 13:
 
* [[Linear Regression]]
 
* [[Linear Regression]]
 
* [[Regularization]]
 
* [[Regularization]]
** [[Lasso Rrgression]]
 
** [http://towardsdatascience.com/ridge-and-lasso-regression-a-complete-guide-with-python-scikit-learn-e20e34bcbf0b Ridge and Lasso Regression: A Complete Guide with Python Scikit-Learn | Saptashwa - Towards Data Science]
 
 
* [[Logistic Regression (LR)]]
 
* [[Logistic Regression (LR)]]
 
* [[Statistics for Intelligence]]
 
* [[Statistics for Intelligence]]
 
* [[Overfitting Challenge]]
 
* [[Overfitting Challenge]]
 +
* [[Boosting]]
 
* [http://www.analyticsvidhya.com/blog/2015/08/comprehensive-guide-regression/ 7 Types of Regression Techniques you should know! | Sunil Ray]
 
* [http://www.analyticsvidhya.com/blog/2015/08/comprehensive-guide-regression/ 7 Types of Regression Techniques you should know! | Sunil Ray]
  

Revision as of 00:16, 13 July 2019

YouTube search... ...Google search


or Tikhonov Regularization, is the most commonly used regression algorithm to approximate an answer for an equation with no unique solution. This type of problem is very common in machine learning tasks, where the "best" solution must be chosen using limited data. Simply, [Regularization]] introduces additional information to an problem to choose the "best" solution for it. This algorithm is used for analyzing multiple regression data that suffer from multicollinearity. Multicollinearity, or collinearity, is the existence of near-linear relationships among the independent variables. When multicollinearity occurs, least squares estimates are unbiased, but their variances are large so they may be far from the true value. By adding a degree of bias to the regression estimates, ridge regression reduces the standard errors.

0*5hhRo51IxvuvU0TT.png