Difference between revisions of "Kernel Trick"

From
Jump to: navigation, search
Line 11: Line 11:
 
* [[Local Linear Embedding]]
 
* [[Local Linear Embedding]]
 
* [http://en.wikipedia.org/wiki/Kernel_method Kernel method | Wikipedia]
 
* [http://en.wikipedia.org/wiki/Kernel_method Kernel method | Wikipedia]
 +
* [http://staff.ustc.edu.cn/~cheneh/paper_pdf/2017/Chu-Guan-Neurocomputing.pdf Efficient karaoke song recommendation via multiple kernel learning approximation | C. Guana, Y. Fub, X. Luc, E. Chena, X. Li, and H. Xiong]
  
  
Line 18: Line 19:
  
  
http://scikit-learn.org/stable/_images/sphx_glr_plot_kernel_approximation_0021.png
+
http://upload.wikimedia.org/wikipedia/commons/thumb/c/cc/Kernel_trick_idea.svg/750px-Kernel_trick_idea.svg.png
  
  
Line 28: Line 29:
  
 
== "Kernel Trick" ==  
 
== "Kernel Trick" ==  
 +
The kernel trick avoids the explicit mapping that is needed to get linear learning algorithms to learn a nonlinear function or decision boundary.
  
 
<youtube>wBVSbVktLIY</youtube>
 
<youtube>wBVSbVktLIY</youtube>

Revision as of 17:37, 7 January 2019

YouTube search... ...Google search


The word "kernel" is used in mathematics to denote a weighting function for a weighted sum or integral.

functions that approximate the feature mappings that correspond to certain kernels, as they are used for example in Support Vector Machine (SVM). The feature functions perform non-linear transformations of the input, which can serve as a basis for linear classification or other algorithms. The advantage of using approximate explicit feature maps compared to the kernel trick, which makes use of feature maps implicitly, is that explicit mappings can be better suited for online learning and can significantly reduce the cost of learning with very large datasets. Standard kernelized Support Vector Machine (SVM)s do not scale well to large datasets, but using an approximate kernel map it is possible to use much more efficient linear Support Vector Machine (SVM)s. Kernel Approximation | Scikit-Learn


750px-Kernel_trick_idea.svg.png



"Kernel Trick"

The kernel trick avoids the explicit mapping that is needed to get linear learning algorithms to learn a nonlinear function or decision boundary.