Difference between revisions of "Local Linear Embedding (LLE)"
| Line 11: | Line 11: | ||
* [[...find outliers]] | * [[...find outliers]] | ||
* [[Embedding]] | * [[Embedding]] | ||
| + | ** [[T-Distributed Stochastic Neighbor Embedding (t-SNE)]] | ||
* [[Anomaly Detection]] | * [[Anomaly Detection]] | ||
* [[Dimensional Reduction]] | * [[Dimensional Reduction]] | ||
* [[Principal Component Analysis (PCA)]] | * [[Principal Component Analysis (PCA)]] | ||
| − | |||
* [[Isomap]] | * [[Isomap]] | ||
* [[Kernel Trick]] | * [[Kernel Trick]] | ||
| Line 20: | Line 20: | ||
* [http://en.wikipedia.org/wiki/Nonlinear_dimensionality_reduction Nonlinear dimensionality reduction | Wikipedia] | * [http://en.wikipedia.org/wiki/Nonlinear_dimensionality_reduction Nonlinear dimensionality reduction | Wikipedia] | ||
| − | + | Embeddings... | |
* projecting an input into another more convenient representation space. For example we can project (embed) faces into a space in which face matching can be more reliable. | [http://www.quora.com/profile/Chomba-Bupe Chomba Bupe] | * projecting an input into another more convenient representation space. For example we can project (embed) faces into a space in which face matching can be more reliable. | [http://www.quora.com/profile/Chomba-Bupe Chomba Bupe] | ||
* a mapping of a discrete — categorical — variable to a vector of continuous numbers. In the context of neural networks, embeddings are low-dimensional, learned continuous vector representations of discrete variables. Neural network embeddings are useful because they can reduce the dimensionality of categorical variables and meaningfully represent categories in the transformed space. [http://towardsdatascience.com/neural-network-embeddings-explained-4d028e6f0526 Neural Network Embeddings Explained | Will Koehrsen - Towards Data Science] | * a mapping of a discrete — categorical — variable to a vector of continuous numbers. In the context of neural networks, embeddings are low-dimensional, learned continuous vector representations of discrete variables. Neural network embeddings are useful because they can reduce the dimensionality of categorical variables and meaningfully represent categories in the transformed space. [http://towardsdatascience.com/neural-network-embeddings-explained-4d028e6f0526 Neural Network Embeddings Explained | Will Koehrsen - Towards Data Science] | ||
| + | * a relatively low-dimensional space into which you can translate high-dimensional vectors. Embeddings make it easier to do machine learning on large inputs like sparse vectors representing words. Ideally, an embedding captures some of the semantics of the input by placing semantically similar inputs close together in the embedding space. An embedding can be learned and reused across models. [http://developers.google.com/machine-learning/crash-course/embeddings/video-lecture Embeddings | Machine Learning Crash Course] | ||
Neural network embeddings have 3 primary purposes: | Neural network embeddings have 3 primary purposes: | ||
Revision as of 09:27, 5 April 2020
YouTube search... ...Google search
- AI Solver
- ...find outliers
- Embedding
- Anomaly Detection
- Dimensional Reduction
- Principal Component Analysis (PCA)
- Isomap
- Kernel Trick
- Locally Linear Embedding | S.T. Roweis & L. K. Saul - NYU
- Nonlinear dimensionality reduction | Wikipedia
Embeddings...
- projecting an input into another more convenient representation space. For example we can project (embed) faces into a space in which face matching can be more reliable. | Chomba Bupe
- a mapping of a discrete — categorical — variable to a vector of continuous numbers. In the context of neural networks, embeddings are low-dimensional, learned continuous vector representations of discrete variables. Neural network embeddings are useful because they can reduce the dimensionality of categorical variables and meaningfully represent categories in the transformed space. Neural Network Embeddings Explained | Will Koehrsen - Towards Data Science
- a relatively low-dimensional space into which you can translate high-dimensional vectors. Embeddings make it easier to do machine learning on large inputs like sparse vectors representing words. Ideally, an embedding captures some of the semantics of the input by placing semantically similar inputs close together in the embedding space. An embedding can be learned and reused across models. Embeddings | Machine Learning Crash Course
Neural network embeddings have 3 primary purposes:
- Finding nearest neighbors in the embedding space. These can be used to make recommendations based on user interests or cluster categories.
- As input to a machine learning model for a supervised task.
- For visualization of concepts and relations between categories.
begins by finding a set of the nearest neighbors of each point. It then computes a set of weights for each point that best describes the point as a linear combination of its neighbors. Finally, it uses an [1]-based optimization technique to find the low-dimensional embedding of points, such that each point is still described with the same linear combination of its neighbors. LLE tends to handle non-uniform sample densities poorly because there is no fixed unit to prevent the weights from drifting as various regions differ in sample densities. LLE has no internal model. LLE was presented at approximately the same time as Isomap. It has several advantages over Isomap, including faster optimization when implemented to take advantage of sparse matrix algorithms, and better results with many problems
