Difference between revisions of "Hierarchical Navigable Small World (HNSW)"
m |
m |
||
| (2 intermediate revisions by the same user not shown) | |||
| Line 23: | Line 23: | ||
* [[Inverted File Indexes (IVF)]] | * [[Inverted File Indexes (IVF)]] | ||
* [[Approximate Nearest Neighbor (ANN)]] | * [[Approximate Nearest Neighbor (ANN)]] | ||
| − | * [[AI Solver]] ... [[Algorithms]] ... [[Algorithm Administration|Administration]] ... [[Model Search]] ... [[Discriminative vs. Generative | + | * [[AI Solver]] ... [[Algorithms]] ... [[Algorithm Administration|Administration]] ... [[Model Search]] ... [[Discriminative vs. Generative]] ... [[Train, Validate, and Test]] |
** [[...predict categories]] | ** [[...predict categories]] | ||
* [[Excel]] ... [[LangChain#Documents|Documents]] ... [[Database|Database; Vector & Relational]] ... [[Graph]] ... [[LlamaIndex]] | * [[Excel]] ... [[LangChain#Documents|Documents]] ... [[Database|Database; Vector & Relational]] ... [[Graph]] ... [[LlamaIndex]] | ||
| − | + | ||
Hierarchical Navigable Small World (HNSW) is a state-of-the-art algorithm used for approximate nearest neighbor search. It constructs optimized [[graph]] structures to efficiently index and search for nearest neighbors in high-dimensional spaces. | Hierarchical Navigable Small World (HNSW) is a state-of-the-art algorithm used for approximate nearest neighbor search. It constructs optimized [[graph]] structures to efficiently index and search for nearest neighbors in high-dimensional spaces. | ||
| Line 33: | Line 33: | ||
HNSW has been widely used in various applications that require similarity search, such as [[Video/Image|image and video retrieval]], [[Recommendation|recommendation systems]], and [[Natural Language Processing (NLP)]]. It is considered one of the state-of-the-art methods for approximate nearest neighbor search and has shown excellent performance in large-scale datasets. | HNSW has been widely used in various applications that require similarity search, such as [[Video/Image|image and video retrieval]], [[Recommendation|recommendation systems]], and [[Natural Language Processing (NLP)]]. It is considered one of the state-of-the-art methods for approximate nearest neighbor search and has shown excellent performance in large-scale datasets. | ||
| + | |||
<youtube>QvKMwLjdK-s</youtube> | <youtube>QvKMwLjdK-s</youtube> | ||
<youtube>v1AiTcwZaRY</youtube> | <youtube>v1AiTcwZaRY</youtube> | ||
Latest revision as of 22:04, 5 March 2024
YouTube ... Quora ... Google search ... Google News ... Bing News
- K-Nearest Neighbors (KNN)
- Inverted File Indexes (IVF)
- Approximate Nearest Neighbor (ANN)
- AI Solver ... Algorithms ... Administration ... Model Search ... Discriminative vs. Generative ... Train, Validate, and Test
- Excel ... Documents ... Database; Vector & Relational ... Graph ... LlamaIndex
Hierarchical Navigable Small World (HNSW) is a state-of-the-art algorithm used for approximate nearest neighbor search. It constructs optimized graph structures to efficiently index and search for nearest neighbors in high-dimensional spaces.
The main idea behind HNSW is to create a multi-layered graph where a path between any pair of vertices can be traversed in a small number of steps. The graph structure represents a hierarchy, with fewer connections on the top layers and denser regions on the bottom layers. This hierarchical structure allows for efficient navigation and search in high-dimensional spaces. HNSW incrementally builds a multi-layer structure consisting of nested subsets of the stored elements. The maximum layer in which an element is present is selected randomly with an exponentially decaying probability distribution. This randomness helps in producing graphs similar to the previously studied Navigable Small World (NSW) structures. During the search process, HNSW explores the graph by traversing the layers and moving towards the target point. It uses a combination of greedy search and backward search to efficiently find the approximate nearest neighbors. The graph structure and the hierarchical nature of HNSW allow for fast and accurate approximate nearest neighbor queries.
HNSW has been widely used in various applications that require similarity search, such as image and video retrieval, recommendation systems, and Natural Language Processing (NLP). It is considered one of the state-of-the-art methods for approximate nearest neighbor search and has shown excellent performance in large-scale datasets.
