Distance Adaptive Beam Search for Provably Accurate Graph-Based Nearest Neighbor Search
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866915296384647168 |
|---|---|
| author | Al-Jazzazi, Yousef Diwan, Haya Gou, Jinrui Musco, Cameron Musco, Christopher Suel, Torsten |
| author_facet | Al-Jazzazi, Yousef Diwan, Haya Gou, Jinrui Musco, Cameron Musco, Christopher Suel, Torsten |
| contents | Nearest neighbor search is central in machine learning, information retrieval, and databases. For high-dimensional datasets, graph-based methods such as HNSW, DiskANN, and NSG have become popular thanks to their empirical accuracy and efficiency. These methods construct a directed graph over the dataset and perform beam search on the graph to find nodes close to a given query. While significant work has focused on practical refinements and theoretical understanding of graph-based methods, many questions remain. We propose a new distance-based termination condition for beam search to replace the commonly used condition based on beam width. We prove that, as long as the search graph is navigable, our resulting Adaptive Beam Search method is guaranteed to approximately solve the nearest-neighbor problem, establishing a connection between navigability and the performance of graph-based search. We also provide extensive experiments on our new termination condition for both navigable graphs and approximately navigable graphs used in practice, such as HNSW and Vamana graphs. We find that Adaptive Beam Search outperforms standard beam search over a range of recall values, data sets, graph constructions, and target number of nearest neighbors. It thus provides a simple and practical way to improve the performance of popular methods. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_15636 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Distance Adaptive Beam Search for Provably Accurate Graph-Based Nearest Neighbor Search Al-Jazzazi, Yousef Diwan, Haya Gou, Jinrui Musco, Cameron Musco, Christopher Suel, Torsten Information Retrieval Databases Data Structures and Algorithms Machine Learning Nearest neighbor search is central in machine learning, information retrieval, and databases. For high-dimensional datasets, graph-based methods such as HNSW, DiskANN, and NSG have become popular thanks to their empirical accuracy and efficiency. These methods construct a directed graph over the dataset and perform beam search on the graph to find nodes close to a given query. While significant work has focused on practical refinements and theoretical understanding of graph-based methods, many questions remain. We propose a new distance-based termination condition for beam search to replace the commonly used condition based on beam width. We prove that, as long as the search graph is navigable, our resulting Adaptive Beam Search method is guaranteed to approximately solve the nearest-neighbor problem, establishing a connection between navigability and the performance of graph-based search. We also provide extensive experiments on our new termination condition for both navigable graphs and approximately navigable graphs used in practice, such as HNSW and Vamana graphs. We find that Adaptive Beam Search outperforms standard beam search over a range of recall values, data sets, graph constructions, and target number of nearest neighbors. It thus provides a simple and practical way to improve the performance of popular methods. |
| title | Distance Adaptive Beam Search for Provably Accurate Graph-Based Nearest Neighbor Search |
| topic | Information Retrieval Databases Data Structures and Algorithms Machine Learning |
| url | https://arxiv.org/abs/2505.15636 |