A Comprehensive Survey on Vector Database: Storage and Retrieval Technique, Challenge
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2023
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866910072677859328 |
|---|---|
| author | Ma, Le Zhang, Ran Han, Yikun Yu, Shirui Wang, Zaitian Ning, Zhiyuan Zhang, Jinghan Xu, Ping Li, Pengjiang Qiao, Ziyue Ju, Wei Chen, Chong Wang, Dongjie Liu, Kunpeng Wang, Pengyang Wang, Pengfei Fu, Yanjie Liu, Chunjiang Zhou, Yuanchun Lu, Chang-Tien |
| author_facet | Ma, Le Zhang, Ran Han, Yikun Yu, Shirui Wang, Zaitian Ning, Zhiyuan Zhang, Jinghan Xu, Ping Li, Pengjiang Qiao, Ziyue Ju, Wei Chen, Chong Wang, Dongjie Liu, Kunpeng Wang, Pengyang Wang, Pengfei Fu, Yanjie Liu, Chunjiang Zhou, Yuanchun Lu, Chang-Tien |
| contents | As high-dimensional vector data increasingly surpasses the processing capabilities of traditional database management systems, Vector Databases (VDBs) have emerged and become tightly integrated with large language models, being widely applied in modern artificial intelligence systems. However, existing research has primarily focused on underlying technologies such as approximate nearest neighbor search, with relatively few studies providing a systematic architectural-level review of VDBs or analyzing how these core technologies collectively support the overall capacity of VDBs. This survey aims to offer a comprehensive overview of the core designs and algorithms of VDBs, establishing a holistic understanding of this rapidly evolving field. First, we systematically review the key technologies and design principles of VDBs from the two core dimensions of storage and retrieval, tracing their technological evolution. Next, we conduct an in-depth comparison of several mainstream VDB architectures, summarizing their strengths, limitations, and typical application scenarios. Finally, we explore emerging directions for integrating VDBs with large language models, including open research challenges and trends such as novel indexing strategies. This survey serves as a systematic reference guide for researchers and practitioners, helping readers quickly grasp the technological landscape and development trends in the field of vector databases, and promoting further innovation in both theoretical and applied aspects. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2310_11703 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | A Comprehensive Survey on Vector Database: Storage and Retrieval Technique, Challenge Ma, Le Zhang, Ran Han, Yikun Yu, Shirui Wang, Zaitian Ning, Zhiyuan Zhang, Jinghan Xu, Ping Li, Pengjiang Qiao, Ziyue Ju, Wei Chen, Chong Wang, Dongjie Liu, Kunpeng Wang, Pengyang Wang, Pengfei Fu, Yanjie Liu, Chunjiang Zhou, Yuanchun Lu, Chang-Tien Databases Artificial Intelligence As high-dimensional vector data increasingly surpasses the processing capabilities of traditional database management systems, Vector Databases (VDBs) have emerged and become tightly integrated with large language models, being widely applied in modern artificial intelligence systems. However, existing research has primarily focused on underlying technologies such as approximate nearest neighbor search, with relatively few studies providing a systematic architectural-level review of VDBs or analyzing how these core technologies collectively support the overall capacity of VDBs. This survey aims to offer a comprehensive overview of the core designs and algorithms of VDBs, establishing a holistic understanding of this rapidly evolving field. First, we systematically review the key technologies and design principles of VDBs from the two core dimensions of storage and retrieval, tracing their technological evolution. Next, we conduct an in-depth comparison of several mainstream VDB architectures, summarizing their strengths, limitations, and typical application scenarios. Finally, we explore emerging directions for integrating VDBs with large language models, including open research challenges and trends such as novel indexing strategies. This survey serves as a systematic reference guide for researchers and practitioners, helping readers quickly grasp the technological landscape and development trends in the field of vector databases, and promoting further innovation in both theoretical and applied aspects. |
| title | A Comprehensive Survey on Vector Database: Storage and Retrieval Technique, Challenge |
| topic | Databases Artificial Intelligence |
| url | https://arxiv.org/abs/2310.11703 |