Designing Interfaces for Multimodal Vector Search Applications
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866929503464325120 |
|---|---|
| author | Elliott, Owen Pendrigh Hamer, Tom Clark, Jesse |
| author_facet | Elliott, Owen Pendrigh Hamer, Tom Clark, Jesse |
| contents | Multimodal vector search offers a new paradigm for information retrieval by exposing numerous pieces of functionality which are not possible in traditional lexical search engines. While multimodal vector search can be treated as a drop in replacement for these traditional systems, the experience can be significantly enhanced by leveraging the unique capabilities of multimodal search. Central to any information retrieval system is a user who expresses an information need, traditional user interfaces with a single search bar allow users to interact with lexical search systems effectively however are not necessarily optimal for multimodal vector search. In this paper we explore novel capabilities of multimodal vector search applications utilising CLIP models and present implementations and design patterns which better allow users to express their information needs and effectively interact with these systems in an information retrieval context. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_11629 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Designing Interfaces for Multimodal Vector Search Applications Elliott, Owen Pendrigh Hamer, Tom Clark, Jesse Information Retrieval Human-Computer Interaction H.5.2; H.1.1; H.1.2; H.3.3 Multimodal vector search offers a new paradigm for information retrieval by exposing numerous pieces of functionality which are not possible in traditional lexical search engines. While multimodal vector search can be treated as a drop in replacement for these traditional systems, the experience can be significantly enhanced by leveraging the unique capabilities of multimodal search. Central to any information retrieval system is a user who expresses an information need, traditional user interfaces with a single search bar allow users to interact with lexical search systems effectively however are not necessarily optimal for multimodal vector search. In this paper we explore novel capabilities of multimodal vector search applications utilising CLIP models and present implementations and design patterns which better allow users to express their information needs and effectively interact with these systems in an information retrieval context. |
| title | Designing Interfaces for Multimodal Vector Search Applications |
| topic | Information Retrieval Human-Computer Interaction H.5.2; H.1.1; H.1.2; H.3.3 |
| url | https://arxiv.org/abs/2409.11629 |