Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2401.04055 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911750629097472 |
|---|---|
| author | Mandikal, Priyanka Mooney, Raymond |
| author_facet | Mandikal, Priyanka Mooney, Raymond |
| contents | Traditional information retrieval is based on sparse bag-of-words vector representations of documents and queries. More recent deep-learning approaches have used dense embeddings learned using a transformer-based large language model. We show that on a classic benchmark on scientific document retrieval in the medical domain of cystic fibrosis, that both of these models perform roughly equivalently. Notably, dense vectors from the state-of-the-art SPECTER2 model do not significantly enhance performance. However, a hybrid model that we propose combining these methods yields significantly better results, underscoring the merits of integrating classical and contemporary deep learning techniques in information retrieval in the domain of specialized scientific documents. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_04055 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Sparse Meets Dense: A Hybrid Approach to Enhance Scientific Document Retrieval Mandikal, Priyanka Mooney, Raymond Information Retrieval Traditional information retrieval is based on sparse bag-of-words vector representations of documents and queries. More recent deep-learning approaches have used dense embeddings learned using a transformer-based large language model. We show that on a classic benchmark on scientific document retrieval in the medical domain of cystic fibrosis, that both of these models perform roughly equivalently. Notably, dense vectors from the state-of-the-art SPECTER2 model do not significantly enhance performance. However, a hybrid model that we propose combining these methods yields significantly better results, underscoring the merits of integrating classical and contemporary deep learning techniques in information retrieval in the domain of specialized scientific documents. |
| title | Sparse Meets Dense: A Hybrid Approach to Enhance Scientific Document Retrieval |
| topic | Information Retrieval |
| url | https://arxiv.org/abs/2401.04055 |