ExpandR: Teaching Dense Retrievers Beyond Queries with LLM Guidance
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866915312309370880 |
|---|---|
| author | Yao, Sijia Huang, Pengcheng Liu, Zhenghao Gu, Yu Yan, Yukun Yu, Shi Yu, Ge |
| author_facet | Yao, Sijia Huang, Pengcheng Liu, Zhenghao Gu, Yu Yan, Yukun Yu, Shi Yu, Ge |
| contents | Large language models (LLMs) have demonstrated significant potential in enhancing dense retrieval through query augmentation. However, most existing methods treat the LLM and the retriever as separate modules, overlooking the alignment between generation and ranking objectives. In this work, we propose ExpandR, a unified LLM-augmented dense retrieval framework that jointly optimizes both the LLM and the retriever. ExpandR employs the LLM to generate semantically rich query expansions, which are leveraged to enhance the retriever's training. Simultaneously, the LLM is trained using Direct Preference Optimization (DPO), guided by a carefully designed reward function that balances retrieval effectiveness and generation consistency. This joint optimization paradigm enables mutual adaptation between the LLM and the retriever, resulting in query expansions that are both informative and well-suited for retrieval. Experimental results on multiple benchmarks show that ExpandR consistently outperforms strong baselines, achieving more than a 5% improvement in retrieval performance. All codes are available at https://github.com/NEUIR/ExpandR. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_17057 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | ExpandR: Teaching Dense Retrievers Beyond Queries with LLM Guidance Yao, Sijia Huang, Pengcheng Liu, Zhenghao Gu, Yu Yan, Yukun Yu, Shi Yu, Ge Information Retrieval Artificial Intelligence Large language models (LLMs) have demonstrated significant potential in enhancing dense retrieval through query augmentation. However, most existing methods treat the LLM and the retriever as separate modules, overlooking the alignment between generation and ranking objectives. In this work, we propose ExpandR, a unified LLM-augmented dense retrieval framework that jointly optimizes both the LLM and the retriever. ExpandR employs the LLM to generate semantically rich query expansions, which are leveraged to enhance the retriever's training. Simultaneously, the LLM is trained using Direct Preference Optimization (DPO), guided by a carefully designed reward function that balances retrieval effectiveness and generation consistency. This joint optimization paradigm enables mutual adaptation between the LLM and the retriever, resulting in query expansions that are both informative and well-suited for retrieval. Experimental results on multiple benchmarks show that ExpandR consistently outperforms strong baselines, achieving more than a 5% improvement in retrieval performance. All codes are available at https://github.com/NEUIR/ExpandR. |
| title | ExpandR: Teaching Dense Retrievers Beyond Queries with LLM Guidance |
| topic | Information Retrieval Artificial Intelligence |
| url | https://arxiv.org/abs/2502.17057 |