UnIte: Uncertainty-based Iterative Document Sampling for Domain Adaptation in Information Retrieval
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2026
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866918470826852352 |
|---|---|
| author | Kim, Jongyoon Hwang, Minseong Hwang, Seung-won |
| author_facet | Kim, Jongyoon Hwang, Minseong Hwang, Seung-won |
| contents | Unsupervised domain adaptation generalizes neural retrievers to an unseen domain by generating pseudo queries on target domain documents. The quality and efficiency of this adaptation critically depend on which documents are selected for pseudo query generation. The existing document sampling method focuses on diversity but fails to capture model uncertainty. In contrast, we propose **Un**certainty-based **Ite**rative Document Sampling (UnIte) addressing these limitations by (1) filtering documents with high aleatoric uncertainty and (2) prioritizing those with high epistemic uncertainty, maximizing the learning utility of the current model. We conducted extensive experiments on a large corpus of BEIR with small and large models, showing significant gains of +2.45 and +3.49 nDCG@10 with a smaller training sample size, 4k on average. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_25142 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | UnIte: Uncertainty-based Iterative Document Sampling for Domain Adaptation in Information Retrieval Kim, Jongyoon Hwang, Minseong Hwang, Seung-won Information Retrieval Artificial Intelligence Unsupervised domain adaptation generalizes neural retrievers to an unseen domain by generating pseudo queries on target domain documents. The quality and efficiency of this adaptation critically depend on which documents are selected for pseudo query generation. The existing document sampling method focuses on diversity but fails to capture model uncertainty. In contrast, we propose **Un**certainty-based **Ite**rative Document Sampling (UnIte) addressing these limitations by (1) filtering documents with high aleatoric uncertainty and (2) prioritizing those with high epistemic uncertainty, maximizing the learning utility of the current model. We conducted extensive experiments on a large corpus of BEIR with small and large models, showing significant gains of +2.45 and +3.49 nDCG@10 with a smaller training sample size, 4k on average. |
| title | UnIte: Uncertainty-based Iterative Document Sampling for Domain Adaptation in Information Retrieval |
| topic | Information Retrieval Artificial Intelligence |
| url | https://arxiv.org/abs/2604.25142 |