Adaptive Retrieval Without Self-Knowledge? Bringing Uncertainty Back Home
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866915165353541632 |
|---|---|
| author | Moskvoretskii, Viktor Lysyuk, Maria Salnikov, Mikhail Ivanov, Nikolay Pletenev, Sergey Galimzianova, Daria Krayko, Nikita Konovalov, Vasily Nikishina, Irina Panchenko, Alexander |
| author_facet | Moskvoretskii, Viktor Lysyuk, Maria Salnikov, Mikhail Ivanov, Nikolay Pletenev, Sergey Galimzianova, Daria Krayko, Nikita Konovalov, Vasily Nikishina, Irina Panchenko, Alexander |
| contents | Retrieval Augmented Generation (RAG) improves correctness of Question Answering (QA) and addresses hallucinations in Large Language Models (LLMs), yet greatly increase computational costs. Besides, RAG is not always needed as may introduce irrelevant information. Recent adaptive retrieval methods integrate LLMs' intrinsic knowledge with external information appealing to LLM self-knowledge, but they often neglect efficiency evaluations and comparisons with uncertainty estimation techniques. We bridge this gap by conducting a comprehensive analysis of 35 adaptive retrieval methods, including 8 recent approaches and 27 uncertainty estimation techniques, across 6 datasets using 10 metrics for QA performance, self-knowledge, and efficiency. Our findings show that uncertainty estimation techniques often outperform complex pipelines in terms of efficiency and self-knowledge, while maintaining comparable QA performance. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_12835 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Adaptive Retrieval Without Self-Knowledge? Bringing Uncertainty Back Home Moskvoretskii, Viktor Lysyuk, Maria Salnikov, Mikhail Ivanov, Nikolay Pletenev, Sergey Galimzianova, Daria Krayko, Nikita Konovalov, Vasily Nikishina, Irina Panchenko, Alexander Computation and Language Machine Learning Retrieval Augmented Generation (RAG) improves correctness of Question Answering (QA) and addresses hallucinations in Large Language Models (LLMs), yet greatly increase computational costs. Besides, RAG is not always needed as may introduce irrelevant information. Recent adaptive retrieval methods integrate LLMs' intrinsic knowledge with external information appealing to LLM self-knowledge, but they often neglect efficiency evaluations and comparisons with uncertainty estimation techniques. We bridge this gap by conducting a comprehensive analysis of 35 adaptive retrieval methods, including 8 recent approaches and 27 uncertainty estimation techniques, across 6 datasets using 10 metrics for QA performance, self-knowledge, and efficiency. Our findings show that uncertainty estimation techniques often outperform complex pipelines in terms of efficiency and self-knowledge, while maintaining comparable QA performance. |
| title | Adaptive Retrieval Without Self-Knowledge? Bringing Uncertainty Back Home |
| topic | Computation and Language Machine Learning |
| url | https://arxiv.org/abs/2501.12835 |