The “Curious Case of Contexts” in Retrieval‐Augmented Generation With a Combination of Labeled and Unlabeled Data
Fuente:
Wiley Open Access
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Artículo Open Access |
| Published: |
Wiley
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1867015815244546048 |
|---|---|
| author | Payel Santra Madhusudan Ghosh Debasis Ganguly Partha Basuchowdhuri Sudip Kumar Naskar |
| author_facet | Payel Santra Madhusudan Ghosh Debasis Ganguly Partha Basuchowdhuri Sudip Kumar Naskar Payel Santra Madhusudan Ghosh Debasis Ganguly Partha Basuchowdhuri Sudip Kumar Naskar |
| collection | Wiley Open Access |
| contents | The “Curious Case of Contexts” in Retrieval‐Augmented Generation With a Combination of Labeled and Unlabeled Data Payel Santra Madhusudan Ghosh Debasis Ganguly Partha Basuchowdhuri Sudip Kumar Naskar WIREs Data Mining and Knowledge Discovery ABSTRACTWith the growing reliance on LLMs for a wide range of NLP tasks, optimizing the use of labeled and unlabeled data for effective context generation has become critical. This work explores the interplay between two prominent methodologies in few‐shot learning: in‐context learning (ICL), which utilizes labeled task‐specific data, and retrieval‐augmented generation (RAG), which leverages unlabeled external knowledge to augment generative models. Since each has its individual limitations, we propose a novel hybrid approach to obtain “the best of both worlds” by dynamically integrating both labeled and unlabeled data towards improving the downstream performance of LLMs. Our methodology, which we call LU‐RAG (labeled and unlabeled RAG), recomputes the scores of top‐k labeled instances and top‐m unlabeled passages to refine context selection. Our experimental results demonstrate that LU‐RAG consistently outperforms both standalone ICL and RAG across multiple benchmarks, showing significant gains in downstream performance. Furthermore, we show that LU‐RAG performs better with a semantic neighborhood as compared to a lexical one, highlighting its ability to generalize effectively. 10.1002/widm.70021 http://creativecommons.org/licenses/by/4.0/ |
| doi_str_mv | 10.1002/widm.70021 |
| format | Artículo Open Access |
| id | wiley_oa_10_1002_widm_70021 |
| institution | Wiley Open Access |
| license_str_mv | http://creativecommons.org/licenses/by/4.0/ |
| publishDate | 2025 |
| publisher | Wiley |
| record_format | wiley_oa |
| spellingShingle | The “Curious Case of Contexts” in Retrieval‐Augmented Generation With a Combination of Labeled and Unlabeled Data Payel Santra Madhusudan Ghosh Debasis Ganguly Partha Basuchowdhuri Sudip Kumar Naskar WIREs Data Mining and Knowledge Discovery The “Curious Case of Contexts” in Retrieval‐Augmented Generation With a Combination of Labeled and Unlabeled Data Payel Santra Madhusudan Ghosh Debasis Ganguly Partha Basuchowdhuri Sudip Kumar Naskar WIREs Data Mining and Knowledge Discovery ABSTRACTWith the growing reliance on LLMs for a wide range of NLP tasks, optimizing the use of labeled and unlabeled data for effective context generation has become critical. This work explores the interplay between two prominent methodologies in few‐shot learning: in‐context learning (ICL), which utilizes labeled task‐specific data, and retrieval‐augmented generation (RAG), which leverages unlabeled external knowledge to augment generative models. Since each has its individual limitations, we propose a novel hybrid approach to obtain “the best of both worlds” by dynamically integrating both labeled and unlabeled data towards improving the downstream performance of LLMs. Our methodology, which we call LU‐RAG (labeled and unlabeled RAG), recomputes the scores of top‐k labeled instances and top‐m unlabeled passages to refine context selection. Our experimental results demonstrate that LU‐RAG consistently outperforms both standalone ICL and RAG across multiple benchmarks, showing significant gains in downstream performance. Furthermore, we show that LU‐RAG performs better with a semantic neighborhood as compared to a lexical one, highlighting its ability to generalize effectively. 10.1002/widm.70021 http://creativecommons.org/licenses/by/4.0/ |
| title | The “Curious Case of Contexts” in Retrieval‐Augmented Generation With a Combination of Labeled and Unlabeled Data |
| topic | WIREs Data Mining and Knowledge Discovery |
| url | https://wires.onlinelibrary.wiley.com/doi/10.1002/widm.70021 |