ActiShade: Activating Overshadowed Knowledge to Guide Multi-Hop Reasoning in Large Language Models
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866918283405426688 |
|---|---|
| author | Ma, Huipeng Zhang, Luan Song, Dandan Hu, Linmei Tian, Yuhang Yang, Jun Zhou, Changzhi Li, Chenhao Jin, Yizhou Li, Xudong Lin, Meng Zhang, Mingxing Zhang, Shuhao |
| author_facet | Ma, Huipeng Zhang, Luan Song, Dandan Hu, Linmei Tian, Yuhang Yang, Jun Zhou, Changzhi Li, Chenhao Jin, Yizhou Li, Xudong Lin, Meng Zhang, Mingxing Zhang, Shuhao |
| contents | In multi-hop reasoning, multi-round retrieval-augmented generation (RAG) methods typically rely on LLM-generated content as the retrieval query. However, these approaches are inherently vulnerable to knowledge overshadowing - a phenomenon where critical information is overshadowed during generation. As a result, the LLM-generated content may be incomplete or inaccurate, leading to irrelevant retrieval and causing error accumulation during the iteration process. To address this challenge, we propose ActiShade, which detects and activates overshadowed knowledge to guide large language models (LLMs) in multi-hop reasoning. Specifically, ActiShade iteratively detects the overshadowed keyphrase in the given query, retrieves documents relevant to both the query and the overshadowed keyphrase, and generates a new query based on the retrieved documents to guide the next-round iteration. By supplementing the overshadowed knowledge during the formulation of next-round queries while minimizing the introduction of irrelevant noise, ActiShade reduces the error accumulation caused by knowledge overshadowing. Extensive experiments show that ActiShade outperforms existing methods across multiple datasets and LLMs. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_07260 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | ActiShade: Activating Overshadowed Knowledge to Guide Multi-Hop Reasoning in Large Language Models Ma, Huipeng Zhang, Luan Song, Dandan Hu, Linmei Tian, Yuhang Yang, Jun Zhou, Changzhi Li, Chenhao Jin, Yizhou Li, Xudong Lin, Meng Zhang, Mingxing Zhang, Shuhao Computation and Language In multi-hop reasoning, multi-round retrieval-augmented generation (RAG) methods typically rely on LLM-generated content as the retrieval query. However, these approaches are inherently vulnerable to knowledge overshadowing - a phenomenon where critical information is overshadowed during generation. As a result, the LLM-generated content may be incomplete or inaccurate, leading to irrelevant retrieval and causing error accumulation during the iteration process. To address this challenge, we propose ActiShade, which detects and activates overshadowed knowledge to guide large language models (LLMs) in multi-hop reasoning. Specifically, ActiShade iteratively detects the overshadowed keyphrase in the given query, retrieves documents relevant to both the query and the overshadowed keyphrase, and generates a new query based on the retrieved documents to guide the next-round iteration. By supplementing the overshadowed knowledge during the formulation of next-round queries while minimizing the introduction of irrelevant noise, ActiShade reduces the error accumulation caused by knowledge overshadowing. Extensive experiments show that ActiShade outperforms existing methods across multiple datasets and LLMs. |
| title | ActiShade: Activating Overshadowed Knowledge to Guide Multi-Hop Reasoning in Large Language Models |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2601.07260 |