Knowledge Integration Decay in Search-Augmented Reasoning of Large Language Models
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2026
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866914318862254080 |
|---|---|
| author | Yu, Sangwon Kim, Ik-hwan Kang, Donghun Hwang, Bongkyu Choi, Junhwa Jung, Suk-hoon Hong, Seungki Lee, Taehee Yoon, Sungroh |
| author_facet | Yu, Sangwon Kim, Ik-hwan Kang, Donghun Hwang, Bongkyu Choi, Junhwa Jung, Suk-hoon Hong, Seungki Lee, Taehee Yoon, Sungroh |
| contents | Modern Large Language Models (LLMs) have demonstrated remarkable capabilities in complex tasks by employing search-augmented reasoning to incorporate external knowledge into long chains of thought. However, we identify a critical yet underexplored bottleneck in this paradigm, termed Knowledge Integration Decay (KID). Specifically, we observe that as the length of reasoning generated before search grows, models increasingly fail to integrate retrieved evidence into subsequent reasoning steps, limiting performance even when relevant information is available. To address this, we propose Self-Anchored Knowledge Encoding (SAKE), a training-free inference-time strategy designed to stabilize knowledge utilization. By anchoring retrieved knowledge at both the beginning and end of the reasoning process, SAKE prevents it from being overshadowed by prior context, thereby preserving its semantic integrity. Extensive experiments on multi-hop QA and complex reasoning benchmarks demonstrate that SAKE significantly mitigates KID and improves performance, offering a lightweight yet effective solution for knowledge integration in agentic LLMs. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_09517 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Knowledge Integration Decay in Search-Augmented Reasoning of Large Language Models Yu, Sangwon Kim, Ik-hwan Kang, Donghun Hwang, Bongkyu Choi, Junhwa Jung, Suk-hoon Hong, Seungki Lee, Taehee Yoon, Sungroh Computation and Language Modern Large Language Models (LLMs) have demonstrated remarkable capabilities in complex tasks by employing search-augmented reasoning to incorporate external knowledge into long chains of thought. However, we identify a critical yet underexplored bottleneck in this paradigm, termed Knowledge Integration Decay (KID). Specifically, we observe that as the length of reasoning generated before search grows, models increasingly fail to integrate retrieved evidence into subsequent reasoning steps, limiting performance even when relevant information is available. To address this, we propose Self-Anchored Knowledge Encoding (SAKE), a training-free inference-time strategy designed to stabilize knowledge utilization. By anchoring retrieved knowledge at both the beginning and end of the reasoning process, SAKE prevents it from being overshadowed by prior context, thereby preserving its semantic integrity. Extensive experiments on multi-hop QA and complex reasoning benchmarks demonstrate that SAKE significantly mitigates KID and improves performance, offering a lightweight yet effective solution for knowledge integration in agentic LLMs. |
| title | Knowledge Integration Decay in Search-Augmented Reasoning of Large Language Models |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2602.09517 |