ACR: Adaptive Context Refactoring via Context Refactoring Operators for Multi-Turn Dialogue
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866909985625079808 |
|---|---|
| author | Shen, Jiawei Zhu, Jia Guo, Hanghui Shi, Weijie Cui, Yue Niu, Qingyu Ma, Guoqing Liang, Yidan Liu, Jingjiang Wang, Yiling Di, Shimin Xu, Jiajie |
| author_facet | Shen, Jiawei Zhu, Jia Guo, Hanghui Shi, Weijie Cui, Yue Niu, Qingyu Ma, Guoqing Liang, Yidan Liu, Jingjiang Wang, Yiling Di, Shimin Xu, Jiajie |
| contents | Large Language Models (LLMs) have shown remarkable performance in multi-turn dialogue. However, in multi-turn dialogue, models still struggle to stay aligned with what has been established earlier, follow dependencies across many turns, and avoid drifting into incorrect facts as the interaction grows longer. Existing approaches primarily focus on extending the context window, introducing external memory, or applying context compression, yet these methods still face limitations such as \textbf{contextual inertia} and \textbf{state drift}. To address these challenges, we propose the \textbf{A}daptive \textbf{C}ontext \textbf{R}efactoring \textbf{(ACR)} Framework, which dynamically monitors and reshapes the interaction history to mitigate contextual inertia and state drift actively. ACR is built on a library of context refactoring operators and a teacher-guided self-evolving training paradigm that learns when to intervene and how to refactor, thereby decoupling context management from the reasoning process. Extensive experiments on multi-turn dialogue demonstrate that our method significantly outperforms existing baselines while reducing token consumption. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_05589 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | ACR: Adaptive Context Refactoring via Context Refactoring Operators for Multi-Turn Dialogue Shen, Jiawei Zhu, Jia Guo, Hanghui Shi, Weijie Cui, Yue Niu, Qingyu Ma, Guoqing Liang, Yidan Liu, Jingjiang Wang, Yiling Di, Shimin Xu, Jiajie Computation and Language Artificial Intelligence Large Language Models (LLMs) have shown remarkable performance in multi-turn dialogue. However, in multi-turn dialogue, models still struggle to stay aligned with what has been established earlier, follow dependencies across many turns, and avoid drifting into incorrect facts as the interaction grows longer. Existing approaches primarily focus on extending the context window, introducing external memory, or applying context compression, yet these methods still face limitations such as \textbf{contextual inertia} and \textbf{state drift}. To address these challenges, we propose the \textbf{A}daptive \textbf{C}ontext \textbf{R}efactoring \textbf{(ACR)} Framework, which dynamically monitors and reshapes the interaction history to mitigate contextual inertia and state drift actively. ACR is built on a library of context refactoring operators and a teacher-guided self-evolving training paradigm that learns when to intervene and how to refactor, thereby decoupling context management from the reasoning process. Extensive experiments on multi-turn dialogue demonstrate that our method significantly outperforms existing baselines while reducing token consumption. |
| title | ACR: Adaptive Context Refactoring via Context Refactoring Operators for Multi-Turn Dialogue |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2601.05589 |