Agent-Dice: Disentangling Knowledge Updates via Geometric Consensus for Agent Continual Learning
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866918439282540544 |
|---|---|
| author | Wu, Zheng Lou, Xingyu Ma, Xinbei Li, Yansi Liu, Weiwen Zhang, Weinan Wang, Jun Zhang, Zhuosheng |
| author_facet | Wu, Zheng Lou, Xingyu Ma, Xinbei Li, Yansi Liu, Weiwen Zhang, Weinan Wang, Jun Zhang, Zhuosheng |
| contents | Large Language Model (LLM)-based agents significantly extend the utility of LLMs by interacting with dynamic environments. However, enabling agents to continually learn new tasks without catastrophic forgetting remains a critical challenge, known as the stability-plasticity dilemma. In this work, we argue that this dilemma fundamentally arises from the failure to explicitly distinguish between common knowledge shared across tasks and conflicting knowledge introduced by task-specific interference. To address this, we propose Agent-Dice, a parameter fusion framework based on directional consensus evaluation. Concretely, Agent-Dice disentangles knowledge updates through a two-stage process: geometric consensus filtering to prune conflicting gradients, and curvature-based importance weighting to amplify shared semantics. We provide a rigorous theoretical analysis that establishes the validity of the proposed fusion scheme and offers insight into the origins of the stability-plasticity dilemma. Extensive experiments on GUI agents and tool-use agent domains demonstrate that Agent-Dice exhibits outstanding continual learning performance with minimal computational overhead and parameter updates. The codes are available at https://github.com/Wuzheng02/Agent-Dice. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_03641 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Agent-Dice: Disentangling Knowledge Updates via Geometric Consensus for Agent Continual Learning Wu, Zheng Lou, Xingyu Ma, Xinbei Li, Yansi Liu, Weiwen Zhang, Weinan Wang, Jun Zhang, Zhuosheng Computation and Language Large Language Model (LLM)-based agents significantly extend the utility of LLMs by interacting with dynamic environments. However, enabling agents to continually learn new tasks without catastrophic forgetting remains a critical challenge, known as the stability-plasticity dilemma. In this work, we argue that this dilemma fundamentally arises from the failure to explicitly distinguish between common knowledge shared across tasks and conflicting knowledge introduced by task-specific interference. To address this, we propose Agent-Dice, a parameter fusion framework based on directional consensus evaluation. Concretely, Agent-Dice disentangles knowledge updates through a two-stage process: geometric consensus filtering to prune conflicting gradients, and curvature-based importance weighting to amplify shared semantics. We provide a rigorous theoretical analysis that establishes the validity of the proposed fusion scheme and offers insight into the origins of the stability-plasticity dilemma. Extensive experiments on GUI agents and tool-use agent domains demonstrate that Agent-Dice exhibits outstanding continual learning performance with minimal computational overhead and parameter updates. The codes are available at https://github.com/Wuzheng02/Agent-Dice. |
| title | Agent-Dice: Disentangling Knowledge Updates via Geometric Consensus for Agent Continual Learning |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2601.03641 |