Unlocking the Power of Multi-Agent LLM for Reasoning: From Lazy Agents to Deliberation
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911248075980800 |
|---|---|
| author | Zhang, Zhiwei Li, Xiaomin Lin, Yudi Liu, Hui Chandradevan, Ramraj Wu, Linlin Lin, Minhua Wang, Fali Tang, Xianfeng He, Qi Wang, Suhang |
| author_facet | Zhang, Zhiwei Li, Xiaomin Lin, Yudi Liu, Hui Chandradevan, Ramraj Wu, Linlin Lin, Minhua Wang, Fali Tang, Xianfeng He, Qi Wang, Suhang |
| contents | Large Language Models (LLMs) trained with reinforcement learning and verifiable rewards have achieved strong results on complex reasoning tasks. Recent work extends this paradigm to a multi-agent setting, where a meta-thinking agent proposes plans and monitors progress while a reasoning agent executes subtasks through sequential conversational turns. Despite promising performance, we identify a critical limitation: lazy agent behavior, in which one agent dominates while the other contributes little, undermining collaboration and collapsing the setup to an ineffective single agent. In this paper, we first provide a theoretical analysis showing why lazy behavior naturally arises in multi-agent reasoning. We then introduce a stable and efficient method for measuring causal influence, helping mitigate this issue. Finally, as collaboration intensifies, the reasoning agent risks getting lost in multi-turn interactions and trapped by previous noisy responses. To counter this, we propose a verifiable reward mechanism that encourages deliberation by allowing the reasoning agent to discard noisy outputs, consolidate instructions, and restart its reasoning process when necessary. Extensive experiments demonstrate that our framework alleviates lazy agent behavior and unlocks the full potential of multi-agent framework for complex reasoning tasks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_02303 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Unlocking the Power of Multi-Agent LLM for Reasoning: From Lazy Agents to Deliberation Zhang, Zhiwei Li, Xiaomin Lin, Yudi Liu, Hui Chandradevan, Ramraj Wu, Linlin Lin, Minhua Wang, Fali Tang, Xianfeng He, Qi Wang, Suhang Artificial Intelligence Computation and Language Large Language Models (LLMs) trained with reinforcement learning and verifiable rewards have achieved strong results on complex reasoning tasks. Recent work extends this paradigm to a multi-agent setting, where a meta-thinking agent proposes plans and monitors progress while a reasoning agent executes subtasks through sequential conversational turns. Despite promising performance, we identify a critical limitation: lazy agent behavior, in which one agent dominates while the other contributes little, undermining collaboration and collapsing the setup to an ineffective single agent. In this paper, we first provide a theoretical analysis showing why lazy behavior naturally arises in multi-agent reasoning. We then introduce a stable and efficient method for measuring causal influence, helping mitigate this issue. Finally, as collaboration intensifies, the reasoning agent risks getting lost in multi-turn interactions and trapped by previous noisy responses. To counter this, we propose a verifiable reward mechanism that encourages deliberation by allowing the reasoning agent to discard noisy outputs, consolidate instructions, and restart its reasoning process when necessary. Extensive experiments demonstrate that our framework alleviates lazy agent behavior and unlocks the full potential of multi-agent framework for complex reasoning tasks. |
| title | Unlocking the Power of Multi-Agent LLM for Reasoning: From Lazy Agents to Deliberation |
| topic | Artificial Intelligence Computation and Language |
| url | https://arxiv.org/abs/2511.02303 |