EvolveRouter: Co-Evolving Routing and Prompt for Multi-Agent Question Answering

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Huang, Jiatan, Zhang, Zheyuan, Shi, Kaiwen, Ye, Yanfang, Zhang, Chuxu
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866914450698665984
author Huang, Jiatan
Zhang, Zheyuan
Shi, Kaiwen
Ye, Yanfang
Zhang, Chuxu
author_facet Huang, Jiatan
Zhang, Zheyuan
Shi, Kaiwen
Ye, Yanfang
Zhang, Chuxu
contents Large language model agents often exhibit complementary strengths, making routing a promising approach for multi-agent question answering. However, existing routing methods remain limited in two important ways: they typically optimize over a fixed pool of agents without improving the agents themselves, and they often rely on rigid collaboration schemes that cannot adapt the number of participating agents to the query. We propose EvolveRouter, a trainable framework that addresses both limitations by jointly improving agent quality and collaboration structure. First, EvolveRouter couples graph-based query routing with targeted instruction refinement in a closed-loop co-evolution process, allowing router diagnostics to guide agent improvement while refined agents provide cleaner supervision for routing. Second, it introduces an adaptive inference strategy that dynamically determines the effective collaboration size for each query through router-weighted answer agreement. Together, these designs enable more capable and more efficient multi-agent reasoning. Experiments on five question answering benchmarks show that EvolveRouter consistently outperforms SOTA routing baselines in both F1 and exact match, while further analysis confirms the benefits of closed-loop refinement and adaptive collaboration.
format Preprint
id arxiv_https___arxiv_org_abs_2604_05149
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle EvolveRouter: Co-Evolving Routing and Prompt for Multi-Agent Question Answering
Huang, Jiatan
Zhang, Zheyuan
Shi, Kaiwen
Ye, Yanfang
Zhang, Chuxu
Computation and Language
Large language model agents often exhibit complementary strengths, making routing a promising approach for multi-agent question answering. However, existing routing methods remain limited in two important ways: they typically optimize over a fixed pool of agents without improving the agents themselves, and they often rely on rigid collaboration schemes that cannot adapt the number of participating agents to the query. We propose EvolveRouter, a trainable framework that addresses both limitations by jointly improving agent quality and collaboration structure. First, EvolveRouter couples graph-based query routing with targeted instruction refinement in a closed-loop co-evolution process, allowing router diagnostics to guide agent improvement while refined agents provide cleaner supervision for routing. Second, it introduces an adaptive inference strategy that dynamically determines the effective collaboration size for each query through router-weighted answer agreement. Together, these designs enable more capable and more efficient multi-agent reasoning. Experiments on five question answering benchmarks show that EvolveRouter consistently outperforms SOTA routing baselines in both F1 and exact match, while further analysis confirms the benefits of closed-loop refinement and adaptive collaboration.
title EvolveRouter: Co-Evolving Routing and Prompt for Multi-Agent Question Answering
topic Computation and Language
url https://arxiv.org/abs/2604.05149