Diversity Collapse in Multi-Agent LLM Systems: Structural Coupling and Collective Failure in Open-Ended Idea Generation

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Chen, Nuo, Tong, Yicheng, Yang, Yuzhe, He, Yufei, Zhang, Xueyi, Zou, Qingyun, Wang, Qian, He, Bingsheng
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866913050596999168
author Chen, Nuo
Tong, Yicheng
Yang, Yuzhe
He, Yufei
Zhang, Xueyi
Zou, Qingyun
Wang, Qian
He, Bingsheng
author_facet Chen, Nuo
Tong, Yicheng
Yang, Yuzhe
He, Yufei
Zhang, Xueyi
Zou, Qingyun
Wang, Qian
He, Bingsheng
contents Multi-agent systems (MAS) are increasingly used for open-ended idea generation, driven by the expectation that collective interaction will broaden the exploration diversity. However, when and why such collaboration truly expands the solution space remains unclear. We present a systematic empirical study of diversity in MAS-based ideation across three bottom-up levels: model intelligence, agent cognition, and system dynamics. At the model level, we identify a compute efficiency paradox, where stronger, highly aligned models yield diminishing marginal diversity despite higher per-sample quality. At the cognition level, authority-driven dynamics suppress semantic diversity compared to junior-dominated groups. At the system level, group-size scaling yields diminishing returns and dense communication topologies accelerate premature convergence. We characterize these outcomes as collective failures emerging from structural coupling, a process where interaction inadvertently contracts agent exploration and triggers diversity collapse. Our analysis shows that this collapse arises primarily from the interaction structure rather than inherent model insufficiency, highlighting the importance of preserving independence and disagreement when designing MAS for creative tasks. Our code is available at https://github.com/Xtra-Computing/MAS_Diversity.
format Preprint
id arxiv_https___arxiv_org_abs_2604_18005
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Diversity Collapse in Multi-Agent LLM Systems: Structural Coupling and Collective Failure in Open-Ended Idea Generation
Chen, Nuo
Tong, Yicheng
Yang, Yuzhe
He, Yufei
Zhang, Xueyi
Zou, Qingyun
Wang, Qian
He, Bingsheng
Multiagent Systems
Artificial Intelligence
Computation and Language
Multi-agent systems (MAS) are increasingly used for open-ended idea generation, driven by the expectation that collective interaction will broaden the exploration diversity. However, when and why such collaboration truly expands the solution space remains unclear. We present a systematic empirical study of diversity in MAS-based ideation across three bottom-up levels: model intelligence, agent cognition, and system dynamics. At the model level, we identify a compute efficiency paradox, where stronger, highly aligned models yield diminishing marginal diversity despite higher per-sample quality. At the cognition level, authority-driven dynamics suppress semantic diversity compared to junior-dominated groups. At the system level, group-size scaling yields diminishing returns and dense communication topologies accelerate premature convergence. We characterize these outcomes as collective failures emerging from structural coupling, a process where interaction inadvertently contracts agent exploration and triggers diversity collapse. Our analysis shows that this collapse arises primarily from the interaction structure rather than inherent model insufficiency, highlighting the importance of preserving independence and disagreement when designing MAS for creative tasks. Our code is available at https://github.com/Xtra-Computing/MAS_Diversity.
title Diversity Collapse in Multi-Agent LLM Systems: Structural Coupling and Collective Failure in Open-Ended Idea Generation
topic Multiagent Systems
Artificial Intelligence
Computation and Language
url https://arxiv.org/abs/2604.18005