Attention Mechanism for LLM-based Agents Dynamic Diffusion under Information Asymmetry
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866910956541444096 |
|---|---|
| author | Zhang, Yiwen Wu, Yifu Hua, Wenyue Lu, Xiang Hu, Xuming |
| author_facet | Zhang, Yiwen Wu, Yifu Hua, Wenyue Lu, Xiang Hu, Xuming |
| contents | Large language models have been used to simulate human society using multi-agent systems. Most current social simulation research emphasizes interactive behaviors in fixed environments, ignoring information opacity, relationship variability, and diffusion diversity. In this paper, we first propose a general framework for exploring multi-agent information diffusion. We identified LLMs' deficiency in the perception and utilization of social relationships, as well as diverse actions. Then, we designed a dynamic attention mechanism to help agents allocate attention to different information, addressing the limitations of the LLM attention mechanism. Agents start by responding to external information stimuli within a five-agent group, increasing group size and forming information circles while developing relationships and sharing information. Additionally, we explore the information diffusion features in the asymmetric open environment by observing the evolution of information gaps, diffusion patterns, and the accumulation of social capital, which are closely linked to psychological, sociological, and communication theories. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_13160 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Attention Mechanism for LLM-based Agents Dynamic Diffusion under Information Asymmetry Zhang, Yiwen Wu, Yifu Hua, Wenyue Lu, Xiang Hu, Xuming Multiagent Systems Artificial Intelligence Large language models have been used to simulate human society using multi-agent systems. Most current social simulation research emphasizes interactive behaviors in fixed environments, ignoring information opacity, relationship variability, and diffusion diversity. In this paper, we first propose a general framework for exploring multi-agent information diffusion. We identified LLMs' deficiency in the perception and utilization of social relationships, as well as diverse actions. Then, we designed a dynamic attention mechanism to help agents allocate attention to different information, addressing the limitations of the LLM attention mechanism. Agents start by responding to external information stimuli within a five-agent group, increasing group size and forming information circles while developing relationships and sharing information. Additionally, we explore the information diffusion features in the asymmetric open environment by observing the evolution of information gaps, diffusion patterns, and the accumulation of social capital, which are closely linked to psychological, sociological, and communication theories. |
| title | Attention Mechanism for LLM-based Agents Dynamic Diffusion under Information Asymmetry |
| topic | Multiagent Systems Artificial Intelligence |
| url | https://arxiv.org/abs/2502.13160 |