Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Mi, Qirui, Yang, Mengyue, Yu, Xiangning, Zhao, Zhiyu, Deng, Cheng, An, Bo, Zhang, Haifeng, Chen, Xu, Wang, Jun
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:https://arxiv.org/abs/2504.21582
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866908443906932736
author Mi, Qirui
Yang, Mengyue
Yu, Xiangning
Zhao, Zhiyu
Deng, Cheng
An, Bo
Zhang, Haifeng
Chen, Xu
Wang, Jun
author_facet Mi, Qirui
Yang, Mengyue
Yu, Xiangning
Zhao, Zhiyu
Deng, Cheng
An, Bo
Zhang, Haifeng
Chen, Xu
Wang, Jun
contents Simulating collective decision-making involves more than aggregating individual behaviors; it emerges from dynamic interactions among individuals. While large language models (LLMs) offer strong potential for social simulation, achieving quantitative alignment with real-world data remains a key challenge. To bridge this gap, we propose the Mean-Field LLM (MF-LLM) framework, the first to incorporate mean field theory into LLM-based social simulation. MF-LLM models bidirectional interactions between individuals and the population through an iterative process, generating population signals to guide individual decisions, which in turn update the signals. This interplay produces coherent trajectories of collective behavior. To improve alignment with real-world data, we introduce IB-Tune, a novel fine-tuning method inspired by the Information Bottleneck principle, which retains population signals most predictive of future actions while filtering redundant history. Evaluated on a real-world social dataset, MF-LLM reduces KL divergence to human population distributions by 47\% compared to non-mean-field baselines, enabling accurate trend forecasting and effective intervention planning. Generalizing across 7 domains and 4 LLM backbones, MF-LLM provides a scalable, high-fidelity foundation for social simulation.
format Preprint
id arxiv_https___arxiv_org_abs_2504_21582
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle MF-LLM: Simulating Population Decision Dynamics via a Mean-Field Large Language Model Framework
Mi, Qirui
Yang, Mengyue
Yu, Xiangning
Zhao, Zhiyu
Deng, Cheng
An, Bo
Zhang, Haifeng
Chen, Xu
Wang, Jun
Multiagent Systems
Artificial Intelligence
Simulating collective decision-making involves more than aggregating individual behaviors; it emerges from dynamic interactions among individuals. While large language models (LLMs) offer strong potential for social simulation, achieving quantitative alignment with real-world data remains a key challenge. To bridge this gap, we propose the Mean-Field LLM (MF-LLM) framework, the first to incorporate mean field theory into LLM-based social simulation. MF-LLM models bidirectional interactions between individuals and the population through an iterative process, generating population signals to guide individual decisions, which in turn update the signals. This interplay produces coherent trajectories of collective behavior. To improve alignment with real-world data, we introduce IB-Tune, a novel fine-tuning method inspired by the Information Bottleneck principle, which retains population signals most predictive of future actions while filtering redundant history. Evaluated on a real-world social dataset, MF-LLM reduces KL divergence to human population distributions by 47\% compared to non-mean-field baselines, enabling accurate trend forecasting and effective intervention planning. Generalizing across 7 domains and 4 LLM backbones, MF-LLM provides a scalable, high-fidelity foundation for social simulation.
title MF-LLM: Simulating Population Decision Dynamics via a Mean-Field Large Language Model Framework
topic Multiagent Systems
Artificial Intelligence
url https://arxiv.org/abs/2504.21582