When AI Agents Collude Online: Financial Fraud Risks by Collaborative LLM Agents on Social Platforms
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913006389035008 |
|---|---|
| author | Ren, Qibing Zheng, Zhijie Guo, Jiaxuan Yan, Junchi Ma, Lizhuang Shao, Jing |
| author_facet | Ren, Qibing Zheng, Zhijie Guo, Jiaxuan Yan, Junchi Ma, Lizhuang Shao, Jing |
| contents | In this work, we study the risks of collective financial fraud in large-scale multi-agent systems powered by large language model (LLM) agents. We investigate whether agents can collaborate in fraudulent behaviors, how such collaboration amplifies risks, and what factors influence fraud success. To support this research, we present MultiAgentFraudBench, a large-scale benchmark for simulating financial fraud scenarios based on realistic online interactions. The benchmark covers 28 typical online fraud scenarios, spanning the full fraud lifecycle across both public and private domains. We further analyze key factors affecting fraud success, including interaction depth, activity level, and fine-grained collaboration failure modes. Finally, we propose a series of mitigation strategies, including adding content-level warnings to fraudulent posts and dialogues, using LLMs as monitors to block potentially malicious agents, and fostering group resilience through information sharing at the societal level. Notably, we observe that malicious agents can adapt to environmental interventions. Our findings highlight the real-world risks of multi-agent financial fraud and suggest practical measures for mitigating them. Code is available at https://github.com/zheng977/MutiAgent4Fraud. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_06448 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | When AI Agents Collude Online: Financial Fraud Risks by Collaborative LLM Agents on Social Platforms Ren, Qibing Zheng, Zhijie Guo, Jiaxuan Yan, Junchi Ma, Lizhuang Shao, Jing Multiagent Systems Artificial Intelligence Computation and Language Social and Information Networks In this work, we study the risks of collective financial fraud in large-scale multi-agent systems powered by large language model (LLM) agents. We investigate whether agents can collaborate in fraudulent behaviors, how such collaboration amplifies risks, and what factors influence fraud success. To support this research, we present MultiAgentFraudBench, a large-scale benchmark for simulating financial fraud scenarios based on realistic online interactions. The benchmark covers 28 typical online fraud scenarios, spanning the full fraud lifecycle across both public and private domains. We further analyze key factors affecting fraud success, including interaction depth, activity level, and fine-grained collaboration failure modes. Finally, we propose a series of mitigation strategies, including adding content-level warnings to fraudulent posts and dialogues, using LLMs as monitors to block potentially malicious agents, and fostering group resilience through information sharing at the societal level. Notably, we observe that malicious agents can adapt to environmental interventions. Our findings highlight the real-world risks of multi-agent financial fraud and suggest practical measures for mitigating them. Code is available at https://github.com/zheng977/MutiAgent4Fraud. |
| title | When AI Agents Collude Online: Financial Fraud Risks by Collaborative LLM Agents on Social Platforms |
| topic | Multiagent Systems Artificial Intelligence Computation and Language Social and Information Networks |
| url | https://arxiv.org/abs/2511.06448 |