A Survey on Trustworthy LLM Agents: Threats and Countermeasures

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Yu, Miao, Meng, Fanci, Zhou, Xinyun, Wang, Shilong, Mao, Junyuan, Pang, Linsey, Chen, Tianlong, Wang, Kun, Li, Xinfeng, Zhang, Yongfeng, An, Bo, Wen, Qingsong
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915195301920768
author Yu, Miao
Meng, Fanci
Zhou, Xinyun
Wang, Shilong
Mao, Junyuan
Pang, Linsey
Chen, Tianlong
Wang, Kun
Li, Xinfeng
Zhang, Yongfeng
An, Bo
Wen, Qingsong
author_facet Yu, Miao
Meng, Fanci
Zhou, Xinyun
Wang, Shilong
Mao, Junyuan
Pang, Linsey
Chen, Tianlong
Wang, Kun
Li, Xinfeng
Zhang, Yongfeng
An, Bo
Wen, Qingsong
contents With the rapid evolution of Large Language Models (LLMs), LLM-based agents and Multi-agent Systems (MAS) have significantly expanded the capabilities of LLM ecosystems. This evolution stems from empowering LLMs with additional modules such as memory, tools, environment, and even other agents. However, this advancement has also introduced more complex issues of trustworthiness, which previous research focused solely on LLMs could not cover. In this survey, we propose the TrustAgent framework, a comprehensive study on the trustworthiness of agents, characterized by modular taxonomy, multi-dimensional connotations, and technical implementation. By thoroughly investigating and summarizing newly emerged attacks, defenses, and evaluation methods for agents and MAS, we extend the concept of Trustworthy LLM to the emerging paradigm of Trustworthy Agent. In TrustAgent, we begin by deconstructing and introducing various components of the Agent and MAS. Then, we categorize their trustworthiness into intrinsic (brain, memory, and tool) and extrinsic (user, agent, and environment) aspects. Subsequently, we delineate the multifaceted meanings of trustworthiness and elaborate on the implementation techniques of existing research related to these internal and external modules. Finally, we present our insights and outlook on this domain, aiming to provide guidance for future endeavors.
format Preprint
id arxiv_https___arxiv_org_abs_2503_09648
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Survey on Trustworthy LLM Agents: Threats and Countermeasures
Yu, Miao
Meng, Fanci
Zhou, Xinyun
Wang, Shilong
Mao, Junyuan
Pang, Linsey
Chen, Tianlong
Wang, Kun
Li, Xinfeng
Zhang, Yongfeng
An, Bo
Wen, Qingsong
Multiagent Systems
Computers and Society
With the rapid evolution of Large Language Models (LLMs), LLM-based agents and Multi-agent Systems (MAS) have significantly expanded the capabilities of LLM ecosystems. This evolution stems from empowering LLMs with additional modules such as memory, tools, environment, and even other agents. However, this advancement has also introduced more complex issues of trustworthiness, which previous research focused solely on LLMs could not cover. In this survey, we propose the TrustAgent framework, a comprehensive study on the trustworthiness of agents, characterized by modular taxonomy, multi-dimensional connotations, and technical implementation. By thoroughly investigating and summarizing newly emerged attacks, defenses, and evaluation methods for agents and MAS, we extend the concept of Trustworthy LLM to the emerging paradigm of Trustworthy Agent. In TrustAgent, we begin by deconstructing and introducing various components of the Agent and MAS. Then, we categorize their trustworthiness into intrinsic (brain, memory, and tool) and extrinsic (user, agent, and environment) aspects. Subsequently, we delineate the multifaceted meanings of trustworthiness and elaborate on the implementation techniques of existing research related to these internal and external modules. Finally, we present our insights and outlook on this domain, aiming to provide guidance for future endeavors.
title A Survey on Trustworthy LLM Agents: Threats and Countermeasures
topic Multiagent Systems
Computers and Society
url https://arxiv.org/abs/2503.09648