From AI-Generated Content to Agentic Action: Security and Safety Threats in Generative AI
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917502319067136 |
|---|---|
| author | Zhang, Zelin Li, Qi Cao, Jie Liu, Lingshuang Ni, Jianbing |
| author_facet | Zhang, Zelin Li, Qi Cao, Jie Liu, Lingshuang Ni, Jianbing |
| contents | Generative AI systems are increasingly used not only to produce content but also to retrieve data, invoke tools, and execute actions. This work examines the security and safety implications of that shift across content-level, model-level, and agentic threats. We analyze how attacker access requirements, system autonomy, and the scope of potential harm change as models move from generating artifacts to executing operations through tool chains and external APIs. We then assess technical countermeasures including detection, watermarking, alignment, and emerging agentic safeguards, and show that several depend on forms of institutional coordination that current governance arrangements do not yet provide. Across the cases examined, capability deployment and attack-surface expansion repeatedly outpace defensive responses as systems move from generating content to executing real-world actions. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2605_16471 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | From AI-Generated Content to Agentic Action: Security and Safety Threats in Generative AI Zhang, Zelin Li, Qi Cao, Jie Liu, Lingshuang Ni, Jianbing Cryptography and Security Generative AI systems are increasingly used not only to produce content but also to retrieve data, invoke tools, and execute actions. This work examines the security and safety implications of that shift across content-level, model-level, and agentic threats. We analyze how attacker access requirements, system autonomy, and the scope of potential harm change as models move from generating artifacts to executing operations through tool chains and external APIs. We then assess technical countermeasures including detection, watermarking, alignment, and emerging agentic safeguards, and show that several depend on forms of institutional coordination that current governance arrangements do not yet provide. Across the cases examined, capability deployment and attack-surface expansion repeatedly outpace defensive responses as systems move from generating content to executing real-world actions. |
| title | From AI-Generated Content to Agentic Action: Security and Safety Threats in Generative AI |
| topic | Cryptography and Security |
| url | https://arxiv.org/abs/2605.16471 |