AutoRed: A Free-form Adversarial Prompt Generation Framework for Automated Red Teaming
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866912639583518720 |
|---|---|
| author | Diao, Muxi Mou, Yutao He, Keqing Song, Hanbo Zhao, Lulu Zhang, Shikun Ye, Wei Liang, Kongming Ma, Zhanyu |
| author_facet | Diao, Muxi Mou, Yutao He, Keqing Song, Hanbo Zhao, Lulu Zhang, Shikun Ye, Wei Liang, Kongming Ma, Zhanyu |
| contents | The safety of Large Language Models (LLMs) is crucial for the development of trustworthy AI applications. Existing red teaming methods often rely on seed instructions, which limits the semantic diversity of the synthesized adversarial prompts. We propose AutoRed, a free-form adversarial prompt generation framework that removes the need for seed instructions. AutoRed operates in two stages: (1) persona-guided adversarial instruction generation, and (2) a reflection loop to iteratively refine low-quality prompts. To improve efficiency, we introduce a verifier to assess prompt harmfulness without querying the target models. Using AutoRed, we build two red teaming datasets -- AutoRed-Medium and AutoRed-Hard -- and evaluate eight state-of-the-art LLMs. AutoRed achieves higher attack success rates and better generalization than existing baselines. Our results highlight the limitations of seed-based approaches and demonstrate the potential of free-form red teaming for LLM safety evaluation. We will open source our datasets in the near future. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_08329 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | AutoRed: A Free-form Adversarial Prompt Generation Framework for Automated Red Teaming Diao, Muxi Mou, Yutao He, Keqing Song, Hanbo Zhao, Lulu Zhang, Shikun Ye, Wei Liang, Kongming Ma, Zhanyu Computation and Language The safety of Large Language Models (LLMs) is crucial for the development of trustworthy AI applications. Existing red teaming methods often rely on seed instructions, which limits the semantic diversity of the synthesized adversarial prompts. We propose AutoRed, a free-form adversarial prompt generation framework that removes the need for seed instructions. AutoRed operates in two stages: (1) persona-guided adversarial instruction generation, and (2) a reflection loop to iteratively refine low-quality prompts. To improve efficiency, we introduce a verifier to assess prompt harmfulness without querying the target models. Using AutoRed, we build two red teaming datasets -- AutoRed-Medium and AutoRed-Hard -- and evaluate eight state-of-the-art LLMs. AutoRed achieves higher attack success rates and better generalization than existing baselines. Our results highlight the limitations of seed-based approaches and demonstrate the potential of free-form red teaming for LLM safety evaluation. We will open source our datasets in the near future. |
| title | AutoRed: A Free-form Adversarial Prompt Generation Framework for Automated Red Teaming |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2510.08329 |