Building Safe GenAI Applications: An End-to-End Overview of Red Teaming for Large Language Models
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866909525258272768 |
|---|---|
| author | Purpura, Alberto Wadhwa, Sahil Zymet, Jesse Gupta, Akshay Luo, Andy Rad, Melissa Kazemi Shinde, Swapnil Sorower, Mohammad Shahed |
| author_facet | Purpura, Alberto Wadhwa, Sahil Zymet, Jesse Gupta, Akshay Luo, Andy Rad, Melissa Kazemi Shinde, Swapnil Sorower, Mohammad Shahed |
| contents | The rapid growth of Large Language Models (LLMs) presents significant privacy, security, and ethical concerns. While much research has proposed methods for defending LLM systems against misuse by malicious actors, researchers have recently complemented these efforts with an offensive approach that involves red teaming, i.e., proactively attacking LLMs with the purpose of identifying their vulnerabilities. This paper provides a concise and practical overview of the LLM red teaming literature, structured so as to describe a multi-component system end-to-end. To motivate red teaming we survey the initial safety needs of some high-profile LLMs, and then dive into the different components of a red teaming system as well as software packages for implementing them. We cover various attack methods, strategies for attack-success evaluation, metrics for assessing experiment outcomes, as well as a host of other considerations. Our survey will be useful for any reader who wants to rapidly obtain a grasp of the major red teaming concepts for their own use in practical applications. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_01742 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Building Safe GenAI Applications: An End-to-End Overview of Red Teaming for Large Language Models Purpura, Alberto Wadhwa, Sahil Zymet, Jesse Gupta, Akshay Luo, Andy Rad, Melissa Kazemi Shinde, Swapnil Sorower, Mohammad Shahed Computation and Language The rapid growth of Large Language Models (LLMs) presents significant privacy, security, and ethical concerns. While much research has proposed methods for defending LLM systems against misuse by malicious actors, researchers have recently complemented these efforts with an offensive approach that involves red teaming, i.e., proactively attacking LLMs with the purpose of identifying their vulnerabilities. This paper provides a concise and practical overview of the LLM red teaming literature, structured so as to describe a multi-component system end-to-end. To motivate red teaming we survey the initial safety needs of some high-profile LLMs, and then dive into the different components of a red teaming system as well as software packages for implementing them. We cover various attack methods, strategies for attack-success evaluation, metrics for assessing experiment outcomes, as well as a host of other considerations. Our survey will be useful for any reader who wants to rapidly obtain a grasp of the major red teaming concepts for their own use in practical applications. |
| title | Building Safe GenAI Applications: An End-to-End Overview of Red Teaming for Large Language Models |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2503.01742 |