Red Teaming LLMs as Socio-Technical Practice: From Exploration and Data Creation to Evaluation
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2026
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866917285649711104 |
|---|---|
| author | Garcia, Adriana Alvarado Wan, Ruyuan Oguine, Ozioma C. Badillo-Urquiola, Karla |
| author_facet | Garcia, Adriana Alvarado Wan, Ruyuan Oguine, Ozioma C. Badillo-Urquiola, Karla |
| contents | Recently, red teaming, with roots in security, has become a key evaluative approach to ensure the safety and reliability of Generative Artificial Intelligence. However, most existing work emphasizes technical benchmarks and attack success rates, leaving the socio-technical practices of how red teaming datasets are defined, created, and evaluated under-examined. Drawing on 22 interviews with practitioners who design and evaluate red teaming datasets, we examine the data practices and standards that underpin this work. Because adversarial datasets determine the scope and accuracy of model evaluations, they are critical artifacts for assessing potential harms from large language models. Our contributions are first, empirical evidence of practitioners conceptualizing red teaming and developing and evaluating red teaming datasets. Second, we reflect on how practitioners' conceptualization of risk leads to overlooking the context, interaction type, and user specificity. We conclude with three opportunities for HCI researchers to expand the conceptualization and data practices for red-teaming. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_18483 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Red Teaming LLMs as Socio-Technical Practice: From Exploration and Data Creation to Evaluation Garcia, Adriana Alvarado Wan, Ruyuan Oguine, Ozioma C. Badillo-Urquiola, Karla Computers and Society Artificial Intelligence Computation and Language Human-Computer Interaction Recently, red teaming, with roots in security, has become a key evaluative approach to ensure the safety and reliability of Generative Artificial Intelligence. However, most existing work emphasizes technical benchmarks and attack success rates, leaving the socio-technical practices of how red teaming datasets are defined, created, and evaluated under-examined. Drawing on 22 interviews with practitioners who design and evaluate red teaming datasets, we examine the data practices and standards that underpin this work. Because adversarial datasets determine the scope and accuracy of model evaluations, they are critical artifacts for assessing potential harms from large language models. Our contributions are first, empirical evidence of practitioners conceptualizing red teaming and developing and evaluating red teaming datasets. Second, we reflect on how practitioners' conceptualization of risk leads to overlooking the context, interaction type, and user specificity. We conclude with three opportunities for HCI researchers to expand the conceptualization and data practices for red-teaming. |
| title | Red Teaming LLMs as Socio-Technical Practice: From Exploration and Data Creation to Evaluation |
| topic | Computers and Society Artificial Intelligence Computation and Language Human-Computer Interaction |
| url | https://arxiv.org/abs/2602.18483 |