Ask What Your Country Can Do For You: Towards a Public Red Teaming Model
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866908606823137280 |
|---|---|
| author | Kennedy, Wm. Matthew Patlak, Cigdem Dave, Jayraj Chambers, Blake Dhanotiya, Aayush Ramiah, Darshini Schwartz, Reva Hagen, Jack Kundu, Akash Pendharkar, Mouni Baisley, Liam Skeadas, Theodora Chowdhury, Rumman |
| author_facet | Kennedy, Wm. Matthew Patlak, Cigdem Dave, Jayraj Chambers, Blake Dhanotiya, Aayush Ramiah, Darshini Schwartz, Reva Hagen, Jack Kundu, Akash Pendharkar, Mouni Baisley, Liam Skeadas, Theodora Chowdhury, Rumman |
| contents | AI systems have the potential to produce both benefits and harms, but without rigorous and ongoing adversarial evaluation, AI actors will struggle to assess the breadth and magnitude of the AI risk surface. Researchers from the field of systems design have developed several effective sociotechnical AI evaluation and red teaming techniques targeting bias, hate speech, mis/disinformation, and other documented harm classes. However, as increasingly sophisticated AI systems are released into high-stakes sectors (such as education, healthcare, and intelligence-gathering), our current evaluation and monitoring methods are proving less and less capable of delivering effective oversight.
In order to actually deliver responsible AI and to ensure AI's harms are fully understood and its security vulnerabilities mitigated, pioneering new approaches to close this "responsibility gap" are now more urgent than ever. In this paper, we propose one such approach, the cooperative public AI red-teaming exercise, and discuss early results of its prior pilot implementations. This approach is intertwined with CAMLIS itself: the first in-person public demonstrator exercise was held in conjunction with CAMLIS 2024. We review the operational design and results of this exercise, the prior National Institute of Standards and Technology (NIST)'s Assessing the Risks and Impacts of AI (ARIA) pilot exercise, and another similar exercise conducted with the Singapore Infocomm Media Development Authority (IMDA). Ultimately, we argue that this approach is both capable of delivering meaningful results and is also scalable to many AI developing jurisdictions. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_20061 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Ask What Your Country Can Do For You: Towards a Public Red Teaming Model Kennedy, Wm. Matthew Patlak, Cigdem Dave, Jayraj Chambers, Blake Dhanotiya, Aayush Ramiah, Darshini Schwartz, Reva Hagen, Jack Kundu, Akash Pendharkar, Mouni Baisley, Liam Skeadas, Theodora Chowdhury, Rumman Computers and Society Artificial Intelligence Cryptography and Security AI systems have the potential to produce both benefits and harms, but without rigorous and ongoing adversarial evaluation, AI actors will struggle to assess the breadth and magnitude of the AI risk surface. Researchers from the field of systems design have developed several effective sociotechnical AI evaluation and red teaming techniques targeting bias, hate speech, mis/disinformation, and other documented harm classes. However, as increasingly sophisticated AI systems are released into high-stakes sectors (such as education, healthcare, and intelligence-gathering), our current evaluation and monitoring methods are proving less and less capable of delivering effective oversight. In order to actually deliver responsible AI and to ensure AI's harms are fully understood and its security vulnerabilities mitigated, pioneering new approaches to close this "responsibility gap" are now more urgent than ever. In this paper, we propose one such approach, the cooperative public AI red-teaming exercise, and discuss early results of its prior pilot implementations. This approach is intertwined with CAMLIS itself: the first in-person public demonstrator exercise was held in conjunction with CAMLIS 2024. We review the operational design and results of this exercise, the prior National Institute of Standards and Technology (NIST)'s Assessing the Risks and Impacts of AI (ARIA) pilot exercise, and another similar exercise conducted with the Singapore Infocomm Media Development Authority (IMDA). Ultimately, we argue that this approach is both capable of delivering meaningful results and is also scalable to many AI developing jurisdictions. |
| title | Ask What Your Country Can Do For You: Towards a Public Red Teaming Model |
| topic | Computers and Society Artificial Intelligence Cryptography and Security |
| url | https://arxiv.org/abs/2510.20061 |