AI Risk Management Should Incorporate Both Safety and Security
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866909213189472256 |
|---|---|
| author | Qi, Xiangyu Huang, Yangsibo Zeng, Yi Debenedetti, Edoardo Geiping, Jonas He, Luxi Huang, Kaixuan Madhushani, Udari Sehwag, Vikash Shi, Weijia Wei, Boyi Xie, Tinghao Chen, Danqi Chen, Pin-Yu Ding, Jeffrey Jia, Ruoxi Ma, Jiaqi Narayanan, Arvind Su, Weijie J Wang, Mengdi Xiao, Chaowei Li, Bo Song, Dawn Henderson, Peter Mittal, Prateek |
| author_facet | Qi, Xiangyu Huang, Yangsibo Zeng, Yi Debenedetti, Edoardo Geiping, Jonas He, Luxi Huang, Kaixuan Madhushani, Udari Sehwag, Vikash Shi, Weijia Wei, Boyi Xie, Tinghao Chen, Danqi Chen, Pin-Yu Ding, Jeffrey Jia, Ruoxi Ma, Jiaqi Narayanan, Arvind Su, Weijie J Wang, Mengdi Xiao, Chaowei Li, Bo Song, Dawn Henderson, Peter Mittal, Prateek |
| contents | The exposure of security vulnerabilities in safety-aligned language models, e.g., susceptibility to adversarial attacks, has shed light on the intricate interplay between AI safety and AI security. Although the two disciplines now come together under the overarching goal of AI risk management, they have historically evolved separately, giving rise to differing perspectives. Therefore, in this paper, we advocate that stakeholders in AI risk management should be aware of the nuances, synergies, and interplay between safety and security, and unambiguously take into account the perspectives of both disciplines in order to devise mostly effective and holistic risk mitigation approaches. Unfortunately, this vision is often obfuscated, as the definitions of the basic concepts of "safety" and "security" themselves are often inconsistent and lack consensus across communities. With AI risk management being increasingly cross-disciplinary, this issue is particularly salient. In light of this conceptual challenge, we introduce a unified reference framework to clarify the differences and interplay between AI safety and AI security, aiming to facilitate a shared understanding and effective collaboration across communities. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_19524 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | AI Risk Management Should Incorporate Both Safety and Security Qi, Xiangyu Huang, Yangsibo Zeng, Yi Debenedetti, Edoardo Geiping, Jonas He, Luxi Huang, Kaixuan Madhushani, Udari Sehwag, Vikash Shi, Weijia Wei, Boyi Xie, Tinghao Chen, Danqi Chen, Pin-Yu Ding, Jeffrey Jia, Ruoxi Ma, Jiaqi Narayanan, Arvind Su, Weijie J Wang, Mengdi Xiao, Chaowei Li, Bo Song, Dawn Henderson, Peter Mittal, Prateek Cryptography and Security Artificial Intelligence The exposure of security vulnerabilities in safety-aligned language models, e.g., susceptibility to adversarial attacks, has shed light on the intricate interplay between AI safety and AI security. Although the two disciplines now come together under the overarching goal of AI risk management, they have historically evolved separately, giving rise to differing perspectives. Therefore, in this paper, we advocate that stakeholders in AI risk management should be aware of the nuances, synergies, and interplay between safety and security, and unambiguously take into account the perspectives of both disciplines in order to devise mostly effective and holistic risk mitigation approaches. Unfortunately, this vision is often obfuscated, as the definitions of the basic concepts of "safety" and "security" themselves are often inconsistent and lack consensus across communities. With AI risk management being increasingly cross-disciplinary, this issue is particularly salient. In light of this conceptual challenge, we introduce a unified reference framework to clarify the differences and interplay between AI safety and AI security, aiming to facilitate a shared understanding and effective collaboration across communities. |
| title | AI Risk Management Should Incorporate Both Safety and Security |
| topic | Cryptography and Security Artificial Intelligence |
| url | https://arxiv.org/abs/2405.19524 |