Saved in:
| Main Authors: | , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2511.19863 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911284570619904 |
|---|---|
| author | Bengio, Yoshua Clare, Stephen Prunkl, Carina Andriushchenko, Maksym Bucknall, Ben Fox, Philip Maslej, Nestor McGlynn, Conor Murray, Malcolm Rismani, Shalaleh Casper, Stephen Newman, Jessica Privitera, Daniel Mindermann, Sören Acemoglu, Daron Dietterich, Thomas G. Heintz, Fredrik Hinton, Geoffrey Jennings, Nick Leavy, Susan Ludermir, Teresa Marda, Vidushi Margetts, Helen McDermid, John Munga, Jane Narayanan, Arvind Nelson, Alondra Neppel, Clara Ramchurn, Gopal Russell, Stuart Schaake, Marietje Schölkopf, Bernhard Soto, Alavaro Tiedrich, Lee Varoquaux, Gaël Yao, Andrew Zhang, Ya-Qin Aguirre, Leandro Ajala, Olubunmi Albalawi, Fahad AlMalek, Noora Busch, Christian Carvalho, André Collas, Jonathan Gill, Amandeep Hatip, Ahmet Heikkilä, Juha Johnson, Chris Jolly, Gill Katzir, Ziv Kerema, Mary Kitano, Hiroaki Krüger, Antonio McLysaght, Aoife Molchanovskyi, Oleksii Monti, Andrea Lee, Kyoung Mu Nemer, Mona Oliver, Nuria Pezoa, Raquel Plonk, Audrey Portillo, José Ravindran, Balaraman Riza, Hammam Rugege, Crystal Sheikh, Haroon Wong, Denise Zeng, Yi Zhu, Liming |
| author_facet | Bengio, Yoshua Clare, Stephen Prunkl, Carina Andriushchenko, Maksym Bucknall, Ben Fox, Philip Maslej, Nestor McGlynn, Conor Murray, Malcolm Rismani, Shalaleh Casper, Stephen Newman, Jessica Privitera, Daniel Mindermann, Sören Acemoglu, Daron Dietterich, Thomas G. Heintz, Fredrik Hinton, Geoffrey Jennings, Nick Leavy, Susan Ludermir, Teresa Marda, Vidushi Margetts, Helen McDermid, John Munga, Jane Narayanan, Arvind Nelson, Alondra Neppel, Clara Ramchurn, Gopal Russell, Stuart Schaake, Marietje Schölkopf, Bernhard Soto, Alavaro Tiedrich, Lee Varoquaux, Gaël Yao, Andrew Zhang, Ya-Qin Aguirre, Leandro Ajala, Olubunmi Albalawi, Fahad AlMalek, Noora Busch, Christian Carvalho, André Collas, Jonathan Gill, Amandeep Hatip, Ahmet Heikkilä, Juha Johnson, Chris Jolly, Gill Katzir, Ziv Kerema, Mary Kitano, Hiroaki Krüger, Antonio McLysaght, Aoife Molchanovskyi, Oleksii Monti, Andrea Lee, Kyoung Mu Nemer, Mona Oliver, Nuria Pezoa, Raquel Plonk, Audrey Portillo, José Ravindran, Balaraman Riza, Hammam Rugege, Crystal Sheikh, Haroon Wong, Denise Zeng, Yi Zhu, Liming |
| contents | This second update to the 2025 International AI Safety Report assesses new developments in general-purpose AI risk management over the past year. It examines how researchers, public institutions, and AI developers are approaching risk management for general-purpose AI. In recent months, for example, three leading AI developers applied enhanced safeguards to their new models, as their internal pre-deployment testing could not rule out the possibility that these models could be misused to help create biological weapons. Beyond specific precautionary measures, there have been a range of other advances in techniques for making AI models and systems more reliable and resistant to misuse. These include new approaches in adversarial training, data curation, and monitoring systems. In parallel, institutional frameworks that operationalise and formalise these technical capabilities are starting to emerge: the number of companies publishing Frontier AI Safety Frameworks more than doubled in 2025, and governments and international organisations have established a small number of governance frameworks for general-purpose AI, focusing largely on transparency and risk assessment. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_19863 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | International AI Safety Report 2025: Second Key Update: Technical Safeguards and Risk Management Bengio, Yoshua Clare, Stephen Prunkl, Carina Andriushchenko, Maksym Bucknall, Ben Fox, Philip Maslej, Nestor McGlynn, Conor Murray, Malcolm Rismani, Shalaleh Casper, Stephen Newman, Jessica Privitera, Daniel Mindermann, Sören Acemoglu, Daron Dietterich, Thomas G. Heintz, Fredrik Hinton, Geoffrey Jennings, Nick Leavy, Susan Ludermir, Teresa Marda, Vidushi Margetts, Helen McDermid, John Munga, Jane Narayanan, Arvind Nelson, Alondra Neppel, Clara Ramchurn, Gopal Russell, Stuart Schaake, Marietje Schölkopf, Bernhard Soto, Alavaro Tiedrich, Lee Varoquaux, Gaël Yao, Andrew Zhang, Ya-Qin Aguirre, Leandro Ajala, Olubunmi Albalawi, Fahad AlMalek, Noora Busch, Christian Carvalho, André Collas, Jonathan Gill, Amandeep Hatip, Ahmet Heikkilä, Juha Johnson, Chris Jolly, Gill Katzir, Ziv Kerema, Mary Kitano, Hiroaki Krüger, Antonio McLysaght, Aoife Molchanovskyi, Oleksii Monti, Andrea Lee, Kyoung Mu Nemer, Mona Oliver, Nuria Pezoa, Raquel Plonk, Audrey Portillo, José Ravindran, Balaraman Riza, Hammam Rugege, Crystal Sheikh, Haroon Wong, Denise Zeng, Yi Zhu, Liming Computers and Society This second update to the 2025 International AI Safety Report assesses new developments in general-purpose AI risk management over the past year. It examines how researchers, public institutions, and AI developers are approaching risk management for general-purpose AI. In recent months, for example, three leading AI developers applied enhanced safeguards to their new models, as their internal pre-deployment testing could not rule out the possibility that these models could be misused to help create biological weapons. Beyond specific precautionary measures, there have been a range of other advances in techniques for making AI models and systems more reliable and resistant to misuse. These include new approaches in adversarial training, data curation, and monitoring systems. In parallel, institutional frameworks that operationalise and formalise these technical capabilities are starting to emerge: the number of companies publishing Frontier AI Safety Frameworks more than doubled in 2025, and governments and international organisations have established a small number of governance frameworks for general-purpose AI, focusing largely on transparency and risk assessment. |
| title | International AI Safety Report 2025: Second Key Update: Technical Safeguards and Risk Management |
| topic | Computers and Society |
| url | https://arxiv.org/abs/2511.19863 |