Saved in:
| Main Authors: | , , , , , , , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2403.13793 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916194483699712 |
|---|---|
| author | Phuong, Mary Aitchison, Matthew Catt, Elliot Cogan, Sarah Kaskasoli, Alexandre Krakovna, Victoria Lindner, David Rahtz, Matthew Assael, Yannis Hodkinson, Sarah Howard, Heidi Lieberum, Tom Kumar, Ramana Raad, Maria Abi Webson, Albert Ho, Lewis Lin, Sharon Farquhar, Sebastian Hutter, Marcus Deletang, Gregoire Ruoss, Anian El-Sayed, Seliem Brown, Sasha Dragan, Anca Shah, Rohin Dafoe, Allan Shevlane, Toby |
| author_facet | Phuong, Mary Aitchison, Matthew Catt, Elliot Cogan, Sarah Kaskasoli, Alexandre Krakovna, Victoria Lindner, David Rahtz, Matthew Assael, Yannis Hodkinson, Sarah Howard, Heidi Lieberum, Tom Kumar, Ramana Raad, Maria Abi Webson, Albert Ho, Lewis Lin, Sharon Farquhar, Sebastian Hutter, Marcus Deletang, Gregoire Ruoss, Anian El-Sayed, Seliem Brown, Sasha Dragan, Anca Shah, Rohin Dafoe, Allan Shevlane, Toby |
| contents | To understand the risks posed by a new AI system, we must understand what it can and cannot do. Building on prior work, we introduce a programme of new "dangerous capability" evaluations and pilot them on Gemini 1.0 models. Our evaluations cover four areas: (1) persuasion and deception; (2) cyber-security; (3) self-proliferation; and (4) self-reasoning. We do not find evidence of strong dangerous capabilities in the models we evaluated, but we flag early warning signs. Our goal is to help advance a rigorous science of dangerous capability evaluation, in preparation for future models. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_13793 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Evaluating Frontier Models for Dangerous Capabilities Phuong, Mary Aitchison, Matthew Catt, Elliot Cogan, Sarah Kaskasoli, Alexandre Krakovna, Victoria Lindner, David Rahtz, Matthew Assael, Yannis Hodkinson, Sarah Howard, Heidi Lieberum, Tom Kumar, Ramana Raad, Maria Abi Webson, Albert Ho, Lewis Lin, Sharon Farquhar, Sebastian Hutter, Marcus Deletang, Gregoire Ruoss, Anian El-Sayed, Seliem Brown, Sasha Dragan, Anca Shah, Rohin Dafoe, Allan Shevlane, Toby Machine Learning To understand the risks posed by a new AI system, we must understand what it can and cannot do. Building on prior work, we introduce a programme of new "dangerous capability" evaluations and pilot them on Gemini 1.0 models. Our evaluations cover four areas: (1) persuasion and deception; (2) cyber-security; (3) self-proliferation; and (4) self-reasoning. We do not find evidence of strong dangerous capabilities in the models we evaluated, but we flag early warning signs. Our goal is to help advance a rigorous science of dangerous capability evaluation, in preparation for future models. |
| title | Evaluating Frontier Models for Dangerous Capabilities |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2403.13793 |