Saved in:
Bibliographic Details
Main Authors: Kembery, Edward, Reed, Tom
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2411.10547
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916500444545024
author Kembery, Edward
Reed, Tom
author_facet Kembery, Edward
Reed, Tom
contents The downstream use cases, benefits, and risks of AI models depend significantly on what sort of access is provided to the model, and who it is provided to. Though existing safety frameworks and AI developer usage policies recognise that the risk posed by a given model depends on the level of access provided to a given audience, the procedures they use to make decisions about model access are ad hoc, opaque, and lacking in empirical substantiation. This paper consequently proposes that frontier AI companies build on existing safety frameworks by outlining transparent procedures for making decisions about model access, which we term Responsible Access Policies (RAPs). We recommend that, at a minimum, RAPs should include the following: i) processes for empirically evaluating model capabilities given different styles of access, ii) processes for assessing the risk profiles of different categories of user, and iii) clear and robust pre-commitments regarding when to grant or revoke specific types of access for particular groups under specified conditions.
format Preprint
id arxiv_https___arxiv_org_abs_2411_10547
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle AI Safety Frameworks Should Include Procedures for Model Access Decisions
Kembery, Edward
Reed, Tom
Computers and Society
The downstream use cases, benefits, and risks of AI models depend significantly on what sort of access is provided to the model, and who it is provided to. Though existing safety frameworks and AI developer usage policies recognise that the risk posed by a given model depends on the level of access provided to a given audience, the procedures they use to make decisions about model access are ad hoc, opaque, and lacking in empirical substantiation. This paper consequently proposes that frontier AI companies build on existing safety frameworks by outlining transparent procedures for making decisions about model access, which we term Responsible Access Policies (RAPs). We recommend that, at a minimum, RAPs should include the following: i) processes for empirically evaluating model capabilities given different styles of access, ii) processes for assessing the risk profiles of different categories of user, and iii) clear and robust pre-commitments regarding when to grant or revoke specific types of access for particular groups under specified conditions.
title AI Safety Frameworks Should Include Procedures for Model Access Decisions
topic Computers and Society
url https://arxiv.org/abs/2411.10547