Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2409.17216 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917786946633728 |
|---|---|
| author | Gupta, Ritwik Walker, Leah Corona, Rodolfo Fu, Stephanie Petryk, Suzanne Napolitano, Janet Darrell, Trevor Reddie, Andrew W. |
| author_facet | Gupta, Ritwik Walker, Leah Corona, Rodolfo Fu, Stephanie Petryk, Suzanne Napolitano, Janet Darrell, Trevor Reddie, Andrew W. |
| contents | Current regulations on powerful AI capabilities are narrowly focused on "foundation" or "frontier" models. However, these terms are vague and inconsistently defined, leading to an unstable foundation for governance efforts. Critically, policy debates often fail to consider the data used with these models, despite the clear link between data and model performance. Even (relatively) "small" models that fall outside the typical definitions of foundation and frontier models can achieve equivalent outcomes when exposed to sufficiently specific datasets. In this work, we illustrate the importance of considering dataset size and content as essential factors in assessing the risks posed by models both today and in the future. More broadly, we emphasize the risk posed by over-regulating reactively and provide a path towards careful, quantitative evaluation of capabilities that can lead to a simplified regulatory environment. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_17216 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Data-Centric AI Governance: Addressing the Limitations of Model-Focused Policies Gupta, Ritwik Walker, Leah Corona, Rodolfo Fu, Stephanie Petryk, Suzanne Napolitano, Janet Darrell, Trevor Reddie, Andrew W. Computers and Society Artificial Intelligence Current regulations on powerful AI capabilities are narrowly focused on "foundation" or "frontier" models. However, these terms are vague and inconsistently defined, leading to an unstable foundation for governance efforts. Critically, policy debates often fail to consider the data used with these models, despite the clear link between data and model performance. Even (relatively) "small" models that fall outside the typical definitions of foundation and frontier models can achieve equivalent outcomes when exposed to sufficiently specific datasets. In this work, we illustrate the importance of considering dataset size and content as essential factors in assessing the risks posed by models both today and in the future. More broadly, we emphasize the risk posed by over-regulating reactively and provide a path towards careful, quantitative evaluation of capabilities that can lead to a simplified regulatory environment. |
| title | Data-Centric AI Governance: Addressing the Limitations of Model-Focused Policies |
| topic | Computers and Society Artificial Intelligence |
| url | https://arxiv.org/abs/2409.17216 |