A Comprehensive Framework to Operationalize Social Stereotypes for Responsible AI Evaluations
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866916980915699712 |
|---|---|
| author | Davani, Aida Dev, Sunipa Pérez-Urbina, Héctor Prabhakaran, Vinodkumar |
| author_facet | Davani, Aida Dev, Sunipa Pérez-Urbina, Héctor Prabhakaran, Vinodkumar |
| contents | Societal stereotypes are at the center of a myriad of responsible AI interventions targeted at reducing the generation and propagation of potentially harmful outcomes. While these efforts are much needed, they tend to be fragmented and often address different parts of the issue without adopting a unified or holistic approach to social stereotypes and how they impact various parts of the machine learning pipeline. As a result, current interventions fail to capitalize on the underlying mechanisms that are common across different types of stereotypes, and to anchor on particular aspects that are relevant in certain cases. In this paper, we draw on social psychological research and build on NLP data and methods, to propose a unified framework to operationalize stereotypes in generative AI evaluations. Our framework identifies key components of stereotypes that are crucial in AI evaluation, including the target group, associated attribute, relationship characteristics, perceiving group, and context. We also provide considerations and recommendations for its responsible use. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_02074 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | A Comprehensive Framework to Operationalize Social Stereotypes for Responsible AI Evaluations Davani, Aida Dev, Sunipa Pérez-Urbina, Héctor Prabhakaran, Vinodkumar Computers and Society Societal stereotypes are at the center of a myriad of responsible AI interventions targeted at reducing the generation and propagation of potentially harmful outcomes. While these efforts are much needed, they tend to be fragmented and often address different parts of the issue without adopting a unified or holistic approach to social stereotypes and how they impact various parts of the machine learning pipeline. As a result, current interventions fail to capitalize on the underlying mechanisms that are common across different types of stereotypes, and to anchor on particular aspects that are relevant in certain cases. In this paper, we draw on social psychological research and build on NLP data and methods, to propose a unified framework to operationalize stereotypes in generative AI evaluations. Our framework identifies key components of stereotypes that are crucial in AI evaluation, including the target group, associated attribute, relationship characteristics, perceiving group, and context. We also provide considerations and recommendations for its responsible use. |
| title | A Comprehensive Framework to Operationalize Social Stereotypes for Responsible AI Evaluations |
| topic | Computers and Society |
| url | https://arxiv.org/abs/2501.02074 |