On the Complexities of Testing for Compliance with Human Oversight Requirements in AI Regulation
Fuente:
arXiv
Guardado en:
| Autores principales: | , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866916860175319040 |
|---|---|
| author | Langer, Markus Lazar, Veronika Baum, Kevin |
| author_facet | Langer, Markus Lazar, Veronika Baum, Kevin |
| contents | Human oversight requirements are a core component of the European AI Act and in AI governance. In this paper, we highlight key challenges in testing for compliance with these requirements. A central difficulty lies in balancing simple, but potentially ineffective checklist-based approaches with resource-intensive and context-sensitive empirical testing of the effectiveness of human oversight of AI. Questions regarding when to update compliance testing, the context-dependent nature of human oversight requirements, and difficult-to-operationalize standards further complicate compliance testing. We argue that these challenges illustrate broader challenges in the future of sociotechnical AI governance, i.e. a future that shifts from ensuring good technological products to good sociotechnical systems. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_03300 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | On the Complexities of Testing for Compliance with Human Oversight Requirements in AI Regulation Langer, Markus Lazar, Veronika Baum, Kevin Human-Computer Interaction Computers and Society K.4.1; K.5.2; J.4 Human oversight requirements are a core component of the European AI Act and in AI governance. In this paper, we highlight key challenges in testing for compliance with these requirements. A central difficulty lies in balancing simple, but potentially ineffective checklist-based approaches with resource-intensive and context-sensitive empirical testing of the effectiveness of human oversight of AI. Questions regarding when to update compliance testing, the context-dependent nature of human oversight requirements, and difficult-to-operationalize standards further complicate compliance testing. We argue that these challenges illustrate broader challenges in the future of sociotechnical AI governance, i.e. a future that shifts from ensuring good technological products to good sociotechnical systems. |
| title | On the Complexities of Testing for Compliance with Human Oversight Requirements in AI Regulation |
| topic | Human-Computer Interaction Computers and Society K.4.1; K.5.2; J.4 |
| url | https://arxiv.org/abs/2504.03300 |