A Nested Model for AI Design and Validation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Dubey, Akshat, Yang, Zewen, Hattab, Georges
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912000746979328
author Dubey, Akshat
Yang, Zewen
Hattab, Georges
author_facet Dubey, Akshat
Yang, Zewen
Hattab, Georges
contents The growing AI field faces trust, transparency, fairness, and discrimination challenges. Despite the need for new regulations, there is a mismatch between regulatory science and AI, preventing a consistent framework. A five-layer nested model for AI design and validation aims to address these issues and streamline AI application design and validation, improving fairness, trust, and AI adoption. This model aligns with regulations, addresses AI practitioner's daily challenges, and offers prescriptive guidance for determining appropriate evaluation approaches by identifying unique validity threats. We have three recommendations motivated by this model: authors should distinguish between layers when claiming contributions to clarify the specific areas in which the contribution is made and to avoid confusion, authors should explicitly state upstream assumptions to ensure that the context and limitations of their AI system are clearly understood, AI venues should promote thorough testing and validation of AI systems and their compliance with regulatory requirements.
format Preprint
id arxiv_https___arxiv_org_abs_2407_16888
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A Nested Model for AI Design and Validation
Dubey, Akshat
Yang, Zewen
Hattab, Georges
Computers and Society
Artificial Intelligence
Human-Computer Interaction
Machine Learning
The growing AI field faces trust, transparency, fairness, and discrimination challenges. Despite the need for new regulations, there is a mismatch between regulatory science and AI, preventing a consistent framework. A five-layer nested model for AI design and validation aims to address these issues and streamline AI application design and validation, improving fairness, trust, and AI adoption. This model aligns with regulations, addresses AI practitioner's daily challenges, and offers prescriptive guidance for determining appropriate evaluation approaches by identifying unique validity threats. We have three recommendations motivated by this model: authors should distinguish between layers when claiming contributions to clarify the specific areas in which the contribution is made and to avoid confusion, authors should explicitly state upstream assumptions to ensure that the context and limitations of their AI system are clearly understood, AI venues should promote thorough testing and validation of AI systems and their compliance with regulatory requirements.
title A Nested Model for AI Design and Validation
topic Computers and Society
Artificial Intelligence
Human-Computer Interaction
Machine Learning
url https://arxiv.org/abs/2407.16888