AI Mismatches: Identifying Potential Algorithmic Harms Before AI Development
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866910911496716288 |
|---|---|
| author | Saxena, Devansh Jung, Ji-Youn Forlizzi, Jodi Holstein, Kenneth Zimmerman, John |
| author_facet | Saxena, Devansh Jung, Ji-Youn Forlizzi, Jodi Holstein, Kenneth Zimmerman, John |
| contents | AI systems are often introduced with high expectations, yet many fail to deliver, resulting in unintended harm and missed opportunities for benefit. We frequently observe significant "AI Mismatches", where the system's actual performance falls short of what is needed to ensure safety and co-create value. These mismatches are particularly difficult to address once development is underway, highlighting the need for early-stage intervention. Navigating complex, multi-dimensional risk factors that contribute to AI Mismatches is a persistent challenge. To address it, we propose an AI Mismatch approach to anticipate and mitigate risks early on, focusing on the gap between realistic model performance and required task performance. Through an analysis of 774 AI cases, we extracted a set of critical factors, which informed the development of seven matrices that map the relationships between these factors and highlight high-risk areas. Through case studies, we demonstrate how our approach can help reduce risks in AI development. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_18682 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | AI Mismatches: Identifying Potential Algorithmic Harms Before AI Development Saxena, Devansh Jung, Ji-Youn Forlizzi, Jodi Holstein, Kenneth Zimmerman, John Human-Computer Interaction Artificial Intelligence AI systems are often introduced with high expectations, yet many fail to deliver, resulting in unintended harm and missed opportunities for benefit. We frequently observe significant "AI Mismatches", where the system's actual performance falls short of what is needed to ensure safety and co-create value. These mismatches are particularly difficult to address once development is underway, highlighting the need for early-stage intervention. Navigating complex, multi-dimensional risk factors that contribute to AI Mismatches is a persistent challenge. To address it, we propose an AI Mismatch approach to anticipate and mitigate risks early on, focusing on the gap between realistic model performance and required task performance. Through an analysis of 774 AI cases, we extracted a set of critical factors, which informed the development of seven matrices that map the relationships between these factors and highlight high-risk areas. Through case studies, we demonstrate how our approach can help reduce risks in AI development. |
| title | AI Mismatches: Identifying Potential Algorithmic Harms Before AI Development |
| topic | Human-Computer Interaction Artificial Intelligence |
| url | https://arxiv.org/abs/2502.18682 |