Study on the Helpfulness of Explainable Artificial Intelligence
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866912073713188864 |
|---|---|
| author | Labarta, Tobias Kulicheva, Elizaveta Froelian, Ronja Geißler, Christian Melman, Xenia von Klitzing, Julian |
| author_facet | Labarta, Tobias Kulicheva, Elizaveta Froelian, Ronja Geißler, Christian Melman, Xenia von Klitzing, Julian |
| contents | Explainable Artificial Intelligence (XAI) is essential for building advanced machine learning-powered applications, especially in critical domains such as medical diagnostics or autonomous driving. Legal, business, and ethical requirements motivate using effective XAI, but the increasing number of different methods makes it challenging to pick the right ones. Further, as explanations are highly context-dependent, measuring the effectiveness of XAI methods without users can only reveal a limited amount of information, excluding human factors such as the ability to understand it. We propose to evaluate XAI methods via the user's ability to successfully perform a proxy task, designed such that a good performance is an indicator for the explanation to provide helpful information. In other words, we address the helpfulness of XAI for human decision-making. Further, a user study on state-of-the-art methods was conducted, showing differences in their ability to generate trust and skepticism and the ability to judge the rightfulness of an AI decision correctly. Based on the results, we highly recommend using and extending this approach for more objective-based human-centered user studies to measure XAI performance in an end-to-end fashion. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_11896 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Study on the Helpfulness of Explainable Artificial Intelligence Labarta, Tobias Kulicheva, Elizaveta Froelian, Ronja Geißler, Christian Melman, Xenia von Klitzing, Julian Human-Computer Interaction Artificial Intelligence 68T37, 91E99 I.2.0; I.2.3; H.5.2; H.1.2; K.4.2 Explainable Artificial Intelligence (XAI) is essential for building advanced machine learning-powered applications, especially in critical domains such as medical diagnostics or autonomous driving. Legal, business, and ethical requirements motivate using effective XAI, but the increasing number of different methods makes it challenging to pick the right ones. Further, as explanations are highly context-dependent, measuring the effectiveness of XAI methods without users can only reveal a limited amount of information, excluding human factors such as the ability to understand it. We propose to evaluate XAI methods via the user's ability to successfully perform a proxy task, designed such that a good performance is an indicator for the explanation to provide helpful information. In other words, we address the helpfulness of XAI for human decision-making. Further, a user study on state-of-the-art methods was conducted, showing differences in their ability to generate trust and skepticism and the ability to judge the rightfulness of an AI decision correctly. Based on the results, we highly recommend using and extending this approach for more objective-based human-centered user studies to measure XAI performance in an end-to-end fashion. |
| title | Study on the Helpfulness of Explainable Artificial Intelligence |
| topic | Human-Computer Interaction Artificial Intelligence 68T37, 91E99 I.2.0; I.2.3; H.5.2; H.1.2; K.4.2 |
| url | https://arxiv.org/abs/2410.11896 |