Guardado en:
| Autores principales: | , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | https://arxiv.org/abs/2410.12284 |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866914980285120512 |
|---|---|
| author | Kayser, Maxime Menzat, Bayar Emde, Cornelius Bercean, Bogdan Novak, Alex Espinosa, Abdala Papiez, Bartlomiej W. Gaube, Susanne Lukasiewicz, Thomas Camburu, Oana-Maria |
| author_facet | Kayser, Maxime Menzat, Bayar Emde, Cornelius Bercean, Bogdan Novak, Alex Espinosa, Abdala Papiez, Bartlomiej W. Gaube, Susanne Lukasiewicz, Thomas Camburu, Oana-Maria |
| contents | The growing capabilities of AI models are leading to their wider use, including in safety-critical domains. Explainable AI (XAI) aims to make these models safer to use by making their inference process more transparent. However, current explainability methods are seldom evaluated in the way they are intended to be used: by real-world end users. To address this, we conducted a large-scale user study with 85 healthcare practitioners in the context of human-AI collaborative chest X-ray analysis. We evaluated three types of explanations: visual explanations (saliency maps), natural language explanations, and a combination of both modalities. We specifically examined how different explanation types influence users depending on whether the AI advice and explanations are factually correct. We find that text-based explanations lead to significant over-reliance, which is alleviated by combining them with saliency maps. We also observe that the quality of explanations, that is, how much factually correct information they entail, and how much this aligns with AI correctness, significantly impacts the usefulness of the different explanation types. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_12284 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Fool Me Once? Contrasting Textual and Visual Explanations in a Clinical Decision-Support Setting Kayser, Maxime Menzat, Bayar Emde, Cornelius Bercean, Bogdan Novak, Alex Espinosa, Abdala Papiez, Bartlomiej W. Gaube, Susanne Lukasiewicz, Thomas Camburu, Oana-Maria Human-Computer Interaction Computation and Language Computer Vision and Pattern Recognition The growing capabilities of AI models are leading to their wider use, including in safety-critical domains. Explainable AI (XAI) aims to make these models safer to use by making their inference process more transparent. However, current explainability methods are seldom evaluated in the way they are intended to be used: by real-world end users. To address this, we conducted a large-scale user study with 85 healthcare practitioners in the context of human-AI collaborative chest X-ray analysis. We evaluated three types of explanations: visual explanations (saliency maps), natural language explanations, and a combination of both modalities. We specifically examined how different explanation types influence users depending on whether the AI advice and explanations are factually correct. We find that text-based explanations lead to significant over-reliance, which is alleviated by combining them with saliency maps. We also observe that the quality of explanations, that is, how much factually correct information they entail, and how much this aligns with AI correctness, significantly impacts the usefulness of the different explanation types. |
| title | Fool Me Once? Contrasting Textual and Visual Explanations in a Clinical Decision-Support Setting |
| topic | Human-Computer Interaction Computation and Language Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2410.12284 |