Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2408.17401 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911114297606144 |
|---|---|
| author | Rago, Antonio Palfi, Bence Sukpanichnant, Purin Nabli, Hannibal Vivek, Kavyesh Kostopoulou, Olga Kinross, James Toni, Francesca |
| author_facet | Rago, Antonio Palfi, Bence Sukpanichnant, Purin Nabli, Hannibal Vivek, Kavyesh Kostopoulou, Olga Kinross, James Toni, Francesca |
| contents | AI-driven tools for healthcare are widely acknowledged as potentially beneficial to health practitioners and patients, e.g. the QCancer regression tool for cancer risk prediction. However, for these tools to be trusted, they need to be supplemented with explanations. We examine how explanations' content and format affect user comprehension and trust when explaining QCancer's predictions. Regarding content, we deploy the SHAP and Occlusion-1 explanation methods. Regarding format, we present SHAP explanations, conventionally, as charts (SC) and Occlusion-1 explanations as charts (OC) as well as text (OT), to which their simpler nature lends itself. We conduct experiments with two sets of stakeholders: the general public (representing patients) and medical students (representing healthcare practitioners). Our experiments showed higher subjective comprehension and trust for Occlusion-1 over SHAP explanations based on content. However, when controlling for format, only OT outperformed SC, suggesting this trend is driven by preferences for text. Other findings corroborated that explanation format, rather than content, is often the critical factor. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_17401 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Exploring the Effect of Explanation Content and Format on User Comprehension and Trust in Healthcare Rago, Antonio Palfi, Bence Sukpanichnant, Purin Nabli, Hannibal Vivek, Kavyesh Kostopoulou, Olga Kinross, James Toni, Francesca Artificial Intelligence AI-driven tools for healthcare are widely acknowledged as potentially beneficial to health practitioners and patients, e.g. the QCancer regression tool for cancer risk prediction. However, for these tools to be trusted, they need to be supplemented with explanations. We examine how explanations' content and format affect user comprehension and trust when explaining QCancer's predictions. Regarding content, we deploy the SHAP and Occlusion-1 explanation methods. Regarding format, we present SHAP explanations, conventionally, as charts (SC) and Occlusion-1 explanations as charts (OC) as well as text (OT), to which their simpler nature lends itself. We conduct experiments with two sets of stakeholders: the general public (representing patients) and medical students (representing healthcare practitioners). Our experiments showed higher subjective comprehension and trust for Occlusion-1 over SHAP explanations based on content. However, when controlling for format, only OT outperformed SC, suggesting this trend is driven by preferences for text. Other findings corroborated that explanation format, rather than content, is often the critical factor. |
| title | Exploring the Effect of Explanation Content and Format on User Comprehension and Trust in Healthcare |
| topic | Artificial Intelligence |
| url | https://arxiv.org/abs/2408.17401 |