Exploring the Requirements of Clinicians for Explainable AI Decision Support Systems in Intensive Care
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909394572148736 |
|---|---|
| author | Clark, Jeffrey N. Wragg, Matthew Nielsen, Emily Perello-Nieto, Miquel Keshtmand, Nawid Ambler, Michael Sharma, Shiv Bourdeaux, Christopher P. Brigden, Amberly Santos-Rodriguez, Raul |
| author_facet | Clark, Jeffrey N. Wragg, Matthew Nielsen, Emily Perello-Nieto, Miquel Keshtmand, Nawid Ambler, Michael Sharma, Shiv Bourdeaux, Christopher P. Brigden, Amberly Santos-Rodriguez, Raul |
| contents | There is a growing need to understand how digital systems can support clinical decision-making, particularly as artificial intelligence (AI) models become increasingly complex and less human-interpretable. This complexity raises concerns about trustworthiness, impacting safe and effective adoption of such technologies. Improved understanding of decision-making processes and requirements for explanations coming from decision support tools is a vital component in providing effective explainable solutions. This is particularly relevant in the data-intensive, fast-paced environments of intensive care units (ICUs). To explore these issues, group interviews were conducted with seven ICU clinicians, representing various roles and experience levels. Thematic analysis revealed three core themes: (T1) ICU decision-making relies on a wide range of factors, (T2) the complexity of patient state is challenging for shared decision-making, and (T3) requirements and capabilities of AI decision support systems. We include design recommendations from clinical input, providing insights to inform future AI systems for intensive care. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_11774 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Exploring the Requirements of Clinicians for Explainable AI Decision Support Systems in Intensive Care Clark, Jeffrey N. Wragg, Matthew Nielsen, Emily Perello-Nieto, Miquel Keshtmand, Nawid Ambler, Michael Sharma, Shiv Bourdeaux, Christopher P. Brigden, Amberly Santos-Rodriguez, Raul Human-Computer Interaction Artificial Intelligence There is a growing need to understand how digital systems can support clinical decision-making, particularly as artificial intelligence (AI) models become increasingly complex and less human-interpretable. This complexity raises concerns about trustworthiness, impacting safe and effective adoption of such technologies. Improved understanding of decision-making processes and requirements for explanations coming from decision support tools is a vital component in providing effective explainable solutions. This is particularly relevant in the data-intensive, fast-paced environments of intensive care units (ICUs). To explore these issues, group interviews were conducted with seven ICU clinicians, representing various roles and experience levels. Thematic analysis revealed three core themes: (T1) ICU decision-making relies on a wide range of factors, (T2) the complexity of patient state is challenging for shared decision-making, and (T3) requirements and capabilities of AI decision support systems. We include design recommendations from clinical input, providing insights to inform future AI systems for intensive care. |
| title | Exploring the Requirements of Clinicians for Explainable AI Decision Support Systems in Intensive Care |
| topic | Human-Computer Interaction Artificial Intelligence |
| url | https://arxiv.org/abs/2411.11774 |