Saved in:
Bibliographic Details
Main Authors: Zając, Hubert D., Ribeiro, Jorge M. N., Ingala, Silvia, Gentile, Simona, Wanjohi, Ruth, Gitau, Samuel N., Carlsen, Jonathan F., Nielsen, Michael B., Andersen, Tariq O.
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2407.11978
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929423849095168
author Zając, Hubert D.
Ribeiro, Jorge M. N.
Ingala, Silvia
Gentile, Simona
Wanjohi, Ruth
Gitau, Samuel N.
Carlsen, Jonathan F.
Nielsen, Michael B.
Andersen, Tariq O.
author_facet Zając, Hubert D.
Ribeiro, Jorge M. N.
Ingala, Silvia
Gentile, Simona
Wanjohi, Ruth
Gitau, Samuel N.
Carlsen, Jonathan F.
Nielsen, Michael B.
Andersen, Tariq O.
contents Artificial Intelligence (AI) repeatedly match or outperform radiologists in lab experiments. However, real-world implementations of radiological AI-based systems are found to provide little to no clinical value. This paper explores how to design AI for clinical usefulness in different contexts. We conducted 19 design sessions and design interventions with 13 radiologists from 7 clinical sites in Denmark and Kenya, based on three iterations of a functional AI-based prototype. Ten sociotechnical dependencies were identified as crucial for the design of AI in radiology. We conceptualised four technical dimensions that must be configured to the intended clinical context of use: AI functionality, AI medical focus, AI decision threshold, and AI Explainability. We present four design recommendations on how to address dependencies pertaining to the medical knowledge, clinic type, user expertise level, patient context, and user situation that condition the configuration of these technical dimensions.
format Preprint
id arxiv_https___arxiv_org_abs_2407_11978
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle "It depends": Configuring AI to Improve Clinical Usefulness Across Contexts
Zając, Hubert D.
Ribeiro, Jorge M. N.
Ingala, Silvia
Gentile, Simona
Wanjohi, Ruth
Gitau, Samuel N.
Carlsen, Jonathan F.
Nielsen, Michael B.
Andersen, Tariq O.
Human-Computer Interaction
Artificial Intelligence
Artificial Intelligence (AI) repeatedly match or outperform radiologists in lab experiments. However, real-world implementations of radiological AI-based systems are found to provide little to no clinical value. This paper explores how to design AI for clinical usefulness in different contexts. We conducted 19 design sessions and design interventions with 13 radiologists from 7 clinical sites in Denmark and Kenya, based on three iterations of a functional AI-based prototype. Ten sociotechnical dependencies were identified as crucial for the design of AI in radiology. We conceptualised four technical dimensions that must be configured to the intended clinical context of use: AI functionality, AI medical focus, AI decision threshold, and AI Explainability. We present four design recommendations on how to address dependencies pertaining to the medical knowledge, clinic type, user expertise level, patient context, and user situation that condition the configuration of these technical dimensions.
title "It depends": Configuring AI to Improve Clinical Usefulness Across Contexts
topic Human-Computer Interaction
Artificial Intelligence
url https://arxiv.org/abs/2407.11978