2-Factor Retrieval for Improved Human-AI Decision Making in Radiology
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866917852861169664 |
|---|---|
| author | Solomon, Jim Jalilian, Laleh Vilesov, Alexander Mathew, Meryl Grogan, Tristan Bedayat, Arash Kadambi, Achuta |
| author_facet | Solomon, Jim Jalilian, Laleh Vilesov, Alexander Mathew, Meryl Grogan, Tristan Bedayat, Arash Kadambi, Achuta |
| contents | Human-machine teaming in medical AI requires us to understand to what degree a trained clinician should weigh AI predictions. While previous work has shown the potential of AI assistance at improving clinical predictions, existing clinical decision support systems either provide no explainability of their predictions or use techniques like saliency and Shapley values, which do not allow for physician-based verification. To address this gap, this study compares previously used explainable AI techniques with a newly proposed technique termed '2-factor retrieval (2FR)', which is a combination of interface design and search retrieval that returns similarly labeled data without processing this data. This results in a 2-factor security blanket where: (a) correct images need to be retrieved by the AI; and (b) humans should associate the retrieved images with the current pathology under test. We find that when tested on chest X-ray diagnoses, 2FR leads to increases in clinician accuracy, with particular improvements when clinicians are radiologists and have low confidence in their decision. Our results highlight the importance of understanding how different modes of human-AI decision making may impact clinician accuracy in clinical decision support systems. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_00372 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | 2-Factor Retrieval for Improved Human-AI Decision Making in Radiology Solomon, Jim Jalilian, Laleh Vilesov, Alexander Mathew, Meryl Grogan, Tristan Bedayat, Arash Kadambi, Achuta Human-Computer Interaction Artificial Intelligence Human-machine teaming in medical AI requires us to understand to what degree a trained clinician should weigh AI predictions. While previous work has shown the potential of AI assistance at improving clinical predictions, existing clinical decision support systems either provide no explainability of their predictions or use techniques like saliency and Shapley values, which do not allow for physician-based verification. To address this gap, this study compares previously used explainable AI techniques with a newly proposed technique termed '2-factor retrieval (2FR)', which is a combination of interface design and search retrieval that returns similarly labeled data without processing this data. This results in a 2-factor security blanket where: (a) correct images need to be retrieved by the AI; and (b) humans should associate the retrieved images with the current pathology under test. We find that when tested on chest X-ray diagnoses, 2FR leads to increases in clinician accuracy, with particular improvements when clinicians are radiologists and have low confidence in their decision. Our results highlight the importance of understanding how different modes of human-AI decision making may impact clinician accuracy in clinical decision support systems. |
| title | 2-Factor Retrieval for Improved Human-AI Decision Making in Radiology |
| topic | Human-Computer Interaction Artificial Intelligence |
| url | https://arxiv.org/abs/2412.00372 |