Saved in:
| Main Authors: | , , , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2404.04485 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910490005864448 |
|---|---|
| author | Gu, Hongyan Yang, Chunxu Magaki, Shino Zarrin-Khameh, Neda Lakis, Nelli S. Cobos, Inma Khanlou, Negar Zhang, Xinhai R. Assi, Jasmeet Byers, Joshua T. Hamza, Ameer Han, Karam Meyer, Anders Mirbaha, Hilda Mohila, Carrie A. Stevens, Todd M. Stone, Sara L. Yan, Wenzhong Haeri, Mohammad Chen, Xiang 'Anthony' |
| author_facet | Gu, Hongyan Yang, Chunxu Magaki, Shino Zarrin-Khameh, Neda Lakis, Nelli S. Cobos, Inma Khanlou, Negar Zhang, Xinhai R. Assi, Jasmeet Byers, Joshua T. Hamza, Ameer Han, Karam Meyer, Anders Mirbaha, Hilda Mohila, Carrie A. Stevens, Todd M. Stone, Sara L. Yan, Wenzhong Haeri, Mohammad Chen, Xiang 'Anthony' |
| contents | As Artificial Intelligence (AI) making advancements in medical decision-making, there is a growing need to ensure doctors develop appropriate reliance on AI to avoid adverse outcomes. However, existing methods in enabling appropriate AI reliance might encounter challenges while being applied in the medical domain. With this regard, this work employs and provides the validation of an alternative approach -- majority voting -- to facilitate appropriate reliance on AI in medical decision-making. This is achieved by a multi-institutional user study involving 32 medical professionals with various backgrounds, focusing on the pathology task of visually detecting a pattern, mitoses, in tumor images. Here, the majority voting process was conducted by synthesizing decisions under AI assistance from a group of pathology doctors (pathologists). Two metrics were used to evaluate the appropriateness of AI reliance: Relative AI Reliance (RAIR) and Relative Self-Reliance (RSR). Results showed that even with groups of three pathologists, majority-voted decisions significantly increased both RAIR and RSR -- by approximately 9% and 31%, respectively -- compared to decisions made by one pathologist collaborating with AI. This increased appropriateness resulted in better precision and recall in the detection of mitoses. While our study is centered on pathology, we believe these insights can be extended to general high-stakes decision-making processes involving similar visual tasks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_04485 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Majority Voting of Doctors Improves Appropriateness of AI Reliance in Pathology Gu, Hongyan Yang, Chunxu Magaki, Shino Zarrin-Khameh, Neda Lakis, Nelli S. Cobos, Inma Khanlou, Negar Zhang, Xinhai R. Assi, Jasmeet Byers, Joshua T. Hamza, Ameer Han, Karam Meyer, Anders Mirbaha, Hilda Mohila, Carrie A. Stevens, Todd M. Stone, Sara L. Yan, Wenzhong Haeri, Mohammad Chen, Xiang 'Anthony' Human-Computer Interaction As Artificial Intelligence (AI) making advancements in medical decision-making, there is a growing need to ensure doctors develop appropriate reliance on AI to avoid adverse outcomes. However, existing methods in enabling appropriate AI reliance might encounter challenges while being applied in the medical domain. With this regard, this work employs and provides the validation of an alternative approach -- majority voting -- to facilitate appropriate reliance on AI in medical decision-making. This is achieved by a multi-institutional user study involving 32 medical professionals with various backgrounds, focusing on the pathology task of visually detecting a pattern, mitoses, in tumor images. Here, the majority voting process was conducted by synthesizing decisions under AI assistance from a group of pathology doctors (pathologists). Two metrics were used to evaluate the appropriateness of AI reliance: Relative AI Reliance (RAIR) and Relative Self-Reliance (RSR). Results showed that even with groups of three pathologists, majority-voted decisions significantly increased both RAIR and RSR -- by approximately 9% and 31%, respectively -- compared to decisions made by one pathologist collaborating with AI. This increased appropriateness resulted in better precision and recall in the detection of mitoses. While our study is centered on pathology, we believe these insights can be extended to general high-stakes decision-making processes involving similar visual tasks. |
| title | Majority Voting of Doctors Improves Appropriateness of AI Reliance in Pathology |
| topic | Human-Computer Interaction |
| url | https://arxiv.org/abs/2404.04485 |