Demographic Bias of Expert-Level Vision-Language Foundation Models in Medical Imaging
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866929253110513664 |
|---|---|
| author | Yang, Yuzhe Liu, Yujia Liu, Xin Gulhane, Avanti Mastrodicasa, Domenico Wu, Wei Wang, Edward J Sahani, Dushyant W Patel, Shwetak |
| author_facet | Yang, Yuzhe Liu, Yujia Liu, Xin Gulhane, Avanti Mastrodicasa, Domenico Wu, Wei Wang, Edward J Sahani, Dushyant W Patel, Shwetak |
| contents | Advances in artificial intelligence (AI) have achieved expert-level performance in medical imaging applications. Notably, self-supervised vision-language foundation models can detect a broad spectrum of pathologies without relying on explicit training annotations. However, it is crucial to ensure that these AI models do not mirror or amplify human biases, thereby disadvantaging historically marginalized groups such as females or Black patients. The manifestation of such biases could systematically delay essential medical care for certain patient subgroups. In this study, we investigate the algorithmic fairness of state-of-the-art vision-language foundation models in chest X-ray diagnosis across five globally-sourced datasets. Our findings reveal that compared to board-certified radiologists, these foundation models consistently underdiagnose marginalized groups, with even higher rates seen in intersectional subgroups, such as Black female patients. Such demographic biases present over a wide range of pathologies and demographic attributes. Further analysis of the model embedding uncovers its significant encoding of demographic information. Deploying AI systems with these biases in medical imaging can intensify pre-existing care disparities, posing potential challenges to equitable healthcare access and raising ethical questions about their clinical application. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_14815 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Demographic Bias of Expert-Level Vision-Language Foundation Models in Medical Imaging Yang, Yuzhe Liu, Yujia Liu, Xin Gulhane, Avanti Mastrodicasa, Domenico Wu, Wei Wang, Edward J Sahani, Dushyant W Patel, Shwetak Computers and Society Artificial Intelligence Computer Vision and Pattern Recognition Machine Learning Advances in artificial intelligence (AI) have achieved expert-level performance in medical imaging applications. Notably, self-supervised vision-language foundation models can detect a broad spectrum of pathologies without relying on explicit training annotations. However, it is crucial to ensure that these AI models do not mirror or amplify human biases, thereby disadvantaging historically marginalized groups such as females or Black patients. The manifestation of such biases could systematically delay essential medical care for certain patient subgroups. In this study, we investigate the algorithmic fairness of state-of-the-art vision-language foundation models in chest X-ray diagnosis across five globally-sourced datasets. Our findings reveal that compared to board-certified radiologists, these foundation models consistently underdiagnose marginalized groups, with even higher rates seen in intersectional subgroups, such as Black female patients. Such demographic biases present over a wide range of pathologies and demographic attributes. Further analysis of the model embedding uncovers its significant encoding of demographic information. Deploying AI systems with these biases in medical imaging can intensify pre-existing care disparities, posing potential challenges to equitable healthcare access and raising ethical questions about their clinical application. |
| title | Demographic Bias of Expert-Level Vision-Language Foundation Models in Medical Imaging |
| topic | Computers and Society Artificial Intelligence Computer Vision and Pattern Recognition Machine Learning |
| url | https://arxiv.org/abs/2402.14815 |