Advancing human-centric AI for robust X-ray analysis through holistic self-supervised learning
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866910432392904704 |
|---|---|
| author | Moutakanni, Théo Bojanowski, Piotr Chassagnon, Guillaume Hudelot, Céline Joulin, Armand LeCun, Yann Muckley, Matthew Oquab, Maxime Revel, Marie-Pierre Vakalopoulou, Maria |
| author_facet | Moutakanni, Théo Bojanowski, Piotr Chassagnon, Guillaume Hudelot, Céline Joulin, Armand LeCun, Yann Muckley, Matthew Oquab, Maxime Revel, Marie-Pierre Vakalopoulou, Maria |
| contents | AI Foundation models are gaining traction in various applications, including medical fields like radiology. However, medical foundation models are often tested on limited tasks, leaving their generalisability and biases unexplored. We present RayDINO, a large visual encoder trained by self-supervision on 873k chest X-rays. We compare RayDINO to previous state-of-the-art models across nine radiology tasks, from classification and dense segmentation to text generation, and provide an in depth analysis of population, age and sex biases of our model. Our findings suggest that self-supervision allows patient-centric AI proving useful in clinical workflows and interpreting X-rays holistically. With RayDINO and small task-specific adapters, we reach state-of-the-art results and improve generalization to unseen populations while mitigating bias, illustrating the true promise of foundation models: versatility and robustness. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_01469 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Advancing human-centric AI for robust X-ray analysis through holistic self-supervised learning Moutakanni, Théo Bojanowski, Piotr Chassagnon, Guillaume Hudelot, Céline Joulin, Armand LeCun, Yann Muckley, Matthew Oquab, Maxime Revel, Marie-Pierre Vakalopoulou, Maria Computer Vision and Pattern Recognition Artificial Intelligence AI Foundation models are gaining traction in various applications, including medical fields like radiology. However, medical foundation models are often tested on limited tasks, leaving their generalisability and biases unexplored. We present RayDINO, a large visual encoder trained by self-supervision on 873k chest X-rays. We compare RayDINO to previous state-of-the-art models across nine radiology tasks, from classification and dense segmentation to text generation, and provide an in depth analysis of population, age and sex biases of our model. Our findings suggest that self-supervision allows patient-centric AI proving useful in clinical workflows and interpreting X-rays holistically. With RayDINO and small task-specific adapters, we reach state-of-the-art results and improve generalization to unseen populations while mitigating bias, illustrating the true promise of foundation models: versatility and robustness. |
| title | Advancing human-centric AI for robust X-ray analysis through holistic self-supervised learning |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence |
| url | https://arxiv.org/abs/2405.01469 |