Health system learning achieves generalist neuroimaging models
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912726361571328 |
|---|---|
| author | Kondepudi, Akhil Rao, Akshay Zhao, Chenhui Lyu, Yiwei Harake, Samir Banerjee, Soumyanil Joshi, Rushikesh Meissner, Anna-Katharina Hou, Renly Jiang, Cheng Chowdury, Asadur Srinivasan, Ashok Athey, Brian Gulani, Vikas Pandey, Aditya Lee, Honglak Hollon, Todd |
| author_facet | Kondepudi, Akhil Rao, Akshay Zhao, Chenhui Lyu, Yiwei Harake, Samir Banerjee, Soumyanil Joshi, Rushikesh Meissner, Anna-Katharina Hou, Renly Jiang, Cheng Chowdury, Asadur Srinivasan, Ashok Athey, Brian Gulani, Vikas Pandey, Aditya Lee, Honglak Hollon, Todd |
| contents | Frontier artificial intelligence (AI) models, such as OpenAI's GPT-5 and Meta's DINOv3, have advanced rapidly through training on internet-scale public data, yet such systems lack access to private clinical data. Neuroimaging, in particular, is underrepresented in the public domain due to identifiable facial features within MRI and CT scans, fundamentally restricting model performance in clinical medicine. Here, we show that frontier models underperform on neuroimaging tasks and that learning directly from uncurated data generated during routine clinical care at health systems, a paradigm we call health system learning, yields high-performance, generalist neuroimaging models. We introduce NeuroVFM, a visual foundation model trained on 5.24 million clinical MRI and CT volumes using a scalable volumetric joint-embedding predictive architecture. NeuroVFM learns comprehensive representations of brain anatomy and pathology, achieving state-of-the-art performance across multiple clinical tasks, including radiologic diagnosis and report generation. The model exhibits emergent neuroanatomic understanding and interpretable visual grounding of diagnostic findings. When paired with open-source language models through lightweight visual instruction tuning, NeuroVFM generates radiology reports that surpass frontier models in accuracy, clinical triage, and expert preference. Through clinically grounded visual understanding, NeuroVFM reduces hallucinated findings and critical errors, offering safer clinical decision support. These results establish health system learning as a paradigm for building generalist medical AI and provide a scalable framework for clinical foundation models. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_18640 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Health system learning achieves generalist neuroimaging models Kondepudi, Akhil Rao, Akshay Zhao, Chenhui Lyu, Yiwei Harake, Samir Banerjee, Soumyanil Joshi, Rushikesh Meissner, Anna-Katharina Hou, Renly Jiang, Cheng Chowdury, Asadur Srinivasan, Ashok Athey, Brian Gulani, Vikas Pandey, Aditya Lee, Honglak Hollon, Todd Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning Frontier artificial intelligence (AI) models, such as OpenAI's GPT-5 and Meta's DINOv3, have advanced rapidly through training on internet-scale public data, yet such systems lack access to private clinical data. Neuroimaging, in particular, is underrepresented in the public domain due to identifiable facial features within MRI and CT scans, fundamentally restricting model performance in clinical medicine. Here, we show that frontier models underperform on neuroimaging tasks and that learning directly from uncurated data generated during routine clinical care at health systems, a paradigm we call health system learning, yields high-performance, generalist neuroimaging models. We introduce NeuroVFM, a visual foundation model trained on 5.24 million clinical MRI and CT volumes using a scalable volumetric joint-embedding predictive architecture. NeuroVFM learns comprehensive representations of brain anatomy and pathology, achieving state-of-the-art performance across multiple clinical tasks, including radiologic diagnosis and report generation. The model exhibits emergent neuroanatomic understanding and interpretable visual grounding of diagnostic findings. When paired with open-source language models through lightweight visual instruction tuning, NeuroVFM generates radiology reports that surpass frontier models in accuracy, clinical triage, and expert preference. Through clinically grounded visual understanding, NeuroVFM reduces hallucinated findings and critical errors, offering safer clinical decision support. These results establish health system learning as a paradigm for building generalist medical AI and provide a scalable framework for clinical foundation models. |
| title | Health system learning achieves generalist neuroimaging models |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2511.18640 |