Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2509.00549 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916927507529728 |
|---|---|
| author | Liu, Peirong Puonti, Oula Hu, Xiaoling Gopinath, Karthik Sorby-Adams, Annabel Alexander, Daniel C. Kimberly, W. Taylor Iglesias, Juan E. |
| author_facet | Liu, Peirong Puonti, Oula Hu, Xiaoling Gopinath, Karthik Sorby-Adams, Annabel Alexander, Daniel C. Kimberly, W. Taylor Iglesias, Juan E. |
| contents | Recent learning-based approaches have made astonishing advances in calibrated medical imaging like computerized tomography (CT), yet they struggle to generalize in uncalibrated modalities -- notably magnetic resonance (MR) imaging, where performance is highly sensitive to the differences in MR contrast, resolution, and orientation. This prevents broad applicability to diverse real-world clinical protocols. Here we introduce BrainFM, a modality-agnostic, multi-task vision foundation model for human brain imaging. With the proposed "mild-to-severe" intra-subject generation and "real-synth" mix-up training strategy, BrainFM is resilient to the appearance of acquired images (e.g., modality, contrast, deformation, resolution, artifacts), and can be directly applied to five fundamental brain imaging tasks, including image synthesis for CT and T1w/T2w/FLAIR MRI, anatomy segmentation, scalp-to-cortical distance, bias field estimation, and registration. We evaluate the efficacy of BrainFM on eleven public datasets, and demonstrate its robustness and effectiveness across all tasks and input modalities. Code is available at https://github.com/jhuldr/BrainFM. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_00549 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | A Modality-agnostic Multi-task Foundation Model for Human Brain Imaging Liu, Peirong Puonti, Oula Hu, Xiaoling Gopinath, Karthik Sorby-Adams, Annabel Alexander, Daniel C. Kimberly, W. Taylor Iglesias, Juan E. Computer Vision and Pattern Recognition Recent learning-based approaches have made astonishing advances in calibrated medical imaging like computerized tomography (CT), yet they struggle to generalize in uncalibrated modalities -- notably magnetic resonance (MR) imaging, where performance is highly sensitive to the differences in MR contrast, resolution, and orientation. This prevents broad applicability to diverse real-world clinical protocols. Here we introduce BrainFM, a modality-agnostic, multi-task vision foundation model for human brain imaging. With the proposed "mild-to-severe" intra-subject generation and "real-synth" mix-up training strategy, BrainFM is resilient to the appearance of acquired images (e.g., modality, contrast, deformation, resolution, artifacts), and can be directly applied to five fundamental brain imaging tasks, including image synthesis for CT and T1w/T2w/FLAIR MRI, anatomy segmentation, scalp-to-cortical distance, bias field estimation, and registration. We evaluate the efficacy of BrainFM on eleven public datasets, and demonstrate its robustness and effectiveness across all tasks and input modalities. Code is available at https://github.com/jhuldr/BrainFM. |
| title | A Modality-agnostic Multi-task Foundation Model for Human Brain Imaging |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2509.00549 |