GreenRFM: Toward a resource-efficient radiology foundation model

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Li, Yingtai, Ming, Shuai, Zhao, Mingyue, Lai, Haoran, Wang, Rongsheng, Zhou, Rui, Wang, Rundong, Li, Yujia, Wei, Wei, Zhou, Shaohua Kevin
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866910043854602240
author Li, Yingtai
Ming, Shuai
Zhao, Mingyue
Lai, Haoran
Wang, Rongsheng
Zhou, Rui
Wang, Rundong
Li, Yujia
Wei, Wei
Zhou, Shaohua Kevin
author_facet Li, Yingtai
Ming, Shuai
Zhao, Mingyue
Lai, Haoran
Wang, Rongsheng
Zhou, Rui
Wang, Rundong
Li, Yujia
Wei, Wei
Zhou, Shaohua Kevin
contents The development of radiology foundation models (RFMs) is hindered by a reliance on brute-force scaling. Existing approaches often directly translate methods for natural images, which prioritize scale over precision and hence lead to brittle and expensive models in clinical practice. To address this, we present a resource-efficient pre-training framework, GreenRFM, that achieves state-of-the-art performance. Our framework ensures robust generalization across diverse patient populations and imaging protocols, reducing computational requirements by orders of magnitude while surpassing complex, parameter-heavy models. These capabilities stem from principled supervision design that aims to maximally utilize supervisory signals via More distilled, Ubiquitous, Semantic-enforcing, and Task-aligning (MUST) supervision, rather than simply piling up the quantity of training data. We offer two GreenRFM configurations: (i) a performant model that establishes a new state-of-the-art using a single 24GB GPU within 24 hours, and (ii) a lightweight model that matches existing benchmarks with 6GB VRAM in 4 hours. We conduct extensive experiments using over 200,000 images from four institutions and of two modalities. GreenRFMs achieve superior performances on chest and abdominal CT datasets, regardless of public or private benchmark, surpassing a range of baseline models. In addition, the results on internal musculoskeletal MRI images show that the same supervision principles transfer between different modalities. Our performance and efficiency challenge the ``scale is all you need'' dogma and democratize the equitable development of state-of-the-art RFMs for clinicians even on a laptop.
format Preprint
id arxiv_https___arxiv_org_abs_2603_06467
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle GreenRFM: Toward a resource-efficient radiology foundation model
Li, Yingtai
Ming, Shuai
Zhao, Mingyue
Lai, Haoran
Wang, Rongsheng
Zhou, Rui
Wang, Rundong
Li, Yujia
Wei, Wei
Zhou, Shaohua Kevin
Computer Vision and Pattern Recognition
The development of radiology foundation models (RFMs) is hindered by a reliance on brute-force scaling. Existing approaches often directly translate methods for natural images, which prioritize scale over precision and hence lead to brittle and expensive models in clinical practice. To address this, we present a resource-efficient pre-training framework, GreenRFM, that achieves state-of-the-art performance. Our framework ensures robust generalization across diverse patient populations and imaging protocols, reducing computational requirements by orders of magnitude while surpassing complex, parameter-heavy models. These capabilities stem from principled supervision design that aims to maximally utilize supervisory signals via More distilled, Ubiquitous, Semantic-enforcing, and Task-aligning (MUST) supervision, rather than simply piling up the quantity of training data. We offer two GreenRFM configurations: (i) a performant model that establishes a new state-of-the-art using a single 24GB GPU within 24 hours, and (ii) a lightweight model that matches existing benchmarks with 6GB VRAM in 4 hours. We conduct extensive experiments using over 200,000 images from four institutions and of two modalities. GreenRFMs achieve superior performances on chest and abdominal CT datasets, regardless of public or private benchmark, surpassing a range of baseline models. In addition, the results on internal musculoskeletal MRI images show that the same supervision principles transfer between different modalities. Our performance and efficiency challenge the ``scale is all you need'' dogma and democratize the equitable development of state-of-the-art RFMs for clinicians even on a laptop.
title GreenRFM: Toward a resource-efficient radiology foundation model
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2603.06467