A Reasoning-Enabled Vision-Language Foundation Model for Chest X-ray Interpretation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhang, Yabin, Wang, Chong, Gao, Yunhe, Liu, Jiaming, Varma, Maya, Xu, Justin, Ostmeier, Sophie, Long, Jin, Gatidis, Sergios, Dehkharghani, Seena, Michalson, Arne, Hong, Eun Kyoung, Bluethgen, Christian, Guo, Haiwei Henry, Ortiz, Alexander Victor, Altmayer, Stephan, Bodapati, Sandhya, Janizek, Joseph David, Chang, Ken, Delbrouck, Jean-Benoit, Chaudhari, Akshay S., Langlotz, Curtis P.
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912994811707392
author Zhang, Yabin
Wang, Chong
Gao, Yunhe
Liu, Jiaming
Varma, Maya
Xu, Justin
Ostmeier, Sophie
Long, Jin
Gatidis, Sergios
Dehkharghani, Seena
Michalson, Arne
Hong, Eun Kyoung
Bluethgen, Christian
Guo, Haiwei Henry
Ortiz, Alexander Victor
Altmayer, Stephan
Bodapati, Sandhya
Janizek, Joseph David
Chang, Ken
Delbrouck, Jean-Benoit
Chaudhari, Akshay S.
Langlotz, Curtis P.
author_facet Zhang, Yabin
Wang, Chong
Gao, Yunhe
Liu, Jiaming
Varma, Maya
Xu, Justin
Ostmeier, Sophie
Long, Jin
Gatidis, Sergios
Dehkharghani, Seena
Michalson, Arne
Hong, Eun Kyoung
Bluethgen, Christian
Guo, Haiwei Henry
Ortiz, Alexander Victor
Altmayer, Stephan
Bodapati, Sandhya
Janizek, Joseph David
Chang, Ken
Delbrouck, Jean-Benoit
Chaudhari, Akshay S.
Langlotz, Curtis P.
contents Chest X-rays (CXRs) are among the most frequently performed imaging examinations worldwide, yet rising imaging volumes increase radiologist workload and the risk of diagnostic errors. Although artificial intelligence (AI) systems have shown promise for CXR interpretation, most generate only final predictions, without making explicit how visual evidence is translated into radiographic findings and diagnostic predictions. We present CheXOne, a reasoning-enabled vision-language model for CXR interpretation. CheXOne jointly generates diagnostic predictions and explicit, clinically grounded reasoning traces that connect visual evidence, radiographic findings, and these predictions. The model is trained on 14.7 million instruction and reasoning samples curated from 30 public datasets spanning 36 CXR interpretation tasks, using a two-stage framework that combines instruction tuning with reinforcement learning to improve reasoning quality. We evaluate CheXOne in zero-shot settings across visual question answering, report generation, visual grounding and reasoning assessment, covering 17 evaluation settings. CheXOne outperforms existing medical and general-domain foundation models and achieves strong performance on independent public benchmarks. A clinical reader study demonstrates that CheXOne-drafted reports are comparable to or better than resident-written reports in 55% of cases, while effectively addressing clinical indications and enhancing both report writing and CXR interpretation efficiency. Further analyses involving radiologists reveal that the generated reasoning traces show high clinical factuality and provide causal support for the final predictions, offering a plausible explanation for the performance gains. These results suggest that explicit reasoning can improve model performance, interpretability and clinical utility in AI-assisted CXR interpretation.
format Preprint
id arxiv_https___arxiv_org_abs_2604_00493
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle A Reasoning-Enabled Vision-Language Foundation Model for Chest X-ray Interpretation
Zhang, Yabin
Wang, Chong
Gao, Yunhe
Liu, Jiaming
Varma, Maya
Xu, Justin
Ostmeier, Sophie
Long, Jin
Gatidis, Sergios
Dehkharghani, Seena
Michalson, Arne
Hong, Eun Kyoung
Bluethgen, Christian
Guo, Haiwei Henry
Ortiz, Alexander Victor
Altmayer, Stephan
Bodapati, Sandhya
Janizek, Joseph David
Chang, Ken
Delbrouck, Jean-Benoit
Chaudhari, Akshay S.
Langlotz, Curtis P.
Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
Chest X-rays (CXRs) are among the most frequently performed imaging examinations worldwide, yet rising imaging volumes increase radiologist workload and the risk of diagnostic errors. Although artificial intelligence (AI) systems have shown promise for CXR interpretation, most generate only final predictions, without making explicit how visual evidence is translated into radiographic findings and diagnostic predictions. We present CheXOne, a reasoning-enabled vision-language model for CXR interpretation. CheXOne jointly generates diagnostic predictions and explicit, clinically grounded reasoning traces that connect visual evidence, radiographic findings, and these predictions. The model is trained on 14.7 million instruction and reasoning samples curated from 30 public datasets spanning 36 CXR interpretation tasks, using a two-stage framework that combines instruction tuning with reinforcement learning to improve reasoning quality. We evaluate CheXOne in zero-shot settings across visual question answering, report generation, visual grounding and reasoning assessment, covering 17 evaluation settings. CheXOne outperforms existing medical and general-domain foundation models and achieves strong performance on independent public benchmarks. A clinical reader study demonstrates that CheXOne-drafted reports are comparable to or better than resident-written reports in 55% of cases, while effectively addressing clinical indications and enhancing both report writing and CXR interpretation efficiency. Further analyses involving radiologists reveal that the generated reasoning traces show high clinical factuality and provide causal support for the final predictions, offering a plausible explanation for the performance gains. These results suggest that explicit reasoning can improve model performance, interpretability and clinical utility in AI-assisted CXR interpretation.
title A Reasoning-Enabled Vision-Language Foundation Model for Chest X-ray Interpretation
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2604.00493