MI-CXR: A Benchmark for Longitudinal Reasoning over Multi-Interval Chest X-rays

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Cho, Sunghwan Steve, Han, Yunseok, Do, Jaeyoung
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909046182772736
author Cho, Sunghwan Steve
Han, Yunseok
Do, Jaeyoung
author_facet Cho, Sunghwan Steve
Han, Yunseok
Do, Jaeyoung
contents Longitudinal chest X-ray (CXR) interpretation requires reasoning over disease evolution across multiple patient visits, yet most existing medical VQA benchmarks focus on single images or short-horizon image pairs. We introduce MI-CXR, a benchmark for standardized evaluation of Multi-Interval longitudinal reasoning over multi-visit CXR sequences, without requiring free-form report generation or additional clinical context. MI-CXR comprises five-way multiple-choice questions over five-visit patient timelines and instantiates three complementary task families: Temporal Event Localization, Interval-wise Change Reasoning, and Global Trajectory Summarization, which assess clinically grounded visual reasoning over time. Evaluating 14 state-of-the-art vision-language models (VLMs) shows low overall performance, with an average accuracy of 29.3%, only modestly above random guessing. Using stage-wise diagnostic probing, we find that models often produce locally plausible interval descriptions but fail to enforce temporal constraints or compose evidence into globally consistent decisions over the full timeline. These findings reveal key limitations of current VLMs and establish MI-CXR as a principled benchmark for longitudinal medical reasoning. The benchmark is available at https://github.com/AIDASLab/MI-CXR
format Preprint
id arxiv_https___arxiv_org_abs_2605_15574
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle MI-CXR: A Benchmark for Longitudinal Reasoning over Multi-Interval Chest X-rays
Cho, Sunghwan Steve
Han, Yunseok
Do, Jaeyoung
Computer Vision and Pattern Recognition
Longitudinal chest X-ray (CXR) interpretation requires reasoning over disease evolution across multiple patient visits, yet most existing medical VQA benchmarks focus on single images or short-horizon image pairs. We introduce MI-CXR, a benchmark for standardized evaluation of Multi-Interval longitudinal reasoning over multi-visit CXR sequences, without requiring free-form report generation or additional clinical context. MI-CXR comprises five-way multiple-choice questions over five-visit patient timelines and instantiates three complementary task families: Temporal Event Localization, Interval-wise Change Reasoning, and Global Trajectory Summarization, which assess clinically grounded visual reasoning over time. Evaluating 14 state-of-the-art vision-language models (VLMs) shows low overall performance, with an average accuracy of 29.3%, only modestly above random guessing. Using stage-wise diagnostic probing, we find that models often produce locally plausible interval descriptions but fail to enforce temporal constraints or compose evidence into globally consistent decisions over the full timeline. These findings reveal key limitations of current VLMs and establish MI-CXR as a principled benchmark for longitudinal medical reasoning. The benchmark is available at https://github.com/AIDASLab/MI-CXR
title MI-CXR: A Benchmark for Longitudinal Reasoning over Multi-Interval Chest X-rays
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2605.15574