Saved in:
Bibliographic Details
Main Authors: Srivastava, Shantam, Bhosale, Mahesh, Doermann, David, Gao, Mingchen
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2604.10410
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918449392910336
author Srivastava, Shantam
Bhosale, Mahesh
Doermann, David
Gao, Mingchen
author_facet Srivastava, Shantam
Bhosale, Mahesh
Doermann, David
Gao, Mingchen
contents Interpreting chest X-rays is inherently challenging due to the overlap between anatomical structures and the subtle presentation of many clinically significant pathologies, making accurate diagnosis time-consuming even for experienced radiologists. Recent radiology-focused foundation models, such as LLaVA-Rad and Maira-2, have positioned multi-modal large language models (MLLMs) at the forefront of automated radiology report generation (RRG). However, despite these advances, current foundation models generate reports in a single forward pass. This decoding strategy diminishes attention to visual tokens and increases reliance on language priors as generation proceeds, which in turn introduces spurious pathology co-occurrences in the generated reports. To mitigate these limitations, we propose Category-Wise Contrastive Decoding (CWCD), a novel and modular framework designed to enhance structured radiology report generation (SRRG). Our approach introduces category-specific parameterization and generates category-wise reports by contrasting normal X-rays with masked X-rays using category-specific visual prompts. Experimental results demonstrate that CWCD consistently outperforms baseline methods across both clinical efficacy and natural language generation metrics. An ablation study further elucidates the contribution of each architectural component to overall performance.
format Preprint
id arxiv_https___arxiv_org_abs_2604_10410
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle CWCD: Category-Wise Contrastive Decoding for Structured Medical Report Generation
Srivastava, Shantam
Bhosale, Mahesh
Doermann, David
Gao, Mingchen
Artificial Intelligence
Interpreting chest X-rays is inherently challenging due to the overlap between anatomical structures and the subtle presentation of many clinically significant pathologies, making accurate diagnosis time-consuming even for experienced radiologists. Recent radiology-focused foundation models, such as LLaVA-Rad and Maira-2, have positioned multi-modal large language models (MLLMs) at the forefront of automated radiology report generation (RRG). However, despite these advances, current foundation models generate reports in a single forward pass. This decoding strategy diminishes attention to visual tokens and increases reliance on language priors as generation proceeds, which in turn introduces spurious pathology co-occurrences in the generated reports. To mitigate these limitations, we propose Category-Wise Contrastive Decoding (CWCD), a novel and modular framework designed to enhance structured radiology report generation (SRRG). Our approach introduces category-specific parameterization and generates category-wise reports by contrasting normal X-rays with masked X-rays using category-specific visual prompts. Experimental results demonstrate that CWCD consistently outperforms baseline methods across both clinical efficacy and natural language generation metrics. An ablation study further elucidates the contribution of each architectural component to overall performance.
title CWCD: Category-Wise Contrastive Decoding for Structured Medical Report Generation
topic Artificial Intelligence
url https://arxiv.org/abs/2604.10410