CF-Seg: Counterfactuals meet Segmentation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Mehta, Raghav, Ribeiro, Fabio De Sousa, Xia, Tian, Roschewitz, Melanie, Santhirasekaram, Ainkaran, Marshall, Dominic C., Glocker, Ben
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913901589823488
author Mehta, Raghav
Ribeiro, Fabio De Sousa
Xia, Tian
Roschewitz, Melanie
Santhirasekaram, Ainkaran
Marshall, Dominic C.
Glocker, Ben
author_facet Mehta, Raghav
Ribeiro, Fabio De Sousa
Xia, Tian
Roschewitz, Melanie
Santhirasekaram, Ainkaran
Marshall, Dominic C.
Glocker, Ben
contents Segmenting anatomical structures in medical images plays an important role in the quantitative assessment of various diseases. However, accurate segmentation becomes significantly more challenging in the presence of disease. Disease patterns can alter the appearance of surrounding healthy tissues, introduce ambiguous boundaries, or even obscure critical anatomical structures. As such, segmentation models trained on real-world datasets may struggle to provide good anatomical segmentation, leading to potential misdiagnosis. In this paper, we generate counterfactual (CF) images to simulate how the same anatomy would appear in the absence of disease without altering the underlying structure. We then use these CF images to segment structures of interest, without requiring any changes to the underlying segmentation model. Our experiments on two real-world clinical chest X-ray datasets show that the use of counterfactual images improves anatomical segmentation, thereby aiding downstream clinical decision-making.
format Preprint
id arxiv_https___arxiv_org_abs_2506_16213
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle CF-Seg: Counterfactuals meet Segmentation
Mehta, Raghav
Ribeiro, Fabio De Sousa
Xia, Tian
Roschewitz, Melanie
Santhirasekaram, Ainkaran
Marshall, Dominic C.
Glocker, Ben
Image and Video Processing
Artificial Intelligence
Computer Vision and Pattern Recognition
Segmenting anatomical structures in medical images plays an important role in the quantitative assessment of various diseases. However, accurate segmentation becomes significantly more challenging in the presence of disease. Disease patterns can alter the appearance of surrounding healthy tissues, introduce ambiguous boundaries, or even obscure critical anatomical structures. As such, segmentation models trained on real-world datasets may struggle to provide good anatomical segmentation, leading to potential misdiagnosis. In this paper, we generate counterfactual (CF) images to simulate how the same anatomy would appear in the absence of disease without altering the underlying structure. We then use these CF images to segment structures of interest, without requiring any changes to the underlying segmentation model. Our experiments on two real-world clinical chest X-ray datasets show that the use of counterfactual images improves anatomical segmentation, thereby aiding downstream clinical decision-making.
title CF-Seg: Counterfactuals meet Segmentation
topic Image and Video Processing
Artificial Intelligence
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2506.16213