Pixel-level Counterfactual Contrastive Learning for Medical Image Segmentation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Lafargue-Hauret, Marceau, Mehta, Raghav, Ribeiro, Fabio De Sousa, Roschewitz, Mélanie, Glocker, Ben
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866918395181531136
author Lafargue-Hauret, Marceau
Mehta, Raghav
Ribeiro, Fabio De Sousa
Roschewitz, Mélanie
Glocker, Ben
author_facet Lafargue-Hauret, Marceau
Mehta, Raghav
Ribeiro, Fabio De Sousa
Roschewitz, Mélanie
Glocker, Ben
contents Image segmentation relies on large annotated datasets, which are expensive and slow to produce. Silver-standard (AI-generated) labels are easier to obtain, but they risk introducing bias. Self-supervised learning, needing only images, has become key for pre-training. Recent work combining contrastive learning with counterfactual generation improves representation learning for classification but does not readily extend to pixel-level tasks. We propose a pipeline combining counterfactual generation with dense contrastive learning via Dual-View (DVD-CL) and Multi-View (MVD-CL) methods, along with supervised variants that utilize available silver-standard annotations. A new visualisation algorithm, the Color-coded High Resolution Overlay map (CHRO-map) is also introduced. Experiments show annotation-free DVD-CL outperforms other dense contrastive learning methods, while supervised variants using silver-standard labels outperform training on the silver-standard labeled data directly, achieving $\sim$94% DSC on challenging data. These results highlight that pixel-level contrastive learning, enhanced by counterfactuals and silver-standard annotations, improves robustness to acquisition and pathological variations.
format Preprint
id arxiv_https___arxiv_org_abs_2603_17110
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Pixel-level Counterfactual Contrastive Learning for Medical Image Segmentation
Lafargue-Hauret, Marceau
Mehta, Raghav
Ribeiro, Fabio De Sousa
Roschewitz, Mélanie
Glocker, Ben
Computer Vision and Pattern Recognition
Machine Learning
Image segmentation relies on large annotated datasets, which are expensive and slow to produce. Silver-standard (AI-generated) labels are easier to obtain, but they risk introducing bias. Self-supervised learning, needing only images, has become key for pre-training. Recent work combining contrastive learning with counterfactual generation improves representation learning for classification but does not readily extend to pixel-level tasks. We propose a pipeline combining counterfactual generation with dense contrastive learning via Dual-View (DVD-CL) and Multi-View (MVD-CL) methods, along with supervised variants that utilize available silver-standard annotations. A new visualisation algorithm, the Color-coded High Resolution Overlay map (CHRO-map) is also introduced. Experiments show annotation-free DVD-CL outperforms other dense contrastive learning methods, while supervised variants using silver-standard labels outperform training on the silver-standard labeled data directly, achieving $\sim$94% DSC on challenging data. These results highlight that pixel-level contrastive learning, enhanced by counterfactuals and silver-standard annotations, improves robustness to acquisition and pathological variations.
title Pixel-level Counterfactual Contrastive Learning for Medical Image Segmentation
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2603.17110