USIGAN: Unbalanced Self-Information Feature Transport for Weakly Paired Image IHC Virtual Staining

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Peng, Yue, Xiong, Bing, Chen, Fuqiang, Eybo, De, Zhang, RanRan, Hu, Wanming, Cai, Jing, Qin, Wenjian
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866917510480134144
author Peng, Yue
Xiong, Bing
Chen, Fuqiang
Eybo, De
Zhang, RanRan
Hu, Wanming
Cai, Jing
Qin, Wenjian
author_facet Peng, Yue
Xiong, Bing
Chen, Fuqiang
Eybo, De
Zhang, RanRan
Hu, Wanming
Cai, Jing
Qin, Wenjian
contents Immunohistochemical (IHC) virtual staining is a task that generates virtual IHC images from H\&E images while maintaining pathological semantic consistency with adjacent slices. This task aims to achieve cross-domain mapping between morphological structures and staining patterns through generative models, providing an efficient and cost-effective solution for pathological analysis. However, under weakly paired conditions, spatial heterogeneity between adjacent slices presents significant challenges. This can lead to inaccurate one-to-many mappings and generate results that are inconsistent with the pathological semantics of adjacent slices. To address this issue, we propose a novel unbalanced self-information feature transport for IHC virtual staining, named USIGAN, which extracts global morphological semantics without relying on positional correspondence.By removing weakly paired terms in the joint marginal distribution, we effectively mitigate the impact of weak pairing on joint distributions, thereby significantly improving the content consistency and pathological semantic consistency of the generated results. Moreover, we design the Unbalanced Optimal Transport Consistency (UOT-CTM) mechanism and the Pathology Self-Correspondence (PC-SCM) mechanism to construct correlation matrices between H\&E and generated IHC in image-level and real IHC and generated IHC image sets in intra-group level.. Experiments conducted on two publicly available datasets demonstrate that our method achieves superior performance across multiple clinically significant metrics, such as IoD and Pearson-R correlation, demonstrating better clinical relevance.
format Preprint
id arxiv_https___arxiv_org_abs_2507_05843
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle USIGAN: Unbalanced Self-Information Feature Transport for Weakly Paired Image IHC Virtual Staining
Peng, Yue
Xiong, Bing
Chen, Fuqiang
Eybo, De
Zhang, RanRan
Hu, Wanming
Cai, Jing
Qin, Wenjian
Computer Vision and Pattern Recognition
Immunohistochemical (IHC) virtual staining is a task that generates virtual IHC images from H\&E images while maintaining pathological semantic consistency with adjacent slices. This task aims to achieve cross-domain mapping between morphological structures and staining patterns through generative models, providing an efficient and cost-effective solution for pathological analysis. However, under weakly paired conditions, spatial heterogeneity between adjacent slices presents significant challenges. This can lead to inaccurate one-to-many mappings and generate results that are inconsistent with the pathological semantics of adjacent slices. To address this issue, we propose a novel unbalanced self-information feature transport for IHC virtual staining, named USIGAN, which extracts global morphological semantics without relying on positional correspondence.By removing weakly paired terms in the joint marginal distribution, we effectively mitigate the impact of weak pairing on joint distributions, thereby significantly improving the content consistency and pathological semantic consistency of the generated results. Moreover, we design the Unbalanced Optimal Transport Consistency (UOT-CTM) mechanism and the Pathology Self-Correspondence (PC-SCM) mechanism to construct correlation matrices between H\&E and generated IHC in image-level and real IHC and generated IHC image sets in intra-group level.. Experiments conducted on two publicly available datasets demonstrate that our method achieves superior performance across multiple clinically significant metrics, such as IoD and Pearson-R correlation, demonstrating better clinical relevance.
title USIGAN: Unbalanced Self-Information Feature Transport for Weakly Paired Image IHC Virtual Staining
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2507.05843