Unsupervised Causal Prototypical Networks for De-biased Interpretable Dermoscopy Diagnosis

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Jia, Junhao, Wu, Yueyi, Chen, Huangwei, Jing, Haodong, Wang, Haishuai, Bu, Jiajun, Wu, Lei
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912930092548096
author Jia, Junhao
Wu, Yueyi
Chen, Huangwei
Jing, Haodong
Wang, Haishuai
Bu, Jiajun
Wu, Lei
author_facet Jia, Junhao
Wu, Yueyi
Chen, Huangwei
Jing, Haodong
Wang, Haishuai
Bu, Jiajun
Wu, Lei
contents Despite the success of deep learning in dermoscopy image analysis, its inherent black-box nature hinders clinical trust, motivating the use of prototypical networks for case-based visual transparency. However, inevitable selection bias in clinical data often drives these models toward shortcut learning, where environmental confounders are erroneously encoded as predictive prototypes, generating spurious visual evidence that misleads medical decision-making. To mitigate these confounding effects, we propose CausalProto, an Unsupervised Causal Prototypical Network that fundamentally purifies the visual evidence chain. Framed within a Structural Causal Model, we employ an Information Bottleneck-constrained encoder to enforce strict unsupervised orthogonal disentanglement between pathological features and environmental confounders. By mapping these decoupled representations into independent prototypical spaces, we leverage the learned spurious dictionary to perform backdoor adjustment via do-calculus, transforming complex causal interventions into efficient expectation pooling to marginalize environmental noise. Extensive experiments on multiple dermoscopy datasets demonstrate that CausalProto achieves superior diagnostic performance and consistently outperforms standard black box models, while simultaneously providing transparent and high purity visual interpretability without suffering from the traditional accuracy compromise.
format Preprint
id arxiv_https___arxiv_org_abs_2602_23752
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Unsupervised Causal Prototypical Networks for De-biased Interpretable Dermoscopy Diagnosis
Jia, Junhao
Wu, Yueyi
Chen, Huangwei
Jing, Haodong
Wang, Haishuai
Bu, Jiajun
Wu, Lei
Image and Video Processing
Computer Vision and Pattern Recognition
Despite the success of deep learning in dermoscopy image analysis, its inherent black-box nature hinders clinical trust, motivating the use of prototypical networks for case-based visual transparency. However, inevitable selection bias in clinical data often drives these models toward shortcut learning, where environmental confounders are erroneously encoded as predictive prototypes, generating spurious visual evidence that misleads medical decision-making. To mitigate these confounding effects, we propose CausalProto, an Unsupervised Causal Prototypical Network that fundamentally purifies the visual evidence chain. Framed within a Structural Causal Model, we employ an Information Bottleneck-constrained encoder to enforce strict unsupervised orthogonal disentanglement between pathological features and environmental confounders. By mapping these decoupled representations into independent prototypical spaces, we leverage the learned spurious dictionary to perform backdoor adjustment via do-calculus, transforming complex causal interventions into efficient expectation pooling to marginalize environmental noise. Extensive experiments on multiple dermoscopy datasets demonstrate that CausalProto achieves superior diagnostic performance and consistently outperforms standard black box models, while simultaneously providing transparent and high purity visual interpretability without suffering from the traditional accuracy compromise.
title Unsupervised Causal Prototypical Networks for De-biased Interpretable Dermoscopy Diagnosis
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2602.23752