Hierarchical Self-Supervised Adversarial Training for Robust Vision Models in Histopathology

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Malik, Hashmat Shadab, Kunhimon, Shahina, Naseer, Muzammal, Khan, Fahad Shahbaz, Khan, Salman
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909536799948800
author Malik, Hashmat Shadab
Kunhimon, Shahina
Naseer, Muzammal
Khan, Fahad Shahbaz
Khan, Salman
author_facet Malik, Hashmat Shadab
Kunhimon, Shahina
Naseer, Muzammal
Khan, Fahad Shahbaz
Khan, Salman
contents Adversarial attacks pose significant challenges for vision models in critical fields like healthcare, where reliability is essential. Although adversarial training has been well studied in natural images, its application to biomedical and microscopy data remains limited. Existing self-supervised adversarial training methods overlook the hierarchical structure of histopathology images, where patient-slide-patch relationships provide valuable discriminative signals. To address this, we propose Hierarchical Self-Supervised Adversarial Training (HSAT), which exploits these properties to craft adversarial examples using multi-level contrastive learning and integrate it into adversarial training for enhanced robustness. We evaluate HSAT on multiclass histopathology dataset OpenSRH and the results show that HSAT outperforms existing methods from both biomedical and natural image domains. HSAT enhances robustness, achieving an average gain of 54.31% in the white-box setting and reducing performance drops to 3-4% in the black-box setting, compared to 25-30% for the baseline. These results set a new benchmark for adversarial training in this domain, paving the way for more robust models. Our Code for training and evaluation is available at https://github.com/HashmatShadab/HSAT.
format Preprint
id arxiv_https___arxiv_org_abs_2503_10629
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Hierarchical Self-Supervised Adversarial Training for Robust Vision Models in Histopathology
Malik, Hashmat Shadab
Kunhimon, Shahina
Naseer, Muzammal
Khan, Fahad Shahbaz
Khan, Salman
Computer Vision and Pattern Recognition
Adversarial attacks pose significant challenges for vision models in critical fields like healthcare, where reliability is essential. Although adversarial training has been well studied in natural images, its application to biomedical and microscopy data remains limited. Existing self-supervised adversarial training methods overlook the hierarchical structure of histopathology images, where patient-slide-patch relationships provide valuable discriminative signals. To address this, we propose Hierarchical Self-Supervised Adversarial Training (HSAT), which exploits these properties to craft adversarial examples using multi-level contrastive learning and integrate it into adversarial training for enhanced robustness. We evaluate HSAT on multiclass histopathology dataset OpenSRH and the results show that HSAT outperforms existing methods from both biomedical and natural image domains. HSAT enhances robustness, achieving an average gain of 54.31% in the white-box setting and reducing performance drops to 3-4% in the black-box setting, compared to 25-30% for the baseline. These results set a new benchmark for adversarial training in this domain, paving the way for more robust models. Our Code for training and evaluation is available at https://github.com/HashmatShadab/HSAT.
title Hierarchical Self-Supervised Adversarial Training for Robust Vision Models in Histopathology
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2503.10629