Leveraging Pathology Foundation Models for Panoptic Segmentation of Melanoma in H&E Images
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866912490708795392 |
|---|---|
| author | Lv, Jiaqi Zhu, Yijie Tenorio, Carmen Guadalupe Colin Chohan, Brinder Singh Eastwood, Mark Raza, Shan E Ahmed |
| author_facet | Lv, Jiaqi Zhu, Yijie Tenorio, Carmen Guadalupe Colin Chohan, Brinder Singh Eastwood, Mark Raza, Shan E Ahmed |
| contents | Melanoma is an aggressive form of skin cancer with rapid progression and high metastatic potential. Accurate characterisation of tissue morphology in melanoma is crucial for prognosis and treatment planning. However, manual segmentation of tissue regions from haematoxylin and eosin (H&E) stained whole-slide images (WSIs) is labour-intensive and prone to inter-observer variability, this motivates the need for reliable automated tissue segmentation methods. In this study, we propose a novel deep learning network for the segmentation of five tissue classes in melanoma H&E images. Our approach leverages Virchow2, a pathology foundation model trained on 3.1 million histopathology images as a feature extractor. These features are fused with the original RGB images and subsequently processed by an encoder-decoder segmentation network (Efficient-UNet) to produce accurate segmentation maps. The proposed model achieved first place in the tissue segmentation task of the PUMA Grand Challenge, demonstrating robust performance and generalizability. Our results show the potential and efficacy of incorporating pathology foundation models into segmentation networks to accelerate computational pathology workflows. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_13974 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Leveraging Pathology Foundation Models for Panoptic Segmentation of Melanoma in H&E Images Lv, Jiaqi Zhu, Yijie Tenorio, Carmen Guadalupe Colin Chohan, Brinder Singh Eastwood, Mark Raza, Shan E Ahmed Image and Video Processing Computer Vision and Pattern Recognition Quantitative Methods Melanoma is an aggressive form of skin cancer with rapid progression and high metastatic potential. Accurate characterisation of tissue morphology in melanoma is crucial for prognosis and treatment planning. However, manual segmentation of tissue regions from haematoxylin and eosin (H&E) stained whole-slide images (WSIs) is labour-intensive and prone to inter-observer variability, this motivates the need for reliable automated tissue segmentation methods. In this study, we propose a novel deep learning network for the segmentation of five tissue classes in melanoma H&E images. Our approach leverages Virchow2, a pathology foundation model trained on 3.1 million histopathology images as a feature extractor. These features are fused with the original RGB images and subsequently processed by an encoder-decoder segmentation network (Efficient-UNet) to produce accurate segmentation maps. The proposed model achieved first place in the tissue segmentation task of the PUMA Grand Challenge, demonstrating robust performance and generalizability. Our results show the potential and efficacy of incorporating pathology foundation models into segmentation networks to accelerate computational pathology workflows. |
| title | Leveraging Pathology Foundation Models for Panoptic Segmentation of Melanoma in H&E Images |
| topic | Image and Video Processing Computer Vision and Pattern Recognition Quantitative Methods |
| url | https://arxiv.org/abs/2507.13974 |