DualProtoSeg: Simple and Efficient Design with Text- and Image-Guided Prototype Learning for Weakly Supervised Histopathology Image Segmentation
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917138060541952 |
|---|---|
| author | Vu, Anh M. Le, Khang P. Vo, Trang T. K. Thach, Ha Nguyen, Huy Hung Yang, David Huynh, Han H. Nguyen, Quynh Pham, Tuan M. Le, Tuan-Anh Le, Minh H. N. Nguyen, Thanh-Huy Awasthi, Akash Mohan, Chandra Han, Zhu Van Nguyen, Hien |
| author_facet | Vu, Anh M. Le, Khang P. Vo, Trang T. K. Thach, Ha Nguyen, Huy Hung Yang, David Huynh, Han H. Nguyen, Quynh Pham, Tuan M. Le, Tuan-Anh Le, Minh H. N. Nguyen, Thanh-Huy Awasthi, Akash Mohan, Chandra Han, Zhu Van Nguyen, Hien |
| contents | Weakly supervised semantic segmentation (WSSS) in histopathology seeks to reduce annotation cost by learning from image-level labels, yet it remains limited by inter-class homogeneity, intra-class heterogeneity, and the region-shrinkage effect of CAM-based supervision. We propose a simple and effective prototype-driven framework that leverages vision-language alignment to improve region discovery under weak supervision. Our method integrates CoOp-style learnable prompt tuning to generate text-based prototypes and combines them with learnable image prototypes, forming a dual-modal prototype bank that captures both semantic and appearance cues. To address oversmoothing in ViT representations, we incorporate a multi-scale pyramid module that enhances spatial precision and improves localization quality. Experiments on the BCSS-WSSS benchmark show that our approach surpasses existing state-of-the-art methods, and detailed analyses demonstrate the benefits of text description diversity, context length, and the complementary behavior of text and image prototypes. These results highlight the effectiveness of jointly leveraging textual semantics and visual prototype learning for WSSS in digital pathology. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2512_10314 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | DualProtoSeg: Simple and Efficient Design with Text- and Image-Guided Prototype Learning for Weakly Supervised Histopathology Image Segmentation Vu, Anh M. Le, Khang P. Vo, Trang T. K. Thach, Ha Nguyen, Huy Hung Yang, David Huynh, Han H. Nguyen, Quynh Pham, Tuan M. Le, Tuan-Anh Le, Minh H. N. Nguyen, Thanh-Huy Awasthi, Akash Mohan, Chandra Han, Zhu Van Nguyen, Hien Computer Vision and Pattern Recognition Weakly supervised semantic segmentation (WSSS) in histopathology seeks to reduce annotation cost by learning from image-level labels, yet it remains limited by inter-class homogeneity, intra-class heterogeneity, and the region-shrinkage effect of CAM-based supervision. We propose a simple and effective prototype-driven framework that leverages vision-language alignment to improve region discovery under weak supervision. Our method integrates CoOp-style learnable prompt tuning to generate text-based prototypes and combines them with learnable image prototypes, forming a dual-modal prototype bank that captures both semantic and appearance cues. To address oversmoothing in ViT representations, we incorporate a multi-scale pyramid module that enhances spatial precision and improves localization quality. Experiments on the BCSS-WSSS benchmark show that our approach surpasses existing state-of-the-art methods, and detailed analyses demonstrate the benefits of text description diversity, context length, and the complementary behavior of text and image prototypes. These results highlight the effectiveness of jointly leveraging textual semantics and visual prototype learning for WSSS in digital pathology. |
| title | DualProtoSeg: Simple and Efficient Design with Text- and Image-Guided Prototype Learning for Weakly Supervised Histopathology Image Segmentation |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2512.10314 |