Cover Image

Toward Modality Gap: Vision Prototype Learning for Weakly-supervised Semantic Segmentation with CLIP

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Xu, Zhongxing, Tang, Feilong, Chen, Zhe, Su, Yingxue, Zhao, Zhiyi, Zhang, Ge, Su, Jionglong, Ge, Zongyuan
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Hunting Attributes: Context Prototype-Aware Learning for Weakly Supervised Semantic Segmentation
by: Tang, Feilong, et al.
Published: (2024)

Neighbor Does Matter: Density-Aware Contrastive Learning for Medical Semi-supervised Segmentation
by: Tang, Feilong, et al.
Published: (2024)

SAM-DCE: Addressing Token Uniformity and Semantic Over-Smoothing in Medical Segmentation
by: Hu, Yingzhen, et al.
Published: (2025)

PG-SAM: Prior-Guided SAM with Medical for Multi-organ Segmentation
by: Zhong, Yiheng, et al.
Published: (2025)

Seeing Far and Clearly: Mitigating Hallucinations in MLLMs with Attention Causal Decoding
by: Tang, Feilong, et al.
Published: (2025)

Distribution Guidance Network for Weakly Supervised Point Cloud Semantic Segmentation
by: Pan, Zhiyi, et al.
Published: (2024)

Exploring CLIP's Dense Knowledge for Weakly Supervised Semantic Segmentation
by: Yang, Zhiwei, et al.
Published: (2025)

SFC: Shared Feature Calibration in Weakly Supervised Semantic Segmentation
by: Zhao, Xinqiao, et al.
Published: (2024)

Thinking in Uncertainty: Mitigating Hallucinations in MLRMs with Latent Entropy-Aware Decoding
by: Xu, Zhongxing, et al.
Published: (2026)

WeakTr: Exploring Plain Vision Transformer for Weakly-supervised Semantic Segmentation
by: Zhu, Lianghui, et al.
Published: (2023)

SkinCLIP-VL: Consistency-Aware Vision-Language Learning for Multimodal Skin Cancer Diagnosis
by: Lu, Zhixiang, et al.
Published: (2026)

Causal-SAM-LLM: Large Language Models as Causal Reasoners for Robust Medical Segmentation
by: Tang, Tao, et al.
Published: (2025)

OphCLIP: Hierarchical Retrieval-Augmented Learning for Ophthalmic Surgical Video-Language Pretraining
by: Hu, Ming, et al.
Published: (2024)

Explore the Potential of CLIP for Training-Free Open Vocabulary Semantic Segmentation
by: Shao, Tong, et al.
Published: (2024)

Incomplete Modality Disentangled Representation for Ophthalmic Disease Grading and Diagnosis
by: Liu, Chengzhi, et al.
Published: (2025)

MSWAL: 3D Multi-class Segmentation of Whole Abdominal Lesions Dataset
by: Wu, Zhaodong, et al.
Published: (2025)

Closed-Loop Transfer for Weakly-supervised Affordance Grounding
by: Tang, Jiajin, et al.
Published: (2025)

Frozen CLIP: A Strong Backbone for Weakly Supervised Semantic Segmentation
by: Zhang, Bingfeng, et al.
Published: (2024)

Point Cloud Semantic Segmentation with Sparse and Inhomogeneous Annotations
by: Pan, Zhiyi, et al.
Published: (2023)

ColonAdapter: Geometry Estimation Through Foundation Model Adaptation for Colonoscopy
by: Jiang, Zhiyi, et al.
Published: (2025)

RMMSS: Towards Advanced Robust Multi-Modal Semantic Segmentation with Hybrid Prototype Distillation and Feature Selection
by: Tan, Jiaqi, et al.
Published: (2025)

Discriminating retinal microvascular and neuronal differences related to migraines: Deep Learning based Crossectional Study
by: Tang, Feilong, et al.
Published: (2024)

Confidence-Aware Self-Distillation for Multimodal Sentiment Analysis with Incomplete Modalities
by: Luo, Yanxi, et al.
Published: (2025)

Multi-Modal Prototypes for Open-World Semantic Segmentation
by: Yang, Yuhuan, et al.
Published: (2023)

Generalized Category Discovery under Domain Shift: A Frequency Domain Perspective
by: Feng, Wei, et al.
Published: (2025)

Revisiting Continual Semantic Segmentation with Pre-trained Vision Models
by: Zhang, Duzhen, et al.
Published: (2025)

DiCLIP: Diffusion Model Enhances CLIP's Dense Knowledge for Weakly Supervised Semantic Segmentation
by: Yang, Zhiwei, et al.
Published: (2026)

SSR: Semantic and Spatial Rectification for CLIP-based Weakly Supervised Segmentation
by: Bi, Xiuli, et al.
Published: (2025)

NEARL-CLIP: Interacted Query Adaptation with Orthogonal Regularization for Medical Vision-Language Understanding
by: Peng, Zelin, et al.
Published: (2025)

Diversified and Personalized Multi-rater Medical Image Segmentation
by: Wu, Yicheng, et al.
Published: (2024)

CorrCLIP: Reconstructing Patch Correlations in CLIP for Open-Vocabulary Semantic Segmentation
by: Zhang, Dengke, et al.
Published: (2024)

Semantic Class Distribution Learning for Debiasing Semi-Supervised Medical Image Segmentation
by: Su, Yingxue, et al.
Published: (2026)

Towards Dynamic 3D Reconstruction of Hand-Instrument Interaction in Ophthalmic Surgery
by: Hu, Ming, et al.
Published: (2025)

Enhancing Vision-Language Models Generalization via Diversity-Driven Novel Feature Synthesis
by: Yan, Siyuan, et al.
Published: (2024)

ReCLIP++: Learn to Rectify the Bias of CLIP for Unsupervised Semantic Segmentation
by: Wang, Jingyun, et al.
Published: (2024)

Towards Modality-agnostic Label-efficient Segmentation with Entropy-Regularized Distribution Alignment
by: Tang, Liyao, et al.
Published: (2024)

DermAgent: A Self-Reflective Agentic System for Dermatological Image Analysis with Multi-Tool Reasoning and Traceable Decision-Making
by: Liu, Yize, et al.
Published: (2026)

Boundary-Refined Prototype Generation: A General End-to-End Paradigm for Semi-Supervised Semantic Segmentation
by: Dong, Junhao, et al.
Published: (2023)

3D Weakly Supervised Semantic Segmentation with 2D Vision-Language Guidance
by: Xu, Xiaoxu, et al.
Published: (2024)

Bring Adaptive Binding Prototypes to Generalized Referring Expression Segmentation
by: Li, Weize, et al.
Published: (2024)