Mind the Gap: Preserving and Compensating for the Modality Gap in CLIP-Based Continual Learning
Fuente:
arXiv
Saved in:
| Main Authors: | Huang, Linlan, Cao, Xusheng, Lu, Haori, Meng, Yifan, Yang, Fei, Liu, Xialei |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Class-Incremental Learning with CLIP: Adaptive Representation Adjustment and Parameter Fusion
by: Huang, Linlan, et al.
Published: (2024)
by: Huang, Linlan, et al.
Published: (2024)
Knowledge Graph Enhanced Generative Multi-modal Models for Class-Incremental Learning
by: Cao, Xusheng, et al.
Published: (2025)
by: Cao, Xusheng, et al.
Published: (2025)
Restoring Forgotten Knowledge in Non-Exemplar Class Incremental Learning through Test-Time Semantic Evolution
by: Lu, Haori, et al.
Published: (2025)
by: Lu, Haori, et al.
Published: (2025)
Generative Multi-modal Models are Good Class-Incremental Learners
by: Cao, Xusheng, et al.
Published: (2024)
by: Cao, Xusheng, et al.
Published: (2024)
Learning Part Knowledge to Facilitate Category Understanding for Fine-Grained Generalized Category Discovery
by: Wang, Enguang, et al.
Published: (2025)
by: Wang, Enguang, et al.
Published: (2025)
Continual Learning for VLMs: A Survey and Taxonomy Beyond Forgetting
by: Liu, Yuyang, et al.
Published: (2025)
by: Liu, Yuyang, et al.
Published: (2025)
Mind the Gap: Learning Modality-Agnostic Representations with a Cross-Modality UNet
by: Niu, Xin, et al.
Published: (2026)
by: Niu, Xin, et al.
Published: (2026)
Toward Modality Gap: Vision Prototype Learning for Weakly-supervised Semantic Segmentation with CLIP
by: Xu, Zhongxing, et al.
Published: (2024)
by: Xu, Zhongxing, et al.
Published: (2024)
KAC: Kolmogorov-Arnold Classifier for Continual Learning
by: Hu, Yusong, et al.
Published: (2025)
by: Hu, Yusong, et al.
Published: (2025)
Mind the Gap: Continuous Magnification Sampling for Pathology Foundation Models
by: Möllers, Alexander, et al.
Published: (2026)
by: Möllers, Alexander, et al.
Published: (2026)
Fill the Gap: Quantifying and Reducing the Modality Gap in Image-Text Representation Learning
by: Role, François, et al.
Published: (2025)
by: Role, François, et al.
Published: (2025)
Cross the Gap: Exposing the Intra-modal Misalignment in CLIP via Modality Inversion
by: Mistretta, Marco, et al.
Published: (2025)
by: Mistretta, Marco, et al.
Published: (2025)
Mind the Gap: Confidence Discrepancy Can Guide Federated Semi-Supervised Learning Across Pseudo-Mismatch
by: Liu, Yijie, et al.
Published: (2025)
by: Liu, Yijie, et al.
Published: (2025)
Mitigate the Gap: Investigating Approaches for Improving Cross-Modal Alignment in CLIP
by: Eslami, Sedigheh, et al.
Published: (2024)
by: Eslami, Sedigheh, et al.
Published: (2024)
Overcoming the Stability Gap in Continual Learning
by: Harun, Md Yousuf, et al.
Published: (2023)
by: Harun, Md Yousuf, et al.
Published: (2023)
Mind the Gap Between Prototypes and Images in Cross-domain Finetuning
by: Tian, Hongduan, et al.
Published: (2024)
by: Tian, Hongduan, et al.
Published: (2024)
GET: Unlocking the Multi-modal Potential of CLIP for Generalized Category Discovery
by: Wang, Enguang, et al.
Published: (2024)
by: Wang, Enguang, et al.
Published: (2024)
Mind the Domain Gap: Measuring the Domain Gap Between Real-World and Synthetic Point Clouds for Automated Driving Development
by: Duc, Nguyen, et al.
Published: (2025)
by: Duc, Nguyen, et al.
Published: (2025)
Mind the Gap: Promoting Missing Modality Brain Tumor Segmentation with Alignment
by: Liu, Tianyi, et al.
Published: (2024)
by: Liu, Tianyi, et al.
Published: (2024)
Explaining and Mitigating the Modality Gap in Contrastive Multimodal Learning
by: Yaras, Can, et al.
Published: (2024)
by: Yaras, Can, et al.
Published: (2024)
Mind the Gap: Bridging Occlusion in Gait Recognition via Residual Gap Correction
by: Gupta, Ayush, et al.
Published: (2025)
by: Gupta, Ayush, et al.
Published: (2025)
Closing the Modality Gap Aligns Group-Wise Semantics
by: Grassucci, Eleonora, et al.
Published: (2026)
by: Grassucci, Eleonora, et al.
Published: (2026)
It's Not a Modality Gap: Characterizing and Addressing the Contrastive Gap
by: Fahim, Abrar, et al.
Published: (2024)
by: Fahim, Abrar, et al.
Published: (2024)
GNSP: Gradient Null Space Projection for Preserving Cross-Modal Alignment in VLMs Continual Learning
by: Peng, Tiantian, et al.
Published: (2025)
by: Peng, Tiantian, et al.
Published: (2025)
Multimodal Unsupervised Domain Generalization by Retrieving Across the Modality Gap
by: Liao, Christopher, et al.
Published: (2024)
by: Liao, Christopher, et al.
Published: (2024)
Bridge the Modality and Capability Gaps in Vision-Language Model Selection
by: Yi, Chao, et al.
Published: (2024)
by: Yi, Chao, et al.
Published: (2024)
Bridging the Task Gap: Multi-Task Adversarial Transferability in CLIP and Its Derivatives
by: Liu, Kuanrong, et al.
Published: (2025)
by: Liu, Kuanrong, et al.
Published: (2025)
Top-K Pairwise Ranking: Bridging the Gap Among Ranking-Based Measures for Multi-Label Classification
by: Wang, Zitai, et al.
Published: (2024)
by: Wang, Zitai, et al.
Published: (2024)
Is the Modality Gap a Bug or a Feature? A Robustness Perspective
by: Chowers, Rhea, et al.
Published: (2026)
by: Chowers, Rhea, et al.
Published: (2026)
Cross-Modal Mapping: Mitigating the Modality Gap for Few-Shot Image Classification
by: Yang, Xi, et al.
Published: (2024)
by: Yang, Xi, et al.
Published: (2024)
Closing the Approximation Gap of Partial AUC Optimization: A Tale of Two Formulations
by: Jiang, Yangbangyan, et al.
Published: (2025)
by: Jiang, Yangbangyan, et al.
Published: (2025)
Exploring the Stability Gap in Continual Learning: The Role of the Classification Head
by: Łapacz, Wojciech, et al.
Published: (2024)
by: Łapacz, Wojciech, et al.
Published: (2024)
Closing the Oracle Gap: Increment Vector Transformation for Class Incremental Learning
by: Qiu, Zihuan, et al.
Published: (2025)
by: Qiu, Zihuan, et al.
Published: (2025)
Logo-VGR: Visual Grounded Reasoning for Open-world Logo Recognition
by: Liang, Zichen, et al.
Published: (2025)
by: Liang, Zichen, et al.
Published: (2025)
Preserving Cross-Modal Consistency for CLIP-based Class-Incremental Learning
by: Chen, Haoran, et al.
Published: (2025)
by: Chen, Haoran, et al.
Published: (2025)
Disentangled Representation Learning with the Gromov-Monge Gap
by: Uscidda, Théo, et al.
Published: (2024)
by: Uscidda, Théo, et al.
Published: (2024)
SFTok: Bridging the Performance Gap in Discrete Tokenizers
by: Rao, Qihang, et al.
Published: (2025)
by: Rao, Qihang, et al.
Published: (2025)
Closing the Modality Gap for Mixed Modality Search
by: Li, Binxu, et al.
Published: (2025)
by: Li, Binxu, et al.
Published: (2025)
Mind the Gap: Analyzing Lacunae with Transformer-Based Transcription
by: Borkar, Jaydeep, et al.
Published: (2024)
by: Borkar, Jaydeep, et al.
Published: (2024)
Mind the Gap: Aligning Vision Foundation Models to Image Feature Matching
by: Liu, Yuhan, et al.
Published: (2025)
by: Liu, Yuhan, et al.
Published: (2025)
Similar Items
-
Class-Incremental Learning with CLIP: Adaptive Representation Adjustment and Parameter Fusion
by: Huang, Linlan, et al.
Published: (2024) -
Knowledge Graph Enhanced Generative Multi-modal Models for Class-Incremental Learning
by: Cao, Xusheng, et al.
Published: (2025) -
Restoring Forgotten Knowledge in Non-Exemplar Class Incremental Learning through Test-Time Semantic Evolution
by: Lu, Haori, et al.
Published: (2025) -
Generative Multi-modal Models are Good Class-Incremental Learners
by: Cao, Xusheng, et al.
Published: (2024) -
Learning Part Knowledge to Facilitate Category Understanding for Fine-Grained Generalized Category Discovery
by: Wang, Enguang, et al.
Published: (2025)