Image de couverture de livre

ComKD-CLIP: Comprehensive Knowledge Distillation for Contrastive Language-Image Pre-traning Model

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Chen, Yifan, Qiao, Xiaozhen, Sun, Zhe, Li, Xuelong
Format:	Preprint
Publié:	2024
Sujets:	Computer Vision and Pattern Recognition
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Class-Aware Prototype Learning with Negative Contrast for Test-Time Adaptation of Vision-Language Models
par: Qiao, Xiaozhen, et autres
Publié: (2025)

CLIP-KD: An Empirical Study of CLIP Model Distillation
par: Yang, Chuanguang, et autres
Publié: (2023)

Mitigating Long-Tail Bias in HOI Detection via Adaptive Diversity Cache
par: Jiang, Yuqiu, et autres
Publié: (2025)

Switch-KD: Visual-Switch Knowledge Distillation for Vision-Language Models
par: Sun, Haoyi, et autres
Publié: (2026)

Bidirectional Prototype-Reward co-Evolution for Test-Time Adaptation of Vision-Language Models
par: Qiao, Xiaozhen, et autres
Publié: (2025)

CREST: Cross-modal Resonance through Evidential Deep Learning for Enhanced Zero-Shot Learning
par: Huang, Haojian, et autres
Publié: (2024)

PromptKD: Unsupervised Prompt Distillation for Vision-Language Models
par: Li, Zheng, et autres
Publié: (2024)

Dynamic Contrastive Knowledge Distillation for Efficient Image Restoration
par: Zhou, Yunshuai, et autres
Publié: (2024)

Align-KD: Distilling Cross-Modal Alignment Knowledge for Mobile Vision-Language Model
par: Feng, Qianhan, et autres
Publié: (2024)

CrossKD: Cross-Head Knowledge Distillation for Object Detection
par: Wang, Jiabao, et autres
Publié: (2023)

TopKD: Top-scaled Knowledge Distillation
par: Wang, Qi, et autres
Publié: (2025)

EA-KD: Entropy-based Adaptive Knowledge Distillation
par: Su, Chi-Ping, et autres
Publié: (2023)

CLIP-RD: Relative Distillation for Efficient CLIP Knowledge Distillation
par: Chung, Jeannie, et autres
Publié: (2026)

ClinKD: Cross-Modal Clinical Knowledge Distiller For Multi-Task Medical Images
par: Ge, Hongyu, et autres
Publié: (2025)

KD-DETR: Knowledge Distillation for Detection Transformer with Consistent Distillation Points Sampling
par: Wang, Yu, et autres
Publié: (2022)

MoKD: Multi-Task Optimization for Knowledge Distillation
par: Hayder, Zeeshan, et autres
Publié: (2025)

BD-KD: Balancing the Divergences for Online Knowledge Distillation
par: Amara, Ibtihel, et autres
Publié: (2022)

Advancing Visual Reliability: Color-Accurate Underwater Image Enhancement for Real-Time Underwater Missions
par: Zhou, Yiqiang, et autres
Publié: (2026)

RadCLIP: Enhancing Radiologic Image Analysis through Contrastive Language-Image Pre-training
par: Lu, Zhixiu, et autres
Publié: (2024)

Lightweight Model Pre-training via Language Guided Knowledge Distillation
par: Li, Mingsheng, et autres
Publié: (2024)

ACAM-KD: Adaptive and Cooperative Attention Masking for Knowledge Distillation
par: Lan, Qizhen, et autres
Publié: (2025)

FreeKD: Knowledge Distillation via Semantic Frequency Prompt
par: Zhang, Yuan, et autres
Publié: (2023)

CanKD: Cross-Attention-based Non-local operation for Feature-based Knowledge Distillation
par: Sun, Shizhe, et autres
Publié: (2025)

StableKD: Breaking Inter-block Optimization Entanglement for Stable Knowledge Distillation
par: Kao, Shiu-hong, et autres
Publié: (2023)

A Closer Look at the Robustness of Contrastive Language-Image Pre-Training (CLIP)
par: Tu, Weijie, et autres
Publié: (2024)

Fine-grained Image-to-LiDAR Contrastive Distillation with Visual Foundation Models
par: Zhang, Yifan, et autres
Publié: (2024)

AI-KD: Towards Alignment Invariant Face Image Quality Assessment Using Knowledge Distillation
par: Babnik, Žiga, et autres
Publié: (2024)

AHAP: Reconstructing Arbitrary Humans from Arbitrary Perspectives with Geometric Priors
par: Qiao, Xiaozhen, et autres
Publié: (2026)

DiffKD-DCIS: Predicting Upgrade of Ductal Carcinoma In Situ with Diffusion Augmentation and Knowledge Distillation
par: Li, Tao, et autres
Publié: (2026)

PowerCLIP: Powerset Alignment for Contrastive Pre-Training
par: Kawamura, Masaki, et autres
Publié: (2025)

AuG-KD: Anchor-Based Mixup Generation for Out-of-Domain Knowledge Distillation
par: Tang, Zihao, et autres
Publié: (2024)

Distilling Knowledge from Text-to-Image Generative Models Improves Visio-Linguistic Reasoning in CLIP
par: Basu, Samyadeep, et autres
Publié: (2023)

Is Contrastive Distillation Enough for Learning Comprehensive 3D Representations?
par: Zhang, Yifan, et autres
Publié: (2024)

Ultrasound-CLIP: Semantic-Aware Contrastive Pre-training for Ultrasound Image-Text Understanding
par: Jin, Jiayun, et autres
Publié: (2026)

LLaVA-KD: A Framework of Distilling Multimodal Large Language Models
par: Cai, Yuxuan, et autres
Publié: (2024)

TernaryCLIP: Efficiently Compressing Vision-Language Models with Ternary Weights and Distilled Knowledge
par: Zhang, Shu-Hao, et autres
Publié: (2025)

CustomKD: Customizing Large Vision Foundation for Edge Model Improvement via Knowledge Distillation
par: Lee, Jungsoo, et autres
Publié: (2025)

Contrastive Localized Language-Image Pre-Training
par: Chen, Hong-You, et autres
Publié: (2024)

VLM-KD: Knowledge Distillation from VLM for Long-Tail Visual Recognition
par: Zhang, Zaiwei, et autres
Publié: (2024)

MST-KD: Multiple Specialized Teachers Knowledge Distillation for Fair Face Recognition
par: Caldeira, Eduarda, et autres
Publié: (2024)