Cover Image

CLIP-KD: An Empirical Study of CLIP Model Distillation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Yang, Chuanguang, An, Zhulin, Huang, Libo, Bi, Junyu, Yu, Xinqiang, Yang, Han, Diao, Boyu, Xu, Yongjun
Format:	Preprint
Published:	2023
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Multi-Teacher Knowledge Distillation with Reinforcement Learning for Visual Recognition
by: Yang, Chuanguang, et al.
Published: (2025)

Relational Diffusion Distillation for Efficient Image Generation
by: Feng, Weilun, et al.
Published: (2024)

Exemplar-Free Class Incremental Learning via Incremental Representation
by: Huang, Libo, et al.
Published: (2024)

Teacher-Guided Student Self-Knowledge Distillation Using Diffusion Model
by: Wang, Yu, et al.
Published: (2026)

Efficient Continual Learning through Frequency Decomposition and Integration
by: Liu, Ruiqi, et al.
Published: (2025)

Parameterized Prompt for Incremental Object Detection
by: An, Zijia, et al.
Published: (2025)

Q-VDiT: Towards Accurate Quantization and Distillation of Video-Generation Diffusion Transformers
by: Feng, Weilun, et al.
Published: (2025)

PrePrompt: Predictive prompting for class incremental learning
by: Huang, Libo, et al.
Published: (2025)

Continual Learning in the Frequency Domain
by: Liu, Ruiqi, et al.
Published: (2024)

IOR: Inversed Objects Replay for Incremental Object Detection
by: An, Zijia, et al.
Published: (2024)

MPQ-DM: Mixed Precision Quantization for Extremely Low Bit Diffusion Models
by: Feng, Weilun, et al.
Published: (2024)

Multi-party Collaborative Attention Control for Image Customization
by: Yang, Han, et al.
Published: (2025)

MPQ-DMv2: Flexible Residual Mixed Precision Quantization for Low-Bit Diffusion Models with Temporal Distillation
by: Feng, Weilun, et al.
Published: (2025)

S$^2$Q-VDiT: Accurate Quantized Video Diffusion Transformer with Salient Data and Sparse Token Distillation
by: Feng, Weilun, et al.
Published: (2025)

SRKD: Towards Efficient 3D Point Cloud Segmentation via Structure- and Relation-aware Knowledge Distillation
by: Li, Yuqi, et al.
Published: (2025)

Dynamical Adapter Fusion: Constructing A Global Adapter for Pre-Trained Model-based Class-Incremental Learning
by: Liu, Ruiqi, et al.
Published: (2026)

CLIP-RD: Relative Distillation for Efficient CLIP Knowledge Distillation
by: Chung, Jeannie, et al.
Published: (2026)

MultiAnimate: Pose-Guided Image Animation Made Extensible
by: Hu, Yingcheng, et al.
Published: (2026)

Semantic-Guided Dynamic Sparsification for Pre-Trained Model-based Class-Incremental Learning
by: Liu, Ruiqi, et al.
Published: (2026)

Can CLIP Count Stars? An Empirical Study on Quantity Bias in CLIP
by: Zhang, Zeliang, et al.
Published: (2024)

ComKD-CLIP: Comprehensive Knowledge Distillation for Contrastive Language-Image Pre-traning Model
by: Chen, Yifan, et al.
Published: (2024)

From Isolation to Integration: Building an Adaptive Expert Forest for Pre-Trained Model-based Class-Incremental Learning
by: Liu, Ruiqi, et al.
Published: (2026)

QuantSparse: Comprehensively Compressing Video Diffusion Transformer with Model Quantization and Attention Sparsification
by: Feng, Weilun, et al.
Published: (2025)

CLIP-CID: Efficient CLIP Distillation via Cluster-Instance Discrimination
by: Yang, Kaicheng, et al.
Published: (2024)

CLIP-Mamba: CLIP Pretrained Mamba Models with OOD and Hessian Evaluation
by: Huang, Weiquan, et al.
Published: (2024)

Frequency-Aligned Knowledge Distillation for Lightweight Spatiotemporal Forecasting
by: Li, Yuqi, et al.
Published: (2025)

Echo-Forcing: A Scene Memory Framework for Interactive Long Video Generation
by: Wu, Mingqiang, et al.
Published: (2026)

Quantized Visual Geometry Grounded Transformer
by: Feng, Weilun, et al.
Published: (2025)

AMMKD: Adaptive Multimodal Multi-teacher Distillation for Lightweight Vision-Language Models
by: Li, Yuqi, et al.
Published: (2025)

GaitKD: A Universal Decoupled Distillation Framework for Efficient Gait Recognition
by: Li, Yuqi, et al.
Published: (2026)

WorldCache: Accelerating World Models for Free via Heterogeneous Token Caching
by: Feng, Weilun, et al.
Published: (2026)

KD-DETR: Knowledge Distillation for Detection Transformer with Consistent Distillation Points Sampling
by: Wang, Yu, et al.
Published: (2022)

CLIP-VG: Self-paced Curriculum Adapting of CLIP for Visual Grounding
by: Xiao, Linhui, et al.
Published: (2023)

Online Policy Distillation with Decision-Attention
by: Yu, Xinqiang, et al.
Published: (2024)

MoCLIP: Motion-Aware Fine-Tuning and Distillation of CLIP for Human Motion Generation
by: Maldonado, Gabriel, et al.
Published: (2025)

SuperCLIP: CLIP with Simple Classification Supervision
by: Zhao, Weiheng, et al.
Published: (2025)

DGS-Net: Distillation-Guided Gradient Surgery for CLIP Fine-Tuning in AI-Generated Image Detection
by: Yan, Jiazhen, et al.
Published: (2025)

CLIP-VIS: Adapting CLIP for Open-Vocabulary Video Instance Segmentation
by: Zhu, Wenqi, et al.
Published: (2024)

DiCLIP: Diffusion Model Enhances CLIP's Dense Knowledge for Weakly Supervised Semantic Segmentation
by: Yang, Zhiwei, et al.
Published: (2026)

CLIP-Map: Structured Matrix Mapping for Parameter-Efficient CLIP Compression
by: Zhang, Kangjie, et al.
Published: (2026)