Cover Image

CKD: Contrastive Knowledge Distillation from A Sample-wise Perspective

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhu, Wencheng, Zhou, Xin, Zhu, Pengfei, Wang, Yu, Hu, Qinghua
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

VTD-CLIP: Video-to-Text Discretization via Prompting CLIP
by: Zhu, Wencheng, et al.
Published: (2025)

Rethinking Knowledge in Distillation: An In-context Sample Retrieval Perspective
by: Zhu, Jinjing, et al.
Published: (2025)

Dynamic Sub-graph Distillation for Robust Semi-supervised Continual Learning
by: Fan, Yan, et al.
Published: (2023)

Exploring Diverse Representations for Open Set Recognition
by: Wang, Yu, et al.
Published: (2024)

I2CKD : Intra- and Inter-Class Knowledge Distillation for Semantic Segmentation
by: Karine, Ayoub, et al.
Published: (2024)

Point Cloud Quantization through Multimodal Prompting for 3D Understanding
by: Li, Hongxuan, et al.
Published: (2025)

DIFF-MF: A Difference-Driven Channel-Spatial State Space Model for Multi-Modal Image Fusion
by: Sun, Yiming, et al.
Published: (2026)

Visible and Clear: Finding Tiny Objects in Difference Map
by: Cao, Bing, et al.
Published: (2024)

Task-Customized Mixture of Adapters for General Image Fusion
by: Zhu, Pengfei, et al.
Published: (2024)

KD-DETR: Knowledge Distillation for Detection Transformer with Consistent Distillation Points Sampling
by: Wang, Yu, et al.
Published: (2022)

CtrlFuse: Mask-Prompt Guided Controllable Infrared and Visible Image Fusion
by: Sun, Yiming, et al.
Published: (2026)

Dynamic Contrastive Knowledge Distillation for Efficient Image Restoration
by: Zhou, Yunshuai, et al.
Published: (2024)

LLaVA-CKD: Bottom-Up Cascaded Knowledge Distillation for Vision-Language Models
by: Gkalelis, Nikolaos, et al.
Published: (2026)

BackMix: Regularizing Open Set Recognition by Removing Underlying Fore-Background Priors
by: Wang, Yu, et al.
Published: (2025)

Sample-wise Adaptive Weighting for Transfer Consistency in Adversarial Distillation
by: Lee, Hongsin, et al.
Published: (2025)

Asymmetric Reinforcing against Multi-modal Representation Bias
by: Gao, Xiyuan, et al.
Published: (2025)

ActDistill: General Action-Guided Self-Derived Distillation for Efficient Vision-Language-Action Models
by: Ye, Wencheng, et al.
Published: (2025)

Beyond Single-Sample: Reliable Multi-Sample Distillation for Video Understanding
by: Li, Songlin, et al.
Published: (2026)

Efficient Masked AutoEncoder for Video Object Counting and A Large-Scale Benchmark
by: Cao, Bing, et al.
Published: (2024)

Dream-IF: Dynamic Relative EnhAnceMent for Image Fusion
by: Xu, Xingxin, et al.
Published: (2025)

Bi-directional Self-Registration for Misaligned Infrared-Visible Image Fusion
by: Li, Timing, et al.
Published: (2025)

WeCKD: Weakly-supervised Chained Distillation Network for Efficient Multimodal Medical Imaging
by: Rahman, Md. Abdur, et al.
Published: (2025)

Multi-perspective Contrastive Logit Distillation
by: Wang, Qi, et al.
Published: (2024)

Scale-Aware Contrastive Reverse Distillation for Unsupervised Medical Anomaly Detection
by: Li, Chunlei, et al.
Published: (2025)

DFMSD: Dual Feature Masking Stage-wise Knowledge Distillation for Object Detection
by: Zhang, Zhourui, et al.
Published: (2024)

Unleashing Degradation-Carrying Features in Symmetric U-Net: Simpler and Stronger Baselines for All-in-One Image Restoration
by: Jiao, Wenlong, et al.
Published: (2025)

RGBX-R1: Visual Modality Chain-of-Thought Guided Reinforcement Learning for Multimodal Grounding
by: Wu, Jiahe, et al.
Published: (2026)

Decoupled Multi-Predictor Optimization for Inference-Efficient Model Tuning
by: Luo, Liwei, et al.
Published: (2025)

Enriching Knowledge Distillation with Intra-Class Contrastive Learning
by: Yuan, Hua, et al.
Published: (2025)

Reversible Efficient Diffusion for Image Fusion
by: Xu, Xingxin, et al.
Published: (2026)

Image-Free Timestep Distillation via Continuous-Time Consistency with Trajectory-Sampled Pairs
by: Tang, Bao, et al.
Published: (2025)

Decoupling Dark Knowledge via Block-wise Logit Distillation for Feature-level Alignment
by: Yu, Chengting, et al.
Published: (2024)

Sample-level Adaptive Knowledge Distillation for Action Recognition
by: Li, Ping, et al.
Published: (2025)

Text-driven 3D Human Generation via Contrastive Preference Optimization
by: Zhou, Pengfei, et al.
Published: (2025)

Multi-view Deep Subspace Clustering Networks
by: Zhu, Pengfei, et al.
Published: (2019)

Sampling to Distill: Knowledge Transfer from Open-World Data
by: Wang, Yuzheng, et al.
Published: (2023)

Scale-wise Distillation of Diffusion Models
by: Starodubcev, Nikita, et al.
Published: (2025)

Dynamic Brightness Adaptation for Robust Multi-modal Image Fusion
by: Sun, Yiming, et al.
Published: (2024)

Student-Oriented Teacher Knowledge Refinement for Knowledge Distillation
by: Shen, Chaomin, et al.
Published: (2024)

DepthAgent: Towards Better Universal Depth Estimation via Sample-wise Expert Selection
by: Zhu, Jie, et al.
Published: (2026)