Cover Image

Preview-based Category Contrastive Learning for Knowledge Distillation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ding, Muhe, Wu, Jianlong, Dong, Xue, Li, Xiaojie, Qin, Pengda, Gan, Tian, Nie, Liqiang
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

DKDM: Data-Free Knowledge Distillation for Diffusion Models with Any Architecture
by: Xiang, Qianlong, et al.
Published: (2024)

Continuous Knowledge-Preserving Decomposition with Adaptive Layer Selection for Few-Shot Class-Incremental Learning
by: Li, Xiaojie, et al.
Published: (2025)

On Distilling the Displacement Knowledge for Few-Shot Class-Incremental Learning
by: Fang, Pengfei, et al.
Published: (2024)

Enriching Knowledge Distillation with Intra-Class Contrastive Learning
by: Yuan, Hua, et al.
Published: (2025)

GenView++: Unifying Adaptive Generative Augmentation and Quality-Driven Supervision for Contrastive Representation Learning
by: Li, Xiaojie, et al.
Published: (2025)

Continual Distillation Learning: Knowledge Distillation in Prompt-based Continual Learning
by: Zhang, Qifan, et al.
Published: (2024)

Category Adaptation Meets Projected Distillation in Generalized Continual Category Discovery
by: Rypeść, Grzegorz, et al.
Published: (2023)

Video DataFlywheel: Resolving the Impossible Data Trinity in Video-Language Understanding
by: Wang, Xiao, et al.
Published: (2024)

Conditional Pseudo-Supervised Contrast for Data-Free Knowledge Distillation
by: Shao, Renrong, et al.
Published: (2025)

Topology-Guided Knowledge Distillation for Efficient Point Cloud Processing
by: Hai, Luu Tung, et al.
Published: (2025)

Densely Distilling Cumulative Knowledge for Continual Learning
by: Shi, Zenglin, et al.
Published: (2024)

Quantum-Gated Task-interaction Knowledge Distillation for Pre-trained Model-based Class-Incremental Learning
by: Li, Linjie, et al.
Published: (2026)

PSPU: Enhanced Positive and Unlabeled Learning by Leveraging Pseudo Supervision
by: Wang, Chengjie, et al.
Published: (2024)

Frequency-Aligned Knowledge Distillation for Lightweight Spatiotemporal Forecasting
by: Li, Yuqi, et al.
Published: (2025)

Highlight Every Step: Knowledge Distillation via Collaborative Teaching
by: Zhao, Haoran, et al.
Published: (2019)

A Generalization Theory of Cross-Modality Distillation with Contrastive Learning
by: Lin, Hangyu, et al.
Published: (2024)

Image Diffusion Preview with Consistency Solver
by: Wang, Fu-Yun, et al.
Published: (2025)

Unleashing the Potential of Model Bias for Generalized Category Discovery
by: An, Wenbin, et al.
Published: (2024)

Learning Part Knowledge to Facilitate Category Understanding for Fine-Grained Generalized Category Discovery
by: Wang, Enguang, et al.
Published: (2025)

A Label is Worth a Thousand Images in Dataset Distillation
by: Qin, Tian, et al.
Published: (2024)

FREPix: Frequency-Heterogeneous Flow Matching for Pixel-Space Image Generation
by: Lin, Mingfeng, et al.
Published: (2026)

ReffAKD: Resource-efficient Autoencoder-based Knowledge Distillation
by: Doshi, Divyang, et al.
Published: (2024)

MST-Distill: Mixture of Specialized Teachers for Cross-Modal Knowledge Distillation
by: Li, Hui, et al.
Published: (2025)

Improving Knowledge Distillation in Transfer Learning with Layer-wise Learning Rates
by: Kokane, Shirley, et al.
Published: (2024)

Sparsity Hurts: Simple Linear Adapter Can Boost Generalized Category Discovery
by: Ye, Bo, et al.
Published: (2026)

Distilling the Knowledge in Data Pruning
by: Ben-Baruch, Emanuel, et al.
Published: (2024)

Mamba-FSCIL: Dynamic Adaptation with Selective State Space Model for Few-Shot Class-Incremental Learning
by: Li, Xiaojie, et al.
Published: (2024)

ContrastCAD: Contrastive Learning-based Representation Learning for Computer-Aided Design Models
by: Jung, Minseop, et al.
Published: (2024)

Unveil Benign Overfitting for Transformer in Vision: Training Dynamics, Convergence, and Generalization
by: Jiang, Jiarui, et al.
Published: (2024)

Dress&Dance: Dress up and Dance as You Like It - Technical Preview
by: Chen, Jun-Kun, et al.
Published: (2025)

Learnable Cross-modal Knowledge Distillation for Multi-modal Learning with Missing Modality
by: Wang, Hu, et al.
Published: (2023)

iCD: A Implicit Clustering Distillation Mathod for Structural Information Mining
by: Xue, Xiang, et al.
Published: (2025)

Uncertainty-Aware Multi-Expert Knowledge Distillation for Imbalanced Disease Grading
by: Tong, Shuo, et al.
Published: (2025)

EDocNet: Efficient Datasheet Layout Analysis Based on Focus and Global Knowledge Distillation
by: Chen, Hong Cai, et al.
Published: (2025)

Improving Neural ODEs via Knowledge Distillation
by: Chu, Haoyu, et al.
Published: (2022)

Forward-Backward Knowledge Distillation for Continual Clustering
by: Sadeghi, Mohammadreza, et al.
Published: (2024)

Adaptive Teaching with Shared Classifier for Knowledge Distillation
by: Jang, Jaeyeon, et al.
Published: (2024)

Data-Augmented Quantization-Aware Knowledge Distillation
by: Kur, Justin, et al.
Published: (2025)

Knowledge Distillation Based on Transformed Teacher Matching
by: Zheng, Kaixiang, et al.
Published: (2024)

Pixel Distillation: A New Knowledge Distillation Scheme for Low-Resolution Image Recognition
by: Guo, Guangyu, et al.
Published: (2021)