Cover Image

Enriching Knowledge Distillation with Intra-Class Contrastive Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Yuan, Hua, Xu, Ning, Geng, Xin, Rui, Yong
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Preview-based Category Contrastive Learning for Knowledge Distillation
by: Ding, Muhe, et al.
Published: (2024)

On Distilling the Displacement Knowledge for Few-Shot Class-Incremental Learning
by: Fang, Pengfei, et al.
Published: (2024)

A Generalization Theory of Cross-Modality Distillation with Contrastive Learning
by: Lin, Hangyu, et al.
Published: (2024)

DivControl: Knowledge Diversion for Controllable Image Generation
by: Xie, Yucheng, et al.
Published: (2025)

Conditional Pseudo-Supervised Contrast for Data-Free Knowledge Distillation
by: Shao, Renrong, et al.
Published: (2025)

SynerMix: Synergistic Mixup Solution for Enhanced Intra-Class Cohesion and Inter-Class Separability in Image Classification
by: Xu, Ye, et al.
Published: (2024)

External Knowledge Injection for CLIP-Based Class-Incremental Learning
by: Zhou, Da-Wei, et al.
Published: (2025)

Quantum-Gated Task-interaction Knowledge Distillation for Pre-trained Model-based Class-Incremental Learning
by: Li, Linjie, et al.
Published: (2026)

Breaking Class Barriers: Efficient Dataset Distillation via Inter-Class Feature Compensator
by: Zhang, Xin, et al.
Published: (2024)

Improving Knowledge Distillation in Transfer Learning with Layer-wise Learning Rates
by: Kokane, Shirley, et al.
Published: (2024)

Continual Distillation Learning: Knowledge Distillation in Prompt-based Continual Learning
by: Zhang, Qifan, et al.
Published: (2024)

I2CANSAY:Inter-Class Analogical Augmentation and Intra-Class Significance Analysis for Non-Exemplar Online Task-Free Continual Learning
by: Dong, Songlin, et al.
Published: (2024)

Learnable Cross-modal Knowledge Distillation for Multi-modal Learning with Missing Modality
by: Wang, Hu, et al.
Published: (2023)

Densely Distilling Cumulative Knowledge for Continual Learning
by: Shi, Zenglin, et al.
Published: (2024)

Componential Prompt-Knowledge Alignment for Domain Incremental Learning
by: Xu, Kunlun, et al.
Published: (2025)

Improving Learning of New Diseases through Knowledge-Enhanced Initialization for Federated Adapter Tuning
by: Peng, Danni, et al.
Published: (2025)

Distilling Knowledge from Heterogeneous Architectures for Semantic Segmentation
by: Huang, Yanglin, et al.
Published: (2025)

A Theoretical Framework for Preventing Class Collapse in Supervised Contrastive Learning
by: Lee, Chungpa, et al.
Published: (2025)

Highlight Every Step: Knowledge Distillation via Collaborative Teaching
by: Zhao, Haoran, et al.
Published: (2019)

C^2Prompt: Class-aware Client Knowledge Interaction for Federated Continual Learning
by: Xu, Kunlun, et al.
Published: (2025)

Brain-Inspired Continual Learning-Robust Feature Distillation and Re-Consolidation for Class Incremental Learning
by: Khan, Hikmat, et al.
Published: (2024)

Distilling the Knowledge in Data Pruning
by: Ben-Baruch, Emanuel, et al.
Published: (2024)

A Tale of Two Classes: Adapting Supervised Contrastive Learning to Binary Imbalanced Datasets
by: Mildenberger, David, et al.
Published: (2025)

Improving the Transferability of Adversarial Examples by Inverse Knowledge Distillation
by: Wu, Wenyuan, et al.
Published: (2025)

Reproducibility review of "Why Not Other Classes": Towards Class-Contrastive Back-Propagation Explanations
by: Eriksson, Arvid, et al.
Published: (2025)

Self-Supervised Weight Templates for Scalable Vision Model Initialization
by: Xie, Yucheng, et al.
Published: (2026)

Future-Proofing Class-Incremental Learning
by: Jodelet, Quentin, et al.
Published: (2024)

When Classes Evolve: A Benchmark and Framework for Stage-Aware Class-Incremental Learning
by: Zhang, Zheng, et al.
Published: (2026)

Uncertainty-Aware Multi-Expert Knowledge Distillation for Imbalanced Disease Grading
by: Tong, Shuo, et al.
Published: (2025)

MoEGCL: Mixture of Ego-Graphs Contrastive Representation Learning for Multi-View Clustering
by: Zhu, Jian, et al.
Published: (2025)

Learning to Compress Contexts for Efficient Knowledge-based Visual Question Answering
by: Weng, Weixi, et al.
Published: (2024)

One-Step Diffusion Distillation via Deep Equilibrium Models
by: Geng, Zhengyang, et al.
Published: (2023)

Data-Augmented Quantization-Aware Knowledge Distillation
by: Kur, Justin, et al.
Published: (2025)

Improving Neural ODEs via Knowledge Distillation
by: Chu, Haoyu, et al.
Published: (2022)

Forward-Backward Knowledge Distillation for Continual Clustering
by: Sadeghi, Mohammadreza, et al.
Published: (2024)

Adaptive Teaching with Shared Classifier for Knowledge Distillation
by: Jang, Jaeyeon, et al.
Published: (2024)

Knowledge Distillation Based on Transformed Teacher Matching
by: Zheng, Kaixiang, et al.
Published: (2024)

Pixel Distillation: A New Knowledge Distillation Scheme for Low-Resolution Image Recognition
by: Guo, Guangyu, et al.
Published: (2021)

Exemplar-free Class Incremental Learning via Discriminative and Comparable One-class Classifiers
by: Sun, Wenju, et al.
Published: (2022)

Consistency Enhancement-Based Deep Multiview Clustering via Contrastive Learning
by: Yang, Hao, et al.
Published: (2024)