Cover Image

Conditional Pseudo-Supervised Contrast for Data-Free Knowledge Distillation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Shao, Renrong, Zhang, Wei, wang, Jun
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Data-free Knowledge Distillation for Fine-grained Visual Categorization
by: Shao, Renrong, et al.
Published: (2024)

Attention Residual Fusion Network with Contrast for Source-free Domain Adaptation
by: Shao, Renrong, et al.
Published: (2025)

Enhancing Weakly-Supervised Histopathology Image Segmentation with Knowledge Distillation on MIL-Based Pseudo-Labels
by: He, Yinsheng, et al.
Published: (2024)

Enriching Knowledge Distillation with Intra-Class Contrastive Learning
by: Yuan, Hua, et al.
Published: (2025)

Preview-based Category Contrastive Learning for Knowledge Distillation
by: Ding, Muhe, et al.
Published: (2024)

Supervised Multi-Modal Fission Learning
by: Mao, Lingchao, et al.
Published: (2024)

Small Scale Data-Free Knowledge Distillation
by: Liu, He, et al.
Published: (2024)

Distilling the Knowledge in Data Pruning
by: Ben-Baruch, Emanuel, et al.
Published: (2024)

The Role of Masking for Efficient Supervised Knowledge Distillation of Vision Transformers
by: Son, Seungwoo, et al.
Published: (2023)

DKDM: Data-Free Knowledge Distillation for Diffusion Models with Any Architecture
by: Xiang, Qianlong, et al.
Published: (2024)

Synergy-Guided Regional Supervision of Pseudo Labels for Semi-Supervised Medical Image Segmentation
by: Wang, Tao, et al.
Published: (2024)

Data-Augmented Quantization-Aware Knowledge Distillation
by: Kur, Justin, et al.
Published: (2025)

Self-Supervised Quantization-Aware Knowledge Distillation
by: Zhao, Kaiqi, et al.
Published: (2024)

FERD: Fairness-Enhanced Data-Free Robustness Distillation
by: Li, Zhengxiao, et al.
Published: (2025)

Variational Supervised Contrastive Learning
by: Wang, Ziwen, et al.
Published: (2025)

Teacher as a Lenient Expert: Teacher-Agnostic Data-Free Knowledge Distillation
by: Shin, Hyunjune, et al.
Published: (2024)

Improving Neural ODEs via Knowledge Distillation
by: Chu, Haoyu, et al.
Published: (2022)

Distilling Diffusion Models into Conditional GANs
by: Kang, Minguk, et al.
Published: (2024)

Continual Distillation Learning: Knowledge Distillation in Prompt-based Continual Learning
by: Zhang, Qifan, et al.
Published: (2024)

PSPU: Enhanced Positive and Unlabeled Learning by Leveraging Pseudo Supervision
by: Wang, Chengjie, et al.
Published: (2024)

Pseudo-label Refinement for Improving Self-Supervised Learning Systems
by: Zia-ur-Rehman, et al.
Published: (2024)

FinePseudo: Improving Pseudo-Labelling through Temporal-Alignablity for Semi-Supervised Fine-Grained Action Recognition
by: Dave, Ishan Rajendrakumar, et al.
Published: (2024)

PRCL: Probabilistic Representation Contrastive Learning for Semi-Supervised Semantic Segmentation
by: Xie, Haoyu, et al.
Published: (2024)

Score Forgetting Distillation: A Swift, Data-Free Method for Machine Unlearning in Diffusion Models
by: Chen, Tianqi, et al.
Published: (2024)

Diverse Image Priors for Black-box Data-free Knowledge Distillation
by: Vo, Tri-Nhan, et al.
Published: (2026)

PLESS: Pseudo-Label Enhancement with Spreading Scribbles for Weakly Supervised Segmentation
by: Gabrielyan, Yeva, et al.
Published: (2026)

D4C: Data-Free Quantization for Contrastive Language-Image Pre-training Models
by: Zhang, Wenlun, et al.
Published: (2025)

Dual-Head Knowledge Distillation: Enhancing Logits Utilization with an Auxiliary Head
by: Yang, Penghui, et al.
Published: (2024)

Toward Guidance-Free AR Visual Generation via Condition Contrastive Alignment
by: Chen, Huayu, et al.
Published: (2024)

SimO Loss: Anchor-Free Contrastive Loss for Fine-Grained Supervised Contrastive Learning
by: Bouhsine, Taha, et al.
Published: (2024)

Pixel Distillation: A New Knowledge Distillation Scheme for Low-Resolution Image Recognition
by: Guo, Guangyu, et al.
Published: (2021)

Dynamic Temperature Knowledge Distillation
by: Wei, Yukang, et al.
Published: (2024)

Distilling Knowledge from Heterogeneous Architectures for Semantic Segmentation
by: Huang, Yanglin, et al.
Published: (2025)

Learning to Discover Knowledge: A Weakly-Supervised Partial Domain Adaptation Approach
by: Lan, Mengcheng, et al.
Published: (2024)

Mind the Gap: Confidence Discrepancy Can Guide Federated Semi-Supervised Learning Across Pseudo-Mismatch
by: Liu, Yijie, et al.
Published: (2025)

A Generalization Theory of Cross-Modality Distillation with Contrastive Learning
by: Lin, Hangyu, et al.
Published: (2024)

Supervised Contrastive Frame Aggregation for Video Representation Learning
by: Chowdhury, Shaif, et al.
Published: (2025)

SINCERE: Supervised Information Noise-Contrastive Estimation REvisited
by: Feeney, Patrick, et al.
Published: (2023)

Dynamically Scaled Temperature in Self-Supervised Contrastive Learning
by: Manna, Siladittya, et al.
Published: (2023)

Analysis of Pseudo-Labeling for Online Source-Free Universal Domain Adaptation
by: Schlachter, Pascal, et al.
Published: (2025)