Cover Image

ReffAKD: Resource-efficient Autoencoder-based Knowledge Distillation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Doshi, Divyang, Kim, Jung-Eun
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Continual Distillation Learning: Knowledge Distillation in Prompt-based Continual Learning
by: Zhang, Qifan, et al.
Published: (2024)

Adaptive Teaching with Shared Classifier for Knowledge Distillation
by: Jang, Jaeyeon, et al.
Published: (2024)

AI-KD: Adversarial learning and Implicit regularization for self-Knowledge Distillation
by: Kim, Hyungmin, et al.
Published: (2022)

Preview-based Category Contrastive Learning for Knowledge Distillation
by: Ding, Muhe, et al.
Published: (2024)

HyperKD: Distilling Cross-Spectral Knowledge in Masked Autoencoders via Inverse Domain Shift with Spatial-Aware Masking and Specialized Loss
by: Matin, Abdul, et al.
Published: (2025)

Diffusion-based Data Augmentation and Knowledge Distillation with Generated Soft Labels Solving Data Scarcity Problems of SAR Oil Spill Segmentation
by: Moon, Jaeho, et al.
Published: (2024)

Distilling the Knowledge in Data Pruning
by: Ben-Baruch, Emanuel, et al.
Published: (2024)

RESQUE: Quantifying Estimator to Task and Distribution Shift for Sustainable Model Reusability
by: Sangarya, Vishwesh, et al.
Published: (2024)

Improving Diagnostic Accuracy for Oral Cancer with inpainting Synthesis Lesions Generated Using Diffusion Models
by: Lee, Yong Oh, et al.
Published: (2025)

The Role of Teacher Calibration in Knowledge Distillation
by: Kim, Suyoung, et al.
Published: (2025)

Densely Distilling Cumulative Knowledge for Continual Learning
by: Shi, Zenglin, et al.
Published: (2024)

Forward-Backward Knowledge Distillation for Continual Clustering
by: Sadeghi, Mohammadreza, et al.
Published: (2024)

Knowledge Distillation Based on Transformed Teacher Matching
by: Zheng, Kaixiang, et al.
Published: (2024)

Improving Neural ODEs via Knowledge Distillation
by: Chu, Haoyu, et al.
Published: (2022)

Data-Augmented Quantization-Aware Knowledge Distillation
by: Kur, Justin, et al.
Published: (2025)

Pixel Distillation: A New Knowledge Distillation Scheme for Low-Resolution Image Recognition
by: Guo, Guangyu, et al.
Published: (2021)

Impact of Layer Norm on Memorization and Generalization in Transformers
by: Singhal, Rishi, et al.
Published: (2025)

ContrastCAD: Contrastive Learning-based Representation Learning for Computer-Aided Design Models
by: Jung, Minseop, et al.
Published: (2024)

Enriching Knowledge Distillation with Intra-Class Contrastive Learning
by: Yuan, Hua, et al.
Published: (2025)

Distilling Knowledge from Heterogeneous Architectures for Semantic Segmentation
by: Huang, Yanglin, et al.
Published: (2025)

Adaptive Temperature Based on Logits Correlation in Knowledge Distillation
by: Matsuyama, Kazuhiro, et al.
Published: (2025)

Quantum-Gated Task-interaction Knowledge Distillation for Pre-trained Model-based Class-Incremental Learning
by: Li, Linjie, et al.
Published: (2026)

Robust Continual Unlearning against Knowledge Erosion and Forgetting Reversal
by: Park, Eun-Ju, et al.
Published: (2026)

ViTCAE: ViT-based Class-conditioned Autoencoder
by: Jebraeeli, Vahid, et al.
Published: (2025)

On Distilling the Displacement Knowledge for Few-Shot Class-Incremental Learning
by: Fang, Pengfei, et al.
Published: (2024)

Rethinking Decoupled Knowledge Distillation: A Predictive Distribution Perspective
by: Zheng, Bowen, et al.
Published: (2025)

Topology-Guided Knowledge Distillation for Efficient Point Cloud Processing
by: Hai, Luu Tung, et al.
Published: (2025)

The Role of Masking for Efficient Supervised Knowledge Distillation of Vision Transformers
by: Son, Seungwoo, et al.
Published: (2023)

Conditional Pseudo-Supervised Contrast for Data-Free Knowledge Distillation
by: Shao, Renrong, et al.
Published: (2025)

A Unified Revisit of Temperature in Classification-Based Knowledge Distillation
by: Frank, Logan, et al.
Published: (2026)

Highlight Every Step: Knowledge Distillation via Collaborative Teaching
by: Zhao, Haoran, et al.
Published: (2019)

Improving Diversity in Black-box Few-shot Knowledge Distillation
by: Vo, Tri-Nhan, et al.
Published: (2026)

Domain Generalization for Crop Segmentation with Standardized Ensemble Knowledge Distillation
by: Angarano, Simone, et al.
Published: (2023)

MST-Distill: Mixture of Specialized Teachers for Cross-Modal Knowledge Distillation
by: Li, Hui, et al.
Published: (2025)

Advancing Compressed Video Action Recognition through Progressive Knowledge Distillation
by: Soufleri, Efstathia, et al.
Published: (2024)

Improving Knowledge Distillation in Transfer Learning with Layer-wise Learning Rates
by: Kokane, Shirley, et al.
Published: (2024)

Dual-Head Knowledge Distillation: Enhancing Logits Utilization with an Auxiliary Head
by: Yang, Penghui, et al.
Published: (2024)

Optimizing YOLOv5s Object Detection through Knowledge Distillation algorithm
by: Huang, Guanming, et al.
Published: (2024)

Uncertainty-Aware Multi-Expert Knowledge Distillation for Imbalanced Disease Grading
by: Tong, Shuo, et al.
Published: (2025)

Diverse Image Priors for Black-box Data-free Knowledge Distillation
by: Vo, Tri-Nhan, et al.
Published: (2026)