Saved in:
| Main Authors: | Frank, Logan, Davis, Jim |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2603.02430 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
What Makes a Good Dataset for Knowledge Distillation?
by: Frank, Logan, et al.
Published: (2024)
by: Frank, Logan, et al.
Published: (2024)
Adaptive Temperature Based on Logits Correlation in Knowledge Distillation
by: Matsuyama, Kazuhiro, et al.
Published: (2025)
by: Matsuyama, Kazuhiro, et al.
Published: (2025)
Dynamic Temperature Knowledge Distillation
by: Wei, Yukang, et al.
Published: (2024)
by: Wei, Yukang, et al.
Published: (2024)
HSI Image Enhancement Classification Based on Knowledge Distillation: A Study on Forgetting
by: Zhu, Songfeng
Published: (2026)
by: Zhu, Songfeng
Published: (2026)
Uncertainty-Aware Dual-Student Knowledge Distillation for Efficient Image Classification
by: Gore, Aakash, et al.
Published: (2025)
by: Gore, Aakash, et al.
Published: (2025)
Knowledge Distillation Based on Transformed Teacher Matching
by: Zheng, Kaixiang, et al.
Published: (2024)
by: Zheng, Kaixiang, et al.
Published: (2024)
Explainability-Driven Leaf Disease Classification Using Adversarial Training and Knowledge Distillation
by: Echim, Sebastian-Vasile, et al.
Published: (2023)
by: Echim, Sebastian-Vasile, et al.
Published: (2023)
Crossmodal Knowledge Distillation with WordNet-Relaxed Text Embeddings for Robust Image Classification
by: Guo, Chenqi, et al.
Published: (2025)
by: Guo, Chenqi, et al.
Published: (2025)
Unified Knowledge Distillation Framework: Fine-Grained Alignment and Geometric Relationship Preservation for Deep Face Recognition
by: Mishra, Durgesh, et al.
Published: (2025)
by: Mishra, Durgesh, et al.
Published: (2025)
Distilling the Knowledge in Data Pruning
by: Ben-Baruch, Emanuel, et al.
Published: (2024)
by: Ben-Baruch, Emanuel, et al.
Published: (2024)
Pixel Distillation: A New Knowledge Distillation Scheme for Low-Resolution Image Recognition
by: Guo, Guangyu, et al.
Published: (2021)
by: Guo, Guangyu, et al.
Published: (2021)
Semantic Knowledge Distillation for Onboard Satellite Earth Observation Image Classification
by: Le, Thanh-Dung, et al.
Published: (2024)
by: Le, Thanh-Dung, et al.
Published: (2024)
Continual Distillation Learning: Knowledge Distillation in Prompt-based Continual Learning
by: Zhang, Qifan, et al.
Published: (2024)
by: Zhang, Qifan, et al.
Published: (2024)
Deep Learning Improvements for Sparse Spatial Field Reconstruction
by: Sunderhaft, Robert, et al.
Published: (2024)
by: Sunderhaft, Robert, et al.
Published: (2024)
Towards A Generalizable Pathology Foundation Model via Unified Knowledge Distillation
by: Ma, Jiabo, et al.
Published: (2024)
by: Ma, Jiabo, et al.
Published: (2024)
DiffusionOPD: A Unified Perspective of On-Policy Distillation in Diffusion Models
by: Li, Quanhao, et al.
Published: (2026)
by: Li, Quanhao, et al.
Published: (2026)
EDocNet: Efficient Datasheet Layout Analysis Based on Focus and Global Knowledge Distillation
by: Chen, Hong Cai, et al.
Published: (2025)
by: Chen, Hong Cai, et al.
Published: (2025)
AuG-KD: Anchor-Based Mixup Generation for Out-of-Domain Knowledge Distillation
by: Tang, Zihao, et al.
Published: (2024)
by: Tang, Zihao, et al.
Published: (2024)
Dual-Model Weight Selection and Self-Knowledge Distillation for Medical Image Classification
by: Tsutsumi, Ayaka, et al.
Published: (2025)
by: Tsutsumi, Ayaka, et al.
Published: (2025)
Adaptive Knowledge Distillation for Classification of Hand Images using Explainable Vision Transformers
by: Nguyen, Thanh Thi, et al.
Published: (2024)
by: Nguyen, Thanh Thi, et al.
Published: (2024)
KD-OCT: Efficient Knowledge Distillation for Clinical-Grade Retinal OCT Classification
by: Nourbakhsh, Erfan, et al.
Published: (2025)
by: Nourbakhsh, Erfan, et al.
Published: (2025)
Improving Neural ODEs via Knowledge Distillation
by: Chu, Haoyu, et al.
Published: (2022)
by: Chu, Haoyu, et al.
Published: (2022)
Densely Distilling Cumulative Knowledge for Continual Learning
by: Shi, Zenglin, et al.
Published: (2024)
by: Shi, Zenglin, et al.
Published: (2024)
Forward-Backward Knowledge Distillation for Continual Clustering
by: Sadeghi, Mohammadreza, et al.
Published: (2024)
by: Sadeghi, Mohammadreza, et al.
Published: (2024)
Adaptive Teaching with Shared Classifier for Knowledge Distillation
by: Jang, Jaeyeon, et al.
Published: (2024)
by: Jang, Jaeyeon, et al.
Published: (2024)
Data-Augmented Quantization-Aware Knowledge Distillation
by: Kur, Justin, et al.
Published: (2025)
by: Kur, Justin, et al.
Published: (2025)
Rethinking Decoupled Knowledge Distillation: A Predictive Distribution Perspective
by: Zheng, Bowen, et al.
Published: (2025)
by: Zheng, Bowen, et al.
Published: (2025)
Schrodinger AI: A Unified Spectral-Dynamical Framework for Classification, Reasoning, and Operator-Based Generalization
by: Nguyen, Truong Son
Published: (2025)
by: Nguyen, Truong Son
Published: (2025)
Enhancing Weakly-Supervised Histopathology Image Segmentation with Knowledge Distillation on MIL-Based Pseudo-Labels
by: He, Yinsheng, et al.
Published: (2024)
by: He, Yinsheng, et al.
Published: (2024)
Revisiting Semi-supervised Adversarial Robustness via Noise-aware Online Robust Distillation
by: Wu, Tsung-Han, et al.
Published: (2024)
by: Wu, Tsung-Han, et al.
Published: (2024)
Enriching Knowledge Distillation with Intra-Class Contrastive Learning
by: Yuan, Hua, et al.
Published: (2025)
by: Yuan, Hua, et al.
Published: (2025)
Distilling Knowledge from Heterogeneous Architectures for Semantic Segmentation
by: Huang, Yanglin, et al.
Published: (2025)
by: Huang, Yanglin, et al.
Published: (2025)
Preview-based Category Contrastive Learning for Knowledge Distillation
by: Ding, Muhe, et al.
Published: (2024)
by: Ding, Muhe, et al.
Published: (2024)
Semi-Supervised Learning with Online Knowledge Distillation for Skin Lesion Classification
by: Manivannan, Siyamalan
Published: (2025)
by: Manivannan, Siyamalan
Published: (2025)
Revisiting the Evaluation of Deep Neural Networks for Pedestrian Detection
by: Feifel, Patrick, et al.
Published: (2025)
by: Feifel, Patrick, et al.
Published: (2025)
MST-Distill: Mixture of Specialized Teachers for Cross-Modal Knowledge Distillation
by: Li, Hui, et al.
Published: (2025)
by: Li, Hui, et al.
Published: (2025)
Unified Classification and Rejection: A One-versus-All Framework
by: Cheng, Zhen, et al.
Published: (2023)
by: Cheng, Zhen, et al.
Published: (2023)
Optimizing Parking Space Classification: Distilling Ensembles into Lightweight Classifiers
by: Alves, Paulo Luza, et al.
Published: (2024)
by: Alves, Paulo Luza, et al.
Published: (2024)
Improving Diversity in Black-box Few-shot Knowledge Distillation
by: Vo, Tri-Nhan, et al.
Published: (2026)
by: Vo, Tri-Nhan, et al.
Published: (2026)
Topology-Guided Knowledge Distillation for Efficient Point Cloud Processing
by: Hai, Luu Tung, et al.
Published: (2025)
by: Hai, Luu Tung, et al.
Published: (2025)
Similar Items
-
What Makes a Good Dataset for Knowledge Distillation?
by: Frank, Logan, et al.
Published: (2024) -
Adaptive Temperature Based on Logits Correlation in Knowledge Distillation
by: Matsuyama, Kazuhiro, et al.
Published: (2025) -
Dynamic Temperature Knowledge Distillation
by: Wei, Yukang, et al.
Published: (2024) -
HSI Image Enhancement Classification Based on Knowledge Distillation: A Study on Forgetting
by: Zhu, Songfeng
Published: (2026) -
Uncertainty-Aware Dual-Student Knowledge Distillation for Efficient Image Classification
by: Gore, Aakash, et al.
Published: (2025)