:: Library Catalog

Cover Image

Saved in:

Bibliographic Details
Main Authors:	Matsuyama, Kazuhiro, Anjum, Usman, Matsuyama, Satoko, Shoda, Tetsuo, Zhan, Justin
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Computer Vision and Pattern Recognition
Online Access:	https://arxiv.org/abs/2503.09030
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Dual-Head Knowledge Distillation: Enhancing Logits Utilization with an Auxiliary Head
by: Yang, Penghui, et al.
Published: (2024)

LaVCa: LLM-assisted Visual Cortex Captioning
by: Matsuyama, Takuya, et al.
Published: (2025)

Decoupling Dark Knowledge via Block-wise Logit Distillation for Feature-level Alignment
by: Yu, Chengting, et al.
Published: (2024)

Aligning Logits Generatively for Principled Black-Box Knowledge Distillation
by: Ma, Jing, et al.
Published: (2022)

Logit-Based Losses Limit the Effectiveness of Feature Knowledge Distillation
by: Cooper, Nicholas, et al.
Published: (2025)

Data-Augmented Quantization-Aware Knowledge Distillation
by: Kur, Justin, et al.
Published: (2025)

A Unified Revisit of Temperature in Classification-Based Knowledge Distillation
by: Frank, Logan, et al.
Published: (2026)

Adaptive Teaching with Shared Classifier for Knowledge Distillation
by: Jang, Jaeyeon, et al.
Published: (2024)

FedHPL: Efficient Heterogeneous Federated Learning with Prompt Tuning and Logit Distillation
by: Ma, Yuting, et al.
Published: (2024)

Dynamic Temperature Knowledge Distillation
by: Wei, Yukang, et al.
Published: (2024)

Knowledge Distillation Based on Transformed Teacher Matching
by: Zheng, Kaixiang, et al.
Published: (2024)

Brain Tumor Detection in MRI Based on Federated Learning with YOLOv11
by: Monisha, Sheikh Moonwara Anjum, et al.
Published: (2025)

Knowledge Distillation with Refined Logits
by: Sun, Wujie, et al.
Published: (2024)

Logit Standardization in Knowledge Distillation
by: Sun, Shangquan, et al.
Published: (2024)

Efficient Domain Adaptation for Text Line Recognition via Decoupled Language Models
by: Dev, Arundhathi, et al.
Published: (2026)

Distilling the Knowledge in Data Pruning
by: Ben-Baruch, Emanuel, et al.
Published: (2024)

Continual Distillation Learning: Knowledge Distillation in Prompt-based Continual Learning
by: Zhang, Qifan, et al.
Published: (2024)

RLGS: Reinforcement Learning-Based Adaptive Hyperparameter Tuning for Gaussian Splatting
by: Li, Zhan, et al.
Published: (2025)

Align and Distill: Unifying and Improving Domain Adaptive Object Detection
by: Kay, Justin, et al.
Published: (2024)

EDocNet: Efficient Datasheet Layout Analysis Based on Focus and Global Knowledge Distillation
by: Chen, Hong Cai, et al.
Published: (2025)

AuG-KD: Anchor-Based Mixup Generation for Out-of-Domain Knowledge Distillation
by: Tang, Zihao, et al.
Published: (2024)

Improving Neural ODEs via Knowledge Distillation
by: Chu, Haoyu, et al.
Published: (2022)

Densely Distilling Cumulative Knowledge for Continual Learning
by: Shi, Zenglin, et al.
Published: (2024)

Forward-Backward Knowledge Distillation for Continual Clustering
by: Sadeghi, Mohammadreza, et al.
Published: (2024)

Logit Disagreement: OoD Detection with Bayesian Neural Networks
by: Raina, Kevin
Published: (2025)

ELODI: Ensemble Logit Difference Inhibition for Positive-Congruent Training
by: Zhao, Yue, et al.
Published: (2022)

Pixel Distillation: A New Knowledge Distillation Scheme for Low-Resolution Image Recognition
by: Guo, Guangyu, et al.
Published: (2021)

Adaptive Knowledge Distillation for Classification of Hand Images using Explainable Vision Transformers
by: Nguyen, Thanh Thi, et al.
Published: (2024)

Enhancing Weakly-Supervised Histopathology Image Segmentation with Knowledge Distillation on MIL-Based Pseudo-Labels
by: He, Yinsheng, et al.
Published: (2024)

Enriching Knowledge Distillation with Intra-Class Contrastive Learning
by: Yuan, Hua, et al.
Published: (2025)

Distilling Knowledge from Heterogeneous Architectures for Semantic Segmentation
by: Huang, Yanglin, et al.
Published: (2025)

Preview-based Category Contrastive Learning for Knowledge Distillation
by: Ding, Muhe, et al.
Published: (2024)

MST-Distill: Mixture of Specialized Teachers for Cross-Modal Knowledge Distillation
by: Li, Hui, et al.
Published: (2025)

Optimizing Few-Step Generation with Adaptive Matching Distillation
by: Bai, Lichen, et al.
Published: (2026)

External Knowledge Injection for CLIP-Based Class-Incremental Learning
by: Zhou, Da-Wei, et al.
Published: (2025)

Logit Scaling for Out-of-Distribution Detection
by: Djurisic, Andrija, et al.
Published: (2024)

EOL: Transductive Few-Shot Open-Set Recognition by Enhancing Outlier Logits
by: Ochal, Mateusz, et al.
Published: (2024)

Rethinking Decoupled Knowledge Distillation: A Predictive Distribution Perspective
by: Zheng, Bowen, et al.
Published: (2025)

Topology-Guided Knowledge Distillation for Efficient Point Cloud Processing
by: Hai, Luu Tung, et al.
Published: (2025)

Conditional Pseudo-Supervised Contrast for Data-Free Knowledge Distillation
by: Shao, Renrong, et al.
Published: (2025)