Cover Image

Local Dense Logit Relations for Enhanced Knowledge Distillation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Xu, Liuchi, Liu, Kang, Liu, Jinshuai, Wang, Lu, Xu, Lisheng, Cheng, Jun
Format:	Preprint
Published:	2025
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Heterogeneous Complementary Distillation
by: Xu, Liuchi, et al.
Published: (2025)

Enhancing Logits Distillation with Plug\&Play Kendall's $τ$ Ranking Loss
by: Guan, Yuchen, et al.
Published: (2024)

Logit Standardization in Knowledge Distillation
by: Sun, Shangquan, et al.
Published: (2024)

Knowledge Distillation with Refined Logits
by: Sun, Wujie, et al.
Published: (2024)

Dual-Head Knowledge Distillation: Enhancing Logits Utilization with an Auxiliary Head
by: Yang, Penghui, et al.
Published: (2024)

Generative Denoise Distillation: Simple Stochastic Noises Induce Efficient Knowledge Transfer for Dense Prediction
by: Liu, Zhaoge, et al.
Published: (2024)

Densely Distilling Cumulative Knowledge for Continual Learning
by: Shi, Zenglin, et al.
Published: (2024)

Multi-perspective Contrastive Logit Distillation
by: Wang, Qi, et al.
Published: (2024)

FedHPL: Efficient Heterogeneous Federated Learning with Prompt Tuning and Logit Distillation
by: Ma, Yuting, et al.
Published: (2024)

Adaptive Temperature Based on Logits Correlation in Knowledge Distillation
by: Matsuyama, Kazuhiro, et al.
Published: (2025)

LumiNet: Perception-Driven Knowledge Distillation via Statistical Logit Calibration
by: Hossain, Md. Ismail, et al.
Published: (2023)

Decoupling Dark Knowledge via Block-wise Logit Distillation for Feature-level Alignment
by: Yu, Chengting, et al.
Published: (2024)

Logits DeConfusion with CLIP for Few-Shot Learning
by: Li, Shuo, et al.
Published: (2025)

Aligning Logits Generatively for Principled Black-Box Knowledge Distillation
by: Ma, Jing, et al.
Published: (2022)

Can Students Beyond The Teacher? Distilling Knowledge from Teacher's Bias
by: Zhang, Jianhua, et al.
Published: (2024)

Enhancing Out-of-Distribution Detection with Extended Logit Normalization
by: Ding, Yifan, et al.
Published: (2025)

CLIPSelf: Vision Transformer Distills Itself for Open-Vocabulary Dense Prediction
by: Wu, Size, et al.
Published: (2023)

Multi-modal Knowledge Decomposition based Online Distillation for Biomarker Prediction in Breast Cancer Histopathology
by: Zhang, Qibin, et al.
Published: (2025)

SAMKD: Spatial-aware Adaptive Masking Knowledge Distillation for Object Detection
by: Zhang, Zhourui, et al.
Published: (2025)

CLIP-RD: Relative Distillation for Efficient CLIP Knowledge Distillation
by: Chung, Jeannie, et al.
Published: (2026)

Bidirectional Logits Tree: Pursuing Granularity Reconcilement in Fine-Grained Classification
by: Lu, Zhiguang, et al.
Published: (2024)

PRG: Prompt-Based Distillation Without Annotation via Proxy Relational Graph
by: Xu, Yijin, et al.
Published: (2024)

Generating Transferrable Adversarial Examples via Local Mixing and Logits Optimization for Remote Sensing Object Recognition
by: Liu, Chun, et al.
Published: (2025)

Exploring Graph-based Knowledge: Multi-Level Feature Distillation via Channels Relational Graph
by: Wang, Zhiwei, et al.
Published: (2024)

Balance Divergence for Knowledge Distillation
by: Qi, Yafei, et al.
Published: (2025)

LEAD: Exploring Logit Space Evolution for Model Selection
by: Hu, Zixuan, et al.
Published: (2025)

Towards Customized Knowledge Distillation for Chip-Level Dense Image Predictions
by: Zhang, Dong, et al.
Published: (2024)

MUSE: Multi-Scale Dense Self-Distillation for Nucleus Detection and Classification
by: Yang, Zijiang, et al.
Published: (2025)

Stable Score Distillation
by: Zhu, Haiming, et al.
Published: (2025)

DFMSD: Dual Feature Masking Stage-wise Knowledge Distillation for Object Detection
by: Zhang, Zhourui, et al.
Published: (2024)

VRM: Knowledge Distillation via Virtual Relation Matching
by: Zhang, Weijia, et al.
Published: (2025)

Relational Diffusion Distillation for Efficient Image Generation
by: Feng, Weilun, et al.
Published: (2024)

ATAS: Any-to-Any Self-Distillation for Enhanced Open-Vocabulary Dense Prediction
by: Yeo, Juan, et al.
Published: (2025)

Distilling the Past: Information-Dense and Style-Aware Replay for Lifelong Person Re-Identification
by: Wang, Mingyu, et al.
Published: (2025)

SRKD: Towards Efficient 3D Point Cloud Segmentation via Structure- and Relation-aware Knowledge Distillation
by: Li, Yuqi, et al.
Published: (2025)

Knowledge Distillation via Query Selection for Detection Transformer
by: Liu, Yi, et al.
Published: (2024)

Delving Deep into Semantic Relation Distillation
by: Yan, Zhaoyi, et al.
Published: (2025)

FreeKD: Knowledge Distillation via Semantic Frequency Prompt
by: Zhang, Yuan, et al.
Published: (2023)

Expandable Residual Approximation for Knowledge Distillation
by: Yan, Zhaoyi, et al.
Published: (2025)

Distilling Cross-Modal Knowledge via Feature Disentanglement
by: Liu, Junhong, et al.
Published: (2025)