Imagen de Portada

Knowledge Distillation with Refined Logits

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Sun, Wujie, Chen, Defang, Lyu, Siwei, Chen, Genlang, Chen, Chun, Wang, Can
Formato:	Preprint
Publicado:	2024
Materias:	Computer Vision and Pattern Recognition
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Simple and Fast Distillation of Diffusion Models
por: Zhou, Zhenyu, et al.
Publicado: (2024)

DICE: Distilling Classifier-Free Guidance into Text Embeddings
por: Zhou, Zhenyu, et al.
Publicado: (2025)

Analyzing and Improving Fast Sampling of Text-to-Image Diffusion Models
por: Zhou, Zhenyu, et al.
Publicado: (2026)

Knowledge Translation: A New Pathway for Model Compression
por: Sun, Wujie, et al.
Publicado: (2024)

Fully AI-Generated Image Detection: Definition, Recent Advances and Challenges
por: Xu, Qijie, et al.
Publicado: (2025)

Geometric Regularity in Deterministic Sampling Dynamics of Diffusion-based Generative Models
por: Chen, Defang, et al.
Publicado: (2025)

On the Trajectory Regularity of ODE-based Diffusion Sampling
por: Chen, Defang, et al.
Publicado: (2024)

Logit Standardization in Knowledge Distillation
por: Sun, Shangquan, et al.
Publicado: (2024)

Conditional Image Synthesis with Diffusion Models: A Survey
por: Zhan, Zheyuan, et al.
Publicado: (2024)

Fast ODE-based Sampling for Diffusion Models in Around 5 Steps
por: Zhou, Zhenyu, et al.
Publicado: (2023)

Dual-Head Knowledge Distillation: Enhancing Logits Utilization with an Auxiliary Head
por: Yang, Penghui, et al.
Publicado: (2024)

Local Dense Logit Relations for Enhanced Knowledge Distillation
por: Xu, Liuchi, et al.
Publicado: (2025)

Multi-perspective Contrastive Logit Distillation
por: Wang, Qi, et al.
Publicado: (2024)

Decoupling Dark Knowledge via Block-wise Logit Distillation for Feature-level Alignment
por: Yu, Chengting, et al.
Publicado: (2024)

A Geometric Perspective on Diffusion Models
por: Chen, Defang, et al.
Publicado: (2023)

Enhancing Logits Distillation with Plug\&Play Kendall's $τ$ Ranking Loss
por: Guan, Yuchen, et al.
Publicado: (2024)

Uncertainty-Aware Knowledge Distillation for Multimodal Large Language Models
por: Sun, Jingchen, et al.
Publicado: (2026)

Adaptive Temperature Based on Logits Correlation in Knowledge Distillation
por: Matsuyama, Kazuhiro, et al.
Publicado: (2025)

LumiNet: Perception-Driven Knowledge Distillation via Statistical Logit Calibration
por: Hossain, Md. Ismail, et al.
Publicado: (2023)

RefineStyle: Dynamic Convolution Refinement for StyleGAN
por: Xia, Siwei, et al.
Publicado: (2024)

Student-Oriented Teacher Knowledge Refinement for Knowledge Distillation
por: Shen, Chaomin, et al.
Publicado: (2024)

Logit-Based Losses Limit the Effectiveness of Feature Knowledge Distillation
por: Cooper, Nicholas, et al.
Publicado: (2025)

Infrared UAV Target Tracking with Dynamic Feature Refinement and Global Contextual Attention Knowledge Distillation
por: Fang, Houzhang, et al.
Publicado: (2025)

Hybrid Data-Free Knowledge Distillation
por: Tang, Jialiang, et al.
Publicado: (2024)

OST: Refining Text Knowledge with Optimal Spatio-Temporal Descriptor for General Video Recognition
por: Chen, Tongjia, et al.
Publicado: (2023)

Aligning Logits Generatively for Principled Black-Box Knowledge Distillation
por: Ma, Jing, et al.
Publicado: (2022)

Self-Cooperation Knowledge Distillation for Novel Class Discovery
por: Wang, Yuzheng, et al.
Publicado: (2024)

SKDF: A Simple Knowledge Distillation Framework for Distilling Open-Vocabulary Knowledge to Open-world Object Detector
por: Ma, Shuailei, et al.
Publicado: (2023)

Balance Divergence for Knowledge Distillation
por: Qi, Yafei, et al.
Publicado: (2025)

Seeing Further on the Shoulders of Giants: Knowledge Inheritance for Vision Foundation Models
por: Huang, Jiabo, et al.
Publicado: (2025)

Expandable Residual Approximation for Knowledge Distillation
por: Yan, Zhaoyi, et al.
Publicado: (2025)

Channel Attention-Guided Cross-Modal Knowledge Distillation for Referring Image Segmentation
por: Yang, Chen
Publicado: (2026)

Switch-KD: Visual-Switch Knowledge Distillation for Vision-Language Models
por: Sun, Haoyi, et al.
Publicado: (2026)

Defense against Unauthorized Distillation in Image Restoration via Feature Space Perturbation
por: Hu, Han, et al.
Publicado: (2025)

UNIKD: UNcertainty-filtered Incremental Knowledge Distillation for Neural Implicit Representation
por: Guo, Mengqi, et al.
Publicado: (2022)

Rendering-Refined Stable Diffusion for Privacy Compliant Synthetic Data
por: Patwari, Kartik, et al.
Publicado: (2024)

ComKD-CLIP: Comprehensive Knowledge Distillation for Contrastive Language-Image Pre-traning Model
por: Chen, Yifan, et al.
Publicado: (2024)

Gradient-Aware Logit Adjustment Loss for Long-tailed Classifier
por: Zhang, Fan, et al.
Publicado: (2024)

Logits DeConfusion with CLIP for Few-Shot Learning
por: Li, Shuo, et al.
Publicado: (2025)

Improving Facial Landmark Detection Accuracy and Efficiency with Knowledge Distillation
por: Hong, Zong-Wei, et al.
Publicado: (2024)