Image de couverture de livre

A Note on Knowledge Distillation Loss Function for Object Classification

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteur principal:	Chen, Defang
Format:	Preprint
Publié:	2021
Sujets:	Machine Learning Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Online Adversarial Knowledge Distillation for Graph Neural Networks
par: Wang, Can, et autres
Publié: (2021)

Confidence-aware Self-Semantic Distillation on Knowledge Graph Embedding
par: Liu, Yichen, et autres
Publié: (2022)

A Note on Loss Functions and Error Compounding in Model-based Reinforcement Learning
par: Jiang, Nan
Publié: (2024)

A Functional Perspective on Knowledge Distillation in Neural Networks
par: Mason-Williams, Israel, et autres
Publié: (2025)

AdaKD: Dynamic Knowledge Distillation of ASR models using Adaptive Loss Weighting
par: Ganguly, Shreyan, et autres
Publié: (2024)

Knowledge Translation: A New Pathway for Model Compression
par: Sun, Wujie, et autres
Publié: (2024)

Meta-Learning Adaptive Loss Functions
par: Raymond, Christian, et autres
Publié: (2023)

Consistently Informative Soft-Label Temperature for Knowledge Distillation
par: Luong, Hoang-Chau, et autres
Publié: (2026)

S^2-KD: Semantic-Spectral Knowledge Distillation Spatiotemporal Forecasting
par: Wang, Wenshuo, et autres
Publié: (2025)

Graph Knowledge Distillation to Mixture of Experts
par: Rumiantsev, Pavel, et autres
Publié: (2024)

Dynamic Temperature Scheduler for Knowledge Distillation
par: Islam, Sibgat Ul, et autres
Publié: (2025)

Membership and Memorization in LLM Knowledge Distillation
par: Zhang, Ziqi, et autres
Publié: (2025)

Cooperative Knowledge Distillation: A Learner Agnostic Approach
par: Livanos, Michael, et autres
Publié: (2024)

How to Backdoor the Knowledge Distillation
par: Wu, Chen, et autres
Publié: (2025)

Improve Knowledge Distillation via Label Revision and Data Selection
par: Lan, Weichao, et autres
Publié: (2024)

Low-Dimensional Federated Knowledge Graph Embedding via Knowledge Distillation
par: Zhang, Xiaoxiong, et autres
Publié: (2024)

Knowledge Distillation Must Account for What It Loses
par: Wang, Wenshuo
Publié: (2026)

Reinforcement-aware Knowledge Distillation for LLM Reasoning
par: Zhang, Zhaoyang, et autres
Publié: (2026)

Collaborative Adaptive Curriculum for Progressive Knowledge Distillation
par: Liu, Jing, et autres
Publié: (2026)

Visualizing Loss Functions as Topological Landscape Profiles
par: Geniesse, Caleb, et autres
Publié: (2024)

Group Relative Knowledge Distillation: Learning from Teacher's Relational Inductive Bias
par: Li, Chao, et autres
Publié: (2025)

Logit-Based Losses Limit the Effectiveness of Feature Knowledge Distillation
par: Cooper, Nicholas, et autres
Publié: (2025)

Mirage: Model-Agnostic Graph Distillation for Graph Classification
par: Gupta, Mridul, et autres
Publié: (2023)

FedSKD: Aggregation-free Model-heterogeneous Federated Learning via Multi-dimensional Similarity Knowledge Distillation for Medical Image Classification
par: Weng, Ziqiao, et autres
Publié: (2025)

Large Language Model Guided Knowledge Distillation for Time Series Anomaly Detection
par: Liu, Chen, et autres
Publié: (2024)

Teach Harder, Learn Poorer: Rethinking Hard Sample Distillation for GNN-to-MLP Knowledge Distillation
par: Wu, Lirong, et autres
Publié: (2024)

Balancing Knowledge Distillation for Imbalance Learning with Bilevel Optimization
par: Nguyen, Anh B. H., et autres
Publié: (2026)

Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Models
par: Bick, Aviv, et autres
Publié: (2024)

Revisiting Knowledge Distillation: The Hidden Role of Dataset Size
par: Lanzillotta, Giulia, et autres
Publié: (2025)

Model Merging via Multi-Teacher Knowledge Distillation
par: Dalili, Seyed Arshan, et autres
Publié: (2025)

Practical Insights into Knowledge Distillation for Pre-Trained Models
par: Alballa, Norah, et autres
Publié: (2024)

Rethinking Momentum Knowledge Distillation in Online Continual Learning
par: Michel, Nicolas, et autres
Publié: (2023)

Robust Knowledge Distillation Based on Feature Variance Against Backdoored Teacher Model
par: Chen, Jinyin, et autres
Publié: (2024)

Integrating Knowledge Distillation Methods: A Sequential Multi-Stage Framework
par: Tian, Yinxi, et autres
Publié: (2026)

Time-Aware Knowledge Representations of Dynamic Objects with Multidimensional Persistence
par: Coskunuzer, Baris, et autres
Publié: (2024)

DistilCLIP-EEG: Enhancing Epileptic Seizure Detection Through Multi-modal Learning and Knowledge Distillation
par: Wang, Zexin, et autres
Publié: (2025)

HSI Image Enhancement Classification Based on Knowledge Distillation: A Study on Forgetting
par: Zhu, Songfeng
Publié: (2026)

A Principled Loss Function for Direct Language Model Alignment
par: Tan, Yuandong
Publié: (2025)

Enhancing Transformer with GNN Structural Knowledge via Distillation: A Novel Approach
par: Duan, Zhihua, et autres
Publié: (2025)

Condensed Data Expansion Using Model Inversion for Knowledge Distillation
par: Binici, Kuluhan, et autres
Publié: (2024)