Cover Image

Improve Knowledge Distillation via Label Revision and Data Selection

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Lan, Weichao, Cheung, Yiu-ming, Xu, Qing, Liu, Buhua, Hu, Zhikai, Li, Mengke, Chen, Zhenghua
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Adjusting Logit in Gaussian Form for Long-Tailed Visual Recognition
by: Li, Mengke, et al.
Published: (2023)

Categorical Data Clustering via Value Order Estimated Distance Metric Learning
by: Zhang, Yiqun, et al.
Published: (2024)

Learning Order Forest for Qualitative-Attribute Data Clustering
by: Zhao, Mingjie, et al.
Published: (2026)

Break the Tie: Learning Cluster-Customized Category Relationships for Categorical Data Clustering
by: Zhao, Mingjie, et al.
Published: (2025)

Bridging the Semantic Gap for Categorical Data Clustering via Large Language Models
by: Yang, Zihua, et al.
Published: (2026)

Learning Unified Distance Metric for Heterogeneous Attribute Data Clustering
by: Zhang, Yiqun, et al.
Published: (2026)

Long-Tailed Visual Recognition via Permutation-Invariant Head-to-Tail Feature Fusion
by: Li, Mengke, et al.
Published: (2025)

CCE: Confidence-Consistency Evaluation for Time Series Anomaly Detection
by: Zhong, Zhijie, et al.
Published: (2025)

Feature Fusion from Head to Tail for Long-Tailed Visual Recognition
by: Li, Mengke, et al.
Published: (2023)

Classifying Long-tailed and Label-noise Data via Disentangling and Unlearning
by: Shu, Chen, et al.
Published: (2025)

Beyond Statistical Co-occurrence: Unlocking Intrinsic Semantics for Tabular Data Clustering
by: Zhao, Mingjie, et al.
Published: (2026)

Enhancing Graph Neural Networks with Limited Labeled Data by Actively Distilling Knowledge from Large Language Models
by: Li, Quan, et al.
Published: (2024)

Consistently Informative Soft-Label Temperature for Knowledge Distillation
by: Luong, Hoang-Chau, et al.
Published: (2026)

Multi-Label Knowledge Distillation
by: Yang, Penghui, et al.
Published: (2023)

DistillSpec: Improving Speculative Decoding via Knowledge Distillation
by: Zhou, Yongchao, et al.
Published: (2023)

Explain in Your Own Words: Improving Reasoning via Token-Selective Dual Knowledge Distillation
by: Kim, Minsang, et al.
Published: (2026)

Improving the Transferability of Adversarial Examples by Inverse Knowledge Distillation
by: Wu, Wenyuan, et al.
Published: (2025)

Enhancing the Performance of Neural Networks Through Causal Discovery and Integration of Domain Knowledge
by: Zhang, Xiaoge, et al.
Published: (2023)

Personalized Treatment Outcome Prediction from Scarce Data via Dual-Channel Knowledge Distillation and Adaptive Fusion
by: Chen, Wenjie, et al.
Published: (2025)

Improving Group Fairness in Knowledge Distillation via Laplace Approximation of Early Exits
by: Fasth, Edvin, et al.
Published: (2025)

AdaSPEC: Selective Knowledge Distillation for Efficient Speculative Decoders
by: Hu, Yuezhou, et al.
Published: (2025)

PEAM: Parametric Embodied Agent Memory through Contrastive Internalization of Experience in Minecraft
by: Guo, Yuchen, et al.
Published: (2026)

Post-Pruning Accuracy Recovery via Data-Free Knowledge Distillation
by: Tripurwar, Chinmay, et al.
Published: (2025)

Ask, Attend, Attack: A Effective Decision-Based Black-Box Targeted Attack for Image-to-Text Models
by: Zeng, Qingyuan, et al.
Published: (2024)

CADM: Cluster-customized Adaptive Distance Metric for Categorical Data Clustering
by: Chen, Taixi, et al.
Published: (2025)

Rethinking Inverse Reinforcement Learning: from Data Alignment to Task Alignment
by: Zhou, Weichao, et al.
Published: (2024)

Can Segmentation Models Understand the World? Towards Proactive Affordance Reasoning via Visual Chain-of-Thought
by: Guo, Yuchen, et al.
Published: (2026)

HyReaL: Clustering Attributed Graph via Hyper-Complex Space Representation Learning
by: Chen, Junyang, et al.
Published: (2024)

Collaborative Adaptive Curriculum for Progressive Knowledge Distillation
by: Liu, Jing, et al.
Published: (2026)

Implementing Trust in Non-Small Cell Lung Cancer Diagnosis with a Conformalized Uncertainty-Aware AI Framework in Whole-Slide Images
by: Zhang, Xiaoge, et al.
Published: (2024)

TRACE: Distilling Where It Matters via Token-Routed Self On-Policy Alignment
by: Wang, Jiaxuan, et al.
Published: (2026)

A Cross Modal Knowledge Distillation & Data Augmentation Recipe for Improving Transcriptomics Representations through Morphological Features
by: Bendidi, Ihab, et al.
Published: (2025)

COLLEAGUE.SKILL: Automated AI Skill Generation via Expert Knowledge Distillation
by: Zhou, Tianyi, et al.
Published: (2026)

HFedCKD: Toward Robust Heterogeneous Federated Learning via Data-free Knowledge Distillation and Two-way Contrast
by: Zheng, Yiting, et al.
Published: (2025)

Low-Dimensional Federated Knowledge Graph Embedding via Knowledge Distillation
by: Zhang, Xiaoxiong, et al.
Published: (2024)

Preserving Node Distinctness in Graph Autoencoders via Similarity Distillation
by: Chen, Ge, et al.
Published: (2024)

Model Merging via Multi-Teacher Knowledge Distillation
by: Dalili, Seyed Arshan, et al.
Published: (2025)

Condensed Data Expansion Using Model Inversion for Knowledge Distillation
by: Binici, Kuluhan, et al.
Published: (2024)

Learning Critically: Selective Self Distillation in Federated Learning on Non-IID Data
by: He, Yuting, et al.
Published: (2025)

Small Scale Data-Free Knowledge Distillation
by: Liu, He, et al.
Published: (2024)