:: Library Catalog

Cover Image

Saved in:

Bibliographic Details
Main Authors:	Livanos, Michael, Davidson, Ian, Wong, Stephen
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence
Online Access:	https://arxiv.org/abs/2402.05942
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Identification and Uses of Deep Learning Backbones via Pattern Mining
by: Livanos, Michael, et al.
Published: (2024)

Foundations for Unfairness in Anomaly Detection -- Case Studies in Facial Imaging Data
by: Livanos, Michael, et al.
Published: (2024)

Mirage: Model-Agnostic Graph Distillation for Graph Classification
by: Gupta, Mridul, et al.
Published: (2023)

Teacher as a Lenient Expert: Teacher-Agnostic Data-Free Knowledge Distillation
by: Shin, Hyunjune, et al.
Published: (2024)

Enhancing Transformer with GNN Structural Knowledge via Distillation: A Novel Approach
by: Duan, Zhihua, et al.
Published: (2025)

Transformer Is Inherently a Causal Learner
by: Wang, Xinyue, et al.
Published: (2026)

Edge-free but Structure-aware: Prototype-Guided Knowledge Distillation from GNNs to MLPs
by: Wu, Taiqiang, et al.
Published: (2023)

ChaosMining: A Benchmark to Evaluate Post-Hoc Local Attribution Methods in Low SNR Environments
by: Shi, Ge, et al.
Published: (2024)

Boosting Efficiency in Task-Agnostic Exploration through Causal Knowledge
by: Yang, Yupei, et al.
Published: (2024)

Wearable Accelerometer Foundation Models for Health via Knowledge Distillation
by: Abbaspourazad, Salar, et al.
Published: (2024)

A Novel Approach To Implementing Knowledge Distillation In Tsetlin Machines
by: Kinateder, Calvin
Published: (2025)

Graph Knowledge Distillation to Mixture of Experts
by: Rumiantsev, Pavel, et al.
Published: (2024)

Dynamic Temperature Scheduler for Knowledge Distillation
by: Islam, Sibgat Ul, et al.
Published: (2025)

Membership and Memorization in LLM Knowledge Distillation
by: Zhang, Ziqi, et al.
Published: (2025)

LLM-NEO: Parameter Efficient Knowledge Distillation for Large Language Models
by: Yang, Runming, et al.
Published: (2024)

A Functional Perspective on Knowledge Distillation in Neural Networks
by: Mason-Williams, Israel, et al.
Published: (2025)

Approaching Low-Cost Cardiac Intelligence with Semi-Supervised Knowledge Distillation
by: Zhou, Rushuang, et al.
Published: (2025)

Low-Dimensional Federated Knowledge Graph Embedding via Knowledge Distillation
by: Zhang, Xiaoxiong, et al.
Published: (2024)

Knowledge Distillation Must Account for What It Loses
by: Wang, Wenshuo
Published: (2026)

Reinforcement-aware Knowledge Distillation for LLM Reasoning
by: Zhang, Zhaoyang, et al.
Published: (2026)

Collaborative Adaptive Curriculum for Progressive Knowledge Distillation
by: Liu, Jing, et al.
Published: (2026)

PathE: Leveraging Entity-Agnostic Paths for Parameter-Efficient Knowledge Graph Embeddings
by: Reklos, Ioannis, et al.
Published: (2025)

A Note on Knowledge Distillation Loss Function for Object Classification
by: Chen, Defang
Published: (2021)

Instruction-tuned Language Models are Better Knowledge Learners
by: Jiang, Zhengbao, et al.
Published: (2024)

Teach Harder, Learn Poorer: Rethinking Hard Sample Distillation for GNN-to-MLP Knowledge Distillation
by: Wu, Lirong, et al.
Published: (2024)

Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Models
by: Bick, Aviv, et al.
Published: (2024)

Practical Insights into Knowledge Distillation for Pre-Trained Models
by: Alballa, Norah, et al.
Published: (2024)

Balancing Knowledge Distillation for Imbalance Learning with Bilevel Optimization
by: Nguyen, Anh B. H., et al.
Published: (2026)

Online Adversarial Knowledge Distillation for Graph Neural Networks
by: Wang, Can, et al.
Published: (2021)

Revisiting Knowledge Distillation: The Hidden Role of Dataset Size
by: Lanzillotta, Giulia, et al.
Published: (2025)

Model Merging via Multi-Teacher Knowledge Distillation
by: Dalili, Seyed Arshan, et al.
Published: (2025)

Rethinking Momentum Knowledge Distillation in Online Continual Learning
by: Michel, Nicolas, et al.
Published: (2023)

Consistently Informative Soft-Label Temperature for Knowledge Distillation
by: Luong, Hoang-Chau, et al.
Published: (2026)

Integrating Knowledge Distillation Methods: A Sequential Multi-Stage Framework
by: Tian, Yinxi, et al.
Published: (2026)

How to Backdoor the Knowledge Distillation
by: Wu, Chen, et al.
Published: (2025)

Scale-Agnostic Kolmogorov-Arnold Geometry in Neural Networks
by: Vanherreweghe, Mathew, et al.
Published: (2025)

Hybrid Learners Do Not Forget: A Brain-Inspired Neuro-Symbolic Approach to Continual Learning
by: Banayeeanzade, Amin, et al.
Published: (2025)

DistilCLIP-EEG: Enhancing Epileptic Seizure Detection Through Multi-modal Learning and Knowledge Distillation
by: Wang, Zexin, et al.
Published: (2025)

Few-shot Class-incremental Fault Diagnosis by Preserving Class-Agnostic Knowledge with Dual-Granularity Representations
by: Yang, Zhendong, et al.
Published: (2025)

DistillSpec: Improving Speculative Decoding via Knowledge Distillation
by: Zhou, Yongchao, et al.
Published: (2023)