Cover Image

A Functional Perspective on Knowledge Distillation in Neural Networks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Mason-Williams, Israel, Mason-Williams, Gabryel, Yannakoudakis, Helen
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A Function-Centric Perspective on Flat and Sharp Minima
by: Mason-Williams, Israel, et al.
Published: (2025)

Reproducibility: The New Frontier in AI Governance
by: Mason-Williams, Israel, et al.
Published: (2025)

Quality Audio Prototyping: a prototype system for unified sound retrieval and procedural generation
by: Garcia, Nelly, et al.
Published: (2026)

Online Adversarial Knowledge Distillation for Graph Neural Networks
by: Wang, Can, et al.
Published: (2021)

The Impact of Off-Policy Training Data on Probe Generalisation
by: Kirch, Nathalie, et al.
Published: (2025)

D-SPEAR: Dual-Stream Prioritized Experience Adaptive Replay for Stable Reinforcement Learning in Robotic Manipulation
by: Zhang, Yu, et al.
Published: (2026)

A Meta-Learning Approach for Multi-Objective Reinforcement Learning in Sustainable Home Environments
by: Lu, Junlin, et al.
Published: (2024)

A Deep Reinforcement Learning Approach to Battery Management in Dairy Farming via Proximal Policy Optimization
by: Ali, Nawazish, et al.
Published: (2024)

Not All Timesteps Matter Equally: Selective Alignment Knowledge Distillation for Spiking Neural Networks
by: Sun, Kai, et al.
Published: (2026)

Knowledge Distillation in Wide Neural Networks: Risk Bound, Data Efficiency and Imperfect Teacher
by: Ji, Guangda, et al.
Published: (2020)

A Note on Knowledge Distillation Loss Function for Object Classification
by: Chen, Defang
Published: (2021)

Demonstration Guided Multi-Objective Reinforcement Learning
by: Lu, Junlin, et al.
Published: (2024)

Hindsight Preference Replay Improves Preference-Conditioned Multi-Objective Reinforcement Learning
by: Shianifar, Jonaid, et al.
Published: (2026)

AIM: Adaptive Intervention for Deep Multi-task Learning of Molecular Properties
by: Minot, Mason, et al.
Published: (2025)

Dataset Distillation with Neural Characteristic Function: A Minmax Perspective
by: Wang, Shaobo, et al.
Published: (2025)

Knowledge Distillation Neural Network for Predicting Car-following Behaviour of Human-driven and Autonomous Vehicles
by: Adewale, Ayobami, et al.
Published: (2024)

Logical Distillation of Graph Neural Networks
by: Pluska, Alexander, et al.
Published: (2024)

A Reinforcement Learning Approach to Dairy Farm Battery Management using Q Learning
by: Ali, Nawazish, et al.
Published: (2024)

Enhancing Graph Neural Networks with Limited Labeled Data by Actively Distilling Knowledge from Large Language Models
by: Li, Quan, et al.
Published: (2024)

Neural Tangent Knowledge Distillation for Optical Convolutional Networks
by: Xiang, Jinlin, et al.
Published: (2025)

Agent-Based Modeling and Deep Neural Networks for Establishing Digital Twins of Secure Facilities under Sensing Restrictions
by: Gunaratne, Chathika, et al.
Published: (2025)

Publication Trend Analysis and Synthesis via Large Language Model: A Case Study of Engineering in PNAS
by: Smetana, Mason, et al.
Published: (2025)

MAPLE: A Framework for Active Preference Learning Guided by Large Language Models
by: Mahmud, Saaduddin, et al.
Published: (2024)

Toward Student-Oriented Teacher Network Training For Knowledge Distillation
by: Dong, Chengyu, et al.
Published: (2022)

Rapfi: Distilling Efficient Neural Network for the Game of Gomoku
by: Jin, Zhanggen, et al.
Published: (2025)

Distilling Symbolic Priors for Concept Learning into Neural Networks
by: Marinescu, Ioana, et al.
Published: (2024)

A Survey on Knowledge Editing of Neural Networks
by: Mazzia, Vittorio, et al.
Published: (2023)

Knowledge Distillation on Spatial-Temporal Graph Convolutional Network for Traffic Prediction
by: Izadi, Mohammad, et al.
Published: (2024)

Generalizing Teacher Networks for Effective Knowledge Distillation Across Student Architectures
by: Binici, Kuluhan, et al.
Published: (2024)

Go-Explore for Residential Energy Management
by: Lu, Junlin, et al.
Published: (2024)

Integral Signatures of Activation Functions: A 9-Dimensional Taxonomy and Stability Theory for Deep Learning
by: Mali, Ankur, et al.
Published: (2025)

Bridging Classical and Quantum Machine Learning: Knowledge Transfer From Classical to Quantum Neural Networks Using Knowledge Distillation
by: Hasan, Mohammad Junayed, et al.
Published: (2023)

Exploring Feature-based Knowledge Distillation for Recommender System: A Frequency Perspective
by: Zhu, Zhangchi, et al.
Published: (2024)

Eau De $Q$-Network: Adaptive Distillation of Neural Networks in Deep Reinforcement Learning
by: Vincent, Théo, et al.
Published: (2025)

Attribution Explanations for Deep Neural Networks: A Theoretical Perspective
by: Deng, Huiqi, et al.
Published: (2025)

Dynamic Temperature Scheduler for Knowledge Distillation
by: Islam, Sibgat Ul, et al.
Published: (2025)

Membership and Memorization in LLM Knowledge Distillation
by: Zhang, Ziqi, et al.
Published: (2025)

Graph Knowledge Distillation to Mixture of Experts
by: Rumiantsev, Pavel, et al.
Published: (2024)

Cooperative Knowledge Distillation: A Learner Agnostic Approach
by: Livanos, Michael, et al.
Published: (2024)

Deep Neural Networks via Complex Network Theory: a Perspective
by: La Malfa, Emanuele, et al.
Published: (2024)