Image de couverture de livre

Knowledge Distillation for Federated Learning: a Practical Guide

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Mora, Alessio, Tenison, Irene, Bellavista, Paolo, Rish, Irina
Format:	Preprint
Publié:	2022
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Federated Unlearning Made Practical: Seamless Integration via Negated Pseudo-Gradients
par: Mora, Alessio, et autres
Publié: (2025)

FedQUIT: On-Device Federated Unlearning via a Quasi-Competent Virtual Teacher
par: Mora, Alessio, et autres
Publié: (2024)

Federated Unlearning: A Survey on Methods, Design Guidelines, and Evaluation Metrics
par: Romandini, Nicolò, et autres
Publié: (2024)

SparsyFed: Sparse Adaptive Federated Training
par: Guastella, Adriano, et autres
Publié: (2025)

Forget to Generalize: Iterative Adaptation for Generalization in Federated Learning
par: Alotaibi, Abdulrahman, et autres
Publié: (2026)

FTTE: Enabling Federated and Resource-Constrained Deep Edge Intelligence
par: Tenison, Irene, et autres
Publié: (2025)

Warming Up for Zeroth-Order Federated Pre-Training with Low Resource Clients
par: Legate, Gwen, et autres
Publié: (2025)

AdaBet: Gradient-free Layer Selection for Efficient Training of Deep Neural Networks
par: Tenison, Irene, et autres
Publié: (2025)

Enabling Realtime Reinforcement Learning at Scale with Staggered Asynchronous Inference
par: Riemer, Matthew, et autres
Publié: (2024)

Knowledge Distillation in Federated Edge Learning: A Survey
par: Wu, Zhiyuan, et autres
Publié: (2023)

Parameter Efficiency Is Not Memory Efficiency: Rethinking Fine-Tuning for On-Device LLM Adaptation
par: Tenison, Irene, et autres
Publié: (2026)

Tailored Federated Learning: Leveraging Direction Regulation & Knowledge Distillation
par: Tang, Huidong, et autres
Publié: (2024)

MuLoCo: Muon is a practical inner optimizer for DiLoCo
par: Thérien, Benjamin, et autres
Publié: (2025)

Influence Functions for Efficient Data Selection in Reasoning
par: Humane, Prateek, et autres
Publié: (2025)

$μ$LO: Compute-Efficient Meta-Generalization of Learned Optimizers
par: Thérien, Benjamin, et autres
Publié: (2024)

Tackling Data Heterogeneity in Federated Learning through Knowledge Distillation with Inequitable Aggregation
par: Ma, Xing
Publié: (2025)

Partial Knowledge Distillation for Alleviating the Inherent Inter-Class Discrepancy in Federated Learning
par: Gan, Xiaoyu, et autres
Publié: (2024)

Reviving Stale Updates: Data-Free Knowledge Distillation for Asynchronous Federated Learning
par: Askin, Baris, et autres
Publié: (2025)

A Guide to Robust Generalization: The Impact of Architecture, Pre-training, and Optimization Strategy
par: Heuillet, Maxime, et autres
Publié: (2025)

FedEMA-Distill: Exponential Moving Average Guided Knowledge Distillation for Robust Federated Learning
par: Reguieg, Hamza, et autres
Publié: (2026)

Beyond Cosine Decay: On the effectiveness of Infinite Learning Rate Schedule for Continual Pre-training
par: Singh, Vaibhav, et autres
Publié: (2025)

Learning from Stochastic Teacher Representations Using Student-Guided Knowledge Distillation
par: Aslam, Muhammad Haseeb, et autres
Publié: (2025)

Clustered Federated Learning with Hierarchical Knowledge Distillation
par: Ahmad, Sabtain, et autres
Publié: (2025)

UNIDEAL: Curriculum Knowledge Distillation Federated Learning
par: Yang, Yuwen, et autres
Publié: (2023)

Enabling Weak Client Participation via On-device Knowledge Distillation in Heterogeneous Federated Learning
par: Lim, Jihyun, et autres
Publié: (2025)

A Novel Algorithm for Personalized Federated Learning: Knowledge Distillation with Weighted Combination Loss
par: Hu, Hengrui, et autres
Publié: (2025)

FedCache 2.0: Federated Edge Learning with Knowledge Caching and Dataset Distillation
par: Pan, Quyang, et autres
Publié: (2024)

SFedKD: Sequential Federated Learning with Discrepancy-Aware Multi-Teacher Knowledge Distillation
par: Xu, Haotian, et autres
Publié: (2025)

HYDRA-FL: Hybrid Knowledge Distillation for Robust and Accurate Federated Learning
par: Khan, Momin Ahmad, et autres
Publié: (2024)

Non-Adversarial Inverse Reinforcement Learning via Successor Feature Matching
par: Jain, Arnav Kumar, et autres
Publié: (2024)

Optimized Federated Knowledge Distillation with Distributed Neural Architecture Search
par: Medjadji, Chaimaa, et autres
Publié: (2026)

Handling Delay in Real-Time Reinforcement Learning
par: Anokhin, Ivan, et autres
Publié: (2025)

One-shot Federated Learning Methods: A Practical Guide
par: Liu, Xiang, et autres
Publié: (2025)

A Multi-Prototype-Guided Federated Knowledge Distillation Approach in AI-RAN Enabled Multi-Access Edge Computing System
par: Zou, Luyao, et autres
Publié: (2026)

Low-Dimensional Federated Knowledge Graph Embedding via Knowledge Distillation
par: Zhang, Xiaoxiong, et autres
Publié: (2024)

Practical Insights into Knowledge Distillation for Pre-Trained Models
par: Alballa, Norah, et autres
Publié: (2024)

Blind Federated Learning without initial model
par: Salmeron, Jose L., et autres
Publié: (2024)

InfGraND: An Influence-Guided GNN-to-MLP Knowledge Distillation
par: Eskandari, Amir, et autres
Publié: (2026)

FedKDX: Federated Learning with Negative Knowledge Distillation for Enhanced Healthcare AI Systems
par: Pham, Quang-Tu, et autres
Publié: (2026)

Small Vocabularies, Big Gains: Pretraining and Tokenization in Time Series Models
par: Roger, Alexis, et autres
Publié: (2025)