Cover Image

Knowledge Distillation in Federated Learning: a Survey on Long Lasting Challenges and New Solutions

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Qin, Laiqiao, Zhu, Tianqing, Zhou, Wanlei, Yu, Philip S.
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Distributed, Parallel, and Cluster Computing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Linkage on Security, Privacy and Fairness in Federated Learning: New Balances and New Perspectives
by: Wang, Linlin, et al.
Published: (2024)

Update Selective Parameters: Federated Machine Unlearning Based on Model Explanation
by: Xu, Heng, et al.
Published: (2024)

Federated Learning with Blockchain-Enhanced Machine Unlearning: A Trustworthy Approach
by: Zuo, Xuhan, et al.
Published: (2024)

FedAL: Black-Box Federated Knowledge Distillation Enabled by Adversarial Learning
by: Han, Pengchao, et al.
Published: (2023)

Privacy-Preserving Federated Learning with Consistency via Knowledge Distillation Using Conditional Generator
by: Luo, Kangyang, et al.
Published: (2024)

A Comprehensive Survey of Federated Transfer Learning: Challenges, Methods and Applications
by: Guo, Wei, et al.
Published: (2024)

Topology-aware Federated Learning in Edge Computing: A Comprehensive Survey
by: Wu, Jiajun, et al.
Published: (2023)

Knowledge-Driven Federated Graph Learning on Model Heterogeneity
by: Wu, Zhengyu, et al.
Published: (2025)

Clustered Federated Learning with Hierarchical Knowledge Distillation
by: Ahmad, Sabtain, et al.
Published: (2025)

UNIDEAL: Curriculum Knowledge Distillation Federated Learning
by: Yang, Yuwen, et al.
Published: (2023)

Knowledge Distillation in Federated Learning: A Survey on Long Lasting Challenges and New Solutions
by: Laiqiao Qin, et al.
Published: (2025)

A Survey on Contribution Evaluation in Vertical Federated Learning
by: Cui, Yue, et al.
Published: (2024)

Sentinel: Dynamic Knowledge Distillation for Personalized Federated Intrusion Detection in Heterogeneous IoT Networks
by: Singh, Gurpreet, et al.
Published: (2025)

A Unified Solution to Diverse Heterogeneities in One-shot Federated Learning
by: Bai, Jun, et al.
Published: (2024)

Vertical Federated Learning: Challenges, Methodologies and Experiments
by: Wei, Kang, et al.
Published: (2022)

DROP: Poison Dilution via Knowledge Distillation for Federated Learning
by: Syros, Georgios, et al.
Published: (2025)

Heterogeneity: An Open Challenge for Federated On-board Machine Learning
by: Hartmann, Maria, et al.
Published: (2024)

Dual-Distilled Heterogeneous Federated Learning with Adaptive Margins for Trainable Global Prototypes
by: Siddika, Fatema, et al.
Published: (2025)

Stragglers Can Contribute More: Uncertainty-Aware Distillation for Asynchronous Federated Learning
by: Wang, Yujia, et al.
Published: (2025)

Efficient Model Compression for Hierarchical Federated Learning
by: Zhu, Xi, et al.
Published: (2024)

Homogenizing Non-IID datasets via In-Distribution Knowledge Distillation for Decentralized Learning
by: Ravikumar, Deepak, et al.
Published: (2023)

Communication-Efficient Federated Learning through Adaptive Weight Clustering and Server-Side Distillation
by: Tsouvalas, Vasileios, et al.
Published: (2024)

DFDG: Data-Free Dual-Generator Adversarial Distillation for One-Shot Federated Learning
by: Luo, Kangyang, et al.
Published: (2024)

Towards Client Driven Federated Learning
by: Li, Songze, et al.
Published: (2024)

Personalized Federated Domain-Incremental Learning based on Adaptive Knowledge Matching
by: Li, Yichen, et al.
Published: (2024)

Training Heterogeneous Client Models using Knowledge Distillation in Serverless Federated Learning
by: Chadha, Mohak, et al.
Published: (2024)

Adaptive Federated Learning via New Entropy Approach
by: Zheng, Shensheng, et al.
Published: (2023)

Ranking-based Client Selection with Imitation Learning for Efficient Federated Learning
by: Tian, Chunlin, et al.
Published: (2024)

Overcoming Challenges of Partial Client Participation in Federated Learning : A Comprehensive Review
by: Sen, Mrinmay, et al.
Published: (2025)

A Survey on Federated Fine-tuning of Large Language Models
by: Wu, Yebo, et al.
Published: (2025)

AIGC-assisted Federated Learning for Edge Intelligence: Architecture Design, Research Challenges and Future Directions
by: Qiang, Xianke, et al.
Published: (2025)

A Survey on Federated Unlearning: Challenges and Opportunities
by: Jeong, Hyejun, et al.
Published: (2024)

Knowledge-Aware Evolution for Streaming Federated Continual Learning with Category Overlap and without Task Identifiers
by: Tan, Sixing, et al.
Published: (2026)

Review of Mathematical Optimization in Federated Learning
by: Yang, Shusen, et al.
Published: (2024)

FedCAda: Adaptive Client-Side Optimization for Accelerated and Stable Federated Learning
by: Zhou, Liuzhi, et al.
Published: (2024)

Federated Learning Survey: A Multi-Level Taxonomy of Aggregation Techniques, Experimental Insights, and Future Frontiers
by: Arbaoui, Meriem, et al.
Published: (2025)

Federated Distillation on Edge Devices: Efficient Client-Side Filtering for Non-IID Data
by: Mujtaba, Ahmed, et al.
Published: (2025)

Personalized Federated Learning via ADMM with Moreau Envelope
by: Zhu, Shengkun, et al.
Published: (2023)

Beyond Model Scale Limits: End-Edge-Cloud Federated Learning with Self-Rectified Knowledge Agglomeration
by: Wu, Zhiyuan, et al.
Published: (2025)

Orthogonal Calibration for Asynchronous Federated Learning
by: Zhang, Jiayun, et al.
Published: (2025)