Cover Image

HFedCKD: Toward Robust Heterogeneous Federated Learning via Data-free Knowledge Distillation and Two-way Contrast

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zheng, Yiting, Lin, Bohan, Chen, Jinqian, Zhu, Jihua
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

HFedMoE: Resource-aware Heterogeneous Federated Learning with Mixture-of-Experts
by: Fang, Zihan, et al.
Published: (2026)

TPFL: A Trustworthy Personalized Federated Learning Framework via Subjective Logic
by: Chen, Jinqian, et al.
Published: (2024)

Beyond Factor Aggregation: Gauge-Aware Low-Rank Server Representations for Federated LoRA
by: Chen, Jinqian, et al.
Published: (2026)

Watch Your Head: Assembling Projection Heads to Save the Reliability of Federated Models
by: Chen, Jinqian, et al.
Published: (2024)

AFBS:Buffer Gradient Selection in Semi-asynchronous Federated Learning
by: Lu, Chaoyi, et al.
Published: (2025)

FedPSA: Modeling Behavioral Staleness in Asynchronous Federated Learning
by: Lu, Chaoyi, et al.
Published: (2026)

CKD: Contrastive Knowledge Distillation from A Sample-wise Perspective
by: Zhu, Wencheng, et al.
Published: (2024)

FedTAD: Topology-aware Data-free Knowledge Distillation for Subgraph Federated Learning
by: Zhu, Yinlin, et al.
Published: (2024)

Towards Diverse Device Heterogeneous Federated Learning via Task Arithmetic Knowledge Integration
by: Morafah, Mahdi, et al.
Published: (2024)

Towards Personalized Federated Learning via Comprehensive Knowledge Distillation
by: Wang, Pengju, et al.
Published: (2024)

LLaVA-CKD: Bottom-Up Cascaded Knowledge Distillation for Vision-Language Models
by: Gkalelis, Nikolaos, et al.
Published: (2026)

Federated Learning on Virtual Heterogeneous Data with Local-global Distillation
by: Huang, Chun-Yin, et al.
Published: (2023)

Towards Deviation-Robust Agent Navigation via Perturbation-Aware Contrastive Learning
by: Lin, Bingqian, et al.
Published: (2024)

Robust Knowledge Distillation in Federated Learning: Counteracting Backdoor Attacks
by: Alharbi, Ebtisaam, et al.
Published: (2025)

Robust Noisy Label Learning via Two-Stream Sample Distillation
by: Bai, Sihan, et al.
Published: (2024)

MH-pFLID: Model Heterogeneous personalized Federated Learning via Injection and Distillation for Medical Data Analysis
by: Xie, Luyuan, et al.
Published: (2024)

LCFed: An Efficient Clustered Federated Learning Framework for Heterogeneous Data
by: Zhang, Yuxin, et al.
Published: (2025)

Towards Robust Federated Multimodal Graph Learning under Modality Heterogeneity
by: Zhang, Sirui, et al.
Published: (2026)

FedAC: An Adaptive Clustered Federated Learning Framework for Heterogeneous Data
by: Zhang, Yuxin, et al.
Published: (2024)

Training Heterogeneous Client Models using Knowledge Distillation in Serverless Federated Learning
by: Chadha, Mohak, et al.
Published: (2024)

Aggregation Alignment for Federated Learning with Mixture-of-Experts under Data Heterogeneity
by: Fang, Zihan, et al.
Published: (2026)

Towards Optimal Customized Architecture for Heterogeneous Federated Learning with Contrastive Cloud-Edge Model Decoupling
by: Chen, Xingyan, et al.
Published: (2024)

On ADMM in Heterogeneous Federated Learning: Personalization, Robustness, and Fairness
by: Zhu, Shengkun, et al.
Published: (2024)

Towards Performance-Enhanced Model-Contrastive Federated Learning using Historical Information in Heterogeneous Scenarios
by: Zhang, Hongliang, et al.
Published: (2026)

Mosaic: Data-Free Knowledge Distillation via Mixture-of-Experts for Heterogeneous Distributed Environments
by: Liu, Junming, et al.
Published: (2025)

Improving the Robustness of Knowledge-Grounded Dialogue via Contrastive Learning
by: Wang, Jiaan, et al.
Published: (2024)

FedHPD: Heterogeneous Federated Reinforcement Learning via Policy Distillation
by: Jiang, Wenzheng, et al.
Published: (2025)

Selective Knowledge Sharing for Personalized Federated Learning Under Capacity Heterogeneity
by: Wang, Zheng, et al.
Published: (2024)

FedCoSR: Personalized Federated Learning with Contrastive Shareable Representations for Label Heterogeneity in Non-IID Data
by: Huang, Chenghao, et al.
Published: (2024)

Feature Distillation is the Better Choice for Model-Heterogeneous Federated Learning
by: Li, Yichen, et al.
Published: (2025)

FedEMA-Distill: Exponential Moving Average Guided Knowledge Distillation for Robust Federated Learning
by: Reguieg, Hamza, et al.
Published: (2026)

FedMTFI: Feature Importance Based Optimized Multi Teacher Knowledge Distillation in Heterogeneous Federated Learning Environment
by: Shadin, Nazmus Shakib, et al.
Published: (2026)

Low-Dimensional Federated Knowledge Graph Embedding via Knowledge Distillation
by: Zhang, Xiaoxiong, et al.
Published: (2024)

FedSKD: Aggregation-free Model-heterogeneous Federated Learning via Multi-dimensional Similarity Knowledge Distillation for Medical Image Classification
by: Weng, Ziqiao, et al.
Published: (2025)

Towards Robust Knowledge Removal in Federated Learning with High Data Heterogeneity
by: Santi, Riccardo, et al.
Published: (2025)

DeepFusion: Accelerating MoE Training via Federated Knowledge Distillation from Heterogeneous Edge Devices
by: Li, Songyuan, et al.
Published: (2026)

Heterogeneous Graph Structure Learning through the Lens of Data-generating Processes
by: Jiang, Keyue, et al.
Published: (2025)

Class Incremental Fault Diagnosis under Limited Fault Data via Supervised Contrastive Knowledge Distillation
by: Zhang, Hanrong, et al.
Published: (2025)

Knowledge Distillation in Federated Learning: A Survey on Long Lasting Challenges and New Solutions
by: Laiqiao Qin, et al.
Published: (2025)

Clustered Federated Learning with Hierarchical Knowledge Distillation
by: Ahmad, Sabtain, et al.
Published: (2025)