SFedKD: Sequential Federated Learning with Discrepancy-Aware Multi-Teacher Knowledge Distillation
Fuente:
arXiv
Guardado en:
| Autores principales: | Xu, Haotian, Zhou, Jinrui, Zhang, Xichong, Xiao, Mingjun, Sun, He, Xu, Yin |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
CooperLLM: Cloud-Edge-End Cooperative Federated Fine-tuning for LLMs via ZOO-based Gradient Correction
por: Sun, He, et al.
Publicado: (2026)
por: Sun, He, et al.
Publicado: (2026)
MemKD: Memory-Discrepancy Knowledge Distillation for Efficient Time Series Classification
por: Udayangani, Nilushika, et al.
Publicado: (2026)
por: Udayangani, Nilushika, et al.
Publicado: (2026)
BicKD: Bilateral Contrastive Knowledge Distillation
por: Zhu, Jiangnan, et al.
Publicado: (2026)
por: Zhu, Jiangnan, et al.
Publicado: (2026)
SFedHIFI: Fire Rate-Based Heterogeneous Information Fusion for Spiking Federated Learning
por: Tao, Ran, et al.
Publicado: (2026)
por: Tao, Ran, et al.
Publicado: (2026)
HPM-KD: Hierarchical Progressive Multi-Teacher Framework for Knowledge Distillation and Efficient Model Compression
por: Haase, Gustavo Coelho, et al.
Publicado: (2025)
por: Haase, Gustavo Coelho, et al.
Publicado: (2025)
Partial Knowledge Distillation for Alleviating the Inherent Inter-Class Discrepancy in Federated Learning
por: Gan, Xiaoyu, et al.
Publicado: (2024)
por: Gan, Xiaoyu, et al.
Publicado: (2024)
MTL-KD: Multi-Task Learning Via Knowledge Distillation for Generalizable Neural Vehicle Routing Solver
por: Zheng, Yuepeng, et al.
Publicado: (2025)
por: Zheng, Yuepeng, et al.
Publicado: (2025)
CLIP-Embed-KD: Computationally Efficient Knowledge Distillation Using Embeddings as Teachers
por: Nair, Lakshmi
Publicado: (2024)
por: Nair, Lakshmi
Publicado: (2024)
FlyKD: Graph Knowledge Distillation on the Fly with Curriculum Learning
por: Ku, Eugene
Publicado: (2024)
por: Ku, Eugene
Publicado: (2024)
ShiftKD: Benchmarking Knowledge Distillation under Distribution Shift
por: Zhang, Songming, et al.
Publicado: (2023)
por: Zhang, Songming, et al.
Publicado: (2023)
FedeKD: Energy-Based Gating for Robust Federated Knowledge Distillation under Heterogeneous Settings
por: Nguyen, Quang-Huy, et al.
Publicado: (2026)
por: Nguyen, Quang-Huy, et al.
Publicado: (2026)
Dual Model Replacement:invisible Multi-target Backdoor Attack based on Federal Learning
por: Wang, Rong, et al.
Publicado: (2024)
por: Wang, Rong, et al.
Publicado: (2024)
TuneShift-KD: Knowledge Distillation and Transfer for Fine-tuned Models
por: Guan, Yushi, et al.
Publicado: (2026)
por: Guan, Yushi, et al.
Publicado: (2026)
RMT-KD: Random Matrix Theoretic Causal Knowledge Distillation
por: Ettori, Davide, et al.
Publicado: (2025)
por: Ettori, Davide, et al.
Publicado: (2025)
SFedCA: Credit Assignment-Based Active Client Selection Strategy for Spiking Federated Learning
por: Zhan, Qiugang, et al.
Publicado: (2024)
por: Zhan, Qiugang, et al.
Publicado: (2024)
FedSiKD: Clients Similarity and Knowledge Distillation: Addressing Non-i.i.d. and Constraints in Federated Learning
por: Alsenani, Yousef, et al.
Publicado: (2024)
por: Alsenani, Yousef, et al.
Publicado: (2024)
FedMTFI: Feature Importance Based Optimized Multi Teacher Knowledge Distillation in Heterogeneous Federated Learning Environment
por: Shadin, Nazmus Shakib, et al.
Publicado: (2026)
por: Shadin, Nazmus Shakib, et al.
Publicado: (2026)
Reviving Stale Updates: Data-Free Knowledge Distillation for Asynchronous Federated Learning
por: Askin, Baris, et al.
Publicado: (2025)
por: Askin, Baris, et al.
Publicado: (2025)
S^2-KD: Semantic-Spectral Knowledge Distillation Spatiotemporal Forecasting
por: Wang, Wenshuo, et al.
Publicado: (2025)
por: Wang, Wenshuo, et al.
Publicado: (2025)
TabKD: Tabular Knowledge Distillation through Interaction Diversity of Learned Feature Bins
por: Pereira, Shovon Niverd, et al.
Publicado: (2026)
por: Pereira, Shovon Niverd, et al.
Publicado: (2026)
Multi-intent Aware Contrastive Learning for Sequential Recommendation
por: Huang, Junshu, et al.
Publicado: (2024)
por: Huang, Junshu, et al.
Publicado: (2024)
Knowledge Distillation in Federated Edge Learning: A Survey
por: Wu, Zhiyuan, et al.
Publicado: (2023)
por: Wu, Zhiyuan, et al.
Publicado: (2023)
AuG-KD: Anchor-Based Mixup Generation for Out-of-Domain Knowledge Distillation
por: Tang, Zihao, et al.
Publicado: (2024)
por: Tang, Zihao, et al.
Publicado: (2024)
Sequential Kernelized Stein Discrepancy
por: Martinez-Taboada, Diego, et al.
Publicado: (2024)
por: Martinez-Taboada, Diego, et al.
Publicado: (2024)
DeepKD: A Deeply Decoupled and Denoised Knowledge Distillation Trainer
por: Huang, Haiduo, et al.
Publicado: (2025)
por: Huang, Haiduo, et al.
Publicado: (2025)
$γ$-FedHT: Stepsize-Aware Hard-Threshold Gradient Compression in Federated Learning
por: Lu, Rongwei, et al.
Publicado: (2025)
por: Lu, Rongwei, et al.
Publicado: (2025)
Model Merging via Multi-Teacher Knowledge Distillation
por: Dalili, Seyed Arshan, et al.
Publicado: (2025)
por: Dalili, Seyed Arshan, et al.
Publicado: (2025)
AI-KD: Adversarial learning and Implicit regularization for self-Knowledge Distillation
por: Kim, Hyungmin, et al.
Publicado: (2022)
por: Kim, Hyungmin, et al.
Publicado: (2022)
Multi-Teacher Knowledge Distillation via Teacher-Informed Mixture Priors
por: Fang, Luyang, et al.
Publicado: (2026)
por: Fang, Luyang, et al.
Publicado: (2026)
Communication-Aware Knowledge Distillation for Federated LLM Fine-Tuning over Wireless Networks
por: Zhang, Xinlu, et al.
Publicado: (2025)
por: Zhang, Xinlu, et al.
Publicado: (2025)
Sinkhorn Distance Minimization for Knowledge Distillation
por: Cui, Xiao, et al.
Publicado: (2024)
por: Cui, Xiao, et al.
Publicado: (2024)
Group Relative Knowledge Distillation: Learning from Teacher's Relational Inductive Bias
por: Li, Chao, et al.
Publicado: (2025)
por: Li, Chao, et al.
Publicado: (2025)
Low-Dimensional Federated Knowledge Graph Embedding via Knowledge Distillation
por: Zhang, Xiaoxiong, et al.
Publicado: (2024)
por: Zhang, Xiaoxiong, et al.
Publicado: (2024)
C2G-KD: PCA-Constrained Generator for Data-Free Knowledge Distillation
por: Bengtsson, Magnus, et al.
Publicado: (2025)
por: Bengtsson, Magnus, et al.
Publicado: (2025)
AdaKD: Dynamic Knowledge Distillation of ASR models using Adaptive Loss Weighting
por: Ganguly, Shreyan, et al.
Publicado: (2024)
por: Ganguly, Shreyan, et al.
Publicado: (2024)
Adv-KD: Adversarial Knowledge Distillation for Faster Diffusion Sampling
por: Mekonnen, Kidist Amde, et al.
Publicado: (2024)
por: Mekonnen, Kidist Amde, et al.
Publicado: (2024)
Knowledge Distillation for Federated Learning: a Practical Guide
por: Mora, Alessio, et al.
Publicado: (2022)
por: Mora, Alessio, et al.
Publicado: (2022)
Federated Learning on Virtual Heterogeneous Data with Local-global Distillation
por: Huang, Chun-Yin, et al.
Publicado: (2023)
por: Huang, Chun-Yin, et al.
Publicado: (2023)
Integrating Knowledge Distillation Methods: A Sequential Multi-Stage Framework
por: Tian, Yinxi, et al.
Publicado: (2026)
por: Tian, Yinxi, et al.
Publicado: (2026)
Privacy-Preserving Federated Learning via Dataset Distillation
por: Xu, ShiMao, et al.
Publicado: (2024)
por: Xu, ShiMao, et al.
Publicado: (2024)
Ejemplares similares
-
CooperLLM: Cloud-Edge-End Cooperative Federated Fine-tuning for LLMs via ZOO-based Gradient Correction
por: Sun, He, et al.
Publicado: (2026) -
MemKD: Memory-Discrepancy Knowledge Distillation for Efficient Time Series Classification
por: Udayangani, Nilushika, et al.
Publicado: (2026) -
BicKD: Bilateral Contrastive Knowledge Distillation
por: Zhu, Jiangnan, et al.
Publicado: (2026) -
SFedHIFI: Fire Rate-Based Heterogeneous Information Fusion for Spiking Federated Learning
por: Tao, Ran, et al.
Publicado: (2026) -
HPM-KD: Hierarchical Progressive Multi-Teacher Framework for Knowledge Distillation and Efficient Model Compression
por: Haase, Gustavo Coelho, et al.
Publicado: (2025)