Saved in:
| Main Authors: | Xu, Haotian, Zhou, Jinrui, Zhang, Xichong, Xiao, Mingjun, Sun, He, Xu, Yin |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2507.08508 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
CooperLLM: Cloud-Edge-End Cooperative Federated Fine-tuning for LLMs via ZOO-based Gradient Correction
by: Sun, He, et al.
Published: (2026)
by: Sun, He, et al.
Published: (2026)
MemKD: Memory-Discrepancy Knowledge Distillation for Efficient Time Series Classification
by: Udayangani, Nilushika, et al.
Published: (2026)
by: Udayangani, Nilushika, et al.
Published: (2026)
BicKD: Bilateral Contrastive Knowledge Distillation
by: Zhu, Jiangnan, et al.
Published: (2026)
by: Zhu, Jiangnan, et al.
Published: (2026)
SFedHIFI: Fire Rate-Based Heterogeneous Information Fusion for Spiking Federated Learning
by: Tao, Ran, et al.
Published: (2026)
by: Tao, Ran, et al.
Published: (2026)
HPM-KD: Hierarchical Progressive Multi-Teacher Framework for Knowledge Distillation and Efficient Model Compression
by: Haase, Gustavo Coelho, et al.
Published: (2025)
by: Haase, Gustavo Coelho, et al.
Published: (2025)
Partial Knowledge Distillation for Alleviating the Inherent Inter-Class Discrepancy in Federated Learning
by: Gan, Xiaoyu, et al.
Published: (2024)
by: Gan, Xiaoyu, et al.
Published: (2024)
CLIP-Embed-KD: Computationally Efficient Knowledge Distillation Using Embeddings as Teachers
by: Nair, Lakshmi
Published: (2024)
by: Nair, Lakshmi
Published: (2024)
MTL-KD: Multi-Task Learning Via Knowledge Distillation for Generalizable Neural Vehicle Routing Solver
by: Zheng, Yuepeng, et al.
Published: (2025)
by: Zheng, Yuepeng, et al.
Published: (2025)
FlyKD: Graph Knowledge Distillation on the Fly with Curriculum Learning
by: Ku, Eugene
Published: (2024)
by: Ku, Eugene
Published: (2024)
Dual Model Replacement:invisible Multi-target Backdoor Attack based on Federal Learning
by: Wang, Rong, et al.
Published: (2024)
by: Wang, Rong, et al.
Published: (2024)
ShiftKD: Benchmarking Knowledge Distillation under Distribution Shift
by: Zhang, Songming, et al.
Published: (2023)
by: Zhang, Songming, et al.
Published: (2023)
SFedCA: Credit Assignment-Based Active Client Selection Strategy for Spiking Federated Learning
by: Zhan, Qiugang, et al.
Published: (2024)
by: Zhan, Qiugang, et al.
Published: (2024)
FedeKD: Energy-Based Gating for Robust Federated Knowledge Distillation under Heterogeneous Settings
by: Nguyen, Quang-Huy, et al.
Published: (2026)
by: Nguyen, Quang-Huy, et al.
Published: (2026)
TuneShift-KD: Knowledge Distillation and Transfer for Fine-tuned Models
by: Guan, Yushi, et al.
Published: (2026)
by: Guan, Yushi, et al.
Published: (2026)
RMT-KD: Random Matrix Theoretic Causal Knowledge Distillation
by: Ettori, Davide, et al.
Published: (2025)
by: Ettori, Davide, et al.
Published: (2025)
FedMTFI: Feature Importance Based Optimized Multi Teacher Knowledge Distillation in Heterogeneous Federated Learning Environment
by: Shadin, Nazmus Shakib, et al.
Published: (2026)
by: Shadin, Nazmus Shakib, et al.
Published: (2026)
FedSiKD: Clients Similarity and Knowledge Distillation: Addressing Non-i.i.d. and Constraints in Federated Learning
by: Alsenani, Yousef, et al.
Published: (2024)
by: Alsenani, Yousef, et al.
Published: (2024)
Reviving Stale Updates: Data-Free Knowledge Distillation for Asynchronous Federated Learning
by: Askin, Baris, et al.
Published: (2025)
by: Askin, Baris, et al.
Published: (2025)
S^2-KD: Semantic-Spectral Knowledge Distillation Spatiotemporal Forecasting
by: Wang, Wenshuo, et al.
Published: (2025)
by: Wang, Wenshuo, et al.
Published: (2025)
TabKD: Tabular Knowledge Distillation through Interaction Diversity of Learned Feature Bins
by: Pereira, Shovon Niverd, et al.
Published: (2026)
by: Pereira, Shovon Niverd, et al.
Published: (2026)
AuG-KD: Anchor-Based Mixup Generation for Out-of-Domain Knowledge Distillation
by: Tang, Zihao, et al.
Published: (2024)
by: Tang, Zihao, et al.
Published: (2024)
Multi-intent Aware Contrastive Learning for Sequential Recommendation
by: Huang, Junshu, et al.
Published: (2024)
by: Huang, Junshu, et al.
Published: (2024)
Knowledge Distillation in Federated Edge Learning: A Survey
by: Wu, Zhiyuan, et al.
Published: (2023)
by: Wu, Zhiyuan, et al.
Published: (2023)
Sequential Kernelized Stein Discrepancy
by: Martinez-Taboada, Diego, et al.
Published: (2024)
by: Martinez-Taboada, Diego, et al.
Published: (2024)
DeepKD: A Deeply Decoupled and Denoised Knowledge Distillation Trainer
by: Huang, Haiduo, et al.
Published: (2025)
by: Huang, Haiduo, et al.
Published: (2025)
$γ$-FedHT: Stepsize-Aware Hard-Threshold Gradient Compression in Federated Learning
by: Lu, Rongwei, et al.
Published: (2025)
by: Lu, Rongwei, et al.
Published: (2025)
Model Merging via Multi-Teacher Knowledge Distillation
by: Dalili, Seyed Arshan, et al.
Published: (2025)
by: Dalili, Seyed Arshan, et al.
Published: (2025)
Multi-Teacher Knowledge Distillation via Teacher-Informed Mixture Priors
by: Fang, Luyang, et al.
Published: (2026)
by: Fang, Luyang, et al.
Published: (2026)
AI-KD: Adversarial learning and Implicit regularization for self-Knowledge Distillation
by: Kim, Hyungmin, et al.
Published: (2022)
by: Kim, Hyungmin, et al.
Published: (2022)
Sinkhorn Distance Minimization for Knowledge Distillation
by: Cui, Xiao, et al.
Published: (2024)
by: Cui, Xiao, et al.
Published: (2024)
Adv-KD: Adversarial Knowledge Distillation for Faster Diffusion Sampling
by: Mekonnen, Kidist Amde, et al.
Published: (2024)
by: Mekonnen, Kidist Amde, et al.
Published: (2024)
Group Relative Knowledge Distillation: Learning from Teacher's Relational Inductive Bias
by: Li, Chao, et al.
Published: (2025)
by: Li, Chao, et al.
Published: (2025)
Low-Dimensional Federated Knowledge Graph Embedding via Knowledge Distillation
by: Zhang, Xiaoxiong, et al.
Published: (2024)
by: Zhang, Xiaoxiong, et al.
Published: (2024)
Federated Learning on Virtual Heterogeneous Data with Local-global Distillation
by: Huang, Chun-Yin, et al.
Published: (2023)
by: Huang, Chun-Yin, et al.
Published: (2023)
Communication-Aware Knowledge Distillation for Federated LLM Fine-Tuning over Wireless Networks
by: Zhang, Xinlu, et al.
Published: (2025)
by: Zhang, Xinlu, et al.
Published: (2025)
C2G-KD: PCA-Constrained Generator for Data-Free Knowledge Distillation
by: Bengtsson, Magnus, et al.
Published: (2025)
by: Bengtsson, Magnus, et al.
Published: (2025)
AdaKD: Dynamic Knowledge Distillation of ASR models using Adaptive Loss Weighting
by: Ganguly, Shreyan, et al.
Published: (2024)
by: Ganguly, Shreyan, et al.
Published: (2024)
m2mKD: Module-to-Module Knowledge Distillation for Modular Transformers
by: Lo, Ka Man, et al.
Published: (2024)
by: Lo, Ka Man, et al.
Published: (2024)
Knowledge Distillation for Federated Learning: a Practical Guide
by: Mora, Alessio, et al.
Published: (2022)
by: Mora, Alessio, et al.
Published: (2022)
Integrating Knowledge Distillation Methods: A Sequential Multi-Stage Framework
by: Tian, Yinxi, et al.
Published: (2026)
by: Tian, Yinxi, et al.
Published: (2026)
Similar Items
-
CooperLLM: Cloud-Edge-End Cooperative Federated Fine-tuning for LLMs via ZOO-based Gradient Correction
by: Sun, He, et al.
Published: (2026) -
MemKD: Memory-Discrepancy Knowledge Distillation for Efficient Time Series Classification
by: Udayangani, Nilushika, et al.
Published: (2026) -
BicKD: Bilateral Contrastive Knowledge Distillation
by: Zhu, Jiangnan, et al.
Published: (2026) -
SFedHIFI: Fire Rate-Based Heterogeneous Information Fusion for Spiking Federated Learning
by: Tao, Ran, et al.
Published: (2026) -
HPM-KD: Hierarchical Progressive Multi-Teacher Framework for Knowledge Distillation and Efficient Model Compression
by: Haase, Gustavo Coelho, et al.
Published: (2025)