Copertina

FedeKD: Energy-Based Gating for Robust Federated Knowledge Distillation under Heterogeneous Settings

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Nguyen, Quang-Huy, Wang, Jiaqi, Ku, Wei-shinn
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Conformalized Neural Networks for Federated Uncertainty Quantification under Dual Heterogeneity
di: Nguyen, Quang-Huy, et al.
Pubblicazione: (2026)

FlyKD: Graph Knowledge Distillation on the Fly with Curriculum Learning
di: Ku, Eugene
Pubblicazione: (2024)

Federated-inspired Single-cell Batch Integration in Latent Space
di: Nguyen, Quang-Huy, et al.
Pubblicazione: (2026)

ShiftKD: Benchmarking Knowledge Distillation under Distribution Shift
di: Zhang, Songming, et al.
Pubblicazione: (2023)

BicKD: Bilateral Contrastive Knowledge Distillation
di: Zhu, Jiangnan, et al.
Pubblicazione: (2026)

EVL-ECG: Efficient ECG Interpretation With Multi-Aspect Heterogeneous Knowledge Distillation
di: Hong, Dang Nguyen, et al.
Pubblicazione: (2026)

SFedKD: Sequential Federated Learning with Discrepancy-Aware Multi-Teacher Knowledge Distillation
di: Xu, Haotian, et al.
Pubblicazione: (2025)

RMT-KD: Random Matrix Theoretic Causal Knowledge Distillation
di: Ettori, Davide, et al.
Pubblicazione: (2025)

S^2-KD: Semantic-Spectral Knowledge Distillation Spatiotemporal Forecasting
di: Wang, Wenshuo, et al.
Pubblicazione: (2025)

TuneShift-KD: Knowledge Distillation and Transfer for Fine-tuned Models
di: Guan, Yushi, et al.
Pubblicazione: (2026)

Sigmoid Gating is More Sample Efficient than Softmax Gating in Mixture of Experts
di: Nguyen, Huy, et al.
Pubblicazione: (2024)

Robust Federated Learning on Edge Devices with Domain Heterogeneity
di: Le, Huy Q., et al.
Pubblicazione: (2025)

KD-EKF: Knowledge-Distilled Adaptive Covariance EKF for Robust UWB/PDR Indoor Localization
di: Yoo, Kyeonghyun, et al.
Pubblicazione: (2026)

On DeepSeekMoE: Statistical Benefits of Shared Experts and Normalized Sigmoid Gating
di: Nguyen, Huy, et al.
Pubblicazione: (2025)

Convergence Rates for Softmax Gating Mixture of Experts
di: Nguyen, Huy, et al.
Pubblicazione: (2025)

FedSiKD: Clients Similarity and Knowledge Distillation: Addressing Non-i.i.d. and Constraints in Federated Learning
di: Alsenani, Yousef, et al.
Pubblicazione: (2024)

AuG-KD: Anchor-Based Mixup Generation for Out-of-Domain Knowledge Distillation
di: Tang, Zihao, et al.
Pubblicazione: (2024)

MTL-KD: Multi-Task Learning Via Knowledge Distillation for Generalizable Neural Vehicle Routing Solver
di: Zheng, Yuepeng, et al.
Pubblicazione: (2025)

On Least Square Estimation in Softmax Gating Mixture of Experts
di: Nguyen, Huy, et al.
Pubblicazione: (2024)

Tackling Data Heterogeneity in Federated Learning through Knowledge Distillation with Inequitable Aggregation
di: Ma, Xing
Pubblicazione: (2025)

CLIP-Embed-KD: Computationally Efficient Knowledge Distillation Using Embeddings as Teachers
di: Nair, Lakshmi
Pubblicazione: (2024)

m2mKD: Module-to-Module Knowledge Distillation for Modular Transformers
di: Lo, Ka Man, et al.
Pubblicazione: (2024)

AI-KD: Adversarial learning and Implicit regularization for self-Knowledge Distillation
di: Kim, Hyungmin, et al.
Pubblicazione: (2022)

Enabling Weak Client Participation via On-device Knowledge Distillation in Heterogeneous Federated Learning
di: Lim, Jihyun, et al.
Pubblicazione: (2025)

A General Theory for Softmax Gating Multinomial Logistic Mixture of Experts
di: Nguyen, Huy, et al.
Pubblicazione: (2023)

TabKD: Tabular Knowledge Distillation through Interaction Diversity of Learned Feature Bins
di: Pereira, Shovon Niverd, et al.
Pubblicazione: (2026)

C2G-KD: PCA-Constrained Generator for Data-Free Knowledge Distillation
di: Bengtsson, Magnus, et al.
Pubblicazione: (2025)

AdaKD: Dynamic Knowledge Distillation of ASR models using Adaptive Loss Weighting
di: Ganguly, Shreyan, et al.
Pubblicazione: (2024)

Adv-KD: Adversarial Knowledge Distillation for Faster Diffusion Sampling
di: Mekonnen, Kidist Amde, et al.
Pubblicazione: (2024)

HPM-KD: Hierarchical Progressive Multi-Teacher Framework for Knowledge Distillation and Efficient Model Compression
di: Haase, Gustavo Coelho, et al.
Pubblicazione: (2025)

FedKDX: Federated Learning with Negative Knowledge Distillation for Enhanced Healthcare AI Systems
di: Pham, Quang-Tu, et al.
Pubblicazione: (2026)

Towards Robust Knowledge Removal in Federated Learning with High Data Heterogeneity
di: Santi, Riccardo, et al.
Pubblicazione: (2025)

HFedCKD: Toward Robust Heterogeneous Federated Learning via Data-free Knowledge Distillation and Two-way Contrast
di: Zheng, Yiting, et al.
Pubblicazione: (2025)

MemKD: Memory-Discrepancy Knowledge Distillation for Efficient Time Series Classification
di: Udayangani, Nilushika, et al.
Pubblicazione: (2026)

DeepKD: A Deeply Decoupled and Denoised Knowledge Distillation Trainer
di: Huang, Haiduo, et al.
Pubblicazione: (2025)

Quadratic Gating Mixture of Experts: Statistical Insights into Self-Attention
di: Akbarian, Pedram, et al.
Pubblicazione: (2024)

Towards Robust Federated Multimodal Graph Learning under Modality Heterogeneity
di: Zhang, Sirui, et al.
Pubblicazione: (2026)

Statistical Perspective of Top-K Sparse Softmax Gating Mixture of Experts
di: Nguyen, Huy, et al.
Pubblicazione: (2023)

FedMTFI: Feature Importance Based Optimized Multi Teacher Knowledge Distillation in Heterogeneous Federated Learning Environment
di: Shadin, Nazmus Shakib, et al.
Pubblicazione: (2026)

Improving Pareto Set Learning for Expensive Multi-objective Optimization via Stein Variational Hypernetworks
di: Nguyen, Minh-Duc, et al.
Pubblicazione: (2024)