Cover Image

DeepFusion: Accelerating MoE Training via Federated Knowledge Distillation from Heterogeneous Edge Devices

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Li, Songyuan, Hu, Jia, Abdelmoniem, Ahmed M., Min, Geyong, Huang, Haojun, Huang, Jiwei
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence Multiagent Systems
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Incentivizing Multi-Tenant Split Federated Learning for Foundation Models at the Network Edge
by: Li, Songyuan, et al.
Published: (2025)

Dynamic Pricing for On-Demand DNN Inference in the Edge-AI Market
by: Li, Songyuan, et al.
Published: (2025)

Achieving Equilibrium under Utility Heterogeneity: An Agent-Attention Framework for Multi-Agent Multi-Objective Reinforcement Learning
by: Li, Zhuhui, et al.
Published: (2025)

FedGUI: Benchmarking Federated GUI Agents across Heterogeneous Platforms, Devices, and Operating Systems
by: Wang, Wenhao, et al.
Published: (2026)

Safe Multi-Agent Deep Reinforcement Learning for Privacy-Aware Edge-Device Collaborative DNN Inference
by: Wang, Hong, et al.
Published: (2026)

Tapas Are Free! Training-Free Adaptation of Programmatic Agents via LLM-Guided Program Synthesis in Dynamic Environments
by: Hu, Jinwei, et al.
Published: (2025)

FedHPD: Heterogeneous Federated Reinforcement Learning via Policy Distillation
by: Jiang, Wenzheng, et al.
Published: (2025)

Exact and Approximate Heterogeneous Bayesian Decentralized Data Fusion
by: Dagan, Ofer, et al.
Published: (2021)

Heterogeneous Value Decomposition Policy Fusion for Multi-Agent Cooperation
by: Wang, Siying, et al.
Published: (2025)

Multi Agent based Medical Assistant for Edge Devices
by: Gawade, Sakharam, et al.
Published: (2025)

SC-MAS: Constructing Cost-Efficient Multi-Agent Systems with Edge-Level Heterogeneous Collaboration
by: Zhao, Di, et al.
Published: (2026)

UAV-Assisted Multi-Task Federated Learning with Task Knowledge Sharing
by: Yang, Yubo, et al.
Published: (2025)

Heterogeneity in Multi-Agent Reinforcement Learning
by: Hu, Tianyi, et al.
Published: (2025)

Autonomous Synchronization of Discrete-Time Heterogeneous Multiagent Systems
by: Hu, Wei, et al.
Published: (2026)

Task-Driven Co-Design of Heterogeneous Multi-Robot Systems
by: Stralz, Maximilian, et al.
Published: (2026)

DCMAC: Demand-aware Customized Multi-Agent Communication via Upper Bound Training
by: Huo, Dongkun, et al.
Published: (2024)

Heterogeneous RBCs via Deep Multi-Agent Reinforcement Learning
by: Gabriele, Federico, et al.
Published: (2025)

Fault Tolerant Multi-Agent Learning with Adversarial Budget Constraints
by: Mguni, David, et al.
Published: (2025)

CogDrive: Cognition-Driven Multimodal Prediction-Planning Fusion for Safe Autonomy
by: Huang, Heye, et al.
Published: (2025)

A Learning Framework For Cooperative Collision Avoidance of UAV Swarms Leveraging Domain Knowledge
by: Huang, Shuangyao, et al.
Published: (2025)

CataractSurg-80K: Knowledge-Driven Benchmarking for Structured Reasoning in Ophthalmic Surgery Planning
by: Meng, Yang, et al.
Published: (2025)

MAS-on-the-Fly: Dynamic Adaptation of LLM-based Multi-Agent Systems at Test Time
by: Liu, Guangyi, et al.
Published: (2026)

Agentic Federated Learning: The Future of Distributed Training Orchestration
by: Jarczewski, Rafael O., et al.
Published: (2026)

Breaking the Pre-Planning Barrier: Adaptive Real-Time Coordination of Heterogeneous UAVs
by: Hu, Yuhan, et al.
Published: (2025)

Generalized Mission Planning for Heterogeneous Multi-Robot Teams via LLM-constructed Hierarchical Trees
by: Gupta, Piyush, et al.
Published: (2025)

Towards Robust Spiking Neural Networks:Mitigating Heterogeneous Training Vulnerability via Dominant Eigencomponent Projection
by: Zhang, Desong, et al.
Published: (2025)

Behavior Modeling for Training-free Building of Private Domain Multi Agent System
by: Cho, Won Ik, et al.
Published: (2025)

Discrete GCBF Proximal Policy Optimization for Multi-agent Safe Optimal Control
by: Zhang, Songyuan, et al.
Published: (2025)

MMCD: Multi-Modal Collaborative Decision-Making for Connected Autonomy with Knowledge Distillation
by: Liu, Rui, et al.
Published: (2025)

Generalization of Heterogeneous Multi-Robot Policies via Awareness and Communication of Capabilities
by: Howell, Pierce, et al.
Published: (2024)

BootstrapAgent: Distilling Repository Setup into Reusable Agent Knowledge
by: Fu, Sihan, et al.
Published: (2026)

Causal Influence in Federated Edge Inference
by: Kayaalp, Mert, et al.
Published: (2024)

Heterogeneous Mixed Traffic Control and Coordination
by: Islam, Iftekharul, et al.
Published: (2024)

MO-MIX: Multi-Objective Multi-Agent Cooperative Decision-Making With Deep Reinforcement Learning
by: Hu, Tianmeng, et al.
Published: (2026)

Federated Gaussian Process Learning via Pseudo-Representations for Large-Scale Multi-Robot Systems
by: Salunkhe, Sanket A., et al.
Published: (2026)

Lying with Truths: Open-Channel Multi-Agent Collusion for Belief Manipulation via Generative Montage
by: Hu, Jinwei, et al.
Published: (2026)

CLUES: Collaborative High-Quality Data Selection for LLMs via Training Dynamics
by: Zhao, Wanru, et al.
Published: (2025)

Natural GaLore: Accelerating GaLore for memory-efficient LLM Training and Fine-tuning
by: Das, Arijit
Published: (2024)

Momentum for the Win: Collaborative Federated Reinforcement Learning across Heterogeneous Environments
by: Wang, Han, et al.
Published: (2024)

PTDE: Personalized Training with Distilled Execution for Multi-Agent Reinforcement Learning
by: Chen, Yiqun, et al.
Published: (2022)