MixNet: A Runtime Reconfigurable Optical-Electrical Fabric for Distributed Mixture-of-Experts Training
Fuente:
arXiv
Saved in:
| Main Authors: | Liao, Xudong, Sun, Yijun, Tian, Han, Wan, Xinchen, Jin, Yilun, Wang, Zilong, Ren, Zhenghang, Huang, Xinyang, Li, Wenxue, Tse, Kin Fai, Zhong, Zhizhen, Liu, Guyue, Zhang, Ying, Ye, Xiaofeng, Zhang, Yiming, Chen, Kai |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Analyzing Communication Predictability in LLM Training
by: Li, Wenxue, et al.
Published: (2025)
by: Li, Wenxue, et al.
Published: (2025)
MixNet: Efficient Global Modeling for Ultra-High-Definition Image Restoration
by: Wu, Chen, et al.
Published: (2024)
by: Wu, Chen, et al.
Published: (2024)
SA-MixNet: Structure-aware Mixup and Invariance Learning for Scribble-supervised Road Extraction in Remote Sensing Images
by: Feng, Jie, et al.
Published: (2024)
by: Feng, Jie, et al.
Published: (2024)
QoS-Efficient Serving of Multiple Mixture-of-Expert LLMs Using Partial Runtime Reconfiguration
by: Imani, HamidReza, et al.
Published: (2025)
by: Imani, HamidReza, et al.
Published: (2025)
MixNet: Joining Force of Classical and Modern Approaches Toward the Comprehensive Pipeline in Motor Imagery EEG Classification
by: Autthasan, Phairot, et al.
Published: (2024)
by: Autthasan, Phairot, et al.
Published: (2024)
Design and Operation of Shared Machine Learning Clusters on Campus
by: Xu, Kaiqiang, et al.
Published: (2021)
by: Xu, Kaiqiang, et al.
Published: (2021)
Multi-stage Flow Scheduling for LLM Serving
by: Sun, Yijun, et al.
Published: (2026)
by: Sun, Yijun, et al.
Published: (2026)
RaMP: Runtime-Aware Megakernel Polymorphism for Mixture-of-Experts
by: Sharma, Vyom, et al.
Published: (2026)
by: Sharma, Vyom, et al.
Published: (2026)
Routing-Free Mixture-of-Experts
by: Liu, Yilun, et al.
Published: (2026)
by: Liu, Yilun, et al.
Published: (2026)
Understanding and Leveraging the Expert Specialization of Context Faithfulness in Mixture-of-Experts LLMs
by: Bai, Jun, et al.
Published: (2025)
by: Bai, Jun, et al.
Published: (2025)
MoE-Loco: Mixture of Experts for Multitask Locomotion
by: Huang, Runhan, et al.
Published: (2025)
by: Huang, Runhan, et al.
Published: (2025)
Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models
by: Lu, Xudong, et al.
Published: (2024)
by: Lu, Xudong, et al.
Published: (2024)
Intra-Query Runtime Elasticity for Cloud-Native Data Analysis
by: Zhang, Xukang, et al.
Published: (2025)
by: Zhang, Xukang, et al.
Published: (2025)
A Readiness-Driven Runtime for Pipeline-Parallel Training under Runtime Variability
by: Liu, Ruitao, et al.
Published: (2026)
by: Liu, Ruitao, et al.
Published: (2026)
Physical Layer Group Key Generation With the Aid of Reconfigurable Intelligent Surfaces
by: Shahiri, Vahid, et al.
Published: (2025)
by: Shahiri, Vahid, et al.
Published: (2025)
Parameter-Efficient Routed Fine-Tuning: Mixture-of-Experts Demands Mixture of Adaptation Modules
by: Liu, Yilun, et al.
Published: (2025)
by: Liu, Yilun, et al.
Published: (2025)
A Distributed Framework for Compiling and Reasoning with d-DNNF
by: Zhenghang, Xu
Published: (2026)
by: Zhenghang, Xu
Published: (2026)
From Score Distributions to Balance: Plug-and-Play Mixture-of-Experts Routing
by: Shahout, Rana, et al.
Published: (2025)
by: Shahout, Rana, et al.
Published: (2025)
A Pixel-based Reconfigurable Antenna Design for Fluid Antenna Systems
by: Zhang, Jichen, et al.
Published: (2024)
by: Zhang, Jichen, et al.
Published: (2024)
AdaMixT: Adaptive Weighted Mixture of Multi-Scale Expert Transformers for Time Series Forecasting
by: Zhang, Huanyao, et al.
Published: (2025)
by: Zhang, Huanyao, et al.
Published: (2025)
Lifelong Knowledge Editing for Vision Language Models with Low-Rank Mixture-of-Experts
by: Chen, Qizhou, et al.
Published: (2024)
by: Chen, Qizhou, et al.
Published: (2024)
MoPEQ: Mixture of Mixed Precision Quantized Experts
by: Chitty-Venkata, Krishna Teja, et al.
Published: (2025)
by: Chitty-Venkata, Krishna Teja, et al.
Published: (2025)
MoE-SpeQ: Speculative Quantized Decoding with Proactive Expert Prefetching and Offloading for Mixture-of-Experts
by: Wang, Wenfeng, et al.
Published: (2025)
by: Wang, Wenfeng, et al.
Published: (2025)
MoMoE: Mixture of Moderation Experts Framework for AI-Assisted Online Governance
by: Goyal, Agam, et al.
Published: (2025)
by: Goyal, Agam, et al.
Published: (2025)
Inference in Coarsened Time Series via Generalized Method of Moments
by: Man Fai Ip, et al.
Published: (2024)
by: Man Fai Ip, et al.
Published: (2024)
BrainNet-MoE: Brain-Inspired Mixture-of-Experts Learning for Neurological Disease Identification
by: Zhang, Jing, et al.
Published: (2025)
by: Zhang, Jing, et al.
Published: (2025)
Branch-Train-MiX: Mixing Expert LLMs into a Mixture-of-Experts LLM
by: Sukhbaatar, Sainbayar, et al.
Published: (2024)
by: Sukhbaatar, Sainbayar, et al.
Published: (2024)
PERFT: Parameter-Efficient Routed Fine-Tuning for Mixture-of-Expert Model
by: Liu, Yilun, et al.
Published: (2024)
by: Liu, Yilun, et al.
Published: (2024)
Mixed Effects Mixture of Experts: Modeling Double Heterogeneous Trajectories
by: Yue, Xinkai, et al.
Published: (2026)
by: Yue, Xinkai, et al.
Published: (2026)
Dynamic Data Mixing Maximizes Instruction Tuning for Mixture-of-Experts
by: Zhu, Tong, et al.
Published: (2024)
by: Zhu, Tong, et al.
Published: (2024)
LLMs as Firmware Experts: A Runtime-Grown Tree-of-Agents Framework
by: Zhang, Xiangrui, et al.
Published: (2025)
by: Zhang, Xiangrui, et al.
Published: (2025)
Biblical Narrative Mediation: Toward a Theological Reconfiguration of Conflict, Identity, and Reconciliation
by: Caleb Ka Fai, Cheng
Published: (2026)
by: Caleb Ka Fai, Cheng
Published: (2026)
MP-ISMoE: Mixed-Precision Interactive Side Mixture-of-Experts for Efficient Transfer Learning
by: Zhang, Yutong, et al.
Published: (2026)
by: Zhang, Yutong, et al.
Published: (2026)
SEUF: Is Unlearning One Expert Enough for Mixture-of-Experts LLMs?
by: Zhuang, Haomin, et al.
Published: (2024)
by: Zhuang, Haomin, et al.
Published: (2024)
Cross-Stage Attention Multi-Expert Network for Radiologist-Inspired Breast Ultrasound Diagnosis
by: Zhai, Xinyang, et al.
Published: (2026)
by: Zhai, Xinyang, et al.
Published: (2026)
Parameter Efficient Adaptation for Image Restoration with Heterogeneous Mixture-of-Experts
by: Guo, Hang, et al.
Published: (2023)
by: Guo, Hang, et al.
Published: (2023)
Asymptotic theory of $C$-pseudo-cones
by: Wang, Xudong, et al.
Published: (2024)
by: Wang, Xudong, et al.
Published: (2024)
Dynamic Expert Quantization for Scalable Mixture-of-Experts Inference
by: Chu, Kexin, et al.
Published: (2025)
by: Chu, Kexin, et al.
Published: (2025)
MoST: Mixing Speech and Text with Modality-Aware Mixture of Experts
by: Lou, Yuxuan, et al.
Published: (2026)
by: Lou, Yuxuan, et al.
Published: (2026)
Fabrication of a Lipopolysaccharide‐Targeting Peptide‐Based Colloid for Alleviating Carbapenem‐Resistant Enterobacteriaceae‐Induced Cutaneous Infection
by: Ping Zeng, et al.
Published: (2025)
by: Ping Zeng, et al.
Published: (2025)
Similar Items
-
Analyzing Communication Predictability in LLM Training
by: Li, Wenxue, et al.
Published: (2025) -
MixNet: Efficient Global Modeling for Ultra-High-Definition Image Restoration
by: Wu, Chen, et al.
Published: (2024) -
SA-MixNet: Structure-aware Mixup and Invariance Learning for Scribble-supervised Road Extraction in Remote Sensing Images
by: Feng, Jie, et al.
Published: (2024) -
QoS-Efficient Serving of Multiple Mixture-of-Expert LLMs Using Partial Runtime Reconfiguration
by: Imani, HamidReza, et al.
Published: (2025) -
MixNet: Joining Force of Classical and Modern Approaches Toward the Comprehensive Pipeline in Motor Imagery EEG Classification
by: Autthasan, Phairot, et al.
Published: (2024)