Copertina

Bandwidth-Efficient Adaptive Mixture-of-Experts via Low-Rank Compensation

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Liu, Zhenyu, Liu, Yunzhen, Fan, Zehao, Gagnon, Garrett, Hou, Yayue, Wu, Nan, Kang, Yangwook, Liu, Liu
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Context-Aware Mixture-of-Experts Inference on CXL-Enabled GPU-NDP Systems
di: Fan, Zehao, et al.
Pubblicazione: (2025)

Sparse Attention Remapping with Clustering for Efficient LLM Decoding on PIM
di: Fan, Zehao, et al.
Pubblicazione: (2025)

Enhance DNN Adversarial Robustness and Efficiency via Injecting Noise to Non-Essential Neurons
di: Liu, Zhenyu, et al.
Pubblicazione: (2024)

TileQ: Efficient Low-Rank Quantization of Mixture-of-Experts with 2D Tiling
di: Gu, Hongyaoxing, et al.
Pubblicazione: (2026)

MoRE: A Mixture of Low-Rank Experts for Adaptive Multi-Task Learning
di: Zhang, Dacao, et al.
Pubblicazione: (2025)

MiLo: Efficient Quantized MoE Inference with Mixture of Low-Rank Compensators
di: Huang, Beichen, et al.
Pubblicazione: (2025)

MoR: Mixture of Ranks for Low-Rank Adaptation Tuning
di: Tang, Chuanyu, et al.
Pubblicazione: (2024)

Accelerating Mixture-of-Expert Inference with Adaptive Expert Split Mechanism
di: Yan, Jiaming, et al.
Pubblicazione: (2025)

Spatial-Temporal Mixture-of-Graph-Experts for Multi-Type Crime Prediction
di: Wu, Ziyang, et al.
Pubblicazione: (2024)

Efficiently Editing Mixture-of-Experts Models with Compressed Experts
di: He, Yifei, et al.
Pubblicazione: (2025)

RepLoRA: Reparameterizing Low-Rank Adaptation via the Perspective of Mixture of Experts
di: Truong, Tuan, et al.
Pubblicazione: (2025)

RotMoLE: Enhancing Mixture of Low-Rank Experts through Rotational Gating Mechanism
di: Sun, Mengyang, et al.
Pubblicazione: (2026)

Dynamic Adaptive Shared Experts with Grouped Multi-Head Attention Mixture of Experts
di: Li, Cheng, et al.
Pubblicazione: (2025)

LAER-MoE: Load-Adaptive Expert Re-layout for Efficient Mixture-of-Experts Training
di: Liu, Xinyi, et al.
Pubblicazione: (2026)

CRAFT: Fine-Grained Cost-Aware Expert Replication For Efficient Mixture-of-Experts Serving
di: Zhao, Adrian, et al.
Pubblicazione: (2026)

Efficient Quantization of Mixture-of-Experts with Theoretical Generalization Guarantees
di: Chowdhury, Mohammed Nowaz Rabbani, et al.
Pubblicazione: (2026)

Efficient Handwriting-Based Alzheimer,s Disease Diagnosis Using a Low-Rank Mixture of Experts Deep Learning Framework
di: Wang, Wu, et al.
Pubblicazione: (2026)

Efficient Low-Tubal-Rank Tensor Estimation via Alternating Preconditioned Gradient Descent
di: Liu, Zhiyu, et al.
Pubblicazione: (2025)

Rank Also Matters: Hierarchical Configuration for Mixture of Adapter Experts in LLM Fine-Tuning
di: Cong, Peizhuang, et al.
Pubblicazione: (2025)

Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients
di: Zhang, Zhenyu, et al.
Pubblicazione: (2024)

Mixture of Low Rank Adaptation with Partial Parameter Sharing for Time Series Forecasting
di: Pan, Licheng, et al.
Pubblicazione: (2025)

Gaussian Process-Gated Hierarchical Mixtures of Experts
di: Liu, Yuhao, et al.
Pubblicazione: (2023)

HELLoRA: Hot Experts Layer-Level Low-Rank Adaptation for Mixture-of-Experts Models
di: Wei, Jia, et al.
Pubblicazione: (2026)

MoLAE: Mixture of Latent Experts for Parameter-Efficient Language Models
di: Liu, Zehua, et al.
Pubblicazione: (2025)

Towards Efficient Pareto Set Approximation via Mixture of Experts Based Model Fusion
di: Tang, Anke, et al.
Pubblicazione: (2024)

MC#: Mixture Compressor for Mixture-of-Experts Large Models
di: Huang, Wei, et al.
Pubblicazione: (2025)

Mixture Compressor for Mixture-of-Experts LLMs Gains More
di: Huang, Wei, et al.
Pubblicazione: (2024)

Maximum Score Routing For Mixture-of-Experts
di: Dong, Bowen, et al.
Pubblicazione: (2025)

A Stronger Mixture of Low-Rank Experts for Fine-Tuning Foundation Models
di: Sun, Mengyang, et al.
Pubblicazione: (2025)

L2R: Low-Rank and Lipschitz-Controlled Routing for Mixture-of-Experts
di: Yang, Minghao, et al.
Pubblicazione: (2026)

Mixture of Length and Pruning Experts for Knowledge Graphs Reasoning
di: Du, Enjun, et al.
Pubblicazione: (2025)

RoME: Domain-Robust Mixture-of-Experts for MILP Solution Prediction across Domains
di: Pu, Tianle, et al.
Pubblicazione: (2025)

MixTTE: Multi-Level Mixture-of-Experts for Scalable and Adaptive Travel Time Estimation
di: Jiang, Wenzhao, et al.
Pubblicazione: (2026)

Mixture-of-Subspaces in Low-Rank Adaptation
di: Wu, Taiqiang, et al.
Pubblicazione: (2024)

Variational Inference, Entropy, and Orthogonality: A Unified Theory of Mixture-of-Experts
di: Su, Ye, et al.
Pubblicazione: (2026)

FreqMoE: Enhancing Time Series Forecasting through Frequency Decomposition Mixture of Experts
di: Liu, Ziqi
Pubblicazione: (2025)

Mixture of Low-Rank Adapter Experts in Generalizable Audio Deepfake Detection
di: Laakkonen, Janne, et al.
Pubblicazione: (2025)

Adaptive Graph Mixture of Residual Experts: Unsupervised Learning on Diverse Graphs with Heterogeneous Specialization
di: Chu, Yunlong, et al.
Pubblicazione: (2025)

Efficient Generalized Low-Rank Tensor Contextual Bandits
di: Yi, Qianxin, et al.
Pubblicazione: (2023)

Mixture of Universal Experts: Scaling Virtual Width via Depth-Width Transformation
di: Chen, Yilong, et al.
Pubblicazione: (2026)