Copertina

RotMoLE: Enhancing Mixture of Low-Rank Experts through Rotational Gating Mechanism

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Sun, Mengyang, Dou, Maochuan, Feng, Tao, Zhang, Dan, Wang, Yihao, Liu, Junpeng, Zhu, Yifan, Tang, Jie
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Machine Learning Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

A Stronger Mixture of Low-Rank Experts for Fine-Tuning Foundation Models
di: Sun, Mengyang, et al.
Pubblicazione: (2025)

MoLE: Enhancing Human-centric Text-to-image Diffusion via Mixture of Low-rank Experts
di: Zhu, Jie, et al.
Pubblicazione: (2024)

GM-MoE: Low-Light Enhancement with Gated-Mechanism Mixture-of-Experts
di: Liao, Minwen, et al.
Pubblicazione: (2025)

AdaMoLE: Fine-Tuning Large Language Models with Adaptive Mixture of Low-Rank Adaptation Experts
di: Liu, Zefang, et al.
Pubblicazione: (2024)

DynMoLE: Boosting Mixture of LoRA Experts Fine-Tuning with a Hybrid Routing Mechanism
di: Li, Dengchun, et al.
Pubblicazione: (2025)

LeMoLE: LLM-Enhanced Mixture of Linear Experts for Time Series Forecasting
di: Zhang, Lingzheng, et al.
Pubblicazione: (2024)

MoBiLE: Efficient Mixture-of-Experts Inference on Consumer GPU with Mixture of Big Little Experts
di: Zhao, Yushu, et al.
Pubblicazione: (2025)

MoE-I$^2$: Compressing Mixture of Experts Models through Inter-Expert Pruning and Intra-Expert Low-Rank Decomposition
di: Yang, Cheng, et al.
Pubblicazione: (2024)

MoR: Mixture of Ranks for Low-Rank Adaptation Tuning
di: Tang, Chuanyu, et al.
Pubblicazione: (2024)

InstructMoLE: Instruction-Guided Mixture of Low-rank Experts for Multi-Conditional Image Generation
di: Xiao, Jinqi, et al.
Pubblicazione: (2025)

LD-MoLE: Learnable Dynamic Routing for Mixture of LoRA Experts
di: Zhuang, Yuan, et al.
Pubblicazione: (2025)

LightMoE: Reducing Mixture-of-Experts Redundancy through Expert Replacing
di: Hao, Jiawei, et al.
Pubblicazione: (2026)

MoRE: A Mixture of Low-Rank Experts for Adaptive Multi-Task Learning
di: Zhang, Dacao, et al.
Pubblicazione: (2025)

LLaVA-MoLE: Sparse Mixture of LoRA Experts for Mitigating Data Conflicts in Instruction Finetuning MLLMs
di: Chen, Shaoxiang, et al.
Pubblicazione: (2024)

TAG-MoE: Task-Aware Gating for Unified Generative Mixture-of-Experts
di: Xu, Yu, et al.
Pubblicazione: (2026)

GaVaMoE: Gaussian-Variational Gated Mixture of Experts for Explainable Recommendation
di: Tang, Fei, et al.
Pubblicazione: (2024)

MINGLE: Mixture of Null-Space Gated Low-Rank Experts for Test-Time Continual Model Merging
di: Qiu, Zihuan, et al.
Pubblicazione: (2025)

Low-Rank Mixture-of-Experts for Continual Medical Image Segmentation
di: Chen, Qian, et al.
Pubblicazione: (2024)

Multi-Task Dense Prediction via Mixture of Low-Rank Experts
di: Yang, Yuqi, et al.
Pubblicazione: (2024)

L-MoE: End-to-End Training of a Lightweight Mixture of Low-Rank Adaptation Experts
di: Ji, Shihao, et al.
Pubblicazione: (2025)

TeleGate: Whole-Body Humanoid Teleoperation via Gated Expert Selection with Motion Prior
di: Li, Jie, et al.
Pubblicazione: (2026)

PM-MOE: Mixture of Experts on Private Model Parameters for Personalized Federated Learning
di: Feng, Yu, et al.
Pubblicazione: (2025)

SMILE: Zero-Shot Sparse Mixture of Low-Rank Experts Construction From Pre-Trained Foundation Models
di: Tang, Anke, et al.
Pubblicazione: (2024)

MoPEQ: Mixture of Mixed Precision Quantized Experts
di: Chitty-Venkata, Krishna Teja, et al.
Pubblicazione: (2025)

Mixture of Experts for Low-Resource LLMs
di: Joseph, Ori Bar, et al.
Pubblicazione: (2026)

SEER-MoE: Sparse Expert Efficiency through Regularization for Mixture-of-Experts
di: Muzio, Alexandre, et al.
Pubblicazione: (2024)

WaveMoE: A Wavelet-Enhanced Mixture-of-Experts Foundation Model for Time Series Forecasting
di: Wu, Shunyu, et al.
Pubblicazione: (2026)

Each Rank Could be an Expert: Single-Ranked Mixture of Experts LoRA for Multi-Task Learning
di: Zhao, Ziyu, et al.
Pubblicazione: (2025)

MoE++: Accelerating Mixture-of-Experts Methods with Zero-Computation Experts
di: Jin, Peng, et al.
Pubblicazione: (2024)

Confucianism and employee treatment: Evidence from China
di: Xixiong Xu, et al.
Pubblicazione: (2024)

VA-MoE: Variables-Adaptive Mixture of Experts for Incremental Weather Forecasting
di: Chen, Hao, et al.
Pubblicazione: (2024)

One-for-All Does Not Work! Enhancing Vulnerability Detection by Mixture-of-Experts (MoE)
di: Yang, Xu, et al.
Pubblicazione: (2025)

FreqMoE: Enhancing Time Series Forecasting through Frequency Decomposition Mixture of Experts
di: Liu, Ziqi
Pubblicazione: (2025)

Multimodal Mixture of Low-Rank Experts for Sentiment Analysis and Emotion Recognition
di: Zhang, Shuo, et al.
Pubblicazione: (2025)

Mixture of Low-Rank Adapter Experts in Generalizable Audio Deepfake Detection
di: Laakkonen, Janne, et al.
Pubblicazione: (2025)

Bandwidth-Efficient Adaptive Mixture-of-Experts via Low-Rank Compensation
di: Liu, Zhenyu, et al.
Pubblicazione: (2025)

Adaptive Mixture of Low-Rank Experts for Robust Audio Spoofing Detection
di: Chen, Qixian, et al.
Pubblicazione: (2025)

OrdMoE: Preference Alignment via Hierarchical Expert Group Ranking in Multimodal Mixture-of-Experts LLMs
di: Gao, Yuting, et al.
Pubblicazione: (2025)

MoE-Loco: Mixture of Experts for Multitask Locomotion
di: Huang, Runhan, et al.
Pubblicazione: (2025)

ViMoE: An Empirical Study of Designing Vision Mixture-of-Experts
di: Han, Xumeng, et al.
Pubblicazione: (2024)