Image de couverture de livre

MoRE: A Mixture of Low-Rank Experts for Adaptive Multi-Task Learning

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Zhang, Dacao, Zhang, Kun, Chu, Shimao, Wu, Le, Li, Xin, Wei, Si
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

MoRE-LLM: Mixture of Rule Experts Guided by a Large Language Model
par: Koebler, Alexander, et autres
Publié: (2025)

Mixture of Robust Experts (MoRE):A Robust Denoising Method towards multiple perturbations
par: Cheng, Hao, et autres
Publié: (2021)

MoRE-Brain: Routed Mixture of Experts for Interpretable and Generalizable Cross-Subject fMRI Visual Decoding
par: Wei, Yuxiang, et autres
Publié: (2025)

Each Rank Could be an Expert: Single-Ranked Mixture of Experts LoRA for Multi-Task Learning
par: Zhao, Ziyu, et autres
Publié: (2025)

MoRE: A Mixture-of-Experts-Based Task-Adaptive End-to-End Network for Multimodal MRI Reconstruction
par: Li, Yuyang, et autres
Publié: (2026)

MoRE-GNN: Multi-omics Data Integration with a Heterogeneous Graph Autoencoder
par: Wang, Zhiyu, et autres
Publié: (2025)

MoRE: Batch-Robust Multi-Omics Representations from Frozen Pre-trained Transformers
par: Chen, Audrey Pei-Hsuan
Publié: (2025)

MoRE: Multi-Modal Contrastive Pre-training with Transformers on X-Rays, ECGs, and Diagnostic Report
par: Thapa, Samrajya, et autres
Publié: (2024)

Bandwidth-Efficient Adaptive Mixture-of-Experts via Low-Rank Compensation
par: Liu, Zhenyu, et autres
Publié: (2025)

MoRE: Mixture of Residual Experts for Humanoid Lifelike Gaits Learning on Complex Terrains
par: Wang, Dewei, et autres
Publié: (2025)

FlexMoRE: A Flexible Mixture of Rank-heterogeneous Experts for Efficient Federatedly-trained Large Language Models
par: Pirchert, Annemette Brok, et autres
Publié: (2026)

S'MoRE: Structural Mixture of Residual Experts for Parameter-Efficient LLM Fine-tuning
par: Zeng, Hanqing, et autres
Publié: (2025)

FLAME: Adaptive Mixture-of-Experts for Continual Multimodal Multi-Task Learning
par: Han, Xing, et autres
Publié: (2026)

MoE-DisCo:Low Economy Cost Training Mixture-of-Experts Models
par: Ye, Xin, et autres
Publié: (2026)

MoRE: 3D Visual Geometry Reconstruction Meets Mixture-of-Experts
par: Gao, Jingnan, et autres
Publié: (2025)

RotMoLE: Enhancing Mixture of Low-Rank Experts through Rotational Gating Mechanism
par: Sun, Mengyang, et autres
Publié: (2026)

MoR: Mixture of Ranks for Low-Rank Adaptation Tuning
par: Tang, Chuanyu, et autres
Publié: (2024)

Path-Specific Causal Reasoning for Fairness-aware Cognitive Diagnosis
par: Zhang, Dacao, et autres
Publié: (2024)

GraphMoRE: Mitigating Topological Heterogeneity via Mixture of Riemannian Experts
par: Guo, Zihao, et autres
Publié: (2024)

MoTE: Mixture of Task-specific Experts for Pre-Trained ModelBased Class-incremental Learning
par: Li, Linjie, et autres
Publié: (2025)

RepLoRA: Reparameterizing Low-Rank Adaptation via the Perspective of Mixture of Experts
par: Truong, Tuan, et autres
Publié: (2025)

Adaptive Shared Experts with LoRA-Based Mixture of Experts for Multi-Task Learning
par: Yang, Minghao, et autres
Publié: (2025)

HELLoRA: Hot Experts Layer-Level Low-Rank Adaptation for Mixture-of-Experts Models
par: Wei, Jia, et autres
Publié: (2026)

Multi-Task Reinforcement Learning with Mixture of Orthogonal Experts
par: Hendawy, Ahmed, et autres
Publié: (2023)

ALoRE: Efficient Visual Adaptation via Aggregating Low Rank Experts
par: Du, Sinan, et autres
Publié: (2024)

MoBE: Mixture-of-Basis-Experts for Compressing MoE-based LLMs
par: Chen, Xiaodong, et autres
Publié: (2025)

MoS: Unleashing Parameter Efficiency of Low-Rank Adaptation with Mixture of Shards
par: Wang, Sheng, et autres
Publié: (2024)

AT-MoE: Adaptive Task-planning Mixture of Experts via LoRA Approach
par: Li, Xurui, et autres
Publié: (2024)

MoE-I$^2$: Compressing Mixture of Experts Models through Inter-Expert Pruning and Intra-Expert Low-Rank Decomposition
par: Yang, Cheng, et autres
Publié: (2024)

A Stronger Mixture of Low-Rank Experts for Fine-Tuning Foundation Models
par: Sun, Mengyang, et autres
Publié: (2025)

MiLo: Efficient Quantized MoE Inference with Mixture of Low-Rank Compensators
par: Huang, Beichen, et autres
Publié: (2025)

L-MoE: End-to-End Training of a Lightweight Mixture of Low-Rank Adaptation Experts
par: Ji, Shihao, et autres
Publié: (2025)

FLEX-MoE: Federated Mixture-of-Experts with Load-balanced Expert Assignment for Edge Computing
par: Zhang, Boyang, et autres
Publié: (2025)

MVMoE: Multi-Task Vehicle Routing Solver with Mixture-of-Experts
par: Zhou, Jianan, et autres
Publié: (2024)

MoDE: A Mixture-of-Experts Model with Mutual Distillation among the Experts
par: Xie, Zhitian, et autres
Publié: (2024)

AdaMixT: Adaptive Weighted Mixture of Multi-Scale Expert Transformers for Time Series Forecasting
par: Zhang, Huanyao, et autres
Publié: (2025)

Adaptive Graph Mixture of Residual Experts: Unsupervised Learning on Diverse Graphs with Heterogeneous Specialization
par: Chu, Yunlong, et autres
Publié: (2025)

Beyond instruction-conditioning, MoTE: Mixture of Task Experts for Multi-task Embedding Models
par: Romero, Miguel, et autres
Publié: (2025)

DA-MoE: Towards Dynamic Expert Allocation for Mixture-of-Experts Models
par: Aghdam, Maryam Akhavan, et autres
Publié: (2024)

VA-MoE: Variables-Adaptive Mixture of Experts for Incremental Weather Forecasting
par: Chen, Hao, et autres
Publié: (2024)