Imagen de Portada

MoRE: A Mixture of Low-Rank Experts for Adaptive Multi-Task Learning

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Zhang, Dacao, Zhang, Kun, Chu, Shimao, Wu, Le, Li, Xin, Wei, Si
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

MoRE-LLM: Mixture of Rule Experts Guided by a Large Language Model
por: Koebler, Alexander, et al.
Publicado: (2025)

Mixture of Robust Experts (MoRE):A Robust Denoising Method towards multiple perturbations
por: Cheng, Hao, et al.
Publicado: (2021)

MoRE-Brain: Routed Mixture of Experts for Interpretable and Generalizable Cross-Subject fMRI Visual Decoding
por: Wei, Yuxiang, et al.
Publicado: (2025)

Each Rank Could be an Expert: Single-Ranked Mixture of Experts LoRA for Multi-Task Learning
por: Zhao, Ziyu, et al.
Publicado: (2025)

MoRE: A Mixture-of-Experts-Based Task-Adaptive End-to-End Network for Multimodal MRI Reconstruction
por: Li, Yuyang, et al.
Publicado: (2026)

MoRE-GNN: Multi-omics Data Integration with a Heterogeneous Graph Autoencoder
por: Wang, Zhiyu, et al.
Publicado: (2025)

MoRE: Batch-Robust Multi-Omics Representations from Frozen Pre-trained Transformers
por: Chen, Audrey Pei-Hsuan
Publicado: (2025)

MoRE: Multi-Modal Contrastive Pre-training with Transformers on X-Rays, ECGs, and Diagnostic Report
por: Thapa, Samrajya, et al.
Publicado: (2024)

Bandwidth-Efficient Adaptive Mixture-of-Experts via Low-Rank Compensation
por: Liu, Zhenyu, et al.
Publicado: (2025)

MoRE: Mixture of Residual Experts for Humanoid Lifelike Gaits Learning on Complex Terrains
por: Wang, Dewei, et al.
Publicado: (2025)

FlexMoRE: A Flexible Mixture of Rank-heterogeneous Experts for Efficient Federatedly-trained Large Language Models
por: Pirchert, Annemette Brok, et al.
Publicado: (2026)

S'MoRE: Structural Mixture of Residual Experts for Parameter-Efficient LLM Fine-tuning
por: Zeng, Hanqing, et al.
Publicado: (2025)

FLAME: Adaptive Mixture-of-Experts for Continual Multimodal Multi-Task Learning
por: Han, Xing, et al.
Publicado: (2026)

MoE-DisCo:Low Economy Cost Training Mixture-of-Experts Models
por: Ye, Xin, et al.
Publicado: (2026)

MoRE: 3D Visual Geometry Reconstruction Meets Mixture-of-Experts
por: Gao, Jingnan, et al.
Publicado: (2025)

RotMoLE: Enhancing Mixture of Low-Rank Experts through Rotational Gating Mechanism
por: Sun, Mengyang, et al.
Publicado: (2026)

MoR: Mixture of Ranks for Low-Rank Adaptation Tuning
por: Tang, Chuanyu, et al.
Publicado: (2024)

Path-Specific Causal Reasoning for Fairness-aware Cognitive Diagnosis
por: Zhang, Dacao, et al.
Publicado: (2024)

GraphMoRE: Mitigating Topological Heterogeneity via Mixture of Riemannian Experts
por: Guo, Zihao, et al.
Publicado: (2024)

MoTE: Mixture of Task-specific Experts for Pre-Trained ModelBased Class-incremental Learning
por: Li, Linjie, et al.
Publicado: (2025)

RepLoRA: Reparameterizing Low-Rank Adaptation via the Perspective of Mixture of Experts
por: Truong, Tuan, et al.
Publicado: (2025)

Adaptive Shared Experts with LoRA-Based Mixture of Experts for Multi-Task Learning
por: Yang, Minghao, et al.
Publicado: (2025)

HELLoRA: Hot Experts Layer-Level Low-Rank Adaptation for Mixture-of-Experts Models
por: Wei, Jia, et al.
Publicado: (2026)

Multi-Task Reinforcement Learning with Mixture of Orthogonal Experts
por: Hendawy, Ahmed, et al.
Publicado: (2023)

ALoRE: Efficient Visual Adaptation via Aggregating Low Rank Experts
por: Du, Sinan, et al.
Publicado: (2024)

MoBE: Mixture-of-Basis-Experts for Compressing MoE-based LLMs
por: Chen, Xiaodong, et al.
Publicado: (2025)

MoS: Unleashing Parameter Efficiency of Low-Rank Adaptation with Mixture of Shards
por: Wang, Sheng, et al.
Publicado: (2024)

AT-MoE: Adaptive Task-planning Mixture of Experts via LoRA Approach
por: Li, Xurui, et al.
Publicado: (2024)

MoE-I$^2$: Compressing Mixture of Experts Models through Inter-Expert Pruning and Intra-Expert Low-Rank Decomposition
por: Yang, Cheng, et al.
Publicado: (2024)

A Stronger Mixture of Low-Rank Experts for Fine-Tuning Foundation Models
por: Sun, Mengyang, et al.
Publicado: (2025)

MiLo: Efficient Quantized MoE Inference with Mixture of Low-Rank Compensators
por: Huang, Beichen, et al.
Publicado: (2025)

L-MoE: End-to-End Training of a Lightweight Mixture of Low-Rank Adaptation Experts
por: Ji, Shihao, et al.
Publicado: (2025)

FLEX-MoE: Federated Mixture-of-Experts with Load-balanced Expert Assignment for Edge Computing
por: Zhang, Boyang, et al.
Publicado: (2025)

MVMoE: Multi-Task Vehicle Routing Solver with Mixture-of-Experts
por: Zhou, Jianan, et al.
Publicado: (2024)

MoDE: A Mixture-of-Experts Model with Mutual Distillation among the Experts
por: Xie, Zhitian, et al.
Publicado: (2024)

AdaMixT: Adaptive Weighted Mixture of Multi-Scale Expert Transformers for Time Series Forecasting
por: Zhang, Huanyao, et al.
Publicado: (2025)

Adaptive Graph Mixture of Residual Experts: Unsupervised Learning on Diverse Graphs with Heterogeneous Specialization
por: Chu, Yunlong, et al.
Publicado: (2025)

Beyond instruction-conditioning, MoTE: Mixture of Task Experts for Multi-task Embedding Models
por: Romero, Miguel, et al.
Publicado: (2025)

DA-MoE: Towards Dynamic Expert Allocation for Mixture-of-Experts Models
por: Aghdam, Maryam Akhavan, et al.
Publicado: (2024)

VA-MoE: Variables-Adaptive Mixture of Experts for Incremental Weather Forecasting
por: Chen, Hao, et al.
Publicado: (2024)