Copertina

MoDE: Effective Multi-task Parameter Efficient Fine-Tuning with a Mixture of Dyadic Experts

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Ning, Lin, Lara, Harsh, Guo, Meiqi, Rastogi, Abhinav
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

MoDE: CLIP Data Experts via Clustering
di: Ma, Jiawei, et al.
Pubblicazione: (2024)

Parameter-Efficient Fine-Tuning of LLMs with Mixture of Space Experts
di: Zhang, Buze, et al.
Pubblicazione: (2026)

MoELoRA: Contrastive Learning Guided Mixture of Experts on Parameter-Efficient Fine-Tuning for Large Language Models
di: Luo, Tongxu, et al.
Pubblicazione: (2024)

MoRAgent: Parameter Efficient Agent Tuning with Mixture-of-Roles
di: Han, Jing, et al.
Pubblicazione: (2025)

Parameter-Efficient Routed Fine-Tuning: Mixture-of-Experts Demands Mixture of Adaptation Modules
di: Liu, Yilun, et al.
Pubblicazione: (2025)

CoMoE: Contrastive Representation for Mixture-of-Experts in Parameter-Efficient Fine-tuning
di: Feng, Jinyuan, et al.
Pubblicazione: (2025)

MoA: Heterogeneous Mixture of Adapters for Parameter-Efficient Fine-Tuning of Large Language Models
di: Cao, Jie, et al.
Pubblicazione: (2025)

S'MoRE: Structural Mixture of Residual Experts for Parameter-Efficient LLM Fine-tuning
di: Zeng, Hanqing, et al.
Pubblicazione: (2025)

MoDE: Mixture of Diffusion Experts for Any Occluded Face Recognition
di: Fan, Qiannan, et al.
Pubblicazione: (2025)

Solo Connection: A Parameter Efficient Fine-Tuning Technique for Transformers
di: Pathak, Harsh Nilesh, et al.
Pubblicazione: (2025)

Geo-Expert: Towards Expert-Level Geological Reasoning via Parameter-Efficient Fine-Tuning
di: Guo, Chenyou, et al.
Pubblicazione: (2026)

MoLAE: Mixture of Latent Experts for Parameter-Efficient Language Models
di: Liu, Zehua, et al.
Pubblicazione: (2025)

PT-MoE: An Efficient Finetuning Framework for Integrating Mixture-of-Experts into Prompt Tuning
di: Li, Zongqian, et al.
Pubblicazione: (2025)

Beyond instruction-conditioning, MoTE: Mixture of Task Experts for Multi-task Embedding Models
di: Romero, Miguel, et al.
Pubblicazione: (2025)

AdaMoLE: Fine-Tuning Large Language Models with Adaptive Mixture of Low-Rank Adaptation Experts
di: Liu, Zefang, et al.
Pubblicazione: (2024)

Expert Pyramid Tuning: Efficient Parameter Fine-Tuning for Expertise-Driven Task Allocation
di: Zhang, Jia-Chen, et al.
Pubblicazione: (2026)

MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning
di: Jiang, Ting, et al.
Pubblicazione: (2024)

DynMoLE: Boosting Mixture of LoRA Experts Fine-Tuning with a Hybrid Routing Mechanism
di: Li, Dengchun, et al.
Pubblicazione: (2025)

LiME: Lightweight Mixture of Experts for Efficient Multimodal Multi-task Learning
di: Kowsher, Md, et al.
Pubblicazione: (2026)

MoPE: Mixture of Prompt Experts for Parameter-Efficient and Scalable Multimodal Fusion
di: Jiang, Ruixiang, et al.
Pubblicazione: (2024)

MH-MoE: Multi-Head Mixture-of-Experts
di: Huang, Shaohan, et al.
Pubblicazione: (2024)

MoBiLE: Efficient Mixture-of-Experts Inference on Consumer GPU with Mixture of Big Little Experts
di: Zhao, Yushu, et al.
Pubblicazione: (2025)

MoDE: A Mixture-of-Experts Model with Mutual Distillation among the Experts
di: Xie, Zhitian, et al.
Pubblicazione: (2024)

Pangu Pro MoE: Mixture of Grouped Experts for Efficient Sparsity
di: Tang, Yehui, et al.
Pubblicazione: (2025)

PEMT: Multi-Task Correlation Guided Mixture-of-Experts Enables Parameter-Efficient Transfer Learning
di: Lin, Zhisheng, et al.
Pubblicazione: (2024)

Improve Mathematical Reasoning in Language Models by Automated Process Supervision
di: Luo, Liangchen, et al.
Pubblicazione: (2024)

Parameter-Efficient Fine-Tuning With Adapters
di: Chen, Keyu, et al.
Pubblicazione: (2024)

EvoMoE: Expert Evolution in Mixture of Experts for Multimodal Large Language Models
di: Jing, Linglin, et al.
Pubblicazione: (2025)

MoDEM: Mixture of Domain Expert Models
di: Simonds, Toby, et al.
Pubblicazione: (2024)

Routing-Aligned Fine-Tuning for Multilingual Downstream Tasks in Mixture-of-Experts Models
di: Deng, Guanzhi, et al.
Pubblicazione: (2026)

MLP Fusion: Towards Efficient Fine-tuning of Dense and Mixture-of-Experts Language Models
di: Ai, Mengting, et al.
Pubblicazione: (2023)

An Empirical Study on Parameter-Efficient Fine-Tuning for MultiModal Large Language Models
di: Zhou, Xiongtao, et al.
Pubblicazione: (2024)

Light-PEFT: Lightening Parameter-Efficient Fine-Tuning via Early Pruning
di: Gu, Naibin, et al.
Pubblicazione: (2024)

MoSE: Mixture of Slimmable Experts for Efficient and Adaptive Language Models
di: Tastan, Nurbek, et al.
Pubblicazione: (2026)

When MOE Meets LLMs: Parameter Efficient Fine-tuning for Multi-task Medical Applications
di: Liu, Qidong, et al.
Pubblicazione: (2023)

CoMoL: Efficient Mixture of LoRA Experts via Dynamic Core Space Merging
di: Cao, Jie, et al.
Pubblicazione: (2026)

NeuronMoE: Neuron-Guided Mixture-of-Experts for Efficient Multilingual LLM Extension
di: Li, Rongzhi, et al.
Pubblicazione: (2026)

SIBO: A Simple Booster for Parameter-Efficient Fine-Tuning
di: Wen, Zhihao, et al.
Pubblicazione: (2024)

High-Rank Structured Modulation for Parameter-Efficient Fine-Tuning
di: Liu, Yongkang, et al.
Pubblicazione: (2026)

$\infty$-MoE: Generalizing Mixture of Experts to Infinite Experts
di: Takashiro, Shota, et al.
Pubblicazione: (2026)