Image de couverture de livre

MoSLD: An Extremely Parameter-Efficient Mixture-of-Shared LoRAs for Multi-Task Learning

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Zhao, Lulu, Zeng, Weihao, Shi, Xiaofeng, Zhou, Hua
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning Artificial Intelligence Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Mixture-of-LoRAs: An Efficient Multitask Tuning for Large Language Models
par: Feng, Wenfeng, et autres
Publié: (2024)

Rethinking Parameter Sharing for LLM Fine-Tuning with Multiple LoRAs
par: Ban, Hao, et autres
Publié: (2025)

CareBot: A Pioneering Full-Process Open-Source Medical Language Model
par: Zhao, Lulu, et autres
Publié: (2024)

Merging LoRAs like Playing LEGO: Pushing the Modularity of LoRA to Extremes Through Rank-Wise Clustering
par: Zhao, Ziyu, et autres
Publié: (2024)

Aqulia-Med LLM: Pioneering Full-Process Open-Source Medical Language Models
par: Zhao, Lulu, et autres
Publié: (2024)

SAMoRA: Semantic-Aware Mixture of LoRA Experts for Task-Adaptive Learning
par: Shi, Boyan, et autres
Publié: (2026)

Position: Pause Recycling LoRAs and Prioritize Mechanisms to Uncover Limits and Effectiveness
par: Chen, Mei-Yen, et autres
Publié: (2025)

LD-MoLE: Learnable Dynamic Routing for Mixture of LoRA Experts
par: Zhuang, Yuan, et autres
Publié: (2025)

Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAs
par: Microsoft, et autres
Publié: (2025)

Towards Specialized Generalists: A Multi-Task MoE-LoRA Framework for Domain-Specific LLM Adaptation
par: Yang, Yuxin, et autres
Publié: (2026)

DR-LoRA: Dynamic Rank LoRA for Fine-Tuning Mixture-of-Experts Models
par: Deng, Guanzhi, et autres
Publié: (2026)

MoRAL: MoE Augmented LoRA for LLMs' Lifelong Learning
par: Yang, Shu, et autres
Publié: (2024)

Disentangling Task Conflicts in Multi-Task LoRA via Orthogonal Gradient Projection
par: Yang, Ziyu, et autres
Publié: (2026)

LoRA-XS: Low-Rank Adaptation with Extremely Small Number of Parameters
par: Bałazy, Klaudia, et autres
Publié: (2024)

Align, Don't Divide: Revisiting the LoRA Architecture in Multi-Task Learning
par: Liu, Jinda, et autres
Publié: (2025)

MoDULA: Mixture of Domain-Specific and Universal LoRA for Multi-Task Learning
par: Ma, Yufei, et autres
Publié: (2024)

MTL-LoRA: Low-Rank Adaptation for Multi-Task Learning
par: Yang, Yaming, et autres
Publié: (2024)

DynMoLE: Boosting Mixture of LoRA Experts Fine-Tuning with a Hybrid Routing Mechanism
par: Li, Dengchun, et autres
Publié: (2025)

MiSS: Revisiting the Trade-off in LoRA with an Efficient Shard-Sharing Structure
par: Kang, Jiale, et autres
Publié: (2024)

HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning
par: Tian, Chunlin, et autres
Publié: (2024)

ORAL: Prompting Your Large-Scale LoRAs via Conditional Recurrent Diffusion
par: Khan, Rana Muhammad Shahroz, et autres
Publié: (2025)

Learning Attentional Mixture of LoRAs for Language Model Continual Learning
par: Liu, Jialin, et autres
Publié: (2024)

LoRA-Whisper: Parameter-Efficient and Extensible Multilingual ASR
par: Song, Zheshu, et autres
Publié: (2024)

Adaptive Shared Experts with LoRA-Based Mixture of Experts for Multi-Task Learning
par: Yang, Minghao, et autres
Publié: (2025)

LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition
par: Huang, Chengsong, et autres
Publié: (2023)

DLP-LoRA: Efficient Task-Specific LoRA Fusion with a Dynamic, Lightweight Plugin for Large Language Models
par: Zhang, Yuxuan, et autres
Publié: (2024)

Sci-LoRA: Mixture of Scientific LoRAs for Cross-Domain Lay Paraphrasing
par: Cheng, Ming, et autres
Publié: (2025)

LoRA Soups: Merging LoRAs for Practical Skill Composition Tasks
par: Prabhakar, Akshara, et autres
Publié: (2024)

LoRATK: LoRA Once, Backdoor Everywhere in the Share-and-Play Ecosystem
par: Liu, Hongyi, et autres
Publié: (2024)

R-LoRA: Randomized Multi-Head LoRA for Efficient Multi-Task Learning
par: Liu, Jinda, et autres
Publié: (2025)

ShareLoRA: Parameter Efficient and Robust Large Language Model Fine-tuning via Shared Low-Rank Adaptation
par: Song, Yurun, et autres
Publié: (2024)

ELDER: Enhancing Lifelong Model Editing with Mixture-of-LoRA
par: Li, Jiaang, et autres
Publié: (2024)

TT-LoRA MoE: Unifying Parameter-Efficient Fine-Tuning and Sparse Mixture-of-Experts
par: Kunwar, Pradip, et autres
Publié: (2025)

CARLoS: Retrieval via Concise Assessment Representation of LoRAs at Scale
par: Sarfaty, Shahar, et autres
Publié: (2025)

MixLoRA: Enhancing Large Language Models Fine-Tuning with LoRA-based Mixture of Experts
par: Li, Dengchun, et autres
Publié: (2024)

Rank-1 LoRAs Encode Interpretable Reasoning Signals
par: Ward, Jake, et autres
Publié: (2025)

LoraRetriever: Input-Aware LoRA Retrieval and Composition for Mixed Tasks in the Wild
par: Zhao, Ziyu, et autres
Publié: (2024)

STAR: Constraint LoRA with Dynamic Active Learning for Data-Efficient Fine-Tuning of Large Language Models
par: Zhang, Linhai, et autres
Publié: (2024)

LoRA-Guard: Parameter-Efficient Guardrail Adaptation for Content Moderation of Large Language Models
par: Elesedy, Hayder, et autres
Publié: (2024)

KD-LoRA: A Hybrid Approach to Efficient Fine-Tuning with LoRA and Knowledge Distillation
par: Azimi, Rambod, et autres
Publié: (2024)