Copertina

Retrieval-Augmented Mixture of LoRA Experts for Uploadable Machine Learning

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Zhao, Ziyu, Gan, Leilei, Wang, Guoyin, Hu, Yuwei, Shen, Tao, Yang, Hongxia, Kuang, Kun, Wu, Fei
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

LoraRetriever: Input-Aware LoRA Retrieval and Composition for Mixed Tasks in the Wild
di: Zhao, Ziyu, et al.
Pubblicazione: (2024)

Each Rank Could be an Expert: Single-Ranked Mixture of Experts LoRA for Multi-Task Learning
di: Zhao, Ziyu, et al.
Pubblicazione: (2025)

Merging LoRAs like Playing LEGO: Pushing the Modularity of LoRA to Extremes Through Rank-Wise Clustering
di: Zhao, Ziyu, et al.
Pubblicazione: (2024)

Mixture of LoRA Experts
di: Wu, Xun, et al.
Pubblicazione: (2024)

TAS-LoRA: Transformer Architecture Search with Mixture-of-LoRA Experts
di: Jeon, Jeimin, et al.
Pubblicazione: (2026)

SAMoRA: Semantic-Aware Mixture of LoRA Experts for Task-Adaptive Learning
di: Shi, Boyan, et al.
Pubblicazione: (2026)

DR-LoRA: Dynamic Rank LoRA for Fine-Tuning Mixture-of-Experts Models
di: Deng, Guanzhi, et al.
Pubblicazione: (2026)

LD-MoLE: Learnable Dynamic Routing for Mixture of LoRA Experts
di: Zhuang, Yuan, et al.
Pubblicazione: (2025)

Adaptive Shared Experts with LoRA-Based Mixture of Experts for Multi-Task Learning
di: Yang, Minghao, et al.
Pubblicazione: (2025)

Make LoRA Great Again: Boosting LoRA with Adaptive Singular Values and Mixture-of-Experts Optimization Alignment
di: Fan, Chenghao, et al.
Pubblicazione: (2025)

SAML: Speaker Adaptive Mixture of LoRA Experts for End-to-End ASR
di: Zhao, Qiuming, et al.
Pubblicazione: (2024)

CE-LoRA: Computation-Efficient LoRA Fine-Tuning for Language Models
di: Chen, Guanduo, et al.
Pubblicazione: (2025)

MixLoRA-DSI: Dynamically Expandable Mixture-of-LoRA Experts for Rehearsal-Free Generative Retrieval over Dynamic Corpora
di: Huynh, Tuan-Luc, et al.
Pubblicazione: (2025)

MixLoRA: Enhancing Large Language Models Fine-Tuning with LoRA-based Mixture of Experts
di: Li, Dengchun, et al.
Pubblicazione: (2024)

LoRA-Mixer: Coordinate Modular LoRA Experts Through Serial Attention Routing
di: Li, Wenbing, et al.
Pubblicazione: (2025)

MOLM: Mixture of LoRA Markers
di: Fares, Samar, et al.
Pubblicazione: (2025)

Multimodal Instruction Tuning with Conditional Mixture of LoRA
di: Shen, Ying, et al.
Pubblicazione: (2024)

Mixture of Cluster-conditional LoRA Experts for Vision-language Instruction Tuning
di: Gou, Yunhao, et al.
Pubblicazione: (2023)

Dynamic Mixture of Curriculum LoRA Experts for Continual Multimodal Instruction Tuning
di: Ge, Chendi, et al.
Pubblicazione: (2025)

Hierarchical-Task-Aware Multi-modal Mixture of Incremental LoRA Experts for Embodied Continual Learning
di: Jia, Ziqi, et al.
Pubblicazione: (2025)

A Novel Trustworthy Video Summarization Algorithm Through a Mixture of LoRA Experts
di: Du, Wenzhuo, et al.
Pubblicazione: (2025)

AlphaLoRA: Assigning LoRA Experts Based on Layer Training Quality
di: Qing, Peijun, et al.
Pubblicazione: (2024)

Kron-LoRA: Hybrid Kronecker-LoRA Adapters for Scalable, Sustainable Fine-tuning
di: Shen, Yixin
Pubblicazione: (2025)

Mixture of LoRA Experts with Multi-Modal and Multi-Granularity LLM Generative Error Correction for Accented Speech Recognition
di: Mu, Bingshen, et al.
Pubblicazione: (2025)

SC-LoRA: Balancing Efficient Fine-tuning and Knowledge Preservation via Subspace-Constrained LoRA
di: Luo, Minrui, et al.
Pubblicazione: (2025)

Mixture of LoRA Experts for Low-Resourced Multi-Accent Automatic Speech Recognition
di: Bagat, Raphaël, et al.
Pubblicazione: (2025)

AT-MoE: Adaptive Task-planning Mixture of Experts via LoRA Approach
di: Li, Xurui, et al.
Pubblicazione: (2024)

R-LoRA: Randomized Multi-Head LoRA for Efficient Multi-Task Learning
di: Liu, Jinda, et al.
Pubblicazione: (2025)

MoLEx: Mixture of LoRA Experts in Speech Self-Supervised Models for Audio Deepfake Detection
di: Pan, Zihan, et al.
Pubblicazione: (2025)

Higher Layers Need More LoRA Experts
di: Gao, Chongyang, et al.
Pubblicazione: (2024)

MoRAL: MoE Augmented LoRA for LLMs' Lifelong Learning
di: Yang, Shu, et al.
Pubblicazione: (2024)

S-LoRA: Serving Thousands of Concurrent LoRA Adapters
di: Sheng, Ying, et al.
Pubblicazione: (2023)

LoRA-drop: Efficient LoRA Parameter Pruning based on Output Evaluation
di: Zhou, Hongyun, et al.
Pubblicazione: (2024)

Improving LoRA with Variational Learning
di: Cong, Bai, et al.
Pubblicazione: (2025)

Sci-LoRA: Mixture of Scientific LoRAs for Cross-Domain Lay Paraphrasing
di: Cheng, Ming, et al.
Pubblicazione: (2025)

SCALE-LoRA: Auditing Post-Retrieval LoRA Composition with Residual Merging and View Reliability
di: Zhou, Shuaipeng, et al.
Pubblicazione: (2026)

SHE-LoRA: Selective Homomorphic Encryption for Federated Tuning with Heterogeneous LoRA
di: Liu, Jianmin, et al.
Pubblicazione: (2025)

CoMoL: Efficient Mixture of LoRA Experts via Dynamic Core Space Merging
di: Cao, Jie, et al.
Pubblicazione: (2026)

HDMoLE: Mixture of LoRA Experts with Hierarchical Routing and Dynamic Thresholds for Fine-Tuning LLM-based ASR Models
di: Mu, Bingshen, et al.
Pubblicazione: (2024)

Customize Segment Anything Model for Multi-Modal Semantic Segmentation with Mixture of LoRA Experts
di: Zhu, Chenyang, et al.
Pubblicazione: (2024)