Imagen de Portada

LoraRetriever: Input-Aware LoRA Retrieval and Composition for Mixed Tasks in the Wild

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Zhao, Ziyu, Gan, Leilei, Wang, Guoyin, Zhou, Wangchunshu, Yang, Hongxia, Kuang, Kun, Wu, Fei
Formato:	Preprint
Publicado:	2024
Materias:	Artificial Intelligence Computation and Language Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Retrieval-Augmented Mixture of LoRA Experts for Uploadable Machine Learning
por: Zhao, Ziyu, et al.
Publicado: (2024)

Task-Aware LoRA Adapter Composition via Similarity Retrieval in Vector Databases
por: Adsul, Riya, et al.
Publicado: (2026)

LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition
por: Huang, Chengsong, et al.
Publicado: (2023)

Merging LoRAs like Playing LEGO: Pushing the Modularity of LoRA to Extremes Through Rank-Wise Clustering
por: Zhao, Ziyu, et al.
Publicado: (2024)

LoraMap: Harnessing the Power of LoRA Connections
por: Park, Hyeryun, et al.
Publicado: (2024)

LoRA Soups: Merging LoRAs for Practical Skill Composition Tasks
por: Prabhakar, Akshara, et al.
Publicado: (2024)

Tied-Lora: Enhancing parameter efficiency of LoRA with weight tying
por: Renduchintala, Adithya, et al.
Publicado: (2023)

Flexi-LoRA with Input-Adaptive Ranks: Efficient Finetuning for Speech and Reasoning Tasks
por: Li, Zongqian, et al.
Publicado: (2026)

SAMoRA: Semantic-Aware Mixture of LoRA Experts for Task-Adaptive Learning
por: Shi, Boyan, et al.
Publicado: (2026)

LoRA-Flow: Dynamic LoRA Fusion for Large Language Models in Generative Tasks
por: Wang, Hanqing, et al.
Publicado: (2024)

$D^2LoRA$: Data-Driven LoRA Initialization for Low Resource Tasks
por: SeraJ, Javad, et al.
Publicado: (2025)

LoRA-drop: Efficient LoRA Parameter Pruning based on Output Evaluation
por: Zhou, Hongyun, et al.
Publicado: (2024)

Disentangling Task Conflicts in Multi-Task LoRA via Orthogonal Gradient Projection
por: Yang, Ziyu, et al.
Publicado: (2026)

CA-LoRA: Adapting Existing LoRA for Compressed LLMs to Enable Efficient Multi-Tasking on Personal Devices
por: Zhao, Weilin, et al.
Publicado: (2023)

MixLoRA-DSI: Dynamically Expandable Mixture-of-LoRA Experts for Rehearsal-Free Generative Retrieval over Dynamic Corpora
por: Huynh, Tuan-Luc, et al.
Publicado: (2025)

SCALE-LoRA: Auditing Post-Retrieval LoRA Composition with Residual Merging and View Reliability
por: Zhou, Shuaipeng, et al.
Publicado: (2026)

Dual LoRA: Enhancing LoRA with Magnitude and Direction Updates
por: Xu, Yixing, et al.
Publicado: (2025)

LoRA-Drop: Temporal LoRA Decoding for Efficient LLM Inference
por: Rajabzadeh, Hossein, et al.
Publicado: (2026)

Mixture of LoRA Experts
por: Wu, Xun, et al.
Publicado: (2024)

QuAILoRA: Quantization-Aware Initialization for LoRA
por: Lawton, Neal, et al.
Publicado: (2024)

LoRA Done RITE: Robust Invariant Transformation Equilibration for LoRA Optimization
por: Yen, Jui-Nan, et al.
Publicado: (2024)

Vision as LoRA
por: Wang, Han, et al.
Publicado: (2025)

FIM-LoRA: Task-Informative Rank Allocation for LoRA via Calibration-Time Gradient-Variance Estimation
por: Sathyavageeswaran, Ramakrishnan
Publicado: (2026)

LoRA on the Go: Instance-level Dynamic LoRA Selection and Merging
por: Lee, Seungeon, et al.
Publicado: (2025)

JORA: JAX Tensor-Parallel LoRA Library for Retrieval Augmented Fine-Tuning
por: Tahir, Anique, et al.
Publicado: (2024)

Fine-tuning Large Language Models for Improving Factuality in Legal Question Answering
por: Hu, Yinghao, et al.
Publicado: (2025)

PeriodicLoRA: Breaking the Low-Rank Bottleneck in LoRA Optimization
por: Meng, Xiangdi, et al.
Publicado: (2024)

Multi-LoRA Composition for Image Generation
por: Zhong, Ming, et al.
Publicado: (2024)

DLP-LoRA: Efficient Task-Specific LoRA Fusion with a Dynamic, Lightweight Plugin for Large Language Models
por: Zhang, Yuxuan, et al.
Publicado: (2024)

AlphaLoRA: Assigning LoRA Experts Based on Layer Training Quality
por: Qing, Peijun, et al.
Publicado: (2024)

Align, Don't Divide: Revisiting the LoRA Architecture in Multi-Task Learning
por: Liu, Jinda, et al.
Publicado: (2025)

AFA-LoRA: Enabling Non-Linear Adaptations in LoRA with Activation Function Annealing
por: Li, Jiacheng, et al.
Publicado: (2025)

LoRA-Gen: Specializing Large Language Model via Online LoRA Generation
por: Xiao, Yicheng, et al.
Publicado: (2025)

DR-LoRA: Dynamic Rank LoRA for Fine-Tuning Mixture-of-Experts Models
por: Deng, Guanzhi, et al.
Publicado: (2026)

LoRA-Squeeze: Simple and Effective Post-Tuning and In-Tuning Compression of LoRA Modules
por: Vulić, Ivan, et al.
Publicado: (2026)

MixLoRA: Enhancing Large Language Models Fine-Tuning with LoRA-based Mixture of Experts
por: Li, Dengchun, et al.
Publicado: (2024)

A Note on LoRA
por: Fomenko, Vlad, et al.
Publicado: (2024)

Make LoRA Great Again: Boosting LoRA with Adaptive Singular Values and Mixture-of-Experts Optimization Alignment
por: Fan, Chenghao, et al.
Publicado: (2025)

Each Rank Could be an Expert: Single-Ranked Mixture of Experts LoRA for Multi-Task Learning
por: Zhao, Ziyu, et al.
Publicado: (2025)

LoRA-Leak: Membership Inference Attacks Against LoRA Fine-tuned Language Models
por: Ran, Delong, et al.
Publicado: (2025)