Image de couverture de livre

LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Huang, Chengsong, Liu, Qian, Lin, Bill Yuchen, Pang, Tianyu, Du, Chao, Lin, Min
Format:	Preprint
Publié:	2023
Sujets:	Computation and Language Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

LoraRetriever: Input-Aware LoRA Retrieval and Composition for Mixed Tasks in the Wild
par: Zhao, Ziyu, et autres
Publié: (2024)

LoraMap: Harnessing the Power of LoRA Connections
par: Park, Hyeryun, et autres
Publié: (2024)

LoRA-Flow: Dynamic LoRA Fusion for Large Language Models in Generative Tasks
par: Wang, Hanqing, et autres
Publié: (2024)

LoRA-Drop: Temporal LoRA Decoding for Efficient LLM Inference
par: Rajabzadeh, Hossein, et autres
Publié: (2026)

LoRA-Gen: Specializing Large Language Model via Online LoRA Generation
par: Xiao, Yicheng, et autres
Publié: (2025)

LoRA Soups: Merging LoRAs for Practical Skill Composition Tasks
par: Prabhakar, Akshara, et autres
Publié: (2024)

CA-LoRA: Adapting Existing LoRA for Compressed LLMs to Enable Efficient Multi-Tasking on Personal Devices
par: Zhao, Weilin, et autres
Publié: (2023)

Tied-Lora: Enhancing parameter efficiency of LoRA with weight tying
par: Renduchintala, Adithya, et autres
Publié: (2023)

Dual LoRA: Enhancing LoRA with Magnitude and Direction Updates
par: Xu, Yixing, et autres
Publié: (2025)

DLP-LoRA: Efficient Task-Specific LoRA Fusion with a Dynamic, Lightweight Plugin for Large Language Models
par: Zhang, Yuxuan, et autres
Publié: (2024)

$D^2LoRA$: Data-Driven LoRA Initialization for Low Resource Tasks
par: SeraJ, Javad, et autres
Publié: (2025)

AFA-LoRA: Enabling Non-Linear Adaptations in LoRA with Activation Function Annealing
par: Li, Jiacheng, et autres
Publié: (2025)

LoRA-drop: Efficient LoRA Parameter Pruning based on Output Evaluation
par: Zhou, Hongyun, et autres
Publié: (2024)

LoRA on the Go: Instance-level Dynamic LoRA Selection and Merging
par: Lee, Seungeon, et autres
Publié: (2025)

Can LoRA Fusion Support Cross-Domain Tasks in Cloud-Edge Collaboration?
par: Wang, Yatong, et autres
Publié: (2026)

Multi-LoRA Composition for Image Generation
par: Zhong, Ming, et autres
Publié: (2024)

LoRA-PAR: A Flexible Dual-System LoRA Partitioning Approach to Efficient LLM Fine-Tuning
par: Huang, Yining, et autres
Publié: (2025)

Task-Aware LoRA Adapter Composition via Similarity Retrieval in Vector Databases
par: Adsul, Riya, et autres
Publié: (2026)

DR-LoRA: Dynamic Rank LoRA for Fine-Tuning Mixture-of-Experts Models
par: Deng, Guanzhi, et autres
Publié: (2026)

FIM-LoRA: Task-Informative Rank Allocation for LoRA via Calibration-Time Gradient-Variance Estimation
par: Sathyavageeswaran, Ramakrishnan
Publié: (2026)

CoMoL: Efficient Mixture of LoRA Experts via Dynamic Core Space Merging
par: Cao, Jie, et autres
Publié: (2026)

Vision as LoRA
par: Wang, Han, et autres
Publié: (2025)

Mixture of LoRA Experts
par: Wu, Xun, et autres
Publié: (2024)

Efficient Multilingual ASR Finetuning via LoRA Language Experts
par: Li, Jiahong, et autres
Publié: (2025)

LoRA-FA: Efficient and Effective Low Rank Representation Fine-tuning
par: Zhang, Longteng, et autres
Publié: (2023)

Sci-LoRA: Mixture of Scientific LoRAs for Cross-Domain Lay Paraphrasing
par: Cheng, Ming, et autres
Publié: (2025)

HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning
par: Tian, Chunlin, et autres
Publié: (2024)

KD-LoRA: A Hybrid Approach to Efficient Fine-Tuning with LoRA and Knowledge Distillation
par: Azimi, Rambod, et autres
Publié: (2024)

Neeko: Leveraging Dynamic LoRA for Efficient Multi-Character Role-Playing Agent
par: Yu, Xiaoyan, et autres
Publié: (2024)

Dynamic Adaptation of LoRA Fine-Tuning for Efficient and Task-Specific Optimization of Large Language Models
par: Liao, Xiaoxuan, et autres
Publié: (2025)

LoRA-Augmented Generation (LAG) for Knowledge-Intensive Language Tasks
par: Fleshman, William, et autres
Publié: (2025)

CrossWordBench: Evaluating the Reasoning Capabilities of LLMs and LVLMs with Controllable Puzzle Generation
par: Leng, Jixuan, et autres
Publié: (2025)

The Impact of Initialization on LoRA Finetuning Dynamics
par: Hayou, Soufiane, et autres
Publié: (2024)

In-Context Meta LoRA Generation
par: Shao, Yihua, et autres
Publié: (2025)

Disentangling Task Conflicts in Multi-Task LoRA via Orthogonal Gradient Projection
par: Yang, Ziyu, et autres
Publié: (2026)

Flexi-LoRA with Input-Adaptive Ranks: Efficient Finetuning for Speech and Reasoning Tasks
par: Li, Zongqian, et autres
Publié: (2026)

LUNE: Efficient LLM Unlearning via LoRA Fine-Tuning with Negative Examples
par: Liu, Yezi, et autres
Publié: (2025)

LoRA-Squeeze: Simple and Effective Post-Tuning and In-Tuning Compression of LoRA Modules
par: Vulić, Ivan, et autres
Publié: (2026)

LoRA Done RITE: Robust Invariant Transformation Equilibration for LoRA Optimization
par: Yen, Jui-Nan, et autres
Publié: (2024)

SAMoRA: Semantic-Aware Mixture of LoRA Experts for Task-Adaptive Learning
par: Shi, Boyan, et autres
Publié: (2026)