Imagen de Portada

TreeLoRA: Efficient Continual Learning via Layer-Wise LoRAs Guided by a Hierarchical Gradient-Similarity Tree

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Qian, Yu-Yang, Xu, Yuan-Ze, Zhang, Zhen-Yu, Zhao, Peng, Zhou, Zhi-Hua
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Merging LoRAs like Playing LEGO: Pushing the Modularity of LoRA to Extremes Through Rank-Wise Clustering
por: Zhao, Ziyu, et al.
Publicado: (2024)

K-LoRA: Unlocking Training-Free Fusion of Any Subject and Style LoRAs
por: Ouyang, Ziheng, et al.
Publicado: (2025)

LoRA Soups: Merging LoRAs for Practical Skill Composition Tasks
por: Prabhakar, Akshara, et al.
Publicado: (2024)

Sci-LoRA: Mixture of Scientific LoRAs for Cross-Domain Lay Paraphrasing
por: Cheng, Ming, et al.
Publicado: (2025)

ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAs
por: Shah, Viraj, et al.
Publicado: (2023)

LoRA-drop: Efficient LoRA Parameter Pruning based on Output Evaluation
por: Zhou, Hongyun, et al.
Publicado: (2024)

CE-LoRA: Computation-Efficient LoRA Fine-Tuning for Language Models
por: Chen, Guanduo, et al.
Publicado: (2025)

MoSLD: An Extremely Parameter-Efficient Mixture-of-Shared LoRAs for Multi-Task Learning
por: Zhao, Lulu, et al.
Publicado: (2024)

SCALE-LoRA: Auditing Post-Retrieval LoRA Composition with Residual Merging and View Reliability
por: Zhou, Shuaipeng, et al.
Publicado: (2026)

LoRA.rar: Learning to Merge LoRAs via Hypernetworks for Subject-Style Conditioned Image Generation
por: Shenaj, Donald, et al.
Publicado: (2024)

SC-LoRA: Balancing Efficient Fine-tuning and Knowledge Preservation via Subspace-Constrained LoRA
por: Luo, Minrui, et al.
Publicado: (2025)

Mixture-of-LoRAs: An Efficient Multitask Tuning for Large Language Models
por: Feng, Wenfeng, et al.
Publicado: (2024)

R-LoRA: Randomized Multi-Head LoRA for Efficient Multi-Task Learning
por: Liu, Jinda, et al.
Publicado: (2025)

Aletheia: Gradient-Guided Layer Selection for Efficient LoRA Fine-Tuning Across Architectures
por: Saket, Abdulmalek
Publicado: (2026)

LoRA in LoRA: Towards Parameter-Efficient Architecture Expansion for Continual Visual Instruction Tuning
por: Che, Chang, et al.
Publicado: (2025)

Subject or Style: Adaptive and Training-Free Mixture of LoRAs
por: Zhang, Jia-Chen, et al.
Publicado: (2025)

LoRA-Drop: Temporal LoRA Decoding for Efficient LLM Inference
por: Rajabzadeh, Hossein, et al.
Publicado: (2026)

LoRA-Mixer: Coordinate Modular LoRA Experts Through Serial Attention Routing
por: Li, Wenbing, et al.
Publicado: (2025)

In-Context LoRA for Diffusion Transformers
por: Huang, Lianghua, et al.
Publicado: (2024)

LoRA Done RITE: Robust Invariant Transformation Equilibration for LoRA Optimization
por: Yen, Jui-Nan, et al.
Publicado: (2024)

SHE-LoRA: Selective Homomorphic Encryption for Federated Tuning with Heterogeneous LoRA
por: Liu, Jianmin, et al.
Publicado: (2025)

AlphaLoRA: Assigning LoRA Experts Based on Layer Training Quality
por: Qing, Peijun, et al.
Publicado: (2024)

Efficient Multilingual ASR Finetuning via LoRA Language Experts
por: Li, Jiahong, et al.
Publicado: (2025)

Improving Recursive Transformers with Mixture of LoRAs
por: Nouriborji, Mohammadmahdi, et al.
Publicado: (2025)

qa-FLoRA: Data-free query-adaptive Fusion of LoRAs for LLMs
por: Shukla, Shreya, et al.
Publicado: (2025)

LoRA-GA: Low-Rank Adaptation with Gradient Approximation
por: Wang, Shaowen, et al.
Publicado: (2024)

AC-LoRA: Auto Component LoRA for Personalized Artistic Style Image Generation
por: Cui, Zhipu, et al.
Publicado: (2025)

S-LoRA: Serving Thousands of Concurrent LoRA Adapters
por: Sheng, Ying, et al.
Publicado: (2023)

FIM-LoRA: Task-Informative Rank Allocation for LoRA via Calibration-Time Gradient-Variance Estimation
por: Sathyavageeswaran, Ramakrishnan
Publicado: (2026)

Two Is Better Than One: Rotations Scale LoRAs
por: Guo, Hongcan, et al.
Publicado: (2025)

LoRAGuard: An Effective Black-box Watermarking Approach for LoRAs
por: Lv, Peizhuo, et al.
Publicado: (2025)

Learning Attentional Mixture of LoRAs for Language Model Continual Learning
por: Liu, Jialin, et al.
Publicado: (2024)

A Note on LoRA
por: Fomenko, Vlad, et al.
Publicado: (2024)

Learning in the Fisher Subspace: A Guided Initialization for LoRA Fine-Tuning
por: Feng, Zhi-Quan, et al.
Publicado: (2026)

NP-LoRA: Null Space Projection for Subject-Style LoRA Fusion
por: Chen, Chuheng, et al.
Publicado: (2025)

On the Convergence Rate of LoRA Gradient Descent
por: Mu, Siqiao, et al.
Publicado: (2025)

Hierarchical LoRA MoE for Efficient CTR Model Scaling
por: Zeng, Zhichen, et al.
Publicado: (2025)

ChimeraLoRA: Multi-Head LoRA-Guided Synthetic Datasets
por: Kim, Hoyoung, et al.
Publicado: (2026)

Run LoRA Run: Faster and Lighter LoRA Implementations
por: Cherniuk, Daria, et al.
Publicado: (2023)

Dual LoRA: Enhancing LoRA with Magnitude and Direction Updates
por: Xu, Yixing, et al.
Publicado: (2025)