Image de couverture de livre

Layer-wise LoRA fine-tuning: a similarity metric approach

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Ogawa, Keith Ando, Yamamoto, Bruno Lopes, de Alcantara, Lucas Lauton, Pellicer, Lucas, Costa, Rosimeire Pereira, Bollis, Edson, Costa, Anna Helena Reali, Jordao, Artur
Format:	Preprint
Publié:	2026
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Technical Report on Text Dataset Distillation
par: Ogawa, Keith Ando, et autres
Publié: (2025)

Compressing LLMs with MoP: Mixture of Pruners
par: Yamamoto, Bruno Lopes, et autres
Publié: (2026)

Efficient LLMs with AMP: Attention Heads and MLP Pruning
par: Mugnaini, Leandro Giusti, et autres
Publié: (2025)

Effective Layer Pruning Through Similarity Metric Perspective
par: Pons, Ian, et autres
Publié: (2024)

The Virtues of Brevity: Avoid Overthinking in Parallel Test-Time Reasoning
par: Dinardi, Raul Cavalcante, et autres
Publié: (2025)

Uncertainty quantification in fine-tuned LLMs using LoRA ensembles
par: Balabanov, Oleksandr, et autres
Publié: (2024)

LoRA-BAM: Input Filtering for Fine-tuned LLMs via Boxed Abstraction Monitors over LoRA Layers
par: Wu, Changshun, et autres
Publié: (2025)

One Period to Rule Them All: Identifying Critical Learning Periods in Deep Networks
par: Fukase, Vinicius Yuiti, et autres
Publié: (2025)

Relaxed Recursive Transformers: Effective Parameter Sharing with Layer-wise LoRA
par: Bae, Sangmin, et autres
Publié: (2024)

Layer Pruning with Consensus: A Triple-Win Solution
par: Mugnaini, Leandro Giusti, et autres
Publié: (2024)

Kron-LoRA: Hybrid Kronecker-LoRA Adapters for Scalable, Sustainable Fine-tuning
par: Shen, Yixin
Publié: (2025)

Improving Fairness in LLMs Through Testing-Time Adversaries
par: Gregio, Isabela Pereira, et autres
Publié: (2025)

LoRA-Leak: Membership Inference Attacks Against LoRA Fine-tuned Language Models
par: Ran, Delong, et autres
Publié: (2025)

Realistic Market Impact Modeling for Reinforcement Learning Trading Environments
par: Abbade, Lucas Riera, et autres
Publié: (2026)

Block-wise LoRA: Revisiting Fine-grained LoRA for Effective Personalization and Stylization in Text-to-Image Generation
par: Li, Likun, et autres
Publié: (2024)

Pruning Everything, Everywhere, All at Once
par: Nascimento, Gustavo Henrique do, et autres
Publié: (2025)

SC-LoRA: Balancing Efficient Fine-tuning and Knowledge Preservation via Subspace-Constrained LoRA
par: Luo, Minrui, et autres
Publié: (2025)

GeLoRA: Geometric Adaptive Ranks For Efficient LoRA Fine-tuning
par: Ed-dib, Abdessalam, et autres
Publié: (2024)

Activated LoRA: Fine-tuned LLMs for Intrinsics
par: Greenewald, Kristjan, et autres
Publié: (2025)

LoRA-fine-tuned Large Vision Models for Automated Assessment of Post-SBRT Lung Injury
par: Bolhassani, M., et autres
Publié: (2025)

FedQuad: Adaptive Layer-wise LoRA Deployment and Activation Quantization for Federated Fine-Tuning
par: Li, Rukuo, et autres
Publié: (2025)

S-LoRA: Serving Thousands of Concurrent LoRA Adapters
par: Sheng, Ying, et autres
Publié: (2023)

Customizing Language Models with Instance-wise LoRA for Sequential Recommendation
par: Kong, Xiaoyu, et autres
Publié: (2024)

LoRA vs Full Fine-tuning: An Illusion of Equivalence
par: Shuttleworth, Reece, et autres
Publié: (2024)

An empirical study of LoRA-based fine-tuning of large language models for automated test case generation
par: Moradi, Milad, et autres
Publié: (2026)

AlphaLoRA: Assigning LoRA Experts Based on Layer Training Quality
par: Qing, Peijun, et autres
Publié: (2024)

Run LoRA Run: Faster and Lighter LoRA Implementations
par: Cherniuk, Daria, et autres
Publié: (2023)

Dual LoRA: Enhancing LoRA with Magnitude and Direction Updates
par: Xu, Yixing, et autres
Publié: (2025)

Higher Layers Need More LoRA Experts
par: Gao, Chongyang, et autres
Publié: (2024)

Heterogeneous LoRA for Federated Fine-tuning of On-Device Foundation Models
par: Cho, Yae Jee, et autres
Publié: (2024)

LoRA as Oracle
par: Arazzi, Marco, et autres
Publié: (2026)

Vision as LoRA
par: Wang, Han, et autres
Publié: (2025)

FedLoDrop: Federated LoRA with Dropout for Generalized LLM Fine-tuning
par: Xie, Sijing, et autres
Publié: (2025)

FedRot-LoRA: Mitigating Rotational Misalignment in Federated LoRA
par: Zhang, Haoran, et autres
Publié: (2026)

LoRA-Drop: Temporal LoRA Decoding for Efficient LLM Inference
par: Rajabzadeh, Hossein, et autres
Publié: (2026)

TAS-LoRA: Transformer Architecture Search with Mixture-of-LoRA Experts
par: Jeon, Jeimin, et autres
Publié: (2026)

LoRA on the Go: Instance-level Dynamic LoRA Selection and Merging
par: Lee, Seungeon, et autres
Publié: (2025)

Developing an ESG-Oriented Large Language Model through ESG Practices
par: Assis, Gabriel, et autres
Publié: (2026)

ALTO: Adaptive LoRA Tuning and Orchestration for Heterogeneous LoRA Training Workloads
par: Zuo, Jingwei, et autres
Publié: (2026)

LoRA-FAIR: Federated LoRA Fine-Tuning with Aggregation and Initialization Refinement
par: Bian, Jieming, et autres
Publié: (2024)