Image de couverture de livre

Understanding LoRA as Knowledge Memory: An Empirical Analysis

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Back, Seungju, Lee, Dongwoo, Kang, Naun, Lee, Taehee, Hong, S. K., Gwon, Youngjune, Ahn, Sungjin
Format:	Preprint
Publié:	2026
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Riemannian Optimization for LoRA on the Stiefel Manifold
par: Park, Juneyoung, et autres
Publié: (2025)

LoRA on the Go: Instance-level Dynamic LoRA Selection and Merging
par: Lee, Seungeon, et autres
Publié: (2025)

Beware of the Batch Size: Hyperparameter Bias in Evaluating LoRA
par: Lee, Sangyoon, et autres
Publié: (2026)

A Note on LoRA
par: Fomenko, Vlad, et autres
Publié: (2024)

S-LoRA: Serving Thousands of Concurrent LoRA Adapters
par: Sheng, Ying, et autres
Publié: (2023)

Run LoRA Run: Faster and Lighter LoRA Implementations
par: Cherniuk, Daria, et autres
Publié: (2023)

SC-LoRA: Balancing Efficient Fine-tuning and Knowledge Preservation via Subspace-Constrained LoRA
par: Luo, Minrui, et autres
Publié: (2025)

RILQ: Rank-Insensitive LoRA-based Quantization Error Compensation for Boosting 2-bit Large Language Model Accuracy
par: Lee, Geonho, et autres
Publié: (2024)

CE-LoRA: Computation-Efficient LoRA Fine-Tuning for Language Models
par: Chen, Guanduo, et autres
Publié: (2025)

LoRA Diffusion: Zero-Shot LoRA Synthesis for Diffusion Model Personalization
par: Smith, Ethan, et autres
Publié: (2024)

KD-LoRA: A Hybrid Approach to Efficient Fine-Tuning with LoRA and Knowledge Distillation
par: Azimi, Rambod, et autres
Publié: (2024)

LoRA Training in the NTK Regime has No Spurious Local Minima
par: Jang, Uijeong, et autres
Publié: (2024)

LoRA-BAM: Input Filtering for Fine-tuned LLMs via Boxed Abstraction Monitors over LoRA Layers
par: Wu, Changshun, et autres
Publié: (2025)

Block-Diagonal LoRA for Eliminating Communication Overhead in Tensor Parallel LoRA Serving
par: Wang, Xinyu, et autres
Publié: (2025)

FedSVD: Adaptive Orthogonalization for Private Federated Learning with LoRA
par: Lee, Seanie, et autres
Publié: (2025)

Convergent Stochastic Training of Attention and Understanding LoRA
par: Sun, Zhengkai, et autres
Publié: (2026)

LoRA-drop: Efficient LoRA Parameter Pruning based on Output Evaluation
par: Zhou, Hongyun, et autres
Publié: (2024)

Cross-LoRA: A Data-Free LoRA Transfer Framework across Heterogeneous LLMs
par: Xia, Feifan, et autres
Publié: (2025)

ZKLoRA: Efficient Zero-Knowledge Proofs for LoRA Verification
par: Roy, Bidhan, et autres
Publié: (2025)

Latent Space Factorization in LoRA
par: Kumar, Shashi, et autres
Publié: (2025)

Kron-LoRA: Hybrid Kronecker-LoRA Adapters for Scalable, Sustainable Fine-tuning
par: Shen, Yixin
Publié: (2025)

R-LoRA: Randomized Multi-Head LoRA for Efficient Multi-Task Learning
par: Liu, Jinda, et autres
Publié: (2025)

AFA-LoRA: Enabling Non-Linear Adaptations in LoRA with Activation Function Annealing
par: Li, Jiacheng, et autres
Publié: (2025)

LoRA-Mixer: Coordinate Modular LoRA Experts Through Serial Attention Routing
par: Li, Wenbing, et autres
Publié: (2025)

Mechanistic Interpretability of LoRA-Adapted Language Models for Nuclear Reactor Safety Applications
par: Lee, Yoon Pyo
Publié: (2025)

LoRA-FAIR: Federated LoRA Fine-Tuning with Aggregation and Initialization Refinement
par: Bian, Jieming, et autres
Publié: (2024)

LoRA Done RITE: Robust Invariant Transformation Equilibration for LoRA Optimization
par: Yen, Jui-Nan, et autres
Publié: (2024)

Mixture of LoRA Experts
par: Wu, Xun, et autres
Publié: (2024)

FALQON: Accelerating LoRA Fine-tuning with Low-Bit Floating-Point Arithmetic
par: Choi, Kanghyun, et autres
Publié: (2025)

CopRA: A Progressive LoRA Training Strategy
par: Zhuang, Zhan, et autres
Publié: (2024)

LoRA-MME: Multi-Model Ensemble of LoRA-Tuned Encoders for Code Comment Classification
par: Haider, Md Akib, et autres
Publié: (2026)

SCALE-LoRA: Auditing Post-Retrieval LoRA Composition with Residual Merging and View Reliability
par: Zhou, Shuaipeng, et autres
Publié: (2026)

Adaptive Selection of LoRA Components in Privacy-Preserving Federated Learning
par: Kim, Myoungjun, et autres
Publié: (2026)

LoREnc: Low-Rank Encryption for Securing Foundation Models and LoRA Adapters
par: Ahn, Beomjin, et autres
Publié: (2026)

FedRand: Enhancing Privacy in Federated Learning with Randomized LoRA Subparameter Updates
par: Park, Sangwoo, et autres
Publié: (2025)

PRoLoRA: Partial Rotation Empowers More Parameter-Efficient LoRA
par: Wang, Sheng, et autres
Publié: (2024)

On the Convergence Rate of LoRA Gradient Descent
par: Mu, Siqiao, et autres
Publié: (2025)

Conditional LoRA Parameter Generation
par: Jin, Xiaolong, et autres
Publié: (2024)

LoRA Soups: Merging LoRAs for Practical Skill Composition Tasks
par: Prabhakar, Akshara, et autres
Publié: (2024)

ALTO: Adaptive LoRA Tuning and Orchestration for Heterogeneous LoRA Training Workloads
par: Zuo, Jingwei, et autres
Publié: (2026)