Image de couverture de livre

Riemannian Optimization for LoRA on the Stiefel Manifold

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Park, Juneyoung, Kang, Minjae, Lee, Seongbae, Lee, Haegang, Kim, Seongwan, Lee, Jaeho
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Rethinking the Rank Threshold for LoRA Fine-Tuning
par: Park, Juneyoung
Publié: (2026)

Beware of the Batch Size: Hyperparameter Bias in Evaluating LoRA
par: Lee, Sangyoon, et autres
Publié: (2026)

LCSB: Layer-Cyclic Selective Backpropagation for Memory-Efficient On-Device LLM Fine-Tuning
par: Park, Juneyoung, et autres
Publié: (2026)

Memory-Efficient Structured Backpropagation for On-Device LLM Fine-Tuning
par: Park, Juneyoung, et autres
Publié: (2026)

FedSVD: Adaptive Orthogonalization for Private Federated Learning with LoRA
par: Lee, Seanie, et autres
Publié: (2025)

LoRA on the Go: Instance-level Dynamic LoRA Selection and Merging
par: Lee, Seungeon, et autres
Publié: (2025)

FoRA: Fisher-orthogonal Rank Adaptation for Parameter-Efficient Fine-Tuning
par: Park, Juneyoung, et autres
Publié: (2026)

FALQON: Accelerating LoRA Fine-tuning with Low-Bit Floating-Point Arithmetic
par: Choi, Kanghyun, et autres
Publié: (2025)

A Note on LoRA
par: Fomenko, Vlad, et autres
Publié: (2024)

Mechanistic Interpretability of LoRA-Adapted Language Models for Nuclear Reactor Safety Applications
par: Lee, Yoon Pyo
Publié: (2025)

S-LoRA: Serving Thousands of Concurrent LoRA Adapters
par: Sheng, Ying, et autres
Publié: (2023)

LoRA Done RITE: Robust Invariant Transformation Equilibration for LoRA Optimization
par: Yen, Jui-Nan, et autres
Publié: (2024)

Hybrid-LoRA: Bridging Full Fine-Tuning and Low-Rank Adaptation for Post-Training
par: Zhang, Chengqian, et autres
Publié: (2026)

FiLoRA: Focus-and-Ignore LoRA for Controllable Feature Reliance
par: Chung, Hyunsuk, et autres
Publié: (2026)

RILQ: Rank-Insensitive LoRA-based Quantization Error Compensation for Boosting 2-bit Large Language Model Accuracy
par: Lee, Geonho, et autres
Publié: (2024)

Kron-LoRA: Hybrid Kronecker-LoRA Adapters for Scalable, Sustainable Fine-tuning
par: Shen, Yixin
Publié: (2025)

R-LoRA: Randomized Multi-Head LoRA for Efficient Multi-Task Learning
par: Liu, Jinda, et autres
Publié: (2025)

LoRA-Mixer: Coordinate Modular LoRA Experts Through Serial Attention Routing
par: Li, Wenbing, et autres
Publié: (2025)

SCALE-LoRA: Auditing Post-Retrieval LoRA Composition with Residual Merging and View Reliability
par: Zhou, Shuaipeng, et autres
Publié: (2026)

Co-LoRA: Collaborative Model Personalization on Heterogeneous Multi-Modal Clients
par: Seo, Minhyuk, et autres
Publié: (2025)

Conditional LoRA Parameter Generation
par: Jin, Xiaolong, et autres
Publié: (2024)

SC-LoRA: Balancing Efficient Fine-tuning and Knowledge Preservation via Subspace-Constrained LoRA
par: Luo, Minrui, et autres
Publié: (2025)

TransPL: VQ-Code Transition Matrices for Pseudo-Labeling of Time Series Unsupervised Domain Adaptation
par: Kim, Jaeho, et autres
Publié: (2025)

Adaptive Selection of LoRA Components in Privacy-Preserving Federated Learning
par: Kim, Myoungjun, et autres
Publié: (2026)

Robust Federated Finetuning of LLMs via Alternating Optimization of LoRA
par: Chen, Shuangyi, et autres
Publié: (2025)

Label-Free Cross-Task LoRA Merging with Null-Space Compression
par: Lee, Wonyoung, et autres
Publié: (2026)

Semantic-guided LoRA Parameters Generation
par: Li, Miaoge, et autres
Publié: (2025)

Text-to-LoRA: Instant Transformer Adaption
par: Charakorn, Rujikorn, et autres
Publié: (2025)

Subliminal Learning is a LoRA Artifact
par: Nief, Todd, et autres
Publié: (2026)

KD-LoRA: A Hybrid Approach to Efficient Fine-Tuning with LoRA and Knowledge Distillation
par: Azimi, Rambod, et autres
Publié: (2024)

Learning Rate Matters: Vanilla LoRA May Suffice for LLM Fine-tuning
par: Lee, Yu-Ang, et autres
Publié: (2026)

HiLoRA: Adaptive Hierarchical LoRA Routing for Training-Free Domain Generalization
par: Han, Ziyi, et autres
Publié: (2025)

Preference-Aligned LoRA Merging: Preserving Subspace Coverage and Addressing Directional Anisotropy
par: Jeong, Wooseong, et autres
Publié: (2026)

LoRA-Pro: Are Low-Rank Adapters Properly Optimized?
par: Wang, Zhengbo, et autres
Publié: (2024)

Improving LoRA with Variational Learning
par: Cong, Bai, et autres
Publié: (2025)

Activated LoRA: Fine-tuned LLMs for Intrinsics
par: Greenewald, Kristjan, et autres
Publié: (2025)

ALTO: Adaptive LoRA Tuning and Orchestration for Heterogeneous LoRA Training Workloads
par: Zuo, Jingwei, et autres
Publié: (2026)

ALLoRA: Adaptive Learning Rate Mitigates LoRA Fatal Flaws
par: Huang, Hai, et autres
Publié: (2024)

FedTreeLoRA: Reconciling Statistical and Functional Heterogeneity in Federated LoRA Fine-Tuning
par: Bian, Jieming, et autres
Publié: (2026)

AlignGuard-LoRA: Alignment-Preserving Fine-Tuning via Fisher-Guided Decomposition and Riemannian-Geodesic Collision Regularization
par: Das, Amitava, et autres
Publié: (2025)