Image de couverture de livre

Curvature-Guided LoRA: Steering in the pretrained NTK subspace

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Zheng, Frédéric, Proutière, Alexandre
Format:	Preprint
Publié:	2026
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

LoRA Training in the NTK Regime has No Spurious Local Minima
par: Jang, Uijeong, et autres
Publié: (2024)

Conformal Predictions under Markovian Data
par: Zheng, Frédéric, et autres
Publié: (2024)

Run LoRA Run: Faster and Lighter LoRA Implementations
par: Cherniuk, Daria, et autres
Publié: (2023)

S-LoRA: Serving Thousands of Concurrent LoRA Adapters
par: Sheng, Ying, et autres
Publié: (2023)

CE-LoRA: Computation-Efficient LoRA Fine-Tuning for Language Models
par: Chen, Guanduo, et autres
Publié: (2025)

LoRA Diffusion: Zero-Shot LoRA Synthesis for Diffusion Model Personalization
par: Smith, Ethan, et autres
Publié: (2024)

Near-optimal Rank Adaptive Inference of High Dimensional Matrices
par: Zheng, Frédéric, et autres
Publié: (2025)

Block-Diagonal LoRA for Eliminating Communication Overhead in Tensor Parallel LoRA Serving
par: Wang, Xinyu, et autres
Publié: (2025)

CTR-LoRA: Curvature-Aware and Trust-Region Guided Low-Rank Adaptation for Large Language Models
par: Wang, Zhuxuanzi, et autres
Publié: (2025)

LoRA-drop: Efficient LoRA Parameter Pruning based on Output Evaluation
par: Zhou, Hongyun, et autres
Publié: (2024)

Cross-LoRA: A Data-Free LoRA Transfer Framework across Heterogeneous LLMs
par: Xia, Feifan, et autres
Publié: (2025)

LoRA on the Go: Instance-level Dynamic LoRA Selection and Merging
par: Lee, Seungeon, et autres
Publié: (2025)

Latent Space Factorization in LoRA
par: Kumar, Shashi, et autres
Publié: (2025)

Kron-LoRA: Hybrid Kronecker-LoRA Adapters for Scalable, Sustainable Fine-tuning
par: Shen, Yixin
Publié: (2025)

R-LoRA: Randomized Multi-Head LoRA for Efficient Multi-Task Learning
par: Liu, Jinda, et autres
Publié: (2025)

AFA-LoRA: Enabling Non-Linear Adaptations in LoRA with Activation Function Annealing
par: Li, Jiacheng, et autres
Publié: (2025)

LoRA-Mixer: Coordinate Modular LoRA Experts Through Serial Attention Routing
par: Li, Wenbing, et autres
Publié: (2025)

LoRA-FAIR: Federated LoRA Fine-Tuning with Aggregation and Initialization Refinement
par: Bian, Jieming, et autres
Publié: (2024)

LoRA Done RITE: Robust Invariant Transformation Equilibration for LoRA Optimization
par: Yen, Jui-Nan, et autres
Publié: (2024)

Mixture of LoRA Experts
par: Wu, Xun, et autres
Publié: (2024)

CopRA: A Progressive LoRA Training Strategy
par: Zhuang, Zhan, et autres
Publié: (2024)

LoRA-MME: Multi-Model Ensemble of LoRA-Tuned Encoders for Code Comment Classification
par: Haider, Md Akib, et autres
Publié: (2026)

SCALE-LoRA: Auditing Post-Retrieval LoRA Composition with Residual Merging and View Reliability
par: Zhou, Shuaipeng, et autres
Publié: (2026)

Learning in the Fisher Subspace: A Guided Initialization for LoRA Fine-Tuning
par: Feng, Zhi-Quan, et autres
Publié: (2026)

A Note on LoRA
par: Fomenko, Vlad, et autres
Publié: (2024)

PRoLoRA: Partial Rotation Empowers More Parameter-Efficient LoRA
par: Wang, Sheng, et autres
Publié: (2024)

On the Convergence Rate of LoRA Gradient Descent
par: Mu, Siqiao, et autres
Publié: (2025)

Conditional LoRA Parameter Generation
par: Jin, Xiaolong, et autres
Publié: (2024)

CoLoRSMamba: Conditional LoRA-Steered Mamba for Supervised Multimodal Violence Detection
par: Senadeera, Damith Chamalke, et autres
Publié: (2026)

LoRA Soups: Merging LoRAs for Practical Skill Composition Tasks
par: Prabhakar, Akshara, et autres
Publié: (2024)

LoRA-BAM: Input Filtering for Fine-tuned LLMs via Boxed Abstraction Monitors over LoRA Layers
par: Wu, Changshun, et autres
Publié: (2025)

SC-LoRA: Balancing Efficient Fine-tuning and Knowledge Preservation via Subspace-Constrained LoRA
par: Luo, Minrui, et autres
Publié: (2025)

ALTO: Adaptive LoRA Tuning and Orchestration for Heterogeneous LoRA Training Workloads
par: Zuo, Jingwei, et autres
Publié: (2026)

FiLoRA: Focus-and-Ignore LoRA for Controllable Feature Reliance
par: Chung, Hyunsuk, et autres
Publié: (2026)

PLoRA: Efficient LoRA Hyperparameter Tuning for Large Models
par: Yan, Minghao, et autres
Publié: (2025)

MoRA: LoRA Guided Multi-Modal Disease Diagnosis with Missing Modality
par: Shi, Zhiyi, et autres
Publié: (2024)

tLoRA: Efficient Multi-LoRA Training with Elastic Shared Super-Models
par: Li, Kevin, et autres
Publié: (2026)

KD-LoRA: A Hybrid Approach to Efficient Fine-Tuning with LoRA and Knowledge Distillation
par: Azimi, Rambod, et autres
Publié: (2024)

LoRA-PAR: A Flexible Dual-System LoRA Partitioning Approach to Efficient LLM Fine-Tuning
par: Huang, Yining, et autres
Publié: (2025)

Sci-LoRA: Mixture of Scientific LoRAs for Cross-Domain Lay Paraphrasing
par: Cheng, Ming, et autres
Publié: (2025)