Imagen de Portada

LoKO: Low-Rank Kalman Optimizer for Online Fine-Tuning of Large Models

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Abdi, Hossein, Sun, Mingfei, Zhang, Andi, Kaski, Samuel, Pan, Wei
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Bayesian Natural Gradient Fine-Tuning of CLIP Models via Kalman Filtering
por: Abdi, Hossein, et al.
Publicado: (2025)

Gradient Regularized Natural Gradients
por: Dash, Satya Prakash, et al.
Publicado: (2026)

RefLoRA: Refactored Low-Rank Adaptation for Efficient Fine-Tuning of Large Models
por: Zhang, Yilang, et al.
Publicado: (2025)

Rank-1 Approximation of Inverse Fisher for Natural Policy Gradients in Deep Reinforcement Learning
por: Huo, Yingxiao, et al.
Publicado: (2026)

LoFT: Low-Rank Adaptation That Behaves Like Full Fine-Tuning
por: Tastan, Nurbek, et al.
Publicado: (2025)

Low-Rank Agent-Specific Adaptation (LoRASA) for Multi-Agent Policy Learning
por: Zhang, Beining, et al.
Publicado: (2025)

Hybrid-LoRA: Bridging Full Fine-Tuning and Low-Rank Adaptation for Post-Training
por: Zhang, Chengqian, et al.
Publicado: (2026)

QR-LoRA: QR-Based Low-Rank Adaptation for Efficient Fine-Tuning of Large Language Models
por: Liang, Jessica, et al.
Publicado: (2025)

Decentralized Low-Rank Fine-Tuning of Large Language Models
por: Ghiasvand, Sajjad, et al.
Publicado: (2025)

ScaLoRA: Optimally Scaled Low-Rank Adaptation for Efficient High-Rank Fine-Tuning
por: Zhang, Yilang, et al.
Publicado: (2025)

LOFT: Low-Rank Orthogonal Fine-Tuning via Task-Aware Support Selection
por: Zhao, Lanxin, et al.
Publicado: (2026)

QDyLoRA: Quantized Dynamic Low-Rank Adaptation for Efficient Large Language Model Tuning
por: Rajabzadeh, Hossein, et al.
Publicado: (2024)

DropLoRA: Sparse Low-Rank Adaptation for Parameter-Efficient Fine-Tuning
por: Zhang, Haojie
Publicado: (2025)

NoRA: Nested Low-Rank Adaptation for Efficient Fine-Tuning Large Models
por: Lin, Cheng, et al.
Publicado: (2024)

LoRETTA: Low-Rank Economic Tensor-Train Adaptation for Ultra-Low-Parameter Fine-Tuning of Large Language Models
por: Yang, Yifan, et al.
Publicado: (2024)

Rethinking Inter-LoRA Orthogonality in Adapter Merging: Insights from Orthogonal Monte Carlo Dropout
por: Zhang, Andi, et al.
Publicado: (2025)

Online Sharp-Calibrated Bayesian Optimization
por: Sinaga, Marshal Arijona, et al.
Publicado: (2026)

Sensitivity-LoRA: Low-Load Sensitivity-Based Fine-Tuning for Large Language Models
por: Zhang, Hao, et al.
Publicado: (2025)

Computational Limits of Low-Rank Adaptation (LoRA) Fine-Tuning for Transformer Models
por: Hu, Jerry Yao-Chieh, et al.
Publicado: (2024)

Low-Rank Curvature for Zeroth-Order Optimization in LLM Fine-Tuning
por: Seung, Hyunseok, et al.
Publicado: (2025)

C-LoRA: Contextual Low-Rank Adaptation for Uncertainty Estimation in Large Language Models
por: Rahmati, Amir Hossein, et al.
Publicado: (2025)

GraLoRA: Granular Low-Rank Adaptation for Parameter-Efficient Fine-Tuning
por: Jung, Yeonjoon, et al.
Publicado: (2025)

LoRAPrune: Structured Pruning Meets Low-Rank Parameter-Efficient Fine-Tuning
por: Zhang, Mingyang, et al.
Publicado: (2023)

Rethinking the Rank Threshold for LoRA Fine-Tuning
por: Park, Juneyoung
Publicado: (2026)

A Stronger Mixture of Low-Rank Experts for Fine-Tuning Foundation Models
por: Sun, Mengyang, et al.
Publicado: (2025)

Sparsity-Aware Low-Rank Representation for Efficient Fine-Tuning of Large Language Models
por: Zhang, Longteng, et al.
Publicado: (2026)

Localized LoRA: A Structured Low-Rank Approximation for Efficient Fine-Tuning
por: Barazandeh, Babak, et al.
Publicado: (2025)

FLoRA: Federated Fine-Tuning Large Language Models with Heterogeneous Low-Rank Adaptations
por: Wang, Ziyao, et al.
Publicado: (2024)

LoSiA: Efficient High-Rank Fine-Tuning via Subnet Localization and Optimization
por: Wang, Xujia, et al.
Publicado: (2025)

Optimizing Fine-Tuning through Advanced Initialization Strategies for Low-Rank Adaptation
por: Xue, Yongfu
Publicado: (2025)

Elicitation-Augmented Bayesian Optimization
por: Haltia, Alvar, et al.
Publicado: (2026)

Memory-Efficient Fine-Tuning via Low-Rank Activation Compression
por: Shi, Jiang-Xin, et al.
Publicado: (2025)

MatryoshkaLoRA: Learning Accurate Hierarchical Low-Rank Representations for LLM Fine-Tuning
por: Modoranu, Ionut-Vlad, et al.
Publicado: (2026)

Few-Shot Adversarial Low-Rank Fine-Tuning of Vision-Language Models
por: Ghiasvand, Sajjad, et al.
Publicado: (2025)

ElaLoRA: Elastic & Learnable Low-Rank Adaptation for Efficient Model Fine-Tuning
por: Chang, Huandong, et al.
Publicado: (2025)

AFLoRA: Adaptive Federated Fine-Tuning of Large Language Models with Resource-Aware Low-Rank Adaption
por: Zhou, Yajie, et al.
Publicado: (2025)

Polynomial Expansion Rank Adaptation: Enhancing Low-Rank Fine-Tuning with High-Order Interactions
por: Zhang, Wenhao, et al.
Publicado: (2026)

FedLoRA-Optimizer: Federated LoRA Fine-Tuning with Global and Local Optimization in Heterogeneous Data Scenarios
por: Zhao, Jianzhe, et al.
Publicado: (2025)

Multi-Objective Bayesian Optimization via Adaptive \varepsilon-Constraints Decomposition
por: Yang, Yaohong, et al.
Publicado: (2026)

Online-LoRA: Task-free Online Continual Learning via Low Rank Adaptation
por: Wei, Xiwen, et al.
Publicado: (2024)