Image de couverture de livre

Decentralized Low-Rank Fine-Tuning of Large Language Models

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Ghiasvand, Sajjad, Alizadeh, Mahnoosh, Pedarsani, Ramtin
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Few-Shot Adversarial Low-Rank Fine-Tuning of Vision-Language Models
par: Ghiasvand, Sajjad, et autres
Publié: (2025)

pFedMMA: Personalized Federated Fine-Tuning with Multi-Modal Adapter for Vision-Language Models
par: Ghiasvand, Sajjad, et autres
Publié: (2025)

REALM: Reliable Expertise-Aware Language Model Fine-Tuning from Noisy Annotations
par: Ghiasvand, Sajjad, et autres
Publié: (2026)

MMLoP: Multi-Modal Low-Rank Prompting for Efficient Vision-Language Adaptation
par: Ghiasvand, Sajjad, et autres
Publié: (2026)

Robust Decentralized Learning with Local Updates and Gradient Tracking
par: Ghiasvand, Sajjad, et autres
Publié: (2024)

Communication-Efficient and Tensorized Federated Fine-Tuning of Large Language Models
par: Ghiasvand, Sajjad, et autres
Publié: (2024)

The Safety-Privacy Tradeoff in Linear Bandits
par: Zibaie, Arghavan, et autres
Publié: (2025)

Inverse Reinforcement Learning by Estimating Expertise of Demonstrators
par: Beliaev, Mark, et autres
Publié: (2024)

Quantized Decentralized Stochastic Learning over Directed Graphs
par: Taheri, Hossein, et autres
Publié: (2020)

Constrained Online Convex Optimization with Polyak Feasibility Steps
par: Hutchinson, Spencer, et autres
Publié: (2025)

Safe Online Convex Optimization with Multi-Point Feedback
par: Hutchinson, Spencer, et autres
Publié: (2024)

Generalization Properties of Adversarial Training for $\ell_0$-Bounded Adversarial Attacks
par: Delgosha, Payam, et autres
Publié: (2024)

The Fair Value of Data Under Heterogeneous Privacy Constraints in Federated Learning
par: Kang, Justin, et autres
Publié: (2023)

Directional Optimism for Safe Linear Bandits
par: Hutchinson, Spencer, et autres
Publié: (2023)

Sparsity-Aware Low-Rank Representation for Efficient Fine-Tuning of Large Language Models
par: Zhang, Longteng, et autres
Publié: (2026)

Long-Term Fairness in Sequential Multi-Agent Selection with Positive Reinforcement
par: Puranik, Bhagyashree, et autres
Publié: (2024)

Conflict-Aware Adversarial Training
par: Xue, Zhiyu, et autres
Publié: (2024)

Stochastic Gradient Descent with Strategic Querying
par: Jiang, Nanfei, et autres
Publié: (2025)

Rate-Optimal Regret for the Safe Learning-based Control of the Constrained Linear Quadratic Regulator
par: Hutchinson, Spencer, et autres
Publié: (2026)

Optimistic Safety for Online Convex Optimization with Unknown Linear Constraints
par: Hutchinson, Spencer, et autres
Publié: (2024)

Robustness and Adaptability of Reinforcement Learning based Cooperative Autonomous Driving in Mixed-autonomy Traffic
par: Valiente, Rodolfo, et autres
Publié: (2022)

QR-LoRA: QR-Based Low-Rank Adaptation for Efficient Fine-Tuning of Large Language Models
par: Liang, Jessica, et autres
Publié: (2025)

AFLoRA: Adaptive Federated Fine-Tuning of Large Language Models with Resource-Aware Low-Rank Adaption
par: Zhou, Yajie, et autres
Publié: (2025)

LoKO: Low-Rank Kalman Optimizer for Online Fine-Tuning of Large Models
par: Abdi, Hossein, et autres
Publié: (2024)

NoRA: Nested Low-Rank Adaptation for Efficient Fine-Tuning Large Models
par: Lin, Cheng, et autres
Publié: (2024)

FLoRA: Federated Fine-Tuning Large Language Models with Heterogeneous Low-Rank Adaptations
par: Wang, Ziyao, et autres
Publié: (2024)

RefLoRA: Refactored Low-Rank Adaptation for Efficient Fine-Tuning of Large Models
par: Zhang, Yilang, et autres
Publié: (2025)

Learning to Understand: Identifying Interactions via the Möbius Transform
par: Kang, Justin S., et autres
Publié: (2024)

Exploring Cross-model Neuronal Correlations in the Context of Predicting Model Performance and Generalizability
par: Oskouie, Haniyeh Ehsani, et autres
Publié: (2024)

Multi-Bin Batching for Increasing LLM Inference Throughput
par: Guldogan, Ozgur, et autres
Publié: (2024)

MI-to-Mid Distilled Compression (M2M-DC): An Hybrid-Information-Guided-Block Pruning with Progressive Inner Slicing Approach to Model Compression
par: Levine, Lionel, et autres
Publié: (2025)

Learning-based social coordination to improve safety and robustness of cooperative autonomous vehicles in mixed traffic
par: Valiente, Rodolfo, et autres
Publié: (2022)

LoRETTA: Low-Rank Economic Tensor-Train Adaptation for Ultra-Low-Parameter Fine-Tuning of Large Language Models
par: Yang, Yifan, et autres
Publié: (2024)

ADF-LoRA: Alternating Low-Rank Aggregation for Decentralized Federated Fine-Tuning
par: Wang, Xiaoyu, et autres
Publié: (2025)

Low-Rank Curvature for Zeroth-Order Optimization in LLM Fine-Tuning
par: Seung, Hyunseok, et autres
Publié: (2025)

A Stronger Mixture of Low-Rank Experts for Fine-Tuning Foundation Models
par: Sun, Mengyang, et autres
Publié: (2025)

Transfer Learning in Physics-Informed Neural Networks: Full Fine-Tuning, Lightweight Fine-Tuning, and Low-Rank Adaptation
par: Wang, Yizheng, et autres
Publié: (2025)

BALF: Budgeted Activation-Aware Low-Rank Factorization for Fine-Tuning-Free Model Compression
par: González-Martínez, David
Publié: (2025)

Sensitivity-LoRA: Low-Load Sensitivity-Based Fine-Tuning for Large Language Models
par: Zhang, Hao, et autres
Publié: (2025)

ScaLoRA: Optimally Scaled Low-Rank Adaptation for Efficient High-Rank Fine-Tuning
par: Zhang, Yilang, et autres
Publié: (2025)