Imagen de Portada

FLoRG: Federated Fine-tuning with Low-rank Gram Matrices and Procrustes Alignment

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Meng, Chuiyang, Tang, Ming, Wong, Vincent W. S.
Formato:	Preprint
Publicado:	2026
Materias:	Machine Learning Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

ZorBA: Zeroth-order Federated Fine-tuning of LLMs with Heterogeneous Block Activation
por: Meng, Chuiyang, et al.
Publicado: (2026)

ASFL: An Adaptive Model Splitting and Resource Allocation Framework for Split Federated Learning
por: Meng, Chuiyang, et al.
Publicado: (2026)

Aggregating Low Rank Adapters in Federated Fine-tuning
por: Trautmann, Evelyn, et al.
Publicado: (2025)

FLoRA: Enhancing Vision-Language Models with Parameter-Efficient Federated Learning
por: Nguyen, Duy Phuong, et al.
Publicado: (2024)

PrunedLoRA: Robust Gradient-Based structured pruning for Low-rank Adaptation in Fine-tuning
por: Yu, Xin, et al.
Publicado: (2025)

LoCO: Low-rank Compositional Rotation Fine-tuning
por: Nguyen, An, et al.
Publicado: (2026)

FLoRA: Fused forward-backward adapters for parameter efficient fine-tuning and reducing inference-time latencies of LLMs
por: Gowda, Dhananjaya, et al.
Publicado: (2025)

FLoRIST: Singular Value Thresholding for Efficient and Accurate Federated Fine-Tuning of Large Language Models
por: Ramesh, Hariharan, et al.
Publicado: (2025)

zFLoRA: Zero-Latency Fused Low-Rank Adapters
por: Gowda, Dhananjaya, et al.
Publicado: (2025)

Safeguarding LLM Fine-tuning via Push-Pull Distributional Alignment
por: Wang, Haozhong, et al.
Publicado: (2026)

New Insights on Unfolding and Fine-tuning Quantum Federated Learning
por: Nanayakkara, Shanika Iroshi, et al.
Publicado: (2025)

Structured Unrestricted-Rank Matrices for Parameter Efficient Fine-tuning
por: Sehanobish, Arijit, et al.
Publicado: (2024)

FedRG: Unleashing the Representation Geometry for Federated Learning with Noisy Clients
por: Wen, Tian, et al.
Publicado: (2026)

MetaLoRA: Tensor-Enhanced Adaptive Low-Rank Fine-tuning
por: Wang, Maolin, et al.
Publicado: (2025)

FeDeRA:Efficient Fine-tuning of Language Models in Federated Learning Leveraging Weight Decomposition
por: Yan, Yuxuan, et al.
Publicado: (2024)

Spatio-temporal Prediction of Fine-Grained Origin-Destination Matrices with Applications in Ridesharing
por: Yang, Run, et al.
Publicado: (2025)

FALQON: Accelerating LoRA Fine-tuning with Low-Bit Floating-Point Arithmetic
por: Choi, Kanghyun, et al.
Publicado: (2025)

SDFLoRA: Selective Decoupled Federated LoRA for Privacy-preserving Fine-tuning with Heterogeneous Clients
por: Shen, Zhikang, et al.
Publicado: (2026)

Quantized Evolution Strategies: High-precision Fine-tuning of Quantized LLMs at Low-precision Cost
por: Xu, Yinggan, et al.
Publicado: (2026)

Neural ODE Transformers: Analyzing Internal Dynamics and Adaptive Fine-tuning
por: Tong, Anh, et al.
Publicado: (2025)

Deploying Models to Non-participating Clients in Federated Learning without Fine-tuning: A Hypernetwork-based Approach
por: Zhou, Yuhao, et al.
Publicado: (2025)

Ravan: Multi-Head Low-Rank Adaptation for Federated Fine-Tuning
por: Raje, Arian, et al.
Publicado: (2025)

Adaptation and Fine-tuning with TabPFN for Travelling Salesman Problem
por: Vu, Nguyen Gia Hien, et al.
Publicado: (2025)

Exploring Memorization in Fine-tuned Language Models
por: Zeng, Shenglai, et al.
Publicado: (2023)

Pharmacist: Safety Alignment Data Curation for Large Language Models against Harmful Fine-tuning
por: Liu, Guozhi, et al.
Publicado: (2025)

LEVI: Generalizable Fine-tuning via Layer-wise Ensemble of Different Views
por: Roh, Yuji, et al.
Publicado: (2024)

Fine-tuning Timeseries Predictors Using Reinforcement Learning
por: Cazaux, Hugo, et al.
Publicado: (2026)

Activated LoRA: Fine-tuned LLMs for Intrinsics
por: Greenewald, Kristjan, et al.
Publicado: (2025)

Rethinking Safety in LLM Fine-tuning: An Optimization Perspective
por: Kim, Minseon, et al.
Publicado: (2025)

Speculative Coreset Selection for Task-Specific Fine-tuning
por: Zhang, Xiaoyu, et al.
Publicado: (2024)

Skip2-LoRA: A Lightweight On-device DNN Fine-tuning Method for Low-cost Edge Devices
por: Matsutani, Hiroki, et al.
Publicado: (2024)

Learning Heterogeneous Performance-Fairness Trade-offs in Federated Learning
por: Ye, Rongguang, et al.
Publicado: (2025)

Step-wise Adaptive Integration of Supervised Fine-tuning and Reinforcement Learning for Task-Specific LLMs
por: Chen, Jack, et al.
Publicado: (2025)

LoX: Low-Rank Extrapolation Robustifies LLM Safety Against Fine-tuning
por: Perin, Gabriel J., et al.
Publicado: (2025)

Fine-tuning Diffusion Policies with Backpropagation Through Diffusion Timesteps
por: Yang, Ningyuan, et al.
Publicado: (2025)

Fine-tuning Large Language Model for Automated Algorithm Design
por: Liu, Fei, et al.
Publicado: (2025)

Fine-tuning Flow Matching Generative Models with Intermediate Feedback
por: Fan, Jiajun, et al.
Publicado: (2025)

CF-VLM:CounterFactual Vision-Language Fine-tuning
por: Zhang, Jusheng, et al.
Publicado: (2025)

Faster Convergence for Transformer Fine-tuning with Line Search Methods
por: Kenneweg, Philip, et al.
Publicado: (2024)

Alignment Dynamics in LLM Fine-Tuning
por: Huang, Yuhan, et al.
Publicado: (2026)