Cover Image

Federated Sketching LoRA: A Flexible Framework for Heterogeneous Collaborative Fine-Tuning of LLMs

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Fang, Wenzhi, Han, Dong-Jun, Yuan, Liangqi, Hosseinalipour, Seyyedali, Brinton, Christopher G.
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Self-Play Enhancement via Advantage-Weighted Refinement in Online Federated LLM Fine-Tuning with Real-Time Feedback
by: Lee, Seohyun, et al.
Published: (2026)

TAP: Two-Stage Adaptive Personalization of Multi-Task and Multi-Modal Foundation Models in Federated Learning
by: Lee, Seohyun, et al.
Published: (2025)

Bridging On-Device and Cloud LLMs for Collaborative Reasoning: A Unified Methodology for Local Routing and Post-Training
by: Fang, Wenzhi, et al.
Published: (2025)

Rethinking the Starting Point: Collaborative Pre-Training for Federated Downstream Tasks
by: Chu, Yun-Wei, et al.
Published: (2024)

Sporadic Gradient Tracking over Directed Graphs: A Theoretical Perspective on Decentralized Federated Learning
by: Zehtabi, Shahryar, et al.
Published: (2026)

Unlocking the Potential of Model Calibration in Federated Learning
by: Chu, Yun-Wei, et al.
Published: (2024)

Decentralized Sporadic Federated Learning: A Unified Algorithmic Framework with Convergence Guarantees
by: Zehtabi, Shahryar, et al.
Published: (2024)

PAAC: Privacy-Aware Agentic Device-Cloud Collaboration
by: Yuan, Liangqi, et al.
Published: (2026)

Orchestrating Federated Learning in Space-Air-Ground Integrated Networks: Adaptive Data Offloading and Seamless Handover
by: Han, Dong-Jun, et al.
Published: (2024)

Resource-Constrained Decentralized Federated Learning via Personalized Event-Triggering
by: Zehtabi, Shahryar, et al.
Published: (2022)

Multi-Source to Multi-Target Decentralized Federated Domain Adaptation
by: Wang, Su, et al.
Published: (2023)

Iterative Critique-and-Routing Controller for Multi-Agent Systems with Heterogeneous LLMs
by: Fang, Wenzhi, et al.
Published: (2026)

Decentralized Domain Generalization with Style Sharing: Formal Model and Convergence Analysis
by: Zehtabi, Shahryar, et al.
Published: (2025)

Cooperative Decentralized Backdoor Attacks on Vertical Federated Learning
by: Lee, Seohyun, et al.
Published: (2025)

Unsupervised Federated Optimization at the Edge: D2D-Enabled Learning without Labels
by: Wagle, Satyavrat, et al.
Published: (2024)

Communication-Efficient Federated Learning under Dynamic Device Arrival and Departure: Convergence Analysis and Algorithm Design
by: Chang, Zhan-Lun, et al.
Published: (2024)

CE-LoRA: Computation-Efficient LoRA Fine-Tuning for Language Models
by: Chen, Guanduo, et al.
Published: (2025)

LoRA-FAIR: Federated LoRA Fine-Tuning with Aggregation and Initialization Refinement
by: Bian, Jieming, et al.
Published: (2024)

FedTreeLoRA: Reconciling Statistical and Functional Heterogeneity in Federated LoRA Fine-Tuning
by: Bian, Jieming, et al.
Published: (2026)

Cross-LoRA: A Data-Free LoRA Transfer Framework across Heterogeneous LLMs
by: Xia, Feifan, et al.
Published: (2025)

Federated Learning over Hierarchical Wireless Networks: Training Latency Minimization via Submodel Partitioning
by: Fang, Wenzhi, et al.
Published: (2023)

Large Language Models over Networks: Collaborative Intelligence under Resource Constraints
by: Yuan, Liangqi, et al.
Published: (2026)

pFedLoRA: Model-Heterogeneous Personalized Federated Learning with LoRA Tuning
by: Yi, Liping, et al.
Published: (2023)

Asynchronous Multi-Model Dynamic Federated Learning over Wireless Networks: Theory, Modeling, and Optimization
by: Chang, Zhan-Lun, et al.
Published: (2023)

FedLoRA-Optimizer: Federated LoRA Fine-Tuning with Global and Local Optimization in Heterogeneous Data Scenarios
by: Zhao, Jianzhe, et al.
Published: (2025)

Local-Cloud Inference Offloading for LLMs in Multi-Modal, Multi-Task, Multi-Dialogue Settings
by: Yuan, Liangqi, et al.
Published: (2025)

LoRAFusion: Efficient LoRA Fine-Tuning for LLMs
by: Zhu, Zhanda, et al.
Published: (2025)

LoRA-PAR: A Flexible Dual-System LoRA Partitioning Approach to Efficient LLM Fine-Tuning
by: Huang, Yining, et al.
Published: (2025)

Device Sampling and Resource Optimization for Federated Learning in Cooperative Edge Networks
by: Wang, Su, et al.
Published: (2023)

Adaptive LoRA Experts Allocation and Selection for Federated Fine-Tuning
by: Wang, Lei, et al.
Published: (2025)

Fed-pilot: Optimizing LoRA Allocation for Efficient Federated Fine-Tuning with Heterogeneous Clients
by: Zhang, Zikai, et al.
Published: (2024)

ALTO: Adaptive LoRA Tuning and Orchestration for Heterogeneous LoRA Training Workloads
by: Zuo, Jingwei, et al.
Published: (2026)

Communication-Efficient Multimodal Federated Learning: Joint Modality and Client Selection
by: Yuan, Liangqi, et al.
Published: (2024)

Heterogeneous LoRA for Federated Fine-tuning of On-Device Foundation Models
by: Cho, Yae Jee, et al.
Published: (2024)

Fed-HeLLo: Efficient Federated Foundation Model Fine-Tuning with Heterogeneous LoRA Allocation
by: Zhang, Zikai, et al.
Published: (2025)

Hierarchical Federated Learning with Multi-Timescale Gradient Correction
by: Fang, Wenzhi, et al.
Published: (2024)

LLMAP: LLM-Assisted Multi-Objective Route Planning with User Preferences
by: Yuan, Liangqi, et al.
Published: (2025)

FedMomentum: Preserving LoRA Training Momentum in Federated Fine-Tuning
by: Yan, Peishen, et al.
Published: (2026)

How Relevance Emerges: Interpreting LoRA Fine-Tuning in Reranking LLMs
by: Nijasure, Atharva, et al.
Published: (2025)

Rethinking the Rank Threshold for LoRA Fine-Tuning
by: Park, Juneyoung
Published: (2026)