Cover Image

FedLoDrop: Federated LoRA with Dropout for Generalized LLM Fine-tuning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Xie, Sijing, Wen, Dingzhu, You, Changsheng, Chen, Qimei, Bennis, Mehdi, Huang, Kaibin
Format:	Preprint
Published:	2025
Subjects:	Information Theory Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Federated Dropout: Convergence Analysis and Resource Allocation
by: Xie, Sijing, et al.
Published: (2024)

Fed-PELAD: Communication-Efficient Federated Learning for Massive MIMO CSI Feedback with Personalized Encoders and a LoRA-Adapted Shared Decoder
by: Zhou, Yixiang, et al.
Published: (2025)

Integrated Sensing, Communication, and Computation for Over-the-Air Federated Edge Learning
by: Wen, Dingzhu, et al.
Published: (2025)

LoRA-Drop: Temporal LoRA Decoding for Efficient LLM Inference
by: Rajabzadeh, Hossein, et al.
Published: (2026)

Finite-Precision Conjugate Gradient Method for Massive MIMO Detection
by: Fang, Yiming, et al.
Published: (2025)

FedRot-LoRA: Mitigating Rotational Misalignment in Federated LoRA
by: Zhang, Haoran, et al.
Published: (2026)

BeamVLM for Low-altitude Economy: Generative Beam Prediction via Vision-language Models
by: Kou, Chenran, et al.
Published: (2026)

Aerial Semantic Relay-Enabled SAGIN: Joint UAV Deployment and Resource Allocation
by: Yin, Yanbo, et al.
Published: (2025)

HAFLQ: Heterogeneous Adaptive Federated LoRA Fine-tuned LLM with Quantization
by: Su, Yang, et al.
Published: (2024)

FedTreeLoRA: Reconciling Statistical and Functional Heterogeneity in Federated LoRA Fine-Tuning
by: Bian, Jieming, et al.
Published: (2026)

Resource Management for Low-latency Cooperative Fine-tuning of Foundation Models at the Network Edge
by: Wu, Hai, et al.
Published: (2024)

Kron-LoRA: Hybrid Kronecker-LoRA Adapters for Scalable, Sustainable Fine-tuning
by: Shen, Yixin
Published: (2025)

LoRACode: LoRA Adapters for Code Embeddings
by: Chaturvedi, Saumya, et al.
Published: (2025)

GPTQ-intrinsic LoRA: A Near-optimal Algorithm for Low-precision Quantization with Low-rank Adaptation
by: Zhang, Shihao, et al.
Published: (2026)

LoRA-FAIR: Federated LoRA Fine-Tuning with Aggregation and Initialization Refinement
by: Bian, Jieming, et al.
Published: (2024)

Heterogeneous LoRA for Federated Fine-tuning of On-Device Foundation Models
by: Cho, Yae Jee, et al.
Published: (2024)

LoRA-Leak: Membership Inference Attacks Against LoRA Fine-tuned Language Models
by: Ran, Delong, et al.
Published: (2025)

GeLoRA: Geometric Adaptive Ranks For Efficient LoRA Fine-tuning
by: Ed-dib, Abdessalam, et al.
Published: (2024)

FedMomentum: Preserving LoRA Training Momentum in Federated Fine-Tuning
by: Yan, Peishen, et al.
Published: (2026)

FedMeld: A Model-dispersal Federated Learning Framework for Space-ground Integrated Networks
by: Chen, Qian, et al.
Published: (2024)

How Relevance Emerges: Interpreting LoRA Fine-Tuning in Reranking LLMs
by: Nijasure, Atharva, et al.
Published: (2025)

Collaborative Edge AI Inference over Cloud-RAN
by: Zhang, Pengfei, et al.
Published: (2024)

Activated LoRA: Fine-tuned LLMs for Intrinsics
by: Greenewald, Kristjan, et al.
Published: (2025)

FedLoRA-Optimizer: Federated LoRA Fine-Tuning with Global and Local Optimization in Heterogeneous Data Scenarios
by: Zhao, Jianzhe, et al.
Published: (2025)

Wireless Federated Learning over Resource-Constrained Networks: Digital versus Analog Transmissions
by: Yao, Jiacheng, et al.
Published: (2024)

SC-LoRA: Balancing Efficient Fine-tuning and Knowledge Preservation via Subspace-Constrained LoRA
by: Luo, Minrui, et al.
Published: (2025)

pFedLoRA: Model-Heterogeneous Personalized Federated Learning with LoRA Tuning
by: Yi, Liping, et al.
Published: (2023)

A Survey on Integrated Sensing, Communication, and Computation
by: Wen, Dingzhu, et al.
Published: (2024)

Efficient Wireless Federated Learning via Low-Rank Gradient Factorization
by: Guo, Mingzhao, et al.
Published: (2024)

Semantic Communication meets System 2 ML: How Abstraction, Compositionality and Emergent Languages Shape Intelligence
by: Bennis, Mehdi, et al.
Published: (2025)

Parametric Retrieval-Augmented Generation using Latent Routing of LoRA Adapters
by: Su, Zhan, et al.
Published: (2025)

LoRA-PAR: A Flexible Dual-System LoRA Partitioning Approach to Efficient LLM Fine-Tuning
by: Huang, Yining, et al.
Published: (2025)

LoRA vs Full Fine-tuning: An Illusion of Equivalence
by: Shuttleworth, Reece, et al.
Published: (2024)

DR-LoRA: Dynamic Rank LoRA for Fine-Tuning Mixture-of-Experts Models
by: Deng, Guanzhi, et al.
Published: (2026)

Compositional Distributed Learning for Multi-View Perception: A Maximal Coding Rate Reduction Perspective
by: Tian, Zhuojun, et al.
Published: (2025)

FedQuad: Adaptive Layer-wise LoRA Deployment and Activation Quantization for Federated Fine-Tuning
by: Li, Rukuo, et al.
Published: (2025)

RAIE: Region-Aware Incremental Preference Editing with LoRA for LLM-based Recommendation
by: Zeng, Jin, et al.
Published: (2026)

LoRA-BAM: Input Filtering for Fine-tuned LLMs via Boxed Abstraction Monitors over LoRA Layers
by: Wu, Changshun, et al.
Published: (2025)

SDFLoRA: Selective Decoupled Federated LoRA for Privacy-preserving Fine-tuning with Heterogeneous Clients
by: Shen, Zhikang, et al.
Published: (2026)

Decentralized Federated Learning with Asynchronous Parameter Sharing for Large-scale IoT Networks
by: Xie, Haihui, et al.
Published: (2024)