Cover Image

FedBiOT: LLM Local Fine-tuning in Federated Learning without Full Model

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wu, Feijie, Li, Zitao, Li, Yaliang, Ding, Bolin, Gao, Jing
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Computation and Language Distributed, Parallel, and Cluster Computing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Improving LoRA in Privacy-preserving Federated Learning
by: Sun, Youbang, et al.
Published: (2024)

Exploring Selective Layer Fine-Tuning in Federated Learning
by: Sun, Yuchang, et al.
Published: (2024)

Federated Full-Parameter Tuning of Billion-Sized Language Models with Communication Cost under 18 Kilobytes
by: Qin, Zhen, et al.
Published: (2023)

FedFQ: Federated Learning with Fine-Grained Quantization
by: Li, Haowei, et al.
Published: (2024)

Memory-Efficient Split Federated Learning for LLM Fine-Tuning on Heterogeneous Mobile Devices
by: Chen, Xiaopei, et al.
Published: (2025)

FedBiF: Communication-Efficient Federated Learning via Bits Freezing
by: Li, Shiwei, et al.
Published: (2025)

FeedSign: Robust Full-parameter Federated Fine-tuning of Large Models with Extremely Low Communication Overhead of One Bit
by: Cai, Zhijie, et al.
Published: (2025)

A Survey on Federated Fine-tuning of Large Language Models
by: Wu, Yebo, et al.
Published: (2025)

FedQuad: Adaptive Layer-wise LoRA Deployment and Activation Quantization for Federated Fine-Tuning
by: Li, Rukuo, et al.
Published: (2025)

EE-LLM: Large-Scale Training and Inference of Early-Exit Large Language Models with 3D Parallelism
by: Chen, Yanxi, et al.
Published: (2023)

FedCostAware: Enabling Cost-Aware Federated Learning on the Cloud
by: Sinha, Aditya, et al.
Published: (2025)

FedSem: A Resource Allocation Scheme for Federated Learning Assisted Semantic Communication
by: Zhou, Xinyu, et al.
Published: (2025)

EcoFed: Efficient Communication for DNN Partitioning-based Federated Learning
by: Wu, Di, et al.
Published: (2023)

Towards Federated RLHF with Aggregated Client Preference for LLMs
by: Wu, Feijie, et al.
Published: (2024)

FedCache: A Knowledge Cache-driven Federated Learning Architecture for Personalized Edge Intelligence
by: Wu, Zhiyuan, et al.
Published: (2023)

FedCod: An Efficient Communication Protocol for Cross-Silo Federated Learning with Coding
by: Yan, Peishen, et al.
Published: (2024)

FedSZ: Leveraging Error-Bounded Lossy Compression for Federated Learning Communications
by: Wilkins, Grant, et al.
Published: (2023)

CG-FedLLM: How to Compress Gradients in Federated Fune-tuning for Large Language Models
by: Wu, Huiwen, et al.
Published: (2024)

Elastic Mixture of Rank-Wise Experts for Knowledge Reuse in Federated Fine-Tuning
by: Wu, Yebo, et al.
Published: (2025)

Efficient Long Context Fine-tuning with Chunk Flow
by: Yuan, Xiulong, et al.
Published: (2025)

FedOptimus: Optimizing Vertical Federated Learning for Scalability and Efficiency
by: Shrivastava, Nikita, et al.
Published: (2025)

HLoRA: Efficient Federated Learning System for LLM Heterogeneous Fine-Tuning
by: Liu, Qianli, et al.
Published: (2025)

FIARSE: Model-Heterogeneous Federated Learning via Importance-Aware Submodel Extraction
by: Wu, Feijie, et al.
Published: (2024)

Memory-Efficient Federated Fine-Tuning of Large Language Models via Layer Pruning
by: Wu, Yebo, et al.
Published: (2025)

FedFog: Resource-Aware Federated Learning in Edge and Fog Networks
by: Sobati-M, Somayeh
Published: (2025)

FedCDC: A Collaborative Framework for Data Consumers in Federated Learning Market
by: Shi, Zhuan, et al.
Published: (2025)

FedHC: A Hierarchical Clustered Federated Learning Framework for Satellite Networks
by: Liu, Zhuocheng, et al.
Published: (2025)

Communication-Efficient Model Aggregation with Layer Divergence Feedback in Federated Learning
by: Wang, Liwei, et al.
Published: (2024)

Practical Federated Learning without a Server
by: Dhasade, Akash, et al.
Published: (2025)

Semantic-aware Token Selection and Resource Optimization for Communication-efficient Split Federated Fine-tuning in Edge Intelligence
by: Qiang, Xianke, et al.
Published: (2026)

LobRA: Multi-tenant Fine-tuning over Heterogeneous Data
by: Lin, Sheng, et al.
Published: (2025)

FedCal: Achieving Local and Global Calibration in Federated Learning via Aggregated Parameterized Scaler
by: Peng, Hongyi, et al.
Published: (2024)

FedShield-LLM: A Secure and Scalable Federated Fine-Tuned Large Language Model
by: Mia, Md Jueal, et al.
Published: (2025)

EnFed: An Energy-aware Federated Learning in Resource Constrained Environments for Human Activity Recognition
by: Mukherjee, Anwesha, et al.
Published: (2024)

Analysis and Optimization of Wireless Multimodal Federated Learning on Modal Heterogeneity
by: Han, Xuefeng, et al.
Published: (2025)

FedNS: A Fast Sketching Newton-Type Algorithm for Federated Learning
by: Li, Jian, et al.
Published: (2024)

FedQS: Optimizing Gradient and Model Aggregation for Semi-Asynchronous Federated Learning
by: Li, Yunbo, et al.
Published: (2025)

FedEve: On Bridging the Client Drift and Period Drift for Cross-device Federated Learning
by: Shen, Tao, et al.
Published: (2025)

FedMoE-DA: Federated Mixture of Experts via Domain Aware Fine-grained Aggregation
by: Zhan, Ziwei, et al.
Published: (2024)

Air-FedGA: A Grouping Asynchronous Federated Learning Mechanism Exploiting Over-the-air Computation
by: Ma, Qianpiao, et al.
Published: (2025)