Copertina

Exploring Selective Layer Fine-Tuning in Federated Learning

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Sun, Yuchang, Xie, Yuexiang, Ding, Bolin, Li, Yaliang, Zhang, Jun
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning Distributed, Parallel, and Cluster Computing
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Trinity-RFT: A General-Purpose and Unified Framework for Reinforcement Fine-Tuning of Large Language Models
di: Pan, Xuchen, et al.
Pubblicazione: (2025)

Improving LoRA in Privacy-preserving Federated Learning
di: Sun, Youbang, et al.
Pubblicazione: (2024)

FedBiOT: LLM Local Fine-tuning in Federated Learning without Full Model
di: Wu, Feijie, et al.
Pubblicazione: (2024)

Federated Full-Parameter Tuning of Billion-Sized Language Models with Communication Cost under 18 Kilobytes
di: Qin, Zhen, et al.
Pubblicazione: (2023)

How to Collaborate: Towards Maximizing the Generalization Performance in Cross-Silo Federated Learning
di: Sun, Yuchang, et al.
Pubblicazione: (2024)

MimiC: Combating Client Dropouts in Federated Learning by Mimicking Central Updates
di: Sun, Yuchang, et al.
Pubblicazione: (2023)

Learn How to Query from Unlabeled Data Streams in Federated Learning
di: Sun, Yuchang, et al.
Pubblicazione: (2024)

Communication-Efficient Federated Fine-Tuning
di: Theologitis, Michael, et al.
Pubblicazione: (2025)

SplitFT: An Adaptive Federated Split Learning System For LLMs Fine-Tuning
di: Shan, Yimeng, et al.
Pubblicazione: (2026)

EE-LLM: Large-Scale Training and Inference of Early-Exit Large Language Models with 3D Parallelism
di: Chen, Yanxi, et al.
Pubblicazione: (2023)

The Impact of Cut Layer Selection in Split Federated Learning
di: Dachille, Justin, et al.
Pubblicazione: (2024)

Flexible Personalized Split Federated Learning for On-Device Fine-Tuning of Foundation Models
di: Yuan, Tianjun, et al.
Pubblicazione: (2025)

Revisiting Federated Fine-Tuning: A Single Communication Round is Enough for Foundation Models
di: Wang, Ziyao, et al.
Pubblicazione: (2024)

FLoRA: Federated Fine-Tuning Large Language Models with Heterogeneous Low-Rank Adaptations
di: Wang, Ziyao, et al.
Pubblicazione: (2024)

Stabilizing Decentralized Federated Fine-Tuning via Topology-Aware Alternating LoRA
di: Wang, Xiaoyu, et al.
Pubblicazione: (2026)

CHASe: Client Heterogeneity-Aware Data Selection for Effective Federated Active Learning
di: Zhang, Jun, et al.
Pubblicazione: (2025)

Accelerating Federated Learning by Selecting Beneficial Herd of Local Gradients
di: Luo, Ping, et al.
Pubblicazione: (2024)

Fed-pilot: Optimizing LoRA Allocation for Efficient Federated Fine-Tuning with Heterogeneous Clients
di: Zhang, Zikai, et al.
Pubblicazione: (2024)

Efficient Federated Fine-Tuning of Large Language Models with Layer Dropout
di: Wang, Shilong, et al.
Pubblicazione: (2025)

Mitigating Catastrophic Forgetting with Adaptive Transformer Block Expansion in Federated Fine-Tuning
di: Huo, Yujia, et al.
Pubblicazione: (2025)

Fed-HeLLo: Efficient Federated Foundation Model Fine-Tuning with Heterogeneous LoRA Allocation
di: Zhang, Zikai, et al.
Pubblicazione: (2025)

Communication-Efficient Multimodal Federated Learning: Joint Modality and Client Selection
di: Yuan, Liangqi, et al.
Pubblicazione: (2024)

Ranking-based Client Selection with Imitation Learning for Efficient Federated Learning
di: Tian, Chunlin, et al.
Pubblicazione: (2024)

Vertical Federated Learning: Challenges, Methodologies and Experiments
di: Wei, Kang, et al.
Pubblicazione: (2022)

A Survey on Federated Fine-tuning of Large Language Models
di: Wu, Yebo, et al.
Pubblicazione: (2025)

Robust Model Aggregation for Heterogeneous Federated Learning: Analysis and Optimizations
di: Shao, Yumeng, et al.
Pubblicazione: (2024)

A Closer Look at Personalized Fine-Tuning in Heterogeneous Federated Learning
di: Chen, Minghui, et al.
Pubblicazione: (2025)

Achieving Linear Speedup in Asynchronous Federated Learning with Heterogeneous Clients
di: Wang, Xiaolu, et al.
Pubblicazione: (2024)

Learning Like Humans: Resource-Efficient Federated Fine-Tuning through Cognitive Developmental Stages
di: Wu, Yebo, et al.
Pubblicazione: (2025)

pFedLoRA: Model-Heterogeneous Personalized Federated Learning with LoRA Tuning
di: Yi, Liping, et al.
Pubblicazione: (2023)

Emulating Full Participation: An Effective and Fair Client Selection Strategy for Federated Learning
di: Li, Qingming, et al.
Pubblicazione: (2024)

CLLoRA: An Approach to Measure the Effects of the Context Length for LLM Fine-Tuning
di: Zhang, Ping, et al.
Pubblicazione: (2025)

Tackling Privacy Heterogeneity in Differentially Private Federated Learning
di: Xu, Ruichen, et al.
Pubblicazione: (2026)

Device Scheduling and Assignment in Hierarchical Federated Learning for Internet of Things
di: Zhang, Tinghao, et al.
Pubblicazione: (2024)

TSFLora: Token-Compressed Split Fine-Tuning for Wireless Edge Networks
di: Qiang, Xianke, et al.
Pubblicazione: (2026)

Adaptive Client Selection via Q-Learning-based Whittle Index in Wireless Federated Learning
di: Li, Qiyue, et al.
Pubblicazione: (2025)

FedEx: Expediting Federated Learning over Heterogeneous Mobile Devices by Overlapping and Participant Selection
di: Geng, Jiaxiang, et al.
Pubblicazione: (2024)

Towards Communication-efficient Federated Learning via Sparse and Aligned Adaptive Optimization
di: Deng, Xiumei, et al.
Pubblicazione: (2024)

Maverick-Aware Shapley Valuation for Client Selection in Federated Learning
di: Yang, Mengwei, et al.
Pubblicazione: (2024)

Adaptive Client Selection with Personalization for Communication Efficient Federated Learning
di: de Souza, Allan M., et al.
Pubblicazione: (2024)