Copertina

Federated Learning of Large Language Models with Parameter-Efficient Prompt Tuning and Adaptive Optimization

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Che, Tianshi, Liu, Ji, Zhou, Yang, Ren, Jiaxiang, Zhou, Jiwen, Sheng, Victor S., Dai, Huaiyu, Dou, Dejing
Natura:	Preprint
Pubblicazione:	2023
Soggetti:	Machine Learning Computation and Language Distributed, Parallel, and Cluster Computing
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Efficient Federated Learning with Timely Update Dissemination
di: Jia, Juncheng, et al.
Pubblicazione: (2025)

Efficient Federated Learning with Heterogeneous Data and Adaptive Dropout
di: Liu, Ji, et al.
Pubblicazione: (2025)

Efficient Federated Learning Using Dynamic Update and Adaptive Pruning with Momentum on Shared Server Data
di: Liu, Ji, et al.
Pubblicazione: (2024)

Fisher Information-based Efficient Curriculum Federated Learning with Large Language Models
di: Liu, Ji, et al.
Pubblicazione: (2024)

Efficient Asynchronous Federated Learning with Sparsification and Quantization
di: Jia, Juncheng, et al.
Pubblicazione: (2023)

A Spark Optimizer for Adaptive, Fine-Grained Parameter Tuning
di: Lyu, Chenghao, et al.
Pubblicazione: (2024)

Advancing Hybrid Defense for Byzantine Attacks in Federated Learning
di: Yue, Kai, et al.
Pubblicazione: (2024)

Multi-Modal Style Transfer-based Prompt Tuning for Efficient Federated Domain Generalization
di: Chen, Yuliang, et al.
Pubblicazione: (2026)

A Federated and Parameter-Efficient Framework for Large Language Model Training in Medicine
di: Li, Anran, et al.
Pubblicazione: (2026)

CacheFL: Privacy-Preserving and Efficient Federated Cache Model Fine-Tuning for Vision-Language Models
di: Yi, Mengjun, et al.
Pubblicazione: (2025)

Memory-Efficient Split Federated Learning for LLM Fine-Tuning on Heterogeneous Mobile Devices
di: Chen, Xiaopei, et al.
Pubblicazione: (2025)

Robust Federated Fine-Tuning in Heterogeneous Networks with Unreliable Connections: An Aggregation View
di: Wang, Yanmeng, et al.
Pubblicazione: (2025)

Energy Efficient Federated Learning with Hyperdimensional Computing (HDC)
di: Ding, Yahao, et al.
Pubblicazione: (2026)

EcoLoRA: Communication-Efficient Federated Fine-Tuning of Large Language Models
di: Liu, Han, et al.
Pubblicazione: (2025)

Memory-Efficient Federated Fine-Tuning of Large Language Models via Layer Pruning
di: Wu, Yebo, et al.
Pubblicazione: (2025)

Energy Efficient Federated Learning with Hyperdimensional Computing over Wireless Communication Networks
di: Ding, Yahao, et al.
Pubblicazione: (2026)

Efficient Parameter Tuning for a Structure-Based Virtual Screening HPC Application
di: Guindani, Bruno, et al.
Pubblicazione: (2024)

Problem-Parameter-Free Decentralized Nonconvex Stochastic Optimization
di: Li, Jiaxiang, et al.
Pubblicazione: (2024)

Joint Optimization of Offloading, Batching and DVFS for Multiuser Co-Inference
di: Xu, Yaodan, et al.
Pubblicazione: (2025)

LoRA-C: Parameter-Efficient Fine-Tuning of Robust CNN for IoT Devices
di: Ding, Chuntao, et al.
Pubblicazione: (2024)

CARAT: Client-Side Adaptive RPC and Cache Co-Tuning for Parallel File Systems
di: Rashid, Md Hasanur, et al.
Pubblicazione: (2026)

HLoRA: Efficient Federated Learning System for LLM Heterogeneous Fine-Tuning
di: Liu, Qianli, et al.
Pubblicazione: (2025)

PromptTuner: SLO-Aware Elastic System for LLM Prompt Tuning
di: Gao, Wei, et al.
Pubblicazione: (2026)

Flexible Personalized Split Federated Learning for On-Device Fine-Tuning of Foundation Models
di: Yuan, Tianjun, et al.
Pubblicazione: (2025)

Adaptive Weighting Push-SUM for Decentralized Optimization with Statistical Diversity
di: Zhou, Yiming, et al.
Pubblicazione: (2024)

CFP: Efficient Optimization of Intra-Operator Parallelism Plans for Large Model Training
di: Hu, Weifang, et al.
Pubblicazione: (2025)

FedQuad: Adaptive Layer-wise LoRA Deployment and Activation Quantization for Federated Fine-Tuning
di: Li, Rukuo, et al.
Pubblicazione: (2025)

Energy-Efficient Wireless Federated Learning via Doubly Adaptive Quantization
di: Han, Xuefeng, et al.
Pubblicazione: (2024)

Low-Latency Federated Fine-Tuning for Large Language Models Over Wireless Networks
di: Pang, Zhiwen, et al.
Pubblicazione: (2026)

SplitFT: An Adaptive Federated Split Learning System For LLMs Fine-Tuning
di: Shan, Yimeng, et al.
Pubblicazione: (2026)

Adaptive Parameter-Efficient Federated Fine-Tuning on Heterogeneous Devices
di: Liu, Jun, et al.
Pubblicazione: (2024)

FDLoRA: Personalized Federated Learning of Large Language Model via Dual LoRA Tuning
di: QI, Jiaxing, et al.
Pubblicazione: (2024)

EC2MoE: Adaptive End-Cloud Pipeline Collaboration Enabling Scalable Mixture-of-Experts Inference
di: Yang, Zheming, et al.
Pubblicazione: (2025)

Unleashing Efficient Asynchronous RL Post-Training via Staleness-Constrained Rollout Coordination
di: Li, Haoyang, et al.
Pubblicazione: (2026)

FedCod: An Efficient Communication Protocol for Cross-Silo Federated Learning with Coding
di: Yan, Peishen, et al.
Pubblicazione: (2024)

Review of Mathematical Optimization in Federated Learning
di: Yang, Shusen, et al.
Pubblicazione: (2024)

Federated Fine-Tuning of Sparsely-Activated Large Language Models on Resource-Constrained Devices
di: Chen, Fahao, et al.
Pubblicazione: (2025)

Dynatune: Dynamic Tuning of Raft Election Parameters Using Network Measurement
di: Shiozaki, Kohya, et al.
Pubblicazione: (2025)

Heterogeneous Federated Fine-Tuning with Parallel One-Rank Adaptation
di: Zhang, Zikai, et al.
Pubblicazione: (2026)

LLM-CoOpt: A Co-Design and Optimization Framework for Efficient LLM Inference on Heterogeneous Platforms
di: Kong, Jie, et al.
Pubblicazione: (2026)