Image de couverture de livre

Optimizing Cross-Client Domain Coverage for Federated Instruction Tuning of Large Language Models

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Wang, Zezhou, Du, Yaxin, Ma, Xingjun, Jiang, Yugang, Qian, Zhuzhong, Chen, Siheng
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning Computation and Language Distributed, Parallel, and Cluster Computing
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Federated Cross-Domain Click-Through Rate Prediction With Large Language Model Augmentation
par: Qin, Jiangcheng, et autres
Publié: (2025)

OpenFedLLM: Training Large Language Models on Decentralized Private Data via Federated Learning
par: Ye, Rui, et autres
Publié: (2024)

Towards Building the Federated GPT: Federated Instruction Tuning
par: Zhang, Jianyi, et autres
Publié: (2023)

FedCAda: Adaptive Client-Side Optimization for Accelerated and Stable Federated Learning
par: Zhou, Liuzhi, et autres
Publié: (2024)

Federated Learning of Large Language Models with Parameter-Efficient Prompt Tuning and Adaptive Optimization
par: Che, Tianshi, et autres
Publié: (2023)

Enhancing Data Quality in Federated Fine-Tuning of Foundation Models
par: Zhao, Wanru, et autres
Publié: (2024)

FedLLM-Bench: Realistic Benchmarks for Federated Learning of Large Language Models
par: Ye, Rui, et autres
Publié: (2024)

A Federated and Parameter-Efficient Framework for Large Language Model Training in Medicine
par: Li, Anran, et autres
Publié: (2026)

Towards Federated RLHF with Aggregated Client Preference for LLMs
par: Wu, Feijie, et autres
Publié: (2024)

FDLoRA: Personalized Federated Learning of Large Language Model via Dual LoRA Tuning
par: QI, Jiaxing, et autres
Publié: (2024)

Can LoRA Fusion Support Cross-Domain Tasks in Cloud-Edge Collaboration?
par: Wang, Yatong, et autres
Publié: (2026)

Dynamic Client Clustering, Bandwidth Allocation, and Workload Optimization for Semi-synchronous Federated Learning
par: Yu, Liangkun, et autres
Publié: (2024)

Optimization of Federated Learning's Client Selection for Non-IID Data Based on Grey Relational Analysis
par: Chen, Shuaijun, et autres
Publié: (2023)

EcoLoRA: Communication-Efficient Federated Fine-Tuning of Large Language Models
par: Liu, Han, et autres
Publié: (2025)

Memory-Efficient Federated Fine-Tuning of Large Language Models via Layer Pruning
par: Wu, Yebo, et autres
Publié: (2025)

Low-Latency Federated Fine-Tuning for Large Language Models Over Wireless Networks
par: Pang, Zhiwen, et autres
Publié: (2026)

Assortment of Attention Heads: Accelerating Federated PEFT with Head Pruning and Strategic Client Selection
par: Venkatesha, Yeshwanth, et autres
Publié: (2025)

Fed-pilot: Optimizing LoRA Allocation for Efficient Federated Fine-Tuning with Heterogeneous Clients
par: Zhang, Zikai, et autres
Publié: (2024)

Inference Acceleration for Large Language Models on CPUs
par: PS, Ditto, et autres
Publié: (2024)

Bridging Memory Gaps: Scaling Federated Learning for Heterogeneous Clients
par: Wu, Yebo, et autres
Publié: (2024)

Multi-Modal Style Transfer-based Prompt Tuning for Efficient Federated Domain Generalization
par: Chen, Yuliang, et autres
Publié: (2026)

DeInfer: Efficient Parallel Inferencing for Decomposed Large Language Models
par: Huang, You-Liang, et autres
Publié: (2026)

Data Heterogeneity-Aware Client Selection for Federated Learning in Wireless Networks
par: Yang, Yanbing, et autres
Publié: (2025)

Mapple: A Domain-Specific Language for Mapping Distributed Programs
par: Wei, Anjiang, et autres
Publié: (2025)

Energy-Efficient Split Learning for Fine-Tuning Large Language Models in Edge Networks
par: Li, Zuguang, et autres
Publié: (2024)

Distributed Bilevel Optimization with Dual Pruning for Resource-limited Clients
par: Li, Mingyi, et autres
Publié: (2025)

LUT-GEMM: Quantized Matrix Multiplication based on LUTs for Efficient Inference in Large-Scale Generative Language Models
par: Park, Gunho, et autres
Publié: (2022)

Beyond the Federation: Topology-aware Federated Learning for Generalization to Unseen Clients
par: Ma, Mengmeng, et autres
Publié: (2024)

Pollen: High-throughput Federated Learning Simulation via Resource-Aware Client Placement
par: Sani, Lorenzo, et autres
Publié: (2023)

DLoRA: Distributed Parameter-Efficient Fine-Tuning Solution for Large Language Model
par: Gao, Chao, et autres
Publié: (2024)

CAFL-L: Constraint-Aware Federated Learning with Lagrangian Dual Optimization for On-Device Language Models
par: Zheng, Dongqi, et autres
Publié: (2025)

Optimizing RLHF Training for Large Language Models with Stage Fusion
par: Zhong, Yinmin, et autres
Publié: (2024)

SplitLoRA: A Split Parameter-Efficient Fine-Tuning Framework for Large Language Models
par: Lin, Zheng, et autres
Publié: (2024)

Trinity-RFT: A General-Purpose and Unified Framework for Reinforcement Fine-Tuning of Large Language Models
par: Pan, Xuchen, et autres
Publié: (2025)

Split Fine-Tuning for Large Language Models in Wireless Networks
par: Zhang, Songge, et autres
Publié: (2025)

Towards Resiliency in Large Language Model Serving with KevlarFlow
par: Qian, Shangshu, et autres
Publié: (2026)

FedSEA-LLaMA: A Secure, Efficient and Adaptive Federated Splitting Framework for Large Language Models
par: Zhang, Zishuai, et autres
Publié: (2025)

CacheFL: Privacy-Preserving and Efficient Federated Cache Model Fine-Tuning for Vision-Language Models
par: Yi, Mengjun, et autres
Publié: (2025)

Adaptive Federated Learning with Auto-Tuned Clients
par: Kim, Junhyung Lyle, et autres
Publié: (2023)

FedEve: On Bridging the Client Drift and Period Drift for Cross-device Federated Learning
par: Shen, Tao, et autres
Publié: (2025)