Image de couverture de livre

FedSRD: Sparsify-Reconstruct-Decompose for Communication-Efficient Federated Large Language Models Fine-Tuning

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Yan, Guochen, Xie, Luyuan, Shen, Qingni, Fang, Yuejian, Wu, Zhonghai
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

FedVCK: Non-IID Robust and Communication-Efficient Federated Learning via Valuable Condensed Knowledge for Medical Image Analysis
par: Yan, Guochen, et autres
Publié: (2024)

Personalized One-shot Federated Graph Learning for Heterogeneous Clients
par: Yan, Guochen, et autres
Publié: (2024)

MH-pFLID: Model Heterogeneous personalized Federated Learning via Injection and Distillation for Medical Data Analysis
par: Xie, Luyuan, et autres
Publié: (2024)

dFLMoE: Decentralized Federated Learning via Mixture of Experts for Medical Data Analysis
par: Xie, Luyuan, et autres
Publié: (2025)

TRLS: A Time Series Representation Learning Framework via Spectrogram for Medical Signal Processing
par: Xie, Luyuan, et autres
Publié: (2024)

pFLFE: Cross-silo Personalized Federated Learning via Feature Enhancement on Medical Image Segmentation
par: Xie, Luyuan, et autres
Publié: (2024)

MH-pFLGB: Model Heterogeneous personalized Federated Learning via Global Bypass for Medical Image Analysis
par: Xie, Luyuan, et autres
Publié: (2024)

Communication-Efficient and Tensorized Federated Fine-Tuning of Large Language Models
par: Ghiasvand, Sajjad, et autres
Publié: (2024)

Exploring Information Seeking Agent Consolidation
par: Yan, Guochen, et autres
Publié: (2026)

FedCoT: Communication-Efficient Federated Reasoning Enhancement for Large Language Models
par: Li, Chuan, et autres
Publié: (2025)

FedKRSO: Communication and Memory Efficient Federated Fine-Tuning of Large Language Models
par: Yang, Guohao, et autres
Publié: (2026)

FlowerTune: A Cross-Domain Benchmark for Federated Fine-Tuning of Large Language Models
par: Gao, Yan, et autres
Publié: (2025)

FedDTPT: Federated Discrete and Transferable Prompt Tuning for Black-Box Large Language Models
par: Wu, Jiaqi, et autres
Publié: (2024)

FedEx-LoRA: Exact Aggregation for Federated and Efficient Fine-Tuning of Foundation Models
par: Singhal, Raghav, et autres
Publié: (2024)

ADePT: Adaptive Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning
par: Tang, Pengwei, et autres
Publié: (2025)

Federated Data-Efficient Instruction Tuning for Large Language Models
par: Qin, Zhen, et autres
Publié: (2024)

Learning to Check: Unleashing Potentials for Self-Correction in Large Language Models
par: Zhang, Che, et autres
Publié: (2024)

FedJudge: Federated Legal Large Language Model
par: Yue, Linan, et autres
Publié: (2023)

FedPT: Federated Proxy-Tuning of Large Language Models on Resource-Constrained Edge Devices
par: Gao, Zhidong, et autres
Publié: (2024)

Enhancing Large Language Model with Decomposed Reasoning for Emotion Cause Pair Extraction
par: Wu, Jialiang, et autres
Publié: (2024)

Parameter-Efficient Fine-Tuning of Large Language Models using Semantic Knowledge Tuning
par: Prottasha, Nusrat Jahan, et autres
Publié: (2024)

Less but Better: Parameter-Efficient Fine-Tuning of Large Language Models for Personality Detection
par: Shen, Lingzhi, et autres
Publié: (2025)

Reversing Large Language Models for Efficient Training and Fine-Tuning
par: Gal, Eshed, et autres
Publié: (2025)

HFT: Half Fine-Tuning for Large Language Models
par: Hui, Tingfeng, et autres
Publié: (2024)

FedCoT: Federated Chain-of-Thought Distillation for Large Language Models
par: Fan, Tao, et autres
Publié: (2024)

Reconstructing Item Characteristic Curves using Fine-Tuned Large Language Models
par: Ormerod, Christopher
Publié: (2026)

Dynamics of Instruction Fine-Tuning for Chinese Large Language Models
par: Song, Chiyu, et autres
Publié: (2023)

Simultaneous Computation and Memory Efficient Zeroth-Order Optimizer for Fine-Tuning Large Language Models
par: Wang, Fei, et autres
Publié: (2024)

Crafting Efficient Fine-Tuning Strategies for Large Language Models
par: Oliver, Michael, et autres
Publié: (2024)

LaMDA: Large Model Fine-Tuning via Spectrally Decomposed Low-Dimensional Adaptation
par: Azizi, Seyedarmin, et autres
Publié: (2024)

Structure-Learnable Adapter Fine-Tuning for Parameter-Efficient Large Language Models
par: Gong, Ming, et autres
Publié: (2025)

Efficient Fine-Tuning of Large Language Models for Automated Medical Documentation
par: Leong, Hui Yi, et autres
Publié: (2024)

FedMKT: Federated Mutual Knowledge Transfer for Large and Small Language Models
par: Fan, Tao, et autres
Publié: (2024)

Consensus-Aligned Neuron Efficient Fine-Tuning Large Language Models for Multi-Domain Machine Translation
par: Jiang, Shuting, et autres
Publié: (2026)

DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning
par: Shi, Zhengxiang, et autres
Publié: (2023)

MeTA-LoRA: Data-Efficient Multi-Task Fine-Tuning for Large Language Models
par: Cheng, Bo, et autres
Publié: (2025)

On the Convergence of Zeroth-Order Federated Tuning for Large Language Models
par: Ling, Zhenqing, et autres
Publié: (2024)

HBO: Hierarchical Balancing Optimization for Fine-Tuning Large Language Models
par: Wang, Weixuan, et autres
Publié: (2025)

Impact of Fine-Tuning Methods on Memorization in Large Language Models
par: Hou, Jie, et autres
Publié: (2025)

MoA: Heterogeneous Mixture of Adapters for Parameter-Efficient Fine-Tuning of Large Language Models
par: Cao, Jie, et autres
Publié: (2025)