Image de couverture de livre

Communication-Efficient and Tensorized Federated Fine-Tuning of Large Language Models

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Ghiasvand, Sajjad, Yang, Yifan, Xue, Zhiyu, Alizadeh, Mahnoosh, Zhang, Zheng, Pedarsani, Ramtin
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

pFedMMA: Personalized Federated Fine-Tuning with Multi-Modal Adapter for Vision-Language Models
par: Ghiasvand, Sajjad, et autres
Publié: (2025)

Decentralized Low-Rank Fine-Tuning of Large Language Models
par: Ghiasvand, Sajjad, et autres
Publié: (2025)

REALM: Reliable Expertise-Aware Language Model Fine-Tuning from Noisy Annotations
par: Ghiasvand, Sajjad, et autres
Publié: (2026)

Few-Shot Adversarial Low-Rank Fine-Tuning of Vision-Language Models
par: Ghiasvand, Sajjad, et autres
Publié: (2025)

MMLoP: Multi-Modal Low-Rank Prompting for Efficient Vision-Language Adaptation
par: Ghiasvand, Sajjad, et autres
Publié: (2026)

Robust Decentralized Learning with Local Updates and Gradient Tracking
par: Ghiasvand, Sajjad, et autres
Publié: (2024)

The Safety-Privacy Tradeoff in Linear Bandits
par: Zibaie, Arghavan, et autres
Publié: (2025)

AdaZeta: Adaptive Zeroth-Order Tensor-Train Adaption for Memory-Efficient Large Language Models Fine-Tuning
par: Yang, Yifan, et autres
Publié: (2024)

LoRETTA: Low-Rank Economic Tensor-Train Adaptation for Ultra-Low-Parameter Fine-Tuning of Large Language Models
par: Yang, Yifan, et autres
Publié: (2024)

Simultaneous Computation and Memory Efficient Zeroth-Order Optimizer for Fine-Tuning Large Language Models
par: Wang, Fei, et autres
Publié: (2024)

SPP: Sparsity-Preserved Parameter-Efficient Fine-Tuning for Large Language Models
par: Lu, Xudong, et autres
Publié: (2024)

Multi-Bin Batching for Increasing LLM Inference Throughput
par: Guldogan, Ozgur, et autres
Publié: (2024)

Dissecting Fine-Tuning Unlearning in Large Language Models
par: Hong, Yihuai, et autres
Publié: (2024)

Dynamic Adaptation of LoRA Fine-Tuning for Efficient and Task-Specific Optimization of Large Language Models
par: Liao, Xiaoxuan, et autres
Publié: (2025)

Federated Fine-Tuning of Large Language Models: Kahneman-Tversky vs. Direct Preference Optimization
par: Spadea, Fernando, et autres
Publié: (2025)

Crafting Efficient Fine-Tuning Strategies for Large Language Models
par: Oliver, Michael, et autres
Publié: (2024)

The Fair Value of Data Under Heterogeneous Privacy Constraints in Federated Learning
par: Kang, Justin, et autres
Publié: (2023)

Empirical Analysis of Efficient Fine-Tuning Methods for Large Pre-Trained Language Models
par: Doering, Nigel, et autres
Publié: (2024)

Less but Better: Parameter-Efficient Fine-Tuning of Large Language Models for Personality Detection
par: Shen, Lingzhi, et autres
Publié: (2025)

Conflict-Aware Adversarial Training
par: Xue, Zhiyu, et autres
Publié: (2024)

TPP-LLM: Modeling Temporal Point Processes by Efficiently Fine-Tuning Large Language Models
par: Liu, Zefang, et autres
Publié: (2024)

Parameter-Efficient Fine-Tuning for Foundation Models
par: Zhang, Dan, et autres
Publié: (2025)

Federated Data-Efficient Instruction Tuning for Large Language Models
par: Qin, Zhen, et autres
Publié: (2024)

Parameter-Efficient Tuning Large Language Models for Graph Representation Learning
par: Zhu, Qi, et autres
Publié: (2024)

L4Q: Parameter Efficient Quantization-Aware Fine-Tuning on Large Language Models
par: Jeon, Hyesung, et autres
Publié: (2024)

Boosting Large Language Models with Mask Fine-Tuning
par: Zhang, Mingyuan, et autres
Publié: (2025)

Personalized Collaborative Fine-Tuning for On-Device Large Language Models
par: Wagner, Nicolas, et autres
Publié: (2024)

How Multilingual Are Large Language Models Fine-Tuned for Translation?
par: Richburg, Aquia, et autres
Publié: (2024)

SVFit: Parameter-Efficient Fine-Tuning of Large Pre-Trained Models Using Singular Values
par: Sun, Chengwei, et autres
Publié: (2024)

Energy-Efficient Split Learning for Fine-Tuning Large Language Models in Edge Networks
par: Li, Zuguang, et autres
Publié: (2024)

Parameter-Efficient Fine-Tuning in Large Models: A Survey of Methodologies
par: Wang, Luping, et autres
Publié: (2024)

SplitLoRA: A Split Parameter-Efficient Fine-Tuning Framework for Large Language Models
par: Lin, Zheng, et autres
Publié: (2024)

On the Convergence of Zeroth-Order Federated Tuning for Large Language Models
par: Ling, Zhenqing, et autres
Publié: (2024)

Fine-Tuning Large Language Models to Appropriately Abstain with Semantic Entropy
par: Tjandra, Benedict Aaron, et autres
Publié: (2024)

Hyperbolic Fine-Tuning for Large Language Models
par: Yang, Menglin, et autres
Publié: (2024)

Comparative Analysis of Different Efficient Fine Tuning Methods of Large Language Models (LLMs) in Low-Resource Setting
par: Srinivasan, Krishna Prasad Varadarajan, et autres
Publié: (2024)

LoRA-SP: Streamlined Partial Parameter Adaptation for Resource-Efficient Fine-Tuning of Large Language Models
par: Wu, Yichao, et autres
Publié: (2024)

Improving Large Language Models with Concept-Aware Fine-Tuning
par: Chen, Michael K., et autres
Publié: (2025)

Federated Learning of Large Language Models with Parameter-Efficient Prompt Tuning and Adaptive Optimization
par: Che, Tianshi, et autres
Publié: (2023)

Multilingual OCR-Aware Fine-Tuning and Prompt-Guided Chain-of-Thought Reasoning for Multimodal Large Language Models
par: Xu, Qinwu, et autres
Publié: (2026)