Copertina

Communication-Efficient and Tensorized Federated Fine-Tuning of Large Language Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Ghiasvand, Sajjad, Yang, Yifan, Xue, Zhiyu, Alizadeh, Mahnoosh, Zhang, Zheng, Pedarsani, Ramtin
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

pFedMMA: Personalized Federated Fine-Tuning with Multi-Modal Adapter for Vision-Language Models
di: Ghiasvand, Sajjad, et al.
Pubblicazione: (2025)

Decentralized Low-Rank Fine-Tuning of Large Language Models
di: Ghiasvand, Sajjad, et al.
Pubblicazione: (2025)

REALM: Reliable Expertise-Aware Language Model Fine-Tuning from Noisy Annotations
di: Ghiasvand, Sajjad, et al.
Pubblicazione: (2026)

Few-Shot Adversarial Low-Rank Fine-Tuning of Vision-Language Models
di: Ghiasvand, Sajjad, et al.
Pubblicazione: (2025)

MMLoP: Multi-Modal Low-Rank Prompting for Efficient Vision-Language Adaptation
di: Ghiasvand, Sajjad, et al.
Pubblicazione: (2026)

Robust Decentralized Learning with Local Updates and Gradient Tracking
di: Ghiasvand, Sajjad, et al.
Pubblicazione: (2024)

The Safety-Privacy Tradeoff in Linear Bandits
di: Zibaie, Arghavan, et al.
Pubblicazione: (2025)

AdaZeta: Adaptive Zeroth-Order Tensor-Train Adaption for Memory-Efficient Large Language Models Fine-Tuning
di: Yang, Yifan, et al.
Pubblicazione: (2024)

LoRETTA: Low-Rank Economic Tensor-Train Adaptation for Ultra-Low-Parameter Fine-Tuning of Large Language Models
di: Yang, Yifan, et al.
Pubblicazione: (2024)

Simultaneous Computation and Memory Efficient Zeroth-Order Optimizer for Fine-Tuning Large Language Models
di: Wang, Fei, et al.
Pubblicazione: (2024)

SPP: Sparsity-Preserved Parameter-Efficient Fine-Tuning for Large Language Models
di: Lu, Xudong, et al.
Pubblicazione: (2024)

Multi-Bin Batching for Increasing LLM Inference Throughput
di: Guldogan, Ozgur, et al.
Pubblicazione: (2024)

Dissecting Fine-Tuning Unlearning in Large Language Models
di: Hong, Yihuai, et al.
Pubblicazione: (2024)

Dynamic Adaptation of LoRA Fine-Tuning for Efficient and Task-Specific Optimization of Large Language Models
di: Liao, Xiaoxuan, et al.
Pubblicazione: (2025)

Federated Fine-Tuning of Large Language Models: Kahneman-Tversky vs. Direct Preference Optimization
di: Spadea, Fernando, et al.
Pubblicazione: (2025)

Crafting Efficient Fine-Tuning Strategies for Large Language Models
di: Oliver, Michael, et al.
Pubblicazione: (2024)

The Fair Value of Data Under Heterogeneous Privacy Constraints in Federated Learning
di: Kang, Justin, et al.
Pubblicazione: (2023)

Empirical Analysis of Efficient Fine-Tuning Methods for Large Pre-Trained Language Models
di: Doering, Nigel, et al.
Pubblicazione: (2024)

Less but Better: Parameter-Efficient Fine-Tuning of Large Language Models for Personality Detection
di: Shen, Lingzhi, et al.
Pubblicazione: (2025)

TPP-LLM: Modeling Temporal Point Processes by Efficiently Fine-Tuning Large Language Models
di: Liu, Zefang, et al.
Pubblicazione: (2024)

Conflict-Aware Adversarial Training
di: Xue, Zhiyu, et al.
Pubblicazione: (2024)

Parameter-Efficient Fine-Tuning for Foundation Models
di: Zhang, Dan, et al.
Pubblicazione: (2025)

Federated Data-Efficient Instruction Tuning for Large Language Models
di: Qin, Zhen, et al.
Pubblicazione: (2024)

Parameter-Efficient Tuning Large Language Models for Graph Representation Learning
di: Zhu, Qi, et al.
Pubblicazione: (2024)

L4Q: Parameter Efficient Quantization-Aware Fine-Tuning on Large Language Models
di: Jeon, Hyesung, et al.
Pubblicazione: (2024)

Boosting Large Language Models with Mask Fine-Tuning
di: Zhang, Mingyuan, et al.
Pubblicazione: (2025)

Personalized Collaborative Fine-Tuning for On-Device Large Language Models
di: Wagner, Nicolas, et al.
Pubblicazione: (2024)

How Multilingual Are Large Language Models Fine-Tuned for Translation?
di: Richburg, Aquia, et al.
Pubblicazione: (2024)

SVFit: Parameter-Efficient Fine-Tuning of Large Pre-Trained Models Using Singular Values
di: Sun, Chengwei, et al.
Pubblicazione: (2024)

Energy-Efficient Split Learning for Fine-Tuning Large Language Models in Edge Networks
di: Li, Zuguang, et al.
Pubblicazione: (2024)

Parameter-Efficient Fine-Tuning in Large Models: A Survey of Methodologies
di: Wang, Luping, et al.
Pubblicazione: (2024)

SplitLoRA: A Split Parameter-Efficient Fine-Tuning Framework for Large Language Models
di: Lin, Zheng, et al.
Pubblicazione: (2024)

On the Convergence of Zeroth-Order Federated Tuning for Large Language Models
di: Ling, Zhenqing, et al.
Pubblicazione: (2024)

Fine-Tuning Large Language Models to Appropriately Abstain with Semantic Entropy
di: Tjandra, Benedict Aaron, et al.
Pubblicazione: (2024)

Hyperbolic Fine-Tuning for Large Language Models
di: Yang, Menglin, et al.
Pubblicazione: (2024)

Comparative Analysis of Different Efficient Fine Tuning Methods of Large Language Models (LLMs) in Low-Resource Setting
di: Srinivasan, Krishna Prasad Varadarajan, et al.
Pubblicazione: (2024)

LoRA-SP: Streamlined Partial Parameter Adaptation for Resource-Efficient Fine-Tuning of Large Language Models
di: Wu, Yichao, et al.
Pubblicazione: (2024)

Improving Large Language Models with Concept-Aware Fine-Tuning
di: Chen, Michael K., et al.
Pubblicazione: (2025)

Federated Learning of Large Language Models with Parameter-Efficient Prompt Tuning and Adaptive Optimization
di: Che, Tianshi, et al.
Pubblicazione: (2023)

Multilingual OCR-Aware Fine-Tuning and Prompt-Guided Chain-of-Thought Reasoning for Multimodal Large Language Models
di: Xu, Qinwu, et al.
Pubblicazione: (2026)