Image de couverture de livre

FeDeRA:Efficient Fine-tuning of Language Models in Federated Learning Leveraging Weight Decomposition

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Yan, Yuxuan, Yang, Qianqian, Tang, Shunpu, Shi, Zhiguo
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning Artificial Intelligence Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models
par: Chen, Yukang, et autres
Publié: (2023)

CoVSpec: Efficient Device-Edge Co-Inference for Vision-Language Models via Speculative Decoding
par: Jia, Yuanyuan, et autres
Publié: (2026)

MixLoRA: Enhancing Large Language Models Fine-Tuning with LoRA-based Mixture of Experts
par: Li, Dengchun, et autres
Publié: (2024)

LoRA-Leak: Membership Inference Attacks Against LoRA Fine-tuned Language Models
par: Ran, Delong, et autres
Publié: (2025)

ShareLoRA: Parameter Efficient and Robust Large Language Model Fine-tuning via Shared Low-Rank Adaptation
par: Song, Yurun, et autres
Publié: (2024)

RoLoRA: Fine-tuning Rotated Outlier-free LLMs for Effective Weight-Activation Quantization
par: Huang, Xijie, et autres
Publié: (2024)

LaFFi: Leveraging Hybrid Natural Language Feedback for Fine-tuning Language Models
par: Li, Qianxi, et autres
Publié: (2023)

HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning
par: Tian, Chunlin, et autres
Publié: (2024)

DLP-LoRA: Efficient Task-Specific LoRA Fusion with a Dynamic, Lightweight Plugin for Large Language Models
par: Zhang, Yuxuan, et autres
Publié: (2024)

KnowTuning: Knowledge-aware Fine-tuning for Large Language Models
par: Lyu, Yougang, et autres
Publié: (2024)

Federated Co-tuning Framework for Large and Small Language Models
par: Fan, Tao, et autres
Publié: (2024)

Federated Fine-tuning of Large Language Models under Heterogeneous Tasks and Client Resources
par: Bai, Jiamu, et autres
Publié: (2024)

Systematic Analysis for Pretrained Language Model Priming for Parameter-Efficient Fine-tuning
par: Huang, Shih-Cheng, et autres
Publié: (2022)

STAR: Constraint LoRA with Dynamic Active Learning for Data-Efficient Fine-Tuning of Large Language Models
par: Zhang, Linhai, et autres
Publié: (2024)

EoRA: Fine-tuning-free Compensation for Compressed LLM with Eigenspace Low-Rank Approximation
par: Liu, Shih-Yang, et autres
Publié: (2024)

Efficient End-to-end Language Model Fine-tuning on Graphs
par: Xue, Rui, et autres
Publié: (2023)

Exploring Memorization in Fine-tuned Language Models
par: Zeng, Shenglai, et autres
Publié: (2023)

Learning Rate Matters: Vanilla LoRA May Suffice for LLM Fine-tuning
par: Lee, Yu-Ang, et autres
Publié: (2026)

EDoRA: Efficient Weight-Decomposed Low-Rank Adaptation via Singular Value Decomposition
par: Nasiri, Hamid, et autres
Publié: (2025)

Semi-supervised Fine-tuning for Large Language Models
par: Luo, Junyu, et autres
Publié: (2024)

DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning
par: Shi, Zhengxiang, et autres
Publié: (2023)

Fine-tuning Language Models for Recipe Generation: A Comparative Analysis and Benchmark Study
par: Vij, Anneketh, et autres
Publié: (2025)

MSPLoRA: A Multi-Scale Pyramid Low-Rank Adaptation for Efficient Model Fine-Tuning
par: Zhao, Jiancheng, et autres
Publié: (2025)

Sensitivity of Small Language Models to Fine-tuning Data Contamination
par: Scaria, Nicy, et autres
Publié: (2025)

HypeLoRA: Hyper-Network-Generated LoRA Adapters for Calibrated Language Model Fine-Tuning
par: Trojan, Bartosz, et autres
Publié: (2026)

Fine-tuning Small Language Models as Efficient Enterprise Search Relevance Labelers
par: Kang, Yue, et autres
Publié: (2026)

PeFoMed: Parameter Efficient Fine-tuning of Multimodal Large Language Models for Medical Imaging
par: He, Jinlong, et autres
Publié: (2024)

Taming Sensitive Weights : Noise Perturbation Fine-tuning for Robust LLM Quantization
par: Wang, Dongwei, et autres
Publié: (2024)

Chinese Essay Rhetoric Recognition Using LoRA, In-context Learning and Model Ensemble
par: Lai, Yuxuan, et autres
Publié: (2026)

Panacea: Mitigating Harmful Fine-tuning for Large Language Models via Post-fine-tuning Perturbation
par: Wang, Yibo, et autres
Publié: (2025)

Efficient Model Development through Fine-tuning Transfer
par: Lin, Pin-Jie, et autres
Publié: (2025)

Learning Fine-Grained Grounded Citations for Attributed Large Language Models
par: Huang, Lei, et autres
Publié: (2024)

Progtuning: Progressive Fine-tuning Framework for Transformer-based Language Models
par: Ji, Xiaoshuang, et autres
Publié: (2025)

JudgeLM: Fine-tuned Large Language Models are Scalable Judges
par: Zhu, Lianghui, et autres
Publié: (2023)

Dhati+: Fine-tuned Large Language Models for Arabic Subjectivity Evaluation
par: Bellaouar, Slimane, et autres
Publié: (2025)

Compositional Subspace Representation Fine-tuning for Adaptive Large Language Models
par: Zhou, Andy
Publié: (2025)

Plug-in and Fine-tuning: Bridging the Gap between Small Language Models and Large Language Models
par: Kim, Kyeonghyun, et autres
Publié: (2025)

Small Language Models Fine-tuned to Coordinate Larger Language Models improve Complex Reasoning
par: Juneja, Gurusha, et autres
Publié: (2023)

Advancing Single and Multi-task Text Classification through Large Language Model Fine-tuning
par: Zhao, Hang, et autres
Publié: (2024)

Information Guided Regularization for Fine-tuning Language Models
par: Sharma, Mandar, et autres
Publié: (2024)