Cover Image

Beyond Parameter Aggregation: Semantic Consensus for Federated Fine-Tuning of LLMs

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Abourayya, Amr, Kleesiek, Jens, Kamp, Michael
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Whom to Trust? Adaptive Collaboration in Personalized Federated Learning
by: Abourayya, Amr, et al.
Published: (2025)

Little is Enough: Boosting Privacy by Sharing Only Hard Labels in Federated Semi-Supervised Learning
by: Abourayya, Amr, et al.
Published: (2023)

Flatness is Necessary, Neural Collapse is Not: Rethinking Generalization via Grokking
by: Han, Ting, et al.
Published: (2025)

Federated Majorize-Minimization: Beyond Parameter Aggregation
by: Dieuleveut, Aymeric, et al.
Published: (2025)

FedReFT: Federated Representation Fine-Tuning with All-But-Me Aggregation
by: Siddika, Fatema, et al.
Published: (2025)

Federated Fine-Tuning of LLMs: Framework Comparison and Research Directions
by: Yan, Na, et al.
Published: (2025)

From LLMs to Edge: Parameter-Efficient Fine-Tuning on Edge Devices
by: Slamanig, Georg, et al.
Published: (2025)

Automated Federated Pipeline for Parameter-Efficient Fine-Tuning of Large Language Models
by: Fang, Zihan, et al.
Published: (2024)

A Survey on Parameter-Efficient Fine-Tuning for Foundation Models in Federated Learning
by: Bian, Jieming, et al.
Published: (2025)

FedSelect: Personalized Federated Learning with Customized Selection of Parameters for Fine-Tuning
by: Tamirisa, Rishub, et al.
Published: (2024)

Personalized Federated Fine-Tuning for LLMs via Data-Driven Heterogeneous Model Architectures
by: Zhang, Yicheng, et al.
Published: (2024)

Look Within or Look Beyond? A Theoretical Comparison Between Parameter-Efficient and Full Fine-Tuning
by: Liu, Yongkang, et al.
Published: (2025)

Communication-Efficient Federated Fine-Tuning
by: Theologitis, Michael, et al.
Published: (2025)

FedSelect: Customized Selection of Parameters for Fine-Tuning during Personalized Federated Learning
by: Tamirisa, Rishub, et al.
Published: (2023)

LoRA-FAIR: Federated LoRA Fine-Tuning with Aggregation and Initialization Refinement
by: Bian, Jieming, et al.
Published: (2024)

Federated Sketching LoRA: A Flexible Framework for Heterogeneous Collaborative Fine-Tuning of LLMs
by: Fang, Wenzhi, et al.
Published: (2025)

Thompson Sampling via Fine-Tuning of LLMs
by: Menet, Nicolas, et al.
Published: (2025)

Federated Binary Matrix Factorization using Proximal Optimization
by: Dalleiger, Sebastian, et al.
Published: (2024)

Parameter-Efficient Fine-Tuning of LLMs with Mixture of Space Experts
by: Zhang, Buze, et al.
Published: (2026)

Exploring Parameter-Efficient Fine-Tuning to Enable Foundation Models in Federated Learning
by: Sun, Guangyu, et al.
Published: (2022)

Meta-Learning Hyperparameters for Parameter Efficient Fine-Tuning
by: Tian, Zichen, et al.
Published: (2026)

Parameter-Efficient Fine-Tuning with Circulant and Diagonal Vectors
by: Ding, Xinyu, et al.
Published: (2025)

Efficiency vs. Alignment: Investigating Safety and Fairness Risks in Parameter-Efficient Fine-Tuning of LLMs
by: Taraghi, Mina, et al.
Published: (2025)

On the Power of Adaptive Weighted Aggregation in Heterogeneous Federated Learning and Beyond
by: Zeng, Dun, et al.
Published: (2023)

SplitFT: An Adaptive Federated Split Learning System For LLMs Fine-Tuning
by: Shan, Yimeng, et al.
Published: (2026)

Memba: Membrane-driven Parameter-Efficient Fine-Tuning for Mamba
by: Lee, Donghyun, et al.
Published: (2025)

Deconfounded Causality-aware Parameter-Efficient Fine-Tuning for Problem-Solving Improvement of LLMs
by: Wang, Ruoyu, et al.
Published: (2024)

Long Exposure: Accelerating Parameter-Efficient Fine-Tuning for LLMs under Shadowy Sparsity
by: Wang, Tuowei, et al.
Published: (2025)

Position-Aware Parameter Efficient Fine-Tuning Approach for Reducing Positional Bias in LLMs
by: Zhang, Zheng, et al.
Published: (2024)

Aggregating Low Rank Adapters in Federated Fine-tuning
by: Trautmann, Evelyn, et al.
Published: (2025)

Parameter Importance is Not Static: Evolving Parameter Isolation for Supervised Fine-Tuning
by: Lin, Zekai, et al.
Published: (2026)

FedProxy: Federated Fine-Tuning of LLMs via Proxy SLMs and Heterogeneity-Aware Fusion
by: Fan, Tao, et al.
Published: (2026)

RevFFN: Memory-Efficient Full-Parameter Fine-Tuning of Mixture-of-Experts LLMs with Reversible Blocks
by: Liu, Ningyuan, et al.
Published: (2025)

GenFT: A Generative Parameter-Efficient Fine-Tuning Method for Pretrained Foundation Models
by: Zhang, Baoquan, et al.
Published: (2025)

Curvature-Aware Safety Restoration In LLMs Fine-Tuning
by: Bach, Thong, et al.
Published: (2025)

Graph Representation Learning Augmented Model Manipulation on Federated Fine-Tuning of LLMs
by: Cai, Hanlin, et al.
Published: (2026)

State-offset Tuning: State-based Parameter-Efficient Fine-Tuning for State Space Models
by: Kang, Wonjun, et al.
Published: (2025)

Parameter-Efficient Continual Fine-Tuning: A Survey
by: Coleman, Eric Nuertey, et al.
Published: (2025)

Parameter-Efficient Fine-Tuning via Circular Convolution
by: Chen, Aochuan, et al.
Published: (2024)

Parameter-Efficient Fine-Tuning of State Space Models
by: Galim, Kevin, et al.
Published: (2024)