Image de couverture de livre

FedSODA: Federated Fine-tuning of LLMs via Similarity Group Pruning and Orchestrated Distillation Alignment

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Zhu, Manning, Guo, Songtao, Zhou, Pengzhan, Ning, Yansong, Han, Chang, Qiao, Dewen
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

FedAH: Aggregated Head for Personalized Federated Learning
par: Zhou, Pengzhan, et autres
Publié: (2024)

FedPAW: Federated Learning with Personalized Aggregation Weights for Urban Vehicle Speed Prediction
par: He, Yuepeng, et autres
Publié: (2024)

FedRAV: Hierarchically Federated Region-Learning for Traffic Object Classification of Autonomous Vehicles
par: Zhai, Yijun, et autres
Publié: (2024)

PrunePEFT: Iterative Hybrid Pruning for Parameter-Efficient Fine-tuning of LLMs
par: Yu, Tongzhou, et autres
Publié: (2025)

FedAttr: Towards Privacy-preserving Client-Level Attribution in Federated LLM Fine-tuning
par: Zhang, Su, et autres
Publié: (2026)

SODA: Semantic-Oriented Distributional Alignment for Generative Recommendation
par: Xue, Ziqi, et autres
Publié: (2026)

FedMLLM: Federated Fine-tuning MLLM on Multimodal Heterogeneity Data
par: Xu, Binqian, et autres
Publié: (2024)

FedSDR: Federated Self-Distillation with Rectification
par: Ren, Ziheng, et autres
Publié: (2026)

SODA: Semi On-Policy Black-Box Distillation for Large Language Models
par: Chen, Xiwen, et autres
Publié: (2026)

Memento: Fine-tuning LLM Agents without Fine-tuning LLMs
par: Zhou, Huichi, et autres
Publié: (2025)

Why LLM Safety Guardrails Collapse After Fine-tuning: A Similarity Analysis Between Alignment and Fine-tuning Datasets
par: Hsiung, Lei, et autres
Publié: (2025)

FedLoDrop: Federated LoRA with Dropout for Generalized LLM Fine-tuning
par: Xie, Sijing, et autres
Publié: (2025)

Personalised Recommendation With Federated Lightweight Graph Convolutional Networks
par: Yansong Zhu, et autres
Publié: (2025)

FedSAUC: A Similarity-Aware Update Control for Communication-Efficient Federated Learning in Edge Computing
par: Lee, Ming-Lun, et autres
Publié: (2025)

Agent Fine-tuning through Distillation for Domain-specific LLMs in Microdomains
par: Xue, Yawen, et autres
Publié: (2025)

FedBiOT: LLM Local Fine-tuning in Federated Learning without Full Model
par: Wu, Feijie, et autres
Publié: (2024)

EDCO: Dynamic Curriculum Orchestration for Domain-specific Large Language Model Fine-tuning
par: Pang, Jing-Cheng, et autres
Publié: (2026)

FedSKD: Aggregation-free Model-heterogeneous Federated Learning via Multi-dimensional Similarity Knowledge Distillation for Medical Image Classification
par: Weng, Ziqiao, et autres
Publié: (2025)

FedVLMBench: Benchmarking Federated Fine-Tuning of Vision-Language Models
par: Zheng, Weiying, et autres
Publié: (2025)

FedAFD: Multimodal Federated Learning via Adversarial Fusion and Distillation
par: Tan, Min, et autres
Publié: (2026)

Fine-tuning vision foundation model for crack segmentation in civil infrastructures
par: Ge, Kang, et autres
Publié: (2023)

FedPDPO: Federated Personalized Direct Preference Optimization for Large Language Model Alignment
par: Zhu, Kewen, et autres
Publié: (2026)

High-Layer Attention Pruning with Rescaling
par: Liu, Songtao, et autres
Publié: (2025)

FedSpaLLM: Federated Pruning of Large Language Models
par: Bai, Guangji, et autres
Publié: (2024)

FedMef: Towards Memory-efficient Federated Dynamic Pruning
par: Huang, Hong, et autres
Publié: (2024)

FedAL: Black-Box Federated Knowledge Distillation Enabled by Adversarial Learning
par: Han, Pengchao, et autres
Publié: (2023)

Debiasing LLMs by Fine-tuning
par: Gao, Zhenyu, et autres
Publié: (2026)

FLoRG: Federated Fine-tuning with Low-rank Gram Matrices and Procrustes Alignment
par: Meng, Chuiyang, et autres
Publié: (2026)

FedSecurity: Benchmarking Attacks and Defenses in Federated Learning and Federated LLMs
par: Han, Shanshan, et autres
Publié: (2023)

FedSiKD: Clients Similarity and Knowledge Distillation: Addressing Non-i.i.d. and Constraints in Federated Learning
par: Alsenani, Yousef, et autres
Publié: (2024)

GSQ-Tuning: Group-Shared Exponents Integer in Fully Quantized Training for LLMs On-Device Fine-tuning
par: Zhou, Sifan, et autres
Publié: (2025)

Leveraging KV Similarity for Online Structured Pruning in LLMs
par: Lee, Jungmin, et autres
Publié: (2025)

EPSD: Early Pruning with Self-Distillation for Efficient Model Compression
par: Chen, Dong, et autres
Publié: (2024)

First- SODA MACHINE high
par: milionna
Publié: (2020)

The Digitizing Project that Made SODA
par: Rible, Jim
Publié: (2005)

A Survey on Federated Fine-tuning of Large Language Models
par: Wu, Yebo, et autres
Publié: (2025)

Alignment-Constrained Dynamic Pruning for LLMs: Identifying and Preserving Alignment-Critical Circuits
par: Patel, Dev, et autres
Publié: (2025)

FedPhD: Federated Pruning with Hierarchical Learning of Diffusion Models
par: Long, Qianyu, et autres
Publié: (2025)

FedRTS: Federated Robust Pruning via Combinatorial Thompson Sampling
par: Huang, Hong, et autres
Publié: (2025)

Distill-SODA: Distilling Self-Supervised Vision Transformer for Source-Free Open-Set Domain Adaptation in Computational Pathology
par: Vray, Guillaume, et autres
Publié: (2023)