Imagen de Portada

FedSODA: Federated Fine-tuning of LLMs via Similarity Group Pruning and Orchestrated Distillation Alignment

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Zhu, Manning, Guo, Songtao, Zhou, Pengzhan, Ning, Yansong, Han, Chang, Qiao, Dewen
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

FedAH: Aggregated Head for Personalized Federated Learning
por: Zhou, Pengzhan, et al.
Publicado: (2024)

FedPAW: Federated Learning with Personalized Aggregation Weights for Urban Vehicle Speed Prediction
por: He, Yuepeng, et al.
Publicado: (2024)

FedRAV: Hierarchically Federated Region-Learning for Traffic Object Classification of Autonomous Vehicles
por: Zhai, Yijun, et al.
Publicado: (2024)

PrunePEFT: Iterative Hybrid Pruning for Parameter-Efficient Fine-tuning of LLMs
por: Yu, Tongzhou, et al.
Publicado: (2025)

FedAttr: Towards Privacy-preserving Client-Level Attribution in Federated LLM Fine-tuning
por: Zhang, Su, et al.
Publicado: (2026)

SODA: Semantic-Oriented Distributional Alignment for Generative Recommendation
por: Xue, Ziqi, et al.
Publicado: (2026)

FedMLLM: Federated Fine-tuning MLLM on Multimodal Heterogeneity Data
por: Xu, Binqian, et al.
Publicado: (2024)

FedSDR: Federated Self-Distillation with Rectification
por: Ren, Ziheng, et al.
Publicado: (2026)

SODA: Semi On-Policy Black-Box Distillation for Large Language Models
por: Chen, Xiwen, et al.
Publicado: (2026)

Why LLM Safety Guardrails Collapse After Fine-tuning: A Similarity Analysis Between Alignment and Fine-tuning Datasets
por: Hsiung, Lei, et al.
Publicado: (2025)

Memento: Fine-tuning LLM Agents without Fine-tuning LLMs
por: Zhou, Huichi, et al.
Publicado: (2025)

FedLoDrop: Federated LoRA with Dropout for Generalized LLM Fine-tuning
por: Xie, Sijing, et al.
Publicado: (2025)

Personalised Recommendation With Federated Lightweight Graph Convolutional Networks
por: Yansong Zhu, et al.
Publicado: (2025)

FedSAUC: A Similarity-Aware Update Control for Communication-Efficient Federated Learning in Edge Computing
por: Lee, Ming-Lun, et al.
Publicado: (2025)

Agent Fine-tuning through Distillation for Domain-specific LLMs in Microdomains
por: Xue, Yawen, et al.
Publicado: (2025)

FedBiOT: LLM Local Fine-tuning in Federated Learning without Full Model
por: Wu, Feijie, et al.
Publicado: (2024)

EDCO: Dynamic Curriculum Orchestration for Domain-specific Large Language Model Fine-tuning
por: Pang, Jing-Cheng, et al.
Publicado: (2026)

FedSKD: Aggregation-free Model-heterogeneous Federated Learning via Multi-dimensional Similarity Knowledge Distillation for Medical Image Classification
por: Weng, Ziqiao, et al.
Publicado: (2025)

FedVLMBench: Benchmarking Federated Fine-Tuning of Vision-Language Models
por: Zheng, Weiying, et al.
Publicado: (2025)

FedAFD: Multimodal Federated Learning via Adversarial Fusion and Distillation
por: Tan, Min, et al.
Publicado: (2026)

Fine-tuning vision foundation model for crack segmentation in civil infrastructures
por: Ge, Kang, et al.
Publicado: (2023)

FedPDPO: Federated Personalized Direct Preference Optimization for Large Language Model Alignment
por: Zhu, Kewen, et al.
Publicado: (2026)

High-Layer Attention Pruning with Rescaling
por: Liu, Songtao, et al.
Publicado: (2025)

FedAL: Black-Box Federated Knowledge Distillation Enabled by Adversarial Learning
por: Han, Pengchao, et al.
Publicado: (2023)

FedSpaLLM: Federated Pruning of Large Language Models
por: Bai, Guangji, et al.
Publicado: (2024)

FedMef: Towards Memory-efficient Federated Dynamic Pruning
por: Huang, Hong, et al.
Publicado: (2024)

Debiasing LLMs by Fine-tuning
por: Gao, Zhenyu, et al.
Publicado: (2026)

FLoRG: Federated Fine-tuning with Low-rank Gram Matrices and Procrustes Alignment
por: Meng, Chuiyang, et al.
Publicado: (2026)

FedSiKD: Clients Similarity and Knowledge Distillation: Addressing Non-i.i.d. and Constraints in Federated Learning
por: Alsenani, Yousef, et al.
Publicado: (2024)

FedSecurity: Benchmarking Attacks and Defenses in Federated Learning and Federated LLMs
por: Han, Shanshan, et al.
Publicado: (2023)

GSQ-Tuning: Group-Shared Exponents Integer in Fully Quantized Training for LLMs On-Device Fine-tuning
por: Zhou, Sifan, et al.
Publicado: (2025)

Leveraging KV Similarity for Online Structured Pruning in LLMs
por: Lee, Jungmin, et al.
Publicado: (2025)

EPSD: Early Pruning with Self-Distillation for Efficient Model Compression
por: Chen, Dong, et al.
Publicado: (2024)

First- SODA MACHINE high
por: milionna
Publicado: (2020)

The Digitizing Project that Made SODA
por: Rible, Jim
Publicado: (2005)

A Survey on Federated Fine-tuning of Large Language Models
por: Wu, Yebo, et al.
Publicado: (2025)

Alignment-Constrained Dynamic Pruning for LLMs: Identifying and Preserving Alignment-Critical Circuits
por: Patel, Dev, et al.
Publicado: (2025)

Distill-SODA: Distilling Self-Supervised Vision Transformer for Source-Free Open-Set Domain Adaptation in Computational Pathology
por: Vray, Guillaume, et al.
Publicado: (2023)

FedPhD: Federated Pruning with Hierarchical Learning of Diffusion Models
por: Long, Qianyu, et al.
Publicado: (2025)

FedRTS: Federated Robust Pruning via Combinatorial Thompson Sampling
por: Huang, Hong, et al.
Publicado: (2025)