Cover Image

Communication-Aware Knowledge Distillation for Federated LLM Fine-Tuning over Wireless Networks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhang, Xinlu, Yan, Na, Su, Yang, Deng, Yansha, Mahmoodi, Toktam
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Joint Model Pruning and Resource Allocation for Wireless Time-triggered Federated Learning
by: Zhang, Xinlu, et al.
Published: (2024)

TT-Prune: Joint Model Pruning and Resource Allocation for Communication-efficient Time-triggered Federated Learning
by: Zhang, Xinlu, et al.
Published: (2025)

Federated Fine-Tuning of LLMs: Framework Comparison and Research Directions
by: Yan, Na, et al.
Published: (2025)

PWC-MoE: Privacy-Aware Wireless Collaborative Mixture of Experts
by: Su, Yang, et al.
Published: (2025)

HAFLQ: Heterogeneous Adaptive Federated LoRA Fine-tuned LLM with Quantization
by: Su, Yang, et al.
Published: (2024)

Multimodal Survival Modeling and Fairness-Aware Clinical Machine Learning for 5-Year Breast Cancer Risk Prediction
by: Khatibi, Toktam
Published: (2026)

CoLLM: Continuous Adaptation for SLO-Aware LLM Serving on Shared GPU Clusters
by: Huang, Shaoyuan, et al.
Published: (2026)

Wireless Federated Multi-Task LLM Fine-Tuning via Sparse-and-Orthogonal LoRA
by: Yang, Nuocheng, et al.
Published: (2026)

Fed MobiLLM: Efficient Federated LLM Fine-Tuning over Heterogeneous Mobile Devices via Server Assisted Side-Tuning
by: Yang, Xingke, et al.
Published: (2025)

TuneShift-KD: Knowledge Distillation and Transfer for Fine-tuned Models
by: Guan, Yushi, et al.
Published: (2026)

A Layer-wise Analysis of Supervised Fine-Tuning
by: Zhao, Qinghua, et al.
Published: (2026)

Reinforcement Fine-Tuning for History-Aware Dense Retriever in RAG
by: Zhang, Yicheng, et al.
Published: (2026)

Communication-Efficient and Tensorized Federated Fine-Tuning of Large Language Models
by: Ghiasvand, Sajjad, et al.
Published: (2024)

Communication-Efficient Federated Fine-Tuning
by: Theologitis, Michael, et al.
Published: (2025)

Communication-Efficient Federated Learning over Wireless Channels via Gradient Sketching
by: Gattani, Vineet Sunil, et al.
Published: (2024)

Communication-Efficient Zero-Order and First-Order Federated Learning Methods over Wireless Networks
by: Assaad, Mohamad, et al.
Published: (2025)

Constrained Edge AI Deployment: Fine-Tuning vs Distillation for LLM Compression
by: Sander, Jacob, et al.
Published: (2025)

Empowering Large Language Models in Wireless Communication: A Novel Dataset and Fine-Tuning Framework
by: Lin, Yushen, et al.
Published: (2025)

FedsLLM: Federated Split Learning for Large Language Models over Communication Networks
by: Zhao, Kai, et al.
Published: (2024)

SFedKD: Sequential Federated Learning with Discrepancy-Aware Multi-Teacher Knowledge Distillation
by: Xu, Haotian, et al.
Published: (2025)

Two Stage Wireless Federated LoRA Fine-Tuning with Sparsified Orthogonal Updates
by: Kim, Bumjun, et al.
Published: (2025)

ELSA: Efficient LLM-Centric Split Aggregation for Privacy-Aware Hierarchical Federated Learning over the Network Edge
by: Yang, Xiaohong, et al.
Published: (2026)

Personalized Federated Fine-Tuning for LLMs via Data-Driven Heterogeneous Model Architectures
by: Zhang, Yicheng, et al.
Published: (2024)

PAE MobiLLM: Privacy-Aware and Efficient LLM Fine-Tuning on the Mobile Device via Additive Side-Tuning
by: Yang, Xingke, et al.
Published: (2025)

A Closer Look at Knowledge Distillation in Spiking Neural Network Training
by: Liu, Xu, et al.
Published: (2025)

Federated Multi Agent Deep Learning and Neural Networks for Advanced Distributed Sensing in Wireless Networks
by: Muller, Nadine, et al.
Published: (2026)

FedKRSO: Communication and Memory Efficient Federated Fine-Tuning of Large Language Models
by: Yang, Guohao, et al.
Published: (2026)

FedFog: Network-Aware Optimization of Federated Learning over Wireless Fog-Cloud Systems
by: Nguyen, Van-Dinh, et al.
Published: (2021)

LLM-driven Knowledge Distillation for Dynamic Text-Attributed Graphs
by: Roy, Amit, et al.
Published: (2025)

Implicit Federated In-context Learning For Task-Specific LLM Fine-Tuning
by: Li, Dongcheng, et al.
Published: (2025)

The Long-Term Effects of Data Selection in LLM Fine-Tuning
by: Yang, Yuxin, et al.
Published: (2026)

FedMomentum: Preserving LoRA Training Momentum in Federated Fine-Tuning
by: Yan, Peishen, et al.
Published: (2026)

Lightweight Federated Learning over Wireless Edge Networks
by: Hou, Xiangwang, et al.
Published: (2025)

Enhancing Federated Domain Adaptation with Multi-Domain Prototype-Based Federated Fine-Tuning
by: Zhang, Jingyuan, et al.
Published: (2024)

FedProxy: Federated Fine-Tuning of LLMs via Proxy SLMs and Heterogeneity-Aware Fusion
by: Fan, Tao, et al.
Published: (2026)

TSFLora: Token-Compressed Split Fine-Tuning for Wireless Edge Networks
by: Qiang, Xianke, et al.
Published: (2026)

Reinforcement-aware Knowledge Distillation for LLM Reasoning
by: Zhang, Zhaoyang, et al.
Published: (2026)

d3LLM: Ultra-Fast Diffusion LLM using Pseudo-Trajectory Distillation
by: Qian, Yu-Yang, et al.
Published: (2026)

AirLLM: Diffusion Policy-based Adaptive LoRA for Remote Fine-Tuning of LLM over the Air
by: Yang, Shiyi, et al.
Published: (2025)

Federated Low-Rank Adaptation with Differential Privacy over Wireless Networks
by: Kang, Tianqu, et al.
Published: (2024)