Cover Image

Communication-Efficient Distributed On-Device LLM Inference Over Wireless Networks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhang, Kai, He, Hengtao, Song, Shenghui, Zhang, Jun, Letaief, Khaled B.
Format:	Preprint
Published:	2025
Subjects:	Distributed, Parallel, and Cluster Computing Signal Processing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Distributed On-Device LLM Inference With Over-the-Air Computation
by: Zhang, Kai, et al.
Published: (2025)

Modular Foundation Model Inference at the Edge: Network-Aware Microservice Optimization
by: Zhu, Juan, et al.
Published: (2026)

Optimal Expert Selection for Distributed Mixture-of-Experts at the Wireless Edge
by: Qin, Shengling, et al.
Published: (2025)

SpecFed: Accelerating Federated LLM Inference with Speculative Decoding and Compressed Transmission
by: Zheng, Ce, et al.
Published: (2026)

Over-the-Air Federated Learning with Phase Noise: Analysis and Countermeasures
by: Dahl, Martin, et al.
Published: (2024)

Clustering-Based User Selection in Federated Learning: Metadata Exploitation for 3GPP Networks
by: Zheng, Ce, et al.
Published: (2026)

FedAQ: Communication-Efficient Federated Edge Learning via Joint Uplink and Downlink Adaptive Quantization
by: Qu, Linping, et al.
Published: (2024)

Reconfigurable Intelligent Computational Surfaces for MEC-Assisted Autonomous Driving Networks
by: Yang, Bo, et al.
Published: (2024)

TernaryVote: Differentially Private, Communication Efficient, and Byzantine Resilient Distributed Optimization on Heterogeneous Data
by: Jin, Richeng, et al.
Published: (2024)

Reconfigurable Intelligent Computational Surfaces for MEC-Assisted Autonomous Driving Networks: Design Optimization and Analysis
by: Zhang, Xueyao, et al.
Published: (2024)

Bayes-Split-Edge: Bayesian Optimization for Constrained Collaborative Inference in Wireless Edge Systems
by: Safaeipour, Fatemeh Zahra, et al.
Published: (2025)

Satellite Federated Edge Learning: Architecture Design and Convergence Analysis
by: Shi, Yuanming, et al.
Published: (2024)

Tiny but Mighty: A Software-Hardware Co-Design Approach for Efficient Multimodal Inference on Battery-Powered Small Devices
by: Li, Yilong, et al.
Published: (2025)

Communication Efficient ConFederated Learning: An Event-Triggered SAGA Approach
by: Wang, Bin, et al.
Published: (2024)

Learn More by Using Less: Distributed Learning with Energy-Constrained Devices
by: Pereira, Roberto, et al.
Published: (2024)

Satellite Edge Artificial Intelligence with Large Models: Architectures and Technologies
by: Shi, Yuanming, et al.
Published: (2025)

Computation Offloading Strategies in Integrated Terrestrial and Non-Terrestrial Networks
by: Mohsin, Muhammad Ahmed, et al.
Published: (2025)

Deep-Reinforcement-Learning-Based AoI-Aware Resource Allocation for RIS-Aided IoV Networks
by: Qi, Kangwei, et al.
Published: (2024)

Towards 6G Intelligence: The Role of Generative AI in Future Wireless Networks
by: Mohsin, Muhammad Ahmed, et al.
Published: (2025)

IRS Aided Federated Learning: Multiple Access and Fundamental Tradeoff
by: Chen, Guangji, et al.
Published: (2024)

Wireless Sensor Networks Nodes Clustering and Optimization Based on Fuzzy C-Means and Water Strider Algorithms
by: Alsharfa, Raya Majid, et al.
Published: (2025)

Reconfigurable Intelligent Surface Aided Vehicular Edge Computing: Joint Phase-shift Optimization and Multi-User Power Allocation
by: Qi, Kangwei, et al.
Published: (2024)

Over-the-air Federated Policy Gradient
by: Yang, Huiwen, et al.
Published: (2023)

The Effect of Quantization in Federated Learning: A Rényi Differential Privacy Perspective
by: Kang, Tianqu, et al.
Published: (2024)

Physics-Inspired Distributed Radio Map Estimation
by: Yang, Dong, et al.
Published: (2025)

A Distributed Plug-and-Play MCMC Algorithm for High-Dimensional Inverse Problems
by: Bouton, Maxime, et al.
Published: (2025)

Over-the-Top Resource Broker System for Split Computing: An Approach to Distribute Cloud Computing Infrastructure
by: Friese, Ingo, et al.
Published: (2025)

An Experimental Exploration of In-Memory Computing for Multi-Layer Perceptrons
by: Carrinho, Pedro, et al.
Published: (2025)

RASC: Region-Aware Self-Calibration for Dense 2D Sensor Arrays
by: Ma, Yinglei, et al.
Published: (2026)

PowerTrain: Fast, Generalizable Time and Power Prediction Models to Optimize DNN Training on Accelerated Edges
by: K., Prashanthi S., et al.
Published: (2024)

Design of A Low-Latency and Parallelizable SVD Dataflow Architecture on FPGA
by: Du, Fangqiang, et al.
Published: (2025)

Parallel-in-Time Kalman Smoothing Using Orthogonal Transformations
by: Gargir, Shahaf, et al.
Published: (2025)

Faster Convergence with Less Communication: Broadcast-Based Subgraph Sampling for Decentralized Learning over Wireless Networks
by: Herrera, Daniel Pérez, et al.
Published: (2024)

Distributed Maximum Consensus over Noisy Links
by: Lari, Ehsan, et al.
Published: (2024)

Data Processing Efficiency Aware User Association and Resource Allocation in Blockchain Enabled Metaverse over Wireless Communications
by: Qian, Liangxin, et al.
Published: (2024)

A Novel Framework of Horizontal-Vertical Hybrid Federated Learning for EdgeIoT
by: Li, Kai, et al.
Published: (2024)

Scheduling and Aggregation Design for Asynchronous Federated Learning over Wireless Networks
by: Hu, Chung-Hsuan, et al.
Published: (2022)

Communication-Efficient Collaborative LLM Inference over LEO Satellite Networks
by: Zhang, Songge, et al.
Published: (2026)

Distributionally Robust Optimization for Aerial Multi-access Edge Computing via Cooperation of UAVs and HAPs
by: Jia, Ziye, et al.
Published: (2025)

Noise-Robust and Resource-Efficient ADMM-based Federated Learning
by: Lari, Ehsan, et al.
Published: (2024)