Cover Image

Collaborative Large Language Model Inference via Resource-Aware Parallel Speculative Decoding

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Koh, Jungyeon, Yang, Hyun Jong
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Signal Processing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Group-wise Semantic Splitting Multiple Access for Multi-User Semantic Communication
by: Koh, Jungyeon, et al.
Published: (2025)

Robust Transmission of Punctured Text with Large Language Model-based Recovery
by: Park, Sojeong, et al.
Published: (2025)

Quantization-Aware Collaborative Inference for Large Embodied AI Models
by: Lyu, Zhonghao, et al.
Published: (2026)

Fast Collaborative Inference via Distributed Speculative Decoding
by: Zheng, Ce, et al.
Published: (2025)

Communication-Efficient Collaborative LLM Inference via Distributed Speculative Decoding
by: Zheng, Ce, et al.
Published: (2025)

Fed-ZOE: Communication-Efficient Over-the-Air Federated Learning via Zeroth-Order Estimation
by: Jang, Jonggyu, et al.
Published: (2024)

EEG-to-Gait Decoding via Phase-Aware Representation Learning
by: Fu, Xi, et al.
Published: (2025)

DSSD: Efficient Edge-Device LLM Deployment and Collaborative Inference via Distributed Split Speculative Decoding
by: Ning, Jiahong, et al.
Published: (2025)

A Masked Representation Learning to Model Cardiac Functions Using Multiple Physiological Signals
by: Park, Seong-A, et al.
Published: (2025)

Communication-Efficient Multi-Modal Edge Inference via Uncertainty-Aware Distributed Learning
by: Zhao, Hang, et al.
Published: (2026)

Communication-Computation Trade-Off in Resource-Constrained Edge Inference
by: Shao, Jiawei, et al.
Published: (2020)

Zero-Shot Load Forecasting with Large Language Models
by: Liao, Wenlong, et al.
Published: (2024)

Post-processing of EEG-based Auditory Attention Decoding Decisions via Hidden Markov Models
by: Heintz, Nicolas, et al.
Published: (2025)

Reliable Inference in Edge-Cloud Model Cascades via Conformal Alignment
by: Huang, Jiayi, et al.
Published: (2025)

Large Language Models over Networks: Collaborative Intelligence under Resource Constraints
by: Yuan, Liangqi, et al.
Published: (2026)

Environment-Aware Channel Inference via Cross-Modal Flow: From Multimodal Sensing to Wireless Channels
by: Liang, Guangming, et al.
Published: (2025)

Power-of-Two (PoT) Weights in Large Language Models (LLMs)
by: Elgenedy, Mahmoud
Published: (2025)

Semantic Pilot Design for Data-Aided Channel Estimation Using a Large Language Model
by: Park, Sojeong, et al.
Published: (2026)

GCMCG: A Clustering-Aware Graph Attention and Expert Fusion Network for Multi-Paradigm, Multi-task, and Cross-Subject EEG Decoding
by: Chen, Yiqiao, et al.
Published: (2025)

Stragglers-Aware Low-Latency Synchronous Federated Learning via Layer-Wise Model Updates
by: Lang, Natalie, et al.
Published: (2024)

Function-Space Empirical Bayes Regularisation with Large Vision-Language Model Priors
by: Hao, Pengcheng, et al.
Published: (2026)

Generative Diffusion Models for Resource Allocation in Wireless Networks
by: Uslu, Yigit Berkay, et al.
Published: (2025)

Evaluating Large Language Models as Virtual Annotators for Time-series Physical Sensing Data
by: Hota, Aritra, et al.
Published: (2024)

Large Language Models Memorize Sensor Datasets! Implications on Human Activity Recognition Research
by: Haresamudram, Harish, et al.
Published: (2024)

RadioLLM: Introducing Large Language Model into Cognitive Radio via Hybrid Prompt and Token Reprogrammings
by: Chen, Shuai, et al.
Published: (2025)

Deep Learning Based Sphere Decoding
by: Mohammadkarimi, Mostafa, et al.
Published: (2018)

Lightweight Task-Oriented Semantic Communication Empowered by Large-Scale AI Models
by: Liu, Chuanhong, et al.
Published: (2025)

Cross-Attention Message-Passing Transformers for Code-Agnostic Decoding in 6G Networks
by: Park, Seong-Joon, et al.
Published: (2025)

Boosted Neural Decoders: Achieving Extreme Reliability of LDPC Codes for 6G Networks
by: Kwak, Hee-Youl, et al.
Published: (2024)

Informed Bootstrap Augmentation Improves EEG Decoding
by: Jeong, Woojae, et al.
Published: (2025)

Deep Riemannian Networks for End-to-End EEG Decoding
by: Wilson, Daniel, et al.
Published: (2022)

Simplicial Gaussian Models: Representation and Inference
by: Marinucci, Lorenzo, et al.
Published: (2025)

Discrete Aware Matrix Completion via Convexized $\ell_0$-Norm Approximation
by: Führling, Niclas, et al.
Published: (2024)

On the Optimality of Single-label and Multi-label Neural Network Decoders
by: Gültekin, Yunus Can, et al.
Published: (2025)

Decoding Motor Behavior Using Deep Learning and Reservoir Computing
by: Lan, Tian
Published: (2025)

Assessing Neuromorphic Computing for Fingertip Force Decoding from Electromyography
by: Shahrooei, Abolfazl, et al.
Published: (2025)

Hardware-Efficient EMG Decoding for Next-Generation Hand Prostheses
by: Kalbasi, Mohammad, et al.
Published: (2024)

On the Design and Performance of Machine Learning Based Error Correcting Decoders
by: Yuan, Yuncheng, et al.
Published: (2024)

Non-invasive Neural Decoding in Source Reconstructed Brain Space
by: Gideoni, Yonatan, et al.
Published: (2024)

Learning Exemplar Representations in Single-Trial EEG Category Decoding
by: Kilgallen, Jack, et al.
Published: (2024)