Imagen de Portada

DSSD: Efficient Edge-Device LLM Deployment and Collaborative Inference via Distributed Split Speculative Decoding

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Ning, Jiahong, Zheng, Ce, Yang, Tingting
Formato:	Preprint
Publicado:	2025
Materias:	Signal Processing
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Communication-Efficient Collaborative LLM Inference via Distributed Speculative Decoding
por: Zheng, Ce, et al.
Publicado: (2025)

SpecFed: Accelerating Federated LLM Inference with Speculative Decoding and Compressed Transmission
por: Zheng, Ce, et al.
Publicado: (2026)

Fast Collaborative Inference via Distributed Speculative Decoding
por: Zheng, Ce, et al.
Publicado: (2025)

EdgePrompt: A Distributed Key-Value Inference Framework for LLMs in 6G Networks
por: Ning, Jiahong, et al.
Publicado: (2025)

Collaborative Large Language Model Inference via Resource-Aware Parallel Speculative Decoding
por: Koh, Jungyeon, et al.
Publicado: (2025)

Quantize-Sample-and-Verify: LLM Acceleration via Adaptive Edge-Cloud Speculative Decoding
por: Zhang, Guangyi, et al.
Publicado: (2025)

Low-Latency Edge LLM Handover via Joint KV Cache Transfer and Token Prefill
por: Lee, Seunghun, et al.
Publicado: (2026)

Real-Time Sound Event Localization and Detection: Deployment Challenges on Edge Devices
por: Yeow, Jun Wei, et al.
Publicado: (2024)

Communication-Efficient Distributed On-Device LLM Inference Over Wireless Networks
por: Zhang, Kai, et al.
Publicado: (2025)

Edge Large AI Models: Collaborative Deployment and IoT Applications
por: Wang, Zixin, et al.
Publicado: (2025)

Bayes-Split-Edge: Bayesian Optimization for Constrained Collaborative Inference in Wireless Edge Systems
por: Safaeipour, Fatemeh Zahra, et al.
Publicado: (2025)

Communication-Efficient Multi-Modal Edge Inference via Uncertainty-Aware Distributed Learning
por: Zhao, Hang, et al.
Publicado: (2026)

Collaborative Edge Inference via Semantic Grouping under Wireless Channel Constraints
por: Mota, Mateus P., et al.
Publicado: (2025)

DeltaLLM: A Training-Free Framework Exploiting Temporal Sparsity for Efficient Edge LLM Inference
por: Qi, Jiawen, et al.
Publicado: (2025)

Enabling Edge Artificial Intelligence via Goal-oriented Deep Neural Network Splitting
por: Binucci, Francesco, et al.
Publicado: (2023)

Joint Channel and Semantic-aware Grouping for Effective Collaborative Edge Inference
por: Mota, Mateus P., et al.
Publicado: (2025)

Channel Capacity-Aware Distributed Encoding for Multi-View Sensing and Edge Inference
por: Yang, Mingjie, et al.
Publicado: (2024)

Virtual-Real Collaborated Split Learning via Model Partitioning in IRS-Assisted IoT Networks
por: Di, Jiaying, et al.
Publicado: (2025)

Task-Oriented Feature Compression for Multimodal Understanding via Device-Edge Co-Inference
por: Yuan, Cheng, et al.
Publicado: (2025)

Efficient Deployment of Deep MIMO Detection Using Learngene
por: Zhang, Jinya, et al.
Publicado: (2025)

Split Covariance Intersection with Correlated Components for Distributed Estimation
por: Cros, Colin, et al.
Publicado: (2024)

Low-Latency Neural Inference on an Edge Device for Real-Time Handwriting Recognition from EEG Signals
por: Sen, Ovishake, et al.
Publicado: (2025)

Energy-Efficient Edge Inference in Integrated Sensing, Communication, and Computation Networks
por: Yao, Jiacheng, et al.
Publicado: (2025)

Reconfigurable Intelligent Surface for Green Edge Inference
por: Hua, Sheng, et al.
Publicado: (2019)

Collaborative Automotive Radar Sensing via Mixed-Precision Distributed Array Completion
por: Eamaz, Arian, et al.
Publicado: (2024)

Efficient Decoders for Sensing Subspace Code
por: Gooty, Siva Aditya, et al.
Publicado: (2025)

Distributed Deployment and Dual-Frequency Concepts to Strengthen Sub-THz Wireless Systems
por: Van der Perre, Liesbet, et al.
Publicado: (2025)

Computational Offloading in Semantic-Aware Cloud-Edge-End Collaborative Networks
por: Ji, Zelin, et al.
Publicado: (2024)

Towards Edge Intelligence via Autonomous Navigation: A Robot-Assisted Data Collection Approach
por: Huang, Tingting, et al.
Publicado: (2026)

Collaborative Edge AI Inference over Cloud-RAN
por: Zhang, Pengfei, et al.
Publicado: (2024)

Lightweight Foundation Model for Wireless Time Series Downstream Tasks on Edge Devices
por: Cheraghinia, Mohammad, et al.
Publicado: (2025)

A Spiking Neural Network Decoder for Implantable Brain Machine Interfaces and its Sparsity-aware Deployment on RISC-V Microcontrollers
por: Liao, Jiawei, et al.
Publicado: (2024)

RIS Deployment Optimization with Iterative Detection and Decoding in Multiuser Multiple-Antenna Systems
por: Porto, R., et al.
Publicado: (2025)

Multi-Rate Task-Oriented Communication for Multi-Edge Cooperative Inference
por: Kim, Dongwon, et al.
Publicado: (2025)

Reliable Inference in Edge-Cloud Model Cascades via Conformal Alignment
por: Huang, Jiayi, et al.
Publicado: (2025)

Distributed Task Offloading and Resource Allocation for Latency Minimization in Mobile Edge Computing Networks
por: Kim, Minwoo, et al.
Publicado: (2024)

UAV-Enabled Passive 6D Movable Antennas: Joint Deployment and Beamforming Optimization
por: Liu, Changhao, et al.
Publicado: (2024)

Delay Minimization for Movable Antennas-Enabled Anti-Jamming Communications With Mobile Edge Computing
por: Xiu, Yue, et al.
Publicado: (2024)

Optimizing Air-borne Network-in-a-box Deployment for Efficient Remote Coverage
por: Javed, Sidrah, et al.
Publicado: (2024)

Edge Training and Inference with Analog ReRAM Technology for Hand Gesture Recognition
por: Clerico, Victoria, et al.
Publicado: (2025)