WISP: Waste- and Interference-Suppressed Distributed Speculative LLM Serving at the Edge via Dynamic Drafting and SLO-Aware Batching

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Li, Xiangchen, Fan, Jiakun, Wang, Qingyuan, Spatharakis, Dimitrios, Ghafouri, Saeid, Vandierendonck, Hans, John, Deepu, Ji, Bo, Butt, Ali R., Nikolopoulos, Dimitrios S.
Format:	Preprint
Published:	2026
Subjects:	Distributed, Parallel, and Cluster Computing Artificial Intelligence C.2.4; D.4.8; D.4.1; F.2.2; I.2.7; D.4.7
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Internet

https://arxiv.org/abs/2601.11652