Cover Image

LatencyPrism: Online Non-intrusive Latency Sculpting for SLO-Guaranteed LLM Inference

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Du, Yin, Ren, Jiayi, Sun, Xiayu, Zhou, Tianyao, Zhou, Haizhu, Ma, Ruiyan, Zhang, Danyang
Format: Preprint
Published: 2026
Subjects:
Distributed, Parallel, and Cluster Computing
Machine Learning
Operating Systems
Online Access:
Acceder al recurso
Tags: Add Tag
No Tags, Be the first to tag this record!
Be the first to leave a comment!
You must be logged in first

Similar Items