Yang, Y., Xu, Y., & Jiao, L. (2024). A Queueing Theoretic Perspective on Low-Latency LLM Inference with Variable Token Length.
Chicago Style (17th ed.) CitationYang, Yuqing, Yuedong Xu, and Lei Jiao. A Queueing Theoretic Perspective on Low-Latency LLM Inference with Variable Token Length. 2024.
MLA (9th ed.) CitationYang, Yuqing, et al. A Queueing Theoretic Perspective on Low-Latency LLM Inference with Variable Token Length. 2024.
Warning: These citations may not always be 100% accurate.