PrefillShare: A Shared Prefill Module for KV Reuse in Multi-LLM Disaggregated Serving

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Woo, Sunghyeon, Kim, Hoseung, Shim, Sunghwan, Jo, Minjung, Jeong, Hyunjoon, Lee, Jeongtae, Kim, Joonghoon, Lee, Sungjae, Park, Baeseong, Kwon, Se Jung, Lee, Dongsoo
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Distributed, Parallel, and Cluster Computing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Internet

https://arxiv.org/abs/2602.12029