Oneiros: KV Cache Optimization through Parameter Remapping for Multi-tenant LLM Serving

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Li, Ruihao, Pal, Shagnik, Pullu, Vineeth Narayan, Sinha, Prasoon, Ryoo, Jeeho, John, Lizy K., Yadwadkar, Neeraja J.
Format:	Preprint
Published:	2025
Subjects:	Operating Systems
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Internet

https://arxiv.org/abs/2507.11507