Adaptive Multi-Objective Tiered Storage Configuration for KV Cache in LLM Service

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zheng, Xianzhe, Wang, Zhengheng, Ma, Ruiyan, Wang, Rui, Wang, Xiyu, Chen, Rui, Zhang, Peng, Pan, Sicheng, Huang, Zhangheng, Wu, Chenxin, Zhang, Yi, Cai, Bo, Liu, Kan, Ma, Teng, Du, Yin, Deng, Dong, Wu, Sai, Zhu, Guoyun, Zhang, Wei, Li, Feifei
Format:	Preprint
Published:	2026
Subjects:	Hardware Architecture Distributed, Parallel, and Cluster Computing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Internet

https://arxiv.org/abs/2603.08739