MEPIC: Memory Efficient Position Independent Caching for LLM Serving

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wang, Qian, Yousefijamarani, Zahra, Heisler, Morgan Lindsay, Gu, Rongzhi, Xiaolong, Bai, Yizhou, Shan, Zhang, Wei, Lan, Wang, Xiong, Ying, Zhang, Yong, Fan, Zhenan
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Be the first to leave a comment!

Similar Items