Improving the Serving Performance of Multi-LoRA Large Language Models via Efficient LoRA and KV Cache Management

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhang, Hang, Shi, Jiuchen, Wang, Yixiao, Chen, Quan, Shan, Yizhou, Guo, Minyi
Format:	Preprint
Published:	2025
Subjects:	Hardware Architecture Artificial Intelligence Machine Learning Performance
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Internet

https://arxiv.org/abs/2505.03756