Cover Image

Infinite-LLM: Efficient LLM Service for Long Context with DistAttention and Distributed KVCache

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Lin, Bin, Zhang, Chen, Peng, Tao, Zhao, Hanyu, Xiao, Wencong, Sun, Minmin, Liu, Anmin, Zhang, Zhipeng, Li, Lanbo, Qiu, Xiafei, Li, Shen, Ji, Zhigang, Xie, Tao, Li, Yong, Lin, Wei
Format: Preprint
Published: 2024
Subjects:
Distributed, Parallel, and Cluster Computing
Hardware Architecture
Online Access:
Acceder al recurso
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Description not available.

Similar Items