FIER: Fine-Grained and Efficient KV Cache Retrieval for Long-context LLM Inference

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wang, Dongwei, Liu, Zijie, Wang, Song, Ren, Yuxin, Deng, Jianing, Hu, Jingtong, Chen, Tianlong, Yang, Huanrui
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!