OBCache: Optimal Brain KV Cache Pruning for Efficient Long-Context LLM Inference

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Gu, Yuzhe, Liang, Xiyu, Zhao, Jiaojiao, Diao, Enmao
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!