ZigZagkv: Dynamic KV Cache Compression for Long-context Modeling based on Layer Uncertainty

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhong, Meizhi, Liu, Xikai, Zhang, Chen, Lei, Yikun, Gao, Yan, Hu, Yao, Chen, Kehai, Zhang, Min
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!