KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Liu, Zirui, Yuan, Jiayi, Jin, Hongye, Zhong, Shaochen, Xu, Zhaozhuo, Braverman, Vladimir, Chen, Beidi, Hu, Xia
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Machine Learning Performance
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Internet

https://arxiv.org/abs/2402.02750