Kitty: Accurate and Efficient 2-bit KV Cache Quantization with Dynamic Channel-wise Precision Boost

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Xia, Haojun, Wu, Xiaoxia, Li, Jisen, Wu, Robert, Wang, Junxiong, Wang, Jue, Li, Chenxi, Singhal, Aman, Shah, Alay Dilipbhai, Ariyak, Alpay, Zhuang, Donglin, Zhou, Zhongzhu, Athiwaratkun, Ben, Zheng, Zhen, Song, Shuaiwen Leon
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Be the first to leave a comment!

Similar Items