MILLION: Mastering Long-Context LLM Inference Via Outlier-Immunized KV Product Quantization

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wang, Zongwu, Xu, Peng, Liu, Fangxin, Hu, Yiwei, Sun, Qingxiao, Li, Gezi, Li, Cheng, Wang, Xuan, Jiang, Li, Guan, Haibing
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!