Subkv: Quantizing Long Context KV Cache for Sub‐Billion Parameter Language Models on Edge Devices

Fuente: Wiley Open Access
Saved in:
Bibliographic Details
Main Authors: Ziqian Zeng, Tao Zhang, Zhengdong Lu, Wenjun Li, Huiping Zhuang, Hongen Shao, Sin G. Teo, Xiaofeng Zou
Format: Artículo Open Access
Published: Wiley 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!