A$^2$ATS: Retrieval-Based KV Cache Reduction via Windowed Rotary Position Embedding and Query-Aware Vector Quantization

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: He, Junhui, Xing, Junna, Wang, Nan, Xu, Rui, Wu, Shangyu, Zhou, Peng, Liu, Qiang, Xue, Chun Jason, Li, Qingan
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!