Krul: Efficient State Restoration for Multi-turn Conversations with Dynamic Cross-layer KV Sharing

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wen, Junyi, Liang, Junyuan, Hong, Zicong, Chen, Wuhui, Cai, Ting, Zheng, Zibin
Format:	Preprint
Published:	2025
Subjects:	Computation and Language Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Internet

https://arxiv.org/abs/2507.08045