LycheeDecode: Accelerating Long-Context LLM Inference via Hybrid-Head Sparse Decoding

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Lin, Gang, Li, Dongfang, Chen, Zhuoen, Shi, Yukun, Chen, Xuhui, Hu, Baotian, Zhang, Min
Format:	Preprint
Published:	2026
Subjects:	Computation and Language Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Internet

https://arxiv.org/abs/2602.04541