Inference acceleration for large language models using "stairs" assisted greedy generation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Grigaliūnas, Domas, Lukoševičius, Mantas
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Machine Learning 68T07, 68T50, 68T05, I.2.6; I.2.7
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Internet

https://arxiv.org/abs/2407.19947