FlashDecoding++: Faster Large Language Model Inference on GPUs

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Hong, Ke, Dai, Guohao, Xu, Jiaming, Mao, Qiuli, Li, Xiuhong, Liu, Jun, Chen, Kangdi, Dong, Yuhan, Wang, Yu
Format:	Preprint
Published:	2023
Subjects:	Machine Learning Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Internet

https://arxiv.org/abs/2311.01282