Efficiency Unleashed: Inference Acceleration for LLM-based Recommender Systems with Speculative Decoding

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Xi, Yunjia, Wang, Hangyu, Chen, Bo, Lin, Jianghao, Zhu, Menghui, Liu, Weiwen, Tang, Ruiming, Wei, Zhewei, Zhang, Weinan, Yu, Yong
Format:	Preprint
Published:	2024
Subjects:	Information Retrieval
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Internet

https://arxiv.org/abs/2408.05676