Reducing Latency of LLM Search Agent via Speculation-based Algorithm-System Co-Design

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Huang, Zixiao, Zeng, Wen, Fu, Tianyu, Liu, Tengxuan, Sun, Yizhou, Hong, Ke, Yang, Xinhao, Liu, Chengchun, Li, Yan, Zhang, Quanlu, Dai, Guohao, Zhu, Zhenhua, Wang, Yu
Format:	Preprint
Published:	2025
Subjects:	Artificial Intelligence Machine Learning Performance
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Internet

https://arxiv.org/abs/2511.20048