Conveyor: Efficient Tool-aware LLM Serving with Tool Partial Execution

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Xu, Yechen, Kong, Xinhao, Chen, Tingjun, Zhuo, Danyang
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!