Cover Image

SpecEE: Accelerating Large Language Model Inference with Speculative Early Exiting

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Xu, Jiaming, Pan, Jiayi, Zhou, Yongkang, Chen, Siming, Li, Jinhao, Lian, Yaoxiu, Wu, Junyi, Dai, Guohao
Format: Preprint
Published: 2025
Subjects:
Distributed, Parallel, and Cluster Computing
Artificial Intelligence
Online Access:
Acceder al recurso
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Description not available.

Similar Items