Cover Image

SpecOffload: Unlocking Latent GPU Capacity for LLM Inference on Resource-Constrained Devices

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhuge, Xiangwen, Shen, Xu, Wang, Zeyu, Dang, Fan, Ding, Xuan, Li, Danyang, Han, Yahui, Hao, Tianxiang, Yang, Zheng
Format: Preprint
Published: 2025
Subjects:
Machine Learning
Online Access:
Acceder al recurso
Tags: Add Tag
No Tags, Be the first to tag this record!
Be the first to leave a comment!
You must be logged in first

Similar Items