Learning to Keep a Promise: Scaling Language Model Decoding Parallelism with Learned Asynchronous Decoding

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Jin, Tian, Cheng, Ellie Y., Ankner, Zack, Saunshi, Nikunj, Elias, Blake M., Yazdanbakhsh, Amir, Ragan-Kelley, Jonathan, Subramanian, Suvinay, Carbin, Michael
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!