Set Block Decoding is a Language Model Inference Accelerator

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Gat, Itai, Ben-Hamu, Heli, Havasi, Marton, Haziza, Daniel, Reizenstein, Jeremy, Synnaeve, Gabriel, Lopez-Paz, David, Karrer, Brian, Lipman, Yaron
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!