Cover Image

Set Block Decoding is a Language Model Inference Accelerator

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Gat, Itai, Ben-Hamu, Heli, Havasi, Marton, Haziza, Daniel, Reizenstein, Jeremy, Synnaeve, Gabriel, Lopez-Paz, David, Karrer, Brian, Lipman, Yaron
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

D-Flow: Differentiating through Flows for Controlled Generation
by: Ben-Hamu, Heli, et al.
Published: (2024)

Flow Matching Guide and Code
by: Lipman, Yaron, et al.
Published: (2024)

Accelerated Sampling from Masked Diffusion Models via Entropy Bounded Unmasking
by: Ben-Hamu, Heli, et al.
Published: (2025)

Edit Flows: Flow Matching with Edit Operations
by: Havasi, Marton, et al.
Published: (2025)

Flow Matching with General Discrete Paths: A Kinetic-Optimal Perspective
by: Shaul, Neta, et al.
Published: (2024)

Generator Matching: Generative modeling with arbitrary Markov processes
by: Holderrieth, Peter, et al.
Published: (2024)

Corrector Sampling in Language Models
by: Gat, Itai, et al.
Published: (2025)

Transition Matching: Scalable and Flexible Generative Modeling
by: Shaul, Neta, et al.
Published: (2025)

Discrete Flow Matching
by: Gat, Itai, et al.
Published: (2024)

Exact Byte-Level Probabilities from Tokenized Language Models for FIM-Tasks and Model Ensembles
by: Phan, Buu, et al.
Published: (2024)

GLASS Flows: Transition Sampling for Alignment of Flow and Diffusion Models
by: Holderrieth, Peter, et al.
Published: (2025)

Generalized Schrödinger Bridge Matching
by: Liu, Guan-Horng, et al.
Published: (2023)

Exploring the Design Space of Transition Matching
by: Singer, Uriel, et al.
Published: (2025)

Simple and Controllable Music Generation
by: Copet, Jade, et al.
Published: (2023)

Understanding and Mitigating Tokenization Bias in Language Models
by: Phan, Buu, et al.
Published: (2024)

Fluid‐Driven Director‐Field Design Enables Versatile Deployment of Multistable Structures
by: Yaron Veksler, et al.
Published: (2024)

Fluid‐Driven Director‐Field Design Enables Versatile Deployment of Multistable Structures
by: Yaron Veksler, et al.
Published: (2024)

Flow Matching on General Geometries
by: Chen, Ricky T. Q., et al.
Published: (2023)

Guarantee Regions for Local Explanations
by: Havasi, Marton, et al.
Published: (2024)

Diverse Concept Proposals for Concept Bottleneck Models
by: Brown, Katrina, et al.
Published: (2024)

Conjugation, loop and closure invariants of the iterated-integrals signature
by: Diehl, Joscha, et al.
Published: (2024)

Optimizing Language Models for Inference Time Objectives using Reinforcement Learning
by: Tang, Yunhao, et al.
Published: (2025)

Masked Audio Generation using a Single Non-Autoregressive Transformer
by: Ziv, Alon, et al.
Published: (2024)

Textually Pretrained Speech Language Models
by: Hassid, Michael, et al.
Published: (2023)

Better & Faster Large Language Models via Multi-token Prediction
by: Gloeckle, Fabian, et al.
Published: (2024)

Space Group Conditional Flow Matching
by: Puny, Omri, et al.
Published: (2025)

Organizing for Ambidexterity: A Paradox-based Typology of Ambidexterity-related Organizational States
by: Daniel Karrer
Published: (2015)

Bandwidth-induced saturation in multimode fiber-based absorbers
by: Sulimany, Kfir, et al.
Published: (2024)

Accelerating Transformer Inference and Training with 2:4 Activation Sparsity
by: Haziza, Daniel, et al.
Published: (2025)

Learning Distributions over Permutations and Rankings with Factorized Representations
by: Severo, Daniel, et al.
Published: (2025)

Joint Audio and Symbolic Conditioning for Temporally Controlled Text-to-Music Generation
by: Tal, Or, et al.
Published: (2024)

What Makes a Good Explanation?: A Harmonized View of Properties of Explanations
by: Chen, Zixi, et al.
Published: (2022)

OneFlow: Concurrent Mixed-Modal and Interleaved Generation with Edit Flows
by: Nguyen, John, et al.
Published: (2025)

Block Verification Accelerates Speculative Decoding
by: Sun, Ziteng, et al.
Published: (2024)

Characterizing and Efficiently Accelerating Multimodal Generation Model Inference
by: Lee, Yejin, et al.
Published: (2024)

Can repeller dynamics explain dominant pebble axis ratios?
by: Havasi-Tóth, Balázs
Published: (2024)

Humains-Junior: A 3.8B Language Model Achieving GPT-4o-Level Factual Accuracy by Directed Exoskeleton Reasoning
by: Yaron, Nissan, et al.
Published: (2025)

Speculative Diffusion Decoding: Accelerating Language Generation through Diffusion
by: Christopher, Jacob K, et al.
Published: (2024)

Machine learning methods for finite population parameter estimation in survey sampling
by: Dagdoug, Mehdi, et al.
Published: (2026)

Second Class Particle Behaviour in Blocking ASEP
by: Adams, Daniel, et al.
Published: (2023)