Cover Image

Efficient Perplexity Bound and Ratio Matching in Discrete Diffusion Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Haxholli, Etrit, Gurbuz, Yeti Z., Can, Ogul, Waxman, Eli
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Minibatch Optimal Transport and Perplexity Bound Estimation in Discrete Flow Matching
by: Haxholli, Etrit, et al.
Published: (2024)

Guideline2Graph: Profile-Aware Multimodal Parsing for Executable Clinical Decision Graphs
by: Kilic, Onur Selim, et al.
Published: (2026)

Stepwise Perplexity-Guided Refinement for Efficient Chain-of-Thought Reasoning in Large Language Models
by: Cui, Yingqian, et al.
Published: (2025)

Momentum Point-Perplexity Mechanics in Large Language Models
by: Tomaz, Lorenzo, et al.
Published: (2025)

Discrete Diffusion Schrödinger Bridge Matching for Graph Transformation
by: Kim, Jun Hyeong, et al.
Published: (2024)

Inconsistent Tokenizations Cause Language Models to be Perplexed by Japanese Grammar
by: Gambardella, Andrew, et al.
Published: (2025)

Membership Inference Attacks on Discrete Diffusion Language Models
by: Kasivelrajan, Shailesh
Published: (2026)

Pair2Score: Pairwise-to-Absolute Transfer for LLM-Based Essay Scoring
by: Hallaç, İbrahim Rıza, et al.
Published: (2026)

Discrete Flow Matching
by: Gat, Itai, et al.
Published: (2024)

Discrete Diffusion in Large Language and Multimodal Models: A Survey
by: Yu, Runpeng, et al.
Published: (2025)

Alzheimer's Dementia Detection Using Perplexity from Paired Large Language Models
by: Xiao, Yao, et al.
Published: (2025)

One-step Diffusion Models with Bregman Density Ratio Matching
by: Zhu, Yuanzhi, et al.
Published: (2025)

BSO: Safety Alignment Is Density Ratio Matching
by: Nguyen, Tien-Phat, et al.
Published: (2026)

A Theoretical Analysis of Discrete Flow Matching Generative Models
by: Su, Maojiang, et al.
Published: (2025)

Fisher Flow Matching for Generative Modeling over Discrete Data
by: Davis, Oscar, et al.
Published: (2024)

Latent-Augmented Discrete Diffusion Models
by: Shariatian, Dario, et al.
Published: (2025)

Informed Correctors for Discrete Diffusion Models
by: Zhao, Yixiu, et al.
Published: (2024)

An Interpretable N-gram Perplexity Threat Model for Large Language Model Jailbreaks
by: Boreiko, Valentyn, et al.
Published: (2024)

Rethinking GSPO: The Perplexity-Entropy Equivalence
by: Liu, Chi
Published: (2025)

Non-Markovian Discrete Diffusion with Causal Language Models
by: Zhang, Yangtian, et al.
Published: (2025)

Steering Masked Discrete Diffusion Models via Discrete Denoising Posterior Prediction
by: Rector-Brooks, Jarrid, et al.
Published: (2024)

Preference-Based Alignment of Discrete Diffusion Models
by: Borso, Umberto, et al.
Published: (2025)

Unifying Perplexing Behaviors in Modified BP Attributions through Alignment Perspective
by: Zheng, Guanhua, et al.
Published: (2025)

Sparse Training of Discrete Diffusion Models for Graph Generation
by: Qin, Yiming, et al.
Published: (2023)

Discrete Modeling via Boundary Conditional Diffusion Processes
by: Gu, Yuxuan, et al.
Published: (2024)

Continuous Diffusion Scales Competitively with Discrete Diffusion for Language
by: Yang, Zhihan, et al.
Published: (2026)

Discrete Flow Matching for Offline-to-Online Reinforcement Learning
by: Khan, Fairoz Nower, et al.
Published: (2026)

Layer- and Timestep-Adaptive Differentiable Token Compression Ratios for Efficient Diffusion Transformers
by: You, Haoran, et al.
Published: (2024)

Encoder-Decoder Diffusion Language Models for Efficient Training and Inference
by: Arriola, Marianne, et al.
Published: (2025)

DARE: Diffusion Language Model Activation Reuse for Efficient Inference
by: Frumkin, Natalia, et al.
Published: (2026)

Discrete State Diffusion Models: A Sample Complexity Perspective
by: Srikanth, Aadithya, et al.
Published: (2025)

Latent-DARM: Bridging Discrete Diffusion And Autoregressive Models For Reasoning
by: Berrayana, Lina, et al.
Published: (2026)

Perplexity Cannot Always Tell Right from Wrong
by: Veličković, Petar, et al.
Published: (2026)

Bounded Ratio Reinforcement Learning
by: Ao, Yunke, et al.
Published: (2026)

Policy-Guided Search on Tree-of-Thoughts for Efficient Problem Solving with Bounded Language Model Queries
by: Pendurkar, Sumedh, et al.
Published: (2026)

Diffusion and Flow Matching Models for Tabular Data: A Survey
by: Li, Zhong, et al.
Published: (2025)

DiRL: An Efficient Post-Training Framework for Diffusion Language Models
by: Zhu, Ying, et al.
Published: (2025)

Generalized Discrete Diffusion with Self-Correction
by: Wang, Linxuan, et al.
Published: (2026)

Steering Without Breaking: Mechanistically Informed Interventions for Discrete Diffusion Language Models
by: Zhou, Hanhan, et al.
Published: (2026)

Flow Matching with General Discrete Paths: A Kinetic-Optimal Perspective
by: Shaul, Neta, et al.
Published: (2024)