Cover Image

Deconstructing Generative Diversity: An Information Bottleneck Analysis of Discrete Latent Generative Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wu, Yudi, Zhao, Wenhao, Liu, Dianbo
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Early Quantization Shrinks Codebook: A Simple Fix for Diversity-Preserving Tokenization
by: Zhao, Wenhao, et al.
Published: (2026)

Representation Collapsing Problems in Vector Quantization
by: Zhao, Wenhao, et al.
Published: (2024)

Evolution Guided Generative Flow Networks
by: Ikram, Zarif, et al.
Published: (2024)

A Theoretical Analysis of Discrete Flow Matching Generative Models
by: Su, Maojiang, et al.
Published: (2025)

Invariant Graph Learning Meets Information Bottleneck for Out-of-Distribution Generalization
by: Mao, Wenyu, et al.
Published: (2024)

Improving Discrete Optimisation Via Decoupled Straight-Through Estimator
by: Shah, Rushi, et al.
Published: (2024)

IIB-LPO: Latent Policy Optimization via Iterative Information Bottleneck
by: Deng, Huilin, et al.
Published: (2026)

SOLAR: A Self-Optimizing Open-Ended Autonomous Agent for Lifelong Learning and Continual Adaptation
by: Vetcha, Nitin, et al.
Published: (2026)

Graph VQ-Transformer (GVT): Fast and Accurate Molecular Generation via High-Fidelity Discrete Latents
by: Zheng, Haozhuo, et al.
Published: (2025)

Latent-Augmented Discrete Diffusion Models
by: Shariatian, Dario, et al.
Published: (2025)

Enhancing Adversarial Transferability via Information Bottleneck Constraints
by: Qi, Biqing, et al.
Published: (2024)

Masked Generative Priors Improve World Models Sequence Modelling Capabilities
by: Meo, Cristian, et al.
Published: (2024)

Deconstructing What Makes a Good Optimizer for Language Models
by: Zhao, Rosie, et al.
Published: (2024)

Learning Discrete Concepts in Latent Hierarchical Models
by: Kong, Lingjing, et al.
Published: (2024)

Breaking the Exploration Bottleneck: Rubric-Scaffolded Reinforcement Learning for General LLM Reasoning
by: Zhou, Yang, et al.
Published: (2025)

VQSynery: Robust Drug Synergy Prediction With Vector Quantization Mechanism
by: Wu, Jiawei, et al.
Published: (2024)

Expected Return Causes Outcome-Level Mode Collapse in Reinforcement Learning and How to Fix It with Inverse Probability Scaling
by: Sinha, Abhijeet, et al.
Published: (2026)

Collaborative Deterministic-Probabilistic Forecasting for Diverse Spatiotemporal Systems
by: Sheng, Zhi, et al.
Published: (2025)

Learning Diverse Policies with Soft Self-Generated Guidance
by: Wang, Guojian, et al.
Published: (2024)

Dynamic Graph Information Bottleneck
by: Yuan, Haonan, et al.
Published: (2024)

Latent Representation and Simulation of Markov Processes via Time-Lagged Information Bottleneck
by: Federici, Marco, et al.
Published: (2023)

Latent-DARM: Bridging Discrete Diffusion And Autoregressive Models For Reasoning
by: Berrayana, Lina, et al.
Published: (2026)

ACES: Generating Diverse Programming Puzzles with with Autotelic Generative Models
by: Pourcel, Julien, et al.
Published: (2023)

RAG-GFM: Overcoming In-Memory Bottlenecks in Graph Foundation Models via Retrieval-Augmented Generation
by: Yuan, Haonan, et al.
Published: (2026)

Discrete-Choice Model with Generalized Additive Utility Network
by: Nishi, Tomoki, et al.
Published: (2023)

Sparse Training of Discrete Diffusion Models for Graph Generation
by: Qin, Yiming, et al.
Published: (2023)

Learning Fair Graph Representations with Multi-view Information Bottleneck
by: Liu, Chuxun, et al.
Published: (2025)

TimeSieve: Extracting Temporal Dynamics through Information Bottlenecks
by: Feng, Ninghui, et al.
Published: (2024)

Unified Generation, Reconstruction, and Representation: Generalized Diffusion with Adaptive Latent Encoding-Decoding
by: Liu, Guangyi, et al.
Published: (2024)

Flexible Variational Information Bottleneck: Achieving Diverse Compression with a Single Training
by: Kudo, Sota, et al.
Published: (2024)

GSTM-HMU: Generative Spatio-Temporal Modeling for Human Mobility Understanding
by: Luo, Wenying, et al.
Published: (2025)

Fourier Transformers for Latent Crystallographic Diffusion and Generative Modeling
by: Duersch, Jed A., et al.
Published: (2026)

Exploring Dynamic Properties of Backdoor Training Through Information Bottleneck
by: Liu, Xinyu, et al.
Published: (2025)

Gradients Must Earn Their Influence: Unifying SFT with Generalized Entropic Objectives
by: Wang, Zecheng, et al.
Published: (2026)

DiscDiff: Latent Diffusion Model for DNA Sequence Generation
by: Li, Zehui, et al.
Published: (2024)

Latent Process Generator Matching
by: Billera, Lukas, et al.
Published: (2026)

Deep Generative Models for Discrete Genotype Simulation
by: Xie, Sihan, et al.
Published: (2025)

Fisher Flow Matching for Generative Modeling over Discrete Data
by: Davis, Oscar, et al.
Published: (2024)

Towards Fine-Grained and Verifiable Concept Bottleneck Models
by: Fang, Yingying, et al.
Published: (2026)

Compositional Generalization via Forced Rendering of Disentangled Latents
by: Liang, Qiyao, et al.
Published: (2025)