Cover Image

Representation Collapsing Problems in Vector Quantization

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhao, Wenhao, Zou, Qiran, Shah, Rushi, Liu, Dianbo
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Early Quantization Shrinks Codebook: A Simple Fix for Diversity-Preserving Tokenization
by: Zhao, Wenhao, et al.
Published: (2026)

Mitigating Premature Discretization with Progressive Quantization for Robust Vector Tokenization
by: Zhao, Wenhao, et al.
Published: (2026)

Improving Discrete Optimisation Via Decoupled Straight-Through Estimator
by: Shah, Rushi, et al.
Published: (2024)

Gaussian Mixture Vector Quantization with Aggregated Categorical Posterior
by: Yan, Mingyuan, et al.
Published: (2024)

VQSynery: Robust Drug Synergy Prediction With Vector Quantization Mechanism
by: Wu, Jiawei, et al.
Published: (2024)

Auto-Discovery-Bench: Diagnosing Structured State Tracking in Oracle-Guided Discovery
by: Chen, Tingting, et al.
Published: (2025)

Deconstructing Generative Diversity: An Information Bottleneck Analysis of Discrete Latent Generative Models
by: Wu, Yudi, et al.
Published: (2025)

Expected Return Causes Outcome-Level Mode Collapse in Reinforcement Learning and How to Fix It with Inverse Probability Scaling
by: Sinha, Abhijeet, et al.
Published: (2026)

Explore-Execute Chain: Towards an Efficient Structured Reasoning Paradigm
by: Yang, Kaisen, et al.
Published: (2025)

Performance Asymmetry in Model-Based Reinforcement Learning
by: Lim, Jing Yu, et al.
Published: (2025)

FML-bench: A Controlled Study of AI Research Agent Strategies from the Perspective of Search Dynamics
by: Zou, Qiran, et al.
Published: (2026)

Pushing Toward the Simplex Vertices: A Simple Remedy for Code Collapse in Smoothed Vector Quantization
by: Morita, Takashi
Published: (2025)

SOLAR: A Self-Optimizing Open-Ended Autonomous Agent for Lifelong Learning and Continual Adaptation
by: Vetcha, Nitin, et al.
Published: (2026)

Graph is a Natural Regularization: Revisiting Vector Quantization for Graph Representation Learning
by: Zhai, Zian, et al.
Published: (2025)

VP-VAE: Rethinking Vector Quantization via Adaptive Vector Perturbation
by: Zhai, Linwei, et al.
Published: (2026)

On the Structural Limitations of Weight-Based Neural Adaptation and the Role of Reversible Behavioral Learning
by: Konduru, Pardhu Sri Rushi Varma
Published: (2026)

QSpec: Speculative Decoding with Complementary Quantization Schemes
by: Zhao, Juntao, et al.
Published: (2024)

Evolution Guided Generative Flow Networks
by: Ikram, Zarif, et al.
Published: (2024)

RWKVQuant: Quantizing the RWKV Family with Proxy Guided Hybrid of Scalar and Vector Quantization
by: Xu, Chen, et al.
Published: (2025)

4bit-Quantization in Vector-Embedding for RAG
by: Jeong, Taehee
Published: (2025)

From Signal Degradation to Computation Collapse: Uncovering the Two Failure Modes of LLM Quantization
by: Zhou, Chenxi, et al.
Published: (2026)

Rep2Text: Decoding Full Text from a Single LLM Token Representation
by: Zhao, Haiyan, et al.
Published: (2025)

STORI: A Benchmark and Taxonomy for Stochastic Environments
by: Barsainyan, Aryan Amit, et al.
Published: (2025)

Quotient DAGs for Off-Policy Evaluation:Forward-Flow Importance Sampling and Exact Slate Propensities
by: Xie, Ziwen, et al.
Published: (2026)

Vector Quantization in the Brain: Grid-like Codes in World Models
by: Peng, Xiangyuan, et al.
Published: (2025)

Sparse-VQ Transformer: An FFN-Free Framework with Vector Quantization for Enhanced Time Series Forecasting
by: Zhao, Yanjun, et al.
Published: (2024)

Difficult Examples Hurt Unsupervised Contrastive Learning: A Theoretical Perspective
by: Zhang, Yi-Ge, et al.
Published: (2025)

Vector Quantized-Elites: Unsupervised and Problem-Agnostic Quality-Diversity Optimization
by: Tsakonas, Constantinos, et al.
Published: (2025)

Mitigating Adversarial Perturbations for Deep Reinforcement Learning via Vector Quantization
by: Luu, Tung M., et al.
Published: (2024)

Learning Grouped Lattice Vector Quantizers for Low-Bit LLM Compression
by: Zhang, Xi, et al.
Published: (2025)

Divide et Calibra: Multiclass Local Calibration via Vector Quantization
by: Barbera, Cesare, et al.
Published: (2026)

VQ-SAD: Vector Quantized Structure Aware Diffusion For Molecule Generation
by: Noravesh, Farshad, et al.
Published: (2026)

On the Collapse Errors Induced by the Deterministic Sampler for Diffusion Models
by: Zhang, Yi, et al.
Published: (2025)

STORM: A Spatio-Temporal Factor Model Based on Dual Vector Quantized Variational Autoencoders for Financial Trading
by: Zhao, Yilei, et al.
Published: (2024)

KBVQ-MoE: KLT-guided SVD with Bias-Corrected Vector Quantization for MoE Large Language Models
by: Xu, Zukang, et al.
Published: (2026)

Understanding Representation of Deep Equilibrium Models from Neural Collapse Perspective
by: Sun, Haixiang, et al.
Published: (2024)

PCDVQ: Enhancing Vector Quantization for Large Language Models via Polar Coordinate Decoupling
by: Yue, Yuxuan, et al.
Published: (2025)

SmaAT-QMix-UNet: A Parameter-Efficient Vector-Quantized UNet for Precipitation Nowcasting
by: Stavrou, Nikolas, et al.
Published: (2026)

Learning under Quantization for High-Dimensional Linear Regression
by: Zhang, Dechen, et al.
Published: (2025)

PFML: Self-Supervised Learning of Time-Series Data Without Representation Collapse
by: Vaaras, Einari, et al.
Published: (2024)