Saved in:
Bibliographic Details
Main Authors: Fang, Dengzhao, Gao, Jingtong, Zhu, Chengcheng, Li, Yu, Zhao, Xiangyu, Chang, Yi
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2508.04618
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912581180981248
author Fang, Dengzhao
Gao, Jingtong
Zhu, Chengcheng
Li, Yu
Zhao, Xiangyu
Chang, Yi
author_facet Fang, Dengzhao
Gao, Jingtong
Zhu, Chengcheng
Li, Yu
Zhao, Xiangyu
Chang, Yi
contents Recommender systems are indispensable for helping users navigate the immense item catalogs of modern online platforms. Recently, generative recommendation has emerged as a promising paradigm, unifying the conventional retrieve-and-rank pipeline into an end-to-end model capable of dynamic generation. However, existing generative methods are fundamentally constrained by their unsupervised tokenization, which generates semantic IDs suffering from two critical flaws: (1) they are semantically flat and uninterpretable, lacking a coherent hierarchy, and (2) they are prone to representation entanglement (i.e., ``ID collisions''), which harms recommendation accuracy and diversity. To overcome these limitations, we propose HiD-VAE, a novel framework that learns hierarchically disentangled item representations through two core innovations. First, HiD-VAE pioneers a hierarchically-supervised quantization process that aligns discrete codes with multi-level item tags, yielding more uniform and disentangled IDs. Crucially, the trained codebooks can predict hierarchical tags, providing a traceable and interpretable semantic path for each recommendation. Second, to combat representation entanglement, HiD-VAE incorporates a novel uniqueness loss that directly penalizes latent space overlap. This mechanism not only resolves the critical ID collision problem but also promotes recommendation diversity by ensuring a more comprehensive utilization of the item representation space. These high-quality, disentangled IDs provide a powerful foundation for downstream generative models. Extensive experiments on three public benchmarks validate HiD-VAE's superior performance against state-of-the-art methods. The code is available at https://anonymous.4open.science/r/HiD-VAE-84B2.
format Preprint
id arxiv_https___arxiv_org_abs_2508_04618
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle HiD-VAE: Interpretable Generative Recommendation via Hierarchical and Disentangled Semantic IDs
Fang, Dengzhao
Gao, Jingtong
Zhu, Chengcheng
Li, Yu
Zhao, Xiangyu
Chang, Yi
Information Retrieval
Artificial Intelligence
Recommender systems are indispensable for helping users navigate the immense item catalogs of modern online platforms. Recently, generative recommendation has emerged as a promising paradigm, unifying the conventional retrieve-and-rank pipeline into an end-to-end model capable of dynamic generation. However, existing generative methods are fundamentally constrained by their unsupervised tokenization, which generates semantic IDs suffering from two critical flaws: (1) they are semantically flat and uninterpretable, lacking a coherent hierarchy, and (2) they are prone to representation entanglement (i.e., ``ID collisions''), which harms recommendation accuracy and diversity. To overcome these limitations, we propose HiD-VAE, a novel framework that learns hierarchically disentangled item representations through two core innovations. First, HiD-VAE pioneers a hierarchically-supervised quantization process that aligns discrete codes with multi-level item tags, yielding more uniform and disentangled IDs. Crucially, the trained codebooks can predict hierarchical tags, providing a traceable and interpretable semantic path for each recommendation. Second, to combat representation entanglement, HiD-VAE incorporates a novel uniqueness loss that directly penalizes latent space overlap. This mechanism not only resolves the critical ID collision problem but also promotes recommendation diversity by ensuring a more comprehensive utilization of the item representation space. These high-quality, disentangled IDs provide a powerful foundation for downstream generative models. Extensive experiments on three public benchmarks validate HiD-VAE's superior performance against state-of-the-art methods. The code is available at https://anonymous.4open.science/r/HiD-VAE-84B2.
title HiD-VAE: Interpretable Generative Recommendation via Hierarchical and Disentangled Semantic IDs
topic Information Retrieval
Artificial Intelligence
url https://arxiv.org/abs/2508.04618