CRAB: Codebook Rebalancing for Bias Mitigation in Generative Recommendation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Fan, Zezhong, Chen, Ziheng, Ma, Luyi, Huang, Jin, Morishetti, Lalitesh, Nag, Kaushiki, Kumar, Sushant, Achan, Kannan
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914450648334336
author Fan, Zezhong
Chen, Ziheng
Ma, Luyi
Huang, Jin
Morishetti, Lalitesh
Nag, Kaushiki
Kumar, Sushant
Achan, Kannan
author_facet Fan, Zezhong
Chen, Ziheng
Ma, Luyi
Huang, Jin
Morishetti, Lalitesh
Nag, Kaushiki
Kumar, Sushant
Achan, Kannan
contents Generative recommendation (GeneRec) has introduced a new paradigm that represents items as discrete semantic tokens and predicts items in a generative manner. Despite its strong performance across multiple recommendation tasks, existing GeneRec approaches still suffer from severe popularity bias and may even exacerbate it. In this work, we conduct a comprehensive empirical analysis to uncover the root causes of this phenomenon, yielding two core insights: 1) imbalanced tokenization inherits and can further amplify popularity bias from historical item interactions; 2) current training procedures disproportionately favor popular tokens while neglecting semantic relationships among tokens, thereby intensifying popularity bias. Building on these insights, we propose CRAB, a post-hoc debiasing strategy for GeneRec that alleviates popularity bias by mitigating frequency imbalance among semantic tokens. Specifically, given a well-trained model, we first rebalance the codebook by splitting over-popular tokens while preserving their hierarchical semantic structure. Based on the adjusted codebook, we further introduce a tree-structured regularizer to enhance semantic consistency, encouraging more informative representations for unpopular tokens during training. Experiments on real-world datasets demonstrate that CRAB significantly improves recommendation performance by effectively alleviating popularity bias.
format Preprint
id arxiv_https___arxiv_org_abs_2604_05113
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle CRAB: Codebook Rebalancing for Bias Mitigation in Generative Recommendation
Fan, Zezhong
Chen, Ziheng
Ma, Luyi
Huang, Jin
Morishetti, Lalitesh
Nag, Kaushiki
Kumar, Sushant
Achan, Kannan
Information Retrieval
Artificial Intelligence
Generative recommendation (GeneRec) has introduced a new paradigm that represents items as discrete semantic tokens and predicts items in a generative manner. Despite its strong performance across multiple recommendation tasks, existing GeneRec approaches still suffer from severe popularity bias and may even exacerbate it. In this work, we conduct a comprehensive empirical analysis to uncover the root causes of this phenomenon, yielding two core insights: 1) imbalanced tokenization inherits and can further amplify popularity bias from historical item interactions; 2) current training procedures disproportionately favor popular tokens while neglecting semantic relationships among tokens, thereby intensifying popularity bias. Building on these insights, we propose CRAB, a post-hoc debiasing strategy for GeneRec that alleviates popularity bias by mitigating frequency imbalance among semantic tokens. Specifically, given a well-trained model, we first rebalance the codebook by splitting over-popular tokens while preserving their hierarchical semantic structure. Based on the adjusted codebook, we further introduce a tree-structured regularizer to enhance semantic consistency, encouraging more informative representations for unpopular tokens during training. Experiments on real-world datasets demonstrate that CRAB significantly improves recommendation performance by effectively alleviating popularity bias.
title CRAB: Codebook Rebalancing for Bias Mitigation in Generative Recommendation
topic Information Retrieval
Artificial Intelligence
url https://arxiv.org/abs/2604.05113