PIT: A Dynamic Personalized Item Tokenizer for End-to-End Generative Recommendation

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Wang, Huanjie, Luo, Xinchen, Bao, Honghui, Zixing, Zhang, Ren, Lejian, Wu, Yunfan, Zhang, Hongwei, Guan, Liwei, Chen, Guang
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866910016500400128
author Wang, Huanjie
Luo, Xinchen
Bao, Honghui
Zixing, Zhang
Ren, Lejian
Wu, Yunfan
Zhang, Hongwei
Guan, Liwei
Chen, Guang
author_facet Wang, Huanjie
Luo, Xinchen
Bao, Honghui
Zixing, Zhang
Ren, Lejian
Wu, Yunfan
Zhang, Hongwei
Guan, Liwei
Chen, Guang
contents Generative Recommendation has revolutionized recommender systems by reformulating retrieval as a sequence generation task over discrete item identifiers. Despite the progress, existing approaches typically rely on static, decoupled tokenization that ignores collaborative signals. While recent methods attempt to integrate collaborative signals into item identifiers either during index construction or through end-to-end modeling, they encounter significant challenges in real-world production environments. Specifically, the volatility of collaborative signals leads to unstable tokenization, and current end-to-end strategies often devolve into suboptimal two-stage training rather than achieving true co-evolution. To bridge this gap, we propose PIT, a dynamic Personalized Item Tokenizer framework for end-to-end generative recommendation, which employs a co-generative architecture that harmonizes collaborative patterns through collaborative signal alignment and synchronizes item tokenizer with generative recommender via a co-evolution learning. This enables the dynamic, joint, end-to-end evolution of both index construction and recommendation. Furthermore, a one-to-many beam index ensures scalability and robustness, facilitating seamless integration into large-scale industrial deployments. Extensive experiments on real-world datasets demonstrate that PIT consistently outperforms competitive baselines. In a large-scale deployment at Kuaishou, an online A/B test yielded a substantial 0.402% uplift in App Stay Time, validating the framework's effectiveness in dynamic industrial environments.
format Preprint
id arxiv_https___arxiv_org_abs_2602_08530
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle PIT: A Dynamic Personalized Item Tokenizer for End-to-End Generative Recommendation
Wang, Huanjie
Luo, Xinchen
Bao, Honghui
Zixing, Zhang
Ren, Lejian
Wu, Yunfan
Zhang, Hongwei
Guan, Liwei
Chen, Guang
Information Retrieval
Generative Recommendation has revolutionized recommender systems by reformulating retrieval as a sequence generation task over discrete item identifiers. Despite the progress, existing approaches typically rely on static, decoupled tokenization that ignores collaborative signals. While recent methods attempt to integrate collaborative signals into item identifiers either during index construction or through end-to-end modeling, they encounter significant challenges in real-world production environments. Specifically, the volatility of collaborative signals leads to unstable tokenization, and current end-to-end strategies often devolve into suboptimal two-stage training rather than achieving true co-evolution. To bridge this gap, we propose PIT, a dynamic Personalized Item Tokenizer framework for end-to-end generative recommendation, which employs a co-generative architecture that harmonizes collaborative patterns through collaborative signal alignment and synchronizes item tokenizer with generative recommender via a co-evolution learning. This enables the dynamic, joint, end-to-end evolution of both index construction and recommendation. Furthermore, a one-to-many beam index ensures scalability and robustness, facilitating seamless integration into large-scale industrial deployments. Extensive experiments on real-world datasets demonstrate that PIT consistently outperforms competitive baselines. In a large-scale deployment at Kuaishou, an online A/B test yielded a substantial 0.402% uplift in App Stay Time, validating the framework's effectiveness in dynamic industrial environments.
title PIT: A Dynamic Personalized Item Tokenizer for End-to-End Generative Recommendation
topic Information Retrieval
url https://arxiv.org/abs/2602.08530