LWGR: Lagrangian-Constrained Personalized World Knowledge for Generative Recommendation
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914578956288000 |
|---|---|
| author | Mu, Lingyu Deng, Hao Xing, Haibo Lin, Kaican Zhu, Zhitong Zhang, Yu Zeng, Xiaoyi Liu, Zhengxiao Lin, Zheng Hu, Jinxin |
| author_facet | Mu, Lingyu Deng, Hao Xing, Haibo Lin, Kaican Zhu, Zhitong Zhang, Yu Zeng, Xiaoyi Liu, Zhengxiao Lin, Zheng Hu, Jinxin |
| contents | Recent progress in large language model (LLM) based generative recommendation (GR) shows that leveraging LLM world knowledge can substantially improve performance. However, existing methods rely on fixed, manually designed instructions to generate semantic knowledge and directly incorporate it into GR, which has two limitations. First, fixed instructions cannot capture the multidimensional heterogeneity of user interests. Second, uncontrollable knowledge fusion may conflict with behavioral signals and harm recommendations. To address these limitations, we propose LWGR, a framework that leverages Lagrangian constraints to transfer users' personalized world knowledge from LLMs into generative recommendation. LWGR enhances GR along two axes: knowledge extraction and fusion. It builds personalized soft instructions to extract behavior-relevant LLM world knowledge, and formulates knowledge fusion as an optimization problem with explicitly bounded performance degradation, which is solved by a Lagrangian primal-dual method to selectively incorporate beneficial knowledge. We further design two training strategies for different LLM scales and a deployment scheme that combines nearline precomputation with lightweight online serving. Experiments on multiple public datasets and one industrial dataset show that LWGR outperforms eight state-of-the-art baselines by up to 11.23% and brings a 1.35% revenue lift on a large-scale advertising platform, demonstrating its effectiveness and practicality. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2605_18771 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | LWGR: Lagrangian-Constrained Personalized World Knowledge for Generative Recommendation Mu, Lingyu Deng, Hao Xing, Haibo Lin, Kaican Zhu, Zhitong Zhang, Yu Zeng, Xiaoyi Liu, Zhengxiao Lin, Zheng Hu, Jinxin Information Retrieval Recent progress in large language model (LLM) based generative recommendation (GR) shows that leveraging LLM world knowledge can substantially improve performance. However, existing methods rely on fixed, manually designed instructions to generate semantic knowledge and directly incorporate it into GR, which has two limitations. First, fixed instructions cannot capture the multidimensional heterogeneity of user interests. Second, uncontrollable knowledge fusion may conflict with behavioral signals and harm recommendations. To address these limitations, we propose LWGR, a framework that leverages Lagrangian constraints to transfer users' personalized world knowledge from LLMs into generative recommendation. LWGR enhances GR along two axes: knowledge extraction and fusion. It builds personalized soft instructions to extract behavior-relevant LLM world knowledge, and formulates knowledge fusion as an optimization problem with explicitly bounded performance degradation, which is solved by a Lagrangian primal-dual method to selectively incorporate beneficial knowledge. We further design two training strategies for different LLM scales and a deployment scheme that combines nearline precomputation with lightweight online serving. Experiments on multiple public datasets and one industrial dataset show that LWGR outperforms eight state-of-the-art baselines by up to 11.23% and brings a 1.35% revenue lift on a large-scale advertising platform, demonstrating its effectiveness and practicality. |
| title | LWGR: Lagrangian-Constrained Personalized World Knowledge for Generative Recommendation |
| topic | Information Retrieval |
| url | https://arxiv.org/abs/2605.18771 |