Intent-Driven Semantic ID Generation for Grounded Conversational News Recommendation

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Su, Hongyang, Kong, Beibei, Cheng, Lei, Zhuo, Chengxiang, Li, Zang, Yu, Chenyun
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917472278413312
author Su, Hongyang
Kong, Beibei
Cheng, Lei
Zhuo, Chengxiang
Li, Zang
Yu, Chenyun
author_facet Su, Hongyang
Kong, Beibei
Cheng, Lei
Zhuo, Chengxiang
Li, Zang
Yu, Chenyun
contents Conversational news recommendation requires grounding each suggestion in a rapidly evolving article corpus while addressing implicit user intents that lack explicit retrievable keywords. To characterize this scenario, we identify 6 intent types from production dialogues: five are implicit and pose fundamental challenges to standard RAG pipelines, forming a critical retrieve-first bottleneck. To address these issues, we introduce intent-driven Semantic ID (SID) generation under a Generate-then-Match paradigm. With two-stage training that consists of multi-task SID alignment and GPT-4 Chain-of-Thought distillation, an LLM maps diverse intents to hierarchical SID prefixes, which are then fuzzy-matched to the current news pool to guarantee fully grounded recommendations. Profile-Aware Dual-Signal Reasoning (PADR) further enables cold-start users to obtain valid recommendations using only profiles. On a mainstream Chinese news platform, our 7B model achieves 0% hallucination and 12.4% L1 match in the 152K open-generation SID space (4x random baseline). It matches GPT-4+Hybrid RAG on L1 while surpassing it on finer-grained metrics (L2 2x, Category +1.2pp) at ~100x lower cost. Cold-start users, where existing baselines score 0%, achieve 18.0% L1 (6x random), the highest among all user groups.
format Preprint
id arxiv_https___arxiv_org_abs_2605_07613
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Intent-Driven Semantic ID Generation for Grounded Conversational News Recommendation
Su, Hongyang
Kong, Beibei
Cheng, Lei
Zhuo, Chengxiang
Li, Zang
Yu, Chenyun
Computation and Language
Conversational news recommendation requires grounding each suggestion in a rapidly evolving article corpus while addressing implicit user intents that lack explicit retrievable keywords. To characterize this scenario, we identify 6 intent types from production dialogues: five are implicit and pose fundamental challenges to standard RAG pipelines, forming a critical retrieve-first bottleneck. To address these issues, we introduce intent-driven Semantic ID (SID) generation under a Generate-then-Match paradigm. With two-stage training that consists of multi-task SID alignment and GPT-4 Chain-of-Thought distillation, an LLM maps diverse intents to hierarchical SID prefixes, which are then fuzzy-matched to the current news pool to guarantee fully grounded recommendations. Profile-Aware Dual-Signal Reasoning (PADR) further enables cold-start users to obtain valid recommendations using only profiles. On a mainstream Chinese news platform, our 7B model achieves 0% hallucination and 12.4% L1 match in the 152K open-generation SID space (4x random baseline). It matches GPT-4+Hybrid RAG on L1 while surpassing it on finer-grained metrics (L2 2x, Category +1.2pp) at ~100x lower cost. Cold-start users, where existing baselines score 0%, achieve 18.0% L1 (6x random), the highest among all user groups.
title Intent-Driven Semantic ID Generation for Grounded Conversational News Recommendation
topic Computation and Language
url https://arxiv.org/abs/2605.07613