Leveraging Scene Context with Dual Networks for Sequential User Behavior Modeling

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Chen, Xu, Shu, Yunmeng, Pan, Yuangang, Lan, Jinsong, Zhu, Xiaoyong, Xiao, Shuai, Zhu, Haojin, Tsang, Ivor W., Zheng, Bo
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914068018757632
author Chen, Xu
Shu, Yunmeng
Pan, Yuangang
Lan, Jinsong
Zhu, Xiaoyong
Xiao, Shuai
Zhu, Haojin
Tsang, Ivor W.
Zheng, Bo
author_facet Chen, Xu
Shu, Yunmeng
Pan, Yuangang
Lan, Jinsong
Zhu, Xiaoyong
Xiao, Shuai
Zhu, Haojin
Tsang, Ivor W.
Zheng, Bo
contents Modeling sequential user behaviors for future behavior prediction is crucial in improving user's information retrieval experience. Recent studies highlight the importance of incorporating contextual information to enhance prediction performance. One crucial but usually neglected contextual information is the scene feature which we define as sub-interfaces within an app, created by developers to provide specific functionalities, such as ``text2product search" and ``live" modules in e-commence apps. Different scenes exhibit distinct functionalities and usage habits, leading to significant distribution gap in user engagement across them. Popular sequential behavior models either ignore the scene feature or merely use it as attribute embeddings, which cannot effectively capture the dynamic interests and interplay between scenes and items when modeling user sequences. In this work, we propose a novel Dual Sequence Prediction networks (DSPnet) to effectively capture the dynamic interests and interplay between scenes and items for future behavior prediction. DSPnet consists of two parallel networks dedicated to learn users' dynamic interests over items and scenes, and a sequence feature enhancement module to capture the interplay for enhanced future behavior prediction. Further, we introduce a Conditional Contrastive Regularization (CCR) loss to capture the invariance of similar historical sequences. Theoretical analysis suggests that DSPnet is a principled way to learn the joint relationships between scene and item sequences. Extensive experiments are conducted on one public benchmark and two collected industrial datasets. The method has been deployed online in our system, bringing a 0.04 point increase in CTR, 0.78\% growth in deals, and 0.64\% rise in GMV. The codes are available at this anonymous github: \textcolor{blue}{https://anonymous.4open.science/r/DSPNet-ForPublish-2506/}.
format Preprint
id arxiv_https___arxiv_org_abs_2509_26172
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Leveraging Scene Context with Dual Networks for Sequential User Behavior Modeling
Chen, Xu
Shu, Yunmeng
Pan, Yuangang
Lan, Jinsong
Zhu, Xiaoyong
Xiao, Shuai
Zhu, Haojin
Tsang, Ivor W.
Zheng, Bo
Information Retrieval
Modeling sequential user behaviors for future behavior prediction is crucial in improving user's information retrieval experience. Recent studies highlight the importance of incorporating contextual information to enhance prediction performance. One crucial but usually neglected contextual information is the scene feature which we define as sub-interfaces within an app, created by developers to provide specific functionalities, such as ``text2product search" and ``live" modules in e-commence apps. Different scenes exhibit distinct functionalities and usage habits, leading to significant distribution gap in user engagement across them. Popular sequential behavior models either ignore the scene feature or merely use it as attribute embeddings, which cannot effectively capture the dynamic interests and interplay between scenes and items when modeling user sequences. In this work, we propose a novel Dual Sequence Prediction networks (DSPnet) to effectively capture the dynamic interests and interplay between scenes and items for future behavior prediction. DSPnet consists of two parallel networks dedicated to learn users' dynamic interests over items and scenes, and a sequence feature enhancement module to capture the interplay for enhanced future behavior prediction. Further, we introduce a Conditional Contrastive Regularization (CCR) loss to capture the invariance of similar historical sequences. Theoretical analysis suggests that DSPnet is a principled way to learn the joint relationships between scene and item sequences. Extensive experiments are conducted on one public benchmark and two collected industrial datasets. The method has been deployed online in our system, bringing a 0.04 point increase in CTR, 0.78\% growth in deals, and 0.64\% rise in GMV. The codes are available at this anonymous github: \textcolor{blue}{https://anonymous.4open.science/r/DSPNet-ForPublish-2506/}.
title Leveraging Scene Context with Dual Networks for Sequential User Behavior Modeling
topic Information Retrieval
url https://arxiv.org/abs/2509.26172