Adaptive Learning on User Segmentation: Universal to Specific Representation via Bipartite Neural Interaction

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Tan, Xiaoyu, Deng, Yongxin, Qu, Chao, Xue, Siqiao, Shi, Xiaoming, Zhang, James, Qiu, Xihe
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917782855090176
author Tan, Xiaoyu
Deng, Yongxin
Qu, Chao
Xue, Siqiao
Shi, Xiaoming
Zhang, James
Qiu, Xihe
author_facet Tan, Xiaoyu
Deng, Yongxin
Qu, Chao
Xue, Siqiao
Shi, Xiaoming
Zhang, James
Qiu, Xihe
contents Recently, models for user representation learning have been widely applied in click-through-rate (CTR) and conversion-rate (CVR) prediction. Usually, the model learns a universal user representation as the input for subsequent scenario-specific models. However, in numerous industrial applications (e.g., recommendation and marketing), the business always operates such applications as various online activities among different user segmentation. These segmentation are always created by domain experts. Due to the difference in user distribution (i.e., user segmentation) and business objectives in subsequent tasks, learning solely on universal representation may lead to detrimental effects on both model performance and robustness. In this paper, we propose a novel learning framework that can first learn general universal user representation through information bottleneck. Then, merge and learn a segmentation-specific or a task-specific representation through neural interaction. We design the interactive learning process by leveraging a bipartite graph architecture to model the representation learning and merging between contextual clusters and each user segmentation. Our proposed method is evaluated in two open-source benchmarks, two offline business datasets, and deployed on two online marketing applications to predict users' CVR. The results demonstrate that our method can achieve superior performance and surpass the baseline methods.
format Preprint
id arxiv_https___arxiv_org_abs_2409_14945
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Adaptive Learning on User Segmentation: Universal to Specific Representation via Bipartite Neural Interaction
Tan, Xiaoyu
Deng, Yongxin
Qu, Chao
Xue, Siqiao
Shi, Xiaoming
Zhang, James
Qiu, Xihe
Machine Learning
Information Retrieval
Recently, models for user representation learning have been widely applied in click-through-rate (CTR) and conversion-rate (CVR) prediction. Usually, the model learns a universal user representation as the input for subsequent scenario-specific models. However, in numerous industrial applications (e.g., recommendation and marketing), the business always operates such applications as various online activities among different user segmentation. These segmentation are always created by domain experts. Due to the difference in user distribution (i.e., user segmentation) and business objectives in subsequent tasks, learning solely on universal representation may lead to detrimental effects on both model performance and robustness. In this paper, we propose a novel learning framework that can first learn general universal user representation through information bottleneck. Then, merge and learn a segmentation-specific or a task-specific representation through neural interaction. We design the interactive learning process by leveraging a bipartite graph architecture to model the representation learning and merging between contextual clusters and each user segmentation. Our proposed method is evaluated in two open-source benchmarks, two offline business datasets, and deployed on two online marketing applications to predict users' CVR. The results demonstrate that our method can achieve superior performance and surpass the baseline methods.
title Adaptive Learning on User Segmentation: Universal to Specific Representation via Bipartite Neural Interaction
topic Machine Learning
Information Retrieval
url https://arxiv.org/abs/2409.14945