Warming Up Cold-Start CTR Prediction by Learning Item-Specific Feature Interactions

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Wang, Yaqing, Piao, Hongming, Dong, Daxiang, Yao, Quanming, Zhou, Jingbo
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910527163203584
author Wang, Yaqing
Piao, Hongming
Dong, Daxiang
Yao, Quanming
Zhou, Jingbo
author_facet Wang, Yaqing
Piao, Hongming
Dong, Daxiang
Yao, Quanming
Zhou, Jingbo
contents In recommendation systems, new items are continuously introduced, initially lacking interaction records but gradually accumulating them over time. Accurately predicting the click-through rate (CTR) for these items is crucial for enhancing both revenue and user experience. While existing methods focus on enhancing item ID embeddings for new items within general CTR models, they tend to adopt a global feature interaction approach, often overshadowing new items with sparse data by those with abundant interactions. Addressing this, our work introduces EmerG, a novel approach that warms up cold-start CTR prediction by learning item-specific feature interaction patterns. EmerG utilizes hypernetworks to generate an item-specific feature graph based on item characteristics, which is then processed by a Graph Neural Network (GNN). This GNN is specially tailored to provably capture feature interactions at any order through a customized message passing mechanism. We further design a meta learning strategy that optimizes parameters of hypernetworks and GNN across various item CTR prediction tasks, while only adjusting a minimal set of item-specific parameters within each task. This strategy effectively reduces the risk of overfitting when dealing with limited data. Extensive experiments on benchmark datasets validate that EmerG consistently performs the best given no, a few and sufficient instances of new items.
format Preprint
id arxiv_https___arxiv_org_abs_2407_10112
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Warming Up Cold-Start CTR Prediction by Learning Item-Specific Feature Interactions
Wang, Yaqing
Piao, Hongming
Dong, Daxiang
Yao, Quanming
Zhou, Jingbo
Information Retrieval
In recommendation systems, new items are continuously introduced, initially lacking interaction records but gradually accumulating them over time. Accurately predicting the click-through rate (CTR) for these items is crucial for enhancing both revenue and user experience. While existing methods focus on enhancing item ID embeddings for new items within general CTR models, they tend to adopt a global feature interaction approach, often overshadowing new items with sparse data by those with abundant interactions. Addressing this, our work introduces EmerG, a novel approach that warms up cold-start CTR prediction by learning item-specific feature interaction patterns. EmerG utilizes hypernetworks to generate an item-specific feature graph based on item characteristics, which is then processed by a Graph Neural Network (GNN). This GNN is specially tailored to provably capture feature interactions at any order through a customized message passing mechanism. We further design a meta learning strategy that optimizes parameters of hypernetworks and GNN across various item CTR prediction tasks, while only adjusting a minimal set of item-specific parameters within each task. This strategy effectively reduces the risk of overfitting when dealing with limited data. Extensive experiments on benchmark datasets validate that EmerG consistently performs the best given no, a few and sufficient instances of new items.
title Warming Up Cold-Start CTR Prediction by Learning Item-Specific Feature Interactions
topic Information Retrieval
url https://arxiv.org/abs/2407.10112