TRACE: Transformer-based user Representations from Attributed Clickstream Event sequences

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Black, William, Manlove, Alexander, Pennington, Jack, Marchini, Andrea, Ilhan, Ercument, Markeviciute, Vilda
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866910613585788928
author Black, William
Manlove, Alexander
Pennington, Jack
Marchini, Andrea
Ilhan, Ercument
Markeviciute, Vilda
author_facet Black, William
Manlove, Alexander
Pennington, Jack
Marchini, Andrea
Ilhan, Ercument
Markeviciute, Vilda
contents For users navigating travel e-commerce websites, the process of researching products and making a purchase often results in intricate browsing patterns that span numerous sessions over an extended period of time. The resulting clickstream data chronicle these user journeys and present valuable opportunities to derive insights that can significantly enhance personalized recommendations. We introduce TRACE, a novel transformer-based approach tailored to generate rich user embeddings from live multi-session clickstreams for real-time recommendation applications. Prior works largely focus on single-session product sequences, whereas TRACE leverages site-wide page view sequences spanning multiple user sessions to model long-term engagement. Employing a multi-task learning framework, TRACE captures comprehensive user preferences and intents distilled into low-dimensional representations. We demonstrate TRACE's superior performance over vanilla transformer and LLM-style architectures through extensive experiments on a large-scale travel e-commerce dataset of real user journeys, where the challenges of long page-histories and sparse targets are particularly prevalent. Visualizations of the learned embeddings reveal meaningful clusters corresponding to latent user states and behaviors, highlighting TRACE's potential to enhance recommendation systems by capturing nuanced user interactions and preferences
format Preprint
id arxiv_https___arxiv_org_abs_2409_12972
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle TRACE: Transformer-based user Representations from Attributed Clickstream Event sequences
Black, William
Manlove, Alexander
Pennington, Jack
Marchini, Andrea
Ilhan, Ercument
Markeviciute, Vilda
Information Retrieval
Artificial Intelligence
Machine Learning
For users navigating travel e-commerce websites, the process of researching products and making a purchase often results in intricate browsing patterns that span numerous sessions over an extended period of time. The resulting clickstream data chronicle these user journeys and present valuable opportunities to derive insights that can significantly enhance personalized recommendations. We introduce TRACE, a novel transformer-based approach tailored to generate rich user embeddings from live multi-session clickstreams for real-time recommendation applications. Prior works largely focus on single-session product sequences, whereas TRACE leverages site-wide page view sequences spanning multiple user sessions to model long-term engagement. Employing a multi-task learning framework, TRACE captures comprehensive user preferences and intents distilled into low-dimensional representations. We demonstrate TRACE's superior performance over vanilla transformer and LLM-style architectures through extensive experiments on a large-scale travel e-commerce dataset of real user journeys, where the challenges of long page-histories and sparse targets are particularly prevalent. Visualizations of the learned embeddings reveal meaningful clusters corresponding to latent user states and behaviors, highlighting TRACE's potential to enhance recommendation systems by capturing nuanced user interactions and preferences
title TRACE: Transformer-based user Representations from Attributed Clickstream Event sequences
topic Information Retrieval
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2409.12972