Efficient and Effective Query Context-Aware Learning-to-Rank Model for Sequential Recommendation
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866912534021275648 |
|---|---|
| author | Dzhoha, Andrii Mironenko, Alisa Labzin, Evgeny Vlasov, Vladimir Versteegh, Maarten Celikik, Marjan |
| author_facet | Dzhoha, Andrii Mironenko, Alisa Labzin, Evgeny Vlasov, Vladimir Versteegh, Maarten Celikik, Marjan |
| contents | Modern sequential recommender systems commonly use transformer-based models for next-item prediction. While these models demonstrate a strong balance between efficiency and quality, integrating interleaving features - such as the query context (e.g., browse category) under which next-item interactions occur - poses challenges. Effectively capturing query context is crucial for refining ranking relevance and enhancing user engagement, as it provides valuable signals about user intent within a session. Unlike item features, historical query context is typically not aligned with item sequences and may be unavailable at inference due to privacy constraints or feature store limitations - making its integration into transformers both challenging and error-prone. This paper analyzes different strategies for incorporating query context into transformers trained with a causal language modeling procedure as a case study. We propose a new method that effectively fuses the item sequence with query context within the attention mechanism. Through extensive offline and online experiments on a large-scale online platform and open datasets, we present evidence that our proposed method is an effective approach for integrating query context to improve model ranking quality in terms of relevance and diversity. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_03789 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Efficient and Effective Query Context-Aware Learning-to-Rank Model for Sequential Recommendation Dzhoha, Andrii Mironenko, Alisa Labzin, Evgeny Vlasov, Vladimir Versteegh, Maarten Celikik, Marjan Information Retrieval Machine Learning Modern sequential recommender systems commonly use transformer-based models for next-item prediction. While these models demonstrate a strong balance between efficiency and quality, integrating interleaving features - such as the query context (e.g., browse category) under which next-item interactions occur - poses challenges. Effectively capturing query context is crucial for refining ranking relevance and enhancing user engagement, as it provides valuable signals about user intent within a session. Unlike item features, historical query context is typically not aligned with item sequences and may be unavailable at inference due to privacy constraints or feature store limitations - making its integration into transformers both challenging and error-prone. This paper analyzes different strategies for incorporating query context into transformers trained with a causal language modeling procedure as a case study. We propose a new method that effectively fuses the item sequence with query context within the attention mechanism. Through extensive offline and online experiments on a large-scale online platform and open datasets, we present evidence that our proposed method is an effective approach for integrating query context to improve model ranking quality in terms of relevance and diversity. |
| title | Efficient and Effective Query Context-Aware Learning-to-Rank Model for Sequential Recommendation |
| topic | Information Retrieval Machine Learning |
| url | https://arxiv.org/abs/2507.03789 |