Improving Sequential Query Recommendation with Immediate User Feedback

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Parambath, Shameem A Puthiya, Anagnostopoulos, Christos, Murray-Smith, Roderick
Format: Preprint
Veröffentlicht: 2022
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909241260900352
author Parambath, Shameem A Puthiya
Anagnostopoulos, Christos
Murray-Smith, Roderick
author_facet Parambath, Shameem A Puthiya
Anagnostopoulos, Christos
Murray-Smith, Roderick
contents We propose an algorithm for next query recommendation in interactive data exploration settings, like knowledge discovery for information gathering. The state-of-the-art query recommendation algorithms are based on sequence-to-sequence learning approaches that exploit historical interaction data. Due to the supervision involved in the learning process, such approaches fail to adapt to immediate user feedback. We propose to augment the transformer-based causal language models for query recommendations to adapt to the immediate user feedback using multi-armed bandit (MAB) framework. We conduct a large-scale experimental study using log files from a popular online literature discovery service and demonstrate that our algorithm improves the per-round regret substantially, with respect to the state-of-the-art transformer-based query recommendation models, which do not make use of immediate user feedback. Our data model and source code are available at https://github.com/shampp/exp3_ss
format Preprint
id arxiv_https___arxiv_org_abs_2205_06297
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Improving Sequential Query Recommendation with Immediate User Feedback
Parambath, Shameem A Puthiya
Anagnostopoulos, Christos
Murray-Smith, Roderick
Information Retrieval
Machine Learning
We propose an algorithm for next query recommendation in interactive data exploration settings, like knowledge discovery for information gathering. The state-of-the-art query recommendation algorithms are based on sequence-to-sequence learning approaches that exploit historical interaction data. Due to the supervision involved in the learning process, such approaches fail to adapt to immediate user feedback. We propose to augment the transformer-based causal language models for query recommendations to adapt to the immediate user feedback using multi-armed bandit (MAB) framework. We conduct a large-scale experimental study using log files from a popular online literature discovery service and demonstrate that our algorithm improves the per-round regret substantially, with respect to the state-of-the-art transformer-based query recommendation models, which do not make use of immediate user feedback. Our data model and source code are available at https://github.com/shampp/exp3_ss
title Improving Sequential Query Recommendation with Immediate User Feedback
topic Information Retrieval
Machine Learning
url https://arxiv.org/abs/2205.06297