Salvato in:
Dettagli Bibliografici
Autori principali: Kabir, Md. Ahsanul, Hasan, Mohammad Al, Mandal, Aritra, Hao, Liyang, Khan, Ishita, Tunkelang, Daniel, Wu, Zhe
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:https://arxiv.org/abs/2507.10385
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866916843096113152
author Kabir, Md. Ahsanul
Hasan, Mohammad Al
Mandal, Aritra
Hao, Liyang
Khan, Ishita
Tunkelang, Daniel
Wu, Zhe
author_facet Kabir, Md. Ahsanul
Hasan, Mohammad Al
Mandal, Aritra
Hao, Liyang
Khan, Ishita
Tunkelang, Daniel
Wu, Zhe
contents The major task of any e-commerce search engine is to retrieve the most relevant inventory items, which best match the user intent reflected in a query. This task is non-trivial due to many reasons, including ambiguous queries, misaligned vocabulary between buyers, and sellers, over- or under-constrained queries by the presence of too many or too few tokens. To address these challenges, query reformulation is used, which modifies a user query through token dropping, replacement or expansion, with the objective to bridge semantic gap between query tokens and users' search intent. Early methods of query reformulation mostly used statistical measures derived from token co-occurrence frequencies from selective user sessions having clicks or purchases. In recent years, supervised deep learning approaches, specifically transformer-based neural language models, or sequence-to-sequence models are being used for query reformulation task. However, these models do not utilize the semantic tags of a query token, which are significant for capturing user intent of an e-commerce query. In this work, we pose query reformulation as a token classification task, and solve this task by designing a dependency-aware transformer-based language model, TagBERT, which makes use of semantic tags of a token for learning superior query phrase embedding. Experiments on large, real-life e-commerce datasets show that TagBERT exhibits superior performance than plethora of competing models, including BERT, eBERT, and Sequence-to-Sequence transformer model for important token classification task.
format Preprint
id arxiv_https___arxiv_org_abs_2507_10385
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Extracting Important Tokens in E-Commerce Queries with a Tag Interaction-Aware Transformer Model
Kabir, Md. Ahsanul
Hasan, Mohammad Al
Mandal, Aritra
Hao, Liyang
Khan, Ishita
Tunkelang, Daniel
Wu, Zhe
Machine Learning
The major task of any e-commerce search engine is to retrieve the most relevant inventory items, which best match the user intent reflected in a query. This task is non-trivial due to many reasons, including ambiguous queries, misaligned vocabulary between buyers, and sellers, over- or under-constrained queries by the presence of too many or too few tokens. To address these challenges, query reformulation is used, which modifies a user query through token dropping, replacement or expansion, with the objective to bridge semantic gap between query tokens and users' search intent. Early methods of query reformulation mostly used statistical measures derived from token co-occurrence frequencies from selective user sessions having clicks or purchases. In recent years, supervised deep learning approaches, specifically transformer-based neural language models, or sequence-to-sequence models are being used for query reformulation task. However, these models do not utilize the semantic tags of a query token, which are significant for capturing user intent of an e-commerce query. In this work, we pose query reformulation as a token classification task, and solve this task by designing a dependency-aware transformer-based language model, TagBERT, which makes use of semantic tags of a token for learning superior query phrase embedding. Experiments on large, real-life e-commerce datasets show that TagBERT exhibits superior performance than plethora of competing models, including BERT, eBERT, and Sequence-to-Sequence transformer model for important token classification task.
title Extracting Important Tokens in E-Commerce Queries with a Tag Interaction-Aware Transformer Model
topic Machine Learning
url https://arxiv.org/abs/2507.10385