Implicit Search Intent Recognition using EEG and Eye Tracking: Novel Dataset and Cross-User Prediction

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Sharma, Mansi, Chen, Shuang, Müller, Philipp, Rekrut, Maurice, Krüger, Antonio
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866916878396424192
author Sharma, Mansi
Chen, Shuang
Müller, Philipp
Rekrut, Maurice
Krüger, Antonio
author_facet Sharma, Mansi
Chen, Shuang
Müller, Philipp
Rekrut, Maurice
Krüger, Antonio
contents For machines to effectively assist humans in challenging visual search tasks, they must differentiate whether a human is simply glancing into a scene (navigational intent) or searching for a target object (informational intent). Previous research proposed combining electroencephalography (EEG) and eye-tracking measurements to recognize such search intents implicitly, i.e., without explicit user input. However, the applicability of these approaches to real-world scenarios suffers from two key limitations. First, previous work used fixed search times in the informational intent condition -- a stark contrast to visual search, which naturally terminates when the target is found. Second, methods incorporating EEG measurements addressed prediction scenarios that require ground truth training data from the target user, which is impractical in many use cases. We address these limitations by making the first publicly available EEG and eye-tracking dataset for navigational vs. informational intent recognition, where the user determines search times. We present the first method for cross-user prediction of search intents from EEG and eye-tracking recordings and reach 84.5% accuracy in leave-one-user-out evaluations -- comparable to within-user prediction accuracy (85.5%) but offering much greater flexibility
format Preprint
id arxiv_https___arxiv_org_abs_2508_01860
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Implicit Search Intent Recognition using EEG and Eye Tracking: Novel Dataset and Cross-User Prediction
Sharma, Mansi
Chen, Shuang
Müller, Philipp
Rekrut, Maurice
Krüger, Antonio
Human-Computer Interaction
Computer Vision and Pattern Recognition
For machines to effectively assist humans in challenging visual search tasks, they must differentiate whether a human is simply glancing into a scene (navigational intent) or searching for a target object (informational intent). Previous research proposed combining electroencephalography (EEG) and eye-tracking measurements to recognize such search intents implicitly, i.e., without explicit user input. However, the applicability of these approaches to real-world scenarios suffers from two key limitations. First, previous work used fixed search times in the informational intent condition -- a stark contrast to visual search, which naturally terminates when the target is found. Second, methods incorporating EEG measurements addressed prediction scenarios that require ground truth training data from the target user, which is impractical in many use cases. We address these limitations by making the first publicly available EEG and eye-tracking dataset for navigational vs. informational intent recognition, where the user determines search times. We present the first method for cross-user prediction of search intents from EEG and eye-tracking recordings and reach 84.5% accuracy in leave-one-user-out evaluations -- comparable to within-user prediction accuracy (85.5%) but offering much greater flexibility
title Implicit Search Intent Recognition using EEG and Eye Tracking: Novel Dataset and Cross-User Prediction
topic Human-Computer Interaction
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2508.01860