Evaluating Atypical Gaze Patterns through Vision Models: The Case of Cortical Visual Impairment

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Avramidis, Kleanthis, Chang, Melinda Y., Sharma, Rahul, Borchert, Mark S., Narayanan, Shrikanth
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917590794764288
author Avramidis, Kleanthis
Chang, Melinda Y.
Sharma, Rahul
Borchert, Mark S.
Narayanan, Shrikanth
author_facet Avramidis, Kleanthis
Chang, Melinda Y.
Sharma, Rahul
Borchert, Mark S.
Narayanan, Shrikanth
contents A wide range of neurological and cognitive disorders exhibit distinct behavioral markers aside from their clinical manifestations. Cortical Visual Impairment (CVI) is a prime example of such conditions, resulting from damage to visual pathways in the brain, and adversely impacting low- and high-level visual function. The characteristics impacted by CVI are primarily described qualitatively, challenging the establishment of an objective, evidence-based measure of CVI severity. To study those characteristics, we propose to create visual saliency maps by adequately prompting deep vision models with attributes of clinical interest. After extracting saliency maps for a curated set of stimuli, we evaluate fixation traces on those from children with CVI through eye tracking technology. Our experiments reveal significant gaze markers that verify clinical knowledge and yield nuanced discriminability when compared to those of age-matched control subjects. Using deep learning to unveil atypical visual saliency is an important step toward establishing an eye-tracking signature for severe neurodevelopmental disorders, like CVI.
format Preprint
id arxiv_https___arxiv_org_abs_2402_09655
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Evaluating Atypical Gaze Patterns through Vision Models: The Case of Cortical Visual Impairment
Avramidis, Kleanthis
Chang, Melinda Y.
Sharma, Rahul
Borchert, Mark S.
Narayanan, Shrikanth
Signal Processing
Image and Video Processing
A wide range of neurological and cognitive disorders exhibit distinct behavioral markers aside from their clinical manifestations. Cortical Visual Impairment (CVI) is a prime example of such conditions, resulting from damage to visual pathways in the brain, and adversely impacting low- and high-level visual function. The characteristics impacted by CVI are primarily described qualitatively, challenging the establishment of an objective, evidence-based measure of CVI severity. To study those characteristics, we propose to create visual saliency maps by adequately prompting deep vision models with attributes of clinical interest. After extracting saliency maps for a curated set of stimuli, we evaluate fixation traces on those from children with CVI through eye tracking technology. Our experiments reveal significant gaze markers that verify clinical knowledge and yield nuanced discriminability when compared to those of age-matched control subjects. Using deep learning to unveil atypical visual saliency is an important step toward establishing an eye-tracking signature for severe neurodevelopmental disorders, like CVI.
title Evaluating Atypical Gaze Patterns through Vision Models: The Case of Cortical Visual Impairment
topic Signal Processing
Image and Video Processing
url https://arxiv.org/abs/2402.09655