FutureVision: A methodology for the investigation of future cognition
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915285241430016 |
|---|---|
| author | Torrent, Tiago Timponi Turner, Mark Hinrichs, Nicolás Belcavello, Frederico Lourenço, Igor Almeida, Arthur Lorenzi Viridiano, Marcelo Matos, Ely Edison |
| author_facet | Torrent, Tiago Timponi Turner, Mark Hinrichs, Nicolás Belcavello, Frederico Lourenço, Igor Almeida, Arthur Lorenzi Viridiano, Marcelo Matos, Ely Edison |
| contents | This paper presents a methodology combining multimodal semantic analysis with an eye-tracking experimental protocol to investigate the cognitive effort involved in understanding the communication of future scenarios. To demonstrate the methodology, we conduct a pilot study examining how visual fixation patterns vary during the evaluation of valence and counterfactuality in fictional ad pieces describing futuristic scenarios, using a portable eye tracker. Participants eye movements are recorded while evaluating the stimuli and describing them to a conversation partner. Gaze patterns are analyzed alongside semantic representations of the stimuli and participants descriptions, constructed from a frame semantic annotation of both linguistic and visual modalities. Preliminary results show that far-future and pessimistic scenarios are associated with longer fixations and more erratic saccades, supporting the hypothesis that fractures in the base spaces underlying the interpretation of future scenarios increase cognitive load for comprehenders. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_01597 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | FutureVision: A methodology for the investigation of future cognition Torrent, Tiago Timponi Turner, Mark Hinrichs, Nicolás Belcavello, Frederico Lourenço, Igor Almeida, Arthur Lorenzi Viridiano, Marcelo Matos, Ely Edison Computation and Language This paper presents a methodology combining multimodal semantic analysis with an eye-tracking experimental protocol to investigate the cognitive effort involved in understanding the communication of future scenarios. To demonstrate the methodology, we conduct a pilot study examining how visual fixation patterns vary during the evaluation of valence and counterfactuality in fictional ad pieces describing futuristic scenarios, using a portable eye tracker. Participants eye movements are recorded while evaluating the stimuli and describing them to a conversation partner. Gaze patterns are analyzed alongside semantic representations of the stimuli and participants descriptions, constructed from a frame semantic annotation of both linguistic and visual modalities. Preliminary results show that far-future and pessimistic scenarios are associated with longer fixations and more erratic saccades, supporting the hypothesis that fractures in the base spaces underlying the interpretation of future scenarios increase cognitive load for comprehenders. |
| title | FutureVision: A methodology for the investigation of future cognition |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2502.01597 |