Computational characterization of the role of an attention schema in controlling visuospatial attention

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Piefke, Lotta, Doerig, Adrien, Kietzmann, Tim, Thorat, Sushrut
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914788143005696
author Piefke, Lotta
Doerig, Adrien
Kietzmann, Tim
Thorat, Sushrut
author_facet Piefke, Lotta
Doerig, Adrien
Kietzmann, Tim
Thorat, Sushrut
contents How does the brain control attention? The Attention Schema Theory suggests that the brain explicitly models its state of attention, termed an attention schema, for its control. However, it remains unclear under which circumstances an attention schema is computationally useful, and whether it can emerge in a learning system without hard-wiring. To address these questions, we trained a reinforcement learning agent with attention to track and catch a ball in a noisy environment. Crucially, the agent had additional resources that it could freely use. We asked under which conditions these additional resources develop an attention schema to track attention. We found that the more uncertain the agent was about the location of its attentional window, the more it benefited from these additional resources, which developed an attention schema. Together, these results indicate that an attention schema emerges in simple learning systems where attention is important and difficult to track.
format Preprint
id arxiv_https___arxiv_org_abs_2402_01056
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Computational characterization of the role of an attention schema in controlling visuospatial attention
Piefke, Lotta
Doerig, Adrien
Kietzmann, Tim
Thorat, Sushrut
Neurons and Cognition
How does the brain control attention? The Attention Schema Theory suggests that the brain explicitly models its state of attention, termed an attention schema, for its control. However, it remains unclear under which circumstances an attention schema is computationally useful, and whether it can emerge in a learning system without hard-wiring. To address these questions, we trained a reinforcement learning agent with attention to track and catch a ball in a noisy environment. Crucially, the agent had additional resources that it could freely use. We asked under which conditions these additional resources develop an attention schema to track attention. We found that the more uncertain the agent was about the location of its attentional window, the more it benefited from these additional resources, which developed an attention schema. Together, these results indicate that an attention schema emerges in simple learning systems where attention is important and difficult to track.
title Computational characterization of the role of an attention schema in controlling visuospatial attention
topic Neurons and Cognition
url https://arxiv.org/abs/2402.01056