Learning to Abstract Visuomotor Mappings using Meta-Reinforcement Learning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Velazquez-Vargas, Carlos A., Christian, Isaac Ray, Taylor, Jordan A., Kumar, Sreejan
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911771057455104
author Velazquez-Vargas, Carlos A.
Christian, Isaac Ray
Taylor, Jordan A.
Kumar, Sreejan
author_facet Velazquez-Vargas, Carlos A.
Christian, Isaac Ray
Taylor, Jordan A.
Kumar, Sreejan
contents We investigated the human capacity to acquire multiple visuomotor mappings for de novo skills. Using a grid navigation paradigm, we tested whether contextual cues implemented as different "grid worlds", allow participants to learn two distinct key-mappings more efficiently. Our results indicate that when contextual information is provided, task performance is significantly better. The same held true for meta-reinforcement learning agents that differed in whether or not they receive contextual information when performing the task. We evaluated their accuracy in predicting human performance in the task and analyzed their internal representations. The results indicate that contextual cues allow the formation of separate representations in space and time when using different visuomotor mappings, whereas the absence of them favors sharing one representation. While both strategies can allow learning of multiple visuomotor mappings, we showed contextual cues provide a computational advantage in terms of how many mappings can be learned.
format Preprint
id arxiv_https___arxiv_org_abs_2402_03072
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Learning to Abstract Visuomotor Mappings using Meta-Reinforcement Learning
Velazquez-Vargas, Carlos A.
Christian, Isaac Ray
Taylor, Jordan A.
Kumar, Sreejan
Neurons and Cognition
Artificial Intelligence
Machine Learning
We investigated the human capacity to acquire multiple visuomotor mappings for de novo skills. Using a grid navigation paradigm, we tested whether contextual cues implemented as different "grid worlds", allow participants to learn two distinct key-mappings more efficiently. Our results indicate that when contextual information is provided, task performance is significantly better. The same held true for meta-reinforcement learning agents that differed in whether or not they receive contextual information when performing the task. We evaluated their accuracy in predicting human performance in the task and analyzed their internal representations. The results indicate that contextual cues allow the formation of separate representations in space and time when using different visuomotor mappings, whereas the absence of them favors sharing one representation. While both strategies can allow learning of multiple visuomotor mappings, we showed contextual cues provide a computational advantage in terms of how many mappings can be learned.
title Learning to Abstract Visuomotor Mappings using Meta-Reinforcement Learning
topic Neurons and Cognition
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2402.03072