Modulation of temporal decision-making in a deep reinforcement learning agent under the dual-task paradigm

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Pednekar, Amrapali, Garrido-Pérez, Álvaro, Khaluf, Yara, Simoens, Pieter
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866911247357706240
author Pednekar, Amrapali
Garrido-Pérez, Álvaro
Khaluf, Yara
Simoens, Pieter
author_facet Pednekar, Amrapali
Garrido-Pérez, Álvaro
Khaluf, Yara
Simoens, Pieter
contents This study explores the interference in temporal processing within a dual-task paradigm from an artificial intelligence (AI) perspective. In this context, the dual-task setup is implemented as a simplified version of the Overcooked environment with two variations, single task (T) and dual task (T+N). Both variations involve an embedded time production task, but the dual task (T+N) additionally involves a concurrent number comparison task. Two deep reinforcement learning (DRL) agents were separately trained for each of these tasks. These agents exhibited emergent behavior consistent with human timing research. Specifically, the dual task (T+N) agent exhibited significant overproduction of time relative to its single task (T) counterpart. This result was consistent across four target durations. Preliminary analysis of neural dynamics in the agents' LSTM layers did not reveal any clear evidence of a dedicated or intrinsic timer. Hence, further investigation is needed to better understand the underlying time-keeping mechanisms of the agents and to provide insights into the observed behavioral patterns. This study is a small step towards exploring parallels between emergent DRL behavior and behavior observed in biological systems in order to facilitate a better understanding of both.
format Preprint
id arxiv_https___arxiv_org_abs_2511_01415
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Modulation of temporal decision-making in a deep reinforcement learning agent under the dual-task paradigm
Pednekar, Amrapali
Garrido-Pérez, Álvaro
Khaluf, Yara
Simoens, Pieter
Artificial Intelligence
This study explores the interference in temporal processing within a dual-task paradigm from an artificial intelligence (AI) perspective. In this context, the dual-task setup is implemented as a simplified version of the Overcooked environment with two variations, single task (T) and dual task (T+N). Both variations involve an embedded time production task, but the dual task (T+N) additionally involves a concurrent number comparison task. Two deep reinforcement learning (DRL) agents were separately trained for each of these tasks. These agents exhibited emergent behavior consistent with human timing research. Specifically, the dual task (T+N) agent exhibited significant overproduction of time relative to its single task (T) counterpart. This result was consistent across four target durations. Preliminary analysis of neural dynamics in the agents' LSTM layers did not reveal any clear evidence of a dedicated or intrinsic timer. Hence, further investigation is needed to better understand the underlying time-keeping mechanisms of the agents and to provide insights into the observed behavioral patterns. This study is a small step towards exploring parallels between emergent DRL behavior and behavior observed in biological systems in order to facilitate a better understanding of both.
title Modulation of temporal decision-making in a deep reinforcement learning agent under the dual-task paradigm
topic Artificial Intelligence
url https://arxiv.org/abs/2511.01415