Of Mice and Machines: A Comparison of Learning Between Real World Mice and RL Agents

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Han, Shuo, Espinosa, German, Huang, Junda, Dombeck, Daniel A., MacIver, Malcolm A., Stadie, Bradly C.
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909846649962496
author Han, Shuo
Espinosa, German
Huang, Junda
Dombeck, Daniel A.
MacIver, Malcolm A.
Stadie, Bradly C.
author_facet Han, Shuo
Espinosa, German
Huang, Junda
Dombeck, Daniel A.
MacIver, Malcolm A.
Stadie, Bradly C.
contents Recent advances in reinforcement learning (RL) have demonstrated impressive capabilities in complex decision-making tasks. This progress raises a natural question: how do these artificial systems compare to biological agents, which have been shaped by millions of years of evolution? To help answer this question, we undertake a comparative study of biological mice and RL agents in a predator-avoidance maze environment. Through this analysis, we identify a striking disparity: RL agents consistently demonstrate a lack of self-preservation instinct, readily risking ``death'' for marginal efficiency gains. These risk-taking strategies are in contrast to biological agents, which exhibit sophisticated risk-assessment and avoidance behaviors. Towards bridging this gap between the biological and artificial, we propose two novel mechanisms that encourage more naturalistic risk-avoidance behaviors in RL agents. Our approach leads to the emergence of naturalistic behaviors, including strategic environment assessment, cautious path planning, and predator avoidance patterns that closely mirror those observed in biological systems.
format Preprint
id arxiv_https___arxiv_org_abs_2505_12204
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Of Mice and Machines: A Comparison of Learning Between Real World Mice and RL Agents
Han, Shuo
Espinosa, German
Huang, Junda
Dombeck, Daniel A.
MacIver, Malcolm A.
Stadie, Bradly C.
Machine Learning
Neurons and Cognition
Recent advances in reinforcement learning (RL) have demonstrated impressive capabilities in complex decision-making tasks. This progress raises a natural question: how do these artificial systems compare to biological agents, which have been shaped by millions of years of evolution? To help answer this question, we undertake a comparative study of biological mice and RL agents in a predator-avoidance maze environment. Through this analysis, we identify a striking disparity: RL agents consistently demonstrate a lack of self-preservation instinct, readily risking ``death'' for marginal efficiency gains. These risk-taking strategies are in contrast to biological agents, which exhibit sophisticated risk-assessment and avoidance behaviors. Towards bridging this gap between the biological and artificial, we propose two novel mechanisms that encourage more naturalistic risk-avoidance behaviors in RL agents. Our approach leads to the emergence of naturalistic behaviors, including strategic environment assessment, cautious path planning, and predator avoidance patterns that closely mirror those observed in biological systems.
title Of Mice and Machines: A Comparison of Learning Between Real World Mice and RL Agents
topic Machine Learning
Neurons and Cognition
url https://arxiv.org/abs/2505.12204