Saved in:
Bibliographic Details
Main Authors: Köksal-Ersöz, Elif, Chossat, Pascal, Lavigne, Frédéric
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2501.01964
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929657958367232
author Köksal-Ersöz, Elif
Chossat, Pascal
Lavigne, Frédéric
author_facet Köksal-Ersöz, Elif
Chossat, Pascal
Lavigne, Frédéric
contents Adaptation of behavior requires the brain to change goals in a changing environment. Synaptic learning has demonstrated its effectiveness in changing the probability of selecting actions based on their outcome. In the extreme case, it is vital not to repeat an action to a given goal that led to harmful punishment. The present model proposes a simple neural mechanism of gain modulation that makes possible immediate changes in the probability of selecting a goal after punishment of variable intensity. Results show how gain modulation determine the type of elementary navigation process within the state space of a network of neuronal populations of excitatory neurons regulated by inhibition. Immediately after punishment, the system can avoid the punished populations by going back or by jumping to unpunished populations. This does not require particular credit assignment at the `choice' population but only gain modulation of neurons active at the time of punishment. Gain modulation does not require statistical relearning that may lead to further errors, but can encode memories of past experiences without modification of synaptic efficacies. Therefore, gain modulation can complements synaptic plasticity.
format Preprint
id arxiv_https___arxiv_org_abs_2501_01964
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Gain modulation of actions selection without synaptic relearning
Köksal-Ersöz, Elif
Chossat, Pascal
Lavigne, Frédéric
Neurons and Cognition
Dynamical Systems
Adaptation of behavior requires the brain to change goals in a changing environment. Synaptic learning has demonstrated its effectiveness in changing the probability of selecting actions based on their outcome. In the extreme case, it is vital not to repeat an action to a given goal that led to harmful punishment. The present model proposes a simple neural mechanism of gain modulation that makes possible immediate changes in the probability of selecting a goal after punishment of variable intensity. Results show how gain modulation determine the type of elementary navigation process within the state space of a network of neuronal populations of excitatory neurons regulated by inhibition. Immediately after punishment, the system can avoid the punished populations by going back or by jumping to unpunished populations. This does not require particular credit assignment at the `choice' population but only gain modulation of neurons active at the time of punishment. Gain modulation does not require statistical relearning that may lead to further errors, but can encode memories of past experiences without modification of synaptic efficacies. Therefore, gain modulation can complements synaptic plasticity.
title Gain modulation of actions selection without synaptic relearning
topic Neurons and Cognition
Dynamical Systems
url https://arxiv.org/abs/2501.01964