Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2506.14598 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866908410803388416 |
|---|---|
| author | Ralambomihanta, Tokiniaina Raharison Anokhin, Ivan Pogodin, Roman Kahou, Samira Ebrahimi Cornford, Jonathan Richards, Blake Aaron |
| author_facet | Ralambomihanta, Tokiniaina Raharison Anokhin, Ivan Pogodin, Roman Kahou, Samira Ebrahimi Cornford, Jonathan Richards, Blake Aaron |
| contents | Animals often receive information about errors and rewards after a significant delay. For example, there is typically a delay of tens to hundreds of milliseconds between motor actions and visual feedback. The standard approach to handling delays in models of synaptic plasticity is to use eligibility traces. However, standard eligibility traces that decay exponentially mix together any events that happen during the delay, presenting a problem for any credit assignment signal that occurs with a significant delay. Here, we show that eligibility traces formed by a state-space model, inspired by a cascade of biochemical reactions, can provide a temporally precise memory for handling credit assignment at arbitrary delays. We demonstrate that these cascading eligibility traces (CETs) work for credit assignment at behavioral time-scales, ranging from seconds to minutes. As well, we can use CETs to handle extremely slow retrograde signals, as have been found in retrograde axonal signaling. These results demonstrate that CETs can provide an excellent basis for modeling synaptic plasticity. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_14598 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Learning From the Past with Cascading Eligibility Traces Ralambomihanta, Tokiniaina Raharison Anokhin, Ivan Pogodin, Roman Kahou, Samira Ebrahimi Cornford, Jonathan Richards, Blake Aaron Neurons and Cognition Animals often receive information about errors and rewards after a significant delay. For example, there is typically a delay of tens to hundreds of milliseconds between motor actions and visual feedback. The standard approach to handling delays in models of synaptic plasticity is to use eligibility traces. However, standard eligibility traces that decay exponentially mix together any events that happen during the delay, presenting a problem for any credit assignment signal that occurs with a significant delay. Here, we show that eligibility traces formed by a state-space model, inspired by a cascade of biochemical reactions, can provide a temporally precise memory for handling credit assignment at arbitrary delays. We demonstrate that these cascading eligibility traces (CETs) work for credit assignment at behavioral time-scales, ranging from seconds to minutes. As well, we can use CETs to handle extremely slow retrograde signals, as have been found in retrograde axonal signaling. These results demonstrate that CETs can provide an excellent basis for modeling synaptic plasticity. |
| title | Learning From the Past with Cascading Eligibility Traces |
| topic | Neurons and Cognition |
| url | https://arxiv.org/abs/2506.14598 |