Conditionally Stable Motivation: A Neurocomputational Model of Long-Horizon Goal Persistence under Extreme Reward Sparsity
Fuente:
Zenodo
Guardado en:
| Autor principal: | |
|---|---|
| Formato: | Recurso digital |
| Publicado: |
Zenodo
2026
|
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866901974111223808 |
|---|---|
| author | Sulin, Zhang |
| author_facet | Sulin, Zhang |
| contents | <p>Long-horizon human pursuits (e.g., lifelong projects, scientific careers, entrepreneurship, elite training) sometimes show a striking pattern: persistence with low or zero immediate reward for extended periods, punctuated by sudden, intense bursts of goal-directed activity when opportunities arise. Classical reinforcement learning (RL) and canonical motivational theories — which emphasize reward prediction errors, temporal discounting, and reward-driven value updating — struggle to capture this “enduring yet conditional” persistence. Here we formalize and defend a neurocomputational hypothesis we call Conditionally Stable Motivation (CSM). CSM posits that (i) certain high-order goals are encoded as stable latent value attractors (state components, not ephemeral reward signals), (ii) a latent opportunity set mediates whether the goal’s motivational potential remains active, and (iii) neural circuits implement a two-mode control policy (maintenance vs. exploitation) governed by the opportunity set, with dopaminergic signals acting primarily as opportunity indicators rather than pure reward prediction errors in this regime. We present a precise mathematical model (state augmentation, motivational potential, policy switching rules), map model components to plausible neural substrates (vmPFC, dlPFC, ACC, ventral striatum/VTA), derive empirical predictions, and outline experiments and simulation paradigms for validation. We argue that CSM (a) reconciles long-horizon persistence with sparse rewards, (b) makes falsifiable neurophysiological predictions distinct from standard RL, and (c) provides a framework for understanding both adaptive persistence and pathological forms of unyielding pursuit.</p> <p>Keywords: long-horizon goals, motivation, vmPFC, dopamine, reinforcement learning, opportunity space, hierarchical control, theoretical neuroscience</p> |
| format | Recurso digital |
| id | zenodo_https___doi_org_10_5281_zenodo_18492090 |
| institution | Zenodo |
| language | |
| publishDate | 2026 |
| publisher | Zenodo |
| record_format | zenodo |
| spellingShingle | Conditionally Stable Motivation: A Neurocomputational Model of Long-Horizon Goal Persistence under Extreme Reward Sparsity Sulin, Zhang <p>Long-horizon human pursuits (e.g., lifelong projects, scientific careers, entrepreneurship, elite training) sometimes show a striking pattern: persistence with low or zero immediate reward for extended periods, punctuated by sudden, intense bursts of goal-directed activity when opportunities arise. Classical reinforcement learning (RL) and canonical motivational theories — which emphasize reward prediction errors, temporal discounting, and reward-driven value updating — struggle to capture this “enduring yet conditional” persistence. Here we formalize and defend a neurocomputational hypothesis we call Conditionally Stable Motivation (CSM). CSM posits that (i) certain high-order goals are encoded as stable latent value attractors (state components, not ephemeral reward signals), (ii) a latent opportunity set mediates whether the goal’s motivational potential remains active, and (iii) neural circuits implement a two-mode control policy (maintenance vs. exploitation) governed by the opportunity set, with dopaminergic signals acting primarily as opportunity indicators rather than pure reward prediction errors in this regime. We present a precise mathematical model (state augmentation, motivational potential, policy switching rules), map model components to plausible neural substrates (vmPFC, dlPFC, ACC, ventral striatum/VTA), derive empirical predictions, and outline experiments and simulation paradigms for validation. We argue that CSM (a) reconciles long-horizon persistence with sparse rewards, (b) makes falsifiable neurophysiological predictions distinct from standard RL, and (c) provides a framework for understanding both adaptive persistence and pathological forms of unyielding pursuit.</p> <p>Keywords: long-horizon goals, motivation, vmPFC, dopamine, reinforcement learning, opportunity space, hierarchical control, theoretical neuroscience</p> |
| title | Conditionally Stable Motivation: A Neurocomputational Model of Long-Horizon Goal Persistence under Extreme Reward Sparsity |
| url | https://doi.org/10.5281/zenodo.18492090 |