TAVAE: A VAE with Adaptable Priors Explains Contextual Modulation in the Visual Cortex

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Meszéna, Balázs, Murray, Keith T., Corbo, Julien, Erkat, O. Batuhan, Hajnal, Márton A., Polack, Pierre-Olivier, Orbán, Gergő
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912900351787008
author Meszéna, Balázs
Murray, Keith T.
Corbo, Julien
Erkat, O. Batuhan
Hajnal, Márton A.
Polack, Pierre-Olivier
Orbán, Gergő
author_facet Meszéna, Balázs
Murray, Keith T.
Corbo, Julien
Erkat, O. Batuhan
Hajnal, Márton A.
Polack, Pierre-Olivier
Orbán, Gergő
contents The brain interprets visual information through learned regularities, a computation formalized as probabilistic inference under a prior. The visual cortex establishes priors for this inference, some delivered through established top-down connections that inform low-level cortices about statistics represented at higher levels in the cortical hierarchy. While evidence shows that adaptation leads to priors reflecting the structure of natural images, it remains unclear whether similar priors can be flexibly acquired when learning a specific task. To investigate this, we built a generative model of V1 optimized for a simple discrimination task and analyzed it together with large-scale recordings from mice performing an analogous task. In line with recent approaches, we assumed that neuronal activity in V1 corresponds to latent posteriors in the generative model, enabling investigation of task-related priors in neuronal responses. To obtain a flexible test bed, we extended the VAE formalism so that a task can be acquired efficiently by reusing previously learned representations. Task-specific priors learned by this Task-Amortized VAE were used to investigate biases in mice and model when presenting stimuli that violated trained task statistics. Mismatch between learned task statistics and incoming sensory evidence produced signatures of uncertainty in stimulus category in the TAVAE posterior, reflecting properties of bimodal response profiles in V1 recordings. The task-optimized generative model accounted for key characteristics of V1 population activity, including within-day updates to population responses. Our results confirm that flexible task-specific contextual priors can be learned on demand by the visual system and deployed as early as the entry level of visual cortex.
format Preprint
id arxiv_https___arxiv_org_abs_2602_11956
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle TAVAE: A VAE with Adaptable Priors Explains Contextual Modulation in the Visual Cortex
Meszéna, Balázs
Murray, Keith T.
Corbo, Julien
Erkat, O. Batuhan
Hajnal, Márton A.
Polack, Pierre-Olivier
Orbán, Gergő
Neurons and Cognition
Artificial Intelligence
Machine Learning
The brain interprets visual information through learned regularities, a computation formalized as probabilistic inference under a prior. The visual cortex establishes priors for this inference, some delivered through established top-down connections that inform low-level cortices about statistics represented at higher levels in the cortical hierarchy. While evidence shows that adaptation leads to priors reflecting the structure of natural images, it remains unclear whether similar priors can be flexibly acquired when learning a specific task. To investigate this, we built a generative model of V1 optimized for a simple discrimination task and analyzed it together with large-scale recordings from mice performing an analogous task. In line with recent approaches, we assumed that neuronal activity in V1 corresponds to latent posteriors in the generative model, enabling investigation of task-related priors in neuronal responses. To obtain a flexible test bed, we extended the VAE formalism so that a task can be acquired efficiently by reusing previously learned representations. Task-specific priors learned by this Task-Amortized VAE were used to investigate biases in mice and model when presenting stimuli that violated trained task statistics. Mismatch between learned task statistics and incoming sensory evidence produced signatures of uncertainty in stimulus category in the TAVAE posterior, reflecting properties of bimodal response profiles in V1 recordings. The task-optimized generative model accounted for key characteristics of V1 population activity, including within-day updates to population responses. Our results confirm that flexible task-specific contextual priors can be learned on demand by the visual system and deployed as early as the entry level of visual cortex.
title TAVAE: A VAE with Adaptable Priors Explains Contextual Modulation in the Visual Cortex
topic Neurons and Cognition
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2602.11956