Neural encoding with affine feature response transforms
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866910775727095808 |
|---|---|
| author | Le, Lynn Kimman, Nils Dado, Thirza Seeliger, Katja Papale, Paolo Lozano, Antonio Roelfsema, Pieter van Gerven, Marcel Güçlütürk, Yağmur Güçlü, Umut |
| author_facet | Le, Lynn Kimman, Nils Dado, Thirza Seeliger, Katja Papale, Paolo Lozano, Antonio Roelfsema, Pieter van Gerven, Marcel Güçlütürk, Yağmur Güçlü, Umut |
| contents | Current linearizing encoding models that predict neural responses to sensory input typically neglect neuroscience-inspired constraints that could enhance model efficiency and interpretability. To address this, we propose a new method called affine feature response transform (AFRT), which exploits the brain's retinotopic organization. Applying AFRT to encode multi-unit activity in areas V1, V4, and IT of the macaque brain, we demonstrate that AFRT reduces redundant computations and enhances the performance of current linearizing encoding models by segmenting each neuron's receptive field into an affine retinal transform, followed by a localized feature response. Remarkably, by factorizing receptive fields into a sequential affine component with three interpretable parameters (for shifting and scaling) and response components with a small number of feature weights per response, AFRT achieves encoding with orders of magnitude fewer parameters compared to unstructured models. We show that the retinal transform of each neuron's encoding agrees well with the brain's receptive field. Together, these findings suggest that this new subset within spatial transformer network can be instrumental in neural encoding models of naturalistic stimuli. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_03741 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Neural encoding with affine feature response transforms Le, Lynn Kimman, Nils Dado, Thirza Seeliger, Katja Papale, Paolo Lozano, Antonio Roelfsema, Pieter van Gerven, Marcel Güçlütürk, Yağmur Güçlü, Umut Neurons and Cognition Current linearizing encoding models that predict neural responses to sensory input typically neglect neuroscience-inspired constraints that could enhance model efficiency and interpretability. To address this, we propose a new method called affine feature response transform (AFRT), which exploits the brain's retinotopic organization. Applying AFRT to encode multi-unit activity in areas V1, V4, and IT of the macaque brain, we demonstrate that AFRT reduces redundant computations and enhances the performance of current linearizing encoding models by segmenting each neuron's receptive field into an affine retinal transform, followed by a localized feature response. Remarkably, by factorizing receptive fields into a sequential affine component with three interpretable parameters (for shifting and scaling) and response components with a small number of feature weights per response, AFRT achieves encoding with orders of magnitude fewer parameters compared to unstructured models. We show that the retinal transform of each neuron's encoding agrees well with the brain's receptive field. Together, these findings suggest that this new subset within spatial transformer network can be instrumental in neural encoding models of naturalistic stimuli. |
| title | Neural encoding with affine feature response transforms |
| topic | Neurons and Cognition |
| url | https://arxiv.org/abs/2501.03741 |