In silico discovery of representational relationships across visual cortex

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Gifford, Alessandro T., Jastrzębowska, Maya A., Singer, Johannes J. D., Cichy, Radoslaw M.
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911020764626944
author Gifford, Alessandro T.
Jastrzębowska, Maya A.
Singer, Johannes J. D.
Cichy, Radoslaw M.
author_facet Gifford, Alessandro T.
Jastrzębowska, Maya A.
Singer, Johannes J. D.
Cichy, Radoslaw M.
contents Now published in Nature Human Behavior doi: https://doi.org/10.1038/s41562-025-02252-z Human vision is mediated by a complex interconnected network of cortical brain areas that jointly represent visual information. While these areas are increasingly understood in isolation, their representational relationships remain elusive. Here we developed relational neural control (RNC), and used it to investigate the representational relationships for univariate and multivariate fMRI responses of areas across visual cortex. Through RNC we generated and explored in silico fMRI responses for large amounts of images, discovering controlling images that align or disentangle responses across areas, thus indicating their shared or unique representational content. This revealed a typical network-level configuration of representational relationships in which shared or unique representational content varied based on cortical distance, categorical selectivity, and position within the visual hierarchy. Closing the empirical cycle, we validated the in silico discoveries on in vivo fMRI responses from independent subjects. Together, this reveals how visual areas jointly represent the world as an interconnected network.
format Preprint
id arxiv_https___arxiv_org_abs_2411_10872
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle In silico discovery of representational relationships across visual cortex
Gifford, Alessandro T.
Jastrzębowska, Maya A.
Singer, Johannes J. D.
Cichy, Radoslaw M.
Neurons and Cognition
Now published in Nature Human Behavior doi: https://doi.org/10.1038/s41562-025-02252-z Human vision is mediated by a complex interconnected network of cortical brain areas that jointly represent visual information. While these areas are increasingly understood in isolation, their representational relationships remain elusive. Here we developed relational neural control (RNC), and used it to investigate the representational relationships for univariate and multivariate fMRI responses of areas across visual cortex. Through RNC we generated and explored in silico fMRI responses for large amounts of images, discovering controlling images that align or disentangle responses across areas, thus indicating their shared or unique representational content. This revealed a typical network-level configuration of representational relationships in which shared or unique representational content varied based on cortical distance, categorical selectivity, and position within the visual hierarchy. Closing the empirical cycle, we validated the in silico discoveries on in vivo fMRI responses from independent subjects. Together, this reveals how visual areas jointly represent the world as an interconnected network.
title In silico discovery of representational relationships across visual cortex
topic Neurons and Cognition
url https://arxiv.org/abs/2411.10872