Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2512.08560 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911315440697344 |
|---|---|
| author | Wasserman, Navve Cosarinsky, Matias Golbari, Yuval Oliva, Aude Torralba, Antonio Shaham, Tamar Rott Irani, Michal |
| author_facet | Wasserman, Navve Cosarinsky, Matias Golbari, Yuval Oliva, Aude Torralba, Antonio Shaham, Tamar Rott Irani, Michal |
| contents | Understanding how the human brain represents visual concepts, and in which brain regions these representations are encoded, remains a long-standing challenge. Decades of work have advanced our understanding of visual representations, yet brain signals remain large and complex, and the space of possible visual concepts is vast. As a result, most studies remain small-scale, rely on manual inspection, focus on specific regions and properties, and rarely include systematic validation. We present a large-scale, automated framework for discovering and explaining visual representations across the human cortex. Our method comprises two main stages. First, we discover candidate interpretable patterns in fMRI activity through unsupervised, data-driven decomposition methods. Next, we explain each pattern by identifying the set of natural images that most strongly elicit it and generating a natural-language description of their shared visual meaning. To scale this process, we introduce an automated pipeline that tests multiple candidate explanations, assigns quantitative reliability scores, and selects the most consistent description for each voxel pattern. Our framework reveals thousands of interpretable patterns spanning many distinct visual concepts, including fine-grained representations previously unreported. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2512_08560 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | BrainExplore: Large-Scale Discovery of Interpretable Visual Representations in the Human Brain Wasserman, Navve Cosarinsky, Matias Golbari, Yuval Oliva, Aude Torralba, Antonio Shaham, Tamar Rott Irani, Michal Computer Vision and Pattern Recognition Understanding how the human brain represents visual concepts, and in which brain regions these representations are encoded, remains a long-standing challenge. Decades of work have advanced our understanding of visual representations, yet brain signals remain large and complex, and the space of possible visual concepts is vast. As a result, most studies remain small-scale, rely on manual inspection, focus on specific regions and properties, and rarely include systematic validation. We present a large-scale, automated framework for discovering and explaining visual representations across the human cortex. Our method comprises two main stages. First, we discover candidate interpretable patterns in fMRI activity through unsupervised, data-driven decomposition methods. Next, we explain each pattern by identifying the set of natural images that most strongly elicit it and generating a natural-language description of their shared visual meaning. To scale this process, we introduce an automated pipeline that tests multiple candidate explanations, assigns quantitative reliability scores, and selects the most consistent description for each voxel pattern. Our framework reveals thousands of interpretable patterns spanning many distinct visual concepts, including fine-grained representations previously unreported. |
| title | BrainExplore: Large-Scale Discovery of Interpretable Visual Representations in the Human Brain |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2512.08560 |