Beyond Pixels: A Differentiable Pipeline for Probing Neuronal Selectivity in 3D
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914094237351936 |
|---|---|
| author | Elumalai, Pavithra Bashiri, Mohammad Chakrabarty, Goirik Shrinivasan, Suhas Sinz, Fabian H. |
| author_facet | Elumalai, Pavithra Bashiri, Mohammad Chakrabarty, Goirik Shrinivasan, Suhas Sinz, Fabian H. |
| contents | Visual perception relies on inference of 3D scene properties such as shape, pose, and lighting. To understand how visual sensory neurons enable robust perception, it is crucial to characterize their selectivity to such physically interpretable factors. However, current approaches mainly operate on 2D pixels, making it difficult to isolate selectivity for physical scene properties. To address this limitation, we introduce a differentiable rendering pipeline that optimizes deformable meshes to obtain MEIs directly in 3D. The method parameterizes mesh deformations with radial basis functions and learns offsets and scales that maximize neuronal responses while enforcing geometric regularity. Applied to models of monkey area V4, our approach enables probing neuronal selectivity to interpretable 3D factors such as pose and lighting. This approach bridges inverse graphics with systems neuroscience, offering a way to probe neural selectivity with physically grounded, 3D stimuli beyond conventional pixel-based methods. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_13433 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Beyond Pixels: A Differentiable Pipeline for Probing Neuronal Selectivity in 3D Elumalai, Pavithra Bashiri, Mohammad Chakrabarty, Goirik Shrinivasan, Suhas Sinz, Fabian H. Computer Vision and Pattern Recognition Visual perception relies on inference of 3D scene properties such as shape, pose, and lighting. To understand how visual sensory neurons enable robust perception, it is crucial to characterize their selectivity to such physically interpretable factors. However, current approaches mainly operate on 2D pixels, making it difficult to isolate selectivity for physical scene properties. To address this limitation, we introduce a differentiable rendering pipeline that optimizes deformable meshes to obtain MEIs directly in 3D. The method parameterizes mesh deformations with radial basis functions and learns offsets and scales that maximize neuronal responses while enforcing geometric regularity. Applied to models of monkey area V4, our approach enables probing neuronal selectivity to interpretable 3D factors such as pose and lighting. This approach bridges inverse graphics with systems neuroscience, offering a way to probe neural selectivity with physically grounded, 3D stimuli beyond conventional pixel-based methods. |
| title | Beyond Pixels: A Differentiable Pipeline for Probing Neuronal Selectivity in 3D |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2510.13433 |