Task-Optimized Convolutional Recurrent Networks Align with Tactile Processing in the Rodent Brain

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Chung, Trinity, Shen, Yuchen, Kong, Nathan C. L., Nayebi, Aran
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915550463000576
author Chung, Trinity
Shen, Yuchen
Kong, Nathan C. L.
Nayebi, Aran
author_facet Chung, Trinity
Shen, Yuchen
Kong, Nathan C. L.
Nayebi, Aran
contents Tactile sensing remains far less understood in neuroscience and less effective in artificial systems compared to more mature modalities such as vision and language. We bridge these gaps by introducing a novel Encoder-Attender-Decoder (EAD) framework to systematically explore the space of task-optimized temporal neural networks trained on realistic tactile input sequences from a customized rodent whisker-array simulator. We identify convolutional recurrent neural networks (ConvRNNs) as superior encoders to purely feedforward and state-space architectures for tactile categorization. Crucially, these ConvRNN-encoder-based EAD models achieve neural representations closely matching rodent somatosensory cortex, saturating the explainable neural variability and revealing a clear linear relationship between supervised categorization performance and neural alignment. Furthermore, contrastive self-supervised ConvRNN-encoder-based EADs, trained with tactile-specific augmentations, match supervised neural fits, serving as an ethologically-relevant, label-free proxy. For neuroscience, our findings highlight nonlinear recurrent processing as important for general-purpose tactile representations in somatosensory cortex, providing the first quantitative characterization of the underlying inductive biases in this system. For embodied AI, our results emphasize the importance of recurrent EAD architectures to handle realistic tactile inputs, along with tailored self-supervised learning methods for achieving robust tactile perception with the same type of sensors animals use to sense in unstructured environments.
format Preprint
id arxiv_https___arxiv_org_abs_2505_18361
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Task-Optimized Convolutional Recurrent Networks Align with Tactile Processing in the Rodent Brain
Chung, Trinity
Shen, Yuchen
Kong, Nathan C. L.
Nayebi, Aran
Neurons and Cognition
Artificial Intelligence
Machine Learning
Robotics
Tactile sensing remains far less understood in neuroscience and less effective in artificial systems compared to more mature modalities such as vision and language. We bridge these gaps by introducing a novel Encoder-Attender-Decoder (EAD) framework to systematically explore the space of task-optimized temporal neural networks trained on realistic tactile input sequences from a customized rodent whisker-array simulator. We identify convolutional recurrent neural networks (ConvRNNs) as superior encoders to purely feedforward and state-space architectures for tactile categorization. Crucially, these ConvRNN-encoder-based EAD models achieve neural representations closely matching rodent somatosensory cortex, saturating the explainable neural variability and revealing a clear linear relationship between supervised categorization performance and neural alignment. Furthermore, contrastive self-supervised ConvRNN-encoder-based EADs, trained with tactile-specific augmentations, match supervised neural fits, serving as an ethologically-relevant, label-free proxy. For neuroscience, our findings highlight nonlinear recurrent processing as important for general-purpose tactile representations in somatosensory cortex, providing the first quantitative characterization of the underlying inductive biases in this system. For embodied AI, our results emphasize the importance of recurrent EAD architectures to handle realistic tactile inputs, along with tailored self-supervised learning methods for achieving robust tactile perception with the same type of sensors animals use to sense in unstructured environments.
title Task-Optimized Convolutional Recurrent Networks Align with Tactile Processing in the Rodent Brain
topic Neurons and Cognition
Artificial Intelligence
Machine Learning
Robotics
url https://arxiv.org/abs/2505.18361