Meta-learning In-Context Enables Training-Free Cross Subject Brain Decoding
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2026
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866908949800812544 |
|---|---|
| author | Nan, Mu Yu, Muquan Mai, Weijian Prince, Jacob S. Adeli, Hossein Zhang, Rui Cao, Jiahang Becker, Benjamin Pyles, John A. Henderson, Margaret M. Song, Chunfeng Kriegeskorte, Nikolaus Tarr, Michael J. Hu, Xiaoqing Luo, Andrew F. |
| author_facet | Nan, Mu Yu, Muquan Mai, Weijian Prince, Jacob S. Adeli, Hossein Zhang, Rui Cao, Jiahang Becker, Benjamin Pyles, John A. Henderson, Margaret M. Song, Chunfeng Kriegeskorte, Nikolaus Tarr, Michael J. Hu, Xiaoqing Luo, Andrew F. |
| contents | Visual decoding from brain signals is a key challenge at the intersection of computer vision and neuroscience, requiring methods that bridge neural representations and computational models of vision. A field-wide goal is to achieve generalizable, cross-subject models. A major obstacle towards this goal is the substantial variability in neural representations across individuals, which has so far required training bespoke models or fine-tuning separately for each subject. To address this challenge, we introduce a meta-optimized approach for semantic visual decoding from fMRI that generalizes to novel subjects without any fine-tuning. By simply conditioning on a small set of image-brain activation examples from the new individual, our model rapidly infers their unique neural encoding patterns to facilitate robust and efficient visual decoding. Our approach is explicitly optimized for in-context learning of the new subject's encoding model and performs decoding by hierarchical inference, inverting the encoder. First, for multiple brain regions, we estimate the per-voxel visual response encoder parameters by constructing a context over multiple stimuli and responses. Second, we construct a context consisting of encoder parameters and response values over multiple voxels to perform aggregated functional inversion. We demonstrate strong cross-subject and cross-scanner generalization across diverse visual backbones without retraining or fine-tuning. Moreover, our approach requires neither anatomical alignment nor stimulus overlap. This work is a critical step towards a generalizable foundation model for non-invasive brain decoding. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_08537 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Meta-learning In-Context Enables Training-Free Cross Subject Brain Decoding Nan, Mu Yu, Muquan Mai, Weijian Prince, Jacob S. Adeli, Hossein Zhang, Rui Cao, Jiahang Becker, Benjamin Pyles, John A. Henderson, Margaret M. Song, Chunfeng Kriegeskorte, Nikolaus Tarr, Michael J. Hu, Xiaoqing Luo, Andrew F. Machine Learning Neurons and Cognition Visual decoding from brain signals is a key challenge at the intersection of computer vision and neuroscience, requiring methods that bridge neural representations and computational models of vision. A field-wide goal is to achieve generalizable, cross-subject models. A major obstacle towards this goal is the substantial variability in neural representations across individuals, which has so far required training bespoke models or fine-tuning separately for each subject. To address this challenge, we introduce a meta-optimized approach for semantic visual decoding from fMRI that generalizes to novel subjects without any fine-tuning. By simply conditioning on a small set of image-brain activation examples from the new individual, our model rapidly infers their unique neural encoding patterns to facilitate robust and efficient visual decoding. Our approach is explicitly optimized for in-context learning of the new subject's encoding model and performs decoding by hierarchical inference, inverting the encoder. First, for multiple brain regions, we estimate the per-voxel visual response encoder parameters by constructing a context over multiple stimuli and responses. Second, we construct a context consisting of encoder parameters and response values over multiple voxels to perform aggregated functional inversion. We demonstrate strong cross-subject and cross-scanner generalization across diverse visual backbones without retraining or fine-tuning. Moreover, our approach requires neither anatomical alignment nor stimulus overlap. This work is a critical step towards a generalizable foundation model for non-invasive brain decoding. |
| title | Meta-learning In-Context Enables Training-Free Cross Subject Brain Decoding |
| topic | Machine Learning Neurons and Cognition |
| url | https://arxiv.org/abs/2604.08537 |