Statistical Learning for Latent Embedding Alignment with Application to Brain Encoding and Decoding

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Xu, Shuoxun, Yan, Zhanhao, Li, Lexin
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866911534970568704
author Xu, Shuoxun
Yan, Zhanhao
Li, Lexin
author_facet Xu, Shuoxun
Yan, Zhanhao
Li, Lexin
contents Brain encoding and decoding aims to understand the relationship between external stimuli and brain activities, and is a fundamental problem in neuroscience. In this article, we study latent embedding alignment for brain encoding and decoding, with a focus on improving sample efficiency under limited fMRI-stimulus paired data and substantial subject heterogeneity. We propose a lightweight alignment framework equipped with two statistical learning components: inverse semi-supervised learning that leverages abundant unpaired stimulus embeddings through inverse mapping and residual debiasing, and meta transfer learning that borrows strength from pretrained models across subjects via sparse aggregation and residual correction. Both methods operate exclusively at the alignment stage while keeping encoders and decoders frozen, allowing for efficient computation, modular deployment, and rigorous theoretical analysis. We establish finite-sample generalization bounds and safety guarantees, and demonstrate competitive empirical performance on the large-scale fMRI-image reconstruction benchmark data.
format Preprint
id arxiv_https___arxiv_org_abs_2603_21042
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Statistical Learning for Latent Embedding Alignment with Application to Brain Encoding and Decoding
Xu, Shuoxun
Yan, Zhanhao
Li, Lexin
Methodology
Machine Learning
Brain encoding and decoding aims to understand the relationship between external stimuli and brain activities, and is a fundamental problem in neuroscience. In this article, we study latent embedding alignment for brain encoding and decoding, with a focus on improving sample efficiency under limited fMRI-stimulus paired data and substantial subject heterogeneity. We propose a lightweight alignment framework equipped with two statistical learning components: inverse semi-supervised learning that leverages abundant unpaired stimulus embeddings through inverse mapping and residual debiasing, and meta transfer learning that borrows strength from pretrained models across subjects via sparse aggregation and residual correction. Both methods operate exclusively at the alignment stage while keeping encoders and decoders frozen, allowing for efficient computation, modular deployment, and rigorous theoretical analysis. We establish finite-sample generalization bounds and safety guarantees, and demonstrate competitive empirical performance on the large-scale fMRI-image reconstruction benchmark data.
title Statistical Learning for Latent Embedding Alignment with Application to Brain Encoding and Decoding
topic Methodology
Machine Learning
url https://arxiv.org/abs/2603.21042