Inter-individual and inter-site neural code conversion without shared stimuli
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866909275750662144 |
|---|---|
| author | Wang, Haibao Ho, Jun Kai Cheng, Fan L. Aoki, Shuntaro C. Muraki, Yusuke Tanaka, Misato Kamitani, Yukiyasu |
| author_facet | Wang, Haibao Ho, Jun Kai Cheng, Fan L. Aoki, Shuntaro C. Muraki, Yusuke Tanaka, Misato Kamitani, Yukiyasu |
| contents | Inter-individual variability in fine-grained functional brain organization poses challenges for scalable data analysis and modeling. Functional alignment techniques can help mitigate these individual differences but typically require paired brain data with the same stimuli between individuals, which is often unavailable. We present a neural code conversion method that overcomes this constraint by optimizing conversion parameters based on the discrepancy between the stimulus contents represented by original and converted brain activity patterns. This approach, combined with hierarchical features of deep neural networks (DNNs) as latent content representations, achieves conversion accuracy comparable to methods using shared stimuli. The converted brain activity from a source subject can be accurately decoded using the target's pre-trained decoders, producing high-quality visual image reconstructions that rival within-individual decoding, even with data across different sites and limited training samples. Our approach offers a promising framework for scalable neural data analysis and modeling and a foundation for brain-to-brain communication. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_11517 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Inter-individual and inter-site neural code conversion without shared stimuli Wang, Haibao Ho, Jun Kai Cheng, Fan L. Aoki, Shuntaro C. Muraki, Yusuke Tanaka, Misato Kamitani, Yukiyasu Neurons and Cognition Human-Computer Interaction Inter-individual variability in fine-grained functional brain organization poses challenges for scalable data analysis and modeling. Functional alignment techniques can help mitigate these individual differences but typically require paired brain data with the same stimuli between individuals, which is often unavailable. We present a neural code conversion method that overcomes this constraint by optimizing conversion parameters based on the discrepancy between the stimulus contents represented by original and converted brain activity patterns. This approach, combined with hierarchical features of deep neural networks (DNNs) as latent content representations, achieves conversion accuracy comparable to methods using shared stimuli. The converted brain activity from a source subject can be accurately decoded using the target's pre-trained decoders, producing high-quality visual image reconstructions that rival within-individual decoding, even with data across different sites and limited training samples. Our approach offers a promising framework for scalable neural data analysis and modeling and a foundation for brain-to-brain communication. |
| title | Inter-individual and inter-site neural code conversion without shared stimuli |
| topic | Neurons and Cognition Human-Computer Interaction |
| url | https://arxiv.org/abs/2403.11517 |