Decoding Linguistic Representations of Human Brain

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Wang, Yu, Liu, Heyang, Wang, Yuhao, Xuan, Chuan, Hou, Yixuan, Feng, Sheng, Liu, Hongcheng, Liao, Yusheng, Wang, Yanfeng
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866911971534700544
author Wang, Yu
Liu, Heyang
Wang, Yuhao
Xuan, Chuan
Hou, Yixuan
Feng, Sheng
Liu, Hongcheng
Liao, Yusheng
Wang, Yanfeng
author_facet Wang, Yu
Liu, Heyang
Wang, Yuhao
Xuan, Chuan
Hou, Yixuan
Feng, Sheng
Liu, Hongcheng
Liao, Yusheng
Wang, Yanfeng
contents Language, as an information medium created by advanced organisms, has always been a concern of neuroscience regarding how it is represented in the brain. Decoding linguistic representations in the evoked brain has shown groundbreaking achievements, thanks to the rapid improvement of neuroimaging, medical technology, life sciences and artificial intelligence. In this work, we present a taxonomy of brain-to-language decoding of both textual and speech formats. This work integrates two types of research: neuroscience focusing on language understanding and deep learning-based brain decoding. Generating discernible language information from brain activity could not only help those with limited articulation, especially amyotrophic lateral sclerosis (ALS) patients but also open up a new way for the next generation's brain-computer interface (BCI). This article will help brain scientists and deep-learning researchers to gain a bird's eye view of fine-grained language perception, and thus facilitate their further investigation and research of neural process and language decoding.
format Preprint
id arxiv_https___arxiv_org_abs_2407_20622
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Decoding Linguistic Representations of Human Brain
Wang, Yu
Liu, Heyang
Wang, Yuhao
Xuan, Chuan
Hou, Yixuan
Feng, Sheng
Liu, Hongcheng
Liao, Yusheng
Wang, Yanfeng
Computation and Language
Sound
Audio and Speech Processing
Language, as an information medium created by advanced organisms, has always been a concern of neuroscience regarding how it is represented in the brain. Decoding linguistic representations in the evoked brain has shown groundbreaking achievements, thanks to the rapid improvement of neuroimaging, medical technology, life sciences and artificial intelligence. In this work, we present a taxonomy of brain-to-language decoding of both textual and speech formats. This work integrates two types of research: neuroscience focusing on language understanding and deep learning-based brain decoding. Generating discernible language information from brain activity could not only help those with limited articulation, especially amyotrophic lateral sclerosis (ALS) patients but also open up a new way for the next generation's brain-computer interface (BCI). This article will help brain scientists and deep-learning researchers to gain a bird's eye view of fine-grained language perception, and thus facilitate their further investigation and research of neural process and language decoding.
title Decoding Linguistic Representations of Human Brain
topic Computation and Language
Sound
Audio and Speech Processing
url https://arxiv.org/abs/2407.20622