Dynamic Neural Communication: Convergence of Computer Vision and Brain-Computer Interface
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910788903501824 |
|---|---|
| author | Park, Ji-Ha Lee, Seo-Hyun Kim, Soowon Lee, Seong-Whan |
| author_facet | Park, Ji-Ha Lee, Seo-Hyun Kim, Soowon Lee, Seong-Whan |
| contents | Interpreting human neural signals to decode static speech intentions such as text or images and dynamic speech intentions such as audio or video is showing great potential as an innovative communication tool. Human communication accompanies various features, such as articulatory movements, facial expressions, and internal speech, all of which are reflected in neural signals. However, most studies only generate short or fragmented outputs, while providing informative communication by leveraging various features from neural signals remains challenging. In this study, we introduce a dynamic neural communication method that leverages current computer vision and brain-computer interface technologies. Our approach captures the user's intentions from neural signals and decodes visemes in short time steps to produce dynamic visual outputs. The results demonstrate the potential to rapidly capture and reconstruct lip movements during natural speech attempts from human neural signals, enabling dynamic neural communication through the convergence of computer vision and brain--computer interface. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_09211 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Dynamic Neural Communication: Convergence of Computer Vision and Brain-Computer Interface Park, Ji-Ha Lee, Seo-Hyun Kim, Soowon Lee, Seong-Whan Artificial Intelligence Interpreting human neural signals to decode static speech intentions such as text or images and dynamic speech intentions such as audio or video is showing great potential as an innovative communication tool. Human communication accompanies various features, such as articulatory movements, facial expressions, and internal speech, all of which are reflected in neural signals. However, most studies only generate short or fragmented outputs, while providing informative communication by leveraging various features from neural signals remains challenging. In this study, we introduce a dynamic neural communication method that leverages current computer vision and brain-computer interface technologies. Our approach captures the user's intentions from neural signals and decodes visemes in short time steps to produce dynamic visual outputs. The results demonstrate the potential to rapidly capture and reconstruct lip movements during natural speech attempts from human neural signals, enabling dynamic neural communication through the convergence of computer vision and brain--computer interface. |
| title | Dynamic Neural Communication: Convergence of Computer Vision and Brain-Computer Interface |
| topic | Artificial Intelligence |
| url | https://arxiv.org/abs/2411.09211 |