Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2506.14783 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911010444541952 |
|---|---|
| author | Masry, Mohamed Amen, Mohamed Elzyat, Mohamed Hamed, Mohamed Magdy, Norhan Khaled, Maram |
| author_facet | Masry, Mohamed Amen, Mohamed Elzyat, Mohamed Hamed, Mohamed Magdy, Norhan Khaled, Maram |
| contents | Decoding natural language from brain activity using non-invasive electroencephalography (EEG) remains a significant challenge in neuroscience and machine learning, particularly for open-vocabulary scenarios where traditional methods struggle with noise and variability. Previous studies have achieved high accuracy on small-closed vocabularies, but it still struggles on open vocabularies. In this study, we propose ETS, a framework that integrates EEG with synchronized eye-tracking data to address two critical tasks: (1) open-vocabulary text generation and (2) sentiment classification of perceived language. Our model achieves a superior performance on BLEU and Rouge score for EEG-To-Text decoding and up to 10% F1 score on EEG-based ternary sentiment classification, which significantly outperforms supervised baselines. Furthermore, we show that our proposed model can handle data from various subjects and sources, showing great potential for high performance open vocabulary eeg-to-text system. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_14783 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | ETS: Open Vocabulary Electroencephalography-To-Text Decoding and Sentiment Classification Masry, Mohamed Amen, Mohamed Elzyat, Mohamed Hamed, Mohamed Magdy, Norhan Khaled, Maram Machine Learning Computation and Language Human-Computer Interaction Decoding natural language from brain activity using non-invasive electroencephalography (EEG) remains a significant challenge in neuroscience and machine learning, particularly for open-vocabulary scenarios where traditional methods struggle with noise and variability. Previous studies have achieved high accuracy on small-closed vocabularies, but it still struggles on open vocabularies. In this study, we propose ETS, a framework that integrates EEG with synchronized eye-tracking data to address two critical tasks: (1) open-vocabulary text generation and (2) sentiment classification of perceived language. Our model achieves a superior performance on BLEU and Rouge score for EEG-To-Text decoding and up to 10% F1 score on EEG-based ternary sentiment classification, which significantly outperforms supervised baselines. Furthermore, we show that our proposed model can handle data from various subjects and sources, showing great potential for high performance open vocabulary eeg-to-text system. |
| title | ETS: Open Vocabulary Electroencephalography-To-Text Decoding and Sentiment Classification |
| topic | Machine Learning Computation and Language Human-Computer Interaction |
| url | https://arxiv.org/abs/2506.14783 |