Decoding Speaker-Normalized Pitch from EEG for Mandarin Perception
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915305234628608 |
|---|---|
| author | Chen, Jiaxin Wang, Yiming Zhang, Ziyu Han, Jiayang Liu, Yin-Long Feng, Rui Liang, Xiuyuan Ling, Zhen-Hua Yuan, Jiahong |
| author_facet | Chen, Jiaxin Wang, Yiming Zhang, Ziyu Han, Jiayang Liu, Yin-Long Feng, Rui Liang, Xiuyuan Ling, Zhen-Hua Yuan, Jiahong |
| contents | The same speech content produced by different speakers exhibits significant differences in pitch contour, yet listeners' semantic perception remains unaffected. This phenomenon may stem from the brain's perception of pitch contours being independent of individual speakers' pitch ranges. In this work, we recorded electroencephalogram (EEG) while participants listened to Mandarin monosyllables with varying tones, phonemes, and speakers. The CE-ViViT model is proposed to decode raw or speaker-normalized pitch contours directly from EEG. Experimental results demonstrate that the proposed model can decode pitch contours with modest errors, achieving performance comparable to state-of-the-art EEG regression methods. Moreover, speaker-normalized pitch contours were decoded more accurately, supporting the neural encoding of relative pitch. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_19626 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Decoding Speaker-Normalized Pitch from EEG for Mandarin Perception Chen, Jiaxin Wang, Yiming Zhang, Ziyu Han, Jiayang Liu, Yin-Long Feng, Rui Liang, Xiuyuan Ling, Zhen-Hua Yuan, Jiahong Sound Audio and Speech Processing The same speech content produced by different speakers exhibits significant differences in pitch contour, yet listeners' semantic perception remains unaffected. This phenomenon may stem from the brain's perception of pitch contours being independent of individual speakers' pitch ranges. In this work, we recorded electroencephalogram (EEG) while participants listened to Mandarin monosyllables with varying tones, phonemes, and speakers. The CE-ViViT model is proposed to decode raw or speaker-normalized pitch contours directly from EEG. Experimental results demonstrate that the proposed model can decode pitch contours with modest errors, achieving performance comparable to state-of-the-art EEG regression methods. Moreover, speaker-normalized pitch contours were decoded more accurately, supporting the neural encoding of relative pitch. |
| title | Decoding Speaker-Normalized Pitch from EEG for Mandarin Perception |
| topic | Sound Audio and Speech Processing |
| url | https://arxiv.org/abs/2505.19626 |