Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2509.14479 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916955616706560 |
|---|---|
| author | Foley, Sean Lee, Jihwan Huang, Kevin Shi, Xuan Lee, Yoonjeong Goldstein, Louis Narayanan, Shrikanth |
| author_facet | Foley, Sean Lee, Jihwan Huang, Kevin Shi, Xuan Lee, Yoonjeong Goldstein, Louis Narayanan, Shrikanth |
| contents | We release the USC Long Single-Speaker (LSS) dataset containing real-time MRI video of the vocal tract dynamics and simultaneous audio obtained during speech production. This unique dataset contains roughly one hour of video and audio data from a single native speaker of American English, making it one of the longer publicly available single-speaker datasets of real-time MRI speech data. Along with the articulatory and acoustic raw data, we release derived representations of the data that are suitable for a range of downstream tasks. This includes video cropped to the vocal tract region, sentence-level splits of the data, restored and denoised audio, and regions-of-interest timeseries. We also benchmark this dataset on articulatory synthesis and phoneme recognition tasks, providing baseline performance for these tasks on this dataset which future research can aim to improve upon. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_14479 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | A long-form single-speaker real-time MRI speech dataset and benchmark Foley, Sean Lee, Jihwan Huang, Kevin Shi, Xuan Lee, Yoonjeong Goldstein, Louis Narayanan, Shrikanth Sound We release the USC Long Single-Speaker (LSS) dataset containing real-time MRI video of the vocal tract dynamics and simultaneous audio obtained during speech production. This unique dataset contains roughly one hour of video and audio data from a single native speaker of American English, making it one of the longer publicly available single-speaker datasets of real-time MRI speech data. Along with the articulatory and acoustic raw data, we release derived representations of the data that are suitable for a range of downstream tasks. This includes video cropped to the vocal tract region, sentence-level splits of the data, restored and denoised audio, and regions-of-interest timeseries. We also benchmark this dataset on articulatory synthesis and phoneme recognition tasks, providing baseline performance for these tasks on this dataset which future research can aim to improve upon. |
| title | A long-form single-speaker real-time MRI speech dataset and benchmark |
| topic | Sound |
| url | https://arxiv.org/abs/2509.14479 |