Saved in:
Bibliographic Details
Main Authors: Foley, Sean, Lee, Jihwan, Huang, Kevin, Shi, Xuan, Lee, Yoonjeong, Goldstein, Louis, Narayanan, Shrikanth
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2509.14479
Tags: Add Tag
No Tags, Be the first to tag this record!
Table of Contents:
  • We release the USC Long Single-Speaker (LSS) dataset containing real-time MRI video of the vocal tract dynamics and simultaneous audio obtained during speech production. This unique dataset contains roughly one hour of video and audio data from a single native speaker of American English, making it one of the longer publicly available single-speaker datasets of real-time MRI speech data. Along with the articulatory and acoustic raw data, we release derived representations of the data that are suitable for a range of downstream tasks. This includes video cropped to the vocal tract region, sentence-level splits of the data, restored and denoised audio, and regions-of-interest timeseries. We also benchmark this dataset on articulatory synthesis and phoneme recognition tasks, providing baseline performance for these tasks on this dataset which future research can aim to improve upon.