A Speech Production Model for Radar: Connecting Speech Acoustics with Radar-Measured Vibrations
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915206265831424 |
|---|---|
| author | Lenz, Isabella Rong, Yu Bliss, Daniel Liss, Julie Berisha, Visar |
| author_facet | Lenz, Isabella Rong, Yu Bliss, Daniel Liss, Julie Berisha, Visar |
| contents | Millimeter Wave (mmWave) radar has emerged as a promising modality for speech sensing, offering advantages over traditional microphones. Prior works have demonstrated that radar captures motion signals related to vocal vibrations, but there is a gap in the understanding of the analytical connection between radar-measured vibrations and acoustic speech signals. We establish a mathematical framework linking radar-captured neck vibrations to speech acoustics. We derive an analytical relationship between neck surface displacements and speech. We use data from 66 human participants, and statistical spectral distance analysis to empirically assess the model. Our results show that the radar-measured signal aligns more closely with our model filtered vibration signal derived from speech than with raw speech itself. These findings provide a foundation for improved radar-based speech processing for applications in speech enhancement, coding, surveillance, and authentication. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_15627 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | A Speech Production Model for Radar: Connecting Speech Acoustics with Radar-Measured Vibrations Lenz, Isabella Rong, Yu Bliss, Daniel Liss, Julie Berisha, Visar Audio and Speech Processing Signal Processing Millimeter Wave (mmWave) radar has emerged as a promising modality for speech sensing, offering advantages over traditional microphones. Prior works have demonstrated that radar captures motion signals related to vocal vibrations, but there is a gap in the understanding of the analytical connection between radar-measured vibrations and acoustic speech signals. We establish a mathematical framework linking radar-captured neck vibrations to speech acoustics. We derive an analytical relationship between neck surface displacements and speech. We use data from 66 human participants, and statistical spectral distance analysis to empirically assess the model. Our results show that the radar-measured signal aligns more closely with our model filtered vibration signal derived from speech than with raw speech itself. These findings provide a foundation for improved radar-based speech processing for applications in speech enhancement, coding, surveillance, and authentication. |
| title | A Speech Production Model for Radar: Connecting Speech Acoustics with Radar-Measured Vibrations |
| topic | Audio and Speech Processing Signal Processing |
| url | https://arxiv.org/abs/2503.15627 |