VoiceMorph: How AI Voice Morphing Reveals the Boundaries of Auditory Self-Recognition

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Shimizu, Kye, Gao, Minghan, Ganesh, Ananya, Maes, Pattie
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911226914668544
author Shimizu, Kye
Gao, Minghan
Ganesh, Ananya
Maes, Pattie
author_facet Shimizu, Kye
Gao, Minghan
Ganesh, Ananya
Maes, Pattie
contents This study investigated auditory self-recognition boundaries using AI voice morphing technology, examining when individuals cease recognizing their own voice. Through controlled morphing between participants' voices and demographically matched targets at 1% increments using a mixed-methods design, we measured self-identification ratings and response times among 21 participants aged 18-64. Results revealed a critical recognition threshold at 35.2% morphing (95% CI [31.4, 38.1]). Older participants tolerated significantly higher morphing levels before losing self-recognition ($β$ = 0.617, p = 0.048), suggesting age-related vulnerabilities. Greater acoustic embedding distances predicted slower decision-making ($r \approx 0.5-0.53, p < 0.05$), with the longest response times for cloned versions of participants' own voices. Qualitative analysis revealed prosodic-based recognition strategies, universal voice manipulation discomfort, and awareness of applications spanning assistive technology to security risks. These findings establish foundational evidence for individual differences in voice morphing detection, with implications for AI ethics and vulnerable population protection as voice synthesis becomes accessible.
format Preprint
id arxiv_https___arxiv_org_abs_2510_16192
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle VoiceMorph: How AI Voice Morphing Reveals the Boundaries of Auditory Self-Recognition
Shimizu, Kye
Gao, Minghan
Ganesh, Ananya
Maes, Pattie
Human-Computer Interaction
This study investigated auditory self-recognition boundaries using AI voice morphing technology, examining when individuals cease recognizing their own voice. Through controlled morphing between participants' voices and demographically matched targets at 1% increments using a mixed-methods design, we measured self-identification ratings and response times among 21 participants aged 18-64. Results revealed a critical recognition threshold at 35.2% morphing (95% CI [31.4, 38.1]). Older participants tolerated significantly higher morphing levels before losing self-recognition ($β$ = 0.617, p = 0.048), suggesting age-related vulnerabilities. Greater acoustic embedding distances predicted slower decision-making ($r \approx 0.5-0.53, p < 0.05$), with the longest response times for cloned versions of participants' own voices. Qualitative analysis revealed prosodic-based recognition strategies, universal voice manipulation discomfort, and awareness of applications spanning assistive technology to security risks. These findings establish foundational evidence for individual differences in voice morphing detection, with implications for AI ethics and vulnerable population protection as voice synthesis becomes accessible.
title VoiceMorph: How AI Voice Morphing Reveals the Boundaries of Auditory Self-Recognition
topic Human-Computer Interaction
url https://arxiv.org/abs/2510.16192