KunquDB: An Attempt for Speaker Verification in the Chinese Opera Scenario

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Zhou, Huali, Lin, Yuke, Liu, Dong, Li, Ming
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866911997112614912
author Zhou, Huali
Lin, Yuke
Liu, Dong
Li, Ming
author_facet Zhou, Huali
Lin, Yuke
Liu, Dong
Li, Ming
contents This work aims to promote Chinese opera research in both musical and speech domains, with a primary focus on overcoming the data limitations. We introduce KunquDB, a relatively large-scale, well-annotated audio-visual dataset comprising 339 speakers and 128 hours of content. Originating from the Kunqu Opera Art Canon (Kunqu yishu dadian), KunquDB is meticulously structured by dialogue lines, providing explicit annotations including character names, speaker names, gender information, vocal manner classifications, and accompanied by preliminary text transcriptions. KunquDB provides a versatile foundation for role-centric acoustic studies and advancements in speech-related research, including Automatic Speaker Verification (ASV). Beyond enriching opera research, this dataset bridges the gap between artistic expression and technological innovation. Pioneering the exploration of ASV in Chinese opera, we construct four test trials considering two distinct vocal manners in opera voices: stage speech (ST) and singing (S). Implementing domain adaptation methods effectively mitigates domain mismatches induced by these vocal manner variations while there is still room for further improvement as a benchmark.
format Preprint
id arxiv_https___arxiv_org_abs_2403_13356
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle KunquDB: An Attempt for Speaker Verification in the Chinese Opera Scenario
Zhou, Huali
Lin, Yuke
Liu, Dong
Li, Ming
Audio and Speech Processing
Sound
Image and Video Processing
This work aims to promote Chinese opera research in both musical and speech domains, with a primary focus on overcoming the data limitations. We introduce KunquDB, a relatively large-scale, well-annotated audio-visual dataset comprising 339 speakers and 128 hours of content. Originating from the Kunqu Opera Art Canon (Kunqu yishu dadian), KunquDB is meticulously structured by dialogue lines, providing explicit annotations including character names, speaker names, gender information, vocal manner classifications, and accompanied by preliminary text transcriptions. KunquDB provides a versatile foundation for role-centric acoustic studies and advancements in speech-related research, including Automatic Speaker Verification (ASV). Beyond enriching opera research, this dataset bridges the gap between artistic expression and technological innovation. Pioneering the exploration of ASV in Chinese opera, we construct four test trials considering two distinct vocal manners in opera voices: stage speech (ST) and singing (S). Implementing domain adaptation methods effectively mitigates domain mismatches induced by these vocal manner variations while there is still room for further improvement as a benchmark.
title KunquDB: An Attempt for Speaker Verification in the Chinese Opera Scenario
topic Audio and Speech Processing
Sound
Image and Video Processing
url https://arxiv.org/abs/2403.13356