Audio-based Kinship Verification Using Age Domain Conversion
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866929543147683840 |
|---|---|
| author | Sun, Qiyang Akman, Alican Jing, Xin Milling, Manuel Schuller, Björn W. |
| author_facet | Sun, Qiyang Akman, Alican Jing, Xin Milling, Manuel Schuller, Björn W. |
| contents | Audio-based kinship verification (AKV) is important in many domains, such as home security monitoring, forensic identification, and social network analysis. A key challenge in the task arises from differences in age across samples from different individuals, which can be interpreted as a domain bias in a cross-domain verification task. To address this issue, we design the notion of an "age-standardised domain" wherein we utilise the optimised CycleGAN-VC3 network to perform age-audio conversion to generate the in-domain audio. The generated audio dataset is employed to extract a range of features, which are then fed into a metric learning architecture to verify kinship. Experiments are conducted on the KAN_AV audio dataset, which contains age and kinship labels. The results demonstrate that the method markedly enhances the accuracy of kinship verification, while also offering novel insights for future kinship verification research. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_11120 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Audio-based Kinship Verification Using Age Domain Conversion Sun, Qiyang Akman, Alican Jing, Xin Milling, Manuel Schuller, Björn W. Sound Artificial Intelligence Audio and Speech Processing 68T10 I.5.4; I.2.6 Audio-based kinship verification (AKV) is important in many domains, such as home security monitoring, forensic identification, and social network analysis. A key challenge in the task arises from differences in age across samples from different individuals, which can be interpreted as a domain bias in a cross-domain verification task. To address this issue, we design the notion of an "age-standardised domain" wherein we utilise the optimised CycleGAN-VC3 network to perform age-audio conversion to generate the in-domain audio. The generated audio dataset is employed to extract a range of features, which are then fed into a metric learning architecture to verify kinship. Experiments are conducted on the KAN_AV audio dataset, which contains age and kinship labels. The results demonstrate that the method markedly enhances the accuracy of kinship verification, while also offering novel insights for future kinship verification research. |
| title | Audio-based Kinship Verification Using Age Domain Conversion |
| topic | Sound Artificial Intelligence Audio and Speech Processing 68T10 I.5.4; I.2.6 |
| url | https://arxiv.org/abs/2410.11120 |