Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2407.19875 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914891432984576 |
|---|---|
| author | Tang, Jiehui Wang, Xiaofei Xiao, Zhen Liu, Jiayi Liu, Xueliang Hong, Richang |
| author_facet | Tang, Jiehui Wang, Xiaofei Xiao, Zhen Liu, Jiayi Liu, Xueliang Hong, Richang |
| contents | This paper presents Team Xaiofei's innovative approach to exploring Face-Voice Association in Multilingual Environments (FAME) at ACM Multimedia 2024. We focus on the impact of different languages in face-voice matching by building upon Fusion and Orthogonal Projection (FOP), introducing four key components: a dual-branch structure, dynamic sample pair weighting, robust data augmentation, and score polarization strategy. Our dual-branch structure serves as an auxiliary mechanism to better integrate and provide more comprehensive information. We also introduce a dynamic weighting mechanism for various sample pairs to optimize learning. Data augmentation techniques are employed to enhance the model's generalization across diverse conditions. Additionally, score polarization strategy based on age and gender matching confidence clarifies and accentuates the final results. Our methods demonstrate significant effectiveness, achieving an equal error rate (EER) of 20.07 on the V2-EH dataset and 21.76 on the V1-EU dataset. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_19875 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Exploring Robust Face-Voice Matching in Multilingual Environments Tang, Jiehui Wang, Xiaofei Xiao, Zhen Liu, Jiayi Liu, Xueliang Hong, Richang Computer Vision and Pattern Recognition This paper presents Team Xaiofei's innovative approach to exploring Face-Voice Association in Multilingual Environments (FAME) at ACM Multimedia 2024. We focus on the impact of different languages in face-voice matching by building upon Fusion and Orthogonal Projection (FOP), introducing four key components: a dual-branch structure, dynamic sample pair weighting, robust data augmentation, and score polarization strategy. Our dual-branch structure serves as an auxiliary mechanism to better integrate and provide more comprehensive information. We also introduce a dynamic weighting mechanism for various sample pairs to optimize learning. Data augmentation techniques are employed to enhance the model's generalization across diverse conditions. Additionally, score polarization strategy based on age and gender matching confidence clarifies and accentuates the final results. Our methods demonstrate significant effectiveness, achieving an equal error rate (EER) of 20.07 on the V2-EH dataset and 21.76 on the V1-EU dataset. |
| title | Exploring Robust Face-Voice Matching in Multilingual Environments |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2407.19875 |