Saved in:
Bibliographic Details
Main Authors: Moscati, Marta, Saeed, Muhammad Saad, Zanoni, Marina, Noman, Mubashir, Das, Rohan Kumar, Swain, Monorama, Hou, Yufang, Andre, Elisabeth, Malik, Khalid Mahmood, Schedl, Markus, Nawaz, Shah
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2603.24569
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908918814343168
author Moscati, Marta
Saeed, Muhammad Saad
Zanoni, Marina
Noman, Mubashir
Das, Rohan Kumar
Swain, Monorama
Hou, Yufang
Andre, Elisabeth
Malik, Khalid Mahmood
Schedl, Markus
Nawaz, Shah
author_facet Moscati, Marta
Saeed, Muhammad Saad
Zanoni, Marina
Noman, Mubashir
Das, Rohan Kumar
Swain, Monorama
Hou, Yufang
Andre, Elisabeth
Malik, Khalid Mahmood
Schedl, Markus
Nawaz, Shah
contents Multimodal speaker identification systems typically assume the availability of complete and homogeneous audio-visual modalities during both training and testing. However, in real-world applications, such assumptions often do not hold. Visual information may be missing due to occlusions, camera failures, or privacy constraints, while multilingual speakers introduce additional complexity due to linguistic variability across languages. These challenges significantly affect the robustness and generalization of multimodal speaker identification systems. The POLY-SIM Grand Challenge 2026 aims to advance research in multimodal speaker identification under missing-modality and cross-lingual conditions. Specifically, the Grand Challenge encourages the development of robust methods that can effectively leverage incomplete multimodal inputs while maintaining strong performance across different languages. This report presents the design and organization of the POLY-SIM Grand Challenge 2026, including the dataset, task formulation, evaluation protocol, and baseline model. By providing a standardized benchmark and evaluation framework, the challenge aims to foster progress toward more robust and practical multimodal speaker identification systems.
format Preprint
id arxiv_https___arxiv_org_abs_2603_24569
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle POLY-SIM: Polyglot Speaker Identification with Missing Modality Grand Challenge 2026 Evaluation Plan
Moscati, Marta
Saeed, Muhammad Saad
Zanoni, Marina
Noman, Mubashir
Das, Rohan Kumar
Swain, Monorama
Hou, Yufang
Andre, Elisabeth
Malik, Khalid Mahmood
Schedl, Markus
Nawaz, Shah
Computer Vision and Pattern Recognition
Multimodal speaker identification systems typically assume the availability of complete and homogeneous audio-visual modalities during both training and testing. However, in real-world applications, such assumptions often do not hold. Visual information may be missing due to occlusions, camera failures, or privacy constraints, while multilingual speakers introduce additional complexity due to linguistic variability across languages. These challenges significantly affect the robustness and generalization of multimodal speaker identification systems. The POLY-SIM Grand Challenge 2026 aims to advance research in multimodal speaker identification under missing-modality and cross-lingual conditions. Specifically, the Grand Challenge encourages the development of robust methods that can effectively leverage incomplete multimodal inputs while maintaining strong performance across different languages. This report presents the design and organization of the POLY-SIM Grand Challenge 2026, including the dataset, task formulation, evaluation protocol, and baseline model. By providing a standardized benchmark and evaluation framework, the challenge aims to foster progress toward more robust and practical multimodal speaker identification systems.
title POLY-SIM: Polyglot Speaker Identification with Missing Modality Grand Challenge 2026 Evaluation Plan
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2603.24569