RobustA: Robust Anomaly Detection in Multimodal Data
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866911258028015616 |
|---|---|
| author | AlMarri, Salem Liaqat, Muhammad Irzam Zaheer, Muhammad Zaigham Nawaz, Shah Nandakumar, Karthik Schedl, Markus |
| author_facet | AlMarri, Salem Liaqat, Muhammad Irzam Zaheer, Muhammad Zaigham Nawaz, Shah Nandakumar, Karthik Schedl, Markus |
| contents | In recent years, multimodal anomaly detection methods have demonstrated remarkable performance improvements over video-only models. However, real-world multimodal data is often corrupted due to unforeseen environmental distortions. In this paper, we present the first-of-its-kind work that comprehensively investigates the adverse effects of corrupted modalities on multimodal anomaly detection task. To streamline this work, we propose RobustA, a carefully curated evaluation dataset to systematically observe the impacts of audio and visual corruptions on the overall effectiveness of anomaly detection systems. Furthermore, we propose a multimodal anomaly detection method, which shows notable resilience against corrupted modalities. The proposed method learns a shared representation space for different modalities and employs a dynamic weighting scheme during inference based on the estimated level of corruption. Our work represents a significant step forward in enabling the real-world application of multimodal anomaly detection, addressing situations where the likely events of modality corruptions occur. The proposed evaluation dataset with corrupted modalities and respective extracted features will be made publicly available. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_07276 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | RobustA: Robust Anomaly Detection in Multimodal Data AlMarri, Salem Liaqat, Muhammad Irzam Zaheer, Muhammad Zaigham Nawaz, Shah Nandakumar, Karthik Schedl, Markus Machine Learning In recent years, multimodal anomaly detection methods have demonstrated remarkable performance improvements over video-only models. However, real-world multimodal data is often corrupted due to unforeseen environmental distortions. In this paper, we present the first-of-its-kind work that comprehensively investigates the adverse effects of corrupted modalities on multimodal anomaly detection task. To streamline this work, we propose RobustA, a carefully curated evaluation dataset to systematically observe the impacts of audio and visual corruptions on the overall effectiveness of anomaly detection systems. Furthermore, we propose a multimodal anomaly detection method, which shows notable resilience against corrupted modalities. The proposed method learns a shared representation space for different modalities and employs a dynamic weighting scheme during inference based on the estimated level of corruption. Our work represents a significant step forward in enabling the real-world application of multimodal anomaly detection, addressing situations where the likely events of modality corruptions occur. The proposed evaluation dataset with corrupted modalities and respective extracted features will be made publicly available. |
| title | RobustA: Robust Anomaly Detection in Multimodal Data |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2511.07276 |