SNIFR : Boosting Fine-Grained Child Harmful Content Detection Through Audio-Visual Alignment with Cascaded Cross-Transformer

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Phukan, Orchid Chetia, Akhtar, Mohd Mujtaba, Girish, Behera, Swarup Ranjan, Siddiqui, Abu Osama, Jain, Sarthak, Mallick, Priyabrata, Patibandla, Jaya Sai Kiran, Reddy, Pailla Balakrishna, Buduru, Arun Balaji, Sharma, Rajesh
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866913874750472192
author Phukan, Orchid Chetia
Akhtar, Mohd Mujtaba
Girish
Behera, Swarup Ranjan
Siddiqui, Abu Osama
Jain, Sarthak
Mallick, Priyabrata
Patibandla, Jaya Sai Kiran
Reddy, Pailla Balakrishna
Buduru, Arun Balaji
Sharma, Rajesh
author_facet Phukan, Orchid Chetia
Akhtar, Mohd Mujtaba
Girish
Behera, Swarup Ranjan
Siddiqui, Abu Osama
Jain, Sarthak
Mallick, Priyabrata
Patibandla, Jaya Sai Kiran
Reddy, Pailla Balakrishna
Buduru, Arun Balaji
Sharma, Rajesh
contents As video-sharing platforms have grown over the past decade, child viewership has surged, increasing the need for precise detection of harmful content like violence or explicit scenes. Malicious users exploit moderation systems by embedding unsafe content in minimal frames to evade detection. While prior research has focused on visual cues and advanced such fine-grained detection, audio features remain underexplored. In this study, we embed audio cues with visual for fine-grained child harmful content detection and introduce SNIFR, a novel framework for effective alignment. SNIFR employs a transformer encoder for intra-modality interaction, followed by a cascaded cross-transformer for inter-modality alignment. Our approach achieves superior performance over unimodal and baseline fusion methods, setting a new state-of-the-art.
format Preprint
id arxiv_https___arxiv_org_abs_2506_03378
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle SNIFR : Boosting Fine-Grained Child Harmful Content Detection Through Audio-Visual Alignment with Cascaded Cross-Transformer
Phukan, Orchid Chetia
Akhtar, Mohd Mujtaba
Girish
Behera, Swarup Ranjan
Siddiqui, Abu Osama
Jain, Sarthak
Mallick, Priyabrata
Patibandla, Jaya Sai Kiran
Reddy, Pailla Balakrishna
Buduru, Arun Balaji
Sharma, Rajesh
Audio and Speech Processing
Computer Vision and Pattern Recognition
Multimedia
As video-sharing platforms have grown over the past decade, child viewership has surged, increasing the need for precise detection of harmful content like violence or explicit scenes. Malicious users exploit moderation systems by embedding unsafe content in minimal frames to evade detection. While prior research has focused on visual cues and advanced such fine-grained detection, audio features remain underexplored. In this study, we embed audio cues with visual for fine-grained child harmful content detection and introduce SNIFR, a novel framework for effective alignment. SNIFR employs a transformer encoder for intra-modality interaction, followed by a cascaded cross-transformer for inter-modality alignment. Our approach achieves superior performance over unimodal and baseline fusion methods, setting a new state-of-the-art.
title SNIFR : Boosting Fine-Grained Child Harmful Content Detection Through Audio-Visual Alignment with Cascaded Cross-Transformer
topic Audio and Speech Processing
Computer Vision and Pattern Recognition
Multimedia
url https://arxiv.org/abs/2506.03378