Image de couverture de livre

Enhancing Real-World Active Speaker Detection with Multi-Modal Extraction Pre-Training

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Tao, Ruijie, Qian, Xinyuan, Das, Rohan Kumar, Gao, Xiaoxue, Wang, Jiadong, Li, Haizhou
Format:	Preprint
Publié:	2024
Sujets:	Audio and Speech Processing Image and Video Processing
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Listening for "You": Enhancing Speech Image Retrieval via Target Speaker Extraction
par: Yang, Wenhao, et autres
Publié: (2025)

Audio-Visual Target Speaker Extraction with Reverse Selective Auditory Attention
par: Tao, Ruijie, et autres
Publié: (2024)

CoAVT: A Cognition-Inspired Unified Audio-Visual-Text Pre-Training Model for Multimodal Processing
par: Yue, Xianghu, et autres
Publié: (2024)

Audio-Visual Approach For Multimodal Concurrent Speaker Detection
par: Eliav, Amit, et autres
Publié: (2024)

DLIOS: An LLM-Augmented Real-Time Multi-Modal Interactive Enhancement Overlay System for Douyin Live Streaming
par: Wen, Shuide, et autres
Publié: (2026)

KunquDB: An Attempt for Speaker Verification in the Chinese Opera Scenario
par: Zhou, Huali, et autres
Publié: (2024)

Audio-Visual Speaker Diarization: Current Databases, Approaches and Challenges
par: Mingote, Victoria, et autres
Publié: (2024)

BUT System Description for CHiME-9 MCoRec Challenge
par: Klement, Dominik, et autres
Publié: (2026)

Bounds on Agreement between Subjective and Objective Measurements
par: Pieper, Jaden, et autres
Publié: (2026)

USED: Universal Speaker Extraction and Diarization
par: Ao, Junyi, et autres
Publié: (2023)

TACO: Training-free Sound Prompted Segmentation via Semantically Constrained Audio-visual CO-factorization
par: Malard, Hugo, et autres
Publié: (2024)

Towards Language-Independent Face-Voice Association with Multimodal Foundation Models
par: Farhadipour, Aref, et autres
Publié: (2025)

Attentive AV-FusionNet: Audio-Visual Quality Prediction with Hybrid Attention
par: Salaj, Ina, et autres
Publié: (2025)

Interpretable Modeling of Articulatory Temporal Dynamics from real-time MRI for Phoneme Recognition
par: Park, Jay, et autres
Publié: (2025)

Improvement Of Audiovisual Quality Estimation Using A Nonlinear Autoregressive Exogenous Neural Network And Bitstream Parameters
par: Kossi, Koffi, et autres
Publié: (2024)

The role of audio-visual integration in the time course of phonetic encoding in self-supervised speech models
par: Wang, Yi, et autres
Publié: (2025)

Efficient Face Detection with Audio-Based Region Proposals for Human-Robot Interactions
par: Aris, William, et autres
Publié: (2023)

Multimodal sensor fusion for real-time location-dependent defect detection in laser-directed energy deposition
par: Chen, Lequn, et autres
Publié: (2023)

UNQA: Unified No-Reference Quality Assessment for Audio, Image, Video, and Audio-Visual Content
par: Cao, Yuqin, et autres
Publié: (2024)

DHFP-PE: Dual-Precision Hybrid Floating Point Processing Element for AI Acceleration
par: Kumar, Shubham, et autres
Publié: (2026)

Listening without Looking: Modality Bias in Audio-Visual Captioning
par: Ishikawa, Yuchi, et autres
Publié: (2025)

Spoken question answering for visual queries
par: Shabtay, Nimrod, et autres
Publié: (2025)

RestoreGrad: Signal Restoration Using Conditional Denoising Diffusion Models with Jointly Learned Prior
par: Lee, Ching-Hua, et autres
Publié: (2025)

Efficient Test-Time Adaptation through Latent Subspace Coefficients Search
par: Luo, Xinyu, et autres
Publié: (2025)

Beyond Correlation: Evaluating Multimedia Quality Models with the Constrained Concordance Index
par: Ragano, Alessandro, et autres
Publié: (2024)

Bootstrapping Audiovisual Speech Recognition in Zero-AV-Resource Scenarios with Synthetic Visual Data
par: Buitrago, Pol, et autres
Publié: (2026)

A Smart-Glasses for Emergency Medical Services via Multimodal Multitask Learning
par: Jin, Liuyi, et autres
Publié: (2025)

Voice Conversion Augmentation for Speaker Recognition on Defective Datasets
par: Tao, Ruijie, et autres
Publié: (2024)

Learning Video Temporal Dynamics with Cross-Modal Attention for Robust Audio-Visual Speech Recognition
par: Kim, Sungnyun, et autres
Publié: (2024)

LiVeAction: a Lightweight, Versatile, and Asymmetric Neural Codec Design for Real-time Operation
par: Jacobellis, Dan, et autres
Publié: (2026)

Adaptive Multimodal Person Recognition: A Robust Framework for Handling Missing Modalities
par: Farhadipour, Aref, et autres
Publié: (2025)

W4S4: WaLRUS Meets S4 for Long-Range Sequence Modeling
par: Babaei, Hossein, et autres
Publié: (2025)

SoundSil-DS: Deep Denoising and Segmentation of Sound-field Images with Silhouettes
par: Tanigawa, Risako, et autres
Publié: (2024)

A multi-modal approach for identifying schizophrenia using cross-modal attention
par: Premananth, Gowtham, et autres
Publié: (2023)

Multimodal Biomarkers for Schizophrenia: Towards Individual Symptom Severity Estimation
par: Premananth, Gowtham, et autres
Publié: (2025)

Fast Swap-Based Element Selection for Multiplication-Free Dimension Reduction
par: Ono, Nobutaka
Publié: (2026)

Leveraging Reverberation and Visual Depth Cues for Sound Event Localization and Detection with Distance Estimation
par: Berghi, Davide, et autres
Publié: (2024)

Spatial and Semantic Embedding Integration for Stereo Sound Event Localization and Detection in Regular Videos
par: Berghi, Davide, et autres
Publié: (2025)

SaFARi: State-Space Models for Frame-Agnostic Representation
par: Babaei, Hossein, et autres
Publié: (2025)

Multimodal Marvels of Deep Learning in Medical Diagnosis: A Comprehensive Review of COVID-19 Detection
par: Islam, Md Shofiqul, et autres
Publié: (2025)